Yes, it is a big consideration!
At my age it is a problem that I have yet to solve. I have a very nice plan that encompasses everything that I would want in a layout. Yet, how do I design it in a manner in which it can be easily taken down if I have to downsize to another dwelling or when I croak? Right now the only solution seems to be a compromise to something on a much smaller scale than what I really want to achieve.