I live in Oregon, and working on my layout is definitely a winter activity - so much to do outside in the summer keeping up two houses on 2 acres. As a friend once told me, "There is a reason train rhymes with rain" for us west coasters.
I too have come to the conclusion that, building the layout, dealing with the various challenges and design decisions, is more fulfilling for me than actually running trains around the loop.