I bought a smoking caboose once that had gotten hot on one side but not very noticeable. Think I paid $10 or 15 for it. I only switch it on for running.
So, in the spirit of paranoia, I lined the walls and floor of the caboose with sheet copper from an old processor heatsink. Just in case I forget to turn the switch off.