I go for realism and just leave most of the rust. I remove rust on the top of the rails with fine sand paper to improve operation. A piece of new track would stick out with my 1950s toy train layout built with used track and switches. After all real railroad tracks are rusty except for the top where the train wheel run for active tracks.
Charlie