I began with felt and have enjoyed it over the years. Lately, I have been upgrading with ballasting my tracks and open areas. I left the felt on and it covered nicely and blends well.
I would encourage you to put a layer of masonite or foam underneath the felt.