I use a Dremel and reinforced cutoff wheel for cutting GG/Ross, a "floppy Dremel sandpaper wheel" (not sure of the real name) for general burr cleanup and, if needed, a quick in-and-out of the "hole" using a round miniature file. It goes pretty quickly. You may also be over-cleaning the stuff. It looks worse from 2 inches away than when on the layout - it really isn't a "fine cabinet".
Don't forget the safety goggles.
