I removed the flywheel altogether. I put a hose from the motor shaft, over a smaller hose piece on it, and connected it to a piece of square plastic stock filed down slid into the U-joint. It was real quiet apart on the bench at slow speeds.
How was it at high speeds in this configuration? If just as noisy at high speeds without flywheel or plastic cup, then I get to eat crow.