Stop running it until you check the speaker! This has the 3V board, so it won't have any white battery, it most likely has the blue NiCad battery. That one is well past it's prime being 13 years old, time for a replacement.
FWIW, I doubt the sound issues are the battery, so you need to address those in any case.