Have you tried Eveready or Ray-O-vac batteries? Stay away from store brand batteries as you don't know who makes them.
I too have some trouble with Duracell leaking but never popping their top.
FYI; I have heard bad reports about the re-cycled Energizer a.k.a. re-cycled Bunny batteries, mainly they don't hold a charge that long or fail quickly.
Lee Fritz