All good ideas. You do know you do not have to whack it like you were driving a nail? Try "taptaptap". Or get one of those good "General" spring-loaded center punches, back the cap all the way off, and hold it in place with your finger for a very small dimple. A #56 drill does not need much of a dimple.
Also use cutting fluid, once you get the drill started. If you use a jig, start out with cutting fluid.