I tried holding one with pliers and just using the X-acto to chisel the base off, and quickly realized that wasn't going to work for me. Putting the figure in the vise worked great and I quickly polished off the rest of the removals.
These are so cool I sat down and formatted another order, they'll be a nice variety of figures for the layout.