YIKES! Don't put it across the power supply, you'll simply have a firecracker!
Yes, it does matter which polarity! It goes in series with the power supply lead. If you put it in the positive side, put the anode (no stripe) pointing toward the power supply and the cathode (stripe) point toward the load.