I also once operated in HO and still do in N. Trust me. While a little N scale locomotive weighing less than one pound and costing $100 to $200 won’t like a drop to the floor, a 10- to 15-pound O gauge locomotive costing $300 to $1,500 will like it a lot less, as would you.
Don’t run the track too close to the edges without adequate protection.