Yes, too small, as 1:64 is S scale. S is between O and HO; kind of wee.
BUT - having said that, when kept at the back of a scene, 1:64 will work as it can enhance the forced perspective thing (as part of the scene; can't do it alone). Keep them away from the O-scale (true and 1:43) stuff and the front of the layout.