What Chuck said … his advice on the use of a 3-prong adapter and ground wire got some of my balky and phantom switches working fine.
Before re-connecting the manual controller, I think you can also try placing your hand over the switch and using the remote. If it works, seems like it would likely be a ground plane issue.