There's usually a groove in the wheel where the tire is suppose to sit, check to make sure each tire is sitting in the groove.
I had an engine I replaced the tires on and the replacement tires were wider than the groove, thus not sitting down. The engine kept derailing until I turned it over, and while running, trimmed the tires using a razor blade. Once I got them to fit in the grooves all derailments ceased.