[Synchro909]

While what ChicagoBob says is right, if the king pin bushes are too tight, the car will wander as well.
Something that hasn't been mentioned yet but I think is worth mentioning if you are new to driving a Model A! What was the road surface you were driving on like? If there are longitudinal ridges or ruts in the surface, the type of tyres on these cars will follow the rut/groove until you steer out of it, then the car will dart off in the direction you steered. That's just the way it is with what you guys call "Bias Tires". A set of radial ply tyres will fix in immediately, assuming all else is OK.