Just a thought, it's probably something else in your suspension such as tie rod ends. When I had my MR2 it was a little like that, nothing major, but I suspect if I had have let the problem develop it would be giving symptoms like your describing. Check that all your components are straight, or bent where they're supposed to be too.