Try wrapping a bit of rubber(ie a bit of old inner tube) around the shaft and using a pair of multigrips or vice grips to hold it. It shouldnt really knock unless the nut isnt done up properly or the bearing has flogged out. In which case I dont think a washer will really help.