If it only does it in neutral, though, it might be that your clutch fork is shot or all bent up. The trick here is if it's a small whine/humming when it's in neutral and the clutch is out versus a metallic shhhh type sound.(bearings wearing against each other) If the bearings are shot, the gear lever will also tend to vibrate pretty badly while in gear.
