If the fan is blowing out any vents it is fine, you said you didnt hear it in the middle (edit: im assuming you meant you couldn't hear it in the middle vent but the others you could). There is just the one fan.
Your problem sounds like either a linkage problem or a diverter door. Does it switch at all with the lever, to defrost or anything?