I had a similiar issue when I installed my 2003 2rz. I can't remember the exact RPM but it would not idle down, it also sounded like it was sucking alot of air. The problem was the idle air control valve was stuck. After taking it apart to unstick it and clean it up, it idle perfect. Good luck
Mine sounds the same way. Where is the idle ait control valve on the motor?