Look at this from a cruising speed perspective. 3000 RPM's on the freeway = 70mph.
2rz makes 63hp 110ft lbs
3rz makes 74hp 130ft lbs
then toss on some headers and a cam and away you go.
once you get dual cases and 4.7's you wont really notice anything, but driving at speed you will. Put it this way, with the 3RZ you'll better off for mud, sand & snow. And you cant tell me that you never feel the urge to hit the gas when you're headed back to base camp. Suck it up and wait. Do it once and get what you really want.