Just unbolt it next time out, takes about 15 minutes, tie strap the sway bar out of the way and drive around. Then decide. You can make a pretty cheap "quick disconnnects " if you find you like the streetability more with the bar.
I didn't notice any difference in my rig, so I took the entire thing out. (solid axle) I'm still the "quickest" in the turns in my group.