Yes get rid of the 4" Bl, I don't believe anybody makes anything bigger than 3" so the one you have is likely one of those backyard builds that should never be used on a rig.
What size tires are on it? You can get a combo of 4"(if needed) using other/better ways of lifting a vehicle to clear larger tires and not have the shifter problems.
