So here's what I'm thinking, with A being my axle position in stock trim and B being the position once I added the lift putting my alignment in a different position and creating my wobble. Once I added the lift to the rear it put the axle back into specs and the wobble went away. So hopefully once I add the SAS spring hanger to the front it will move the angle back to A, at least that's the plan.
I rotate my tires at regular intervals but only front to rear and rear to front since they are directional and it never changed the wobble.