It turns out I didn't pay attention when I hooked up the tie rod and drag link on the passenger side arm. I had them in the wrong holes.
Once I got them in the right holes and re did the alignment everything was good. It also explained why one tire was always turing more than the other one and screeching while turning and going around corners.