I had tried that before posting, I got the pins in but have to say in all the videos I watched there was no issue in any of them with them lining up so I had to try somethings, below was the solution that allowed me to get the pins in.
I got the pins in what I did for anyone with this issue is...