Aasanstra,
Your divots don't lie. Your playing partners may, but never your divots. Since you know you are from out to in with your path into the ball, first check and see if your takeaway is moving away to the outside or the inside. You can check that by putting a yardstick or string next to your ball on your target line. Be sure you see your club head moving slightly to the inside on the takeaway. Many times pulling iron shots are from an improper sequence of movement back into the ball. The proper sequence from the top of your swing is that your hips and lower body turn before your upper body and your arms. The proper sequencing will put your arms in the correct position to hit the back of the ball and create straighter golf shots.
Let me know how it goes. Good luck and returning to hunting pins with your middle irons!