That's the exact reason I pulled away from being a primarily 1911 shooter.
For me, I feel it was the different holster locations and index coming out of the holster. If I went and practiced a bunch OWB for gaming, I'd continually grip too high on the safety when dry firing at the house from AIWB concealment.