You're limp-wristing it or you put it together wrong. Only possibilities, as anything else wouldn't be Perfection.
At least with Glock, the roll mark makes it plain. Now why it's so difficult to sell "M" guns to the masses is a question I'm not competent to answer, but there's no secret that M guns are different then 5 guns. With the P320, there's no such model differentiation. Additionally, parts wearing faster then expected and impacting accuracy sucks, but it doesn't suck as much as shooting yourself in the dick with a dropped gun that the company insists is drop safe. Even when it's shot other people in the general groinal region.