That's my approach as well.
My other concession to reality is I only shoot from AIWB concealed, which excludes me from IDPA and forces me into IPSC Limited.
While this might cost me .5 on a stage or two, it's not a big enough disadvantage that I'm going to change my holster or carry position.
I can think of a whole lot of other areas to shave 2 seconds over the course of a match.