If you plan to keep the Colt and don't view it as an investment to be sold later, then begin grinding. I suggest that you leave the back of the hammer somewhat rounded instead of flat. By leaving this part rounded, there remains a small hump increasing mass when compared to a flat back area. My unsubstantiated opinion is that this practice may prevent light strikes.