If they seem to want to come out when shooting, go ahead and use purple (the weakest flavor). If they stay in acceptably well, no Loctite is better for serviceability.
I'm not trained as a gunsmith, but I have a little experience making machines work better. My thinking on internal work is that shiny isn't the goal. Removing lumps, bumps, burrs and sharp edges that shouldn't be there and that cause unevenness is the goal, with a reasonably smooth surface left behind. Felt doesn't flatten lumps, it just makes them shiny. Stones enable the removal of high points and leveling of a surface with a minimum amount of material removed.