I dont know if its more fragile, but I think additional damage or irritation is more noticeable. I've had serious tinnitus since the 70's. Its really annoying most of the time. I got used to it as best I can, and try to always use some ear pro even when using power tools. I carry foam plugs in the pocket at all times, and wont take a shot hunting without using ear plugs. No game animal is worth losing any more hearing over.
I'm not going to stop shooting, but I do tend to avoid things that seem louder or sharper to me. 16" AR's seem louder, so I have a 20". 357's in any barrel length are really sharp and loud, I'd rather shoot a 44 mag just from a muzzle blast standpoint. Some like the flashbang effect, but when I'm about to shoot anything really sharp or loud, I cringe, and it always hurts instantly and I say lots of bad words. The auditory exclusion thing has so far pretty well passed me by. Now, theres very few things that I shoot that are really sharp, or situations where I'm willing to shoot without plugs in.
Some of this, you just have to figure it out as you go. Good luck with it. Its annoying, but not the end of the world.