Obscured glass also obscures your sight picture. With a long gun, you can have offset irons that don't require you to look through the glass. With a handgun, that's not an option. There's also no quick disconnect to ditch the glass if you need to.
Now, of course we can get into odds/stakes, etc but that's still my biggest concern with optics on a handgun.