Yes! I knew I saw someone else try this before, but I couldn’t remember what thread.
It’s a shame this doesn’t seem more a commonplace practice. Searching “IWB Speedloader” ends up with an old RevolverGuy.com article about a never-produced product and basically nothing else. Carrying a decent speedloader in an concealable, accessible manner can be done comfortably.