I get it. My first job in federal LE was doing internal security investigations within Treasury after a stint of close to a year of undercover work. It had many of the same sorts of oversight obligations of an IG with more hands on investigating and field work in a variety of arenas. Still, I soon despaired and became somewhat claustrophobic in that environment and directed my sights toward sunnier shores...literally as it turned out.
They weren't the kind of agency to (ordinarily) force transfer unless you sought promotion to supervisory levels. Then you might need to go to a satellite office or HQ.