Much of my adult life I worked in in a relatively small industry - demolition, and abatement of hazardous materials (asbestos, lead, etc.) in a small state Hawaii. I had an excellent relationship with all of the State and county officials responsible for regulating our industry, and knew almost all of the people at various contractors would subcontract our company. I primarily worked with family owned companies. I got constantly recruited by larger corporate entities but always said no.
I made less than I would have at larger companies, but had almost complete control of my time. I enjoyed that type of environment after having spent eight years in the Army. There are always tradeoffs working for family owned companies. At the last company I worked at I got along incredibly well with the owner, but clashed with his daughter. I told him once I charge you this much to work for you, if part of my duties are listening to your daughter be abrasive are part of that we are going to need add $10,000+ to my salary, I won't do it without charging you. He talked to his daughter.
Working at an institution where I would have no leverage, no matter the prestige or the compensation sounds absolutely horrific. I'm retired now and somewhat gladly, though I've seem to fill that retirement with as much or more activity than I had when I was employed.