Model-Based Soft Maximization of Suitable Metrics of Long-Term Human Power

Power is a key concept in AI safety. This talk explores promoting safety and wellbeing by forcing AI agents to explicitly empower humans, using a principled approach to design a parameterizable objective function representing long-term aggregate of human power.