Reward tampering

An extreme form of specification gaming in which the agent not only exploits flaws in the reward function but directly modifies its own evaluation mechanism—for example, an LLM-as-a-Judge—to inflate the reward. It is more dangerous than reward hacking because it destroys the very measure of success. Described in a paper by Anthropic (Denison et al., 2024).