Security & reliability · Concept

Reward hacking

Optimize a reward signal in a way that defeats its intended purpose.

Related terms

Prompt injection · Indirect prompt injection · Jailbreak

Primary references

Reference definition