Glossary
Effective challenge
Critical analysis of a model by objective, informed people who can identify its limits and get changes made.
Effective challenge is a principle of the US Federal Reserve guidance SR 11-7 (2011) on model risk, which SR 26-2 replaced in 2026. It means critical review of a model by objective, informed parties who can identify its limitations and assumptions and have the standing to make changes happen.
Three things make it work: competence, independence from the builder, and influence over the outcome.
Example: a rule is built by one person and reviewed by another, who checks the data, reruns the code and writes down what could make the result fail. A review by the builder alone is not effective challenge.