About Guardrails#
NeMo Guardrails provides configurable safety checks that evaluate user inputs and model outputs before responses are returned to your application. This section explains how Guardrails is wired into the request flow, how configurations are defined, and how inference requests are executed.
The Guardrails system consists of three core areas:
Architecture: How NeMo Guardrails sits between your app and models, and how requests flow through safety checks.
Configurations: How guardrail configs define which checks run and which models perform them.
Inference: How to call guardrails endpoints and customize behavior at request time.
Core Concepts#
Understand the Guardrails request flow and model routing.
Learn how guardrail configs define rails, models, and prompts.
Run guardrails checks and configure request behavior.
Run guardrails inference and configure request behavior.