AI Vocabulary · 05 Agents
What is Guardrails?
Checks and limits built around an AI system to block unwanted inputs, outputs or actions before they cause harm.
Guardrails are safety rails placed around an AI system rather than inside the model. They can filter what goes in (for example blocking personal data or suspicious instructions), check what comes out (for example blocking made-up prices or off-topic answers), and limit actions (for example a spending cap or a list of allowed recipients).
Some guardrails are simple rules, others use a second AI model to judge the first. None are perfect: they reduce risk from things like prompt injection or data leakage, but don't remove it.
Why it matters for you
Customer-facing AI without guardrails is a reputational risk: one screenshot of a bot promising a refund it can't give or saying something offensive can travel fast. Guardrails make AI predictable enough to put in front of customers.
Own it
Define your own red lines, such as topics, data and actions that are off-limits, and turn them into guardrails and tests. Combine them with permissions, evals and human oversight rather than relying on any one layer.
Where it comes from
The word comes from the barriers along roads and bridges. In AI it became a technical term in 2023, when tools appeared for adding programmable rules around chatbots, such as NVIDIA's open-source NeMo Guardrails, released in April 2023 (SiliconANGLE). Today "guardrails" covers any rule or check that keeps an AI system on course.
Related
Your AI Learning Hub
Learn the whole AI Vocabulary, step by step, and build with it. Build it. Own it.