Open-source Python framework from deepset for building RAG pipelines, AI agents and multimodal apps from modular components.

Prediction Guard
Self-hosted control plane that governs AI agent actions with runtime controls, a supply chain registry and audit logs.
What is Prediction Guard?
Prediction Guard is a control plane for organizations that run fleets of AI agents and need to decide what each agent may do. It sits between applications and the model, tool and compute layers, registering each agent with an identity and role, limiting access to approved models and MCP servers, and checking every input, output and action against policy. If a check fails, the caller receives a policy violation and the action is blocked, and the site cites under 200ms of control overhead per request. Further capabilities include PII masking, prompt injection and toxicity checks, human-in-the-loop approval, kill switches and quarantine, an immutable audit log, SIEM streaming to tools such as Datadog and Splunk, an exportable AIBOM, and the no-code Agent Forge builder. It exposes OpenAI and Anthropic compatible APIs and deploys in your own cloud, on-prem, hybrid or air-gapped. Pricing is through AWS and Azure Marketplace listings or custom Enterprise agreements.
Use cases
- Govern what AI agents can access
- Block out-of-policy agent actions
- Mask PII in model inputs and outputs
- Audit every agent and model call
- Set API key rate limits and quotas
- Stream AI security events to a SIEM
- Build no-code agents with controls
- Align agent controls with NIST and OWASP
Who it's for
Why use Prediction Guard
- Applies one set of controls across models, tools and agents instead of stitching together separate services.
- Stops out-of-scope actions before they run and records each decision for audit.
- Data and policy decisions stay inside your trust boundary, including air-gapped setups.
- Existing OpenAI or Anthropic SDK code works against the compatible endpoint.
- Buying through AWS or Azure Marketplace can use cloud spend you have already committed.
Prediction Guard features
- Self-hosted control plane in your own cloud account
- OpenAI and Anthropic compatible API
- Registry covering the models, tools and MCP servers in your agents' supply chain
- Input and output controls with PII masking
- Prompt injection and toxicity checks
- Runtime controls scoped per API key
- Human-in-the-loop approval, kill switches and quarantine
- Immutable audit log and usage telemetry
- SIEM and OTel integration
- Exportable AIBOM and compliance evidence
- Agent Forge no-code agent builder
- Air-gapped and single-tenant options on Enterprise
Prediction Guard integrations
How to get started with Prediction Guard
- Deploy the control plane in your cloud account, on-prem or air-gapped environment.
- Connect cloud model endpoints, self-hosted models and MCP tool servers to the registry.
- Register agents with identities and roles, and create API keys with rate limits and quotas.
- Point your SDK at the compatible endpoint so input, output and tool calls are checked.
- Review the audit log and stream events to your SIEM, intervening with approvals or kill switches when needed.
Prediction Guard limitations
- Marketplace rates are shown on each AWS or Azure listing rather than on the site
- SSO, SAML, air-gapped deployment and a contracted SLA are Enterprise only
- You deploy and run the control plane in your own environment
Prediction Guard pricing
Prediction Guard is sold on custom quotes, so its prices aren't published.
Prediction Guard plans
Prediction Guard
Price on vendor site
billed through AWS or Azure Marketplace
- Self-hosted control plane
- OpenAI and Anthropic compatible API
- Agent supply chain registry
- PII masking and injection checks
- Immutable audit log
- Agent Forge
- Email support
Prediction Guard Enterprise
Custom
annual agreements, volume pricing
- Volume pricing across teams
- Air-gapped and single-tenant options
- SSO, SAML and RBAC
- Exportable AIBOM
- Dedicated solutions engineer
- Priority support with SLA
Plans as listed on the official pricing page on . Prices can change and may vary by country or exclude tax. Check the official pricing page.
Prediction Guard alternatives
The main Prediction Guard alternatives listed on Debuly are Portkey, LiteLLM, Credo AI, Kong AI Gateway, IronCurtain and BlackVault. The table compares pricing and platforms; order is A–Z.
| Tool | Pricing | Starting price | Platforms |
|---|---|---|---|
| Prediction Guard | Contact sales | — | Self-hosted, API, Kubernetes, AWS Marketplace |
| BlackVault | Open source | — | Web, API, Self-hosted |
| Credo AI | Contact sales | — | Web, API |
| IronCurtain | Open source | — | CLI, Self-hosted |
| Kong AI Gateway | Contact sales | — | Web, API, Self-hosted |
| LiteLLM | Open source | — | Python, API, Self-hosted, CLI |
| Portkey | Freemium | $49/mo | Web, API, Self-hosted |

BlackVault
Open-source credential firewall for AI agents that swaps real API keys for scoped proxy tokens with budgets, rate limits and a kill switch.
Open sourceVisit BlackVault (official site)
Credo AI
Enterprise AI governance platform for discovering AI systems, assessing risk, enforcing policy and producing compliance evidence.
Contact salesVisit Credo AI (official site)IronCurtain
Open-source runtime that limits what AI agents can do, using security policy compiled from a plain-English constitution.
Open sourceVisit IronCurtain (official site)
Kong AI Gateway
Gateway and control layer for LLM, MCP and agent traffic, with usage metering, billing and cost limits built in.
Contact salesVisit Kong AI Gateway (official site)LiteLLM
Open-source AI gateway and Python SDK that gives one OpenAI-format API to 100+ LLM providers, with keys, budgets and cost tracking.
Open sourceVisit LiteLLM (official site)
Portkey
AI gateway with observability, guardrails, caching and prompt management for teams running LLM apps in production.
FreemiumVisit Portkey (official site)
Prediction Guard FAQ
How much does Prediction Guard cost?
The site does not publish a price. The standard offering is billed through AWS or Azure Marketplace at the rates on each listing, and Enterprise uses custom annual or volume pricing.
What plans does Prediction Guard have?
There are two ways to buy: the standard Prediction Guard product through a cloud marketplace, and Prediction Guard Enterprise with volume pricing, SSO, SAML, air-gapped deployment and priority support.
Is there a free plan for Prediction Guard?
The pricing page does not list a free plan. You can book a demo or review the marketplace listings.
Does Prediction Guard have an API?
Yes. It offers OpenAI and Anthropic compatible APIs, so existing SDK code can point to your control plane.
Where does Prediction Guard run?
It deploys on-prem, in your cloud account, in hybrid setups or air-gapped, and is described as Kubernetes-native.
What are alternatives to Prediction Guard?
Related options include Portkey, LiteLLM, Lakera, Protect AI and NVIDIA NeMo Guardrails.
Sources & verification
Facts on this page come from the official sources below, each with the date we read it. Written by Debuly; the vendor did not review this page.
| Source | Type | Accessed |
|---|---|---|
| predictionguard.com/ | official | |
| predictionguard.com/pricing | pricing | |
| predictionguard.com/platform-engineers | official | |
| predictionguard.com/product-overview | official | |
| frontend.predictionguard.com/ | official |
Image credits
- Logo: from predictionguard.com · fetched · Vendor trademark, used only to identify the product; removed on request
- Cover: none collected yet, so a generated tile is shown.
Spot an error? Report an issue with this listing. We also remove a logo or image on the owner's request.




