Bifrost Guardrails | Enterprise AI Safety & Policy Enforcement

Two-Tier Architecture: Rules + Profiles

Rules decide what to check and when to check it. Profiles decide how to check it and which provider runs the check. Configure both once and apply them anywhere.

• Rules: When to validate. Define validation logic using Common Expression Language (CEL). Rules specify whether to check inputs, outputs, or both, and can reference multiple profiles for defense-in-depth. Example: Apply PII detection + content moderation to customer-facing endpoints.
• Profiles: How to validate. Configure external guardrail providers with credentials, thresholds, and detection parameters. Reusable profiles eliminate redundant configuration across rules. Example: AWS Bedrock profile with high-sensitivity PII detection.

Guardrail Providers

Detection Capabilities

• 50+ PII typesPII leakage prevention. Detect and redact 50+ types of sensitive information including SSNs, credit cards, addresses, medical records, and device identifiers before they reach or leave the model.
• Multi-categoryContent safety filtering. Block or redact hate speech, sexual content, violence, self-harm, and profanity across inputs and outputs. Severity-based thresholds enable fine-grained control.
• Multi-layeredPrompt injection defense. Protect against direct and indirect prompt attacks, jailbreaks, and mutation attempts. Multiple providers offer layered defense against evolving attack vectors.
• Context-awareHallucination detection. Identify when models generate factually incorrect or unsupported information. Patronus AI provides context-aware evaluation for high-stakes applications.
• Copyright detectionProtected material screening. Azure Content Safety detects copyrighted content and protected intellectual property in model outputs, helping organizations avoid legal exposure.
• No-code rulesCustom organizational policies. Define business-specific rules in natural language (GraySwan) or through configuration. Enforce brand safety, regulatory requirements, and internal compliance policies.

Setup Steps

1. 01Configure guardrail providers. Set up guardrail provider profiles through the dashboard or API. Configure credentials, detection thresholds, and category filters for each provider.

   # Via dashboard: Guardrails > Providers
   # Or via config.json
   {
     "guardrail_providers": [{
       "id": "bedrock-prod",
       "type": "aws_bedrock",
       "region": "us-east-1",
       "guardrail_id": "your-guardrail-id",
       "version": "DRAFT"
     }]
   }

2. 02Create validation rules. Define when and how to validate requests using CEL expressions. Rules can apply to specific routes, models, virtual keys, or user attributes.

   # Via dashboard: Guardrails > Configuration
   # Or via config.json
   {
     "guardrail_rules": [{
       "id": "customer-safety",
       "condition": "request.path.startsWith('/v1/chat')",
       "input_profiles": ["bedrock-prod"],
       "output_profiles": ["patronus-ai"],
       "action": "BLOCK"
     }]
   }

3. 03Attach to requests. Apply guardrails via request headers or inline configuration. Bifrost validates inputs before sending to the model and outputs before returning to the client.

   curl https://your-gateway/v1/chat/completions \
     -H "x-bf-guardrail-id: customer-safety" \
     -H "Authorization: Bearer vk-..." \
     -d '{
       "model": "gpt-4",
       "messages": [{"role": "user", "content": "..."}]
     }'

Response Types

• Pass (HTTP 200). Validation succeeded. Request processed normally with detailed guardrail metadata including processing times and rule results.
• Block (HTTP 446). Violations detected and request blocked. Response includes violation details, severity levels, and affected content excerpts for audit trails.
• Warning (HTTP 246). Violations detected but content modified (PII redacted) rather than blocked. Includes redaction counts and modification details.

200

446

246

Enterprise Features

• Sampling control. Apply guardrails to a percentage of requests for performance optimization while maintaining statistical confidence.
• Async processing. Choose synchronous or asynchronous validation modes. Async reduces latency for non-critical checks.
• Defense-in-depth. Link multiple provider profiles to single rules for sequential validation and comprehensive protection.
• Comprehensive logging. Detailed audit trails capture every validation with timestamps, results, and violation details for compliance.
• Timeout configuration. Set maximum execution duration per rule to prevent guardrail latency from impacting user experience.
• Multi-region support. Deploy guardrails across 13 AWS regions. Azure Content Safety profiles can target region-specific endpoints for data residency compliance.

Use Cases

• Healthcare HIPAA compliance. Prevent PHI leakage in patient-facing chatbots. AWS Bedrock detects medical record numbers, health plan IDs, and clinical notes before they leave the model.
• Financial PII protection. Block credit card numbers, SSNs, and account details in banking applications. Multi-provider validation ensures no sensitive data escapes detection.
• Prompt injection defense. Protect against adversarial inputs attempting to override system instructions. GraySwan and Azure Prompt Shield detect mutation attempts and indirect attacks.
• Content moderation for UGC. Filter user-generated content in social platforms. Severity-based thresholds allow nuanced handling of hate speech, violence, and sexual content.
• Hallucination prevention. Validate factual accuracy in high-stakes applications like legal research or medical advice. Patronus AI detects unsupported claims and inconsistencies.
• Brand safety enforcement. Define custom organizational policies in natural language. Ensure model outputs align with brand voice, values, and regulatory requirements.

Compliance Frameworks

Bifrost Guardrails help organizations meet regulatory requirements with automated detection, redaction, and comprehensive audit trails.

• SOC 2 Type II. Comprehensive audit trails and access controls for guardrail enforcement.
• GDPR. Personal data protection and right-to-erasure compliance.
• ISO 27001. Information security management and certification alignment.
• HIPAA. PHI detection and redaction for healthcare applications.

Open Source & Enterprise

FAQ

Related resources

• [Source: Guardrails]
• [Docs: Bifrost docs]
• [GitHub: maximhq/bifrost]
• [Pricing: Bifrost pricing]
• [Enterprise: Bifrost enterprise]
• [Book a Demo: Bifrost demo]
• [Resources: Bifrost resources]