--- title: "Bifrost for AWS Bedrock | Enterprise AI Gateway with Governance & Guardrails" description: "Add governance, guardrails, multi-region failover, and cost controls to AWS Bedrock. Bifrost is the enterprise AI gateway with native Bedrock SDK compatibility. Zero code changes." url: "https://www.getmaxim.ai/bifrost/resources/aws-bedrock" markdown: "https://www.getmaxim.ai/bifrost/resources/aws-bedrock.md" --- # Bifrost for AWS Bedrock | Enterprise AI Gateway with Governance & Guardrails > Add governance, guardrails, multi-region failover, and cost controls to AWS Bedrock. Bifrost is the enterprise AI gateway with native Bedrock SDK compatibility. Zero code changes. ## Important Links - [View MCP Gateway](https://www.getmaxim.ai/bifrost/resources/mcp-gateway.md) - [Features](https://www.getmaxim.ai/bifrost/#features) - [Enterprise](https://www.getmaxim.ai/bifrost/enterprise) - [Pricing](https://www.getmaxim.ai/bifrost/pricing.md) - [Docs](https://docs.getbifrost.ai) - [GitHub](https://github.com/maximhq/bifrost) - [Book a Demo](https://www.getmaxim.ai/bifrost/book-a-demo) ## Performance at a Glance - **11µs Internal Overhead.** Ultra-low latency at high throughput - **5,000 req/s Throughput.** Sustained with 100% success rate - **0 Code Changes.** Native Bedrock SDK drop-in - **1000+ Models Supported.** Multi-provider escape hatch ## Arch Cards - **Your Applications:** Existing boto3 Bedrock clients; Converse API and Invoke API calls; streaming and batch workloads; SDK-compatible endpoint configuration - **Bifrost Gateway:** Governance and budget enforcement; Bedrock Guardrails integration; Multi-region routing and failover; Observability and audit logs ## Core Capabilities - **Zero code changes - Native Bedrock SDK Drop-in:** Point boto3 at Bifrost's /bedrock endpoint. Converse, Invoke, and streaming just work. IAM role auth supported. - **99.99% uptime - Multi-Region Failover:** Set up weighted routing across Bedrock regions. When us-east-1 throttles, Bifrost shifts traffic to us-west-2. Add Anthropic or OpenAI as a fallback tier. - **Gateway-level enforcement - Bedrock Guardrails Enforcement:** Attach Bedrock Guardrail ARNs at the gateway level. Layer with Azure Content Safety or Patronus AI for defense-in-depth. - **Real-time enforcement - Per-Team Budget Controls:** Virtual keys give every team, project, or environment its own spending cap, rate limit, and model allowlist, all enforced before requests reach Bedrock. - **Full data isolation - In-VPC Deployment:** Bifrost runs entirely inside your AWS VPC. API keys stay in Secrets Manager with automatic sync and zero-downtime rotation. - **Built-in tracing - Full Request Observability:** Every request logged with prompt/response metadata, latency, tokens, cost, and guardrail actions. Built-in dashboard, OpenTelemetry, Datadog, or BigQuery. ## Setup Steps 1. **01 - Deploy Bifrost.** Run Bifrost inside your VPC with Docker or Kubernetes. Zero configuration needed to start. ### Deploy Bifrost ``` # pull and start bifrost docker pull maximhq/bifrost docker run -p 8080:8080 maximhq/bifrost ``` 2. **02 - Configure Bedrock Provider.** Add your Bedrock regions and IAM credentials in the Bifrost config. Supports multiple regions with weighted routing. ### Configure Bedrock Provider ``` # config.json - Bedrock provider # region: us-east-1, weight: 1.0 # arn: inference-profile ARN # models: claude-3-sonnet, etc. ``` 3. **03 - Update endpoint_url.** Point your existing boto3 client at Bifrost. One line change. Your Converse and Invoke API calls work as-is. ### Update endpoint_url ``` # Python - one line change # endpoint_url="http://bifrost:8080/bedrock" # that's it - boto3 just works ``` ## Guardrail Features - **PII Detection:** Connect your existing Bedrock Guardrail ARN for automatic PII filtering across all requests. - **Content Filtering:** Block harmful outputs across all teams and models at the gateway level. - **Prompt Injection Prevention:** Real-time input validation before requests reach Bedrock. - **Image Scanning:** PNG and JPEG content scanning through Bedrock Guardrails. - **Defense-in-Depth:** Stack Bedrock + Azure Content Safety + Patronus AI for layered protection. - **Usage Metrics:** Detailed guardrail invocation metrics for cost tracking and monitoring. ## Comparison Rows | Capability | Native | Bifrost | | --- | --- | --- | | Multi-region failover | CRI profiles | Automatic with health monitoring | | Cross-provider fallback | Not available | 20+ providers as escape hatch | | Per-team budget caps | IAM-based, no real-time limits | Virtual keys with real-time enforcement | | Guardrails enforcement | Native | Gateway-level, global enforcement | | Semantic caching | Not available | Built-in, configurable per key | | Request observability | CloudWatch logs | Full tracing, OTEL, Datadog, BigQuery | | MCP tool governance | Not available | Per-key filtering with audit trails | | API key rotation | Manual | Auto via Secrets Manager sync | | Added latency | - | 11µs | ## Security Cards - **VPC Isolation:** Full In-VPC deployment with private networking and zero external data exposure. - **AWS Secrets Manager:** Native integration with automatic key sync and zero-downtime rotation. - **Vault Support:** Also works with HashiCorp Vault, Google Secret Manager, and Azure Key Vault. - **Immutable Audit Trails:** Every request logged for SOC 2 Type II, GDPR, HIPAA, and ISO 27001 compliance. - **RBAC:** OpenID Connect integration with user-level governance and team sync. - **Log Exports:** Automated export to S3, data lakes, or your SIEM. ## Use Cases - **Multi-team AI platform:** Central platform team deploys Bifrost as the AI gateway. Each product team gets a virtual key with independent budgets, model allowlists, and guardrail policies. - **Cross-region resilience:** Production agents route through Bifrost with Bedrock us-east-1 as primary and us-west-2 as fallback. If the primary throttles, Bifrost switches automatically. Anthropic Direct serves as a third-tier escape hatch. - **Regulated industry compliance:** Healthcare or financial services teams needing HIPAA/SOC 2 Type II for all AI interactions. Bifrost deploys in-VPC, enforces Bedrock Guardrails for PII detection, logs immutable audit trails, and exports to SIEM. - **Cost optimization at scale:** Customer support agents on Bedrock with semantic caching for repetitive queries. Similar questions return cached responses instantly, cutting token spend. Per-team budgets prevent overspend. - **MCP tool governance:** Bifrost centralizes MCP tool access with per-key filtering and audit trails. Code Mode cuts token usage by 50% by orchestrating tools via Python. - **Multi-provider flexibility:** Start on Bedrock for compliance, but route specific workloads to OpenAI for cost or Groq for speed. Your application code never changes when you add providers. ## Why Teams Choose Bifrost for Bedrock - **11µs overhead at 5,000 requests per second:** - **Native Bedrock SDK compatibility (Converse + Invoke API):** - **Zero code changes, one endpoint_url update:** - **In-VPC deployment with AWS Secrets Manager integration:** - **Bedrock Guardrails enforced globally at the gateway:** - **Multi-region failover with adaptive load balancing:** - **Per-team budgets, rate limits, and model allowlists:** - **Complete audit trails with OpenTelemetry and Datadog/BigQuery export:** - **Open source (Apache 2.0) with enterprise support:** - **Go-native with zero Python GIL bottleneck:** ## Compliance Badges - **Audited quarterly - SOC 2 Type II:** - **EU data residency - GDPR:** - **BAA available - HIPAA:** - **Certified - ISO 27001:** ## Features ### OSS Features - **01 - Model Catalog:** Access 8+ providers and 1000+ AI models through a unified interface. Also supports custom deployed models. - **02 - Budgeting:** Set spending limits and track costs across teams, projects, and models. - **03 - Provider Fallback:** Automatic failover between providers ensures 99.99% uptime for your applications. - **04 - MCP Gateway:** Centralize all MCP tool connections, governance, security, and auth. Your AI can safely use MCP tools with centralized policy enforcement. [MCP Gateway resource](https://www.getmaxim.ai/bifrost/resources/mcp-gateway.md). - **05 - Virtual Key Management:** Create different virtual keys for different use cases with independent budgets and access control. - **06 - Unified Interface:** One consistent API for all providers. Switch models without changing code. - **07 - Drop-in Replacement:** Replace your existing SDK with just one line change. Compatible with OpenAI, Anthropic, LiteLLM, Google GenAI, LangChain, and more. [Drop-in replacement docs](https://docs.getbifrost.ai/features/drop-in-replacement). - **08 - Built-in Observability:** Out-of-the-box OpenTelemetry support. Built-in dashboard for quick visibility without complex setup. - **09 - Community Support:** Active Discord community with responsive support and regular updates. ### Enterprise Features - **01 - Governance:** SAML support for SSO and role-based access control with policy enforcement for team collaboration. [Governance resource](https://www.getmaxim.ai/bifrost/resources/governance.md). - **02 - Adaptive Load Balancing:** Automatically optimizes traffic distribution across provider keys and models based on real-time performance metrics. - **03 - Cluster Mode:** High availability deployment with automatic failover and load balancing. Peer-to-peer clustering where every instance is equal. - **04 - Alerts:** Real-time notifications for budget limits, failures, and performance issues on Email, Slack, PagerDuty, Teams, Webhook, and more. - **05 - Log Exports:** Export and analyze request logs, traces, and telemetry data from Bifrost with enterprise-grade data export for compliance, monitoring, and analytics. - **06 - Audit Logs:** Comprehensive logging and audit trails for compliance and debugging. - **07 - Vault Support:** Secure API key management with HashiCorp Vault, AWS Secrets Manager, Google Secret Manager, and Azure Key Vault integration. - **08 - VPC Deployment:** Deploy Bifrost within your private cloud infrastructure with VPC isolation, custom networking, and enhanced security controls. [Enterprise deployment resource](https://www.getmaxim.ai/bifrost/resources/enterprise-deployment.md). - **09 - Guardrails:** Automatically detect and block unsafe model outputs with real-time policy enforcement and content moderation across all agents. [Guardrails resource](https://www.getmaxim.ai/bifrost/resources/guardrails.md). ## FAQ ### Do I need to change my application code? No. Point your boto3 client's endpoint_url to Bifrost. Your existing Bedrock SDK code works as-is. No SDK swap, no API format changes. ### Does Bifrost support IAM role authentication? Yes. When both access_key and secret_key are empty, Bifrost automatically uses the IAM role attached to the host. No credentials need to be exposed. ### Can I use my existing Bedrock Guardrails? Yes. Bifrost integrates directly with your Bedrock Guardrail ARNs. Enforce them globally at the gateway without per-request application code. ### How much latency does Bifrost add? Bifrost reports 11 microseconds of gateway overhead per request at 5,000 RPS on a t3.xlarge benchmark. Read the benchmark page for test conditions. [Bifrost benchmarks](https://www.getmaxim.ai/bifrost/resources/benchmarks.md). ### Where does Bifrost deploy? Inside your VPC, next to your Bedrock endpoints. Supports Kubernetes, Docker, and direct binary deployment. No data leaves your private network. ### Can I fall back to non-Bedrock providers? Yes. Configure fallback chains like Bedrock us-east-1 → Bedrock us-west-2 → Anthropic Direct → OpenAI. Your applications never go down even if an entire region is unavailable. ### How does Bifrost handle API key rotation? Native AWS Secrets Manager integration with periodic sync. Keys rotate with zero downtime. Also supports HashiCorp Vault, Google Secret Manager, and Azure Key Vault. ### Is Bifrost open source? Yes. Bifrost is Apache 2.0 open source. Commercial enterprise features include guardrails, adaptive load balancing, clustering, in-VPC deployments, and audit logs. [Bifrost enterprise](https://www.getmaxim.ai/bifrost/enterprise). ## Related Resources - [Source: AWS Bedrock](https://www.getmaxim.ai/bifrost/resources/aws-bedrock.md) - [Docs: Bifrost docs](https://docs.getbifrost.ai) - [GitHub: maximhq/bifrost](https://github.com/maximhq/bifrost) - [Pricing: Bifrost pricing](https://www.getmaxim.ai/bifrost/pricing.md) - [Enterprise: Bifrost enterprise](https://www.getmaxim.ai/bifrost/enterprise) - [Book a Demo: Bifrost demo](https://www.getmaxim.ai/bifrost/book-a-demo) - [Resources: Bifrost resources](https://www.getmaxim.ai/bifrost/resources.md) --- *This is a markdown version of [https://www.getmaxim.ai/bifrost/resources/aws-bedrock](https://www.getmaxim.ai/bifrost/resources/aws-bedrock) for AI/LLM consumption.*