Bifrost resources library

Resources

• [Performance] [Performance Benchmarks]. Live comparisons, latency metrics, and throughput data that show why Bifrost is the fastest LLM gateway.
• [Guide] [LLM Gateway Buyer's Guide]. A comprehensive comparison of leading AI gateway platforms, capabilities, and trade-offs.
• [Integration] [Claude Code Integration]. Enterprise controls for Claude Code with multi-provider routing, governance, and observability.
• [CLI Agents] [CLI Coding Agents]. Enterprise controls for Claude Code, Codex CLI, Gemini CLI, and OpenCode with unified governance and multi-provider access.
• [CLI Tool] [Bifrost CLI]. Interactive terminal tool to launch Claude Code and coding agents through Bifrost with automatic configuration and MCP integration.
• [MCP] [MCP Gateway]. High-performance tool execution for AI agents with explicit approvals and full audit trails.
• [Access Control] [Governance]. Virtual keys, budgets, rate limits, routing, MCP tool filtering, and enterprise RBAC with SSO for Okta and Microsoft Entra.
• [Security] [Guardrails]. Real-time LLM validation with PII detection, content moderation, prompt injection defense, and multi-provider compliance.
• [Migration] [Migrating from LiteLLM]. Step-by-step guide to move LiteLLM-compatible SDK traffic through Bifrost with no application code changes.
• [Alternative] [LiteLLM Alternative]. Comparison page covering gateway performance, deployment, observability, and governance differences with LiteLLM.
• [Free OSS] [OSS for Startups]. Open source LLM gateway with failover, caching, and 20+ providers. Apache 2.0, free for startups and SMEs.
• [Scalability] [Enterprise Gateway for Scalability]. Scale AI workloads with model routing, circuit breaker, semantic caching, cost analytics, RBAC, guardrails, in-VPC deployment, and MCP gateway.
• [Deployment] [Enterprise Deployment]. Deploy Bifrost in your VPC, on-premise, air-gapped, or multi-cloud with Terraform, Helm, and zero data egress.
• [Integration] [AWS Bedrock + Bifrost]. Enterprise governance, guardrails, and multi-region failover for AWS Bedrock with native SDK compatibility.

Open Source & Enterprise

Drop-in replacement for compatible AI SDKs

Change one line of code to point compatible SDKs at Bifrost. Works with OpenAI, Anthropic, LiteLLM, Google GenAI, LangChain, and Vercel AI SDK. [Gateway setup docs] [Drop-in replacement docs]

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ.get("OPENAI_API_KEY"),
    base_url="https://<bifrost_url>/openai",
)

response = client.chat.completions.create(
    model="gpt-4o",
    messages=[{"role": "user", "content": "Hello!"}],
)

import os
from anthropic import Anthropic

anthropic = Anthropic(
    api_key=os.environ.get("ANTHROPIC_API_KEY"),
    base_url="https://<bifrost_url>/anthropic",
)

message = anthropic.messages.create(
    model="claude-3-5-sonnet-20241022",
    max_tokens=1024,
    messages=[{"role": "user", "content": "Hello, Claude"}],
)

import litellm

# Set the base URL to your Bifrost deployment
litellm.api_base = "https://<bifrost_url>"

response = litellm.completion(
    model="gpt-4o",
    messages=[{"role": "user", "content": "Hello!"}],
)

import google.generativeai as genai

genai.configure(
    api_key="YOUR_API_KEY",
    transport="rest",
    client_options={"api_endpoint": "<bifrost_url>/google"},
)

model = genai.GenerativeModel("gemini-pro")
response = model.generate_content("Hello!")

• Point the SDK base URL at your Bifrost deployment.
• Keep API keys in your environment or secret manager.
• See the docs for provider-specific configuration and deployment steps.

Trust

• Open Source. Bifrost is open source under the Apache 2.0 License. [GitHub]
• Publisher. Bifrost is published by H3 Labs Inc. and Maxim AI.
• Compliance. The site references SOC 2 Type II, GDPR, HIPAA, and ISO 27001 signals. [Enterprise deployment]
• Deployment. Enterprise resources cover VPC, on-premise, air-gapped, and multi-cloud use. [Enterprise deployment]

FAQ

Related resources

• [Docs: Bifrost docs]
• [GitHub: maximhq/bifrost]
• [Pricing: Bifrost pricing]
• [Enterprise: Bifrost enterprise]
• [Book a Demo: Bifrost demo]
• [Resources: Bifrost resources]