[ BIFROST BLOG ]

Latest Updates & Tutorials

Insights, integration guides, and updates from the Bifrost team.

Debunking Litellm Rust benchmarking - Part 1

LiteLLM says its new Rust gateway has about 7x lower overhead, 9x less memory and about 4.5x more requests per dollar than Bifrost. We checked those claims against their website, their blog post and the CSV and JSON files in their own ai-gateway-bench repo (2026-11-01). * This post covers their benchmark only. * In Part 2 we will run the same benchmarks with full disclosure and a like-for-like setup. * LiteLLM’s Rust port is still a partial migration. As checked on November 1, 2026, GitHub’s

Nov 01, 2026•Akshay Deo

Bifrost CLI v1.0: One launcher to connect your coding agents to the Gateway and manage Bifrost

Bifrost CLI already enabled developers to launch coding agents such as Claude Code, Codex and OpenCode through Bifrost. With v1.0, developers can now choose which gateway instance to connect to, sign in with SSO or a virtual key, and manage the Gateway from the same terminal. A gateway can only govern the traffic that reaches it. That sounds obvious, but it became a real problem as coding agents moved into the terminal. Developers were using Claude Code, Codex CLI, Gemini CLI and OpenCode, oft

Oct 28, 2026•Raggav Subramani

GPT-6.1 Terra is now available on Birost

OpenAI released GPT-6.1 Terra today, and you can call it through Bifrost right now. Change one model string. Your routing, fallbacks, budgets, guardrails and logs keep working as they are. Terra is OpenAI's new fast, low-cost model for computer use, visual reasoning and everyday writing. It costs half as much as GPT-6.1 Sol and, by OpenAI's numbers, matches GPT-6 Astra on agent benchmarks at a tenth of the price. Why Terra Terra is built for high-volume agentic work where cost and latency ma

Oct 26, 2026•Akshay Deo

Run guardrails on LLM and MCP traffic in the order you choose

Picture an enterprise organization that uses an AI agent to draft replies to support tickets. The tickets come straight from customers, so they contain whatever information customers share. Some customers may include full account numbers. Other customers may ask whether they should move their savings into a particular fund, which perhaps the compliance team does not want an AI answering. With Guardrails in Bifrost, the platform team can enforce multiple guardrail profiles with varying rules on

Oct 22, 2026•Madhu Shantan

A Closer Look at Bifrost Adaptive Routing: How It Works, and What You Can Now See

Adaptive routing has kept LLM traffic on healthy providers and keys for over a year. Here's how it works, and what it now shows you: what it observed, what it did, and when you need to step in. Every team that puts an LLM in front of users learns the same lesson quickly: your product is only as reliable as the provider serving the model, and providers have bad days. They go down, slow to a crawl, rate limit you in the middle of a launch, run your account out of credit, retire the model you depe

Oct 22, 2026•Pratham Mishra

Say hello to the Home page: Your AI usage at a glance, with built-in budget approvals

Bifrost already offers built-in observability. Yet for a user, to figure out “how much have I spent this week?” or "what models can I use?" involves navigating different sections of the Bifrost dashboard. Some admins even built their own custom applications using Bifrost APIs just to give their users/employees this view. With Bifrost Enterprise v2.3.0, this view comes out-of-the-box. Users now land on a Home page that displays their own usage, keys and access the moment they sign in. Meet th

Oct 21, 2026•Suresh Chaudhary

Introducing Agent Gateway in Bifrost: One gateway for models, tools and agents

An agent hands work to another agent. That agent calls a model, uses a few tools, and sends back a result. Now you need to understand what happened - Who started the request? Should they have been able to call that agent? What did it send back? Which model and tool calls went into the answer? Each service might have its own logs. Following the work across all of them is where things get tedious. Agent Gateway brings A2A agent calls into Bifrost, alongside your model and MCP tool calls. You get

Oct 20, 2026•Dhwanil Pithva

Governance that follows your org structure: Access Profiles for teams, business units and customers

AI budgets are now planned the same way the company plans traditional budgets: per team, per department, per customer account. Individual user limits alone aren't enough when you need to control spending and model access across the organization. With Bifrost Enterprise v2.3.0, Access Profiles can now be attached to entities - teams, business units, and customers - not just individual users. This lets you define policies at the entity level, enforce shared budgets, and keep access controls alig

Oct 19, 2026•Anuj Parihar

Cloudflare Workers AI Is Now a Built-In Provider in Bifrost

Cloudflare Workers AI is now available as a first class provider directly in Bifrost. Add your Cloudflare credentials, choose a Workers AI model, and send requests through the same payload you use for your other providers. Setup starts with selecting Cloudflare in the dashboard. Configure an account ID on each key, then use Workers AI for chat, embeddings, or native Clef decisions. The integration connects Bifrost to Workers AI, Cloudflare’s model inference service. What you can use today T

Oct 16, 2026•Madhu Shantan

Bifrost's /v1/decisions: one API for decision models across eight providers

Bifrost added /v1/decisions with TypeSafe's Jev in September. With v2.3.1, the same endpoint now serves decision models from eight providers, plus any self-hosted decision model you add as a custom provider. Decision models score defined outcomes and return probabilities directly, rather than generating free form text like language models. Following TypeSafe's release of Jev, enterprises are adopting them for content classification, request routing, and anomaly detection. Native decision model

Oct 16, 2026•Madhu Shantan

Meet Warp: An agent for your gateway's telemetry

Warp is a new agent built into the Bifrost dashboard. You ask it a question about your gateway traffic in plain English. It answers by running queries against your log store, not by guessing. Getting answers out of your LLM logs Every request through Bifrost is logged with its provider, model, tokens, cost, latency, status, virtual key and full message content. That data already holds the answers to most questions about your LLM usage. But each question takes its own path through the dashboa

Oct 15, 2026•Vrinda Kohli

Benchmarking Bifrost's upgraded Complexity Router

Bifrost’s Complexity Router sends each request to the model it needs, so your frontier model only handles the work that actually needs it. Since v2.0, you choose how incoming requests get classified into complexity tiers: a semantic classifier that matches requests against phrases you define, or a decision model such as Typesafe’s Jev (added in v2.3.0) that judges each request against tier definitions you can edit. We benchmarked both approaches against sending every request to Claude Opus 5.5.

Oct 14, 2026•Reehan