[ BIFROST BLOG ]

Latest Updates & Tutorials

Insights, integration guides, and updates from the Bifrost team.

Multimodal embeddings in Bifrost: Embed images, audio, video and PDFs through a single API

Bifrost's /v1/embeddings API can now embed images, audio, video and PDFs, and Bifrost translates each request into the format of the model serving it. Engineering teams use Bifrost as a single Gateway for their model traffic. Their text embedding calls already go through one /v1/embeddings API, with the same keys and governance irrespective of the provider being called. But what happens when the content you need to search isn't text, such as product photos or recorded support calls? Gemini Em

Nov 13, 2026•Samyabrata Maji

Sign-in with ChatGPT for Codex, routed through Bifrost: Keep your ChatGPT seats with Gateway governance

Bifrost can already help route Codex traffic through the Gateway with a virtual key and a provider key. With v2.4.0, developers can now stay signed in to Codex with their ChatGPT accounts, on the seats your company already pays for, but their model requests will go through Bifrost for centralised governance and observability. Platform and security admins use Bifrost to ensure model traffic goes through a single control plane, where they can decide which models each user or team can use and how

Nov 12, 2026•Suresh Chaudhary

Introducing View as User: See what any user sees, without a test account

With Bifrost Enterprise v2.4.0, admins can now view the dashboard as any user in a read-only mode, and check how access settings apply for their users. Setting up Bifrost for an enterprise means deciding, in several places, what each employee or user can access. A role decides the pages they can view and the actions they can take, and can carry access profiles with it. A data access scope limits which logs, keys and users they see. Access profiles grant models, MCP tools and budgets, and issue

Nov 11, 2026•Suresh Chaudhary

Features

Introducing Relays: Put any HTTP API behind the Gateway

An AI agent rarely runs on model calls alone. For example, consider an invoice agent your finance team runs behind Bifrost. Your sellers use a helper agent to access this invoice agent and it receives each invoice through the Agent Gateway, reads the PDF with a document API, asks an LLM for the vendor and the total, and looks the vendor up in the ERP through an MCP tool. Today, Bifrost governs and logs three of those four calls - but the document API sits outside it, with its own key, its own p

Nov 10, 2026•Anuj Parihar

Engineering

Claude Fable 5.2 is now available on Bifrost

Anthropic just released Claude Fable 5.2, and Bifrost supports it from day one. It costs 20% less than Fable 5.1, does more at lower effort levels, and writes clearer reports after long agent runs. If you already route Claude through Bifrost, change one model string to anthropic/claude-fable-5-2. Your routing rules, fallbacks, virtual keys, budgets, guardrails and logs keep working as they are. Why Fable 5.2 Anthropic positions Fable 5.2 as a cheaper, sharper Fable 5.1 for agentic work. Per

Nov 09, 2026•Akshay Deo

Debunking Litellm Rust benchmarking: Part 1

LiteLLM says its new Rust gateway has about 7x lower overhead, 9x less memory and about 4.5x more requests per dollar than Bifrost. We checked those claims against their website, their blog post and the CSV and JSON files in their own ai-gateway-bench repo (2026-11-01). * This post covers their benchmark only. * In Part 2 we will run the same benchmarks with full disclosure and a like-for-like setup. * LiteLLM’s Rust port is still a partial migration. As checked on November 1, 2026, GitHub’s

Nov 01, 2026•Akshay Deo

AI Gateway

Bifrost CLI v1.0: One launcher to connect your coding agents to the Gateway and manage Bifrost

Bifrost CLI already enabled developers to launch coding agents such as Claude Code, Codex and OpenCode through Bifrost. With v1.0, developers can now choose which gateway instance to connect to, sign in with SSO or a virtual key, and manage the Gateway from the same terminal. A gateway can only govern the traffic that reaches it. That sounds obvious, but it became a real problem as coding agents moved into the terminal. Developers were using Claude Code, Codex CLI, Gemini CLI and OpenCode, oft

Oct 28, 2026•Raggav Subramani

GPT-6.1 Terra is now available on Birost

OpenAI released GPT-6.1 Terra today, and you can call it through Bifrost right now. Change one model string. Your routing, fallbacks, budgets, guardrails and logs keep working as they are. Terra is OpenAI's new fast, low-cost model for computer use, visual reasoning and everyday writing. It costs half as much as GPT-6.1 Sol and, by OpenAI's numbers, matches GPT-6 Astra on agent benchmarks at a tenth of the price. Why Terra Terra is built for high-volume agentic work where cost and latency ma

Oct 26, 2026•Akshay Deo

Run guardrails on LLM and MCP traffic in the order you choose

Picture an enterprise organization that uses an AI agent to draft replies to support tickets. The tickets come straight from customers, so they contain whatever information customers share. Some customers may include full account numbers. Other customers may ask whether they should move their savings into a particular fund, which perhaps the compliance team does not want an AI answering. With Guardrails in Bifrost, the platform team can enforce multiple guardrail profiles with varying rules on

Oct 22, 2026•Madhu Shantan

A Closer Look at Bifrost Adaptive Routing: How It Works, and What You Can Now See

Adaptive routing has kept LLM traffic on healthy providers and keys for over a year. Here's how it works, and what it now shows you: what it observed, what it did, and when you need to step in. Every team that puts an LLM in front of users learns the same lesson quickly: your product is only as reliable as the provider serving the model, and providers have bad days. They go down, slow to a crawl, rate limit you in the middle of a launch, run your account out of credit, retire the model you depe

Oct 22, 2026•Pratham Mishra

Say hello to the Home page: Your AI usage at a glance, with built-in budget approvals

Bifrost already offers built-in observability. Yet for a user, to figure out “how much have I spent this week?” or "what models can I use?" involves navigating different sections of the Bifrost dashboard. Some admins even built their own custom applications using Bifrost APIs just to give their users/employees this view. With Bifrost Enterprise v2.3.0, this view comes out-of-the-box. Users now land on a Home page that displays their own usage, keys and access the moment they sign in. Meet th

Oct 21, 2026•Suresh Chaudhary

Introducing Agent Gateway in Bifrost: One gateway for models, tools and agents

An agent hands work to another agent. That agent calls a model, uses a few tools, and sends back a result. Now you need to understand what happened - Who started the request? Should they have been able to call that agent? What did it send back? Which model and tool calls went into the answer? Each service might have its own logs. Following the work across all of them is where things get tedious. Agent Gateway brings A2A agent calls into Bifrost, alongside your model and MCP tool calls. You get

Oct 20, 2026•Dhwanil Pithva