Try Bifrost Enterprise free for 14 days.
Request access

[ Provider Guide ]

ElevenLabs Provider on Bifrost

ElevenLabs provides advanced text-to-speech (TTS) and speech-to-text (STT) capabilities with voice control, diarization, and multiple output formats.

ElevenLabs provider summary

ElevenLabs is an audio-focused provider supporting text-to-speech (TTS) with streaming, speech-to-text (STT) with diarization, timestamp support, voice configuration (stability, similarity boost), and multiple output formats (MP3, Opus, WAV/PCM).

PropertyDetails
DescriptionAudio-focused provider: TTS with voice control, STT with diarization.
Provider routeelevenlabs/<voice_id>
Supported operationsTTS (streaming), STT (diarization), List Models

Supported operations

Speech (TTS)

Streaming and non-streaming via /v1/text-to-speech/{voice_id}. Timestamp support via /v1/text-to-speech/{voice_id}/with-timestamps

Transcriptions (STT)

Non-streaming via /v1/speech-to-text. Diarization, word/character timestamps, audio event tagging supported.

List Models

Via /v1/models endpoint. Returns available models with language support and capabilities.

Key features

  • • Voice configuration: stability, similarity boost, speaker boost
  • • Multiple output formats: MP3, Opus, WAV/PCM
  • • STT with speaker identification and diarization
  • • Timestamp support for detailed temporal information
  • • Custom pronunciation dictionaries for accurate transcription

References

[ BIFROST FEATURES ]

Open Source & Enterprise

Everything you need to run AI in production, from free open source to enterprise-grade features.

01 Governance

SAML support for SSO and Role-based access control and policy enforcement for team collaboration.

02 Adaptive Load Balancing

Automatically optimizes traffic distribution across provider keys and models based on real-time performance metrics.

03 Cluster Mode

High availability deployment with automatic failover and load balancing. Peer-to-peer clustering where every instance is equal.

04 Alerts

Real-time notifications for budget limits, failures, and performance issues on Email, Slack, PagerDuty, Teams, Webhook and more.

05 Log Exports

Export and analyze request logs, traces, and telemetry data from Bifrost with enterprise-grade data export capabilities for compliance, monitoring, and analytics.

06 Audit Logs

Comprehensive logging and audit trails for compliance and debugging.

07 Vault Support

Secure API key management with HashiCorp Vault, AWS Secrets Manager, Google Secret Manager, and Azure Key Vault integration.

08 VPC Deployment

Deploy Bifrost within your private cloud infrastructure with VPC isolation, custom networking, and enhanced security controls.

09 Guardrails

Automatically detect and block unsafe model outputs with real-time policy enforcement and content moderation across all agents.

[ SHIP RELIABLE AI ]

Try Bifrost Enterprise with a 14-day Free Trial

[quick setup]

Drop-in replacement for any AI SDK

Change just one line of code. Works with OpenAI, Anthropic, Vercel AI SDK, LangChain, and more.

1import os
2from anthropic import Anthropic
3
4anthropic = Anthropic(
5 api_key=os.environ.get("ANTHROPIC_API_KEY"),
6 base_url="https://<bifrost_url>/anthropic",
7)
8
9message = anthropic.messages.create(
10 model="claude-3-5-sonnet-20241022",
11 max_tokens=1024,
12 messages=[
13 {"role": "user", "content": "Hello, Claude"}
14 ]
15)
Drop in once, run everywhere.