Calculate the cost of using Llama-3.1-8B-Instruct from Wandb for your AI applications
Pricing data last updated:
Mode: Chat
Max: 128,000 tokens
Max: 128,000 tokens
Built for enterprise-grade reliability, governance, and scale. Deploy in seconds.
Llama-3.1-8B-Instruct is a chat model from Wandb, one of 16 chat models they offer. It is priced at $0.22 per 1M input tokens and $0.22 per 1M output tokens, ranking 743 out of 2292 chat models by cost and cheaper than 67% of models in this category. It accepts up to 128K input tokens.
Note: Use the interactive calculator above to estimate costs for your specific usage patterns.
Use the maximum token limits shown above to understand the model's capacity. This model can handle up to 128,000 input tokens. The maximum output length is 128,000 tokens.
At $0.22 per 1M input tokens and $0.22 per 1M output tokens, Llama-3.1-8B-Instruct ranks 743 out of 2292 chat models by input cost. It is more affordable compared to the median of $0.55 for chat models, and is cheaper than 67% of models in this category.
| Model | Provider | Input / 1M tokens | Output / 1M tokens | vs Llama-3.1-8B-Instruct |
|---|---|---|---|---|
| ai21.jamba-1-5-mini-v1:0 | AWS Bedrock | $0.20 | $0.40 | -9% |
| anthropic.claude-3-haiku-20240307-v1:0 | AWS Bedrock | $0.25 | $1.25 | +14% |
| Llama-2-13b-chat-hf | Anyscale | $0.25 | $0.25 | +14% |
Similar chat models from other providers
No. Llama-3.1-8B-Instruct costs $0.22 per 1M input tokens while ai21.jamba-1-5-mini-v1:0 costs $0.20 per 1M input tokens, making ai21.jamba-1-5-mini-v1:0 9% more affordable for input. However, Llama-3.1-8B-Instruct may offer different capabilities or performance characteristics that justify the price difference.
Llama-3.1-8B-Instruct input pricing is $0.22 per 1M tokens, which is 60% below the median of $0.55 for chat models. It ranks 743 out of 2292 chat models by input cost, making it cheaper than 67% of models in this category. For output, it costs $0.22 per 1M tokens compared to the median of $1.50.
Among Wandb's 16 chat models, Llama-3.1-8B-Instruct ranks 10 by input cost.
The most comparable chat models to Llama-3.1-8B-Instruct are: ai21.jamba-1-5-mini-v1:0 from AWS Bedrock ($0.20/1M input tokens); anthropic.claude-3-haiku-20240307-v1:0 from AWS Bedrock ($0.25/1M input tokens); Llama-2-13b-chat-hf from Anyscale ($0.25/1M input tokens); apac.anthropic.claude-3-haiku-20240307-v1:0 from AWS Bedrock ($0.25/1M input tokens). These alternatives were selected based on similar capabilities, pricing, and provider diversity. You can compare any of these models in detail using the Bifrost Model Library.
Llama-3.1-8B-Instruct is priced based on input and output tokens. Use the interactive calculator at the top of this page to estimate costs for your specific workload. Enter your expected input and output tokens volume and the calculator will show the total cost breakdown. For reference, processing 1M input tokens costs $0.22 and generating 1M output tokens costs $0.22.
