Meta: Llama 3.1 405B Instruct
Detailed specifications for implementing Meta: Llama 3.1 405B Instruct in your RAG applications.
Model Overview
Released:July 23, 2024
Introducing the highly anticipated Llama3 400B class, a groundbreaking advancement in open-source large language models (LLMs) from Meta AI. With an impressive 128k context window and exceptional evaluation scores, this model sets a new standard for performance and versatility.
The Llama 3.1 series offers a range of model sizes and configurations, with the 405B instruct-tuned variant specifically optimized for high-quality dialogue applications. In rigorous evaluations, it has demonstrated competitive performance against top-tier closed-source models, including GPT-4o and Claude 3.5 Sonnet, solidifying its position as a leader in the field.
For more details on this exciting release, visit the official announcement. Please note that usage of this model is governed by Meta's Acceptable Use Policy.
Architecture
- Modality
- text->text
- Tokenizer
- Llama3
Pricing
Operation | Rate |
---|---|
Prompt | 0.0000008 |
Completion | 0.0000008 |
Image | 0 |
Request | 0 |
Provider Details
- Context Length
- 32,768 tokens
- Max Completion
- 4,096 tokens
- Moderation
- Not Enabled
Ready to implement Meta: Llama 3.1 405B Instruct?
Start building powerful RAG applications with our flexible pricing plans and developer-friendly API.