Meta: Llama 3.1 405B Instruct

Detailed specifications for implementing Meta: Llama 3.1 405B Instruct in your RAG applications.

Model Overview

Released:July 23, 2024

Introducing the highly anticipated Llama3 400B class, a groundbreaking advancement in open-source large language models (LLMs) from Meta AI. With an impressive 128k context window and exceptional evaluation scores, this model sets a new standard for performance and versatility.

The Llama 3.1 series offers a range of model sizes and configurations, with the 405B instruct-tuned variant specifically optimized for high-quality dialogue applications. In rigorous evaluations, it has demonstrated competitive performance against top-tier closed-source models, including GPT-4o and Claude 3.5 Sonnet, solidifying its position as a leader in the field.

For more details on this exciting release, visit the official announcement. Please note that usage of this model is governed by Meta's Acceptable Use Policy.

Architecture

Modality
text->text
Tokenizer
Llama3

Pricing

OperationRate
Prompt0.0000008
Completion0.0000008
Image0
Request0

Provider Details

Context Length
32,768 tokens
Max Completion
4,096 tokens
Moderation
Not Enabled

Ready to implement Meta: Llama 3.1 405B Instruct?

Start building powerful RAG applications with our flexible pricing plans and developer-friendly API.