Meta: Llama 3.1 70B Instruct

Detailed specifications for implementing Meta: Llama 3.1 70B Instruct in your RAG applications.

Model Overview

Released:July 23, 2024

Meta has unveiled its latest model series, Llama 3.1, offering a range of sizes and configurations. Among these, the 70B instruct-tuned version stands out, specifically optimized for delivering high-quality dialogue interactions.

In human evaluations, this model has shown impressive performance, rivaling leading closed-source alternatives.

For more details on the Llama 3.1 release, visit the official blog. Usage of this model is governed by Meta's Acceptable Use Policy.

Architecture

Modality
text->text
Tokenizer
Llama3

Pricing

OperationRate
Prompt0.00000012
Completion0.0000003
Image0
Request0

Provider Details

Context Length
131,072 tokens
Max Completion
4,096 tokens
Moderation
Not Enabled

Ready to implement Meta: Llama 3.1 70B Instruct?

Start building powerful RAG applications with our flexible pricing plans and developer-friendly API.