MaziyarPanahi / llama-3.1 family / text-generation
llama-3.1-405b-instruct
meta/llama-3.1-405b-instruct
Run locally Smallest indexed GGUF / needs Ollama
ollama run hf.co/meta/llama-3.1-405b-instruct/Meta-Llama-3.1-405B-Instruct.Q2_K.gguf-00001-of-00009.gguf Benchmarks
Where it scores.
General Provisional
50.7
Coding Provisional
50.7
Math Provisional
50.7
Reasoning Provisional
50.7
Normalized 0–100 across indexed models.
Runnable variants
Pick a size.
| Precision | Format | Size | Params | File |
|---|---|---|---|---|
| Q2_K / smallest | GGUF | 151.2 GB | — | Meta-Llama-3.1-405B-Instruct.Q2_K.gguf-00001-of-00009.gguf |
| Q3_K_S | GGUF | 177.1 GB | — | Meta-Llama-3.1-405B-Instruct.Q3_K_S.gguf-00001-of-00009.gguf |
Sizes are file sizes, not peak runtime memory.
Raw benchmarks
The inputs.
| Source | Task | Raw | Normalized |
|---|---|---|---|
| ZeroEval | GPQA | 50.7 | 50.7 |
From the Hugging Face model card
About this model.
From the Hugging Face model card