deepseek-ai / deepseek-v3 family / text-generation

DeepSeek-V3.2

deepseek-ai/DeepSeek-V3.2

mit SAFETENSORS + GGUF 685.4B params 164K context Updated 01 Dec 2025
Run locally Smallest indexed GGUF / needs Ollama
ollama run hf.co/deepseek-ai/DeepSeek-V3.2/IQ1_S_S/DeepSeek-V3.2-REAP-345B-A37B-IQ1_S_S-00001-of-00236.gguf
General
82.8
Coding
73.8
Math
76.8
Reasoning
69.7

Normalized 0–100 across indexed models.

PrecisionFormatSizeParamsFile
FP16 / smallestSAFETENSORS7.4 GB—model-00001-of-00002.safetensors
FP16SAFETENSORS17.0 GB—model-00001.safetensors
IQ1_S_SGGUF85.7 GB—IQ1_S_S/DeepSeek-V3.2-REAP-345B-A37B-IQ1_S_S-00001-of-00236.gguf
IQ1_S_LGGUF99.7 GB—IQ1_S_L/DeepSeek-V3.2-REAP-345B-A37B-IQ1_S_L-00001-of-00236.gguf
IQ1_M_LGGUF101.3 GB—IQ1_M_L/DeepSeek-V3.2-REAP-345B-A37B-IQ1_M_L-00001-of-00236.gguf
Q2_KGGUF123.2 GB—Q2_K/DeepSeek-V3.2-REAP-345B-A37B-Q2_K-00001-of-00236.gguf
Q4GGUF161.3 GB—DeepSeek-V3.2-UD-TQ1_0.gguf
IQ1_SGGUF184.1 GB—UD-IQ1_S/DeepSeek-V3.2-UD-IQ1_S-00001-of-00004.gguf
IQ1_MGGUF199.3 GB—UD-IQ1_M/DeepSeek-V3.2-UD-IQ1_M-00001-of-00005.gguf
IQ2_XXSGGUF217.1 GB—UD-IQ2_XXS/DeepSeek-V3.2-UD-IQ2_XXS-00001-of-00005.gguf
IQ2_MGGUF228.1 GB—UD-IQ2_M/DeepSeek-V3.2-UD-IQ2_M-00001-of-00005.gguf
Q2_KGGUF245.4 GB—Q2_K/DeepSeek-V3.2-Q2_K-00001-of-00005.gguf
Q2_K_LGGUF245.6 GB—Q2_K_L/DeepSeek-V3.2-Q2_K_L-00001-of-00005.gguf
Q2_K_XLGGUF246.6 GB—UD-Q2_K_XL/DeepSeek-V3.2-UD-Q2_K_XL-00001-of-00006.gguf
IQ3_XXSGGUF273.1 GB—UD-IQ3_XXS/DeepSeek-V3.2-UD-IQ3_XXS-00001-of-00006.gguf
Q3_K_SGGUF290.4 GB—Q3_K_S/DeepSeek-V3.2-Q3_K_S-00001-of-00006.gguf
Q3_K_MGGUF320.2 GB—Q3_K_M/DeepSeek-V3.2-Q3_K_M-00001-of-00007.gguf
Q3_K_XLGGUF321.0 GB—UD-Q3_K_XL/DeepSeek-V3.2-UD-Q3_K_XL-00001-of-00007.gguf
FP16SAFETENSORS346.9 GB—model-00001-of-00065.safetensors
IQ4_XSGGUF358.3 GB—IQ4_XS/DeepSeek-V3.2-IQ4_XS-00001-of-00008.gguf
FP16SAFETENSORS361.9 GB—model-00001-of-00121.safetensors
FP16SAFETENSORS376.3 GB—model-00001-of-00086.safetensors
IQ4_NLGGUF379.1 GB—IQ4_NL/DeepSeek-V3.2-IQ4_NL-00001-of-00008.gguf
Q4_0GGUF380.1 GB—Q4_0/DeepSeek-V3.2-Q4_0-00001-of-00008.gguf
Q4_K_SGGUF381.1 GB—Q4_K_S/DeepSeek-V3.2-Q4_K_S-00001-of-00008.gguf
FP16SAFETENSORS386.2 GB—model-00001-of-00078.safetensors
FP16SAFETENSORS404.8 GB—model-00001-of-000163.safetensors
Q4_K_MGGUF405.4 GB—Q4_K_M/DeepSeek-V3.2-Q4_K_M-00001-of-00009.gguf
Q4_K_XLGGUF407.8 GB—UD-Q4_K_XL/DeepSeek-V3.2-UD-Q4_K_XL-00001-of-00009.gguf
Q4_1GGUF420.8 GB—Q4_1/DeepSeek-V3.2-Q4_1-00001-of-00009.gguf
FP16SAFETENSORS462.1 GB—model-00001-of-00088.safetensors
Q5_K_SGGUF462.6 GB—Q5_K_S/DeepSeek-V3.2-Q5_K_S-00001-of-00010.gguf
Q5_K_MGGUF476.2 GB—Q5_K_M/DeepSeek-V3.2-Q5_K_M-00001-of-00010.gguf
Q5_K_XLGGUF481.9 GB—UD-Q5_K_XL/DeepSeek-V3.2-UD-Q5_K_XL-00001-of-00010.gguf
FP16SAFETENSORS510.4 GB—model-00001-of-00096.safetensors
Q6_KGGUF551.3 GB—Q6_K/DeepSeek-V3.2-Q6_K-00001-of-00012.gguf
Q6_K_XLGGUF574.0 GB—UD-Q6_K_XL/DeepSeek-V3.2-UD-Q6_K_XL-00001-of-00012.gguf
FP16SAFETENSORS689.5 GB—model-00001-of-000163.safetensors
FP16SAFETENSORS689.7 GB—model-00001-of-000163.safetensors
Q8_0GGUF713.3 GB—Q8_0/DeepSeek-V3.2-Q8_0-00001-of-00015.gguf
Q8_K_XLGGUF780.2 GB—UD-Q8_K_XL/DeepSeek-V3.2-UD-Q8_K_XL-00001-of-00017.gguf
BF16GGUF1342.3 GB—BF16/DeepSeek-V3.2-BF16-00001-of-00030.gguf

Sizes are file sizes, not peak runtime memory.

SourceTaskRawNormalized
ArenaArenaScore1424.690.6
ZeroEvalAIME202593.193.1
ZeroEvalGPQA82.482.4
ZeroEvalHLE40.840.8
ZeroEvalSWEBenchVerified73.173.1

From the Hugging Face model card

About this model.

DeepSeek-V3.2: Efficient Reasoning & Agentic AI

DeepSeek-V3
Homepage Chat Hugging Face Discord Wechat Twitter Follow License

Technical Report👁️

Introduction

We introduce DeepSeek-V3.2, a model that harmonizes high computational efficiency with superior reasoning and agent performance. Our approach is built upon three key technical breakthroughs:

  1. DeepSeek Sparse Attention (DSA): We introduce DSA, an efficient attention mechanism that substantially reduces computational complexity while preserving model performance, specifically optimized for long-context scenarios.
  2. Scalable Reinforcement Learning Framework: By implementing a robust RL protocol and scaling post-training compute, DeepSeek-V3.2 performs comparably to GPT-5. Notably, our high-compute variant, DeepSeek-V3.2-Speciale, surpasses GPT-5 and exhibits reasoning proficiency on par with Gemini-3.0-Pro.
    • Achievement: 🥇 Gold-medal performance in the 2025 International Mathematical Olympiad (IMO) and International Olympiad in Informatics (IOI).
  3. Large-Scale Agentic Task Synthesis Pipeline: To integrate reasoning into tool-use scenarios, we developed a novel synthesis pipeline that systematically generates training data at scale. This facilitates scalable agentic post-training, improving compliance and generalization in complex interactive environments.

We have also released the final submissions for IOI 2025, ICPC World Finals, IMO 2025 and CMO 2025, which were selected based on our designed pipeline. These materials are provided for the community to conduct secondary verification. The files can be accessed at assets/olympiad_cases.

Chat Template

DeepSeek-V3.2 introduces significant updates to its chat template compared to prior versions. The primary changes involve a revised format for tool calling and the introduction of a "thinking with tools" capability.

To assist the community in understanding and adapting to this new template, we have provided a dedicated encoding folder, which contains Python scripts and test cases demonstrating how to encode messages in OpenAI-compatible format into input strings for the model and how to parse the model's text output.

A brief example is illustrated below:

import transformers
# encoding/encoding_dsv32.py
from encoding_dsv32 import encode_messages, parse_message_from_completion_text

tokenizer = transformers.AutoTokenizer.from_pretrained("deepseek-ai/DeepSeek-V3.2")

messages = [
    {"role": "user", "content": "hello"},
    {"role": "assistant", "content": "Hello! I am DeepSeek.", "reasoning_content": "thinking..."},
    {"role": "user", "content": "1+1=?"}
]
encode_config = dict(thinking_mode="thinking", drop_thinking=True, add_default_bos_token=True)

# messages -> string
prompt = encode_messages(messages, **encode_config)
# Output: "<|begin▁of▁sentence|><|User|>hello<|Assistant|></think>Hello! I am DeepSeek.<|end▁of▁sentence|><|User|>1+1=?<|Assistant|><think>"

# string -> tokens
tokens = tokenizer.encode(prompt)
# Output: [0, 128803, 33310, 128804, 128799, 19923, 3, 342, 1030, 22651, 4374, 1465, 16, 1, 128803, 19, 13, 19, 127252, 128804, 128798]

Important Notes:

  1. This release does not include a Jinja-format chat template. Please refer to the Python code mentioned above.
  2. The output parsing function included in the code is designed to handle well-formatted strings only. It does not attempt to correct or recover from malformed output that the model might occasionally generate. It is not suitable for production use without robust error handling.
  3. A new role named developer has been introduced in the chat template. This role is dedicated exclusively to search agent scenarios and is designated for no other tasks. The official API does not accept messages assigned to developer.

How to Run Locally

The model structure of DeepSeek-V3.2 and DeepSeek-V3.2-Speciale are the same as DeepSeek-V3.2-Exp. Please visit DeepSeek-V3.2-Exp repo for more information about running this model locally.

Usage Recommendations:

  1. For local deployment, we recommend setting the sampling parameters to temperature = 1.0, top_p = 0.95.
  2. Please note that the DeepSeek-V3.2-Speciale variant is designed exclusively for deep reasoning tasks and does not support the tool-calling functionality.

License

This repository and the model weights are licensed under the MIT License.

Citation

@misc{deepseekai2025deepseekv32,
      title={DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models}, 
      author={DeepSeek-AI},
      year={2025},
}

Contact

If you have any questions, please raise an issue or contact us at service@deepseek.com.