01-ai / yi-1.5 family / text-generation

Yi-1.5-34B-32K

01-ai/Yi-1.5-34B-32K

apache-2.0 SAFETENSORS 34.4B params Provisional scores Updated 26 Jun 2024
General Provisional
—
Coding Provisional
—
Math Provisional
—
Reasoning Provisional
—

Normalized 0–100 across indexed models.

PrecisionFormatSizeParamsFile
FP16 / smallestSAFETENSORS1.2 GB—model-00015-of-00015.safetensors
FP16SAFETENSORS4.8 GB—model-00002-of-00015.safetensors
FP16SAFETENSORS4.8 GB—model-00004-of-00015.safetensors
FP16SAFETENSORS4.8 GB—model-00005-of-00015.safetensors
FP16SAFETENSORS4.8 GB—model-00007-of-00015.safetensors
FP16SAFETENSORS4.8 GB—model-00008-of-00015.safetensors
FP16SAFETENSORS4.8 GB—model-00010-of-00015.safetensors
FP16SAFETENSORS4.8 GB—model-00011-of-00015.safetensors
FP16SAFETENSORS4.8 GB—model-00013-of-00015.safetensors
FP16SAFETENSORS4.8 GB—model-00014-of-00015.safetensors
FP16SAFETENSORS4.8 GB—model-00001-of-00015.safetensors
FP16SAFETENSORS5.0 GB—model-00003-of-00015.safetensors
FP16SAFETENSORS5.0 GB—model-00006-of-00015.safetensors
FP16SAFETENSORS5.0 GB—model-00009-of-00015.safetensors
FP16SAFETENSORS5.0 GB—model-00012-of-00015.safetensors

Sizes are file sizes, not peak runtime memory.

From the Hugging Face model card

About this model.

🐙 GitHub • 👾 Discord • 🐤 Twitter • 💬 WeChat
📝 Paper • 💪 Tech Blog • 🙌 FAQ • 📗 Learning Hub

Intro

Yi-1.5 is an upgraded version of Yi. It is continuously pre-trained on Yi with a high-quality corpus of 500B tokens and fine-tuned on 3M diverse fine-tuning samples.

Compared with Yi, Yi-1.5 delivers stronger performance in coding, math, reasoning, and instruction-following capability, while still maintaining excellent capabilities in language understanding, commonsense reasoning, and reading comprehension.

Model Context Length Pre-trained Tokens
Yi-1.5 4K, 16K, 32K 3.6T

Models

Benchmarks

  • Chat models

    Yi-1.5-34B-Chat is on par with or excels beyond larger models in most benchmarks.

    image/png

    Yi-1.5-9B-Chat is the top performer among similarly sized open-source models.

    image/png

  • Base models

    Yi-1.5-34B is on par with or excels beyond larger models in some benchmarks.

    image/png

    Yi-1.5-9B is the top performer among similarly sized open-source models.

    image/png

Quick Start

For getting up and running with Yi-1.5 models quickly, see README.