JackFram / llama family / text-generation
llama-160m
JackFram/llama-160m
Benchmarks
Where it scores.
General Provisional —
Coding Provisional —
Math Provisional —
Reasoning Provisional —
Normalized 0–100 across indexed models.
Runnable variants
Pick a size.
| Precision | Format | Size | Params | File |
|---|---|---|---|---|
| FP16 / smallest | OTHER | 4 KB | — | training_args.bin |
| FP16 | SAFETENSORS | 650 MB | — | model.safetensors |
| FP16 | OTHER | 650 MB | — | pytorch_model.bin |
Sizes are file sizes, not peak runtime memory.
From the Hugging Face model card
About this model.
From the Hugging Face model card
About this model.
Model description
This is a LLaMA-like model with only 160M parameters trained on Wikipedia and part of the C4-en and C4-realnewslike datasets.
No evaluation has been conducted yet, so use it with care.
The model is mainly developed as a base Small Speculative Model in the SpecInfer paper.
Citation
To cite the model, please use
@misc{miao2023specinfer,
title={SpecInfer: Accelerating Generative LLM Serving with Speculative Inference and Token Tree Verification},
author={Xupeng Miao and Gabriele Oliaro and Zhihao Zhang and Xinhao Cheng and Zeyu Wang and Rae Ying Yee Wong and Zhuoming Chen and Daiyaan Arfeen and Reyna Abhyankar and Zhihao Jia},
year={2023},
eprint={2305.09781},
archivePrefix={arXiv},
primaryClass={cs.CL}
}