AI Vocabulary · 01 The Model
What is Small Language Model (SLM)?
A compact language model that runs fast and cheaply, often on a laptop or phone, at the cost of some capability.
A small language model is a language model with far fewer parameters than the largest ones. There is no exact size limit, but small models are typically small enough to run on a single computer, a laptop or even a phone, which makes them a natural fit for local AI.
Small models are often created or improved with techniques like distillation, where a big model teaches a small one, and quantization, which shrinks a model so it needs less memory.
Why it matters for you
Many everyday tasks, such as classifying, extracting fields, short summaries and simple rewrites, don't need a frontier model. A small model can do them faster, cheaper and sometimes entirely offline.
Own it
Small models are where independence becomes affordable. They let you keep sensitive data on your own hardware and bring your cost per task down.
Where it comes from
Small models are as old as language models, but the label "small language model" was popularised in large part by Microsoft's Phi series. Its 2023 paper "Textbooks Are All You Need" argued that carefully chosen, high-quality training data can make up for size, and the December 2023 post Phi-2: The surprising power of small language models showed a 2.7 billion parameter model holding its own against much larger ones.
Related
Your AI Learning Hub
Learn the whole AI Vocabulary, step by step, and build with it. Build it. Own it.