Live briefing
Everything about Small language model
Type of artificial intelligence model
Small language models (SLM) or compact language models are artificial intelligence language models designed for human natural language processing including language and text generation. Small language models typically have less than forty billion parameters. This make them feasible to train or host entirely on consumer electronics such as personal computers, laptops, or smart devices. Wikipedia →
🧭 Start here: a 6-step reading path
- Read the overview: Small language modelA 5-minute orientation
- Skim a recent paper: The Rise of Small Language ModelsInfluential work since 2022
- Pick up a classic book: An Introduction to ASM86The most-reprinted book on the subject
- Read the landmark paper: LLM vs Small Model? Large Language Model Based Text Augmentation Enhanced Personality Detection ModelCited 34 times
- Go sideways: Hugging FaceA closely related topic
- Go sideways: Lists of open-source artificial intelligence softwareA closely related topic
📖 Definitions
Noun A type of neural network specializing in language but of a smaller scale, typically including millions of parameters, instead of billions to trillions.
🗂️ The subject at a glance
🏆 Landmark papers (most cited)
LLM vs Small Model? Large Language Model Based Text Augmentation Enhanced Personality Detection Model
A Small-Scale Korean-Specific BERT Language Model
MIRSAM: multimodal vision-language segment anything model for infrared small target detection
Compacting AI: In Search of the Small Language Model
Joint Inference Offloading and Model Caching for Small and Large Language Model Collaboration
Small Language Model Can Self-Correct
FLAME: A Small Language Model for Spreadsheet Formulas
Qolda: A Small Vision–Language Model for the Kazakh Language
🆕 Influential since 2022
The Rise of Small Language Models
Towards a small language model powered chain‐of‐reasoning for open‐domain question answering
SC-Phi2: A Fine-Tuned Small Language Model for StarCraft II Build Order Prediction
D3: A Small Language Model for Drug-Drug Interaction prediction and comparison with Large Language Models
Performance of a Small Language Model Versus a Large Language Model in Answering Glaucoma Frequently Asked Patient Questions: Development and Usability Study
📚 Books worth reading
- 📕An Introduction to ASM86Intel · 1981
Der Gruppenstil der RAF im "Info"-SystemOlaf Gätje · 2008
Ranked by number of editions on Open Library, a rough measure of how lasting a book is.
🔗 Related topics
- Hugging Face This article contains Unicode emoticons or emoji. Without proper rendering support, you may see question marks, boxes, or other symbols instead of the…
- Lists of open-source artificial intelligence software These lists include projects which release their software under open-source licenses and are related to artificial intelligence projects. These include…
- Generative pre-trained transformer A generative pre-trained transformer (GPT) is a type of large language model (LLM) that is widely used in generative artificial intelligence chatbots.…
- Allen Institute for AI The Allen Institute for AI (abbreviated Ai2) is a 501(c)(3) non-profit scientific research institute founded by late Microsoft co-founder and philanthropist…
- Neural scaling law In machine learning, a neural scaling law is an empirical scaling law that describes how neural network performance changes as key factors are scaled up…
- 2022 in artificial intelligence The following is a list of events of the year 2022 in artificial intelligence. January 27 – OpenAI introduces InstructGPT, a family of language models…
- Phi (language model) Phi is a series of small language models developed by Microsoft that are open-weights and can run locally on one's device. The initial version, Phi-1,…
- PaLM PaLM (Pathways Language Model) is a 540 billion-parameter dense decoder-only transformer-based large language model (LLM) developed by Google AI. Researchers…