Live briefing
Everything about Knowledge cutoff
Temporal limit of a model's knowledge
In machine learning, a knowledge cutoff is the point in time beyond which a large language model has not been trained on new data. Since large language models are pretrained, any model's knowledge is fixed at what it was trained on before deployment; information about events after this date is absent from the model's training data. The model cannot access information about later events without a system for real-time data access such as retrieval-augmented generation, which fetches new information from an external database. Wikipedia →
🧠Start here: a 6-step reading path
- Read the overview: Knowledge cutoffA 5-minute orientation
- Pick up a classic book: Becoming a music teacherThe most-reprinted book on the subject
- Read the landmark paper: A strategy to incorporate prior knowledge into correlation network cutoff selectionCited 31 times
- Go sideways: Retrieval-augmented generationA closely related topic
- Go sideways: Douwe KielaA closely related topic
đź“– Definitions
No dictionary entry for this exact phrase.
🗂️ The subject at a glance
🏆 Landmark papers (most cited)
đź“š Books worth reading
- 📕Becoming a music teacherDonald L. Hamann · 2016
Ranked by number of editions on Open Library, a rough measure of how lasting a book is.
đź”— Related topics
- Retrieval-augmented generation Retrieval-augmented generation (RAG) is a technique that enables large language models (LLMs) to retrieve and incorporate new information from external…
- Douwe Kiela Douwe Kiela is a Dutch-American research scientist and entrepreneur working in the field of artificial intelligence with a focus on machine learning and…
- Prompt engineering Prompt engineering is the process of structuring natural language inputs (known as prompts) to produce specified outputs from a generative AI model. Context…
- Allen Institute for AI The Allen Institute for AI (abbreviated Ai2) is a 501(c)(3) non-profit scientific research institute founded by late Microsoft co-founder and philanthropist…
- Llama (language model) Llama ("Large Language Model Meta AI" serving as a backronym) was a family of large language models (LLMs) released by Meta AI from February 2023 to April…
- Language and Communication Technologies Language and Communication Technologies (LCT; also known as human language technologies or language technology for short) is the scientific study of technologie…
- Generative pre-trained transformer A generative pre-trained transformer (GPT) is a type of large language model (LLM) that is widely used in generative artificial intelligence chatbots.…
- Machine unlearning Machine unlearning is a branch of machine learning focused on removing specific undesired element, such as private data, wrong or manipulated training…