Live briefing
Everything about AI alignment
Conformance of AI to intended objectives
In the field of artificial intelligence (AI), alignment aims to steer AI systems toward a person's or group's intended goals, preferences, or ethical principles. An AI system is considered aligned if it advances the intended objectives. A misaligned AI system pursues unintended objectives. Wikipedia →
🧠Start here: a 6-step reading path
- Read the overview: AI alignmentA 5-minute orientation
- Skim a recent paper: Muscle5: High-accuracy alignment ensembles enable unbiased assessments of sequence homology and phylogenyInfluential work since 2022
- Pick up a classic book: The First MisalignmentThe most-reprinted book on the subject
- Read the landmark paper: Basic local alignment search toolCited 109,876 times
- Go sideways: Reward hackingA closely related topic
- Go sideways: AI safetyA closely related topic
đź“– Definitions
No dictionary entry for this exact phrase.
🗂️ The subject at a glance
🏆 Landmark papers (most cited)
Basic local alignment search tool
The Sequence Alignment/Map format and SAMtools
Fast gapped-read alignment with Bowtie 2
CLUSTAL W: improving the sensitivity of progressive multiple sequence alignment through sequence weighting, position-specific gap penalties and weight matrix choice
Fast and accurate short read alignment with Burrows–Wheeler transform
MAFFT Multiple Sequence Alignment Software Version 7: Improvements in Performance and Usability
MUSCLE: multiple sequence alignment with high accuracy and high throughput
The CLUSTAL_X windows interface: flexible strategies for multiple sequence alignment aided by quality analysis tools
🆕 Influential since 2022
Muscle5: High-accuracy alignment ensembles enable unbiased assessments of sequence homology and phylogeny
SeqKit2: A Swiss army knife for sequence and alignment processing
Why human–AI relationships need socioaffective alignment
AI Alignment: A Contemporary Survey
Beyond Preferences in AI Alignment
đź“š Books worth reading
The First MisalignmentS.D. Ash · 2026
Minds We CreateErik Bernath · 2026
La parole aux machinesThibaut Giraud · 2025
The House of Fire and BreadSolana Anima Delamor, Trinity Augustine Delamor · 2026
Ranked by number of editions on Open Library, a rough measure of how lasting a book is.
đź”— Related topics
- Reward hacking Reward hacking or specification gaming occurs when an AI trained with reinforcement learning optimizes an objective function—achieving the literal, formal…
- AI safety AI safety is an interdisciplinary field focused on preventing accidents, misuse, or other harmful consequences arising from artificial intelligence (AI)…
- Paul Christiano Paul Christiano is an American researcher in the field of artificial intelligence (AI), with a specific focus on AI alignment, which is the subfield of…
- Intelligent agent An intelligent agent is an entity that perceives its environment, takes actions autonomously to achieve goals, and may improve its performance through…
- The Alignment Problem The Alignment Problem: Machine Learning and Human Values is a 2020 non-fiction book by the American writer Brian Christian. It is based on numerous interviews…
- Reinforcement learning In machine learning and optimal control, reinforcement learning (RL) (also known as approximate dynamic programming) is concerned with how an intelligent…
- Superintelligence A superintelligence is a hypothetical agent that possesses intelligence far surpassing that of the most gifted human minds. Philosopher Nick Bostrom defined…
- Reinforcement learning from human feedback In machine learning, reinforcement learning from human feedback (RLHF) is a technique to align an intelligent agent with human preferences. It involves…