Everything about Reproducibility
Aspect of scientific research
Reproducibility, closely related to replicability and repeatability, is a major principle underpinnings the scientific method. For the findings of a study to be reproducible means that results obtained by an experiment or an observational study or in a statistical analysis of a data set should be achieved again with a high degree of reliability when the study is replicated. There are different kind's of replication but atypically replication studies involve different researchers using the same methodology. Only after one or several such successful replications should a result be recognized as scientific knowledge. Wikipedia →
🧭 Start here: a 6-step reading path
- Read the overview: ReproducibilityA 5-minute orientation
- Skim a recent paper: Leakage and the reproducibility crisis in machine-learning-based scienceInfluential work since 2022
- Pick up a classic book: The Magic School Bus Inside the Human BodyThe most-reprinted book on the subject
- Read the landmark paper: A Concordance Correlation Coefficient to Evaluate ReproducibilityCited 7,518 times
- Go sideways: Leviathan and the Air-PumpA closely related topic
- Go sideways: Replication crisisA closely related topic
📖 Definitions
Noun The quality of being reproducible. The closeness of agreement among repeated measurements of a variable made under the same operating conditions over a period of time, or by different people. The closeness of agreement among scientific results more generally, at the level of whole experiments, either nearly identical or similar.
Noun The closeness of agreement among repeated measurements of a variable made under the same operating conditions over a period of time, or by different people.
Noun The closeness of agreement among scientific results more generally, at the level of whole experiments, either nearly identical or similar.
🏆 Landmark papers (most cited)
A Concordance Correlation Coefficient to Evaluate Reproducibility
Estimating the reproducibility of psychological science
Cesium-containing triple cation perovskite solar cells: improved stability, reproducibility and high efficiency
Loss on ignition as a method for estimating organic and carbonate content in sediments: reproducibility and comparability of results
1,500 scientists lift the lid on reproducibility
REPRODUCIBILITY AND VALIDITY OF A SEMIQUANTITATIVE FOOD FREQUENCY QUESTIONNAIRE
The Validity and Reproducibility of a Work Productivity and Activity Impairment Instrument
RNA-seq: An assessment of technical reproducibility and comparison with gene expression arrays
🆕 Influential since 2022
Leakage and the reproducibility crisis in machine-learning-based science
Replicability, Robustness, and Reproducibility in Psychological Science
Reproducibility in the fabrication and physics of moiré materials
Benzo[d]thiazole Based Wide Bandgap Donor Polymers Enable 19.54% Efficiency Organic Solar Cells Along with Desirable Batch‐to‐Batch Reproducibility and General Applicability
TorchMetrics - Measuring Reproducibility in PyTorch
📚 Books worth reading
The Magic School Bus Inside the Human BodyJoanna Cole · 1989
Modern recording techniquesDavid Miles Huber · 2001
Handbook for sound engineersGlen Ballou · 2013
Sound FXAlex Case · 2007
Understanding and crafting the mixWilliam Moylan · 2007
Sound and recordingFrancis Rumsey, TIM MCCORMICK · 2002
Ma Rainey's black bottomAugust Wilson · 1985
Audio engineering 101Tim Dittmar · 2011
Ranked by number of editions on Open Library, a rough measure of how lasting a book is.
🔗 Related topics
- Leviathan and the Air-Pump Leviathan and the Air-Pump: Hobbes, Boyle, and the Experimental Life (published 1985) is a book by Steven Shapin and Simon Schaffer. It examines the debate…
- Replication crisis The replication crisis, also known as the reproducibility crisis or replicability crisis, is a widespread phenomenon in which published scientific results…
- Simon Schaffer Simon J. Schaffer FBA (born 1 January 1955) is a historian of science, previously a professor of the history and philosophy of science at the Department…
- Research transparency Research transparency is a major aspect of scientific research. It covers a variety of scientific principles and practices: reproducibility, data and code…
- Steven Shapin Steven Shapin (/ˈʃeɪpɪn/ SHAY-pin) (born 1943) is an American historian and sociologist of science. He is Professor Emeritus of the History of Science…
- Water memory Water memory is the purported ability of water to retain a memory of substances previously dissolved in it even after an arbitrary number of serial dilutions…
- Animal Study Registry Animal Study Registry is an online registry for the preregistration of research studies involving animals. Animal Study Registry was launched in January…
- Reproducibility Project The Reproducibility Project is a series of crowdsourced collaborations aiming to reproduce published scientific studies, finding high rates of results…