Everything about Data integrity
Maintenance of data over its entire life-cycle
Data integrity is the maintenance of, and the assurance of, data accuracy and consistency over its entire life-cycle and is a critical aspect to the design, implementation, and usage of any system that stores, processes, or retrieves data. The term is broad in scope and may have widely different meanings depending on the specific context – even under the same general umbrella of computing. It is at times used as a proxy term for data quality, while data validation is a prerequisite for data integrity. Data integrity is the opposite of data corruption. The overall intent of any data integrity technique is the same: ensure data is recorded exactly as intended. Moreover, upon later retrieval, ensure the data is the same as when it was originally recorded. In short, data integrity aims to prevent unintentional changes to information. Data integrity is not to be confused with data security, the discipline of protecting data from unauthorized parties. Wikipedia →
đź§ Start here: a 6-step reading path
- Read the overview: Data integrityA 5-minute orientation
- Skim a recent paper: International Consensus Classification of Myeloid Neoplasms and Acute Leukemias: integrating morphologic, clinical, and genomic dataInfluential work since 2022
- Pick up a classic book: PatternsThe most-reprinted book on the subject
- Read the landmark paper: Geneious Basic: An integrated and extendable desktop software platform for the organization and analysis of sequence dataCited 18,546 times
- Go sideways: Data corruptionA closely related topic
- Go sideways: Referential integrityA closely related topic
đź“– Definitions
Noun The maintenance of, and the assurance of, data accuracy and its consistency over its entire lifecycle.
🗂️ The subject at a glance
🏆 Landmark papers (most cited)
Geneious Basic: An integrated and extendable desktop software platform for the organization and analysis of sequence data
Integrated analysis of multimodal single-cell data
Comprehensive Integration of Single-Cell Data
Integrating single-cell transcriptomic data across different conditions, technologies, and species
TBtools: An Integrative Toolkit Developed for Interactive Analyses of Big Biological Data
Fast, sensitive and accurate integration of single-cell data with Harmony
🆕 Influential since 2022
International Consensus Classification of Myeloid Neoplasms and Acute Leukemias: integrating morphologic, clinical, and genomic data
UALCAN: An update to the integrated cancer data analysis platform
Using MetaboAnalyst 5.0 for LC–HRMS spectra processing, multi-omics integration and covariate adjustment of global metabolomics data
Integrative analysis of multimodal mass spectrometry data in MZmine 3
Artificial intelligence for multimodal data integration in oncology
📚 Books worth reading
PatternsIBM Redbooks · 2002
SAS(R) 9.1.3 Intelligence PlatformSAS Publishing · 2006
VHDLZainalabedin Navabi · 1992
Calculus&MathematicaBill Davis, William Davis · 1994
Data and Computer CommunicationsWilliam Stallings · 1985
Computerized AccountingMcGraw-Hill · 1994
Calculus using MathematicaK. D. Stroyan, Stroyan · 1993
PSPICE and MATLAB for electronicsJohn Okyere Attia · 2002
Ranked by number of editions on Open Library, a rough measure of how lasting a book is.
đź”— Related topics
- Data corruption Data corruption is the undesired alteration in computer data that occurs during writing, reading, storage, transmission, or processing. Computer systems…
- Referential integrity Referential integrity is a property of data stating that all its references are valid. In the context of relational databases, it requires that if a value…
- Data scrubbing Data scrubbing is an error correction technique that uses a background task to periodically inspect main memory or storage for errors, then corrects detected…
- Data redundancy In computer main memory, auxiliary storage and computer buses, data redundancy is the existence of data that is additional to the actual data and permits…
- ZFS ZFS (previously Zettabyte File System, now an orphaned initialism) is a file system with volume management capabilities. It began as part of the Sun Microsystem…
- Data validation In computing, data validation or input validation is the process of ensuring data has undergone data cleansing to confirm it has data quality, that is…
- Checksum A checksum is a small-sized block of data derived from another block of digital data for the purpose of detecting errors that may have been introduced…
- Journaling file system A journaling file system is a file system that keeps track of changes not yet committed to the file system's main part by recording the goal of such changes…