Live briefing
Everything about Data engineering
Software engineering approach to designing and developing information systems
Data engineering is a software engineering approach to the building of data systems, to enable the collection and usage of data. This data is usually used to enable subsequent analysis and data science, which often involves machine learning. Making the data usable usually involves substantial computing and storage, as well as data processing. Wikipedia →
🧭 Start here: a 6-step reading path
- Read the overview: Data engineeringA 5-minute orientation
- Skim a recent paper: Making Waves: Towards data-centric water engineeringInfluential work since 2022
- Pick up a classic book: NASA/DoD aerospace knowledge diffusion research projectThe most-reprinted book on the subject
- Read the landmark paper: Knowledge Engineering with Big DataCited 65 times
- Go sideways: IBM Db2A closely related topic
- Go sideways: Clive FinkelsteinA closely related topic
📖 Definitions
No dictionary entry for this exact phrase.
🏆 Landmark papers (most cited)
Knowledge Engineering with Big Data
Initial Data Engineering
Toward data mining engineering: A software engineering approach
Big data in civil engineering
Knowledge and data engineering
Data fusion system engineering
Engineering innovative mobile data services
Reverse engineering of data
🆕 Influential since 2022
📚 Books worth reading
NASA/DoD aerospace knowledge diffusion research projectThomas E. Pinelli · 1990
Advances in imaging and electron physicsPeter W. Hawkes, Benjamin Kazan · 1995
Advances in Computers, Volume 49 (Advances in Computers)Marvin V. Zelkowitz, Marshall C. Yovits · 1995
Hacking for DummiesKevin Beaver, Jutta Schmidt · 2004
eWork and eBusiness in Architecture, Engineering and ConstructionManuel Martinez, Raimar Scherer · 2004
Cooperative Design, Visualization, and EngineeringYuhua Luo · 2004
Engineering mechanicsJ. L. Meriam, L. G. Kraige · 1978
The Soul of a New MachineTracy Kidder · 1981
Ranked by number of editions on Open Library, a rough measure of how lasting a book is.
🔗 Related topics
- IBM Db2 Db2 is a family of data management products, including database servers, developed by IBM. It initially supported the relational model, but was extended…
- Clive Finkelstein Clive Finkelstein (born ca. 1939 died 9/12/2021) was an Australian computer scientist, known as the "Father" of information engineering methodology. In…
- Amazon Redshift Amazon Redshift is a data warehouse product which forms part of the larger cloud-computing platform Amazon Web Services. It is built on top of technology…
- Apache Drill Apache Drill is an open-source software framework that supports data-intensive distributed applications for interactive analysis of large-scale datasets…
- Outline of databases The following is provided as an overview of and topical guide to databases: Database – organized collection of data, today typically in digital form. The…
- Cloud database A cloud database is a database that typically runs on a cloud computing platform, with access provided as a service. There are two common deployment models:…
- Apache Flink Apache Flink is an open-source, unified stream-processing and batch-processing framework developed by the Apache Software Foundation. The core of Apache…
- Database In computing, a database is an organized collection of data or a type of data store based on the use of a database management system (DBMS), the software…