Everything about Stream processing
Computer programming paradigm
In computer science, stream processing is a programming paradigm that views streams, or sequences of events in time, as the central input and output objects of computation. Stream processing encompasses dataflow programming, reactive programming, and distributed data processing. Stream processing systems use streaming algorithms to trace parallel processing for data streams. The software stack for these systems includes components such as programming models and query languages, for expressing computation; stream management systems for distribution and scheduling; and hardware components for acceleration, including floating-point units, graphics processing units, and field-programmable gate arrays. Wikipedia →
🧭 Start here: a 6-step reading path
- Read the overview: Stream processingA 5-minute orientation
- Skim a recent paper: A survey on the evolution of stream processing systemsInfluential work since 2022
- Pick up a classic book: Computer programs for describing the recession of ground-water discharge and for estimating mean ground-water recharge and discharge from streamflow recordsThe most-reprinted book on the subject
- Read the landmark paper: Leaf processing in a woodland stream*Cited 947 times
- Go sideways: Single instruction, multiple threadsA closely related topic
- Go sideways: ShaderA closely related topic
📖 Definitions
Noun A computing paradigm for gathering, processing and analyzing data stream.
🏆 Landmark papers (most cited)
Leaf processing in a woodland stream*
A catalog of stream processing optimizations
A survey of stream processing
Elastic Scaling for Data Stream Processing
Evaluation of Stream Processing Frameworks
Watermarks in stream processing systems
The algebra of stream processing functions
Autopipelining for Data Stream Processing
🆕 Influential since 2022
📚 Books worth reading
- 📕Computer programs for describing the recession of ground-water discharge and for estimating mean ground-water recharge and discharge from streamflow recordsA. T. Rutledge · 1993
- 📕Monthly maps of sea surface height in the North Atlantic and zonal indices for the Gulf Stream using TOPEX/Poseidon altimeter dataSandipa Singh · 1997
- 📕Computer programs for describing the recession of ground-water discharge and for estimating mean ground-water recharge and discharge from streamflow recordsA. T Rutledge · 1993
Streaming SystemsTyler Akidau, Slava Chernyak · 2018- 📕Electronic computation of water levels in rivers during high dischargesNetherlands (Kingdom, 1815- ). Directie Bovenrivieren. Section River Studies. · 1969
- 📕An evaluation of Idaho stream-gaging networksE. W. Quillian · 1982
- 📕Interactive programs for low-flow frequency analyses for use in regional studiesJ. R. Hyndman · 1978
- 📕Interactive programs for low-flow frequency analyses for use in regional studiesJ. R Hyndman · 1978
Ranked by number of editions on Open Library, a rough measure of how lasting a book is.
🔗 Related topics
- Single instruction, multiple threads Single instruction, multiple threads (SIMT) is an execution model used in parallel computing where a single central "control unit" broadcasts an instruction…
- Shader In computer graphics, a shader is a programmable operation which is applied to data as it moves through the rendering pipeline. Shaders act on data such…
- General-purpose computing on graphics processing units General-purpose computing on graphics processing units (GPGPU, or less often GPGP) is the use of a graphics processing unit (GPU), which typically handles…
- Dataflow In computing, dataflow is a broad concept, which has various meanings depending on the application and context. In the context of software architecture…
- Dataflow architecture Dataflow architecture is a dataflow-based computer architecture that directly contrasts the traditional von Neumann architecture or control flow architecture…
- Single program, multiple data In computing, single program, multiple data (SPMD) is a term that has been used to refer to computational models for exploiting parallelism whereby multiple…
- Graphics Core Next GCN (also known as Graphics Core Next) is a series of graphics processor architectures developed by AMD. GCN was introduced in 2012 as a non-VLIW redesign…
- Data parallelism Data parallelism is parallelization across multiple processors in parallel computing environments. It focuses on distributing the data across different…