Live briefing
Everything about Distributed memory
Multiprocessing memory architecture
In computer science, distributed memory refers to a multiprocessor computer system in which each processor has its own private memory. Computational tasks can only operate on local data, and if remote data are required, the computational task must communicate with one or more remote processors. In contrast, a shared memory multiprocessor offers a single memory space used by all processors. Processors do not have to be aware where data resides, except that there may be performance penalties, and that race conditions are to be avoided. Wikipedia →
🧭 Start here: a 6-step reading path
- Read the overview: Distributed memoryA 5-minute orientation
- Skim a recent paper: Cortical feedback loops bind distributed representations of working memoryInfluential work since 2022
- Pick up a classic book: A primer on memory consistency and cache coherenceThe most-reprinted book on the subject
- Read the landmark paper: Algorithms implementing distributed shared memoryCited 135 times
- Go sideways: Distributed computingA closely related topic
- Go sideways: Parallel computingA closely related topic
📖 Definitions
No dictionary entry for this exact phrase.
🏆 Landmark papers (most cited)
Algorithms implementing distributed shared memory
Distributed shared memory: concepts and systems
Spatial movement with distributed memory
Semicoarsening Multigrid on Distributed Memory Machines
Distributed learning enhances relational memory consolidation
Recoverable distributed shared virtual memory
Heterogeneous distributed shared memory
Compiling for distributed-memory systems
🆕 Influential since 2022
Cortical feedback loops bind distributed representations of working memory
Bifurcations in a diffusive resource-consumer model with distributed memory
The case for distributed shared-memory databases with RDMA-enabled memory disaggregation
Spatially inhomogeneous periodic patterns induced by distributed memory in the memory-based single population model
Scalable Graph Convolutional Network Training on Distributed-Memory Systems
📚 Books worth reading
A primer on memory consistency and cache coherenceDaniel J. Sorin · 2011- 📕Parallelizing Navier-Stokes computations on a variety of architectural platformsD. N. Jayasimha · 1997
Sparse distributed memoryPentti Kanerva · 1988- 📕A scalable parallel cell-projection volume rendering algorithm for three-dimensional unstructured dataKwan-Liu Ma · 1997
Web Proxy Cache Replacement StrategiesHala ElAarag · 2012
Distributed shared memoryJelica Protić, Milo Tomasević · 1997- 📕HARPHorst D. Simon · 1997
Formal systems specificationM. Broy, Stephan Merz · 1996
Ranked by number of editions on Open Library, a rough measure of how lasting a book is.
🔗 Related topics
- Distributed computing Distributed computing is a field of computer science that studies distributed systems, defined as computer systems whose inter-communicating components…
- Parallel computing Parallel computing is a type of computation in which many calculations or processes are carried out simultaneously. Large problems can often be divided…
- Computer cluster A computer cluster is a group of autonomous computers that work together so that they can be viewed as a single system. Unlike grid computers, computer…
- Concurrent computing Concurrent computing is a form of computing in which several computations are executed concurrently—during overlapping time periods, instead of sequentially—wit…
- Load balancing (computing) In computing, load balancing is the process of distributing a set of tasks over a set of resources (computing units) with the aim of making their overall…
- Embarrassingly parallel In parallel computing, an embarrassingly parallel workload or problem (also called embarrassingly parallelizable, perfectly parallel, delightfully parallel…
- GridMathematica gridMathematica is a software product sold by Wolfram Research which extends the parallel processing capabilities of its main product Mathematica. gridMathemati…
- Multiprocessor system architecture A multiprocessor (MP) system is defined as "a system with more than one processor", and, more precisely, "a number of central processing units linked together…