Everything About ___
Live briefing

Everything about Parallel computing

Programming paradigm in which many processes are executed simultaneously

Parallel computing is a type of computation in which many calculations or processes are carried out simultaneously. Large problems can often be divided into smaller ones, which can then be solved at the same time. There are several different forms of parallel computing: bit-level, instruction-level, data, and task parallelism. Parallelism has long been employed in high-performance computing, but has gained broader interest due to the physical constraints preventing frequency scaling. As power consumption by computers has become a concern in recent years, parallel computing has become the dominant paradigm in computer architecture, mainly in the form of multi-core processors. Wikipedia →

🧭 Start here: a 6-step reading path

  1. Read the overview: Parallel computingA 5-minute orientation
  2. Skim a recent paper: High-fidelity parallel entangling gates on a neutral-atom quantum computerInfluential work since 2022
  3. Pick up a classic book: Parallel Processing and Applied MathematicsThe most-reprinted book on the subject
  4. Read the landmark paper: jModelTest 2: more models, new heuristics and parallel computingCited 15,200 times
  5. Go sideways: Instruction-level parallelismA closely related topic
  6. Go sideways: Concurrent computingA closely related topic

📖 Definitions

Noun A type of computation in which many calculations or processes are carried out simultaneously.

🗂️ The subject at a glance

  1. Background
  2. Disadvantages
  3. Granularity
  4. Hardware
  5. Software
  6. Algorithmic methods
  7. Fault tolerance
  8. History
  9. Biological brain as massively parallel computer

🏆 Landmark papers (most cited)

🆕 Influential since 2022

📚 Books worth reading

Ranked by number of editions on Open Library, a rough measure of how lasting a book is.

🔗 Related topics