Everything about Automatic parallelization

🧭 Start here: a 6-step reading path

1. Read the overview: Automatic parallelizationA 5-minute orientation
2. Skim a recent paper: Automatic and Interactive Program Parallelization Using the Cetus Source to Source Compiler Infrastructure v2.0Influential work since 2022
3. Pick up a classic book: PerceptronsThe most-reprinted book on the subject
4. Read the landmark paper: On the control of automatic processes: A parallel distributed processing account of the Stroop effect.Cited 1,419 times
5. Go sideways: Automatic parallelization toolA closely related topic
6. Go sideways: Loop optimizationA closely related topic

🏆 Landmark papers (most cited)

• On the control of automatic processes: A parallel distributed processing account of the Stroop effect.

  Jonathan D. Cohen, Kevin Dunbar, James L. McClelland · 1990 · Psychological Review · 1,419 citations

• SUPERB: A tool for semi-automatic MIMD/SIMD parallelization

  Hans P Zima, Heinz-J Bast, Michael Gerndt · 1988 · Parallel Computing · 223 citations

• Automatic program parallelization

  U. Banerjee, R. Eigenmann, A. Nicolau · 1993 · Proceedings of the IEEE · 198 citations

• The interprocedural analysis and automatic parallelization of Scheme programs

  Williams Ludwell Harrison · 1989 · Lisp and Symbolic Computation · 68 citations

• On the automatic parallelization of the Perfect Benchmarks(R)

  R. Eigenmann, J. Hoeflinger, D. Padua · 1998 · IEEE Transactions on Parallel and Distributed Systems · 61 citations

• Effective automatic parallelization of stencil computations

  Sriram Krishnamoorthy, Muthu Baskaran, Uday Bondhugula · 2007 · ACM SIGPLAN Notices · 51 citations

• A Ubiquitous Machine Learning Accelerator With Automatic Parallelization on FPGA

  Chao Wang, Lei Gong, Xi Li · 2020 · IEEE Transactions on Parallel and Distributed Systems · 38 citations

• Effectivness of abstract interpretation in automatic parallelization

  Francisco Bueno, María García de la Banda, Manuel Hermenegildo · 1999 · ACM Transactions on Programming Languages and Systems · 30 citations

🆕 Influential since 2022

• Automatic and Interactive Program Parallelization Using the Cetus Source to Source Compiler Infrastructure v2.0

  Akshay Bhosale, Parinaz Barakhshan, Miguel Romero Rosas · 2022 · Electronics · 10 citations

• A new thread-level speculative automatic parallelization model and library based on duplicate code execution

  Millán A. Martínez, Basilio B. Fraguela, José C. Cabaleiro · 2024 · The Journal of Supercomputing · 1 citations

• Loop-Block-Level Automatic Parallelization in Compilers

  Mengyao Chen, Qinglei Zhou, Kai Nie · 2026 · Applied Sciences · 0 citations

• Automatic Taxonomy Generation and Incremental Evolution on Apache Spark Parallelization Framework

  Kanwal Aalijah, Rabia Irfan, Umara Umar · 2022 · KIET Journal of Computing and Information Sciences · 0 citations

• Unified Frameworks for Automatic Parallelization and Multi-Tenancy in Machine Learning Pipelines

  Chaitra K M · 2025 · Journal of Information Systems Engineering and Management · 0 citations

📚 Books worth reading

• PerceptronsMarvin Minsky, Seymour Papert · 1969
• 📕CompositionalityCOMPOS '97 (1997 Malente, Germany) · 1998
• Automatic parallelization for a class of regular computationsG. M. Megson, X. Chen · 1997
• 📕Parallel processing in a control systems environmentEric Rogers · 1992
• 📕First Annual Workshop on Space Operations Automation and Robotics (SOAR '87)Workshop on Space Operations Automation and Robotics (1st 1987 Lyndon B. Johnson Space Center) · 1987
• Parallel processing in a control systems environmentEric Rogers, Yun Li · 1993
• Compositionality, concurrency, and partial correctnessJ Zwiers · 1989
• Compositionality · 1998

Ranked by number of editions on Open Library, a rough measure of how lasting a book is.

🔗 Related topics

• Automatic parallelization tool An automatic parallelization tool is a computer program aiding in automatic parallelization of existing sequential (single-threaded) code into parallel…
• Loop optimization In compiler theory, loop optimization is the process of increasing execution speed and reducing the overheads associated with loops. It plays an important…
• Parallel programming model In computing, a parallel programming model is an abstraction of parallel computer architecture, with which it is convenient to express algorithms and their…
• Frameworks supporting the polyhedral model Use of the polyhedral model (also called the polytope model) within a compiler requires software to represent the objects of this framework (sets of integer-val…
• OpenMP OpenMP is an application programming interface (API) that supports multi-platform shared-memory multiprocessing programming in C, C++, and Fortran, on…
• Automatic vectorization Automatic vectorization, in parallel computing, is a special case of automatic parallelization, where a computer program is converted from a scalar implementati…
• Binary Modular Dataflow Machine BMDFM running on various operating systems Binary Modular Dataflow Machine (BMDFM) is a software package that enables running an application in parallel…
• Data parallelism Data parallelism is parallelization across multiple processors in parallel computing environments. It focuses on distributing the data across different…