Live briefing
Everything about Burst buffer
Storage layer in high-performance computing
In the high-performance computing environment, burst buffer is a fast intermediate storage layer positioned between the front-end computing processes and the back-end storage systems. It bridges the performance gap between the processing speed of the compute nodes and the Input/output (I/O) bandwidth of the storage systems. Burst buffers are often built from arrays of high-performance storage devices, such as NVRAM and SSD. It typically offers from one to two orders of magnitude higher I/O bandwidth than the back-end storage systems. Wikipedia →
🧭 Start here: a 6-step reading path
- Read the overview: Burst bufferA 5-minute orientation
- Skim a recent paper: Analysis of causes of burst failure of a buffer tankInfluential work since 2022
- Pick up a classic book: Data Communications and NetworkingThe most-reprinted book on the subject
- Read the landmark paper: GekkoFS — A Temporary Burst Buffer File System for HPC ApplicationsCited 54 times
- Go sideways: GPFSA closely related topic
- Go sideways: Distributed file system for cloudA closely related topic
📖 Definitions
No dictionary entry for this exact phrase.
🗂️ The subject at a glance
🏆 Landmark papers (most cited)
GekkoFS — A Temporary Burst Buffer File System for HPC Applications
Evaluation and Performance Modeling of a Burst Buffer Solution
Optimizing checkpoint data placement with guaranteed burst buffer endurance in large-scale hierarchical storage systems
Gfarm/BB — Gfarm File System for Node-Local Burst Buffer
Low-High Burst: A Double Potency Varying-RTT Based Full-Buffer Shrew Attack Model
Optimizing the SSD Burst Buffer by Traffic Detection
Multiple-Input-Buffer and Shared-Buffer Architectures for Optical Packet- and Burst-Switching Networks
Edge node buffer usage in optical burst switching networks
🆕 Influential since 2022
Analysis of causes of burst failure of a buffer tank
RuYi: Optimizing Burst Buffer Through Automated, Fine-Grained Process-to-BB Mapping
Design and Implementation of Burst Buffer Over-Subscription Scheme for HPC Storage Systems
Simulating Burst Buffer for an Efficient Data Placement Policies Selection
BBView: A burst buffer for MPI file views that performs bulk writes
📚 Books worth reading
Data Communications and NetworkingBehrouz A. Forouzan, Catherine Ann Coombs · 2000
Performance and management of complex communication networksIFIP TC6/WG6.3 & WG7.3 International Conference on the Performance and Management of Complex Communication Networks (1997 Tsukuba Kenkyū Gakuen Toshi, Japan) · 1998
Ranked by number of editions on Open Library, a rough measure of how lasting a book is.
🔗 Related topics
- GPFS GPFS (General Parallel File System, brand name IBM Storage Scale and previously IBM Spectrum Scale) is a high-performance clustered file system software…
- Distributed file system for cloud A distributed file system for cloud is a file system that allows many clients to have access to data and supports operations (create, delete, modify, read…
- ASCI Red ASCI Red (also known as ASCI Option Red or TFLOPS) was the first computer built under the Accelerated Strategic Computing Initiative (ASCI), the supercomputing…
- Application checkpointing Checkpointing is a technique that provides fault tolerance for computing systems. It involves saving a snapshot of an application's state, so that it can…
- Supercomputer architecture Approaches to supercomputer architecture have taken dramatic turns since the earliest systems were introduced in the 1960s. Early supercomputer architectures…
- Edge computing Edge computing is a distributed computing model that brings computation and data storage closer to the sources of data. More broadly, it refers to any…
- Computer cluster A computer cluster is a group of autonomous computers that work together so that they can be viewed as a single system. Unlike grid computers, computer…
- Tachyon (software) Tachyon is a parallel/multiprocessor ray tracing software. It is a parallel ray tracing library for use on distributed memory parallel computers, shared…