Live briefing
Everything about Multimodality
Concept in communication
Multimodality is the application of multiple literacies within one medium. Multiple literacies or "modes" contribute to an audience's understanding of a composition. Everything from the placement of images to the organization of the content to the method of delivery creates meaning. This is the result of a shift from isolated text being relied on as the primary source of communication, to the image being utilized more frequently in the digital age. Multimodality describes communication practices in terms of the textual, aural, linguistic, spatial, and visual resources used to compose messages. Wikipedia →
🧭 Start here: a 6-step reading path
- Read the overview: MultimodalityA 5-minute orientation
- Skim a recent paper: Recommendations for Multimodality Cardiovascular Imaging of Patients with Hypertrophic Cardiomyopathy: An Update from the American Society of Echocardiography, in Collaboration with the American Society of Nuclear Cardiology, the Society for Cardiovascular Magnetic Resonance, and the Society of Cardiovascular Computed TomographyInfluential work since 2022
- Pick up a classic book: A case-based approach to PET/CT in oncologyThe most-reprinted book on the subject
- Read the landmark paper: CLUMPP: a cluster matching and permutation program for dealing with label switching and multimodality in analysis of population structureCited 5,737 times
- Go sideways: Visual rhetoric and compositionA closely related topic
- Go sideways: Multimodal pedagogyA closely related topic
📖 Definitions
Noun The quality of being multimodal; employing multiple modes.
Noun The presence of multiple modes or maxima in a statistical distribution.
🏆 Landmark papers (most cited)
CLUMPP: a cluster matching and permutation program for dealing with label switching and multimodality in analysis of population structure
Multimodality image registration by maximization of mutual information
Expert Consensus for Multimodality Imaging Evaluation of Adult Patients during and after Cancer Therapy: A Report from the American Society of Echocardiography and the European Association of Cardiovascular Imaging
4D XCAT phantom for multimodality imaging research
LIFEx: A Freeware for Radiomic Feature Calculation in Multimodality Imaging to Accelerate Advances in the Characterization of Tumor Heterogeneity
Multimodality Imaging Probes: Design and Challenges
Multiple Temporalities of Language and Body in Interaction: Challenges for Transcribing Multimodality
AMIDE: A Free Software Tool for Multimodality Medical Image Analysis
🆕 Influential since 2022
Recommendations for Multimodality Cardiovascular Imaging of Patients with Hypertrophic Cardiomyopathy: An Update from the American Society of Echocardiography, in Collaboration with the American Society of Nuclear Cardiology, the Society for Cardiovascular Magnetic Resonance, and the Society of Cardiovascular Computed Tomography
Rice-Fusion: A Multimodality Data Fusion Framework for Rice Disease Diagnosis
Multimodality Imaging of Right Heart Function
The multimodality cell segmentation challenge: toward universal solutions
Advances in Multimodality Imaging in Cardio-Oncology
📚 Books worth reading
- 📕A case-based approach to PET/CT in oncologyVictor H. Gerbaudo · 2012
How the Brain Processes Multimodal Technical InstructionsDirk Remley · 2016
Social Signal ProcessingJudee K. Burgoon, Nadia Magnenat-Thalmann · 2016
Kinect HacksJared St Jean · 2012
Adaptive multimodal interactive systemsMatthias Bezold · 2011
NanoCellBiologyBhanu P. Jena, Douglas J. Taatjes · 2014
Programming With The Kinect For Windows Software Development KitDavid Catuhe · 2012
The practice of multimodal therapyArnold A. Lazarus · 1981
Ranked by number of editions on Open Library, a rough measure of how lasting a book is.
🔗 Related topics
- Visual rhetoric and composition The study and practice of visual rhetoric took a more prominent role in the field of composition studies towards the end of the twentieth century and onward…
- Multimodal pedagogy Multimodal pedagogy is an approach to the teaching of writing with the focus of working with multiple modes of communication to create meaning. In the…
- Media theory of composition Commonly called new media theory or media-centered theory of composition, stems from the rise of computers as word processing tools. Media theorists now…
- Visual literacy in education Visual literacy in education refers to the ability to interpret, analyze, and create meaning from visual texts, including both traditional imagery and…
- Multiliteracy Multiliteracy (plural: multiliteracies) is an approach to literacy theory and pedagogy coined in the mid-1990s by the New London Group. The approach is…
- Visual rhetoric Visual rhetoric is the art of effective communication through visual elements such as images, typography, and texts. Visual rhetoric encompasses the skill…
- Kineikonic mode The kineikonic mode is a term for the moving image as a multimodal form. It indicates an approach to the analysis of film, video, television and any instance…
- Literacy in the New Media Age Written in 2003, and published by Taylor & Francis Group, Gunther Kress' book Literacy in the New Media Age explores how the introduction of modern technology…