The visual mode helps writers communicate meaning in a way that can be seen by the audience. Sometimes people must see to believe, and visuals can be helpful and even persuasive. For example, if you want to showcase how climate change has devastated the arctic ecosystem, you might include a video that shows real-world footage, like this one by National Geographic. This video is considered a multi-modal text since words, visuals, and audio are used together for a stronger effect.
Sound catches people’s attention, and writers use the aural mode to bring their words to life. Sometimes a text in a single modality can be augmented or expanded by other modalities. A podcast is entirely an aural text, but take a look at the website for the first episode Someone Knows Something podcast. Notice how this expands the podcast with images, text, and video related to the original narration. Thus, this episode’s web page is a multimodal refashioning of the original text.
Websites also rely heavily on the spatial mode to communicate meaning. Writers make strategic rhetorical decisions about how to arrange digital information in a user-friendly way within a mobile “space.” Features like menus, headers, physical layout, and navigation tools (such as links) help the audience to interact with the site spatially. Websites are considered multi-modal texts since multiple modes are used in combination to communicate with the audience.
In this journalistic piece, which consists largely of print illustrated by a few key pictures, we get insight into Geoffrey Hiller’s longstanding intellectual and visual involvement with the people and places of Myanmar. Coburn Dukehart’s “A Long-Standing Love Affair with Myanmar,” an episode in National Public Radio’s feature, “Daily Picture Show,” is a journalistic report about Hiller with highly symbolic, if realistic, photos from his journeys in the country of Myanmar. Hiller has since published a book of photos on the subject, entitled Daybreak in Myanmar, which is available for sale. As a book of photos, Hiller’s work relies primarily on the linguistic, visual, and spatial modes. But if you visit Hiller’s professional website, you can find many multimodal pieces, most of them in the Flash format. (Note: Flash productions are not visible on iPad or phones but are visible on a computer.)
The gestural mode is often used in combination with other modes, such as linguistic/alphabetic (written/spoken), spatial (physical arrangement), and aural (sound) to provide an enhanced sensory experience for the audience.
For example, sign languages use the gestural mode since position of the sign and movement are significant factors in generating and distinguishing meaning. In this video, look at how the speakers use movements of the hands, head, face, and body, along with position and speed, to communicate meaning to the audience. Sign languages are considered multi-modal communication since they combine linguistic/alphabetic text with movement.
Writers use the spatial mode of communication in the physical layout and organization of a text. For example, this tri-fold pamphlet, printed and folded on paper, presents information spatially on six panels. Physical arrangement impacts the way the audience can interact with your work.
Check out this intriguing multimodal text, “Poor Millennials,” that uses a host of different modes to communicate. How many modes does this text employ? How do you think the multimodality of this text increases its power to communicate its message and ideas?
Trifold Brochure Image by freepik
CC licensed content,
Examples of Multimodal Texts . Provided by: University of Mississippi. Project: PLATO WRIT 100/101. License: CC BY-SA: Attribution-ShareAlike
Modification, adaptation, and original content. Authored by: Audrey Fisch for Lumen Learning. Provided by: Lumen Learning. License: CC BY: Attribution
https://courses.acrobatiq.com/courseware/olemiss_eng_comp_1_0_14/multimodal_literacy/introduction_to_multimodality_and_digital_literacy/what_is_multimodality%3F. Provided by: University of Georgia. Project: PLC-EC Adaptive Courseware Pilot. License: CC BY: Attribution
Adapted from:
"Examples of Multimodal Texts" Provided by Lumen Learning. License: Creative Commons Attribution 4.0 International License (CC BY 4.0).
"Multi-Modal Communication: Writing in Five Modes." Authored by: Ann Fillmore. Provided by SLCC English Department, Open English @ SLCC Copyright © 2016 License: Creative Commons Attribution 4.0 International License (CC BY 4.0).