Let me tell you about multimodal narratives
WOW MULTIMODAL NARRATIVES
So, basically, when something is multimodal, it can be read across multiple mediums. A multimodal narrative presents itself across these different mediums. They can be images, sound, hypertext, whatever. Games, even.
For a multimodal narrative, everything is important and yet nothing is. When something is just written, Law of Conservation of Detail takes effect, meaning everything mentioned is significant, however that may or may not be the case for a multimodal narrative, because of its ability to use images and sound to convey ideas.
For example, if an author was textually describing a room, and he or she mentioned a particular poster, it will probably turn up again later. However, if an author chooses to visually show the room through embedded imagetext, the poster on the wall could be to just fill up space, and have no significance, or they could prove to be a key to the main plot over a thousand pages later.
So, basically multimodal narratives use multimedia elements to make the reader think about what it is they're seeing. Is this poster really important? What role will it play later? Or was it just put here because it looked nice? Are the green curtains green because they're green, or is there some darker reason?
Really cool stuff. Like really.