Cognitive Stylistic Approaches to Digital Storytelling with Insights from Multimodal Reader Response Studies

Abstract

Digital storytelling provides enhanced Cognitive Conditions for interpretive engagement with digital Media through the integration of Language, visuals, sound and the interactivity of Multimodal Resources A cognitive stylistic framework has been applied to determine the effects of Multimodal Design on Readers attention, emotional involvement and the Means they use to make meaning from the story content. Analysis of three Multimodal Digital Stories has identified and categorised Cognitive-Stylistic Elements or Features that include Deictic Shifts and patterns of Foregrounding, Metaphorical Clusters, and Narrative Perspectives. Reader-Response Research collected data from fifty two participants through use of a Multimodal Protocol comprised of Immersion Rating Scale, Recall Test, and Emotion-Mapping Tools. Statistics indicated Cognitive Engagement increased twenty four percent when the Foregrounded Text corresponds with Salient Visuals. A strong relationship was demonstrated between Multimodal Coherence and Emotional Resonance (r = .72, p < .01, 95% CI [.58, .83]), while the relationship between Stylistic Complexity and Depth of Interpretation was moderate yet significant (r = .49, p < .05). Readings of High Coherence segments resulted in nineteen percent more accurate recall when compared to Low Coherence segments. Findings support the claim that Cognitive-Stylistic Mechanisms and Multimodal Resources work together to create Mental Simulation, Narrative Transportation and Comprehension. The research develops an Integrated Cognitive-Multimodal Model for analysis of Digital Narratives and furthers the Theoretical Discourse relating to Stylistics, Literary Linguistics and Reader-Response Research..