Beginning with theory, focusing on insider stories about modes, how they work, and how to work with them, then concluding with the implications and application of such information, this text brings the multiple modes together into an integrated theory of multimodality.

Gunther Kress, a pioneer in the field of multimodality and the co-author of the bestselling Reading Images, produces a comprehensive theoretical framework for the study of the topic providing sample analyses and suggestions for further reading.

To many academics, composition still represents typewritten texts on 8.5" x 11" pages that follow rote argumentative guidelines. In Toward a Composition Made Whole, Jody Shipka views composition as an act of communication that can be expressed through any number of media and as a path to meaning-making. Her study offers an in-depth examination of multimodality via the processes, values, structures, and semiotic practices people employ every day to compose and communicate their thoughts. Shipka counters current associations that equate multimodality only with computer, digitized, or screen-mediated texts, which are often self-limiting. She stretches the boundaries of composition to include a hybridization of aural, visual, and written forms. Shipka analyzes the work of current scholars in multimodality and combines this with recent writing theory to create her own teaching framework. Among her methods, Shipka employs process-oriented reflection and a statement of goals and choices to prepare students to compose using various media in ways that spur their rhetorical and material awareness. They are encouraged to produce unusual text forms while also learning to understand the composition process as a whole. Shipka presents several case studies of students working in multimodal composition and explains the strategies, tools, and spaces they employ. She then offers methods to critically assess multimodal writing projects. Toward a Composition Made Whole challenges theorists and compositionists to further investigate communication practices and broaden the scope of writing to include all composing methods. While Shipka views writing as crucial to discourse, she challenges us to always consider the various purposes that writing serves.

This groundbreaking work takes multimodality studies in a new direction by applying multimodal approaches to the study of poetry and poetics. The book examines poetry’s visual and formal dimensions, applying framing theory to such case studies as Aristotle’s Poetics and Robert Lowell’s "The Heavenly Rain", to demonstrate both the implied, due to the form’s unique relationship with structure, imagery, and rhythm, and explicit forms of multimodality at work, an otherwise little-explored research strand of multimodality studies. The volume explores the theoretical implications of a multimodal approach to poetry and poetics to other art forms and fields of study, making this essential reading for students and scholars working at the intersection of language and communication, including multimodality, discourse analysis, and interdisciplinary literary studies.

A guide that offers a step-by-step process to data-driven qualitative multimodal discourse analysis Systematically Working with Multimodal Data is a hands-on guide that is theoretically grounded and offers a step-by-step process to clearly show how to do a data-driven qualitative Multimodal Discourse Analysis (MDA). This full-color introductory textbook is filled with helpful definitions, notes, discussion points and tasks. With illustrative research examples from YouTube, an Experimental and a Video Ethnographic Study, the text offers many examples of how to deal with small to large amounts of data, including information on how to transcribe video data multimodally, including online videos, and how to analyze the data. This textbook contains ample theory, directions for literature, and a teaching guide to help with a clear understanding of how to work with multimodal data. Contains new research data, exceptional illustrations and diagrams Offers step-by-step processes of working through examples, transcriptions and online videos Goes into great depth so that students can use the book as hands-on material to engage with their own data analysis Designed to be easy-to-use with color-coded definitions, tasks, discussion points and notes Written for advanced undergraduate, graduate and PhD level students, as well as participants in research workshops, Systematically Working with Multimodal Data is an authoritative guide to understanding data-driven qualitative Multimodal Discourse Analysis.

This textbook provides the first foundational introduction to the practice of analysing multimodality, covering the full breadth of media and situations in which multimodality needs to be a concern. Readers learn via use cases how to approach any multimodal situation and to derive their own specifically tailored sets of methods for conducting and evaluating analyses. Extensive references and critical discussion of existing approaches from many disciplines and in each of the multimodal domains addressed are provided. The authors adopt a problem-oriented perspective throughout, showing how an appropriate foundation for understanding multimodality as a phenomenon can be used to derive strong methodological guidance for analysis as well as supporting the adoption and combination of appropriate theoretical tools. Theoretical positions found in the literature are consequently always related back to the purposes of analysis rather than being promoted as valuable in their own right. By these means the book establishes the necessary theoretical foundations to engage productively with today’s increasingly complex combinations of multimodal artefacts and performances of all kinds.

This state-of-the-art account of research and theorizing brings together multimodality, learning and communication through detailed analyses of signmakers and their meaning-making in museums, hospitals, schools and the home environment. By analyzing video recordings, photographs, screenshots and print materials, Jeff Bezemer and Gunther Kress go well beyond the comfortable domains of traditional sites of (social) semiotic and multimodal research. They steer away from spurious invention and naming of ever more new and exciting domains, focusing instead on fundamentals in assembling a set of tools for current tasks: namely, describing and analyzing learning and communication in the contemporary world as one integrated field. The theory outlined in the book is grounded in the findings of the authors’ wide-ranging empirical investigations. Each chapter evaluates the work that is being done and has been done, challenging accepted wisdom and standing much of it on its head. With extensive illustrations and many examples presented to show the reach and applicability of the theory, this book is essential reading for all those working in multimodality, semiotics, applied linguistics and related areas. Images from the book are also available to view online at www.routledge.com/9780415709620/