In the present book, the starting line is defined by a morphogenetic perspective on human communication and culture. The focus is on visual communication, music, religion (myth), and language, i.e., on the “symbolic forms” at the heart of human cultures (Ernst Cassirer). The term “morphogenesis” has more precisely the meaning given by René Thom (1923-2002) in his book “Morphogenesis and Structural Stability” (1972) and the notions of “self-organization” and cooperation of subsystems in the “Synergetics” of Hermann Haken (1927- ). The naturalization of communication and cultural phenomena is the favored strategy, but the major results of the involved disciplines (art history, music theory, religious science, and linguistics) are respected. Visual art from the Paleolithic to modernity stands for visual communication. The present book focuses on studies of classical painting and sculpture (e.g., Leonardo da Vinci, William Turner, and Henry Moore) and modern art (e.g., Jackson Pollock and Joseph Beuys). Musical morphogenesis embraces classical music (from J. S. Bach to Arnold Schönberg) and political songwriting (Bob Dylan, Leonhard Cohen). The myths of pre-literary societies show the effects of self-organization in the re-assembly (bricolage) of traditions. Classical polytheistic and monotheistic religions demonstrate the unfolding of basic germs (religious attractors) and their reduction in periods of crisis, the self-organization of complex religious networks, and rationalized macro-structures (in theologies). Significant tendencies are analyzed in the case of Buddhism and Christianism. Eventually, a holistic view of symbolic communication and human culture emerges based on state-of-the-art in evolutionary biology, cognitive science, linguistics, and semiotics (philosophy of symbolic forms).

Drawing a line, and then another, and another. Go back from the lines to the movements they capture and see gestures in them: not spatial displacements, but modes of knowledge that pass through the exercise of the body. Discovering something new in a gesture: the line that contracts into a point or the point that expands into a zone, perhaps sinking into a hole. Thus experiencing a diagram: a becoming other inscribed in the novelty of the gesture and in the changes of the forms it shapes. This and much more is discussed in the essays gathered in Diagrams and Gestures. Resulting from trans-disciplinary work between mathematicians, philosophers, linguists and semioticians, the volume delivers an up-to-date account of the most valuable research on the connections between gesture and diagram. As one of the most important themes in contemporary thought, the study of these connections poses a challenge for the future: to elaborate a theory that is equal to new and stimulating research methodologies. We call this theory a philosophy of diagrammatic gestures.

Multimodality has most recently been described no longer as a research field or discipline on its own, but rather as a “stage of development within a field” (Bateman 2022a, 49). The realization that (1) many different fields and disciplines now enter their own multimodal phase with new interest in multimodal phenomena and that (2) these disciplines all commit to the development of multimodality research with their own theoretical principles and methodological tools, brings with it not only an immense breadth of potential analytical objects, but also many new meta-methodological issues. “We need to find ways of ‘combining’ insights from the variously imported theoretical and methodological backgrounds brought along by previous non-multimodal stages of any contributing disciplines” (Bateman 2022a, 49). At the same time, the search for a meta-methodology for multimodal analyses is pushed further by the recent trend towards more empirical approaches to multimodal phenomena and the development and use of larger multimodal corpora that just as well require theoretical and methodological refinements. “We need to develop ways of strengthening claims with robustly applicable methods which nevertheless remain firmly anchored theoretically” (Bateman 2022b, 64). For a productive handling of these issues, disciplinary triangulation and finding a ‘common language’ or metalanguage (Maton & Chen 2016) for an ‘integrationist interdisciplinarity’ (van Leeuwen 2005) are the greatest challenges in contemporary multimodality research (Bateman 2022a). Also, there is a need for reconceptualizing the practice of analysis by making available large-scale corpora and broader and more complex empirical setups to fully process the ‘move from theory to data,’ and to substantiate long-lasting theoretical and methodological hypotheses (Pflaeging et al. 2021). For this project, we see these challenges productively as “a multimodal task from the ground up,” as John Bateman (2022b, 64) has phrased it in one of his most recent papers. This Research Topic will address this task by convening the most recent theoretical, methodological, practical, and empirical developments within contemporary multimodality research. The aim is to gain new insights in • the metalanguages or external languages that are currently being developed for multimodal analysis in many different research fields and disciplines, e.g., in pedagogy, literary theory, cultural studies, design, argumentation theory, computer science, and (experimental) psychology; • newest results from data collection methods and multimodal corpus analyses that expand the current quantitative work by, e.g., applying existing theories and methods to larger datasets, or exploring the newest communication technologies. We are particularly interested in seeing how works addressing these aspects contribute to finding ways of productive triangulation and integration for and within a meta-methodology for multimodality research. This Research Topic aims to bring together scholars from a variety of disciplines interested in multimodality research to review, explore, and advance the contributions that John Bateman, as one of the key figures in multimodality research, has made to both theory- and method-building as well as to the driving forward of multimodal empirical and corpus analyses. We welcome contributions that, for example, • critically address the theoretical and methodological advancements that John Bateman has made with regard to the notions of semiotic mode, discourse semantics, genre, textuality, etc.; • apply one of the many approaches that John Bateman has developed for the empirical analysis of multimodal artefacts (e.g., the GeM model for page-based documents, his work on multimodal film and audio-visual analysis, and the discourse semantics and/or annotation approach to visual narratives) to larger corpora or currently newly developing communicative situations; • expand on one of the abovementioned aspects with new ideas and insights from disciplines that have not yet been included in multimodality research.

Wolfgang Wildgen presents three perspectives on the evolution of language as a key element in the evolution of mankind in terms of the development of human symbol use. (1) He approaches this question by constructing possible scenarios in which mechanisms necessary for symbolic behavior could have developed, on the basis of the state of the art in evolutionary anthropology and genetics. (2) Non-linguistic symbolic behavior such as cave art is investigated as an important clue to the developmental background to the origin of language. Creativity and innovation and a population's ability to integrate individual experiments are considered with regard to historical examples of symbolic creativity in the visual arts and natural sciences. (3) Probable linguistic 'fossils' of such linguistic innovations are examined. The results of this study allow for new proposals for a 'protolanguage' and for a theory of language within a broader philosophical and semiotic framework, and raises interesting questions as to human consciousness, universal grammar, and linguistic methodology. (Series B)

Sensory Experiences: Exploring meaning and the senses describes the collective elaboration of a situated cognitive approach with an emphasis on the relations between language and cognition within and across different sensory modalities and practices. This approach, grounded in 40 years of empirical research, is a departure from the analytic, reductive view of human experiences as information processing. The book is structured into two parts. Each author first introduces the situated cognitive approach from their respective sensory domains (vision, audition, olfaction, gustation). The second part is the collective effort to derive methodological guidelines respecting the ecological validity of experimental investigations while formulating operational answers to applied questions (such as the sensory quality of environments and product design). This book will be of interest to students, researchers and practitioners dealing with sensory experiences and anyone who wants to understand and celebrate the cultural diversity of human productions that make life enjoyable!