This state-of-the-art survey contains selected papers contributed by researchers in intelligent systems, cognitive robotics, and neuroscience including contributions from the MirrorBot project and from the NeuroBotics Workshop 2004. The research work presented demonstrates significant novel developments in biologically inspired neural models for use in intelligent robot environments and biomimetic cognitive behavior.

This state-of-the-art survey contains selected papers contributed by researchers in intelligent systems, cognitive robotics, and neuroscience including contributions from the MirrorBot project and from the NeuroBotics Workshop 2004. The research work presented demonstrates significant novel developments in biologically inspired neural models for use in intelligent robot environments and biomimetic cognitive behavior.

Reinforcement Learning (RL) is a very dynamic area in terms of theory and application. This book brings together many different aspects of the current research on several fields associated to RL which has been growing rapidly, producing a wide variety of learning algorithms for different applications. Based on 24 Chapters, it covers a very broad variety of topics in RL and their application in autonomous systems. A set of chapters in this book provide a general overview of RL while other chapters focus mostly on the applications of RL paradigms: Game Theory, Multi-Agent Theory, Robotic, Networking Technologies, Vehicular Navigation, Medicine and Industrial Logistic.

The adult brain is not as hard-wired as traditionally thought. By modifying their small- or large-scale morphology, neurons can make new synaptic connections or break existing ones (structural plasticity). Structural changes accompany memory formation and learning, and are induced by neurogenesis, neurodegeneration and brain injury such as stroke. Exploring the role of structural plasticity in the brain can be greatly assisted by mathematical and computational models, as they enable us to bridge the gap between system-level dynamics and lower level cellular and molecular processes. However, most traditional neural network models have fixed neuronal morphologies and a static connectivity pattern, with plasticity merely arising from changes in the strength of existing synapses (synaptic plasticity). In The Rewiring Brain, the editors bring together for the first time contemporary modeling studies that investigate the implications of structural plasticity for brain function and pathology. Starting with an experimental background on structural plasticity in the adult brain, the book covers computational studies on homeostatic structural plasticity, the impact of structural plasticity on cognition and cortical connectivity, the interaction between synaptic and structural plasticity, neurogenesis-related structural plasticity, and structural plasticity in neurological disorders. Structural plasticity adds a whole new dimension to brain plasticity, and The Rewiring Brain shows how computational approaches may help to gain a better understanding of the full adaptive potential of the adult brain. The book is written for both computational and experimental neuroscientists. - Reviews the current state of knowledge of structural plasticity in the adult brain - Gives a comprehensive overview of computational studies on structural plasticity - Provides insights into the potential driving forces of structural plasticity and the functional implications of structural plasticity for learning and memory - Serves as inspiration for developing novel treatment strategies for stimulating functional repair after brain damage

From the Foreword: "In this book Joscha Bach introduces Dietrich Dörner's PSI architecture and Joscha's implementation of the MicroPSI architecture. These architectures and their implementation have several lessons for other architectures and models. Most notably, the PSI architecture includes drives and thus directly addresses questions of emotional behavior. An architecture including drives helps clarify how emotions could arise. It also changes the way that the architecture works on a fundamental level, providing an architecture more suited for behaving autonomously in a simulated world. PSI includes three types of drives, physiological (e.g., hunger), social (i.e., affiliation needs), and cognitive (i.e., reduction of uncertainty and expression of competency). These drives routinely influence goal formation and knowledge selection and application. The resulting architecture generates new kinds of behaviors, including context dependent memories, socially motivated behavior, and internally motivated task switching. This architecture illustrates how emotions and physical drives can be included in an embodied cognitive architecture. The PSI architecture, while including perceptual, motor, learning, and cognitive processing components, also includes several novel knowledge representations: temporal structures, spatial memories, and several new information processing mechanisms and behaviors, including progress through types of knowledge sources when problem solving (the Rasmussen ladder), and knowledge-based hierarchical active vision. These mechanisms and representations suggest ways for making other architectures more realistic, more accurate, and easier to use. The architecture is demonstrated in the Island simulated environment. While it may look like a simple game, it was carefully designed to allow multiple tasks to be pursued and provides ways to satisfy the multiple drives. It would be useful in its own right for developing other architectures interested in multi-tasking, long-term learning, social interaction, embodied architectures, and related aspects of behavior that arise in a complex but tractable real-time environment. The resulting models are not presented as validated cognitive models, but as theoretical explorations in the space of architectures for generating behavior. The sweep of the architecture can thus be larger-it presents a new cognitive architecture attempting to provide a unified theory of cognition. It attempts to cover perhaps the largest number of phenomena to date. This is not a typical cognitive modeling work, but one that I believe that we can learn much from." --Frank E. Ritter, Series Editor Although computational models of cognition have become very popular, these models are relatively limited in their coverage of cognition-- they usually only emphasize problem solving and reasoning, or treat perception and motivation as isolated modules. The first architecture to cover cognition more broadly is PSI theory, developed by Dietrich Dorner. By integrating motivation and emotion with perception and reasoning, and including grounded neuro-symbolic representations, PSI contributes significantly to an integrated understanding of the mind. It provides a conceptual framework that highlights the relationships between perception and memory, language and mental representation, reasoning and motivation, emotion and cognition, autonomy and social behavior. It is, however, unfortunate that PSI's origin in psychology, its methodology, and its lack of documentation have limited its impact. The proposed book adapts Psi theory to cognitive science and artificial intelligence, by elucidating both its theoretical and technical frameworks, and clarifying its contribution to how we have come to understand cognition.

The multidisciplinary issues involved in the development of biologically inspired intelligent robots include materials, actuators, sensors, structures, functionality, control, intelligence, and autonomy. This book reviews various aspects ranging from the biological model to the vision for the future.