Reinforcement learning (RL) and adaptive dynamic programming (ADP) has been one of the most critical research fields in science and engineering for modern complex systems. This book describes the latest RL and ADP techniques for decision and control in human engineered systems, covering both single player decision and control and multi-player games. Edited by the pioneers of RL and ADP research, the book brings together ideas and methods from many fields and provides an important and timely guidance on controlling a wide variety of systems, such as robots, industrial processes, and economic decision-making.

There has been great interest in "universal controllers" that mimic the functions of human processes to learn about the systems they are controlling on-line so that performance improves automatically. Neural network controllers are derived for robot manipulators in a variety of applications including position control, force control, link flexibility stabilization and the management of high-frequency joint and motor dynamics. The first chapter provides a background on neural networks and the second on dynamical systems and control. Chapter three introduces the robot control problem and standard techniques such as torque, adaptive and robust control. Subsequent chapters give design techniques and Stability Proofs For NN Controllers For Robot Arms, Practical Robotic systems with high frequency vibratory modes, force control and a general class of non-linear systems. The last chapters are devoted to discrete- time NN controllers. Throughout the text, worked examples are provided.

The 24 chapters in this book provides a deep overview of robotics and the application of AI and IoT in robotics. It contains the exploration of AI and IoT based intelligent automation in robotics. The various algorithms and frameworks for robotics based on AI and IoT are presented, analyzed, and discussed. This book also provides insights on application of robotics in education, healthcare, defense and many other fields which utilize IoT and AI. It also introduces the idea of smart cities using robotics.

This monograph presents the fundamentals of global stabilization and optimal control of nonlinear systems with uncertain models. It offers a unified view of deterministic disturbance attenuation, stochastic control, and adaptive control for nonlinear systems. The book addresses researchers in the areas of robust and adaptive nonlinear control, nonlinear H-infinity stochastic control, and other related areas of control and dynamical systems theory.

A general neural-network-based connectionist model, called Fuzzy Neural Network (FNN), is proposed in this book for the realization of a fuzzy logic control and decision system. The FNN is a feedforward multi-layered network which integrates the basic elements and functions of a traditional fuzzy logic controller into a connectionist structure which has distributed learning abilities.In order to set up this proposed FNN, the author recommends two complementary structure/parameter learning algorithms: a two-phase hybrid learning algorithm and an on-line supervised structure/parameter learning algorithm.Both of these learning algorithms require exact supervised training data for learning. In some real-time applications, exact training data may be expensive or even impossible to get. To solve this reinforcement learning problem for real-world applications, a Reinforcement Fuzzy Neural Network (RFNN) is further proposed. Computer simulation examples are presented to illustrate the performance and applicability of the proposed FNN, RFNN and their associated learning algorithms for various applications.

By the dawn of the new millennium, robotics has undergone a major transf- mation in scope and dimensions. This expansion has been brought about by the maturity of the ?eld and the advances in its related technologies. From a largely dominant industrial focus, robotics has been rapidly expanding into the challenges of the human world. The new generation of robots is expected to safely and dependably co-habitat with humans in homes, workplaces, and c- munities, providing support in services, entertainment, education, healthcare, manufacturing, and assistance. Beyond its impact on physical robots, the body of knowledge robotics has produced is revealing a much wider rangeof applications reaching across diverse research areas and scienti?c disciplines, such as: biomechanics, haptics, n- rosciences, virtual simulation, animation, surgery, and sensor networks among others. In return, the challenges of the new emerging areas are proving an ab- dant source of stimulation and insights for the ?eld of robotics. It is indeed at the intersection of disciplines that the most striking advances happen. The goal of the series of Springer Tracts in Advanced Robotics (STAR) is to bring, in a timely fashion, the latest advances and developments in robotics on thebasisoftheirsigni?canceandquality.Itisourhopethatthewiderdissemi- tion of research developments will stimulate more exchanges and collaborations among the research community and contribute to further advancement of this rapidly growing ?eld.