The purpose of this book is to introduce the reader to the basic theory of signal detection and estimation. It is assumed that the reader has a working knowledge of applied probabil ity and random processes such as that taught in a typical first-semester graduate engineering course on these subjects. This material is covered, for example, in the book by Wong (1983) in this series. More advanced concepts in these areas are introduced where needed, primarily in Chapters VI and VII, where continuous-time problems are treated. This book is adapted from a one-semester, second-tier graduate course taught at the University of Illinois. However, this material can also be used for a shorter or first-tier course by restricting coverage to Chapters I through V, which for the most part can be read with a background of only the basics of applied probability, including random vectors and conditional expectations. Sufficient background for the latter option is given for exam pIe in the book by Thomas (1986), also in this series.

The authors here provide a detailed treatment of the design of robust adaptive controllers for nonlinear systems with uncertainties. They employ a new tool based on the ideas of system immersion and manifold invariance. New algorithms are delivered for the construction of robust asymptotically-stabilizing and adaptive control laws for nonlinear systems. The methods proposed lead to modular schemes that are easier to tune than their counterparts obtained from Lyapunov redesign.

The recent success of Reinforcement Learning and related methods can be attributed to several key factors. First, it is driven by reward signals obtained through the interaction with the environment. Second, it is closely related to the human learning behavior. Third, it has a solid mathematical foundation. Nonetheless, conventional Reinforcement Learning theory exhibits some shortcomings particularly in a continuous environment or in considering the stability and robustness of the controlled process. In this monograph, the authors build on Reinforcement Learning to present a learning-based approach for controlling dynamical systems from real-time data and review some major developments in this relatively young field. In doing so the authors develop a framework for learning-based control theory that shows how to learn directly suboptimal controllers from input-output data. There are three main challenges on the development of learning-based control. First, there is a need to generalize existing recursive methods. Second, as a fundamental difference between learning-based control and Reinforcement Learning, stability and robustness are important issues that must be addressed for the safety-critical engineering systems such as self-driving cars. Third, data efficiency of Reinforcement Learning algorithms need be addressed for safety-critical engineering systems. This monograph provides the reader with an accessible primer on a new direction in control theory still in its infancy, namely Learning-Based Control Theory, that is closely tied to the literature of safe Reinforcement Learning and Adaptive Dynamic Programming.