This is the first textbook on a generally applicable control strategy for turbulence and other complex nonlinear systems. The approach of the book employs powerful methods of machine learning for optimal nonlinear control laws. This machine learning control (MLC) is motivated and detailed in Chapters 1 and 2. In Chapter 3, methods of linear control theory are reviewed. In Chapter 4, MLC is shown to reproduce known optimal control laws for linear dynamics (LQR, LQG). In Chapter 5, MLC detects and exploits a strongly nonlinear actuation mechanism of a low-dimensional dynamical system when linear control methods are shown to fail. Experimental control demonstrations from a laminar shear-layer to turbulent boundary-layers are reviewed in Chapter 6, followed by general good practices for experiments in Chapter 7. The book concludes with an outlook on the vast future applications of MLC in Chapter 8. Matlab codes are provided for easy reproducibility of the presented results. The book includes interviews with leading researchers in turbulence control (S. Bagheri, B. Batten, M. Glauser, D. Williams) and machine learning (M. Schoenauer) for a broader perspective. All chapters have exercises and supplemental videos will be available through YouTube.

This book develops a coherent and quite general theoretical approach to algorithm design for iterative learning control based on the use of operator representations and quadratic optimization concepts including the related ideas of inverse model control and gradient-based design. Using detailed examples taken from linear, discrete and continuous-time systems, the author gives the reader access to theories based on either signal or parameter optimization. Although the two approaches are shown to be related in a formal mathematical sense, the text presents them separately as their relevant algorithm design issues are distinct and give rise to different performance capabilities. Together with algorithm design, the text demonstrates the underlying robustness of the paradigm and also includes new control laws that are capable of incorporating input and output constraints, enable the algorithm to reconfigure systematically in order to meet the requirements of different reference and auxiliary signals and also to support new properties such as spectral annihilation. Iterative Learning Control will interest academics and graduate students working in control who will find it a useful reference to the current status of a powerful and increasingly popular method of control. The depth of background theory and links to practical systems will be of use to engineers responsible for precision repetitive processes.

Methods by which robots can learn control laws that enable real-time reactivity using dynamical systems; with applications and exercises. This book presents a wealth of machine learning techniques to make the control of robots more flexible and safe when interacting with humans. It introduces a set of control laws that enable reactivity using dynamical systems, a widely used method for solving motion-planning problems in robotics. These control approaches can replan in milliseconds to adapt to new environmental constraints and offer safe and compliant control of forces in contact. The techniques offer theoretical advantages, including convergence to a goal, non-penetration of obstacles, and passivity. The coverage of learning begins with low-level control parameters and progresses to higher-level competencies composed of combinations of skills. Learning for Adaptive and Reactive Robot Control is designed for graduate-level courses in robotics, with chapters that proceed from fundamentals to more advanced content. Techniques covered include learning from demonstration, optimization, and reinforcement learning, and using dynamical systems in learning control laws, trajectory planning, and methods for compliant and force control . Features for teaching in each chapter: applications, which range from arm manipulators to whole-body control of humanoid robots; pencil-and-paper and programming exercises; lecture videos, slides, and MATLAB code examples available on the author’s website . an eTextbook platform website offering protected material[EPS2] for instructors including solutions.

The material presented in this book addresses the analysis and design of learning control systems. It begins with an introduction to the concept of learning control, including a comprehensive literature review. The text follows with a complete and unifying analysis of the learning control problem for linear LTI systems using a system-theoretic approach which offers insight into the nature of the solution of the learning control problem. Additionally, several design methods are given for LTI learning control, incorporating a technique based on parameter estimation and a one-step learning control algorithm for finite-horizon problems. Further chapters focus upon learning control for deterministic nonlinear systems, and a time-varying learning controller is presented which can be applied to a class of nonlinear systems, including the models of typical robotic manipulators. The book concludes with the application of artificial neural networks to the learning control problem. Three specific ways to neural nets for this purpose are discussed, including two methods which use backpropagation training and reinforcement learning. The appendices in the book are particularly useful because they serve as a tutorial on artificial neural networks.

Real-time Iterative Learning Control demonstrates how the latest advances in iterative learning control (ILC) can be applied to a number of plants widely encountered in practice. The book gives a systematic introduction to real-time ILC design and source of illustrative case studies for ILC problem solving; the fundamental concepts, schematics, configurations and generic guidelines for ILC design and implementation are enhanced by a well-selected group of representative, simple and easy-to-learn example applications. Key issues in ILC design and implementation in linear and nonlinear plants pervading mechatronics and batch processes are addressed, in particular: ILC design in the continuous- and discrete-time domains; design in the frequency and time domains; design with problem-specific performance objectives including robustness and optimality; design in a modular approach by integration with other control techniques; and design by means of classical tools based on Bode plots and state space.

This book provides comprehensive coverage on a new direction in computational mathematics research: automatic search for formulas. Formulas must be sought in all areas of science and life: these are the laws of the universe, the macro and micro world, fundamental physics, engineering, weather and natural disasters forecasting; the search for new laws in economics, politics, sociology. Accumulating many years of experience in the development and application of numerical methods of symbolic regression to solving control problems, the authors offer new possibilities not only in the field of control automation, but also in the design of completely different optimal structures in many fields. For specialists in the field of control, Machine Learning Control by Symbolic Regression opens up a new promising direction of research and acquaints scientists with the methods of automatic construction of control systems.For specialists in the field of machine learning, the book opens up a new, much broader direction than neural networks: methods of symbolic regression. This book makes it easy to master this new area in machine learning and apply this approach everywhere neural networks are used. For mathematicians, the book opens up a new approach to the construction of numerical methods for obtaining analytical solutions to unsolvable problems; for example, numerical analytical solutions of algebraic equations, differential equations, non-trivial integrals, etc. For specialists in the field of artificial intelligence, the book offers a machine way to solve problems, framed in the form of analytical relationships.

Iterative Learning Control (ILC) differs from most existing control methods in the sense that, it exploits every possibility to incorporate past control informa tion, such as tracking errors and control input signals, into the construction of the present control action. There are two phases in Iterative Learning Control: first the long term memory components are used to store past control infor mation, then the stored control information is fused in a certain manner so as to ensure that the system meets control specifications such as convergence, robustness, etc. It is worth pointing out that, those control specifications may not be easily satisfied by other control methods as they require more prior knowledge of the process in the stage of the controller design. ILC requires much less information of the system variations to yield the desired dynamic be haviors. Due to its simplicity and effectiveness, ILC has received considerable attention and applications in many areas for the past one and half decades. Most contributions have been focused on developing new ILC algorithms with property analysis. Since 1992, the research in ILC has progressed by leaps and bounds. On one hand, substantial work has been conducted and reported in the core area of developing and analyzing new ILC algorithms. On the other hand, researchers have realized that integration of ILC with other control techniques may give rise to better controllers that exhibit desired performance which is impossible by any individual approach.