By establishing an alternative foundation of control theory, this thesis represents a significant advance in the theory of control systems, of interest to a broad range of scientists and engineers. While common control strategies for dynamical systems center on the system state as the object to be controlled, the approach developed here focuses on the state trajectory. The concept of precisely realizable trajectories identifies those trajectories that can be accurately achieved by applying appropriate control signals. The resulting simple expressions for the control signal lend themselves to immediate application in science and technology. The approach permits the generalization of many well-known results from the control theory of linear systems, e.g. the Kalman rank condition to nonlinear systems. The relationship between controllability, optimal control and trajectory tracking are clarified. Furthermore, the existence of linear structures underlying nonlinear optimal control is revealed, enabling the derivation of exact analytical solutions to an entire class of nonlinear optimal trajectory tracking problems. The clear and self-contained presentation focuses on a general and mathematically rigorous analysis of controlled dynamical systems. The concepts developed are visualized with the help of particular dynamical systems motivated by physics and chemistry.

Discrete-Time Inverse Optimal Control for Nonlinear Systems proposes a novel inverse optimal control scheme for stabilization and trajectory tracking of discrete-time nonlinear systems. This avoids the need to solve the associated Hamilton-Jacobi-Bellman equation and minimizes a cost functional, resulting in a more efficient controller. Design More Efficient Controllers for Stabilization and Trajectory Tracking of Discrete-Time Nonlinear Systems The book presents two approaches for controller synthesis: the first based on passivity theory and the second on a control Lyapunov function (CLF). The synthesized discrete-time optimal controller can be directly implemented in real-time systems. The book also proposes the use of recurrent neural networks to model discrete-time nonlinear systems. Combined with the inverse optimal control approach, such models constitute a powerful tool to deal with uncertainties such as unmodeled dynamics and disturbances. Learn from Simulations and an In-Depth Case Study The authors include a variety of simulations to illustrate the effectiveness of the synthesized controllers for stabilization and trajectory tracking of discrete-time nonlinear systems. An in-depth case study applies the control schemes to glycemic control in patients with type 1 diabetes mellitus, to calculate the adequate insulin delivery rate required to prevent hyperglycemia and hypoglycemia levels. The discrete-time optimal and robust control techniques proposed can be used in a range of industrial applications, from aerospace and energy to biomedical and electromechanical systems. Highlighting optimal and efficient control algorithms, this is a valuable resource for researchers, engineers, and students working in nonlinear system control.

Brings neural networks and fuzzy logic together with dynamical control systems. Each chapter presents powerful control approaches for the design of intelligent controllers to compensate for actuator nonlinearities.

This book intends to report new optimal control results with critic intelligence for complex discrete-time systems, which covers the novel control theory, advanced control methods, and typical applications for wastewater treatment systems. Therein, combining with artificial intelligence techniques, such as neural networks and reinforcement learning, the novel intelligent critic control theory as well as a series of advanced optimal regulation and trajectory tracking strategies are established for discrete-time nonlinear systems, followed by application verifications to complex wastewater treatment processes. Consequently, developing such kind of critic intelligence approaches is of great significance for nonlinear optimization and wastewater recycling. The book is likely to be of interest to researchers and practitioners as well as graduate students in automation, computer science, and process industry who wish to learn core principles, methods, algorithms, and applications in the field of intelligent optimal control. It is beneficial to promote the development of intelligent optimal control approaches and the construction of high-level intelligent systems.

This volume discusses advances in applied nonlinear optimal control, comprising both theoretical analysis of the developed control methods and case studies about their use in robotics, mechatronics, electric power generation, power electronics, micro-electronics, biological systems, biomedical systems, financial systems and industrial production processes. The advantages of the nonlinear optimal control approaches which are developed here are that, by applying approximate linearization of the controlled systems’ state-space description, one can avoid the elaborated state variables transformations (diffeomorphisms) which are required by global linearization-based control methods. The book also applies the control input directly to the power unit of the controlled systems and not on an equivalent linearized description, thus avoiding the inverse transformations met in global linearization-based control methods and the potential appearance of singularity problems. The method adopted here also retains the known advantages of optimal control, that is, the best trade-off between accurate tracking of reference setpoints and moderate variations of the control inputs. The book’s findings on nonlinear optimal control are a substantial contribution to the areas of nonlinear control and complex dynamical systems, and will find use in several research and engineering disciplines and in practical applications.

This book presents a class of novel optimal control methods and games schemes based on adaptive dynamic programming techniques. For systems with one control input, the ADP-based optimal control is designed for different objectives, while for systems with multi-players, the optimal control inputs are proposed based on games. In order to verify the effectiveness of the proposed methods, the book analyzes the properties of the adaptive dynamic programming methods, including convergence of the iterative value functions and the stability of the system under the iterative control laws. Further, to substantiate the mathematical analysis, it presents various application examples, which provide reference to real-world practices.

Optimal Event-triggered Control using Adaptive Dynamic Programming discusses event triggered controller design which includes optimal control and event sampling design for linear and nonlinear dynamic systems including networked control systems (NCS) when the system dynamics are both known and uncertain. The NCS are a first step to realize cyber-physical systems (CPS) or industry 4.0 vision. The authors apply several powerful modern control techniques to the design of event-triggered controllers and derive event-trigger condition and demonstrate closed-loop stability. Detailed derivations, rigorous stability proofs, computer simulation examples, and downloadable MATLAB® codes are included for each case. The book begins by providing background on linear and nonlinear systems, NCS, networked imperfections, distributed systems, adaptive dynamic programming and optimal control, stability theory, and optimal adaptive event-triggered controller design in continuous-time and discrete-time for linear, nonlinear and distributed systems. It lays the foundation for reinforcement learning-based optimal adaptive controller use for infinite horizons. The text then: Introduces event triggered control of linear and nonlinear systems, describing the design of adaptive controllers for them Presents neural network-based optimal adaptive control and game theoretic formulation of linear and nonlinear systems enclosed by a communication network Addresses the stochastic optimal control of linear and nonlinear NCS by using neuro dynamic programming Explores optimal adaptive design for nonlinear two-player zero-sum games under communication constraints to solve optimal policy and event trigger condition Treats an event-sampled distributed linear and nonlinear systems to minimize transmission of state and control signals within the feedback loop via the communication network Covers several examples along the way and provides applications of event triggered control of robot manipulators, UAV and distributed joint optimal network scheduling and control design for wireless NCS/CPS in order to realize industry 4.0 vision An ideal textbook for senior undergraduate students, graduate students, university researchers, and practicing engineers, Optimal Event Triggered Control Design using Adaptive Dynamic Programming instills a solid understanding of neural network-based optimal controllers under event-sampling and how to build them so as to attain CPS or Industry 4.0 vision.