This monograph covers theoretical and practical aspects of the problem of autonomous guiding of unmanned aerial manipulators using visual information. For the estimation of the vehicle state (position, orientation, velocity, and acceleration), the authors propose a method that relies exclusively on the use of low-cost and highrate sensors together with low-complexity algorithms. This is particularly interesting for applications in which on board computation with low computation power is needed. Another relevant topic covered in this monograph is visual servoing. The authors present an uncalibrated visual servo scheme, capable of estimating at run time, the camera focal length from the observation of a tracked target. The monograph also covers several control techniques, which achieve a number of tasks, such as robot and arm positioning, improve stability and enhance robot arm motions. All methods discussed in this monograph are demonstrated in simulation and through real robot experimentation. The text is appropriate for readers interested in state estimation and control of aerial manipulators, and is a reference book for people who work in mobile robotics research in general.

The ability to fly has greatly expanded the possibilities for robots to perform surveillance, inspection or map generation tasks. Yet it was only in recent years that research in aerial robotics was mature enough to allow active interactions with the environment. The robots responsible for these interactions are called aerial manipulators and usually combine a multirotor platform and one or more robotic arms. The main objective of this thesis is to formalize the concept of aerial manipulator and present guidance methods, using visual information, to provide them with autonomous functionalities. A key competence to control an aerial manipulator is the ability to localize it in the environment. Traditionally, this localization has required external infrastructure of sensors (e.g., GPS or IR cameras), restricting the real applications. Furthermore, localization methods with on-board sensors, exported from other robotics fields such as simultaneous localization and mapping (SLAM), require large computational units becoming a handicap in vehicles where size, load, and power consumption are important restrictions. In this regard, this thesis proposes a method to estimate the state of the vehicle (i.e., position, orientation, velocity and acceleration) by means of on-board, low-cost, light-weight and high-rate sensors. With the physical complexity of these robots, it is required to use advanced control techniques during navigation. Thanks to their redundancy on degrees-of-freedom, they offer the possibility to accomplish not only with mobility requirements but with other tasks simultaneously and hierarchically, prioritizing them depending on their impact to the overall mission success. In this work we present such control laws and define a number of these tasks to drive the vehicle using visual information, guarantee the robot integrity during flight, and improve the platform stability or increase arm operability. The main contributions of this research work are threefold: (1) Present a localization technique to allow autonomous navigation, this method is specifically designed for aerial platforms with size, load and computational burden restrictions. (2) Obtain control commands to drive the vehicle using visual information (visual servo). (3) Integrate the visual servo commands into a hierarchical control law by exploiting the redundancy of the robot to accomplish secondary tasks during flight. These tasks are specific for aerial manipulators and they are also provided. All the techniques presented in this document have been validated throughout extensive experimentation with real robotic platforms.

This text is a thorough treatment of the rapidly growing area of aerial manipulation. It details all the design steps required for the modeling and control of unmanned aerial vehicles (UAV) equipped with robotic manipulators. Starting with the physical basics of rigid-body kinematics, the book gives an in-depth presentation of local and global coordinates, together with the representation of orientation and motion in fixed- and moving-coordinate systems. Coverage of the kinematics and dynamics of unmanned aerial vehicles is developed in a succession of popular UAV configurations for multirotor systems. Such an arrangement, supported by frequent examples and end-of-chapter exercises, leads the reader from simple to more complex UAV configurations. Propulsion-system aerodynamics, essential in UAV design, is analyzed through blade-element and momentum theories, analysis which is followed by a description of drag and ground-aerodynamic effects. The central part of the book is dedicated to aerial-manipulator kinematics, dynamics, and control. Based on foundations laid in the opening chapters, this portion of the book is a structured presentation of Newton–Euler dynamic modeling that results in forward and backward equations in both fixed- and moving-coordinate systems. The Lagrange–Euler approach is applied to expand the model further, providing formalisms to model the variable moment of inertia later used to analyze the dynamics of aerial manipulators in contact with the environment. Using knowledge from sensor data, insights are presented into the ways in which linear, robust, and adaptive control techniques can be applied in aerial manipulation so as to tackle the real-world problems faced by scholars and engineers in the design and implementation of aerial robotics systems. The book is completed by path and trajectory planning with vision-based examples for tracking and manipulation.

Written by an expert with more than 30 years of experience, Guidance of Unmanned Aerial Vehicles contains new analytical results, taken from the author’s research, which can be used for analysis and design of unmanned aerial vehicles guidance and control systems. This book progresses from a clear elucidation of guidance laws and unmanned aerial vehicle dynamics to the modeling of their guidance and control systems. Special attention is paid to guidance of autonomous UAVs, which differs from traditional missile guidance. The author explains UAV applications, contrasting them to a missile’s limited ability (or inability) to control axial acceleration. The discussion of guidance laws for UAVs presents a generalization of missile guidance laws developed by the author. The computational algorithms behind these laws are tested in three applications—for the surveillance problem, the refueling problem, and for the motion control of a swarm of UAVs. The procedure of choosing and testing the guidance laws is also considered in an example of future generation of airborne interceptors launched from UAVs. The author provides an innovative presentation of the theoretical aspects of unmanned aerial vehicles’ guidance that cannot be found in any other book. It presents new ideas that, once crystallized, can be implemented in the new generation of unmanned aerial systems.

Control of Autonomous Aerial Vehicles is an edited book that provides a single-volume snapshot on the state of the art in the field of control theory applied to the design of autonomous unmanned aerial vehicles (UAVs), aka “drones”, employed in a variety of applications. The homogeneous structure allows the reader to transition seamlessly through results in guidance, navigation, and control of UAVs, according to the canonical classification of the main components of a UAV’s autopilot. Each chapter has been written to assist graduate students and practitioners in the fields of aerospace engineering and control theory. The contributing authors duly present detailed literature reviews, conveying their arguments in a systematic way with the help of diagrams, plots, and algorithms. They showcase the applicability of their results by means of flight tests and numerical simulations, the results of which are discussed in detail. Control of Autonomous Aerial Vehicles will interest readers who are researchers, practitioners or graduate students in control theory, autonomous systems or robotics, or in aerospace, mechanical or electrical engineering.

Manipulating objects using arms mounted to unmanned aerial vehicles (UAVs) is attractive because UAVs may access many locations that are otherwise inaccessible to traditional mobile manipulation platforms such as ground vehicles. Historically, UAVs have been employed in ways that avoid interaction with the environment at all costs. The recent trend of increasing small UAV lift capacity and the reduction of the weight of manipulator components make the realization of mobile manipulating UAVs imminent. Despite recent work, several major challenges remain to be overcome before it will be common practice to manipulate objects from UAVs. Among these challenges, the constantly moving UAV platform and compliance of manipulator arms make it difficult to position the UAV and end-effector relative to an object of interest precisely enough for reliable manipulation. Solving this challenge will bring UAVs one step closer to being able to perform meaningful tasks such as infrastructure repair, disaster response, law enforcement, and personal assistance. Toward a solution to this challenge, this thesis describes a way forward that uses the UAV as a means to crudely position a manipulator within reach of the end-effector's goal position in the world. The manipulator then performs the fine positioning of the end-effector, rejecting position perturbations caused by UAV motions. An algorithm to coordinate the redundant degrees of freedom of an aerial manipulation system is described that allows the motions of the manipulator to serve as inputs to the UAV's position controller. To demonstrate this algorithm, the manipulator's six degrees of freedom are servoed using visual sensing to drive an eye-in-hand camera to a specified pose relative to a target while treating motions of the host platform as perturbations. Simultaneously, the host platform's degrees of freedom are regulated using kinematic information from the manipulator. This ultimately drives the UAV to a position that allows the manipulator to assume a pose relative to the UAV that maximizes reachability, thus facilitating the arm's ability to compensate for undesired UAV motions. Maintaining this loose kinematic coupling between the redundant degrees of freedom of the host UAV and manipulator allows this type of controller to be applied to a wide variety of platforms, including manned aircraft, rather than a single instance of a purpose-built system. As a result of this loose coupling, careful consideration must be given to the manipulator design so that it can achieve useful poses while minimally influencing the stability of the host UAV. Accordingly, the novel application of a parallel manipulator mechanism is described.

Unmanned Aerial Systems: Theoretical Foundation and Applications presents some of the latest innovative approaches to drones from the point-of-view of dynamic modeling, system analysis, optimization, control, communications, 3D-mapping, search and rescue, surveillance, farmland and construction monitoring, and more. With the emergence of low-cost UAS, a vast array of research works in academia and products in the industrial sectors have evolved. The book covers the safe operation of UAS, including, but not limited to, fundamental design, mission and path planning, control theory, computer vision, artificial intelligence, applications requirements, and more. This book provides a unique reference of the state-of-the-art research and development of unmanned aerial systems, making it an essential resource for researchers, instructors and practitioners. Covers some of the most innovative approaches to drones Provides the latest state-of-the-art research and development surrounding unmanned aerial systems Presents a comprehensive reference on unmanned aerial systems, with a focus on cutting-edge technologies and recent research trends in the area