This book provides an overview of model-based environmental visual perception for humanoid robots. The visual perception of a humanoid robot creates a bidirectional bridge connecting sensor signals with internal representations of environmental objects. The objective of such perception systems is to answer two fundamental questions: What & where is it? To answer these questions using a sensor-to-representation bridge, coordinated processes are conducted to extract and exploit cues matching robot’s mental representations to physical entities. These include sensor & actuator modeling, calibration, filtering, and feature extraction for state estimation. This book discusses the following topics in depth: • Active Sensing: Robust probabilistic methods for optimal, high dynamic range image acquisition are suitable for use with inexpensive cameras. This enables ideal sensing in arbitrary environmental conditions encountered in human-centric spaces. The book quantitatively shows the importance of equipping robots with dependable visual sensing. • Feature Extraction & Recognition: Parameter-free, edge extraction methods based on structural graphs enable the representation of geometric primitives effectively and efficiently. This is done by eccentricity segmentation providing excellent recognition even on noisy & low-resolution images. Stereoscopic vision, Euclidean metric and graph-shape descriptors are shown to be powerful mechanisms for difficult recognition tasks. • Global Self-Localization & Depth Uncertainty Learning: Simultaneous feature matching for global localization and 6D self-pose estimation are addressed by a novel geometric and probabilistic concept using intersection of Gaussian spheres. The path from intuition to the closed-form optimal solution determining the robot location is described, including a supervised learning method for uncertainty depth modeling based on extensive ground-truth training data from a motion capture system. The methods and experiments are presented in self-contained chapters with comparisons and the state of the art. The algorithms were implemented and empirically evaluated on two humanoid robots: ARMAR III-A & B. The excellent robustness, performance and derived results received an award at the IEEE conference on humanoid robots and the contributions have been utilized for numerous visual manipulation tasks with demonstration at distinguished venues such as ICRA, CeBIT, IAS, and Automatica.

Dealing with visual perception in robots and its applications to manipulation and imitation, this monograph focuses on stereo-based methods and systems for object recognition and 6 DoF pose estimation as well as for marker-less human motion capture.

This book moves toward the realization of domestic robots by presenting an integrated view of computer vision and robotics, covering fundamental topics including optimal sensor design, visual servo-ing, 3D object modelling and recognition, and multi-cue tracking, emphasizing robustness throughout. Covering theory and implementation, experimental results and comprehensive multimedia support including video clips, VRML data, C++ code and lecture slides, this book is a practical reference for roboticists and a valuable teaching resource.

Tomorrow's robots, which includes the humanoid robot, can perform task like tutoring children, working as tour guides, driving humans to and from work, do the family shopping etc. Tomorrow's robots will enhance lives in ways we never dreamed possible. No time to attend the decisive meeting on Asian strategy? Let your robot go for you and make the decisions. Not feeling well enough to go to the clinic? Let Dr Robot come to you, make a diagnosis, and get you the necessary medicine for treatment. No time to coach the soccer team this week? Let the robot do it for you. Tomorrow's robots will be the most exciting and revolutionary things to happen to the world since the invention of the automobile. It will change the way we work, play, think, and live. Because of this, nowadays robotics is one of the most dynamic fields of scientific research. These days, robotics is offered in almost every university in the world. Most mechanical engineering departments offer a similar course at both the undergraduate and graduate levels. And increasingly, many computer and electrical engineering departments are also offering it. This book will guide you, the curious beginner, from yesterday to tomorrow. The book will cover practical knowledge in understanding, developing, and using robots as versatile equipment to automate a variety of industrial processes or tasks. But, the book will also discuss the possibilities we can look forward to when we are capable of creating a vision-guided, learning machine. Readership: Upper-level undergraduates, graduates and researchers in robotics &automated systems, artificial intelligence, machine perception and computer vision.

Visual perception is one of the most important sources of information for both humans and robots. A particular challenge is the acquisition and interpretation of complex unstructured scenes. This work contributes to active vision for humanoid robots. A semantic model of the scene is created, which is extended by successively changing the robot's view in order to explore interaction possibilities of the scene.