Cameras for 3D depth imaging, using either time-of-flight (ToF) or structured light sensors, have received a lot of attention recently and have been improved considerably over the last few years. The present techniques make full-range 3D data available at video frame rates, and thus pave the way for a much broader application of 3D vision systems. A series of workshops have closely followed the developments within ToF imaging over the years. Today, depth imaging workshops can be found at every major computer vision conference. The papers presented in this volume stem from a seminar on Time-of-Flight Imaging held at Schloss Dagstuhl in October 2012. They cover all aspects of ToF depth imaging, from sensors and basic foundations, to algorithms for low level processing, to important applications that exploit depth imaging. In addition, this book contains the proceedings of a workshop on Imaging New Modalities, which was held at the German Conference on Pattern Recognition in Saarbrücken, Germany, in September 2013. A state-of-the-art report on the Kinect sensor and its applications is followed by two reports on local and global ToF motion compensation and a novel depth capture system using a plenoptic multi-lens multi-focus camera sensor.

Time-of-flight (TOF) cameras provide a depth value at each pixel, from which the 3D structure of the scene can be estimated. This new type of active sensor makes it possible to go beyond traditional 2D image processing, directly to depth-based and 3D scene processing. Many computer vision and graphics applications can benefit from TOF data, including 3D reconstruction, activity and gesture recognition, motion capture and face detection. It is already possible to use multiple TOF cameras, in order to increase the scene coverage, and to combine the depth data with images from several colour cameras. Mixed TOF and colour systems can be used for computational photography, including full 3D scene modelling, as well as for illumination and depth-of-field manipulations. This work is a technical introduction to TOF sensors, from architectural and design issues, to selected image processing and computer vision methods.

This book provides a comprehensive overview of the key technologies and applications related to new cameras that have brought 3D data acquisition to the mass market. It covers both the theoretical principles behind the acquisition devices and the practical implementation aspects of the computer vision algorithms needed for the various applications. Real data examples are used in order to show the performances of the various algorithms. The performance and limitations of the depth camera technology are explored, along with an extensive review of the most effective methods for addressing challenges in common applications. Applications covered in specific detail include scene segmentation, 3D scene reconstruction, human pose estimation and tracking and gesture recognition. This book offers students, practitioners and researchers the tools necessary to explore the potential uses of depth data in light of the expanding number of devices available for sale. It explores the impact of these devices on the rapidly growing field of depth-based computer vision.

This book explains how depth measurements from the Time-of-Flight (ToF) range imaging cameras are influenced by the electronic timing-jitter. The author presents jitter extraction and measurement techniques for any type of ToF range imaging cameras. The author mainly focuses on ToF cameras that are based on the amplitude modulated continuous wave (AMCW) lidar techniques that measure the phase difference between the emitted and reflected light signals. The book discusses timing-jitter in the emitted light signal, which is sensible since the light signal of the camera is relatively straightforward to access. The specific types of jitter that present on the light source signal are investigated throughout the book. The book is structured across three main sections: a brief literature review, jitter measurement, and jitter influence in AMCW ToF range imaging.

This book is a printed edition of the Special Issue "Remote Sensed Data and Processing Methodologies for 3D Virtual Reconstruction and Visualization of Complex Architectures" that was published in Remote Sensing

This book presents an interdisciplinary selection of cutting-edge research on RGB-D based computer vision. Features: discusses the calibration of color and depth cameras, the reduction of noise on depth maps and methods for capturing human performance in 3D; reviews a selection of applications which use RGB-D information to reconstruct human figures, evaluate energy consumption and obtain accurate action classification; presents an approach for 3D object retrieval and for the reconstruction of gas flow from multiple Kinect cameras; describes an RGB-D computer vision system designed to assist the visually impaired and another for smart-environment sensing to assist elderly and disabled people; examines the effective features that characterize static hand poses and introduces a unified framework to enforce both temporal and spatial constraints for hand parsing; proposes a new classifier architecture for real-time hand pose recognition and a novel hand segmentation and gesture recognition system.

This book presents prospective, industrially proven methods and software solutions for storing, processing, and viewing multimedia content on digital cameras, camcorders, TV, and mobile devices. Most of the algorithms described here are implemented as systems on chip firmware or as software products and have low computational complexity and memory consumption. In the four parts of the book, which contains a total of 16 chapters, the authors address solutions for the conversion of images and videos by super-resolution, depth estimation and control and mono-to-stereo (2D to 3D) conversion; display applications by video editing; the real-time detection of sport episodes; and the generation and reproduction of natural effects. The practical principles of machine learning are illustrated using technologies such as image classification as a service, mobile user profiling, and automatic view planning with dictionary-based compressed sensing in magnetic resonance imaging. The implementation of these technologies in mobile devices is discussed in relation to algorithms using a depth camera based on a colour-coded aperture, the animated graphical abstract of an image, a motion photo, and approaches and methods for iris recognition on mobile platforms. The book reflects the authors’ practical experience in the development of algorithms for industrial R&D and the commercialization of technologies. Explains digital techniques for digital cameras, camcorders, TV, mobile devices; Offers essential algorithms for the processing pipeline in multimedia devices and accompanying software tools; Features advanced topics on data processing, addressing current technology challenges.