A basic problem in computer vision is to understand the structure of a real world scene given several images of it. Techniques for solving this problem are taken from projective geometry and photogrammetry. Here, the authors cover the geometric principles and their algebraic representation in terms of camera projection matrices, the fundamental matrix and the trifocal tensor. The theory and methods of computation of these entities are discussed with real examples, as is their use in the reconstruction of scenes from multiple images. The new edition features an extended introduction covering the key ideas in the book (which itself has been updated with additional examples and appendices) and significant new results which have appeared since the first edition. Comprehensive background material is provided, so readers familiar with linear algebra and basic numerical methods can understand the projective geometry and estimation algorithms presented, and implement the algorithms directly from the book.

This book constitutes selected papers from the First International Symposium on Geometry and Vision, ISGV 2021, held in Auckland, New Zealand, in January 2021. Due to the COVID-19 pandemic the conference was held in partially virtual format. The 29 papers were thoroughly reviewed and selected from 50 submissions. They cover topics in areas of digital geometry, graphics, image and video technologies, computer vision, and multimedia technologies.

This book introduces the geometry of 3-D vision, that is, the reconstruction of 3-D models of objects from a collection of 2-D images. It details the classic theory of two view geometry and shows that a more proper tool for studying the geometry of multiple views is the so-called rank consideration of the multiple view matrix. It also develops practical reconstruction algorithms and discusses possible extensions of the theory.

This textbook offers a statistical view on the geometry of multiple view analysis, required for camera calibration and orientation and for geometric scene reconstruction based on geometric image features. The authors have backgrounds in geodesy and also long experience with development and research in computer vision, and this is the first book to present a joint approach from the converging fields of photogrammetry and computer vision. Part I of the book provides an introduction to estimation theory, covering aspects such as Bayesian estimation, variance components, and sequential estimation, with a focus on the statistically sound diagnostics of estimation results essential in vision metrology. Part II provides tools for 2D and 3D geometric reasoning using projective geometry. This includes oriented projective geometry and tools for statistically optimal estimation and test of geometric entities and transformations and their relations, tools that are useful also in the context of uncertain reasoning in point clouds. Part III is devoted to modelling the geometry of single and multiple cameras, addressing calibration and orientation, including statistical evaluation and reconstruction of corresponding scene features and surfaces based on geometric image features. The authors provide algorithms for various geometric computation problems in vision metrology, together with mathematical justifications and statistical analysis, thus enabling thorough evaluations. The chapters are self-contained with numerous figures and exercises, and they are supported by an appendix that explains the basic mathematical notation and a detailed index. The book can serve as the basis for undergraduate and graduate courses in photogrammetry, computer vision, and computer graphics. It is also appropriate for researchers, engineers, and software developers in the photogrammetry and GIS industries, particularly those engaged with statistically based geometric computer vision methods.

This classroom-tested and easy-to-understand textbook/reference describes the state of the art in 3D reconstruction from multiple images, taking into consideration all aspects of programming and implementation. Unlike other computer vision textbooks, this guide takes a unique approach in which the initial focus is on practical application and the procedures necessary to actually build a computer vision system. The theoretical background is then briefly explained afterwards, highlighting how one can quickly and simply obtain the desired result without knowing the derivation of the mathematical detail. Features: reviews the fundamental algorithms underlying computer vision; describes the latest techniques for 3D reconstruction from multiple images; summarizes the mathematical theory behind statistical error analysis for general geometric estimation problems; presents derivations at the end of each chapter, with solutions supplied at the end of the book; provides additional material at an associated website.

This monograph by one of the world's leading vision researchers provides a thorough, mathematically rigorous exposition of a broad and vital area in computer vision: the problems and techniques related to three-dimensional (stereo) vision and motion. The emphasis is on using geometry to solve problems in stereo and motion, with examples from navigation and object recognition. Faugeras takes up such important problems in computer vision as projective geometry, camera calibration, edge detection, stereo vision (with many examples on real images), different kinds of representations and transformations (especially 3-D rotations), uncertainty and methods of addressing it, and object representation and recognition. His theoretical account is illustrated with the results of actual working programs.Three-Dimensional Computer Vision proposes solutions to problems arising from a specific robotics scenario in which a system must perceive and act. Moving about an unknown environment, the system has to avoid static and mobile obstacles, build models of objects and places in order to be able to recognize and locate them, and characterize its own motion and that of moving objects, by providing descriptions of the corresponding three-dimensional motions. The ideas generated, however, can be used indifferent settings, resulting in a general book on computer vision that reveals the fascinating relationship of three-dimensional geometry and the imaging process.

This book describes several mathematical models of the primary visual cortex, referring them to a vast ensemble of experimental data and putting forward an original geometrical model for its functional architecture, that is, the highly specific organization of its neural connections. The book spells out the geometrical algorithms implemented by this functional architecture, or put another way, the “neurogeometry” immanent in visual perception. Focusing on the neural origins of our spatial representations, it demonstrates three things: firstly, the way the visual neurons filter the optical signal is closely related to a wavelet analysis; secondly, the contact structure of the 1-jets of the curves in the plane (the retinal plane here) is implemented by the cortical functional architecture; and lastly, the visual algorithms for integrating contours from what may be rather incomplete sensory data can be modelled by the sub-Riemannian geometry associated with this contact structure. As such, it provides readers with the first systematic interpretation of a number of important neurophysiological observations in a well-defined mathematical framework. The book’s neuromathematical exploration appeals to graduate students and researchers in integrative-functional-cognitive neuroscience with a good mathematical background, as well as those in applied mathematics with an interest in neurophysiology.