A basic problem in computer vision is to understand the structure of a real world scene given several images of it. Techniques for solving this problem are taken from projective geometry and photogrammetry. Here, the authors cover the geometric principles and their algebraic representation in terms of camera projection matrices, the fundamental matrix and the trifocal tensor. The theory and methods of computation of these entities are discussed with real examples, as is their use in the reconstruction of scenes from multiple images. The new edition features an extended introduction covering the key ideas in the book (which itself has been updated with additional examples and appendices) and significant new results which have appeared since the first edition. Comprehensive background material is provided, so readers familiar with linear algebra and basic numerical methods can understand the projective geometry and estimation algorithms presented, and implement the algorithms directly from the book.

This book constitutes selected papers from the First International Symposium on Geometry and Vision, ISGV 2021, held in Auckland, New Zealand, in January 2021. Due to the COVID-19 pandemic the conference was held in partially virtual format. The 29 papers were thoroughly reviewed and selected from 50 submissions. They cover topics in areas of digital geometry, graphics, image and video technologies, computer vision, and multimedia technologies.

This textbook offers a statistical view on the geometry of multiple view analysis, required for camera calibration and orientation and for geometric scene reconstruction based on geometric image features. The authors have backgrounds in geodesy and also long experience with development and research in computer vision, and this is the first book to present a joint approach from the converging fields of photogrammetry and computer vision. Part I of the book provides an introduction to estimation theory, covering aspects such as Bayesian estimation, variance components, and sequential estimation, with a focus on the statistically sound diagnostics of estimation results essential in vision metrology. Part II provides tools for 2D and 3D geometric reasoning using projective geometry. This includes oriented projective geometry and tools for statistically optimal estimation and test of geometric entities and transformations and their relations, tools that are useful also in the context of uncertain reasoning in point clouds. Part III is devoted to modelling the geometry of single and multiple cameras, addressing calibration and orientation, including statistical evaluation and reconstruction of corresponding scene features and surfaces based on geometric image features. The authors provide algorithms for various geometric computation problems in vision metrology, together with mathematical justifications and statistical analysis, thus enabling thorough evaluations. The chapters are self-contained with numerous figures and exercises, and they are supported by an appendix that explains the basic mathematical notation and a detailed index. The book can serve as the basis for undergraduate and graduate courses in photogrammetry, computer vision, and computer graphics. It is also appropriate for researchers, engineers, and software developers in the photogrammetry and GIS industries, particularly those engaged with statistically based geometric computer vision methods.

Since its genesis more than thirty-five years ago, the field of computer vision has been known by various names, including pattern recognitions, image analysis, and image understanding. The central problem of computer vision is obtaining descriptive information by computer analysis of images of a scene. Together with the related fields of image processing and computer graphics, it has become an established discipline at the interface between computer science and electrical engineering. This volume contains fourteen papers presented at the AMS Special Session on Geometry Related to Computer Vision, held in Hoboken, New Jersey in Ooctober 1989. This book makes the results presented at the Special Session, which previously had been available only in the computer science literature, more widely available within the mathematical sciences community. Geometry plays a major role in computer vision since scene descriptions always involve geometrical properties of, and relations among, the objects of surfaces in the scene. The papers in this book provide a good sampling of geometric problems connected with computer vision. They deal with digital lines and curves, polygons, shape decompositions, digital connectedness and surfaces, digital metrics, and generalizations to higher-dimensional and graph-structured "spaces". Aimed at computer scientists specializing in image processing, computer vision, and pattern recognition - as well as mathematicians interested in applications to computer science - this book will provide readers with a view of how geometry is currently being applied to problems in computer vision.

This book introduces the geometry of 3-D vision, that is, the reconstruction of 3-D models of objects from a collection of 2-D images. It details the classic theory of two view geometry and shows that a more proper tool for studying the geometry of multiple views is the so-called rank consideration of the multiple view matrix. It also develops practical reconstruction algorithms and discusses possible extensions of the theory.

Appendix 164 3. A 3. A. 1 Approximate Estimation of Fundamental Matrix from General Matrix 164 3. A. 2 Estimation of Affine Transformation 165 4 RECOVERY OF EPIPOLAR GEOMETRY FROM LINE SEGMENTS OR LINES 167 Line Segments or Straight Lines 168 4. 1 4. 2 Solving Motion Using Line Segments Between Two Views 173 4. 2. 1 Overlap of Two Corresponding Line Segments 173 Estimating Motion by Maximizing Overlap 175 4. 2. 2 Implementation Details 4. 2. 3 176 Reconstructing 3D Line Segments 4. 2. 4 179 4. 2. 5 Experimental Results 180 4. 2. 6 Discussions 192 4. 3 Determining Epipolar Geometry of Three Views 194 4. 3. 1 Trifocal Constraints for Point Matches 194 4. 3. 2 Trifocal Constraints for Line Correspondences 199 4. 3. 3 Linear Estimation of K, L, and M Using Points and Lines 200 4. 3. 4 Determining Camera Projection Matrices 201 4. 3. 5 Image Transfer 203 4. 4 Summary 204 5 REDEFINING STEREO, MOTION AND OBJECT RECOGNITION VIA EPIPOLAR GEOMETRY 205 5. 1 Conventional Approaches to Stereo, Motion and Object Recognition 205 5. 1. 1 Stereo 205 5. 1. 2 Motion 206 5. 1. 3 Object Recognition 207 5. 2 Correspondence in Stereo, Motion and Object Recognition as 1D Search 209 5. 2. 1 Stereo Matching 209 xi Contents 5. 2. 2 Motion Correspondence and Segmentation 209 5. 2. 3 3D Object Recognition and Localization 210 Disparity and Spatial Disparity Space 210 5.

This book describes several mathematical models of the primary visual cortex, referring them to a vast ensemble of experimental data and putting forward an original geometrical model for its functional architecture, that is, the highly specific organization of its neural connections. The book spells out the geometrical algorithms implemented by this functional architecture, or put another way, the “neurogeometry” immanent in visual perception. Focusing on the neural origins of our spatial representations, it demonstrates three things: firstly, the way the visual neurons filter the optical signal is closely related to a wavelet analysis; secondly, the contact structure of the 1-jets of the curves in the plane (the retinal plane here) is implemented by the cortical functional architecture; and lastly, the visual algorithms for integrating contours from what may be rather incomplete sensory data can be modelled by the sub-Riemannian geometry associated with this contact structure. As such, it provides readers with the first systematic interpretation of a number of important neurophysiological observations in a well-defined mathematical framework. The book’s neuromathematical exploration appeals to graduate students and researchers in integrative-functional-cognitive neuroscience with a good mathematical background, as well as those in applied mathematics with an interest in neurophysiology.