A basic problem in computer vision is to understand the structure of a real world scene given several images of it. Techniques for solving this problem are taken from projective geometry and photogrammetry. Here, the authors cover the geometric principles and their algebraic representation in terms of camera projection matrices, the fundamental matrix and the trifocal tensor. The theory and methods of computation of these entities are discussed with real examples, as is their use in the reconstruction of scenes from multiple images. The new edition features an extended introduction covering the key ideas in the book (which itself has been updated with additional examples and appendices) and significant new results which have appeared since the first edition. Comprehensive background material is provided, so readers familiar with linear algebra and basic numerical methods can understand the projective geometry and estimation algorithms presented, and implement the algorithms directly from the book.

A basic problem in computer vision is to understand the structure of a real world scene given several images of it. Techniques for solving this problem are taken from projective geometry and photogrammetry. Here, the authors cover the geometric principles and their algebraic representation in terms of camera projection matrices, the fundamental matrix and the trifocal tensor. The theory and methods of computation of these entities are discussed with real examples, as is their use in the reconstruction of scenes from multiple images. The new edition features an extended introduction covering the key ideas in the book (which itself has been updated with additional examples and appendices) and significant new results which have appeared since the first edition. Comprehensive background material is provided, so readers familiar with linear algebra and basic numerical methods can understand the projective geometry and estimation algorithms presented, and implement the algorithms directly from the book.

How to reconstruct scenes from images using geometry and algebra, with applications to computer vision.

Since its genesis more than thirty-five years ago, the field of computer vision has been known by various names, including pattern recognitions, image analysis, and image understanding. The central problem of computer vision is obtaining descriptive information by computer analysis of images of a scene. Together with the related fields of image processing and computer graphics, it has become an established discipline at the interface between computer science and electrical engineering. This volume contains fourteen papers presented at the AMS Special Session on Geometry Related to Computer Vision, held in Hoboken, New Jersey in Ooctober 1989. This book makes the results presented at the Special Session, which previously had been available only in the computer science literature, more widely available within the mathematical sciences community. Geometry plays a major role in computer vision since scene descriptions always involve geometrical properties of, and relations among, the objects of surfaces in the scene. The papers in this book provide a good sampling of geometric problems connected with computer vision. They deal with digital lines and curves, polygons, shape decompositions, digital connectedness and surfaces, digital metrics, and generalizations to higher-dimensional and graph-structured "spaces". Aimed at computer scientists specializing in image processing, computer vision, and pattern recognition - as well as mathematicians interested in applications to computer science - this book will provide readers with a view of how geometry is currently being applied to problems in computer vision.

This textbook offers a statistical view on the geometry of multiple view analysis, required for camera calibration and orientation and for geometric scene reconstruction based on geometric image features. The authors have backgrounds in geodesy and also long experience with development and research in computer vision, and this is the first book to present a joint approach from the converging fields of photogrammetry and computer vision. Part I of the book provides an introduction to estimation theory, covering aspects such as Bayesian estimation, variance components, and sequential estimation, with a focus on the statistically sound diagnostics of estimation results essential in vision metrology. Part II provides tools for 2D and 3D geometric reasoning using projective geometry. This includes oriented projective geometry and tools for statistically optimal estimation and test of geometric entities and transformations and their relations, tools that are useful also in the context of uncertain reasoning in point clouds. Part III is devoted to modelling the geometry of single and multiple cameras, addressing calibration and orientation, including statistical evaluation and reconstruction of corresponding scene features and surfaces based on geometric image features. The authors provide algorithms for various geometric computation problems in vision metrology, together with mathematical justifications and statistical analysis, thus enabling thorough evaluations. The chapters are self-contained with numerous figures and exercises, and they are supported by an appendix that explains the basic mathematical notation and a detailed index. The book can serve as the basis for undergraduate and graduate courses in photogrammetry, computer vision, and computer graphics. It is also appropriate for researchers, engineers, and software developers in the photogrammetry and GIS industries, particularly those engaged with statistically based geometric computer vision methods.

This book introduces the geometry of 3-D vision, that is, the reconstruction of 3-D models of objects from a collection of 2-D images. It details the classic theory of two view geometry and shows that a more proper tool for studying the geometry of multiple views is the so-called rank consideration of the multiple view matrix. It also develops practical reconstruction algorithms and discusses possible extensions of the theory.

Appendix 164 3. A 3. A. 1 Approximate Estimation of Fundamental Matrix from General Matrix 164 3. A. 2 Estimation of Affine Transformation 165 4 RECOVERY OF EPIPOLAR GEOMETRY FROM LINE SEGMENTS OR LINES 167 Line Segments or Straight Lines 168 4. 1 4. 2 Solving Motion Using Line Segments Between Two Views 173 4. 2. 1 Overlap of Two Corresponding Line Segments 173 Estimating Motion by Maximizing Overlap 175 4. 2. 2 Implementation Details 4. 2. 3 176 Reconstructing 3D Line Segments 4. 2. 4 179 4. 2. 5 Experimental Results 180 4. 2. 6 Discussions 192 4. 3 Determining Epipolar Geometry of Three Views 194 4. 3. 1 Trifocal Constraints for Point Matches 194 4. 3. 2 Trifocal Constraints for Line Correspondences 199 4. 3. 3 Linear Estimation of K, L, and M Using Points and Lines 200 4. 3. 4 Determining Camera Projection Matrices 201 4. 3. 5 Image Transfer 203 4. 4 Summary 204 5 REDEFINING STEREO, MOTION AND OBJECT RECOGNITION VIA EPIPOLAR GEOMETRY 205 5. 1 Conventional Approaches to Stereo, Motion and Object Recognition 205 5. 1. 1 Stereo 205 5. 1. 2 Motion 206 5. 1. 3 Object Recognition 207 5. 2 Correspondence in Stereo, Motion and Object Recognition as 1D Search 209 5. 2. 1 Stereo Matching 209 xi Contents 5. 2. 2 Motion Correspondence and Segmentation 209 5. 2. 3 3D Object Recognition and Localization 210 Disparity and Spatial Disparity Space 210 5.