Taking another lesson from nature, the latest advances in image processing technology seek to combine image data from several diverse types of sensors in order to obtain a more accurate view of the scene: very much the same as we rely on our five senses. Multi-Sensor Image Fusion and Its Applications is the first text dedicated to the theory and practice of the registration and fusion of image data, covering such approaches as statistical methods, color-related techniques, model-based methods, and visual information display strategies. After a review of state-of-the-art image fusion techniques, the book provides an overview of fusion algorithms and fusion performance evaluation. The following chapters explore recent progress and practical applications of the proposed techniques to solving problems in such areas as medical diagnosis, surveillance and biometric systems, remote sensing, nondestructive evaluation, blurred image restoration, and image quality assessment. Recognized leaders from industry and academia contribute the chapters, reflecting the latest research trends and providing useful algorithms to aid implementation. Supplying a 28-page full-color insert, Multi-Sensor Image Fusion and Its Applications clearly demonstrates the benefits and possibilities of this revolutionary development. It provides a solid knowledge base for applying these cutting-edge techniques to new challenges and creating future advances.

Remote Sensing Image Fusion: A Practical Guide gives an introduction to remote sensing image fusion providing an overview on the sensors and applications. It describes data selection, application requirements and the choice of a suitable image fusion technique. It comprises a diverse selection of successful image fusion cases that are relevant to other users and other areas of interest around the world. The book helps newcomers to obtain a quick start into the practical value and benefits of multi-sensor image fusion. Experts will find this book useful to obtain an overview on the state of the art and understand current constraints that need to be solved in future research efforts. For industry professionals the book can be a great introduction and basis to understand multisensor remote sensing image exploitation and the development of commercialized image fusion software from a practical perspective. The book concludes with a chapter on current trends and future developments in remote sensing image fusion. Along with the book, RSIF website provides additional up-to-date information in the field.

Understand multi-sensor fusion--the most sophisticated way to deliver accurate real-world data to computer systems. Applications include aviation, medicine, military, manufacturing, and transportation. The Sensor Fusion Toolkit on disk contains C programs discussed in the book and supports each section.

This thesis investigates the issues of implementing multi-sensor imaging system for surveillance applications. Three topics for the fusion of infrared and electro-optic images are studied, i.e. registration, fusion, and evaluation. The first topic is the image registration or alignment, which is to associate corresponding pixels in multiple images to the same physical point in the scene. A trajectory-based method for registering infrared and electro-optic video sequences is proposed in this study. The initial registration parameters are derived from matching the trajectories across the consecutive video frames. Further refinement can be carried out by applying a maximum mutual information approach. The frame difference, from which the feature point is detected, is found with an image structural similarity measurement. The second topic is the implementation of pixel-level fusion. Two applications are considered in this study. Motivated by the adaptive enhancement, a modified pixel-level fusion scheme is proposed to implement the context enhancement. A visual image is first enhanced with the corresponding infrared image. Then, the enhanced image is fused with the visual image again to highlight the background features. This achieves a context enhancement most suitable for human perception. As the application of multi-sensor concealed weapon detection (CWD) is concerned, this thesis clarifies the requirements and concepts for CWD. How the CWD application can benefit from multi-sensor fusion is identified and a framework of multi-sensor CWD is proposed. A solution to synthesize a composite image from infrared and visual image is presented with experimental results. The synthesized image, on one hand provides both the information of personal identification and the suspicious region of concealed weapons; on the other hand implements the privacy protection, which appears to be an important aspect of the CWD process. The third topic is about the fusion performance assessment. In this study, the evaluation metrics are developed for reference-based assessment and blind assessment respectively. An absolute measurement of image features, namely phase congruency, is employed. Future work should include the reliability and optimization study of multiple image sensors from applications' and human perception-related perspectives. This thesis is a contribution to such research.

The purpose of this book is to provide a practical introduction to the th- ries, techniques and applications of image fusion. The present work has been designed as a textbook for a one-semester ?nal-year undergraduate, or ?r- year graduate, course in image fusion. It should also be useful to practising engineers who wish to learn the concepts of image fusion and apply them to practical applications. In addition, the book may also be used as a supp- mentary text for a graduate course on topics in advanced image processing. The book complements the author’s previous work on multi-sensor data [1] fusion by concentrating exclusively on the theories, techniques and app- cations of image fusion. The book is intended to be self-contained in so far as the subject of image fusion is concerned, although some prior exposure to the ?eld of computer vision and image processing may be helpful to the reader. Apart from two preliminary chapters, the book is divided into three parts.

Multisensor Data Fusion: From Algorithms and Architectural Design to Applications covers the contemporary theory and practice of multisensor data fusion, from fundamental concepts to cutting-edge techniques drawn from a broad array of disciplines. Featuring contributions from the world’s leading data fusion researchers and academicians, this authoritative book: Presents state-of-the-art advances in the design of multisensor data fusion algorithms, addressing issues related to the nature, location, and computational ability of the sensors Describes new materials and achievements in optimal fusion and multisensor filters Discusses the advantages and challenges associated with multisensor data fusion, from extended spatial and temporal coverage to imperfection and diversity in sensor technologies Explores the topology, communication structure, computational resources, fusion level, goals, and optimization of multisensor data fusion system architectures Showcases applications of multisensor data fusion in fields such as medicine, transportation's traffic, defense, and navigation Multisensor Data Fusion: From Algorithms and Architectural Design to Applications is a robust collection of modern multisensor data fusion methodologies. The book instills a deeper understanding of the basics of multisensor data fusion as well as a practical knowledge of the problems that can be faced during its execution.

Multi-sensor image fusion focuses on processing images of the same object or scene acquired by multiple sensors, in which various sensors with multi-level and multi-spatial information are complemented and combined to ultimately yield a consistent interpretation of the observed environment. In recent years, multi-sensor image fusion has become a highly active topic, and various fusion methods have been proposed. Many effective processing methods, including multi-scale transformation, fuzzy inference, and deep learning, have been introduced to design fusion algorithms. Despite the great progress, there are still some noteworthy challenges in the field, such as the lack of unified fusion theories and methods for effective generalized fusion, the lack of fault tolerance and robustness, the lack of benchmarks for performance evaluation, the lack of work on specific applications of multi-sensor image fusion, and so on.