Introduces object tracking algorithms from a unified, recursive Bayesian perspective, along with performance bounds and illustrative examples.

This book constitutes the thoroughly refereed joint post-workshop proceedings of two co-located events: the Second International Workshop on Classification of Events, Activities and Relationships, CLEAR 2007, and the 5th Rich Transcription 2007 Meeting Recognition evaluation, RT 2007, held in succession in Baltimore, MD, USA, in May 2007. The workshops had complementary evaluation efforts; CLEAR for the evaluation of human activities, events, and relationships in multiple multimodal data domains; and RT for the evaluation of speech transcription-related technologies from meeting room audio collections. The 35 revised full papers presented from CLEAR 2007 cover 3D person tracking, 2D face detection and tracking, person and vehicle tracking on surveillance data, vehicle and person tracking aerial videos, person identification, head pose estimation, and acoustic event detection. The 15 revised full papers presented from RT 2007 are organized in topical sections on speech-to-text, and speaker diarization.

With the increase in urban population, it became necessary to keep track of the object of interest. In favor of SDGs for sustainable smart city, with the advancement in technology visual tracking extends to track multi-target present in the scene rather estimating location for single target only. In contrast to single object tracking, multi-target introduces one extra step of detection. Tracking multi-target includes detecting and categorizing the target into multiple classes in the first frame and provides each individual target an ID to keep its track in the subsequent frames of a video stream. One category of multi-target algorithms exploits global information to track the target of the detected target. On the other hand, some algorithms consider present and past information of the target to provide efficient tracking solutions. Apart from these, deep leaning-based algorithms provide reliable and accurate solutions. But, these algorithms are computationally slow when applied in real-time. This book presents and summarizes the various visual tracking algorithms and challenges in the domain. The various feature that can be extracted from the target and target saliency prediction is also covered. It explores a comprehensive analysis of the evolution from traditional methods to deep learning methods, from single object tracking to multi-target tracking. In addition, the application of visual tracking and the future of visual tracking can also be introduced to provide the future aspects in the domain to the reader. This book also discusses the advancement in the area with critical performance analysis of each proposed algorithm. This book will be formulated with intent to uncover the challenges and possibilities of efficient and effective tracking of single or multi-object, addressing the various environmental and hardware challenges. The intended audience includes academicians, engineers, postgraduate students, developers, professionals, military personals, scientists, data analysts, practitioners, and people who are interested in exploring more about tracking.· Another projected audience are the researchers and academicians who identify and develop methodologies, frameworks, tools, and applications through reference citations, literature reviews, quantitative/qualitative results, and discussions.

During the past decade, object detection and object tracking in videos have received a great deal of attention from the research community in view of their many applications, such as human activity recognition, human computer interaction, crowd scene analysis, video surveillance, sports video analysis, autonomous vehicle navigation, driver assistance systems, and traffic management. Object detection and object tracking face a number of challenges such as variation in scale, appearance, view of the objects, as well as occlusion, and changes in illumination and environmental conditions. Object tracking has some other challenges such as similar appearance among multiple targets and long-term occlusion, which may cause failure in tracking. Detection-based tracking techniques use an object detector for guiding the tracking process. However, existing object detectors usually suffer from detection errors, which may mislead the trackers, if used for tracking. Thus, improving the performance of the existing detection schemes will consequently enhance the performance of detection-based trackers. The objective of this research is two fold: (a) to investigate the use of 2D discrete Fourier and cosine transforms for vehicle detection, and (b) to develop a detection-based online multi-object tracking technique.The first part of the thesis deals with the use of 2D discrete Fourier and cosine transforms for vehicle detection. For this purpose, we introduce the transform-domain two-dimensional histogram of oriented gradients (TD2DHOG) features, as a truncated version of 2DHOG in the 2DDFT or 2DDCT domain. It is shown that these TD2DHOG features obtained from an image at the original resolution and a downsampled version from the same image are approximately the same within a multiplicative factor. This property is then utilized in developing a scheme for the detection of vehicles of various resolutions using a single classifier rather than multiple resolution-specific classifiers. Extensive experiments are conducted, which show that the use of the single classifier in the proposed detection scheme reduces drastically the training and storage cost over the use of a classifier pyramid, yet providing a detection accuracy similar to that obtained using TD2DHOG features with a classifier pyramid. Furthermore, the proposed method provides a detection accuracy that is similar or even better than that provided by the state-of-the-art techniques.In the second part of the thesis, a robust collaborative model, which enhances the interaction between a pre-trained object detector and a number of particle filter-based single-object online trackers, is proposed. The proposed scheme is based on associating a detection with a tracker for each frame. For each tracker, a motion model that incorporates the associated detections with the object dynamics, and a likelihood function that provides different weights for the propagated particles and the newly created ones from the associated detections are introduced, with a view to reduce the effect of detection errors on the tracking process. Finally, a new image sample selection scheme is introduced in order to update the appearance model of a given tracker. Experimental results show the effectiveness of the proposed scheme in enhancing the multi-object tracking performance.

This book shows how machine learning can detect moving objects in a digital video stream. The authors present different background subtraction approaches, foreground segmentation, and object tracking approaches to accomplish this. They also propose an algorithm that considers a multimodal background subtraction approach that can handle a dynamic background and different constraints. The authors show how the proposed algorithm is able to detect and track 2D & 3D objects in monocular sequences for both indoor and outdoor surveillance environments and at the same time, also able to work satisfactorily in a dynamic background and with challenging constraints. In addition, the shows how the proposed algorithm makes use of parameter optimization and adaptive threshold techniques as intrinsic improvements of the Gaussian Mixture Model. The presented system in the book is also able to handle partial occlusion during object detection and tracking. All the presented work and evaluations were carried out in offline processing with the computation done by a single laptop computer with MATLAB serving as software environment.

The first book, by the leading experts, on this rapidly developing field with applications to security, smart homes, multimedia, and environmental monitoring Comprehensive coverage of fundamentals, algorithms, design methodologies, system implementation issues, architectures, and applications Presents in detail the latest developments in multi-camera calibration, active and heterogeneous camera networks, multi-camera object and event detection, tracking, coding, smart camera architecture and middleware This book is the definitive reference in multi-camera networks. It gives clear guidance on the conceptual and implementation issues involved in the design and operation of multi-camera networks, as well as presenting the state-of-the-art in hardware, algorithms and system development. The book is broad in scope, covering smart camera architectures, embedded processing, sensor fusion and middleware, calibration and topology, network-based detection and tracking, and applications in distributed and collaborative methods in camera networks. This book will be an ideal reference for university researchers, R&D engineers, computer engineers, and graduate students working in signal and video processing, computer vision, and sensor networks. Hamid Aghajan is a Professor of Electrical Engineering (consulting) at Stanford University. His research is on multi-camera networks for smart environments with application to smart homes, assisted living and well being, meeting rooms, and avatar-based communication and social interactions. He is Editor-in-Chief of Journal of Ambient Intelligence and Smart Environments, and was general chair of ACM/IEEE ICDSC 2008. Andrea Cavallaro is Reader (Associate Professor) at Queen Mary, University of London (QMUL). His research is on target tracking and audiovisual content analysis for advanced surveillance and multi-sensor systems. He serves as Associate Editor of the IEEE Signal Processing Magazine and the IEEE Trans. on Multimedia, and has been general chair of IEEE AVSS 2007, ACM/IEEE ICDSC 2009 and BMVC 2009. The first book, by the leading experts, on this rapidly developing field with applications to security, smart homes, multimedia, and environmental monitoring Comprehensive coverage of fundamentals, algorithms, design methodologies, system implementation issues, architectures, and applications Presents in detail the latest developments in multi-camera calibration, active and heterogeneous camera networks, multi-camera object and event detection, tracking, coding, smart camera architecture and middleware