"There is a growing interest in the computer vision community towards video understanding, in particular towards visual event recognition ... This dissertation surveys different taxonomies of motion understanding problems, identifies the major components in an automated visual event recognition system, and presents the challenges and the significant studies in moving object detection, shadow elimination, and object tracking. Novel schemes for shadow detection and object tracking are proposed and implemented. The proposed shadow detection scheme does not rely on models of scene or objects, which makes it robust for a variety of outdoor surveillance applications, and also successfully eliminates problems due to illumination changes that are common in outdoor sequences. The proposed schemes for object tracking address the problem of correspondence in the presence of multiple moving objects and occlusions in the scene, and involve multi-hypothesis decision making and color appearance models"--Abstract, leaf iii.

Performance Evaluation Software: Moving Object Detection and Tracking in Videos introduces a software approach for the real-time evaluation and performance comparison of the methods specializing in moving object detection and/or tracking (D&T) in video processing. Digital video content analysis is an important item for multimedia content-based indexing (MCBI), content-based video retrieval (CBVR) and visual surveillance systems. There are some frequently-used generic algorithms for video object D&T in the literature, such as Background Subtraction (BS), Continuously Adaptive Mean-shift (CMS), Optical Flow (OF), etc. An important problem for performance evaluation is the absence of any stable and flexible software for comparison of different algorithms. In this frame, we have designed and implemented the software for comparing and evaluating the well-known video object D&T algorithms on the same platform. This software is able to compare them with the same metrics in real-time and on the same platform. It also works as an automatic and/or semi-automatic test environment in real-time, which uses the image and video processing essentials, e.g. morphological operations and filters, and ground-truth (GT) XML data files, charting/plotting capabilities, etc. Along with the comprehensive literature survey of the abovementioned video object D&T algorithms, this book also covers the technical details of our performance benchmark software as well as a case study on people D&T for the functionality of the software.

Deep learning, as a recent AI technique, has proven itself efficient in solving many real-world problems. Deep learning algorithms are efficient, high performing, and an effective standard for solving these problems. In addition, with IoT, deep learning is in many emerging and developing domains of computer technology. Deep learning algorithms have brought a revolution in computer vision applications by introducing an efficient solution to several image processing-related problems that have long remained unresolved or moderately solved. Various significant IoT technologies in various industries, such as education, health, transportation, and security, combine IoT with deep learning for complex problem solving and the supported interaction between human beings and their surroundings. Examining the Impact of Deep Learning and IoT on Multi-Industry Applications provides insights on how deep learning, together with IoT, impacts various sectors such as healthcare, agriculture, cyber security, and social media analysis applications. The chapters present solutions to various real-world problems using these methods from various researchers’ points of view. While highlighting topics such as medical diagnosis, power consumption, livestock management, security, and social media analysis, this book is ideal for IT specialists, technologists, security analysts, medical practitioners, imaging specialists, diagnosticians, academicians, researchers, industrial experts, scientists, and undergraduate and postgraduate students who are working in the field of computer engineering, electronics, and electrical engineering.

This Springer Brief presents a comprehensive survey of the existing methodologies of background subtraction methods. It presents a framework for quantitative performance evaluation of different approaches and summarizes the public databases available for research purposes. This well-known methodology has applications in moving object detection from video captured with a stationery camera, separating foreground and background objects and object classification and recognition. The authors identify common challenges faced by researchers including gradual or sudden illumination change, dynamic backgrounds and shadow and ghost regions. This brief concludes with predictions on the future scope of the methods. Clear and concise, this brief equips readers to determine the most effective background subtraction method for a particular project. It is a useful resource for professionals and researchers working in this field.

This book shows how machine learning can detect moving objects in a digital video stream. The authors present different background subtraction approaches, foreground segmentation, and object tracking approaches to accomplish this. They also propose an algorithm that considers a multimodal background subtraction approach that can handle a dynamic background and different constraints. The authors show how the proposed algorithm is able to detect and track 2D & 3D objects in monocular sequences for both indoor and outdoor surveillance environments and at the same time, also able to work satisfactorily in a dynamic background and with challenging constraints. In addition, the shows how the proposed algorithm makes use of parameter optimization and adaptive threshold techniques as intrinsic improvements of the Gaussian Mixture Model. The presented system in the book is also able to handle partial occlusion during object detection and tracking. All the presented work and evaluations were carried out in offline processing with the computation done by a single laptop computer with MATLAB serving as software environment.

In real world monitoring applications, moving object detection remains to be a challenging task due to factors such as background clutter and motion, illumination variations, weather conditions, noise, and occlusions. As a fundamental first step in many computer vision applications such as object tracking, behavior understanding, object or event recognition, and automated video surveillance, various motion detection algorithms have been developed ranging from simple approaches to more sophisticated ones. In this thesis, we present two moving object detection frameworks. The first framework is designed for robust detection of moving and static objects in videos acquired from stationary cameras. This method exploits the benefits of fusing a motion computation method based on spatio-temporal tensor formulation, a novel foreground and background modeling scheme, and a multi-cue appearance comparison. This hybrid system can handle challenges such as shadows, illumination changes, dynamic background, stopped and removed objects. Extensive testing performed on the CVPR 2014 Change Detection benchmark dataset shows that FTSG outperforms most state-of-the-art methods. The second framework adapts moving object detection to full motion videos acquired from moving airborne platforms. This framework has two main modules. The first module stabilizes the video with respect to a set of base-frames in the sequence. The stabilization is done by estimating four-point homographies using prominent feature (PF) block matching, motion filtering and RANSAC for robust matching. Once the frame to base frame homographies are available the flux tensor motion detection module using local second derivative information is applied to detect moving salient features. Spurious responses from the frame boundaries and other post- processing operations are applied to reduce the false alarms and produce accurate moving blob regions that will be useful for tracking.

Techniques of vision-based motion analysis aim to detect, track, identify, and generally understand the behavior of objects in image sequences. With the growth of video data in a wide range of applications from visual surveillance to human-machine interfaces, the ability to automatically analyze and understand object motions from video footage is of increasing importance. Among the latest developments in this field is the application of statistical machine learning algorithms for object tracking, activity modeling, and recognition. Developed from expert contributions to the first and second International Workshop on Machine Learning for Vision-Based Motion Analysis, this important text/reference highlights the latest algorithms and systems for robust and effective vision-based motion understanding from a machine learning perspective. Highlighting the benefits of collaboration between the communities of object motion understanding and machine learning, the book discusses the most active forefronts of research, including current challenges and potential future directions. Topics and features: provides a comprehensive review of the latest developments in vision-based motion analysis, presenting numerous case studies on state-of-the-art learning algorithms; examines algorithms for clustering and segmentation, and manifold learning for dynamical models; describes the theory behind mixed-state statistical models, with a focus on mixed-state Markov models that take into account spatial and temporal interaction; discusses object tracking in surveillance image streams, discriminative multiple target tracking, and guidewire tracking in fluoroscopy; explores issues of modeling for saliency detection, human gait modeling, modeling of extremely crowded scenes, and behavior modeling from video surveillance data; investigates methods for automatic recognition of gestures in Sign Language, and human action recognition from small training sets. Researchers, professional engineers, and graduate students in computer vision, pattern recognition and machine learning, will all find this text an accessible survey of machine learning techniques for vision-based motion analysis. The book will also be of interest to all who work with specific vision applications, such as surveillance, sport event analysis, healthcare, video conferencing, and motion video indexing and retrieval.