An image or video sequence is a series of two-dimensional (2-D) images sequen tially ordered in time. Image sequences can be acquired, for instance, by video, motion picture, X-ray, or acoustic cameras, or they can be synthetically gen erated by sequentially ordering 2-D still images as in computer graphics and animation. The use of image sequences in areas such as entertainment, visual communications, multimedia, education, medicine, surveillance, remote control, and scientific research is constantly growing as the use of television and video systems are becoming more and more common. The boosted interest in digital video for both consumer and professional products, along with the availability of fast processors and memory at reasonable costs, has been a major driving force behind this growth. Before we elaborate on the two major terms that appear in the title of this book, namely motion analysis and image sequence processing, we like to place them in their proper contexts within the range of possible operations that involve image sequences. In this book, we choose to classify these operations into three major categories, namely (i) image sequence processing, (ii) image sequence analysis, and (iii) visualization. The interrelationship among these three categories is pictorially described in Figure 1 below in the form of an "image sequence triangle".

This volume contains the proceedings of the NATO Advanced Study Institute on "Image Sequence Processing and Dynamic Scene Analysis" held 21 June - 2 July, 1982 in Hotel Maritim, Braunlage/Harz, Federal Republic of Germany. The organizing eommittee of the institute consists of T.S. Huang (Director), H.G. Musmann (Co Director), H.H. Nagel (Consultant), and C.E. Liedtke and W. Geuen (Local 'arrangement). This Institute was devoted to the rapidly emerging field of image sequence processing and dynamic scene analysis which has man! important applications in cluding target tracking, television bandwidth compression, highway traffic moni toring, and analysis of heart wall motion for medical diagnosis. The lectures and discussions in this Institute fell into three overlapping categories: Motion estimation; pattern recognition and artificial intelligence techniques in dynamic scene analysis; and, applications. 1) Motion estimation - One of the most important problems in image sequence analysis and dynamic scene analysis is displacement and motion estimation. For example, in interframe coding using temporal DPCM, displacement estimation and compensation can improve efficiency significantly. Also, estimated motion parameters can be powerful cues in target segmentation, detection, and classification. In this Institute, a number of recently developed techniques for displacement and motion estimation were discussed.

An image or video sequence is a series of two-dimensional (2-D) images sequen tially ordered in time. Image sequences can be acquired, for instance, by video, motion picture, X-ray, or acoustic cameras, or they can be synthetically gen erated by sequentially ordering 2-D still images as in computer graphics and animation. The use of image sequences in areas such as entertainment, visual communications, multimedia, education, medicine, surveillance, remote control, and scientific research is constantly growing as the use of television and video systems are becoming more and more common. The boosted interest in digital video for both consumer and professional products, along with the availability of fast processors and memory at reasonable costs, has been a major driving force behind this growth. Before we elaborate on the two major terms that appear in the title of this book, namely motion analysis and image sequence processing, we like to place them in their proper contexts within the range of possible operations that involve image sequences. In this book, we choose to classify these operations into three major categories, namely (i) image sequence processing, (ii) image sequence analysis, and (iii) visualization. The interrelationship among these three categories is pictorially described in Figure 1 below in the form of an "image sequence triangle".

The processing of image sequences has a broad spectrum of important applica tions including target tracking, robot navigation, bandwidth compression of TV conferencing video signals, studying the motion of biological cells using microcinematography, cloud tracking, and highway traffic monitoring. Image sequence processing involves a large amount of data. However, because of the progress in computer, LSI, and VLSI technologies, we have now reached a stage when many useful processing tasks can be done in a reasonable amount of time. As a result, research and development activities in image sequence analysis have recently been growing at a rapid pace. An IEEE Computer Society Workshop on Computer Analysis of Time-Varying Imagery was held in Philadelphia, April 5-6, 1979. A related special issue of the IEEE Transactions on Pattern Anal ysis and Machine Intelligence was published in November 1980. The IEEE Com puter magazine has also published a special issue on the subject in 1981. The purpose of this book is to survey the field of image sequence analysis and to discuss in depth a number of important selected topics. The seven chap ters fall into two categories. Chapters 2, 3, and 7 are comprehensive surveys on, respectively, the whole field of image sequence analysis, efficient coding of image sequences, and the processing of medical image sequences. In Chapters 1, 4, 5, and 6 the authors present mainly results of their own research on, respectively, motion estimation, noise reduction in image sequences, moving object extraction, and occlusion.

Digital image sequences (including digital video) are increasingly common and important components in technical applications ranging from medical imaging and multimedia communications to autonomous vehicle navigation. The immense popularity of DVD video and the introduction of digital television make digital video ubiquitous in the consumer domain. Digital Image Sequence Processing, Compression, and Analysis provides an overview of the current state of the field, as analyzed by leading researchers. An invaluable resource for planning and conducting research in this area, the book conveys a unified view of potential directions for further industrial development. It offers an in-depth treatment of the latest perspectives on processing, compression, and analysis of digital image sequences. Research involving digital image sequences remains extremely active. The advent of economical sequence acquisition, storage, and display devices, together with the availability of computing power, opens new areas of opportunity. This volume delivers the background necessary to understand the strengths and weaknesses of current techniques and the directions that consumer and technical applications may take over the coming decade.

This volume is the fourth in the book series, Advances in Image Communication, a series dedicated to exploring the rapidly evolving, multidisciplinary field of image communications. Each publication stands alone as a state-of-the-art reference work in its particular area of expertise. It also forms an integral part of the comprehensive overview of developments across the field, which the series offers as a whole. Motion Analysis for Image Sequence Coding documents the technical advances made through the years in dealing with motion in image sequences - from straightforward coarse approaches to complicated algorithms. It is timely because of the unprecedented effort which is made to establish a set of international standards for the digital compression of moving pictures and television signals. These standards rely heavily on motion estimation and compensation techniques and will be exploited on a large scale in multimedia applications as well as in intelligent systems. The book will be of prime importance, not only to active engineers and researchers in the field, but also by serving as a basic educational tool.