A long long time ago, echoing philosophical and aesthetic principles that existed since antiquity, William of Ockham enounced the principle of parsimony, better known today as Ockham’s razor: “Entities should not be multiplied without neces sity. ” This principle enabled scientists to select the ”best” physical laws and theories to explain the workings of the Universe and continued to guide scienti?c research, leadingtobeautifulresultsliketheminimaldescriptionlength approachtostatistical inference and the related Kolmogorov complexity approach to pattern recognition. However, notions of complexity and description length are subjective concepts anddependonthelanguage“spoken”whenpresentingideasandresults. The?eldof sparse representations, that recently underwent a Big Bang like expansion, explic itly deals with the Yin Yang interplay between the parsimony of descriptions and the “language” or “dictionary” used in them, and it became an extremely exciting area of investigation. It already yielded a rich crop of mathematically pleasing, deep and beautiful results that quickly translated into a wealth of practical engineering applications. You are holding in your hands the ?rst guide book to Sparseland, and I am sure you’ll ?nd in it both familiar and new landscapes to see and admire, as well as ex cellent pointers that will help you ?nd further valuable treasures. Enjoy the journey to Sparseland! Haifa, Israel, December 2009 Alfred M. Bruckstein vii Preface This book was originally written to serve as the material for an advanced one semester (fourteen 2 hour lectures) graduate course for engineering students at the Technion, Israel.

Compressed sensing or compressive sensing is a new concept in signal processing where one measures a small number of non-adaptive linear combinations of the signal. These measurements are usually much smaller than the number of samples that define the signal. From these small numbers of measurements, the signal is then reconstructed by non-linear procedure. Compressed sensing has recently emerged as a powerful tool for efficiently processing data in non-traditional ways. In this book, we highlight some of the key mathematical insights underlying sparse representation and compressed sensing and illustrate the role of these theories in classical vision, imaging and biometrics problems.

This unique text/reference presents a comprehensive review of the state of the art in sparse representations, modeling and learning. The book examines both the theoretical foundations and details of algorithm implementation, highlighting the practical application of compressed sensing research in visual recognition and computer vision. Topics and features: describes sparse recovery approaches, robust and efficient sparse representation, and large-scale visual recognition; covers feature representation and learning, sparsity induced similarity, and sparse representation and learning-based classifiers; discusses low-rank matrix approximation, graphical models in compressed sensing, collaborative representation-based classification, and high-dimensional nonlinear learning; includes appendices outlining additional computer programming resources, and explaining the essential mathematics required to understand the book.

This book is thesecond volume of a three volume series recording the "Radon Special Semester 2011 on Multiscale Simulation & Analysis in Energy and the Environment" that took placein Linz, Austria, October 3-7, 2011. This volume addresses the common ground in the mathematical and computational procedures required for large-scale inverse problems and data assimilation in forefront applications. The solution of inverse problems is fundamental to a wide variety of applications such as weather forecasting, medical tomography, and oil exploration. Regularisation techniques are needed to ensure solutions of sufficient quality to be useful, and soundly theoretically based. This book addresses the common techniques required for all the applications, and is thus truly interdisciplinary. Thiscollection of surveyarticlesfocusses onthe large inverse problems commonly arising in simulation and forecasting in the earth sciences. For example, operational weather forecasting models have between 107 and 108 degrees of freedom. Even so, these degrees of freedom represent grossly space-time averaged properties of the atmosphere. Accurate forecasts require accurate initial conditions. With recent developments in satellite data, there are between 106 and 107 observations each day. However, while these also represent space-time averaged properties, the averaging implicit in the measurements is quite different from that used in the models. In atmosphere and ocean applications, there is a physically-based model available which can be used to regularise the problem. We assume that there is a set of observations with known error characteristics available over a period of time. The basic deterministic technique is to fit a model trajectory to the observations over a period of time to within the observation error. Since the model is not perfect the model trajectory has to be corrected, which defines the data assimilation problem. The stochastic view can be expressed by using an ensemble of model trajectories, and calculating corrections to both the mean value and the spread which allow the observations to be fitted by each ensemble member. In other areas of earth science, only the structure of the model formulation itself is known and the aim is to use the past observation history to determine the unknown model parameters. The book records the achievements of Workshop2 "Large-Scale Inverse Problems and Applications in the Earth Sciences". Itinvolves experts in the theory of inverse problems together with experts working on both theoretical and practical aspects of the techniques by which large inverse problems arise in the earth sciences.

The focus of this book is on "ill-posed inverse problems". These problems cannot be solved only on the basis of observed data. The building of solutions involves the recognition of other pieces of a priori information. These solutions are then specific to the pieces of information taken into account. Clarifying and taking these pieces of information into account is necessary for grasping the domain of validity and the field of application for the solutions built. For too long, the interest in these problems has remained very limited in the signal-image community. However, the community has since recognized that these matters are more interesting and they have become the subject of much greater enthusiasm. From the application field’s point of view, a significant part of the book is devoted to conventional subjects in the field of inversion: biological and medical imaging, astronomy, non-destructive evaluation, processing of video sequences, target tracking, sensor networks and digital communications. The variety of chapters is also clear, when we examine the acquisition modalities at stake: conventional modalities, such as tomography and NMR, visible or infrared optical imaging, or more recent modalities such as atomic force imaging and polarized light imaging.

This volume features key contributions from the International Conference on Pattern Recognition Applications and Methods, (ICPRAM 2012,) held in Vilamoura, Algarve, Portugal from February 6th-8th, 2012. The conference provided a major point of collaboration between researchers, engineers and practitioners in the areas of Pattern Recognition, both from theoretical and applied perspectives, with a focus on mathematical methodologies. Contributions describe applications of pattern recognition techniques to real-world problems, interdisciplinary research, and experimental and theoretical studies which yield new insights that provide key advances in the field. This book will be suitable for scientists and researchers in optimization, numerical methods, computer science, statistics and for differential geometers and mathematical physicists.