"For those involved in the design and implementation of signal processing algorithms, this book strikes a balance between highly theoretical expositions and the more practical treatments, covering only those approaches necessary for obtaining an optimal estimator and analyzing its performance. Author Steven M. Kay discusses classical estimation followed by Bayesian estimation, and illustrates the theory with numerous pedagogical and real-world examples."--Cover, volume 1.

The application of estimation theory renders the processing of experimental results both rational and effective, and thus helps not only to make our knowledge more precise but to determine the measure of its reliability. As a consequence, estimation theory is indispensable in the analysis of the measuring processes and of experiments in general.The knowledge necessary for studying this book encompasses the disciplines of probability and mathematical statistics as studied in the third or fourth year at university. For readers interested in applications, comparatively detailed chapters on linear and quadratic estimations, and normality of observation vectors have been included. Chapter 2 includes selected items of information from algebra, functional analysis and the theory of probability, intended to facilitate the reading of the text proper and to save the reader looking up individual theorems in various textbooks and papers; it is mainly devoted to the reproducing kernel Hilbert spaces, helpful in solving many estimation problems. The text proper of the book begins with Chapter 3. This is divided into two parts: the first deals with sufficient statistics, complete sufficient statistics, minimal sufficient statistics and relations between them; the second contains the mostimportant inequalities of estimation theory for scalar and vector valued parameters and presents properties of the exponential family of distributions.The fourth chapter is an introduction to asymptotic methods of estimation. The method of statistical moments and the maximum-likelihood method are investigated. The sufficient conditions for asymptotical normality of the estimators are given for both methods. The linear and quadratic methods of estimation are dealt with in the fifth chapter. The method of least squares estimation is treated. Five basic regular versions of the regression model and the unified linear model of estimation are described. Unbiased estimators for unit dispersion (factor of the covariance matrix) are given for all mentioned cases. The equivalence of the least-squares method to the method of generalized minimum norm inversion of the design matrix of the regression model is studied in detail. The problem of estimating the covariance components in the mixed model is mentioned as well. Statistical properties of linear and quadratic estimators developed in the fifth chapter in the case of normally distributed errors of measurement are given in Chapter 6. Further, the application of tensor products of Hilbert spaces generated by the covariance matrix of random error vector of observations is demonstrated. Chapter 7 reviews some further important methods of estimation theory. In the first part Wald's method of decision functions is applied to the construction of estimators. The method of contracted estimators and the method of Hoerl and Kennard are presented in the second part. The basic ideas of robustness and Bahadur's approach to estimation theory are presented in the third and fourth parts of this last chapter.

Estimation theory is a product of need and technology. As a result, it is an integral part of many branches of science and engineering. To help readers differentiate among the rich collection of estimation methods and algorithms, this book describes in detail many of the important estimation methods and shows how they are interrelated. Written as a collection of lessons, this book introduces readers o the general field of estimation theory and includes abundant supplementary material.

This book embraces the many mathematical procedures that engineers and statisticians use to draw inference from imperfect or incomplete measurements. This book presents the fundamental ideas in statistical signal processing along four distinct lines: mathematical and statistical preliminaries; decision theory; estimation theory; and time series analysis.

Parameter Estimation and Inverse Problems, Third Edition, is structured around a course at New Mexico Tech and is designed to be accessible to typical graduate students in the physical sciences who do not have an extensive mathematical background. The book is complemented by a companion website that includes MATLAB codes that correspond to examples that are illustrated with simple, easy to follow problems that illuminate the details of particular numerical methods. Updates to the new edition include more discussions of Laplacian smoothing, an expansion of basis function exercises, the addition of stochastic descent, an improved presentation of Fourier methods and exercises, and more. - Features examples that are illustrated with simple, easy to follow problems that illuminate the details of a particular numerical method - Includes an online instructor's guide that helps professors teach and customize exercises and select homework problems - Covers updated information on adjoint methods that are presented in an accessible manner

The purpose of this book is to introduce the reader to the basic theory of signal detection and estimation. It is assumed that the reader has a working knowledge of applied probabil ity and random processes such as that taught in a typical first-semester graduate engineering course on these subjects. This material is covered, for example, in the book by Wong (1983) in this series. More advanced concepts in these areas are introduced where needed, primarily in Chapters VI and VII, where continuous-time problems are treated. This book is adapted from a one-semester, second-tier graduate course taught at the University of Illinois. However, this material can also be used for a shorter or first-tier course by restricting coverage to Chapters I through V, which for the most part can be read with a background of only the basics of applied probability, including random vectors and conditional expectations. Sufficient background for the latter option is given for exam pIe in the book by Thomas (1986), also in this series.