This book presents a wide range of well-known and less common methods used for estimating the accuracy of probabilistic approximations, including the Esseen type inversion formulas, the Stein method as well as the methods of convolutions and triangle function. Emphasising the correct usage of the methods presented, each step required for the proofs is examined in detail. As a result, this textbook provides valuable tools for proving approximation theorems. While Approximation Methods in Probability Theory will appeal to everyone interested in limit theorems of probability theory, the book is particularly aimed at graduate students who have completed a standard intermediate course in probability theory. Furthermore, experienced researchers wanting to enlarge their toolkit will also find this book useful.

Most functions that occur in mathematics cannot be used directly in computer calculations. Instead they are approximated by manageable functions such as polynomials and piecewise polynomials. The general theory of the subject and its application to polynomial approximation are classical, but piecewise polynomials have become far more useful during the last twenty years. Thus many important theoretical properties have been found recently and many new techniques for the automatic calculation of approximations to prescribed accuracy have been developed. This book gives a thorough and coherent introduction to the theory that is the basis of current approximation methods. Professor Powell describes and analyses the main techniques of calculation supplying sufficient motivation throughout the book to make it accessible to scientists and engineers who require approximation methods for practical needs. Because the book is based on a course of lectures to third-year undergraduates in mathematics at Cambridge University, sufficient attention is given to theory to make it highly suitable as a mathematical textbook at undergraduate or postgraduate level.

The book deals with a powerful and convenient approach to a great variety of types of problems of the recursive monte-carlo or stochastic approximation type. Such recu- sive algorithms occur frequently in stochastic and adaptive control and optimization theory and in statistical esti- tion theory. Typically, a sequence {X } of estimates of a n parameter is obtained by means of some recursive statistical th st procedure. The n estimate is some function of the n_l estimate and of some new observational data, and the aim is to study the convergence, rate of convergence, and the pa- metric dependence and other qualitative properties of the - gorithms. In this sense, the theory is a statistical version of recursive numerical analysis. The approach taken involves the use of relatively simple compactness methods. Most standard results for Kiefer-Wolfowitz and Robbins-Monro like methods are extended considerably. Constrained and unconstrained problems are treated, as is the rate of convergence problem. While the basic method is rather simple, it can be elaborated to allow a broad and deep coverage of stochastic approximation like problems. The approach, relating algorithm behavior to qualitative properties of deterministic or stochastic differ ential equations, has advantages in algorithm conceptualiza tion and design. It is often possible to obtain an intuitive understanding of algorithm behavior or qualitative dependence upon parameters, etc., without getting involved in a great deal of deta~l.

Since its introduction in 1972, Stein’s method has offered a completely novel way of evaluating the quality of normal approximations. Through its characterizing equation approach, it is able to provide approximation error bounds in a wide variety of situations, even in the presence of complicated dependence. Use of the method thus opens the door to the analysis of random phenomena arising in areas including statistics, physics, and molecular biology. Though Stein's method for normal approximation is now mature, the literature has so far lacked a complete self contained treatment. This volume contains thorough coverage of the method’s fundamentals, includes a large number of recent developments in both theory and applications, and will help accelerate the appreciation, understanding, and use of Stein's method by providing the reader with the tools needed to apply it in new situations. It addresses researchers as well as graduate students in Probability, Statistics and Combinatorics.

This book presents broadly applicable methods for the large deviation and moderate deviation analysis of discrete and continuous time stochastic systems. A feature of the book is the systematic use of variational representations for quantities of interest such as normalized logarithms of probabilities and expected values. By characterizing a large deviation principle in terms of Laplace asymptotics, one converts the proof of large deviation limits into the convergence of variational representations. These features are illustrated though their application to a broad range of discrete and continuous time models, including stochastic partial differential equations, processes with discontinuous statistics, occupancy models, and many others. The tools used in the large deviation analysis also turn out to be useful in understanding Monte Carlo schemes for the numerical approximation of the same probabilities and expected values. This connection is illustrated through the design and analysis of importance sampling and splitting schemes for rare event estimation. The book assumes a solid background in weak convergence of probability measures and stochastic analysis, and is suitable for advanced graduate students, postdocs and researchers.

A rigorous mathematical treatment of the technique for studying the properties of an experimental situation.

This is a textbook on classical polynomial and rational approximation theory for the twenty-first century. Aimed at advanced undergraduates and graduate students across all of applied mathematics, it uses MATLAB to teach the field’s most important ideas and results. Approximation Theory and Approximation Practice, Extended Edition differs fundamentally from other works on approximation theory in a number of ways: its emphasis is on topics close to numerical algorithms; concepts are illustrated with Chebfun; and each chapter is a PUBLISHable MATLAB M-file, available online. The book centers on theorems and methods for analytic functions, which appear so often in applications, rather than on functions at the edge of discontinuity with their seductive theoretical challenges. Original sources are cited rather than textbooks, and each item in the bibliography is accompanied by an editorial comment. In addition, each chapter has a collection of exercises, which span a wide range from mathematical theory to Chebfun-based numerical experimentation. This textbook is appropriate for advanced undergraduate or graduate students who have an understanding of numerical analysis and complex analysis. It is also appropriate for seasoned mathematicians who use MATLAB.