Stochastic analysis involves the study of a process involving a randomly determined sequence of observations, each of which represents a sample of one element of probability distribution. This volume considers fundamental theories and contrasts the natural interplay between real and abstract methods. Starting with the introduction of the basic Kolmogorov-Bochner existence theorem, the text explores conditional expectations and probabilities as well as projective and direct limits. Subsequent chapters examine several aspects of discrete martingale theory, including applications to ergodic theory, likelihood ratios, and the Gaussian dichotomy theorem. Prerequisites include a standard measure theory course. No prior knowledge of probability is assumed; therefore, most of the results are proved in detail. Each chapter concludes with a problem section that features many hints and facts, including the most important results in information theory.

This book gives a complete and elementary account of fundamental results on hyperfinite measures and their application to stochastic processes, including the *-finite Stieltjes sum approximation of martingale integrals. Many detailed examples, not found in the literature, are included. It begins with a brief chapter on tools from logic and infinitesimal (or non-standard) analysis so that the material is accessible to beginning graduate students.

This book provides a rigorous mathematical treatment of the non-linear stochastic filtering problem using modern methods. Particular emphasis is placed on the theoretical analysis of numerical methods for the solution of the filtering problem via particle methods. The book should provide sufficient background to enable study of the recent literature. While no prior knowledge of stochastic filtering is required, readers are assumed to be familiar with measure theory, probability theory and the basics of stochastic processes. Most of the technical results that are required are stated and proved in the appendices. Exercises and solutions are included.

This is a textbook for advanced undergraduate students and beginning graduate students in applied mathematics. It presents the basic mathematical foundations of stochastic analysis (probability theory and stochastic processes) as well as some important practical tools and applications (e.g., the connection with differential equations, numerical methods, path integrals, random fields, statistical physics, chemical kinetics, and rare events). The book strikes a nice balance between mathematical formalism and intuitive arguments, a style that is most suited for applied mathematicians. Readers can learn both the rigorous treatment of stochastic analysis as well as practical applications in modeling and simulation. Numerous exercises nicely supplement the main exposition.

In various scientific and industrial fields, stochastic simulations are taking on a new importance. This is due to the increasing power of computers and practitioners’ aim to simulate more and more complex systems, and thus use random parameters as well as random noises to model the parametric uncertainties and the lack of knowledge on the physics of these systems. The error analysis of these computations is a highly complex mathematical undertaking. Approaching these issues, the authors present stochastic numerical methods and prove accurate convergence rate estimates in terms of their numerical parameters (number of simulations, time discretization steps). As a result, the book is a self-contained and rigorous study of the numerical methods within a theoretical framework. After briefly reviewing the basics, the authors first introduce fundamental notions in stochastic calculus and continuous-time martingale theory, then develop the analysis of pure-jump Markov processes, Poisson processes, and stochastic differential equations. In particular, they review the essential properties of Itô integrals and prove fundamental results on the probabilistic analysis of parabolic partial differential equations. These results in turn provide the basis for developing stochastic numerical methods, both from an algorithmic and theoretical point of view. The book combines advanced mathematical tools, theoretical analysis of stochastic numerical methods, and practical issues at a high level, so as to provide optimal results on the accuracy of Monte Carlo simulations of stochastic processes. It is intended for master and Ph.D. students in the field of stochastic processes and their numerical applications, as well as for physicists, biologists, economists and other professionals working with stochastic simulations, who will benefit from the ability to reliably estimate and control the accuracy of their simulations.

This textbook explores probability and stochastic processes at a level that does not require any prior knowledge except basic calculus. It presents the fundamental concepts in a step-by-step manner, and offers remarks and warnings for deeper insights. The chapters include basic examples, which are revisited as the new concepts are introduced. To aid learning, figures and diagrams are used to help readers grasp the concepts, and the solutions to the exercises and problems. Further, a table format is also used where relevant for better comparison of the ideas and formulae. The first part of the book introduces readers to the essentials of probability, including combinatorial analysis, conditional probability, and discrete and continuous random variable. The second part then covers fundamental stochastic processes, including point, counting, renewal and regenerative processes, the Poisson process, Markov chains, queuing models and reliability theory. Primarily intended for undergraduate engineering students, it is also useful for graduate-level students wanting to refresh their knowledge of the basics of probability and stochastic processes.

Foundations of Stochastic Analysis deals with the foundations of the theory of Kolmogorov and Bochner and its impact on the growth of stochastic analysis. Topics covered range from conditional expectations and probabilities to projective and direct limits, as well as martingales and likelihood ratios. Abstract martingales and their applications are also discussed. Comprised of five chapters, this volume begins with an overview of the basic Kolmogorov-Bochner theorem, followed by a discussion on conditional expectations and probabilities containing several characterizations of operators and measures. The applications of these conditional expectations and probabilities to Reynolds operators are also considered. The reader is then introduced to projective limits, direct limits, and a generalized Kolmogorov existence theorem, along with infinite product conditional probability measures. The book also considers martingales and their applications to likelihood ratios before concluding with a description of abstract martingales and their applications to convergence and harmonic analysis, as well as their relation to ergodic theory. This monograph should be of considerable interest to researchers and graduate students working in stochastic analysis.