This is an introduction to stochastic integration and stochastic differential equations written in an understandable way for a wide audience, from students of mathematics to practitioners in biology, chemistry, physics, and finances. The presentation is based on the naïve stochastic integration, rather than on abstract theories of measure and stochastic processes. The proofs are rather simple for practitioners and, at the same time, rather rigorous for mathematicians. Detailed application examples in natural sciences and finance are presented. Much attention is paid to simulation diffusion processes. The topics covered include Brownian motion; motivation of stochastic models with Brownian motion; Itô and Stratonovich stochastic integrals, Itô’s formula; stochastic differential equations (SDEs); solutions of SDEs as Markov processes; application examples in physical sciences and finance; simulation of solutions of SDEs (strong and weak approximations). Exercises with hints and/or solutions are also provided.

This volume presents an introductory course on differential stochastic equations and Malliavin calculus. The material of the book has grown out of a series of courses delivered at the Scuola Normale Superiore di Pisa (and also at the Trento and Funchal Universities) and has been refined over several years of teaching experience in the subject. The lectures are addressed to a reader who is familiar with basic notions of measure theory and functional analysis. The first part is devoted to the Gaussian measure in a separable Hilbert space, the Malliavin derivative, the construction of the Brownian motion and Itô's formula. The second part deals with differential stochastic equations and their connection with parabolic problems. The third part provides an introduction to the Malliavin calculus. Several applications are given, notably the Feynman-Kac, Girsanov and Clark-Ocone formulae, the Krylov-Bogoliubov and Von Neumann theorems. In this third edition several small improvements are added and a new section devoted to the differentiability of the Feynman-Kac semigroup is introduced. A considerable number of corrections and improvements have been made.

The infinite dimensional analysis as a branch of mathematical sciences was formed in the late 19th and early 20th centuries. Motivated by problems in mathematical physics, the first steps in this field were taken by V. Volterra, R. GateallX, P. Levy and M. Frechet, among others (see the preface to Levy[2]). Nevertheless, the most fruitful direction in this field is the infinite dimensional integration theory initiated by N. Wiener and A. N. Kolmogorov which is closely related to the developments of the theory of stochastic processes. It was Wiener who constructed for the first time in 1923 a probability measure on the space of all continuous functions (i. e. the Wiener measure) which provided an ideal math ematical model for Brownian motion. Then some important properties of Wiener integrals, especially the quasi-invariance of Gaussian measures, were discovered by R. Cameron and W. Martin[l, 2, 3]. In 1931, Kolmogorov[l] deduced a second partial differential equation for transition probabilities of Markov processes order with continuous trajectories (i. e. diffusion processes) and thus revealed the deep connection between theories of differential equations and stochastic processes. The stochastic analysis created by K. Ito (also independently by Gihman [1]) in the forties is essentially an infinitesimal analysis for trajectories of stochastic processes. By virtue of Ito's stochastic differential equations one can construct diffusion processes via direct probabilistic methods and treat them as function als of Brownian paths (i. e. the Wiener functionals).

Stochastic analysis involves the study of a process involving a randomly determined sequence of observations, each of which represents a sample of one element of probability distribution. This volume considers fundamental theories and contrasts the natural interplay between real and abstract methods. Starting with the introduction of the basic Kolmogorov-Bochner existence theorem, the text explores conditional expectations and probabilities as well as projective and direct limits. Subsequent chapters examine several aspects of discrete martingale theory, including applications to ergodic theory, likelihood ratios, and the Gaussian dichotomy theorem. Prerequisites include a standard measure theory course. No prior knowledge of probability is assumed; therefore, most of the results are proved in detail. Each chapter concludes with a problem section that features many hints and facts, including the most important results in information theory.

Clear presentation employs methods that recognize computer-related aspects of theory. Topics include expectations and independence, Bernoulli processes and sums of independent random variables, Markov chains, renewal theory, more. 1975 edition.

An Introduction to Stochastic Modeling provides information pertinent to the standard concepts and methods of stochastic modeling. This book presents the rich diversity of applications of stochastic processes in the sciences. Organized into nine chapters, this book begins with an overview of diverse types of stochastic models, which predicts a set of possible outcomes weighed by their likelihoods or probabilities. This text then provides exercises in the applications of simple stochastic analysis to appropriate problems. Other chapters consider the study of general functions of independent, identically distributed, nonnegative random variables representing the successive intervals between renewals. This book discusses as well the numerous examples of Markov branching processes that arise naturally in various scientific disciplines. The final chapter deals with queueing models, which aid the design process by predicting system performance. This book is a valuable resource for students of engineering and management science. Engineers will also find this book useful.

The objective of this book is to introduce the elements of stochastic processes in a rather concise manner where we present the two most important parts — Markov chains and stochastic analysis. The readers are led directly to the core of the main topics to be treated in the context. Further details and additional materials are left to a section containing abundant exercises for further reading and studying.In the part on Markov chains, the focus is on the ergodicity. By using the minimal nonnegative solution method, we deal with the recurrence and various types of ergodicity. This is done step by step, from finite state spaces to denumerable state spaces, and from discrete time to continuous time. The methods of proofs adopt modern techniques, such as coupling and duality methods. Some very new results are included, such as the estimate of the spectral gap. The structure and proofs in the first part are rather different from other existing textbooks on Markov chains.In the part on stochastic analysis, we cover the martingale theory and Brownian motions, the stochastic integral and stochastic differential equations with emphasis on one dimension, and the multidimensional stochastic integral and stochastic equation based on semimartingales. We introduce three important topics here: the Feynman-Kac formula, random time transform and Girsanov transform. As an essential application of the probability theory in classical mathematics, we also deal with the famous Brunn-Minkowski inequality in convex geometry.This book also features modern probability theory that is used in different fields, such as MCMC, or even deterministic areas: convex geometry and number theory. It provides a new and direct routine for students going through the classical Markov chains to the modern stochastic analysis.