The theory of Markov Processes has become a powerful tool in partial differential equations and potential theory with important applications to physics. Professor Dynkin has made many profound contributions to the subject and in this volume are collected several of his most important expository and survey articles. The content of these articles has not been covered in any monograph as yet. This account is accessible to graduate students in mathematics and operations research and will be welcomed by all those interested in stochastic processes and their applications.

Probabilistic methods can be applied very successfully to a number of asymptotic problems for second-order linear and non-linear partial differential equations. Due to the close connection between the second order differential operators with a non-negative characteristic form on the one hand and Markov processes on the other, many problems in PDE's can be reformulated as problems for corresponding stochastic processes and vice versa. In the present book four classes of problems are considered: - the Dirichlet problem with a small parameter in higher derivatives for differential equations and systems - the averaging principle for stochastic processes and PDE's - homogenization in PDE's and in stochastic processes - wave front propagation for semilinear differential equations and systems. From the probabilistic point of view, the first two topics concern random perturbations of dynamical systems. The third topic, homog- enization, is a natural problem for stochastic processes as well as for PDE's. Wave fronts in semilinear PDE's are interesting examples of pattern formation in reaction-diffusion equations. The text presents new results in probability theory and their applica- tion to the above problems. Various examples help the reader to understand the effects. Prerequisites are knowledge in probability theory and in partial differential equations.

This book is concerned with a set of related problems in probability theory that are considered in the context of Markov processes. Some of these are natural to consider, especially for Markov processes. Other problems have a broader range of validity but are convenient to pose for Markov processes. The book can be used as the basis for an interesting course on Markov processes or stationary processes. For the most part these questions are considered for discrete parameter processes, although they are also of obvious interest for continuous time parameter processes. This allows one to avoid the delicate measure theoretic questions that might arise in the continuous parameter case. There is an attempt to motivate the material in terms of applications. Many of the topics concern general questions of structure and representation of processes that have not previously been presented in book form. A set of notes comment on the many problems that are still left open and related material in the literature. It is also hoped that the book will be useful as a reference to the reader who would like an introduction to these topics as well as to the reader interested in extending and completing results of this type.

At first there was the Markov property. The theory of stochastic processes, which can be considered as an exten sion of probability theory, allows the modeling of the evolution of systems through the time. It cannot be properly understood just as pure mathemat ics, separated from the body of experience and examples that have brought it to life. The theory of stochastic processes entered a period of intensive develop ment, which is not finished yet, when the idea of the Markov property was brought in. Not even a serious study of the renewal processes is possible without using the strong tool of Markov processes. The modern theory of Markov processes has its origins in the studies by A. A: Markov (1856-1922) of sequences of experiments "connected in a chain" and in the attempts to describe mathematically the physical phenomenon known as Brownian mo tion. Later, many generalizations (in fact all kinds of weakenings of the Markov property) of Markov type stochastic processes were proposed. Some of them have led to new classes of stochastic processes and useful applications. Let us mention some of them: systems with complete connections [90, 91, 45, 86]; K-dependent Markov processes [44]; semi-Markov processes, and so forth. The semi-Markov processes generalize the renewal processes as well as the Markov jump processes and have numerous applications, especially in relia bility.

This work offers a highly useful, well developed reference on Markov processes, the universal model for random processes and evolutions. The wide range of applications, in exact sciences as well as in other areas like social studies, require a volume that offers a refresher on fundamentals before conveying the Markov processes and examples for

This book discusses quantum theory as the theory of random (Brownian) motion of small particles (electrons etc.) under external forces. Implying that the Schrödinger equation is a complex-valued evolution equation and the Schrödinger function is a complex-valued evolution function, important applications are given. Readers will learn about new mathematical methods (theory of stochastic processes) in solving problems of quantum phenomena. Readers will also learn how to handle stochastic processes in analyzing physical phenomena.

Labelled Markov processes are probabilistic versions of labelled transition systems with continuous state spaces. The book covers basic probability and measure theory on continuous state spaces and then develops the theory of LMPs.