This textbook, now in its third edition, offers a rigorous and self-contained introduction to the theory of continuous-time stochastic processes, stochastic integrals, and stochastic differential equations. Expertly balancing theory and applications, the work features concrete examples of modeling real-world problems from biology, medicine, industrial applications, finance, and insurance using stochastic methods. No previous knowledge of stochastic processes is required. Key topics include: Markov processes Stochastic differential equations Arbitrage-free markets and financial derivatives Insurance risk Population dynamics, and epidemics Agent-based models New to the Third Edition: Infinitely divisible distributions Random measures Levy processes Fractional Brownian motion Ergodic theory Karhunen-Loeve expansion Additional applications Additional exercises Smoluchowski approximation of Langevin systems An Introduction to Continuous-Time Stochastic Processes, Third Edition will be of interest to a broad audience of students, pure and applied mathematicians, and researchers and practitioners in mathematical finance, biomathematics, biotechnology, and engineering. Suitable as a textbook for graduate or undergraduate courses, as well as European Masters courses (according to the two-year-long second cycle of the “Bologna Scheme”), the work may also be used for self-study or as a reference. Prerequisites include knowledge of calculus and some analysis; exposure to probability would be helpful but not required since the necessary fundamentals of measure and integration are provided. From reviews of previous editions: "The book is ... an account of fundamental concepts as they appear in relevant modern applications and literature. ... The book addresses three main groups: first, mathematicians working in a different field; second, other scientists and professionals from a business or academic background; third, graduate or advanced undergraduate students of a quantitative subject related to stochastic theory and/or applications." -Zentralblatt MATH

This tutorial volume presents a coherent and well-balanced introduction to the validation of stochastic systems; it is based on a GI/Dagstuhl research seminar. Supervised by the seminar organizers and volume editors, established researchers in the area as well as graduate students put together a collection of articles competently covering all relevant issues in the area. The lectures are organized in topical sections on: modeling stochastic systems, model checking of stochastic systems, representing large state spaces, deductive verification of stochastic systems.

Because they incorporate both time- and event-driven dynamics, stochastic hybrid systems (SHS) have become ubiquitous in a variety of fields, from mathematical finance to biological processes to communication networks to engineering. Comprehensively integrating numerous cutting-edge studies, Stochastic Hybrid Systems presents a captivating treatment of some of the most ambitious types of dynamic systems. Cohesively edited by leading experts in the field, the book introduces the theoretical basics, computational methods, and applications of SHS. It first discusses the underlying principles behind SHS and the main design limitations of SHS. Building on these fundamentals, the authoritative contributors present methods for computer calculations that apply SHS analysis and synthesis techniques in practice. The book concludes with examples of systems encountered in a wide range of application areas, including molecular biology, communication networks, and air traffic management. It also explains how to resolve practical problems associated with these systems. Stochastic Hybrid Systems achieves an ideal balance between a theoretical treatment of SHS and practical considerations. The book skillfully explores the interaction of physical processes with computerized equipment in an uncertain environment, enabling a better understanding of sophisticated as well as everyday devices and processes.

This comprehensive introduction to the estimation and control of dynamic stochastic systems provides complete derivations of key results. The second edition includes improved and updated material, and a new presentation of polynomial control and new derivation of linear-quadratic-Gaussian control.

This book presents a treatise on the theory and modeling of second-order stationary processes, including an exposition on selected application areas that are important in the engineering and applied sciences. The foundational issues regarding stationary processes dealt with in the beginning of the book have a long history, starting in the 1940s with the work of Kolmogorov, Wiener, Cramér and his students, in particular Wold, and have since been refined and complemented by many others. Problems concerning the filtering and modeling of stationary random signals and systems have also been addressed and studied, fostered by the advent of modern digital computers, since the fundamental work of R.E. Kalman in the early 1960s. The book offers a unified and logically consistent view of the subject based on simple ideas from Hilbert space geometry and coordinate-free thinking. In this framework, the concepts of stochastic state space and state space modeling, based on the notion of the conditional independence of past and future flows of the relevant signals, are revealed to be fundamentally unifying ideas. The book, based on over 30 years of original research, represents a valuable contribution that will inform the fields of stochastic modeling, estimation, system identification, and time series analysis for decades to come. It also provides the mathematical tools needed to grasp and analyze the structures of algorithms in stochastic systems theory.

This book provides recent results on the stochastic approximation of systems by weak convergence techniques. General and particular schemes of proofs for average, diffusion, and Poisson approximations of stochastic systems are presented, allowing one to simplify complex systems and obtain numerically tractable models.The systems discussed in the book include stochastic additive functionals, dynamical systems, stochastic integral functionals, increment processes and impulsive processes. All these systems are switched by Markov and semi-Markov processes whose phase space is considered in asymptotic split and merging schemes. Most of the results from semi-Markov processes are new and presented for the first time in this book.