This book offers a detailed review of perturbed random walks, perpetuities, and random processes with immigration. Being of major importance in modern probability theory, both theoretical and applied, these objects have been used to model various phenomena in the natural sciences as well as in insurance and finance. The book also presents the many significant results and efficient techniques and methods that have been worked out in the last decade. The first chapter is devoted to perturbed random walks and discusses their asymptotic behavior and various functionals pertaining to them, including supremum and first-passage time. The second chapter examines perpetuities, presenting results on continuity of their distributions and the existence of moments, as well as weak convergence of divergent perpetuities. Focusing on random processes with immigration, the third chapter investigates the existence of moments, describes long-time behavior and discusses limit theorems, both with and without scaling. Chapters four and five address branching random walks and the Bernoulli sieve, respectively, and their connection to the results of the previous chapters. With many motivating examples, this book appeals to both theoretical and applied probabilists.

My first encounter with renewal theory and its extensions was in 1967/68 when I took a course in probability theory and stochastic processes, where the then recent book Stochastic Processes by Professor N.D. Prabhu was one of the requirements. Later, my teacher, Professor Carl-Gustav Esseen, gave me some problems in this area for a possible thesis, the result of which was Gut (1974a). Over the years I have, on and off, continued research in this field. During this time it has become clear that many limit theorems can be obtained with the aid of limit theorems for random walks indexed by families of positive, integer valued random variables, typically by families of stopping times. During the spring semester of 1984 Professor Prabhu visited Uppsala and very soon got me started on a book focusing on this aspect. I wish to thank him for getting me into this project, for his advice and suggestions, as well as his kindness and hospitality during my stay at Cornell in the spring of 1985. Throughout the writing of this book I have had immense help and support from Svante Janson. He has not only read, but scrutinized, every word and every formula of this and earlier versions of the manuscript. My gratitude to him for all the errors he found, for his perspicacious suggestions and remarks and, above all, for what his unusual personal as well as scientific generosity has meant to me cannot be expressed in words.

Classical probability theory provides information about random walks after a fixed number of steps. For applications, however, it is more natural to consider random walks evaluated after a random number of steps. Examples are sequential analysis, queuing theory, storage and inventory theory, insurance risk theory, reliability theory, and the theory of contours. Stopped Random Walks: Limit Theorems and Applications shows how this theory can be used to prove limit theorems for renewal counting processes, first passage time processes, and certain two-dimenstional random walks, and to how these results are useful in various applications. This second edition offers updated content and an outlook on further results, extensions and generalizations. A new chapter examines nonlinear renewal processes in order to present the analagous theory for perturbed random walks, modeled as a random walk plus "noise."

The book is devoted to studies of quasi-stationary phenomena in nonlinearly perturbed stochastic systems. New methods of asymptotic analysis for nonlinearly perturbed stochastic processes based on new types of asymptotic expansions for perturbed renewal equation and recurrence algorithms for construction of asymptotic expansions for Markov type processes with absorption are presented. Asymptotic expansions are given in mixed ergodic (for processes) and large deviation theorems (for absorption times) for nonlinearly perturbed regenerative processes, semi-Markov processes, and Markov chains. Applications to analysis of quasi-stationary phenomena in nonlinearly perturbed queueing systems, population dynamics and epidemic models, and for risk processes are presented. The book also contains an extended bibliography of works in the area. It is an essential reference for theoretical and applied researchers in the field of stochastic processes and their applications and may be also useful for doctoral and advanced undergraduate students.

Sequential Analysis: Hypothesis Testing and Changepoint Detection systematically develops the theory of sequential hypothesis testing and quickest changepoint detection. It also describes important applications in which theoretical results can be used efficiently. The book reviews recent accomplishments in hypothesis testing and changepoint detection both in decision-theoretic (Bayesian) and non-decision-theoretic (non-Bayesian) contexts. The authors not only emphasize traditional binary hypotheses but also substantially more difficult multiple decision problems. They address scenarios with simple hypotheses and more realistic cases of two and finitely many composite hypotheses. The book primarily focuses on practical discrete-time models, with certain continuous-time models also examined when general results can be obtained very similarly in both cases. It treats both conventional i.i.d. and general non-i.i.d. stochastic models in detail, including Markov, hidden Markov, state-space, regression, and autoregression models. Rigorous proofs are given for the most important results. Written by leading authorities in the field, this book covers the theoretical developments and applications of sequential hypothesis testing and sequential quickest changepoint detection in a wide range of engineering and environmental domains. It explains how the theoretical aspects influence the hypothesis testing and changepoint detection problems as well as the design of algorithms.

The goal of the 2019 conference on Stochastic Processes and Algebraic Structures held in SPAS2019, Västerås, Sweden, from September 30th to October 2nd 2019, was to showcase the frontiers of research in several important areas of mathematics, mathematical statistics, and its applications. The conference was organized around the following topics 1. Stochastic processes and modern statistical methods,2. Engineering mathematics,3. Algebraic structures and their applications. The conference brought together a select group of scientists, researchers, and practitioners from the industry who are actively contributing to the theory and applications of stochastic, and algebraic structures, methods, and models. The conference provided early stage researchers with the opportunity to learn from leaders in the field, to present their research, as well as to establish valuable research contacts in order to initiate collaborations in Sweden and abroad. New methods for pricing sophisticated financial derivatives, limit theorems for stochastic processes, advanced methods for statistical analysis of financial data, and modern computational methods in various areas of applied science can be found in this book. The principal reason for the growing interest in these questions comes from the fact that we are living in an extremely rapidly changing and challenging environment. This requires the quick introduction of new methods, coming from different areas of applied science. Advanced concepts in the book are illustrated in simple form with the help of tables and figures. Most of the papers are self-contained, and thus ideally suitable for self-study. Solutions to sophisticated problems located at the intersection of various theoretical and applied areas of the natural sciences are presented in these proceedings.

This book is the second volume of a two-volume monograph devoted to the study of limit and ergodic theorems for regularly and singularly perturbed Markov chains, semi-Markov processes, and multi-alternating regenerative processes with semi-Markov modulation. The second volume presents a complete classification of ergodic theorems for alternating regenerative processes, including more than twenty-five such theorems. The text addresses new asymptotic recurrent algorithms of phase space reduction for multi-alternating regenerative processes modulating by regularly and singularly perturbed finite semi-Markov processes. It also features a new study of super-long, long, and short time ergodic theorems for these processes. The book also contains a comprehensive bibliography of major works in the field. It provides an effective reference for both graduate students as well as theoretical and applied researchers studying stochastic processes and their applications.