Topics include matrix-geometric invariant vectors, buffer models, queues in a random environment and more.

Topics include matrix-geometric invariant vectors, buffer models, queues in a random environment and more.

Presents the basic mathematical ideas and algorithms of the matrix analytic theory in a readable, up-to-date, and comprehensive manner.

Matrix-analytic methods (MAM) were introduced by Professor Marcel Neuts and have been applied to a variety of stochastic models since. In order to provide a clear and deep understanding of MAM while showing their power, this book presents MAM concepts and explains the results using a number of worked-out examples. This book's approach will inform and kindle the interest of researchers attracted to this fertile field. To allow readers to practice and gain experience in the algorithmic and computational procedures of MAM, Introduction to Matrix-Analytic Methods in Queues 2 provides a number of computational exercises. It also incorporates simulation as another tool for studying complex stochastic models, especially when the state space of the underlying stochastic models under analytic study grows exponentially. This book's detailed approach will make it more accessible for readers interested in learning about MAM in stochastic models.

Great advances have been made in recent years in the field of computational probability. In particular, the state of the art - as it relates to queuing systems, stochastic Petri-nets and systems dealing with reliability - has benefited significantly from these advances. The objective of this book is to make these topics accessible to researchers, graduate students, and practitioners. Great care was taken to make the exposition as clear as possible. Every line in the book has been evaluated, and changes have been made whenever it was felt that the initial exposition was not clear enough for the intended readership. The work of major research scholars in this field comprises the individual chapters of Computational Probability. The first chapter describes, in nonmathematical terms, the challenges in computational probability. Chapter 2 describes the methodologies available for obtaining the transition matrices for Markov chains, with particular emphasis on stochastic Petri-nets. Chapter 3 discusses how to find transient probabilities and transient rewards for these Markov chains. The next two chapters indicate how to find steady-state probabilities for Markov chains with a finite number of states. Both direct and iterative methods are described in Chapter 4. Details of these methods are given in Chapter 5. Chapters 6 and 7 deal with infinite-state Markov chains, which occur frequently in queueing, because there are times one does not want to set a bound for all queues. Chapter 8 deals with transforms, in particular Laplace transforms. The work of Ward Whitt and his collaborators, who have recently developed a number of numerical methods for Laplace transform inversions, is emphasized in this chapter. Finally, if one wants to optimize a system, one way to do the optimization is through Markov decision making, described in Chapter 9. Markov modeling has found applications in many areas, three of which are described in detail: Chapter 10 analyzes discrete-time queues, Chapter 11 describes networks of queues, and Chapter 12 deals with reliability theory.

The aim of this special issue is to publish original research papers that cover recent advances in the theory and application of stochastic processes. There is especial focus on applications of stochastic processes as models of dynamic phenomena in various research areas, such as queuing theory, physics, biology, economics, medicine, reliability theory, and financial mathematics. Potential topics include, but are not limited to: Markov chains and processes; large deviations and limit theorems; random motions; stochastic biological model; reliability, availability, maintenance, inspection; queueing models; queueing network models; computational methods for stochastic models; applications to risk theory, insurance and mathematical finance.