This book is a revision of Stochastic Processes in Information and Dynamical Systems written by the first author (E.W.) and published in 1971. The book was originally written, and revised, to provide a graduate level text in stochastic processes for students whose primary interest is its applications. It treats both the traditional topic of sta tionary processes in linear time-invariant systems as well as the more modern theory of stochastic systems in which dynamic structure plays a profound role. Our aim is to provide a high-level, yet readily acces sible, treatment of those topics in the theory of continuous-parameter stochastic processes that are important in the analysis of information and dynamical systems. The theory of stochastic processes can easily become abstract. In dealing with it from an applied point of view, we have found it difficult to decide on the appropriate level of rigor. We intend to provide just enough mathematical machinery so that important results can be stated PREFACE vi with precision and clarity; so much ofthe theory of stochastic processes is inherently simple if the suitable framework is provided. The price of providing this framework seems worth paying even though the ul timate goal is in applications and not the mathematics per se.

Suitable for a one-semester course, this text teaches students how to use stochastic processes efficiently. Carefully balancing mathematical rigor and ease of exposition, the book provides students with a sufficient understanding of the theory and a practical appreciation of how it is used in real-life situations. Special emphasis is on the interpretation of various statistical models and concepts as well as the types of questions statistical analysis can answer. To enable hands-on practice, MATLAB code is available online.

Stochastic processes are found in probabilistic systems that evolve with time. Discrete stochastic processes change by only integer time steps (for some time scale), or are characterized by discrete occurrences at arbitrary times. Discrete Stochastic Processes helps the reader develop the understanding and intuition necessary to apply stochastic process theory in engineering, science and operations research. The book approaches the subject via many simple examples which build insight into the structure of stochastic processes and the general effect of these phenomena in real systems. The book presents mathematical ideas without recourse to measure theory, using only minimal mathematical analysis. In the proofs and explanations, clarity is favored over formal rigor, and simplicity over generality. Numerous examples are given to show how results fail to hold when all the conditions are not satisfied. Audience: An excellent textbook for a graduate level course in engineering and operations research. Also an invaluable reference for all those requiring a deeper understanding of the subject.

This book presents a self-contained introduction to stochastic processes with emphasis on their applications in science, engineering, finance, computer science, and operations research. It provides theoretical foundations for modeling time-dependent random phenomena in these areas and illustrates their application by analyzing numerous practical examples. The treatment assumes few prerequisites, requiring only the standard mathematical maturity acquired by undergraduate applied science students. It includes an introductory chapter that summarizes the basic probability theory needed as background. Numerous exercises reinforce the concepts and techniques discussed and allow readers to assess their grasp of the subject. Solutions to most of the exercises are provided in an appendix. While focused primarily on practical aspects, the presentation includes some important proofs along with more challenging examples and exercises for those more theoretically inclined. Mastering the contents of this book prepares readers to apply stochastic modeling in their own fields and enables them to work more creatively with software designed for dealing with the data analysis aspects of stochastic processes.