Stochastic games provide a versatile model for reactive systems that are affected by random events. This dissertation advances the algorithmic theory of stochastic games to incorporate multiple players, whose objectives are not necessarily conflicting. The basis of this work is a comprehensive complexity-theoretic analysis of the standard game-theoretic solution concepts in the context of stochastic games over a finite state space. One main result is that the constrained existence of a Nash equilibrium becomes undecidable in this setting. This impossibility result is accompanied by several positive results, including efficient algorithms for natural special cases.

This book for beginning graduate students presents a course on stochastic games and the mathematical methods used in their analysis.

Numerical Optimization presents a comprehensive and up-to-date description of the most effective methods in continuous optimization. It responds to the growing interest in optimization in engineering, science, and business by focusing on the methods that are best suited to practical problems. For this new edition the book has been thoroughly updated throughout. There are new chapters on nonlinear interior methods and derivative-free methods for optimization, both of which are used widely in practice and the focus of much current research. Because of the emphasis on practical methods, as well as the extensive illustrations and exercises, the book is accessible to a wide audience. It can be used as a graduate text in engineering, operations research, mathematics, computer science, and business. It also serves as a handbook for researchers and practitioners in the field. The authors have strived to produce a text that is pleasant to read, informative, and rigorous - one that reveals both the beautiful nature of the discipline and its practical side.

This volume is based on lectures delivered at the 2011 AMS Short Course on Evolutionary Game Dynamics, held January 4-5, 2011 in New Orleans, Louisiana. Evolutionary game theory studies basic types of social interactions in populations of players. It combines the strategic viewpoint of classical game theory (independent rational players trying to outguess each other) with population dynamics (successful strategies increase their frequencies). A substantial part of the appeal of evolutionary game theory comes from its highly diverse applications such as social dilemmas, the evolution of language, or mating behaviour in animals. Moreover, its methods are becoming increasingly popular in computer science, engineering, and control theory. They help to design and control multi-agent systems, often with a large number of agents (for instance, when routing drivers over highway networks or data packets over the Internet). While these fields have traditionally used a top down approach by directly controlling the behaviour of each agent in the system, attention has recently turned to an indirect approach allowing the agents to function independently while providing incentives that lead them to behave in the desired way. Instead of the traditional assumption of equilibrium behaviour, researchers opt increasingly for the evolutionary paradigm and consider the dynamics of behaviour in populations of agents employing simple, myopic decision rules.

This book constitutes the refereed proceedings of the 12th International Conference on Decision and Game Theory for Security, GameSec 2021,held in October 2021. Due to COVID-19 pandemic the conference was held virtually. The 20 full papers presented were carefully reviewed and selected from 37 submissions. The papers focus on Theoretical Foundations in Equilibrium Computation; Machine Learning and Game Theory; Ransomware; Cyber-Physical Systems Security; Innovations in Attacks and Defenses.

Game theory involves multi-person decision making and differential dynamic game theory has been widely applied to n-person decision making problems, which are stimulated by a vast number of applications. This book addresses the gap to discuss general stochastic n-person noncooperative and cooperative game theory with wide applications to control systems, signal processing systems, communication systems, managements, financial systems, and biological systems. H∞ game strategy, n-person cooperative and noncooperative game strategy are discussed for linear and nonlinear stochastic systems along with some computational algorithms developed to efficiently solve these game strategies.

We live in a highly connected world with multiple self-interested agents interacting and myriad opportunities for conflict and cooperation. The goal of game theory is to understand these opportunities. This book presents a rigorous introduction to the mathematics of game theory without losing sight of the joy of the subject. This is done by focusing on theoretical highlights (e.g., at least six Nobel Prize winning results are developed from scratch) and by presenting exciting connections of game theory to other fields such as computer science (algorithmic game theory), economics (auctions and matching markets), social choice (voting theory), biology (signaling and evolutionary stability), and learning theory. Both classical topics, such as zero-sum games, and modern topics, such as sponsored search auctions, are covered. Along the way, beautiful mathematical tools used in game theory are introduced, including convexity, fixed-point theorems, and probabilistic arguments. The book is appropriate for a first course in game theory at either the undergraduate or graduate level, whether in mathematics, economics, computer science, or statistics. The importance of game-theoretic thinking transcends the academic setting—for every action we take, we must consider not only its direct effects, but also how it influences the incentives of others.