Since its initial publication, this text has defined courses in dynamic optimization taught to economics and management science students. The two-part treatment covers the calculus of variations and optimal control. 1998 edition.

A complete and accessible introduction to the real-world applications of approximate dynamic programming With the growing levels of sophistication in modern-day operations, it is vital for practitioners to understand how to approach, model, and solve complex industrial problems. Approximate Dynamic Programming is a result of the author's decades of experience working in large industrial settings to develop practical and high-quality solutions to problems that involve making decisions in the presence of uncertainty. This groundbreaking book uniquely integrates four distinct disciplines—Markov design processes, mathematical programming, simulation, and statistics—to demonstrate how to successfully model and solve a wide range of real-life problems using the techniques of approximate dynamic programming (ADP). The reader is introduced to the three curses of dimensionality that impact complex problems and is also shown how the post-decision state variable allows for the use of classical algorithmic strategies from operations research to treat complex stochastic optimization problems. Designed as an introduction and assuming no prior training in dynamic programming of any form, Approximate Dynamic Programming contains dozens of algorithms that are intended to serve as a starting point in the design of practical solutions for real problems. The book provides detailed coverage of implementation challenges including: modeling complex sequential decision processes under uncertainty, identifying robust policies, designing and estimating value function approximations, choosing effective stepsize rules, and resolving convergence issues. With a focus on modeling and algorithms in conjunction with the language of mainstream operations research, artificial intelligence, and control theory, Approximate Dynamic Programming: Models complex, high-dimensional problems in a natural and practical way, which draws on years of industrial projects Introduces and emphasizes the power of estimating a value function around the post-decision state, allowing solution algorithms to be broken down into three fundamental steps: classical simulation, classical optimization, and classical statistics Presents a thorough discussion of recursive estimation, including fundamental theory and a number of issues that arise in the development of practical algorithms Offers a variety of methods for approximating dynamic programs that have appeared in previous literature, but that have never been presented in the coherent format of a book Motivated by examples from modern-day operations research, Approximate Dynamic Programming is an accessible introduction to dynamic modeling and is also a valuable guide for the development of high-quality solutions to problems that exist in operations research and engineering. The clear and precise presentation of the material makes this an appropriate text for advanced undergraduate and beginning graduate courses, while also serving as a reference for researchers and practitioners. A companion Web site is available for readers, which includes additional exercises, solutions to exercises, and data sets to reinforce the book's main concepts.

INTRODUCTION 1.

An introduction to the variational methods used to formulate and solve mathematical and physical problems, allowing the reader an insight into the systematic use of elementary (partial) convexity of differentiable functions in Euclidian space. By helping students directly characterize the solutions for many minimization problems, the text serves as a prelude to the field theory for sufficiency, laying as it does the groundwork for further explorations in mathematics, physics, mechanical and electrical engineering, as well as computer science.

Optimal control theory is a technique being used increasingly by academic economists to study problems involving optimal decisions in a multi-period framework. This textbook is designed to make the difficult subject of optimal control theory easily accessible to economists while at the same time maintaining rigour. Economic intuitions are emphasized, and examples and problem sets covering a wide range of applications in economics are provided to assist in the learning process. Theorems are clearly stated and their proofs are carefully explained. The development of the text is gradual and fully integrated, beginning with simple formulations and progressing to advanced topics such as control parameters, jumps in state variables, and bounded state space. For greater economy and elegance, optimal control theory is introduced directly, without recourse to the calculus of variations. The connection with the latter and with dynamic programming is explained in a separate chapter. A second purpose of the book is to draw the parallel between optimal control theory and static optimization. Chapter 1 provides an extensive treatment of constrained and unconstrained maximization, with emphasis on economic insight and applications. Starting from basic concepts, it derives and explains important results, including the envelope theorem and the method of comparative statics. This chapter may be used for a course in static optimization. The book is largely self-contained. No previous knowledge of differential equations is required.

Building on a base of simple economic theory and elementary linear algebra and calculus, this broad treatment of static and dynamic optimization methods discusses the importance of shadow prices, and reviews functions defined by solutions of optimization problems. Recently revised and expanded, the second edition will be a valuable resource for upper level undergraduate and graduate students.

This is the first comprehensive introduction to the concepts, theories, and applications of pricing and revenue optimization. From the initial success of "yield management" in the commercial airline industry down to more recent successes of markdown management and dynamic pricing, the application of mathematical analysis to optimize pricing has become increasingly important across many different industries. But, since pricing and revenue optimization has involved the use of sophisticated mathematical techniques, the topic has remained largely inaccessible to students and the typical manager. With methods proven in the MBA courses taught by the author at Columbia and Stanford Business Schools, this book presents the basic concepts of pricing and revenue optimization in a form accessible to MBA students, MS students, and advanced undergraduates. In addition, managers will find the practical approach to the issue of pricing and revenue optimization invaluable. Solutions to the end-of-chapter exercises are available to instructors who are using this book in their courses. For access to the solutions manual, please contact [email protected].