Address vector and matrix methods necessary in numerical methods and optimization of linear systems in engineering with this unified text. Treats the mathematical models that describe and predict the evolution of our processes and systems, and the numerical methods required to obtain approximate solutions. Explores the dynamical systems theory used to describe and characterize system behaviour, alongside the techniques used to optimize their performance. Integrates and unifies matrix and eigenfunction methods with their applications in numerical and optimization methods. Consolidating, generalizing, and unifying these topics into a single coherent subject, this practical resource is suitable for advanced undergraduate students and graduate students in engineering, physical sciences, and applied mathematics.

Vector and matrix algebra -- Algebraic eigenproblems and their applications -- Differential eigenproblems and their applications -- Vector and matrix calculus -- Analysis of discrete dynamical systems -- Computational linear algebra -- Numerical methods for differential equations -- Finite-difference methods for boundary-value problems -- Finite-difference methods for initial-value problems -- Least-squares methods -- Data analysis : curve fitting and interpolation -- Optimization and root finding of algebraic systems -- Data-driven methods and reduced-order modeling.

This book reflects the strong connection between calculus of variations and the applications for which variational methods form the foundation.

The new edition of this book presents a comprehensive and up-to-date description of the most effective methods in continuous optimization. It responds to the growing interest in optimization in engineering, science, and business by focusing on methods best suited to practical problems. This edition has been thoroughly updated throughout. There are new chapters on nonlinear interior methods and derivative-free methods for optimization, both of which are widely used in practice and are the focus of much current research. Because of the emphasis on practical methods, as well as the extensive illustrations and exercises, the book is accessible to a wide audience.

This advanced textbook provides an introduction to the basic methods of computational physics.

Based on course-tested material, this rigorous yet accessible graduate textbook covers both fundamental and advanced optimization theory and algorithms. It covers a wide range of numerical methods and topics, including both gradient-based and gradient-free algorithms, multidisciplinary design optimization, and uncertainty, with instruction on how to determine which algorithm should be used for a given application. It also provides an overview of models and how to prepare them for use with numerical optimization, including derivative computation. Over 400 high-quality visualizations and numerous examples facilitate understanding of the theory, and practical tips address common issues encountered in practical engineering design optimization and how to address them. Numerous end-of-chapter homework problems, progressing in difficulty, help put knowledge into practice. Accompanied online by a solutions manual for instructors and source code for problems, this is ideal for a one- or two-semester graduate course on optimization in aerospace, civil, mechanical, electrical, and chemical engineering departments.

A hands-on text integrating mathematics, numerics and applications of optimization, with MATLAB code illustrating every concept.