This book is the first easy-to-read text on nonsmooth optimization (NSO, not necessarily differentiable optimization). Solving these kinds of problems plays a critical role in many industrial applications and real-world modeling systems, for example in the context of image denoising, optimal control, neural network training, data mining, economics and computational chemistry and physics. The book covers both the theory and the numerical methods used in NSO and provide an overview of different problems arising in the field. It is organized into three parts: 1. convex and nonconvex analysis and the theory of NSO; 2. test problems and practical applications; 3. a guide to NSO software. The book is ideal for anyone teaching or attending NSO courses. As an accessible introduction to the field, it is also well suited as an independent learning guide for practitioners already familiar with the basics of optimization.

This book is a self-contained elementary study for nonsmooth analysis and optimization, and their use in solution of nonsmooth optimal control problems. The first part of the book is concerned with nonsmooth differential calculus containing necessary tools for nonsmooth optimization. The second part is devoted to the methods of nonsmooth optimization and their development. A proximal bundle method for nonsmooth nonconvex optimization subject to nonsmooth constraints is constructed. In the last part nonsmooth optimization is applied to problems arising from optimal control of systems covered by partial differential equations. Several practical problems, like process control and optimal shape design problems are considered.

The goal of this book is to present the main ideas and techniques in the field of continuous smooth and nonsmooth optimization. Starting with the case of differentiable data and the classical results on constrained optimization problems, and continuing with the topic of nonsmooth objects involved in optimization theory, the book concentrates on both theoretical and practical aspects of this field. This book prepares those who are engaged in research by giving repeated insights into ideas that are subsequently dealt with and illustrated in detail.

Functional analysis has become one of the essential foundations of modern applied mathematics in the last decades, from the theory and numerical solution of differential equations, from optimization and probability theory to medical imaging and mathematical image processing. This textbook offers a compact introduction to the theory and is designed to be used during one semester, fitting exactly 26 lectures of 90 minutes each. It ranges from the topological fundamentals recalled from basic lectures on real analysis to spectral theory in Hilbert spaces. Special attention is given to the central results on dual spaces and weak convergence.

"This book concerns matter that is intrinsically difficult: convex optimization, complementarity and duality, nonsmooth analysis, linear and nonlinear programming, etc. The author has skillfully introduced these and many more concepts, and woven them into a seamless whole by retaining an easy and consistent style throughout. The book is not all the

This second edition provides an enhanced exposition of the long-overlooked Hadamard semidifferential calculus, first introduced in the 1920s by mathematicians Jacques Hadamard and Maurice René Fréchet. Hadamard semidifferential calculus is possibly the largest family of nondifferentiable functions that retains all the features of classical differential calculus, including the chain rule, making it a natural framework for initiating a large audience of undergraduates and non-mathematicians into the world of nondifferentiable optimization. Introduction to Optimization and Hadamard Semidifferential Calculus, Second Edition builds upon its prior edition’s foundations in Hadamard semidifferential calculus, showcasing new material linked to convex analysis and nonsmooth optimization. It presents a modern treatment of optimization and Hadamard semidifferential calculus while remaining at a level that is accessible to undergraduate students, and challenges students with exercises related to problems in such fields as engineering, mechanics, medicine, physics, and economics. Answers are supplied in Appendix B. Students of mathematics, physics, engineering, economics, and other disciplines that demand a basic knowledge of mathematical analysis and linear algebra will find this a fitting primary or companion resource for their studies. This textbook has been designed and tested for a one-term course at the undergraduate level. In its full version, it is appropriate for a first-year graduate course and as a reference.

The aim of this book was to collect the most recent methods developed for NSO and its practical applications. The book contains seven papers: The first is the foreword by the Guest Editors giving a brief review of NSO and its real-life applications and acknowledging the outstanding contributions of Professor Adil Bagirov to both the theoretical and practical aspects of NSO. The second paper introduces a new and very efficient algorithm for solving uncertain unit-commitment (UC) problems. The third paper proposes a new nonsmooth version of the generalized damped Gauss–Newton method for solving nonlinear complementarity problems. In the fourth paper, the abs-linear representation of piecewise linear functions is extended to yield simultaneously their DC decomposition as well as the pair of generalized gradients. The fifth paper presents the use of biased-randomized algorithms as an effective methodology to cope with NP-hard and nonsmooth optimization problems in many practical applications. In the sixth paper, a problem concerning the scheduling of nuclear waste disposal is modeled as a nonsmooth multiobjective mixed-integer nonlinear optimization problem, and a novel method using the two-slope parameterized achievement scalarizing functions is introduced. Finally, the last paper considers binary classification of a multiple instance learning problem and formulates the learning problem as a nonconvex nonsmooth unconstrained optimization problem with a DC objective function.