This book studies mathematical theories of machine learning. The first part of the book explores the optimality and adaptivity of choosing step sizes of gradient descent for escaping strict saddle points in non-convex optimization problems. In the second part, the authors propose algorithms to find local minima in nonconvex optimization and to obtain global minima in some degree from the Newton Second Law without friction. In the third part, the authors study the problem of subspace clustering with noisy and missing data, which is a problem well-motivated by practical applications data subject to stochastic Gaussian noise and/or incomplete data with uniformly missing entries. In the last part, the authors introduce an novel VAR model with Elastic-Net regularization and its equivalent Bayesian model allowing for both a stable sparsity and a group selection.

This book studies mathematical theories of machine learning. The first part of the book explores the optimality and adaptivity of choosing step sizes of gradient descent for escaping strict saddle points in non-convex optimization problems. In the second part, the authors propose algorithms to find local minima in nonconvex optimization and to obtain global minima in some degree from the Newton Second Law without friction. In the third part, the authors study the problem of subspace clustering with noisy and missing data, which is a problem well-motivated by practical applications data subject to stochastic Gaussian noise and/or incomplete data with uniformly missing entries. In the last part, the authors introduce an novel VAR model with Elastic-Net regularization and its equivalent Bayesian model allowing for both a stable sparsity and a group selection. Provides a thorough look into the variety of mathematical theories of machine learning Presented in four parts, allowing for readers to easily navigate the complex theories Includes extensive empirical studies on both the synthetic and real application time series data.

Recently, nature has stimulated many successful techniques, algorithms, and computational applications allowing conventionally difficult problems to be solved through novel computing systems. Nature-Inspired Informatics for Intelligent Applications and Knowledge Discovery: Implications in Business, Science, and Engineering provides the latest findings in nature-inspired algorithms and their applications for breakthroughs in a wide range of disciplinary fields. This defining reference collection contains chapters written by leading researchers and well-known academicians within the field, offering readers a valuable and enriched accumulation of knowledge.

Signal Processing and Machine Learning Theory, authored by world-leading experts, reviews the principles, methods and techniques of essential and advanced signal processing theory. These theories and tools are the driving engines of many current and emerging research topics and technologies, such as machine learning, autonomous vehicles, the internet of things, future wireless communications, medical imaging, etc. - Provides quick tutorial reviews of important and emerging topics of research in signal processing-based tools - Presents core principles in signal processing theory and shows their applications - Discusses some emerging signal processing tools applied in machine learning methods - References content on core principles, technologies, algorithms and applications - Includes references to journal articles and other literature on which to build further, more specific, and detailed knowledge

The third edition of the bestselling Classification Methods for Remotely Sensed Data covers current state-of-the-art machine learning algorithms and developments in the analysis of remotely sensed data. This book is thoroughly updated to meet the needs of readers today and provides six new chapters on deep learning, feature extraction and selection, multisource image fusion, hyperparameter optimization, accuracy assessment with model explainability, and object-based image analysis, which is relatively a new paradigm in image processing and classification. It presents new AI-based analysis tools and metrics together with ongoing debates on accuracy assessment strategies and XAI methods. New in this edition: Provides comprehensive background on the theory of deep learning and its application to remote sensing data. Includes a chapter on hyperparameter optimization techniques to guarantee the highest performance in classification applications. Outlines the latest strategies and accuracy measures in accuracy assessment and summarizes accuracy metrics and assessment strategies. Discusses the methods used for explaining inherent structures and weighing the features of ML and AI algorithms that are critical for explaining the robustness of the models. This book is intended for industry professionals, researchers, academics, and graduate students who want a thorough and up-to-date guide to the many and varied techniques of image classification applied in the fields of geography, geospatial and earth sciences, electronic and computer science, environmental engineering, etc.

Machine Learning and the City Explore the applications of machine learning and artificial intelligence to the built environment Machine Learning and the City: Applications in Architecture and Urban Design delivers a robust exploration of machine learning (ML) and artificial intelligence (AI) in the context of the built environment. Relevant contributions from leading scholars in their respective fields describe the ideas and techniques that underpin ML and AI, how to begin using ML and AI in urban design, and the likely impact of ML and AI on the future of city design and planning. Each section couples theoretical and technical chapters, authoritative references, and concrete examples and projects that illustrate the efficacy and power of machine learning in urban design. The book also includes: An introduction to the probabilistic logic that underpins machine learning Comprehensive explorations of the applications of machine learning and artificial intelligence to urban environments Practical discussions of the consequences of applied machine learning and the future of urban design Perfect for designers approaching machine learning and AI for the first time, Machine Learning and the City: Applications in Architecture and Urban Design will also earn a place in the libraries of urban planners and engineers involved in urban design.

Trained to extract actionable information from large volumes of high-dimensional data, engineers and scientists often have trouble isolating meaningful low-dimensional structures hidden in their high-dimensional observations. Manifold learning, a groundbreaking technique designed to tackle these issues of dimensionality reduction, finds widespread