Rules – the clearest, most explored and best understood form of knowledge representation – are particularly important for data mining, as they offer the best tradeoff between human and machine understandability. This book presents the fundamentals of rule learning as investigated in classical machine learning and modern data mining. It introduces a feature-based view, as a unifying framework for propositional and relational rule learning, thus bridging the gap between attribute-value learning and inductive logic programming, and providing complete coverage of most important elements of rule learning. The book can be used as a textbook for teaching machine learning, as well as a comprehensive reference to research in the field of inductive rule learning. As such, it targets students, researchers and developers of rule learning algorithms, presenting the fundamental rule learning concepts in sufficient breadth and depth to enable the reader to understand, develop and apply rule learning techniques to real-world data.

This book provides an introduction to the mathematical and algorithmic foundations of data science, including machine learning, high-dimensional geometry, and analysis of large networks. Topics include the counterintuitive nature of data in high dimensions, important linear algebraic techniques such as singular value decomposition, the theory of random walks and Markov chains, the fundamentals of and important algorithms for machine learning, algorithms and analysis for clustering, probabilistic models for large networks, representation learning including topic modelling and non-negative matrix factorization, wavelets and compressed sensing. Important probabilistic techniques are developed including the law of large numbers, tail inequalities, analysis of random projections, generalization guarantees in machine learning, and moment methods for analysis of phase transitions in large random graphs. Additionally, important structural and complexity measures are discussed such as matrix norms and VC-dimension. This book is suitable for both undergraduate and graduate courses in the design and analysis of algorithms for data.

A new edition of a graduate-level machine learning textbook that focuses on the analysis and theory of algorithms. This book is a general introduction to machine learning that can serve as a textbook for graduate students and a reference for researchers. It covers fundamental modern topics in machine learning while providing the theoretical basis and conceptual tools needed for the discussion and justification of algorithms. It also describes several key aspects of the application of these algorithms. The authors aim to present novel theoretical tools and concepts while giving concise proofs even for relatively advanced topics. Foundations of Machine Learning is unique in its focus on the analysis and theory of algorithms. The first four chapters lay the theoretical foundation for what follows; subsequent chapters are mostly self-contained. Topics covered include the Probably Approximately Correct (PAC) learning framework; generalization bounds based on Rademacher complexity and VC-dimension; Support Vector Machines (SVMs); kernel methods; boosting; on-line learning; multi-class classification; ranking; regression; algorithmic stability; dimensionality reduction; learning automata and languages; and reinforcement learning. Each chapter ends with a set of exercises. Appendixes provide additional material including concise probability review. This second edition offers three new chapters, on model selection, maximum entropy models, and conditional entropy models. New material in the appendixes includes a major section on Fenchel duality, expanded coverage of concentration inequalities, and an entirely new entry on information theory. More than half of the exercises are new to this edition.

Introduces machine learning and its algorithmic paradigms, explaining the principles behind automated learning approaches and the considerations underlying their usage.

This book constitutes the refereed proceedings of the 9th International RuleML Symposium, RuleML 2015, held in Berlin, Germany, in August 2015. The 25 full papers, 4 short papers, 2 full keynote papers, 2 invited research track overview papers, 1 invited paper, 1 invited abstracts presented were carefully reviewed and selected from 63 submissions. The papers cover the following topics: general RuleML track; complex event processing track, existential rules and datalog+/- track; legal rules and reasoning track; rule learning track; industry track.

"English is so illogical!" It is generally believed that English is a language of exceptions. For many, learning to spell and read is frustrating. For some, it is impossible... especially for the 29% of Americans who are functionally illiterate. But what if the problem is not the language itself, but the rules we were taught? What if we could see the complexity of English as a powerful tool rather than a hindrance? --Denise Eide Uncovering the Logic of English challenges the notion that English is illogical by systematically explaining English spelling and answering questions like "Why is there a silent final E in have, large, and house?" and "Why is discussion spelled with -sion rather than -tion?" With easy-to-read examples and anecdotes, this book describes: - the phonograms and spelling rules which explain 98% of English words - how English words are formed and how this knowledge can revolutionize vocabulary development - how understanding the reasons behind English spelling prevents students from needing to guess The author's inspiring commentary makes a compelling case that understanding the logic of English could transform literacy education and help solve America's literacy crisis. Thorough and filled with the latest linguistic and reading research, Uncovering the Logic of English demonstrates why this systematic approach should be as foundational to our education as 1+1=2.

This book is about making machine learning models and their decisions interpretable. After exploring the concepts of interpretability, you will learn about simple, interpretable models such as decision trees, decision rules and linear regression. Later chapters focus on general model-agnostic methods for interpreting black box models like feature importance and accumulated local effects and explaining individual predictions with Shapley values and LIME. All interpretation methods are explained in depth and discussed critically. How do they work under the hood? What are their strengths and weaknesses? How can their outputs be interpreted? This book will enable you to select and correctly apply the interpretation method that is most suitable for your machine learning project.