This open access book summarizes the first two decades of the NII Testbeds and Community for Information access Research (NTCIR). NTCIR is a series of evaluation forums run by a global team of researchers and hosted by the National Institute of Informatics (NII), Japan. The book is unique in that it discusses not just what was done at NTCIR, but also how it was done and the impact it has achieved. For example, in some chapters the reader sees the early seeds of what eventually grew to be the search engines that provide access to content on the World Wide Web, todays smartphones that can tailor what they show to the needs of their owners, and the smart speakers that enrich our lives at home and on the move. We also get glimpses into how new search engines can be built for mathematical formulae, or for the digital record of a lived human life. Key to the success of the NTCIR endeavor was early recognition that information access research is an empirical discipline and that evaluation therefore lay at the core of the enterprise. Evaluation is thus at the heart of each chapter in this book. They show, for example, how the recognition that some documents are more important than others has shaped thinking about evaluation design. The thirty-three contributors to this volume speak for the many hundreds of researchers from dozens of countries around the world who together shaped NTCIR as organizers and participants. This book is suitable for researchers, practitioners, and students--anyone who wants to learn about past and present evaluation efforts in information retrieval, information access, and natural language processing, as well as those who want to participate in an evaluation task or even to design and organize one.

The Aspiring Thinker’s Guide to Critical Thinking introduces concepts and strategies for developing essential reasoning skills and intellectual character. As students advance in their academic studies and encounter new situations in their lives, they must learn to differentiate fact from fiction and make decisions based in good reasoning. They must learn to be clear, accurate, relevant, logical, and fair when expressing ideas. This book lays out a clear framework for guiding this development and encouraging lifelong intellectual curiosity. As part of the Thinker’s Guide Library, this book advances the mission of the Foundation for Critical Thinking to promote fairminded critical societies through cultivating essential intellectual abilities and virtues across every field of study across world.

The adoption of Information Technology (IT) and Information Systems (IS) represents significant financial investments, with alternative perspectives to the evaluation domain coming from both the public and private sectors. As a result of increasing IT/IS budgets and their growing significance within the development of an organizational infrastructure, the evaluation and performance measurement of new technology remains a perennial issue for management. This book offers a refreshing and updated insight into the social fabric and technical dimensions of IT/IS evaluation together with insights into approaches used to measure the impact of information systems on its stakeholders. In doing so, it describes the portfolio of appraisal techniques that support the justification of IT/IS investments. Evaluating Information Systems explores the concept of evaluation as an evolutionary and dynamic process that takes into account the ability of enterprise technologies to integrate information systems within and between organisations. In particular, when set against a backdrop of organisational learning. It examines the changing portfolio of benefits, costs and risks associated with the adoption and diffusion of technology in today's global marketplace. Finally approaches to impact assessment through performance management and benchmarking is discussed.

Companies make a huge investment of 4 to 10% of their turnover on IT--this book reveals how this is evaluated and measured.

Provides an overview and instruction on the evaluation of interactive information retrieval systems with users.

An introduction to information retrieval, the foundation for modern search engines, that emphasizes implementation and experimentation. Information retrieval is the foundation for modern search engines. This textbook offers an introduction to the core topics underlying modern search technologies, including algorithms, data structures, indexing, retrieval, and evaluation. The emphasis is on implementation and experimentation; each chapter includes exercises and suggestions for student projects. Wumpus—a multiuser open-source information retrieval system developed by one of the authors and available online—provides model implementations and a basis for student work. The modular structure of the book allows instructors to use it in a variety of graduate-level courses, including courses taught from a database systems perspective, traditional information retrieval courses with a focus on IR theory, and courses covering the basics of Web retrieval. In addition to its classroom use, Information Retrieval will be a valuable reference for professionals in computer science, computer engineering, and software engineering.