Governments and clinical providers are investing billions of dollars in health information technologies (HIT). This is being done with the expectation that HIT adoption will translate into healthier patients experiencing better care at lower cost. In the initial push to roll out HIT, the reliability of these claims was often not substantiated by systematic evaluation and testing. As the first wave of widespread adoption of HIT comes to an end and the next wave begins, it is more important than ever that stakeholders evaluate the results of their investment, evaluate their success (or failure), and make decisions about future directions. Structured evaluations of a project’s impact are an essential element of the justification for investment in HIT. A systematic approach to evaluation and testing should allow for comparison between different HIT interventions with the goal of identifying and promoting those which improve clinical care or other outcomes of interest. The question of the day is no longer "why perform evaluations," but "how to perform evaluations." This updated book provides an easy-to-read reference outlining the basic concepts, theory, and methods required to perform a systematic evaluation of HIT. Chapters cover key domains of HIT evaluation: study structure and design, measurement fundamentals, results analysis, communicating results, guidelines development, and reference standards. Updated case studies and examples are included demonstrating the successes or failures of these investments. The authors also include new initiatives put in place by the government and discuss how they are being adopted and used by health systems.

Governments and clinical providers are investing billions of dollars in health information technologies. This is being done with the expectation that HIT adoption will translate into healthier patients experiencing better care at lower cost. As the first wave of adoption comes to an end, stakeholders are ready to evaluate the results of their investment and make decisions about future directions. As a result, structured evaluations of a projects impact are an essential element of the justification for investment in HIT. This book provides an easy-to-read reference outlining the basic concepts, theory, and methods required to perform a systematic evaluation of HIT.

Governments and clinical providers are investing billions of dollars in health information technologies (HIT). This is being done with the expectation that HIT adoption will translate into healthier patients experiencing better care at lower cost. In the initial push to roll out HIT, the reliability of these claims was often not substantiated by systematic evaluation and testing. As the first wave of widespread adoption of HIT comes to an end and the next wave begins, it is more important than ever that stakeholders evaluate the results of their investment, evaluate their success (or failure), and make decisions about future directions. Structured evaluations of a project's impact are an essential element of the justification for investment in HIT. A systematic approach to evaluation and testing should allow for comparison between different HIT interventions with the goal of identifying and promoting those which improve clinical care or other outcomes of interest. The question of the day is no longer "why perform evaluations," but "how to perform evaluations." This updated book provides an easy-to-read reference outlining the basic concepts, theory, and methods required to perform a systematic evaluation of HIT. Chapters cover key domains of HIT evaluation: study structure and design, measurement fundamentals, results analysis, communicating results, guidelines development, and reference standards. Updated case studies and examples are included demonstrating the successes or failures of these investments. The authors also include new initiatives put in place by the government and discuss how they are being adopted and used by health systems.

The Handbook of Evaluation Methods for Health Informatics provides a complete compendium of methods for evaluation of IT-based systems and solutions within healthcare. Emphasis is entirely on assessment of the IT-system within its organizational environment. The author provides a coherent and complete assessment of methods addressing interactions with and effects of technology at the organizational, psychological, and social levels. It offers an explanation of the terminology and theoretical foundations underlying the methodological analysis presented here. The author carefully guides the reader through the process of identifying relevant methods corresponding to specific information needs and conditions for carrying out the evaluation study. The Handbook takes a critical view by focusing on assumptions for application, tacit built-in perspectives of the methods as well as their perils and pitfalls. Collects a number of evaluation methods of medical informatics Addresses metrics and measures Includes an extensive list of anotated references, case studies, and a list of useful Web sites

10.2 The Role and Contents of the URD in an Assessment Perspective -- 10.3 The Enterprise Model -- 10.4 The Normative Model -- 10.5 Assessment of the User Requirements Document -- 10.6 Discussion -- 11 Dynamic Aspects of the Assessment Methodology -- 11.1 Dynamic Aspects of IT-Development and Application -- 11.2 Adaptation of Frames of Reference for Assessment Activities -- 11.3 Feed-forward Loops -- 11.4 Support of Context Dependent Assessment -- 11.5 Conclusion -- 12 The Dynamic Assessment Methodology -- 12.1 Philosophy -- 12.2 Application Area -- 12.3 Operationalisation of the Methodology -- 12.4 Applicable Methods -- 12.5 Summary -- 13 Discussion -- 13.1 Discussion of Fulfilment of Objective for the 4th Goal -- 13.2 Conclusion of the Study -- References -- Appendix 1: Vocabulary -- Appendix 2: Abbreviations & Acronyms -- Appendix 3: KAVAS's & ISAR's Evaluation Methodology -- Appendix 4: Methodology for Assessment of Functionality -- Appendix 5: Experimental Observations: Functionality Assessment -- Appendix 6: Experimental Observations: LFA -- Appendix 7: Causal Analysis of Experimental Observations -- Appendix 8: Method for Elicitation of a Strategy -- Appendix 9: Selected References regarding Assessment Methods

Heavily updated and revised from the successful first edition Appeals to a wide range of informatics professionals, from students to on-site medical information system administrators Includes case studies and real world system evaluations References and self-tests for feedback and motivation after each chapter Great for teaching purposes, the book is recommended for courses offered at universities such as Columbia University Precise definition and use of terms