In 2000, total sales of software in the U.S. reached $180 billion. Reducing the cost of software development and improving software quality are important objectives of the U.S. software industry. However, the complexity of the underlying software needed to support the U.S.'s computerized economy is increasing at an alarming rate. Software nonperformance and failure are expensive, but it is difficult to define and measure software quality. The objective of this study is to investigate the economic impact of an inadequate infrastructure for software testing in the U.S. This study was undertaken as part of joint planning between NIST and industry to help identify and assess technical needs that would improve the industry's software testing capabilities. Illustrated.

This textbook is intended for SPI (software process improvement) managers and - searchers, quality managers, and experienced project and research managers. The papers constitute the research proceedings of the 16th EuroSPI (European Software Process Improvement, www.eurospi.net) conference held in Alcala (Madrid region), September 2–4, 2009, Spain. Conferences have been held since 1994 in Dublin, 1995 in Vienna (Austria), 1997 in Budapest (Hungary), 1998 in Gothenburg (Sweden), 1999 in Pori (Finland), 2000 in Copenhagen (Denmark), 2001 in Limerick (Ireland), 2002 in Nuremberg (G- many), 2003 in Graz (Austria), 2004 in Trondheim (Norway), 2005 in Budapest (Hungary), 2006 in Joensuu (Finland), 2007 in Potsdam (Germany), 2008 in Dublin (Ireland), and 2009 in Alcala (Spain). EuroSPI established an experience library (library.eurospi.net) which will be conti- ously extended over the next few years and will be made available to all attendees. EuroSPI also created an umbrella initiative for establishing a European Qualification Network in which different SPINs and national initiatives join mutually beneficial collaborations (ECQA – European Certification and Qualification Association, www.ecqa.org). With a general assembly during October 15–16, 2007 through Euro-SPI partners and networks, in collaboration with the European Union (supported by the EU L- nardo da Vinci Programme) a European certification association has been created (www.eu-certificates.org, www.ecqa.org) for the IT and services sector to offer SPI knowledge and certificates to industry, establishing close knowledge transfer links between research and industry.

This book constitutes the refereed proceedings of the 11th Software Quality Days Conference, SWQD 2019, held in Vienna, Austria, in January 2019. The Software Quality Days (SWQD) conference started in 2009 and has grown to the biggest conference on software quality in Europe with a strong community. The program of the SWQD conference is designed to encompass a stimulating mixture of practical presentations and new research topics in scientific presentations. The guiding conference topic of the SWQD 2019 is “The Complexity and Challenges of Software Engineering and Software Quality in the Cloud”. The 5 full papers and 3 short papers presented in this volume were carefully reviewed and selected from 17 submissions. The volume also contains 2 invited talks. The contributions were organized in topical sections named: multi-disciplinary systems and software engineering; software quality and process improvement; software testing; knowledge engineering and machine learning; source code analysis; and software maintenance.

“Don’s book is a very good addition both to the testing literature and to the literature on quality assurance and software engineering... . [It] is likely to become a standard for test training as well as a good reference for professional testers and developers. I would also recommend this book as background material for negotiating outsourced software contracts. I often work as an expert witness in litigation for software with very poor quality, and this book might well reduce or eliminate these lawsuits....” –Capers Jones, VP and CTO, Namcook Analytics LLC Software and system testers repeatedly fall victim to the same pitfalls. Think of them as “anti-patterns”: mistakes that make testing far less effective and efficient than it ought to be. In Common System and Software Testing Pitfalls, Donald G. Firesmith catalogs 92 of these pitfalls. Drawing on his 35 years of software and system engineering experience, Firesmith shows testers and technical managers and other stakeholders how to avoid falling into these pitfalls, recognize when they have already fallen in, and escape while minimizing their negative consequences. Firesmith writes for testing professionals and other stakeholders involved in large or medium-sized projects. His anti-patterns and solutions address both “pure software” applications and “software-reliant systems,” encompassing heterogeneous subsystems, hardware, software, data, facilities, material, and personnel. For each pitfall, he identifies its applicability, characteristic symptoms, potential negative consequences and causes, and offers specific actionable recommendations for avoiding it or limiting its consequences. This guide will help you Pinpoint testing processes that need improvement–before, during, and after the project Improve shared understanding and collaboration among all project participants Develop, review, and optimize future project testing programs Make your test documentation far more useful Identify testing risks and appropriate risk-mitigation strategies Categorize testing problems for metrics collection, analysis, and reporting Train new testers, QA specialists, and other project stakeholders With 92 common testing pitfalls organized into 14 categories, this taxonomy of testing pitfalls should be relatively complete. However, in spite of its comprehensiveness, it is also quite likely that additional pitfalls and even missing categories of pitfalls will be identified over time as testers read this book and compare it to their personal experiences. As an enhancement to the print edition, the author has provided the following location on the web where readers can find major additions and modifications to this taxonomy of pitfalls: http://donald.firesmith.net/home/common-testing-pitfalls Please send any recommended changes and additions to dgf (at) sei (dot) cmu (dot) edu, and the author will consider them for publication both on the website and in future editions of this book.

This accessible introduction demonstrates a range of testing techniques in the context of a single worked example that runs throughout. Students can easily see the strengths and limitations of progressively more complex approaches in theory and practice. Test automation and the process of testing are emphasised.