Neural networks are members of a class of software that have the potential to enable intelligent computational systems capable of simulating characteristics of biological thinking and learning. Currently no standards exist to verify and validate neural network-based systems. NASA Independent Verification and Validation Facility has contracted the Institute for Scientific Research, Inc. to perform research on this topic and develop a comprehensive guide to performing V&V on adaptive systems, with emphasis on neural networks used in safety-critical or mission-critical applications. Methods and Procedures for the Verification and Validation of Artificial Neural Networks is the culmination of the first steps in that research. This volume introduces some of the more promising methods and techniques used for the verification and validation (V&V) of neural networks and adaptive systems. A comprehensive guide to performing V&V on neural network systems, aligned with the IEEE Standard for Software Verification and Validation, will follow this book.

This book provides guidance on the verification and validation of neural networks/adaptive systems. Considering every process, activity, and task in the lifecycle, it supplies methods and techniques that will help the developer or V&V practitioner be confident that they are supplying an adaptive/neural network system that will perform as intended. Additionally, it is structured to be used as a cross-reference to the IEEE 1012 standard.

Autonomous systems are those that evolve over time, and through learning, can make intelligent decisions when faced with unidentified and unknown situations. Artificial Neural Networks (ANN) has been applied to an increasing number of real-world problems with considerable complexity. Due to their learning abilities, ANN-based systems have been increasingly attracting attention in applications where autonomy is critical and where identification of possible fault scenarios is not exhaustive before hand. We have proposed a methodology in which the learning rules that a trained network has adapted can be extracted and refined using rule extraction and rule refinement techniques, respectively, and then these refined rules are subsequently formally specified and verified against requirements specification using formal methods. The effectiveness of the proposed approach has been demonstrated using a case study of an attitude control subsystem of a satellite.

The Dryden Flight Research Center V&V working group and NASA Ames Research Center Automated Software Engineering (ASE) group collaborated to prepare this report. The purpose is to describe V&V processes and methods for certification of neural networks for aerospace applications, particularly adaptive flight control systems like Intelligent Flight Control Systems (IFCS) that use neural networks. This report is divided into the following two sections: 1) Overview of Adaptive Systems; and 2) V&V Processes/Methods.Mackall, Dale and Nelson, Stacy and Schumman, Johann and Clancy, Daniel (Technical Monitor)Ames Research Center; Armstrong Flight Research CenterAEROSPACE SYSTEMS; NEURAL NETS; SOFTWARE ENGINEERING; PROGRAM VERIFICATION (COMPUTERS); ADAPTIVE CONTROL; FLIGHT CONTROL; PERFORMANCE TESTS; COMPUTERIZED SIMULATION; SENSITIVITY ANALYSIS; AIRCRAFT STRUCTURES

This open access two-volume set LNCS 11561 and 11562 constitutes the refereed proceedings of the 31st International Conference on Computer Aided Verification, CAV 2019, held in New York City, USA, in July 2019. The 52 full papers presented together with 13 tool papers and 2 case studies, were carefully reviewed and selected from 258 submissions. The papers were organized in the following topical sections: Part I: automata and timed systems; security and hyperproperties; synthesis; model checking; cyber-physical systems and machine learning; probabilistic systems, runtime techniques; dynamical, hybrid, and reactive systems; Part II: logics, decision procedures; and solvers; numerical programs; verification; distributed systems and networks; verification and invariants; and concurrency.

Sponsored by the Committee on Expert Systems and Artificial Intelligence of the Technical Council on Computer Practices of ASCE. This report illustrates advanced methods and new developments in the application of artificial neural networks to solve problems in civil engineering.Ø Topics include: Øevaluating new construction technologies; Øusing multi-layeredØartificial neural networkØarchitecture to overcome problems with conventional traffic signal control systems; Øincreasing the computational efficiency of an optimization model; Øpredicting carbonation depth in concrete structures; Ødetecting defects in concrete piles; Øanalyzing pavement systems; Øusing neural network hybrids to select the most appropriate bidders for a construction project; and Øpredicting the Energy Performance Index of residential buildings. ØMany of the ideas and techniques discussed in this book cross across disciplinary boundaries and, therefore, should be of interest to all civil engineers.