This book contains the reports of selected projects involving natural language commu nication with pictorial information systems. More than just a record of research results, however, it presents concrete applications to the solution of a wide variety of problems. The authors are all prominent figures in the field whose authoritative contributions help ensure its continued expansion in both size and significance. Y. C. Lee and K S. Fu (Purdue University, USA) survey picture query languages which form an interface between the pictorial database system and the user and support infor mation retrieval, data entry and manipulation, data analysis and output generation. They include explicit picture query languages that augment alphanumeric data query langua ges as well as languages and command sets which are implicitly embedded in a pictorial information system but perform similar functions. It is worth mentioning that some forms of query languages can be transformed from a given set of natural language senten ces by using ATN (Augmented Transition Networks), which consequently allows for na turallanguage communication with information system.

This volume contains the proceedings of the NATO Advanced Study Institute on "Pictorial Information Systems in Medicine" held August 27-September 7, 1984 in Hotel Maritim, Braunlage/Harz, Federal Republic of Germany. The program committee of the institute consisted of KH Hohne (Director), G. T Herman, G. S. Lodwick, and D. Meyer-Ebrecht. The organization was in the hands of Klaus Assmann and Fritz Bocker In the last decade medical imaging has undergone a rapid development New imaging modalities such as Computer Tomography (CT), Digital Angiography (DSA) and Magnetic Resonance Imaging (MRI) were developed using the capabilities of modern computers. In a modern hospital these technologies produce already more then 25% of image data in digital form. This format lends itself to the design of computer assisted Information systems Integrating data acquisition, presentation, communi cation and archiving for all modalities and users within a department or even a hospital. Advantages such as rapid access to any archived Image, synoptic presentation, computer assisted image analysis to name only a few, are expected. The design of such pictorial information systems, however, often called PACS (Picture Archiving and Communication Systems) In the medical community is a non-trivial task involving know-how from many disciplines such as - Medicine (especially Radiology), - Data Base Technology, - Computer Graphics, - Man Machine Interaction, - Hardware Technology and others. Most of these disCiplines are represented by disjunct scientific communities.

This book is intended as both an introduction to the state-of-the-art in visual languages, as well as an exposition of the frontiers of research in advanced visual languages. It is for computer scientists, computer engi neers, information scientists, application programmers, and technical managers responsible for software development projects who are inter ested in the methodology and manifold applications of visual languages and visual programming. The contents of this book are drawn from invited papers, as well as selected papers from two workshops: the 1985 IEEE Workshop on Lan guages for Automation-Cognitive Aspects in Information Processing, which was held in Mallorca, Spain, June 28-30, 1985; and the 1984 IEEE Workshop on Visual Languages, which was held in Hiroshima, Japan, December 7-9, 1984. Panos Ligomenides and I organized the technical program of LFA '85, and Tadao Ichikawa and I organized the techni cal program of VL '84. Both workshops have now become successful annual events in their own right. The intersecting area of visual languages and visual programming especially has become a fascinating new research area. It is hoped that this book will focus the reader's attention on some of the interesting research issues as well as the potential for future applications. After reading this book, the reader will undoubtedly get an impression that visual languages and the concept of generalized icons can be studied fruitfully from many different perspectives, including computer graphics, formal language theory, educational methodology, cognitive psychology and visual design.

In the not so distant future, we can expect a world where humans and robots coexist and interact with each other. For this to occur, we need to understand human traits, such as seeing, hearing, thinking, speaking, etc., and institute these traits in robots. The most essential feature necessary for robots to achieve is that of integrative multimedia understanding (IMU) which occurs naturally in humans. It allows us to assimilate pieces of information expressed through different modes such as speech, pictures, gestures, etc. The book describes how robots acquire traits like natural language understanding (NLU) as the central part of IMU. Mental image directed semantic theory (MIDST) is its core, and is based on the hypothesis that NLU is essentially the processing of mental image associated with natural language expressions, namely, mental-image based understanding (MBU). MIDST is intended to model omnisensory mental image in human and to afford a knowledge representation system in order for integrative management of knowledge subjective to cognitive mechanisms of intelligent entities such as humans and robots based on a mental image model visualized as ‘Loci in Attribute Spaces’ and its description language Lmd (mental image description language) to be employed for predicate logic with a systematic scheme for symbol-grounding. This language works as an interlingua among various kinds of information media, and has been applied to several versions of the intelligent system interlingual understanding model aiming at general system (IMAGES). Its latest version, i.e. conversation management system (CMS) simulates MBU and comprehends the user’s intention through dialogue to find and solve problems, and finally, provides a response in text or animation. The book is aimed at researchers and students interested in artificial intelligence, robotics, and cognitive science. Based on philosophical considerations, the methodology will also have an appeal in linguistics, psychology, ontology, geography, and cartography. Key Features: Describes the methodology to provide robots with human-like capability of natural language understanding (NLU) as the central part of IMU Uses methodology that also relates to linguistics, psychology, ontology, geography, and cartography Examines current trends in machine translation

Advances in Computers

Although there has been much progress in developing theories, models and systems in the areas of Natural Language Processing (NLP) and Vision Processing (VP) there has heretofore been little progress on integrating these subareas of Artificial Intelligence (AI). This book contains a set of edited papers addressing computational models and systems for the integration of NLP and VP. The papers focus on site descriptions such as that of the large Japanese $500 million Real World Computing (RWC) project, on historical philosophical issues, on systems which have been built and which integrate the processing of visual scenes together with language about them, and on spatial relations which appear to be the key to integration. The U.S.A., Japan and the EU are well reflected, showing up the fact that integration is a truly international issue. There is no doubt that all of this will be necessary for the InformationSuperHighways of the future.

Humanoid robots are developed to use the infrastructures designed for humans, to ease the interactions with humans, and to help the integrations into human societies. The developments of humanoid robots proceed from building individual robots to establishing societies of robots working alongside with humans. This book addresses the problems of constructing a humanoid body and mind from generating walk patterns and balance maintenance to encoding and specifying humanoid motions and the control of eye and head movements for focusing attention on moving objects. It provides methods for learning motor skills and for language acquisition and describes how to generate facial movements for expressing various emotions and provides methods for decision making and planning. This book discusses the leading researches and challenges in building humanoid robots in order to prepare for the near future when human societies will be advanced by using humanoid robots.