Accompanying continued industrial production and sales of artificial intelligence and expert systems is the risk that difficult and resistant theoretical problems and issues will be ignored. The participants at the Third Tinlap Workshop, whose contributions are contained in Theoretical Issues in Natural Language Processing, remove that risk. They discuss and promote theoretical research on natural language processing, examinations of solutions to current problems, development of new theories, and representations of published literature on the subject. Discussions among these theoreticians in artificial intelligence, logic, psychology, philosophy, and linguistics draw a comprehensive, up-to-date picture of the natural language processing field.

Embeddings have undoubtedly been one of the most influential research areas in Natural Language Processing (NLP). Encoding information into a low-dimensional vector representation, which is easily integrable in modern machine learning models, has played a central role in the development of NLP. Embedding techniques initially focused on words, but the attention soon started to shift to other forms: from graph structures, such as knowledge bases, to other types of textual content, such as sentences and documents. This book provides a high-level synthesis of the main embedding techniques in NLP, in the broad sense. The book starts by explaining conventional word vector space models and word embeddings (e.g., Word2Vec and GloVe) and then moves to other types of embeddings, such as word sense, sentence and document, and graph embeddings. The book also provides an overview of recent developments in contextualized representations (e.g., ELMo and BERT) and explains their potential in NLP. Throughout the book, the reader can find both essential information for understanding a certain topic from scratch and a broad overview of the most successful techniques developed in the literature.

Four separate essays address the complex and difficult connections among grammatical theory, mathematical linguistics, and the operation of real natural-language-processing systems, both human and electronic.William Rounds, Avarind Joshi, Janet Fodor, and Robert Berwick are leading scholars in the multidisciplinary field of natural language processing. In four separate essays they address the complex and difficult connections among grammatical theory, mathematical linguistics, and the operation of real natural-language-processing systems, both human and electronic. The editors' substantial introduction details the progress and problems involved in attempts to relate these four areas of research. William Rounds discusses the relevance of complexity results to linguistics and computational linguistics, providing useful caveats about how results might be misinterpreted and pointing out promising avenues of future research. Avarind Joshi (with K. Vijay-Shanker and David Weir) surveys results showing the equivalence of several different grammatical formalisms, all of which are mildly context-sensitive, with special attention to variants of tree adjoining grammar. Janet Fodor discusses how psycholinguistic results can bear on the choice among competing grammatical theories, surveying a number of recent experiments and their relevance to issues in grammatical theory. Robert Berwick considers the relationship between issues in linguistic theory and the construction of computational parsing systems, in particular the question of what it means to implement a theory of grammar in a computational system. He argues for the advantages of a principle-based approach over a rule-based one, and surveys several recent parsing systems based on the theory of government and binding.

This volume brings together revised versions of a selection of papers presented at the 2003 International Conference on “Recent Advances in Natural Language Processing”. A wide range of topics is covered in the volume: semantics, dialogue, summarization, anaphora resolution, shallow parsing, morphology, part-of-speech tagging, named entity, question answering, word sense disambiguation, information extraction. Various ‘state-of-the-art’ techniques are explored: finite state processing, machine learning (support vector machines, maximum entropy, decision trees, memory-based learning, inductive logic programming, transformation-based learning, perceptions), latent semantic analysis, constraint programming. The papers address different languages (Arabic, English, German, Slavic languages) and use different linguistic frameworks (HPSG, LFG, constraint-based DCG). This book will be of interest to those who work in computational linguistics, corpus linguistics, human language technology, translation studies, cognitive science, psycholinguistics, artificial intelligence, and informatics.

First published in 1982. Simply defined, the field of natural language processing is concerned with theories and techniques that address the problem of natural language communication with computers. One of the goals of this research is to design computer programs that will allow people to interact with computers in natural conversational dialogues.

This book addresses theoretical or applied work in the field of natural language processing.

This volume provides an overview of the field of Hybrid Machine Translation (MT) and presents some of the latest research conducted by linguists and practitioners from different multidisciplinary areas. Nowadays, most important developments in MT are achieved by combining data-driven and rule-based techniques. These combinations typically involve hybridization of different traditional paradigms, such as the introduction of linguistic knowledge into statistical approaches to MT, the incorporation of data-driven components into rule-based approaches, or statistical and rule-based pre- and post-processing for both types of MT architectures. The book is of interest primarily to MT specialists, but also – in the wider fields of Computational Linguistics, Machine Learning and Data Mining – to translators and managers of translation companies and departments who are interested in recent developments concerning automated translation tools.