English
Related papers

Related papers: Semantic Processing of Out-Of-Vocabulary Words in …

200 papers

When deriving contextualized word representations from language models, a decision needs to be made on how to obtain one for out-of-vocabulary (OOV) words that are segmented into subwords. What is the best way to represent these words with…

Computation and Language · Computer Science 2024-02-23 Aina Garí Soler , Matthieu Labeau , Chloé Clavel

On-the-job learning consists in continuously learning while being used in production, in an open environment, meaning that the system has to deal on its own with situations and elements never seen before. The kind of systems that seem to be…

Computation and Language · Computer Science 2021-03-01 Mathilde Veron , Sophie Rosset , Olivier Galibert , Guillaume Bernard

We propose a new contextual-compositional neural network layer that handles out-of-vocabulary (OOV) words in natural language processing (NLP) tagging tasks. This layer consists of a model that attends to both the character sequence and the…

Machine Learning · Computer Science 2019-12-17 Nicolas Garneau , Jean-Samuel Leboeuf , Yuval Pinter , Luc Lamontagne

Spoken dialogue systems promise efficient and natural access to a large variety of information sources and services from any phone. However, current spoken dialogue systems are deficient in their strategies for preventing, identifying and…

Artificial Intelligence · Computer Science 2011-06-10 A. Gorin , I. Langkilde-Geary , M. A. Walker , J. Wright , H. Wright Hastie

Teaching machines to accomplish tasks by conversing naturally with humans is challenging. Currently, developing task-oriented dialogue systems requires creating multiple components and typically this involves either a large amount of…

Computation and Language · Computer Science 2017-04-25 Tsung-Hsien Wen , David Vandyke , Nikola Mrksic , Milica Gasic , Lina M. Rojas-Barahona , Pei-Hao Su , Stefan Ultes , Steve Young

Most prior work in dialogue modeling has been on written conversations mostly because of existing data sets. However, written dialogues are not sufficient to fully capture the nature of spoken conversations as well as the potential speech…

Computation and Language · Computer Science 2021-09-29 Seokhwan Kim , Yang Liu , Di Jin , Alexandros Papangelis , Karthik Gopalakrishnan , Behnam Hedayatnia , Dilek Hakkani-Tur

Accessing the large volumes of information available in public knowledge bases might be complicated for those users unfamiliar with the SPARQL query language. Automatic translation of questions posed in natural language in SPARQL has the…

Computation and Language · Computer Science 2021-11-05 Manuel A. Borroto Santana , Francesco Ricca , Bernardo Cuteri

State-of-the-art NLP systems represent inputs with word embeddings, but these are brittle when faced with Out-of-Vocabulary (OOV) words. To address this issue, we follow the principle of mimick-like models to generate vectors for unseen…

Computation and Language · Computer Science 2022-03-22 Lihu Chen , Gaël Varoquaux , Fabian M. Suchanek

Metadata vocabularies are used in various domains of study. It provides an in-depth description of the resources. In this work, we develop Algorithm Metadata Vocabulary (AMV), a vocabulary for capturing and storing the metadata about the…

Artificial Intelligence · Computer Science 2021-06-08 Biswanath Dutta , Jyotima Patel

We present the dialogue module of the speech-to-speech translation system VERBMOBIL. We follow the approach that the solution to dialogue processing in a mediating scenario can not depend on a single constrained processing tool, but on a…

cmp-lg · Computer Science 2008-02-03 Jan Alexandersson , Norbert Reithinger , Elisabeth Maier

The acoustic-to-word model based on the connectionist temporal classification (CTC) criterion was shown as a natural end-to-end (E2E) model directly targeting words as output units. However, the word-based CTC model suffers from the…

Computation and Language · Computer Science 2018-03-16 Jinyu Li , Guoli Ye , Amit Das , Rui Zhao , Yifan Gong

In this paper we describe an approach to automatic evaluation of both the speech recognition and understanding capabilities of a spoken dialogue system for train time table information. We use word accuracy for recognition and concept…

cmp-lg · Computer Science 2008-02-03 M. Boros , W. Eckert , F. Gallwitz , G. Goerz , G. Hanrieder , H. Niemann

We present a new approach for neural machine translation (NMT) using the morphological and grammatical decomposition of the words (factors) in the output side of the neural network. This architecture addresses two main problems occurring in…

Computation and Language · Computer Science 2017-12-07 Mercedes García-Martínez , Loïc Barrault , Fethi Bougares

In spoken Keyword Search, the query may contain out-of-vocabulary (OOV) words not observed when training the speech recognition system. Using subword language models (LMs) in the first-pass recognition makes it possible to recognize the OOV…

Computation and Language · Computer Science 2020-09-11 Mittul Singh , Sami Virpioja , Peter Smit , Mikko Kurimo

Dialogue systems, also called chatbots, are now used in a wide range of applications. However, they still have some major weaknesses. One key weakness is that they are typically trained from manually-labeled data and/or written with…

Computation and Language · Computer Science 2021-02-25 Bing Liu , Sahisnu Mazumder

There is an emerging interest in the application of natural language processing models to source code processing tasks. One of the major problems in applying deep learning to software engineering is that source code often contains a lot of…

Software Engineering · Computer Science 2021-04-28 Nadezhda Chirkova , Sergey Troshin

Practical dialogue systems require robust methods of detecting out-of-scope (OOS) utterances to avoid conversational breakdowns and related failure modes. Directly training a model with labeled OOS examples yields reasonable performance,…

Computation and Language · Computer Science 2021-09-08 Derek Chen , Zhou Yu

In spoken dialogue systems, we aim to deploy artificial intelligence to build automated dialogue agents that can converse with humans. Dialogue systems are increasingly being designed to move beyond just imitating conversation and also…

Computation and Language · Computer Science 2021-11-03 Atharv Singh Patlan , Shiven Tripathi , Shubham Korde

Verbal omissions are complex syntactic phenomena in VP coordination structures. They occur when verbs and (some of) their arguments are omitted from subsequent clauses after being explicitly stated in an initial clause. Recovering these…

Computation and Language · Computer Science 2023-05-29 Royi Rassin , Yoav Goldberg , Reut Tsarfaty

Automatic translation of dialogue texts is a much needed demand in many real life scenarios. However, the currently existing neural machine translation delivers unsatisfying results. In this paper, we conduct a deep analysis of a dialogue…

Computation and Language · Computer Science 2021-04-22 Tao Wang , Chengqi Zhao , Mingxuan Wang , Lei Li , Deyi Xiong