English
Related papers

Related papers: Detecting and Understanding Generalization Barrier…

200 papers

Machine Translation (MT) has the potential to help people overcome language barriers and is widely used in high-stakes scenarios, such as in hospitals. However, in order to use MT reliably and safely, users need to understand when to trust…

Human-Computer Interaction · Computer Science 2022-05-17 Wesley Hanwen Deng , Nikita Mehandru , Samantha Robertson , Niloufar Salehi

A common task in computational text analyses is to quantify how two corpora differ according to a measurement like word frequency, sentiment, or information content. However, collapsing the texts' rich stories into a single number is often…

While recent work has convincingly showed that sequence-to-sequence models struggle to generalize to new compositions (termed compositional generalization), little is known on what makes compositional generalization hard on a particular…

Computation and Language · Computer Science 2022-10-25 Ben Bogin , Shivanshu Gupta , Jonathan Berant

While recent advances in deep learning led to significant improvements in machine translation, neural machine translation is often still not able to continuously adapt to the environment. For humans, as well as for machine translation,…

Computation and Language · Computer Science 2021-02-15 Jan Niehues

The translation of pronouns presents a special challenge to machine translation to this day, since it often requires context outside the current sentence. Recent work on models that have access to information across sentence boundaries has…

Computation and Language · Computer Science 2019-03-07 Mathias Müller , Annette Rios , Elena Voita , Rico Sennrich

Systematic generalization remains challenging for current language models, which are known to be both sensitive to semantically similar permutations of the input and to struggle with known concepts presented in novel contexts. Although…

Computation and Language · Computer Science 2025-05-28 Sondre Wold , Lucas Georges Gabriel Charpentier , Étienne Simon

We explore the notion of uncertainty in the context of modern abstractive summarization models, using the tools of Bayesian Deep Learning. Our approach approximates Bayesian inference by first extending state-of-the-art summarization models…

Computation and Language · Computer Science 2022-05-04 Alexios Gidiotis , Grigorios Tsoumakas

Neural Machine Translation (NMT) has made remarkable progress over the past years. However, under-translation and over-translation remain two challenging problems in state-of-the-art NMT systems. In this work, we conduct an in-depth…

Computation and Language · Computer Science 2024-05-30 Chenze Shao , Fandong Meng , Jiali Zeng , Jie Zhou

This paper proposes a simple and effective algorithm for incorporating lexical constraints in neural machine translation. Previous work either required re-training existing models with the lexical constraints or incorporating them during…

Computation and Language · Computer Science 2020-04-28 Raymond Hendy Susanto , Shamil Chollampatt , Liling Tan

Machine translation systems are conventionally trained on textual resources that do not model phenomena that occur in spoken language. While the evaluation of neural machine translation systems on textual inputs is actively researched in…

Computation and Language · Computer Science 2019-04-26 Nicholas Ruiz , Mattia Antonino Di Gangi , Nicola Bertoldi , Marcello Federico

A fundamental question in theoretical machine learning is generalization. Over the past decades, the PAC-Bayesian approach has been established as a flexible framework to address the generalization capabilities of machine learning…

Machine Learning · Computer Science 2024-03-28 Fredrik Hellström , Giuseppe Durisi , Benjamin Guedj , Maxim Raginsky

Calibration is a fundamental property of a good predictive model: it requires that the model predicts correctly in proportion to its confidence. Modern neural networks, however, provide no strong guarantees on their calibration -- and can…

Machine Learning · Computer Science 2022-10-07 A. Michael Carrell , Neil Mallinar , James Lucas , Preetum Nakkiran

We introduce a neural machine translation model that views the input and output sentences as sequences of characters rather than words. Since word-level information provides a crucial source of bias, our input model composes representations…

Computation and Language · Computer Science 2015-11-17 Wang Ling , Isabel Trancoso , Chris Dyer , Alan W Black

We present a novel framework for machine translation evaluation using neural networks in a pairwise setting, where the goal is to select the better translation from a pair of hypotheses, given the reference translation. In this framework,…

Computation and Language · Computer Science 2019-12-09 Francisco Guzman , Shafiq Joty , Lluis Marquez , Preslav Nakov

A lot of the recent success in natural language processing (NLP) has been driven by distributed vector representations of words trained on large amounts of text in an unsupervised manner. These representations are typically used as general…

Computation and Language · Computer Science 2018-04-03 Sandeep Subramanian , Adam Trischler , Yoshua Bengio , Christopher J Pal

In natural language processing, a lot of the tasks are successfully solved with recurrent neural networks, but such models have a huge number of parameters. The majority of these parameters are often concentrated in the embedding layer,…

Computation and Language · Computer Science 2018-12-13 Nadezhda Chirkova , Ekaterina Lobacheva , Dmitry Vetrov

Deep neural networks (DNNs) are the workhorses of deep learning, which constitutes the state of the art in numerous application domains. However, DNN-based decision rules are notoriously prone to poor generalization, i.e., may prove…

Machine Learning · Computer Science 2023-05-11 Guy Amir , Osher Maayan , Tom Zelazny , Guy Katz , Michael Schapira

Research on generalization bounds for deep networks seeks to give ways to predict test error using just the training dataset and the network parameters. While generalization bounds can give many insights about architecture design, training…

Machine Learning · Computer Science 2022-03-21 Yi Zhang , Arushi Gupta , Nikunj Saunshi , Sanjeev Arora

The robust generalization of models to rare, in-distribution (ID) samples drawn from the long tail of the training distribution and to out-of-training-distribution (OOD) samples is one of the major challenges of current deep learning…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Paul Gavrikov , Janis Keuper

Generating explanations for neural networks has become crucial for their applications in real-world with respect to reliability and trustworthiness. In natural language processing, existing methods usually provide important features which…

Computation and Language · Computer Science 2020-05-19 Hanjie Chen , Guangtao Zheng , Yangfeng Ji