English
Related papers

Related papers: Natural Language Inference from Multiple Premises

200 papers

In this work we aim to understand and estimate the importance that a neural network assigns to various aspects of the data while learning and making predictions. Here we focus on the recognizing textual entailment (RTE) task and its…

Machine Learning · Computer Science 2020-04-27 Sandeep Suntwal , Mithun Paul , Rebecca Sharp , Mihai Surdeanu

Scoring the factuality of a generated summary involves measuring the degree to which a target text contains factual information using the input document as support. Given the similarities in the problem formulation, previous work has shown…

Computation and Language · Computer Science 2022-12-01 John Glover , Federico Fancellu , Vasudevan Jagannathan , Matthew R. Gormley , Thomas Schaaf

We study the problem of generating inferential texts of events for a variety of commonsense like \textit{if-else} relations. Existing approaches typically use limited evidence from training examples and learn for each relation individually.…

Computation and Language · Computer Science 2020-04-16 Daya Guo , Akari Asai , Duyu Tang , Nan Duan , Ming Gong , Linjun Shou , Daxin Jiang , Jian Yin , Ming Zhou

An outstanding image-text retrieval model depends on high-quality labeled data. While the builders of existing image-text retrieval datasets strive to ensure that the caption matches the linked image, they cannot prevent a caption from…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Xu Yan , Chunhui Ai , Ziqiang Cao , Min Cao , Sujian Li , Wenjie Li , Guohong Fu

Word embeddings are a key component of high-performing natural language processing (NLP) systems, but it remains a challenge to learn good representations for novel words on the fly, i.e., for words that did not occur in the training data.…

Computation and Language · Computer Science 2018-11-12 Timo Schick , Hinrich Schütze

Deep learning (DL) based language models achieve high performance on various benchmarks for Natural Language Inference (NLI). And at this time, symbolic approaches to NLI are receiving less attention. Both approaches (symbolic and DL) have…

Computation and Language · Computer Science 2021-06-11 Zeming Chen , Qiyue Gao , Lawrence S. Moss

While perception tasks such as visual object recognition and text understanding play an important role in human intelligence, the subsequent tasks that involve inference, reasoning and planning require an even higher level of intelligence.…

Machine Learning · Statistics 2016-09-06 Hao Wang , Dit-Yan Yeung

Traditional text embedding benchmarks primarily evaluate embedding models' capabilities to capture semantic similarity. However, more advanced NLP tasks require a deeper understanding of text, such as safety and factuality. These tasks…

Computation and Language · Computer Science 2025-03-05 Simeng Han , Frank Palma Gomez , Tu Vu , Zefei Li , Daniel Cer , Hansi Zeng , Chris Tar , Arman Cohan , Gustavo Hernandez Abrego

State of the art models using deep neural networks have become very good in learning an accurate mapping from inputs to outputs. However, they still lack generalization capabilities in conditions that differ from the ones encountered during…

Computation and Language · Computer Science 2018-08-28 Alexey Romanov , Chaitanya Shivade

State-of-the-art natural language processing models have been shown to achieve remarkable performance in 'closed-world' settings where all the labels in the evaluation set are known at training time. However, in real-world settings, 'novel'…

Computation and Language · Computer Science 2023-05-10 Neeraj Varshney , Himanshu Gupta , Eric Robertson , Bing Liu , Chitta Baral

Text infilling is defined as a task for filling in the missing part of a sentence or paragraph, which is suitable for many real-world natural language generation scenarios. However, given a well-trained sequential generative model,…

Computation and Language · Computer Science 2019-11-20 Dayiheng Liu , Jie Fu , Pengfei Liu , Jiancheng Lv

We present two architectures for multi-task learning with neural sequence models. Our approach allows the relationships between different tasks to be learned dynamically, rather than using an ad-hoc pre-defined structure as in previous…

Computation and Language · Computer Science 2018-11-27 Pengfei Liu , Jie Fu , Yue Dong , Xipeng Qiu , Jackie Chi Kit Cheung

Drawing inferences between open-domain natural language predicates is a necessity for true language understanding. There has been much progress in unsupervised learning of entailment graphs for this purpose. We make three contributions: (1)…

Computation and Language · Computer Science 2021-09-21 Nick McKenna , Liane Guillou , Mohammad Javad Hosseini , Sander Bijl de Vroe , Mark Johnson , Mark Steedman

Causal relationships form the basis for reasoning and decision-making in Artificial Intelligence systems. To exploit the large volume of textual data available today, the automatic discovery of causal relationships from text has emerged as…

Computation and Language · Computer Science 2020-11-30 Farhad Moghimifar , Afshin Rahimi , Mahsa Baktashmotlagh , Xue Li

We propose a new kind of embedding for natural language text that deeply represents semantic meaning. Standard text embeddings use the outputs from hidden layers of a pretrained language model. In our method, we let a language model learn…

Computation and Language · Computer Science 2022-11-22 Oleg Vasilyev , John Bohannon

This paper studies the problem of detecting novel or unexpected instances in text classification. In traditional text classification, the classes appeared in testing must have been seen in training. However, in many applications, this is…

Machine Learning · Computer Science 2020-09-24 Qi Qin , Wenpeng Hu , Bing Liu

Cloze task is a widely used task to evaluate an NLP system's language understanding ability. However, most of the existing cloze tasks only require NLP systems to give the relative best prediction for each input data sample, rather than the…

Computation and Language · Computer Science 2021-12-06 Zizhao Hu , Ravikiran Chanumolu , Xingyu Lin , Nayela Ayaz , Vincent Chi

Text embeddings are a fundamental component in many NLP tasks, including classification, regression, clustering, and semantic search. However, despite their ubiquitous application, challenges persist in interpreting embeddings and…

Computation and Language · Computer Science 2025-10-03 Juri Opitz , Lucas Möller , Andrianos Michail , Sebastian Padó , Simon Clematide

Syntactic structures used to play a vital role in natural language processing (NLP), but since the deep learning revolution, NLP has been gradually dominated by neural models that do not consider syntactic structures in their design. One…

Computation and Language · Computer Science 2023-11-28 Haoyi Wu , Kewei Tu

While word embeddings are currently predominant for natural language processing, most of existing models learn them solely from their contexts. However, these context-based word embeddings are limited since not all words' meaning can be…

Computation and Language · Computer Science 2016-08-23 Jifan Chen , Kan Chen , Xipeng Qiu , Qi Zhang , Xuanjing Huang , Zheng Zhang