English
Related papers

Related papers: ContractNLI: A Dataset for Document-level Natural …

200 papers

The task of natural language inference (NLI) asks whether a given premise (expressed in NL) entails a given NL hypothesis. NLI benchmarks contain human ratings of entailment, but the meaning relationships driving these ratings are not…

Computation and Language · Computer Science 2023-09-06 Juri Opitz , Shira Wein , Julius Steen , Anette Frank , Nathan Schneider

Natural Language Inference (NLI) is the task of inferring the logical relationship, typically entailment or contradiction, between a premise and hypothesis. Code-mixing is the use of more than one language in the same conversation or…

Computation and Language · Computer Science 2020-04-14 Simran Khanuja , Sandipan Dandapat , Sunayana Sitaram , Monojit Choudhury

In the recent past, a popular way of evaluating natural language understanding (NLU), was to consider a model's ability to perform natural language inference (NLI) tasks. In this paper, we investigate if NLI tasks, that are rarely used for…

Computation and Language · Computer Science 2024-11-22 Lovish Madaan , David Esiobu , Pontus Stenetorp , Barbara Plank , Dieuwke Hupkes

The rise of large language models (LLMs) has significantly influenced the quality of information in decision-making systems, leading to the prevalence of AI-generated content and challenges in detecting misinformation and managing…

Computation and Language · Computer Science 2024-10-08 Cheng Jiayang , Chunkit Chan , Qianqian Zhuang , Lin Qiu , Tianhang Zhang , Tengxiao Liu , Yangqiu Song , Yue Zhang , Pengfei Liu , Zheng Zhang

Natural language inference (NLI) data has proven useful in benchmarking and, especially, as pretraining data for tasks requiring language understanding. However, the crowdsourcing protocol that was used to collect this data has known issues…

Computation and Language · Computer Science 2020-10-01 Samuel R. Bowman , Jennimaria Palomaki , Livio Baldini Soares , Emily Pitler

We revisit the reference determinacy (RD) assumption in the task of natural language inference (NLI), i.e., the premise and hypothesis are assumed to refer to the same context when human raters annotate a label. While RD is a practical…

Computation and Language · Computer Science 2025-02-11 Sihao Chen , Chaitanya Malaviya , Alex Fabrikant , Hagai Taitelbaum , Tal Schuster , Senaka Buthpitiya , Dan Roth

We introduce Uncertain Natural Language Inference (UNLI), a refinement of Natural Language Inference (NLI) that shifts away from categorical labels, targeting instead the direct prediction of subjective probability assessments. We…

Computation and Language · Computer Science 2020-05-06 Tongfei Chen , Zhengping Jiang , Adam Poliak , Keisuke Sakaguchi , Benjamin Van Durme

Comparative constructions pose a challenge in Natural Language Inference (NLI), which is the task of determining whether a text entails a hypothesis. Comparatives are structurally complex in that they interact with other linguistic…

Computation and Language · Computer Science 2020-05-19 Izumi Haruta , Koji Mineshima , Daisuke Bekki

A contract is a type of legal document commonly used in organizations. Contract review is an integral and repetitive process to avoid business risk and liability. Contract analysis requires the identification and classification of key…

Artificial Intelligence · Computer Science 2024-04-18 Amit Tewari

Natural Language Inference (NLI) is a hot topic research in natural language processing, contradiction detection between sentences is a special case of NLI. This is considered a difficult NLP task which has a big influence when added as a…

Computation and Language · Computer Science 2023-04-05 Khloud Al Jallad , Nada Ghneim

Laws and their interpretations, legal arguments and agreements\ are typically expressed in writing, leading to the production of vast corpora of legal text. Their analysis, which is at the center of legal practice, becomes increasingly…

Computation and Language · Computer Science 2022-11-09 Ilias Chalkidis , Abhik Jana , Dirk Hartung , Michael Bommarito , Ion Androutsopoulos , Daniel Martin Katz , Nikolaos Aletras

The release of large natural language inference (NLI) datasets like SNLI and MNLI have led to rapid development and improvement of completely neural systems for the task. Most recently, heavily pre-trained, Transformer-based models like…

Computation and Language · Computer Science 2019-12-10 Tiffany Chien , Jugal Kalita

Despite the growing progress in Natural Language Inference (NLI) research, resources for the Bengali language remain extremely limited. Existing Bengali NLI datasets exhibit several inconsistencies, including annotation errors, ambiguous…

Computation and Language · Computer Science 2025-11-13 Farah Binta Haque , Md Yasin , Shishir Saha , Md Shoaib Akhter Rafi , Farig Sadeque

Natural Language Inference (NLI) evaluation is crucial for assessing language understanding models; however, popular datasets suffer from systematic spurious correlations that artificially inflate actual model performance. To address this,…

Computation and Language · Computer Science 2024-10-07 Adrian Cosma , Stefan Ruseti , Mihai Dascalu , Cornelia Caragea

Crowdworker-constructed natural language inference (NLI) datasets have been found to contain statistical artifacts associated with the annotation process that allow hypothesis-only classifiers to achieve better-than-random performance…

Computation and Language · Computer Science 2021-06-04 Christine Herlihy , Rachel Rudinger

State of the art models using deep neural networks have become very good in learning an accurate mapping from inputs to outputs. However, they still lack generalization capabilities in conditions that differ from the ones encountered during…

Computation and Language · Computer Science 2018-08-28 Alexey Romanov , Chaitanya Shivade

Natural Language Inference (NLI) is a growingly essential task in natural language understanding, which requires inferring the relationship between the sentence pairs (premise and hypothesis). Recently, low-resource natural language…

Computation and Language · Computer Science 2022-06-01 Shu'ang Li , Xuming Hu , Li Lin , Aiwei Liu , Lijie Wen , Philip S. Yu

Negation is poorly captured by current language models, although the extent of this problem is not widely understood. We introduce a natural language inference (NLI) test suite to enable probing the capabilities of NLP methods, with the aim…

Computation and Language · Computer Science 2022-10-17 Thinh Hung Truong , Yulia Otmakhova , Timothy Baldwin , Trevor Cohn , Jey Han Lau , Karin Verspoor

Natural Language Inference (NLI) is a cornerstone of Natural Language Processing (NLP), providing insights into the entailment relationships between text pairings. It is a critical component of Natural Language Understanding (NLU),…

Computation and Language · Computer Science 2024-05-08 Fatema Tuj Johora Faria , Mukaffi Bin Moin , Asif Iftekher Fahim , Pronay Debnath , Faisal Muhammad Shah

Modeling natural language inference is a very challenging task. With the availability of large annotated data, it has recently become feasible to train complex models such as neural-network-based inference models, which have shown to…

Computation and Language · Computer Science 2020-03-04 Qian Chen , Xiaodan Zhu , Zhen-Hua Ling , Diana Inkpen , Si Wei