English
Related papers

Related papers: DocNLI: A Large-scale Dataset for Document-level N…

200 papers

The rapid development of deep natural language processing (NLP) models for text classification has led to an urgent need for a unified understanding of these models proposed individually. Existing methods cannot meet the need for…

Computation and Language · Computer Science 2022-06-22 Zhen Li , Xiting Wang , Weikai Yang , Jing Wu , Zhengyan Zhang , Zhiyuan Liu , Maosong Sun , Hui Zhang , Shixia Liu

NLP benchmarks have largely focused on short texts, such as sentences and paragraphs, even though long texts comprise a considerable amount of natural language in the wild. We introduce SCROLLS, a suite of tasks that require reasoning over…

Computation and Language · Computer Science 2022-10-13 Uri Shaham , Elad Segal , Maor Ivgi , Avia Efrat , Ori Yoran , Adi Haviv , Ankit Gupta , Wenhan Xiong , Mor Geva , Jonathan Berant , Omer Levy

We study existing approaches to leverage off-the-shelf Natural Language Inference (NLI) models for the evaluation of summary faithfulness and argue that these are sub-optimal due to the granularity level considered for premises and…

Computation and Language · Computer Science 2024-02-28 Huajian Zhang , Yumo Xu , Laura Perez-Beltrachini

Despite the dramatic progress in Large Language Model (LLM) development, LLMs often provide seemingly plausible but not factual information, often referred to as hallucinations. Retrieval-augmented LLMs provide a non-parametric approach to…

Computation and Language · Computer Science 2023-11-09 Sai Munikoti , Anurag Acharya , Sridevi Wagle , Sameera Horawalavithana

With the development of large-scale Language Models (LLM), fine-tuning pre-trained LLM has become a mainstream paradigm for solving downstream tasks of natural language processing. However, training a language model in the legal field…

Computation and Language · Computer Science 2024-06-07 Chun-Hsien Lin , Pu-Jen Cheng

A Natural Language Interface (NLI) facilitates users to pose queries to retrieve information from a database without using any artificial language such as the Structured Query Language (SQL). Several applications in various domains…

Open Information Extraction (OpenIE) aims to extract structured relational tuples (subject, relation, object) from sentences and plays critical roles for many downstream NLP applications. Existing solutions perform extraction at sentence…

Computation and Language · Computer Science 2021-05-12 Kuicai Dong , Yilin Zhao , Aixin Sun , Jung-Jae Kim , Xiaoli Li

An important challenge for human-like AI is compositional semantics. Recent research has attempted to address this by using deep neural networks to learn vector space embeddings of sentences, which then serve as input to other tasks. We…

Computation and Language · Computer Science 2018-05-21 Ishita Dasgupta , Demi Guo , Andreas Stuhlmüller , Samuel J. Gershman , Noah D. Goodman

Large language models (LLMs) can generate fluent natural language texts when given relevant documents as background context. This ability has attracted considerable interest in developing industry applications of LLMs. However, LLMs are…

Computation and Language · Computer Science 2023-10-11 Deren Lei , Yaxi Li , Mengya Hu , Mingyu Wang , Vincent Yun , Emily Ching , Eslam Kamal

In recent years, deep learning has revolutionized natural language processing (NLP) by enabling the development of models that can learn complex representations of language data, leading to significant improvements in performance across a…

Computation and Language · Computer Science 2023-10-17 Guanghua Wang , Weili Wu

Natural Language Processing (NLP) is a key technique for developing Medical Artificial Intelligence (AI) systems that leverage Electronic Health Record (EHR) data to build diagnostic and prognostic models. NLP enables the conversion of…

Large language models (LLMs) have created a new paradigm for natural language processing. Despite their advancement, LLM-based methods still lag behind traditional approaches in document-level relation extraction (DocRE), a critical task…

Computation and Language · Computer Science 2024-12-10 Xingzuo Li , Kehai Chen , Yunfei Long , Min Zhang

Structured information extraction from scientific literature is crucial for capturing core concepts and emerging trends in specialized fields. While existing datasets aid model development, most focus on specific publication sections due to…

Computation and Language · Computer Science 2026-04-06 Decheng Duan , Yingyi Zhang , Jitong Peng , Chengzhi Zhang

Many search systems work with large amounts of natural language data, e.g., search queries, user profiles, and documents. Building a successful search system requires a thorough understanding of textual data semantics, where deep learning…

Information Retrieval · Computer Science 2021-08-31 Weiwei Guo , Xiaowei Liu , Sida Wang , Michaeel Kazi , Zhiwei Wang , Zhoutong Fu , Jun Jia , Liang Zhang , Huiji Gao , Bo Long

While valuable datasets such as PersonaChat provide a foundation for training persona-grounded dialogue agents, they lack diversity in conversational and narrative settings, primarily existing in the "real" world. To develop dialogue agents…

Computation and Language · Computer Science 2024-01-15 Alexandra DeLucia , Mengjie Zhao , Yoshinori Maeda , Makoto Yoda , Keiichi Yamada , Hiromi Wakaki

While recent research on natural language inference has considerably benefited from large annotated datasets, the amount of inference-related knowledge (including commonsense) provided in the annotated data is still rather limited. There…

Computation and Language · Computer Science 2021-09-10 Xiaoyu Yang , Xiaodan Zhu , Zhan Shi , Tianda Li

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities in document understanding. However, their reasoning processes remain largely black-box, making it difficult to ensure reliability and trustworthiness,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Wenwen Yu , Zhibo Yang , Yuliang Liu , Xiang Bai

Recent years have seen the rise of large language models (LLMs), where practitioners use task-specific prompts; this was shown to be effective for a variety of tasks. However, when applied to semantic textual similarity (STS) and natural…

Computation and Language · Computer Science 2024-02-06 Yuxia Wang , Minghan Wang , Preslav Nakov

Natural Language Inference (NLI) models have been used in various ways to improve the factuality of LLM outputs. This is typically done by applying an NLI model to judge whether the model output is entailed from the supposed evidence,…

Computation and Language · Computer Science 2025-11-04 Sapir Harary , Eran Hirsch , Aviv Slobodkin , David Wan , Mohit Bansal , Ido Dagan

This position paper argues that annotation disagreement in Natural Language Inference (NLI) is not mere noise but often reflects meaningful variation, especially when triggered by ambiguity in the premise or hypothesis. While underspecified…

Computation and Language · Computer Science 2025-09-03 Chathuri Jayaweera , Bonnie J. Dorr