English
Related papers

Related papers: Benchmarking Large Language Models on Reference Ex…

200 papers

Reasoning has emerged as the next major frontier for language models (LMs), with rapid advances from both academic and industrial labs. However, this progress often outpaces methodological rigor, with many evaluations relying on…

Machine Learning · Computer Science 2025-10-08 Andreas Hochlehnert , Hardik Bhatnagar , Vishaal Udandarao , Samuel Albanie , Ameya Prabhu , Matthias Bethge

Document-level relation extraction is a challenging task which requires reasoning over multiple sentences in order to predict relations in a document. In this paper, we pro-pose a joint training frameworkE2GRE(Entity and Evidence Guided…

Computation and Language · Computer Science 2020-08-28 Kevin Huang , Guangtao Wang , Tengyu Ma , Jing Huang

The rapid acceleration of scientific publishing has created substantial challenges for researchers attempting to discover, contextualize, and interpret relevant literature. Traditional keyword-based search systems provide limited semantic…

Information Retrieval · Computer Science 2025-12-16 Sina Jani , Arman Heidari , Amirmohammad Anvari , Zahra Rahimi

Understanding fine-grained links between documents is crucial for many applications, yet progress is limited by the lack of efficient methods for data curation. To address this limitation, we introduce a domain-agnostic framework for…

Computation and Language · Computer Science 2026-01-27 Serwar Basch , Ilia Kuznetsov , Tom Hope , Iryna Gurevych

Challenging problems such as open-domain question answering, fact checking, slot filling and entity linking require access to large, external knowledge sources. While some models do well on individual tasks, developing general models is…

Relation Extraction (RE) has attracted increasing attention, but current RE evaluation is limited to in-domain evaluation setups. Little is known on how well a RE system fares in challenging, but realistic out-of-distribution evaluation…

Computation and Language · Computer Science 2022-10-19 Elisa Bassignana , Barbara Plank

Relation extraction in the biomedical domain is challenging due to the lack of labeled data and high annotation costs, needing domain experts. Distant supervision is commonly used to tackle the scarcity of annotated data by automatically…

Computation and Language · Computer Science 2022-09-14 Saadullah Amin , Pasquale Minervini , David Chang , Pontus Stenetorp , Günter Neumann

End-to-end relation extraction aims to identify named entities and extract relations between them. Most recent work models these two subtasks jointly, either by casting them in one structured prediction framework, or performing multi-task…

Computation and Language · Computer Science 2021-03-24 Zexuan Zhong , Danqi Chen

In this paper, we introduce ChatCite, a novel method leveraging large language models (LLMs) for generating comparative literature summaries. The ability to summarize research papers with a focus on key comparisons between studies is an…

Computation and Language · Computer Science 2024-12-04 Fernando Gabriela Garcia , Spencer Burns , Harrison Fuller

Data attribution and valuation are critical for understanding data-model synergy for Large Language Models (LLMs), yet existing gradient-based methods suffer from scalability challenges on LLMs. Inspired by human cognition, where decision…

Machine Learning · Computer Science 2026-04-20 Yide Ran , Jianwen Xie , Minghui Wang , Wenjin Zheng , Denghui Zhang , Chuan Li , Zhaozhuo Xu

Existing retrieval benchmarks primarily consist of information-seeking queries (e.g., aggregated questions from search engines) where keyword or semantic-based retrieval is usually sufficient. However, many complex real-world queries…

Code-switching is a pervasive linguistic phenomenon in global communication, yet modern information retrieval systems remain predominantly designed for, and evaluated within, monolingual contexts. To bridge this critical disconnect, we…

Information Retrieval · Computer Science 2026-04-21 Qingcheng Zeng , Yuheng Lu , Zeqi Zhou , Heli Qi , Puxuan Yu , Fuheng Zhao , Hitomi Yanaka , Weihao Xuan , Naoto Yokoya

The training paradigm integrating large language models (LLM) is gradually reshaping sequential recommender systems (SRS) and has shown promising results. However, most existing LLM-enhanced methods rely on rich textual information on the…

Information Retrieval · Computer Science 2024-10-17 Dugang Liu , Shenxian Xian , Xiaolin Lin , Xiaolian Zhang , Hong Zhu , Yuan Fang , Zhen Chen , Zhong Ming

The surging amount of biomedical literature & digital clinical records presents a growing need for text mining techniques that can not only identify but also semantically relate entities in unstructured data. In this paper we propose a text…

Computation and Language · Computer Science 2021-12-28 Hasham Ul Haq , Veysel Kocaman , David Talby

Large language models (LLMs) are capable of generating coherent summaries from very long contexts given a user query, and extracting and citing evidence spans helps improve the trustworthiness of these summaries. Whereas previous work has…

Computation and Language · Computer Science 2025-10-31 Dustin Wright , Zain Muhammad Mujahid , Lu Wang , Isabelle Augenstein , David Jurgens

Large language models (LLMs) exhibit remarkable capabilities across diverse tasks, yet aligning them efficiently and effectively with human expectations remains a critical challenge. This thesis advances LLM alignment by introducing novel…

Computation and Language · Computer Science 2025-06-12 Yuxin Jiang

Large language models (LLMs) are increasingly deployed in everyday applications, demanding robust general reasoning capabilities and diverse reasoning skillset. However, current LLM reasoning benchmarks predominantly focus on mathematical…

Large language models (LLMs) are incredible and versatile tools for text-based tasks that have enabled countless, previously unimaginable, applications. Retrieval models, in contrast, have not yet seen such capable general-purpose models…

Information Retrieval · Computer Science 2025-09-10 Julian Killingback , Hamed Zamani

The rapid advancement of large language models (LLMs) has opened new boundaries in the extraction and synthesis of medical knowledge, particularly within evidence synthesis. This paper reviews the state-of-the-art applications of LLMs in…

Scientific reasoning requires not only long-chain reasoning processes, but also knowledge of domain-specific terminologies and adaptation to updated findings. To deal with these challenges for scientific reasoning, we introduce RAISE, a…

Computation and Language · Computer Science 2026-03-20 Minhae Oh , Jeonghye Kim , Nakyung Lee , Donggeon Seo , Taeuk Kim , Jungwoo Lee