English
Related papers

Related papers: Learning to Summarize by Learning to Quiz: Adversa…

200 papers

We propose a methodology that combines several advanced techniques in Large Language Model (LLM) retrieval to support the development of robust, multi-source question-answer systems. This methodology is designed to integrate information…

Artificial Intelligence · Computer Science 2024-12-25 Antony Seabra , Claudio Cavalcante , Joao Nepomuceno , Lucas Lago , Nicolaas Ruberg , Sergio Lifschitz

Query-focused summarization (QFS) gives a summary of documents to answer a query. Past QFS work assumes queries have one answer, ignoring debatable ones (Is law school worth it?). We introduce Debatable QFS (DQFS), a task to create…

Computation and Language · Computer Science 2025-02-04 Nishant Balepur , Alexa Siu , Nedim Lipka , Franck Dernoncourt , Tong Sun , Jordan Boyd-Graber , Puneet Mathur

When summarizing a collection of views, arguments or opinions on some topic, it is often desirable not only to extract the most salient points, but also to quantify their prevalence. Work on multi-document summarization has traditionally…

Computation and Language · Computer Science 2020-10-13 Roy Bar-Haim , Yoav Kantor , Lilach Eden , Roni Friedman , Dan Lahav , Noam Slonim

Current recommendation systems often require some form of textual data summarization, such as generating concise and coherent titles for product carousels or other grouped item displays. While large language models have shown promise in NLP…

Information Retrieval · Computer Science 2025-07-02 Jiao Chen , Kehui Yao , Reza Yousefi Maragheh , Kai Zhao , Jianpeng Xu , Jason Cho , Evren Korpeoglu , Sushant Kumar , Kannan Achan

Various tasks, such as summarization, multi-hop question answering, or coreference resolution, are naturally phrased over collections of real-world documents. Such tasks present a unique set of challenges, revolving around the lack of…

Computation and Language · Computer Science 2024-06-25 Gili Lior , Avi Caciularu , Arie Cattan , Shahar Levy , Ori Shapira , Gabriel Stanovsky

The advances made by Large Language Models (LLMs) have led to the pursuit of LLM agents that can solve intricate, multi-step reasoning tasks. As with any research pursuit, benchmarking and evaluation are key corner stones to efficient and…

Artificial Intelligence · Computer Science 2024-04-10 Luca Gioacchini , Giuseppe Siracusano , Davide Sanvito , Kiril Gashteovski , David Friede , Roberto Bifulco , Carolin Lawrence

We explore the use of long-context capabilities in large language models to create synthetic reading comprehension data from entire books. Previous efforts to construct such datasets relied on crowd-sourcing, but the emergence of…

Cross-lingual summarization is the task of generating a summary in one language (e.g., English) for the given document(s) in a different language (e.g., Chinese). Under the globalization background, this task has attracted increasing…

Computation and Language · Computer Science 2022-08-31 Jiaan Wang , Fandong Meng , Duo Zheng , Yunlong Liang , Zhixu Li , Jianfeng Qu , Jie Zhou

Large language model (LLM) agents are increasingly deployed in structured biomedical data environments, yet they often produce fluent but overconfident outputs when reasoning over complex multi-table data. We introduce an uncertainty-aware…

Current approaches for text summarization are predominantly automatic, with rather limited space for human intervention and control over the process. In this paper, we introduce SummHelper, a 2-phase summarization assistant designed to…

Computation and Language · Computer Science 2023-10-17 Aviv Slobodkin , Niv Nachum , Shmuel Amar , Ori Shapira , Ido Dagan

In the rapidly evolving landscape of digital content, the task of summarizing multimedia documents, which encompass textual, visual, and auditory elements, presents intricate challenges. These challenges include extracting pertinent…

Multimedia · Computer Science 2024-12-30 Azze-Eddine Maredj , Madjid Sadallah

Addressing the challenge of effectively processing long contexts has become a critical issue for Large Language Models (LLMs). Two common strategies have emerged: 1) reducing the input length, such as retrieving relevant chunks by…

Computation and Language · Computer Science 2024-06-06 Yusen Zhang , Ruoxi Sun , Yanfei Chen , Tomas Pfister , Rui Zhang , Sercan Ö. Arik

Large Language Models (LLM) are a new class of computation engines, "programmed" via prompt engineering. We are still learning how to best "program" these LLMs to help developers. We start with the intuition that developers tend to…

Software Engineering · Computer Science 2024-01-15 Toufique Ahmed , Kunal Suresh Pai , Premkumar Devanbu , Earl T. Barr

Large language models (LLMs) have demonstrated their potential to refine their generation based on their own feedback. However, the feedback from LLM itself is often inaccurate, thereby limiting its benefits. In this paper, we propose Study…

Computation and Language · Computer Science 2023-10-25 Danqing Wang , Lei Li

Applying existing question answering (QA) systems to specialized domains like law and finance presents challenges that necessitate domain expertise. Although large language models (LLMs) have shown impressive language comprehension and…

Computation and Language · Computer Science 2023-10-24 Vaibhav Mavi , Abulhair Saparov , Chen Zhao

Large Language Models (LLMs) have shown promising performance in summary evaluation tasks, yet they face challenges such as high computational costs and the Lost-in-the-Middle problem where important information in the middle of long…

Computation and Language · Computer Science 2024-01-19 Yunshu Wu , Hayate Iso , Pouya Pezeshkpour , Nikita Bhutani , Estevam Hruschka

Text segmentation is important for signaling a document's structure. Without segmenting a long document into topically coherent sections, it is difficult for readers to comprehend the text, let alone find important information. The problem…

Computation and Language · Computer Science 2022-11-01 Sangwoo Cho , Kaiqiang Song , Xiaoyang Wang , Fei Liu , Dong Yu

Large Language Models (LLMs) have demonstrated exceptional comprehension capabilities and a vast knowledge base, suggesting that LLMs can serve as efficient tools for automated survey generation. However, recent research related to…

Computation and Language · Computer Science 2025-02-28 Xun Liang , Jiawei Yang , Yezhaohui Wang , Chen Tang , Zifan Zheng , Shichao Song , Zehao Lin , Yebin Yang , Simin Niu , Hanyu Wang , Bo Tang , Feiyu Xiong , Keming Mao , Zhiyu li

Current evaluation methods for large language models (LLMs) primarily rely on static benchmarks, presenting two major challenges: limited knowledge coverage and fixed difficulties that mismatch with the evaluated LLMs. These limitations…

Computation and Language · Computer Science 2026-01-16 Zhichao Shi , Xuhui Jiang , Chengjin Xu , Cangli Yao , Shengjia Ma , Yinghan Shen , Zixuan Li , Jian Guo , Yuanzhuo Wang

Reinforcement Learning (RL) agents often struggle with efficiency and performance in complex environments. We propose a novel framework that uses a Large Language Model (LLM) to dynamically generate a curriculum over available actions,…

Machine Learning · Computer Science 2026-04-03 Amirreza Alasti , Efe Erdal , Yücel Celik , Theresa Eimer