English
Related papers

Related papers: SumRank: Aligning Summarization Models for Long-Do…

200 papers

Recent studies have demonstrated the great potential of Large Language Models (LLMs) serving as zero-shot relevance rankers. The typical approach involves making comparisons between pairs or lists of documents. Although effective, these…

Information Retrieval · Computer Science 2023-11-06 Weiwei Sun , Zheng Chen , Xinyu Ma , Lingyong Yan , Shuaiqiang Wang , Pengjie Ren , Zhumin Chen , Dawei Yin , Zhaochun Ren

Cross-lingual summarization (CLS) is a sophisticated branch in Natural Language Processing that demands models to accurately translate and summarize articles from different source languages. Despite the improvement of the subsequent…

Computation and Language · Computer Science 2024-11-27 Sanzana Karim Lora , M. Sohel Rahman , Rifat Shahriyar

In information retrieval, large language models (LLMs) have demonstrated remarkable potential in text reranking tasks by leveraging their sophisticated natural language understanding and advanced reasoning capabilities. However,…

Information Retrieval · Computer Science 2025-09-22 Haowei Liu , Xuyang Wu , Guohao Sun , Zhiqiang Tao , Yi Fang

Large Language Models (LLMs) have recently achieved remarkable progress by leveraging Reinforcement Learning and extended Chain-of-Thought (CoT) techniques. However, the challenge of performing efficient language reasoning--especially…

Computation and Language · Computer Science 2025-06-17 Zhong-Zhi Li , Xiao Liang , Zihao Tang , Lei Ji , Peijie Wang , Haotian Xu , Xing W , Haizhen Huang , Weiwei Deng , Yeyun Gong , Zhijiang Guo , Xiao Liu , Fei Yin , Cheng-Lin Liu

Large language models (LLMs) have made significant advancements in various natural language processing tasks, including question answering (QA) tasks. While incorporating new information with the retrieval of relevant passages is a…

Computation and Language · Computer Science 2024-04-23 Jaehyung Kim , Jaehyun Nam , Sangwoo Mo , Jongjin Park , Sang-Woo Lee , Minjoon Seo , Jung-Woo Ha , Jinwoo Shin

Large Language Models (LLMs) recently achieved great success in medical text summarization by simply using in-context learning. However, these recent efforts do not perform fine-grained evaluations under difficult settings where LLMs might…

Computation and Language · Computer Science 2026-04-22 Gunjan Balde , Soumyadeep Roy , Mainack Mondal , Niloy Ganguly

We introduce a novel approach for long context summarisation, highlight-guided generation, that leverages sentence-level information as a content plan to improve the traceability and faithfulness of generated summaries. Our framework…

Computation and Language · Computer Science 2025-12-22 Xiaotang Du , Rohit Saxena , Laura Perez-Beltrachini , Pasquale Minervini , Ivan Titov

Researchers have successfully applied large language models (LLMs) such as ChatGPT to reranking in an information retrieval context, but to date, such work has mostly been built on proprietary models hidden behind opaque API endpoints. This…

Information Retrieval · Computer Science 2023-09-27 Ronak Pradeep , Sahel Sharifymoghaddam , Jimmy Lin

Comprehensive summaries of sessions enable an effective continuity in mental health counseling, facilitating informed therapy planning. Yet, manual summarization presents a significant challenge, diverting experts' attention from the core…

This paper investigates reproducibility challenges in automatic text summarization evaluation. Based on experiments conducted across six representative metrics ranging from classical approaches like ROUGE to recent LLM-based methods…

Computation and Language · Computer Science 2025-09-01 Tanguy Herserant , Vincent Guigue

In this work, we introduce a framework for speech summarization that leverages the processing and reasoning capabilities of large language models (LLMs). We propose an end-to-end system that combines an instruction-tuned LLM with an audio…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-16 Wonjune Kang , Deb Roy

Prompt engineering for large language models (LLMs) is often a manual time-intensive process that involves generating, evaluating, and refining prompts iteratively to ensure high-quality outputs. While there has been work on automating…

Computation and Language · Computer Science 2024-07-19 Derek Austin , Elliott Chartock

Text simplification (TS) refers to the process of reducing the complexity of a text while retaining its original meaning and key information. Existing work only shows that large language models (LLMs) have outperformed supervised…

Computation and Language · Computer Science 2025-02-13 Jipeng Qiang , Minjiang Huang , Yi Zhu , Yunhao Yuan , Chaowei Zhang , Kui Yu

Summarizing texts is not a straightforward task. Before even considering text summarization, one should determine what kind of summary is expected. How much should the information be compressed? Is it relevant to reformulate or should the…

Computation and Language · Computer Science 2020-07-16 Paul Tardy , David Janiszek , Yannick Estève , Vincent Nguyen

Despite recent advances, evaluating how well large language models (LLMs) follow user instructions remains an open problem. While evaluation methods of language models have seen a rise in prompt-based approaches, limited work on the…

Computation and Language · Computer Science 2023-10-23 Ondrej Skopek , Rahul Aralikatte , Sian Gooding , Victor Carbune

The rapid growth of textual data across news, legal, medical, and scientific domains is becoming a challenge for efficiently accessing and understanding large volumes of content. It is increasingly complex for users to consume and extract…

Information Retrieval · Computer Science 2025-09-23 Pushpa Devi , Ayush Agrawal , Ashutosh Dubey , C. Ravindranath Chowdary

Large language models (LLMs) have shown remarkable capabilities in generating user summaries from a long list of raw user activity data. These summaries capture essential user information such as preferences and interests, and therefore are…

Machine Learning · Computer Science 2024-09-09 Chao Wang , Neo Wu , Lin Ning , Jiaxing Wu , Luyang Liu , Jun Xie , Shawn O'Banion , Bradley Green

Fine-tuning large language models for domain-specific tasks such as medical text summarization demands substantial computational resources. Parameter-efficient fine-tuning (PEFT) methods offer promising alternatives by updating only a small…

Computation and Language · Computer Science 2026-03-26 Ulugbek Shernazarov , Rostislav Svitsov , Bin Shi

Automatic summarization of legal texts is an important and still a challenging task since legal documents are often long and complicated with unusual structures and styles. Recent advances of deep models trained end-to-end with…

Computation and Language · Computer Science 2022-04-14 Duy-Hung Nguyen , Bao-Sinh Nguyen , Nguyen Viet Dung Nghiem , Dung Tien Le , Mim Amina Khatun , Minh-Tien Nguyen , Hung Le

LLMs and RAG systems are now capable of handling millions of input tokens or more. However, evaluating the output quality of such systems on long-context tasks remains challenging, as tasks like Needle-in-a-Haystack lack complexity. In this…

Computation and Language · Computer Science 2024-07-02 Philippe Laban , Alexander R. Fabbri , Caiming Xiong , Chien-Sheng Wu