English
Related papers

Related papers: Key-Element-Informed sLLM Tuning for Document Summ…

200 papers

Large language models (LLMs) often struggle to provide up-to-date information due to their one-time training and the constantly evolving nature of the world. To keep LLMs current, existing approaches typically involve continued pre-training…

Computation and Language · Computer Science 2025-05-19 Xiaoying Zhang , Baolin Peng , Ye Tian , Jingyan Zhou , Yipeng Zhang , Haitao Mi , Helen Meng

The automation of news analysis and summarization presents a promising solution to the challenge of processing and analyzing vast amounts of information prevalent in today's information society. Large Language Models (LLMs) have…

Artificial Intelligence · Computer Science 2025-02-25 Lionel Richy Panlap Houamegni , Fatih Gedikli

Large language models (LLMs) excel in abstractive summarization tasks, delivering fluent and pertinent summaries. Recent advancements have extended their capabilities to handle long-input contexts, exceeding 100k tokens. However, in…

Computation and Language · Computer Science 2024-11-15 Mathieu Ravaut , Aixin Sun , Nancy F. Chen , Shafiq Joty

Large language models (LLMs) hold great promise in summarizing medical evidence. Most recent studies focus on the application of proprietary LLMs. Using proprietary LLMs introduces multiple risk factors, including a lack of transparency and…

This paper presents novel prompting techniques to improve the performance of automatic summarization systems for scientific articles. Scientific article summarization is highly challenging due to the length and complexity of these…

Computation and Language · Computer Science 2023-12-18 Aldan Creo , Manuel Lama , Juan C. Vidal

Vision-Language Models (VLMs) are able to process increasingly longer videos. Yet, important visual information is easily lost throughout the entire context and missed by VLMs. Also, it is important to design tools that enable…

Computation and Language · Computer Science 2026-01-09 Galann Pennec , Zhengyuan Liu , Nicholas Asher , Philippe Muller , Nancy F. Chen

In enterprise search, building high-quality datasets at scale remains a central challenge due to the difficulty of acquiring labeled data. To resolve this challenge, we propose an efficient approach to fine-tune small language models (SLMs)…

Plan-guided summarization attempts to reduce hallucinations in small language models (SLMs) by grounding generated summaries to the source text, typically by targeting fine-grained details such as dates or named entities. In this work, we…

Computation and Language · Computer Science 2025-08-25 Matt Grenander , Siddharth Varia , Paula Czarnowska , Yogarshi Vyas , Kishaloy Halder , Bonan Min

Recently, many studies have demonstrated that exclusively incorporating OCR-derived text and spatial layouts with large language models (LLMs) can be highly effective for document understanding tasks. However, existing methods that…

Computation and Language · Computer Science 2025-05-20 Jinghui Lu , Haiyang Yu , Yanjie Wang , Yongjie Ye , Jingqun Tang , Ziwei Yang , Binghong Wu , Qi Liu , Hao Feng , Han Wang , Hao Liu , Can Huang

Large language models (LLMs) have demonstrated remarkable performance in a wide range of natural language tasks. However, as these models continue to grow in size, they face significant challenges in terms of computational costs.…

Computation and Language · Computer Science 2023-08-08 Ankush Agarwal , Sakharam Gawade , Amar Prakash Azad , Pushpak Bhattacharyya

Automatic summarization generates concise summaries that contain key ideas of source documents. As the most mainstream datasets for the news sub-domain, CNN/DailyMail and BBC XSum have been widely used for performance benchmarking. However,…

Computation and Language · Computer Science 2023-05-24 Yiming Wang , Zhuosheng Zhang , Rui Wang

Recent studies in prompting large language model (LLM) for document-level machine translation (DMT) primarily focus on the inter-sentence context by flatting the source document into a long sequence. This approach relies solely on the…

Computation and Language · Computer Science 2025-03-18 Bin Liu , Xinglin Lyu , Junhui Li , Daimeng Wei , Min Zhang , Shimin Tao , Hao Yang

This paper explores the rapid development of a telephone call summarization system utilizing large language models (LLMs). Our approach involves initial experiments with prompting existing LLMs to generate summaries of telephone…

Computation and Language · Computer Science 2024-10-25 David Thulke , Yingbo Gao , Rricha Jalota , Christian Dugast , Hermann Ney

Recent advances in large language models (LLMs) have led to new summarization strategies, offering an extensive toolkit for extracting important information. However, these approaches are frequently limited by their reliance on isolated…

Artificial Intelligence · Computer Science 2024-06-21 Pranav Janjani , Mayank Palan , Sarvesh Shirude , Ninad Shegokar , Sunny Kumar , Faruk Kazi

Comprehensive summaries of sessions enable an effective continuity in mental health counseling, facilitating informed therapy planning. Yet, manual summarization presents a significant challenge, diverting experts' attention from the core…

Recent methods that integrate spatial layouts with text for document understanding in large language models (LLMs) have shown promising results. A commonly used method is to represent layout information as text tokens and interleave them…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Zhaoqing Zhu , Chuwei Luo , Zirui Shao , Feiyu Gao , Hangdi Xing , Qi Zheng , Ji Zhang

In this paper, we present our approach for the CLEF 2025 SimpleText Task 1, which addresses both sentence-level and document-level scientific text simplification. For sentence-level simplification, our methodology employs large language…

Computation and Language · Computer Science 2025-08-19 Krishna Chaitanya Marturi , Heba H. Elwazzan

Large language models (LLMs) offer substantial promise for automating clinical text summarization, yet maintaining factual consistency remains challenging due to the length, noise, and heterogeneity of clinical documentation. We present…

Computation and Language · Computer Science 2026-02-24 Fahmida Liza Piya , Rahmatollah Beheshti

Citizen reporting platforms help the public and authorities stay informed about sexual harassment incidents. However, the high volume of data shared on these platforms makes reviewing each individual case challenging. Therefore, a…

Computation and Language · Computer Science 2026-04-20 Garima Chhikara , Anurag Sharma , V. Gurucharan , Kripabandhu Ghosh , Abhijnan Chakraborty

Retrieval-augmented large language models (LLMs) have demonstrated efficacy in knowledge-intensive tasks such as open-domain QA, addressing inherent challenges in knowledge update and factual inadequacy. However, inconsistencies between…

Computation and Language · Computer Science 2024-05-31 Jiajie Jin , Yutao Zhu , Yujia Zhou , Zhicheng Dou