中文
相关论文

相关论文: Interpretable Multi-Headed Attention for Abstracti…

200 篇论文

In recent years, automatic text summarization has witnessed significant advancement, particularly with the development of transformer-based models. However, the challenge of controlling the readability level of generated summaries remains…

计算与语言 · 计算机科学 2025-03-17 Mehmet Samet Duran , Tevfik Aytekin

Automatic summarization of natural language is a current topic in computer science research and industry, studied for decades because of its usefulness across multiple domains. For example, summarization is necessary to create reviews such…

计算与语言 · 计算机科学 2018-12-31 Marc Everett Johnson

Cross-lingual Summarization (CLS) aims at producing a summary in the target language for an article in the source language. Traditional solutions employ a two-step approach, i.e. translate then summarize or summarize then translate.…

计算与语言 · 计算机科学 2020-10-20 Ruochen Xu , Chenguang Zhu , Yu Shi , Michael Zeng , Xuedong Huang

Construction of human-curated annotated datasets for abstractive text summarization (ATS) is very time-consuming and expensive because creating each instance requires a human annotator to read a long document and compose a shorter summary…

We investigate pre-training techniques for abstractive multi-document summarization (MDS), which is much less studied than summarizing single documents. Though recent work has demonstrated the effectiveness of highlighting information…

计算与语言 · 计算机科学 2023-11-17 Joseph J. Peper , Wenzhao Qiu , Lu Wang

In an era where digital text is proliferating at an unprecedented rate, efficient summarization tools are becoming indispensable. While Large Language Models (LLMs) have been successfully applied in various NLP tasks, their role in…

计算与语言 · 计算机科学 2024-08-29 Léo Hemamou , Mehdi Debiane

In this paper, we aim to improve abstractive dialogue summarization quality and, at the same time, enable granularity control. Our model has two primary components and stages: 1) a two-stage generation strategy that generates a preliminary…

计算与语言 · 计算机科学 2021-06-04 Chien-Sheng Wu , Linqing Liu , Wenhao Liu , Pontus Stenetorp , Caiming Xiong

Text summarizing is a critical Natural Language Processing (NLP) task with applications ranging from information retrieval to content generation. Large Language Models (LLMs) have shown remarkable promise in generating fluent abstractive…

计算与语言 · 计算机科学 2025-03-03 Colleen Gilhuly , Haleh Shahzad

We show that a simple unsupervised masking objective can approach near supervised performance on abstractive multi-document news summarization. Our method trains a state-of-the-art neural summarization model to predict the masked out source…

计算与语言 · 计算机科学 2022-01-10 Nikolai Vogler , Songlin Li , Yujie Xu , Yujian Mi , Taylor Berg-Kirkpatrick

We propose an abstraction-based multi-document summarization framework that can construct new sentences by exploring more fine-grained syntactic units than sentences, namely, noun/verb phrases. Different from existing abstraction-based…

计算与语言 · 计算机科学 2015-06-08 Lidong Bing , Piji Li , Yi Liao , Wai Lam , Weiwei Guo , Rebecca J. Passonneau

This paper introduces a novel pipeline for summarising timelines of events reported by multiple news sources. Transformer-based models for abstractive summarisation generate coherent and concise summaries of long documents but can fail to…

机器学习 · 计算机科学 2023-11-06 Yuxuan Ye , Edwin Simpson

Explaining reinforcement learning agents is challenging because policies emerge from complex reward structures and neural representations that are difficult for humans to interpret. Existing approaches often rely on curated demonstrations…

机器学习 · 计算机科学 2026-01-09 Sahar Admoni , Assaf Hallak , Yftah Ziser , Omer Ben-Porat , Ofra Amir

Abstractive summarization is the process of generating novel sentences based on the information extracted from the original text document while retaining the context. Due to abstractive summarization's underlying complexities, most of the…

计算与语言 · 计算机科学 2020-12-18 Prithwiraj Bhattacharjee , Avi Mallick , Md Saiful Islam , Marium-E-Jannat

Graphs that capture relations between textual units have great benefits for detecting salient information from multiple documents and generating overall coherent summaries. In this paper, we develop a neural abstractive multi-document…

计算与语言 · 计算机科学 2020-05-21 Wei Li , Xinyan Xiao , Jiachen Liu , Hua Wu , Haifeng Wang , Junping Du

Summarizing clinical text is crucial in health decision-support and clinical research. Large language models (LLMs) have shown the potential to generate accurate clinical text summaries, but still struggle with issues regarding grounding…

Large language models (LLMs) have shown promise for automatic summarization but the reasons behind their successes are poorly understood. By conducting a human evaluation on ten LLMs across different pretraining methods, prompts, and model…

计算与语言 · 计算机科学 2023-02-01 Tianyi Zhang , Faisal Ladhak , Esin Durmus , Percy Liang , Kathleen McKeown , Tatsunori B. Hashimoto

Controllable summarization aims to provide summaries that take into account user-specified aspects and preferences to better assist them with their information need, as opposed to the standard summarization setup which build a single…

计算与语言 · 计算机科学 2022-04-06 Mounica Maddela , Mayank Kulkarni , Daniel Preotiuc-Pietro

Previous abstractive methods apply sequence-to-sequence structures to generate summary without a module to assist the system to detect vital mentions and relationships within a document. To address this problem, we utilize semantic graph to…

计算与语言 · 计算机科学 2021-09-14 Qiwei Bi , Haoyuan Li , Kun Lu , Hanfang Yang

Recent language models have demonstrated proficiency in summarizing source code. However, as in many other domains of machine learning, language models of code lack sufficient explainability. Informally, we lack a formulaic or intuitive…

软件工程 · 计算机科学 2024-02-23 Jiliang Li , Yifan Zhang , Zachary Karas , Collin McMillan , Kevin Leach , Yu Huang

Code summarization aims to generate concise natural language descriptions for source code. The prevailing approaches adopt transformer-based encoder-decoder architectures, where the Abstract Syntax Tree (AST) of the source code is utilized…

计算与语言 · 计算机科学 2023-08-11 Yeshwanth Nagaraj , Ujjwal Gupta