English
Related papers

Related papers: Enhancing Semantic Understanding with Self-supervi…

200 papers

The advancements in deep learning, particularly the introduction of transformers, have been pivotal in enhancing various natural language processing (NLP) tasks. These include text-to-text applications such as machine translation, text…

Artificial Intelligence · Computer Science 2024-12-24 Gospel Ozioma Nnadi , Flavio Bertini

Abstractive dialogue summarization is the task of distilling conversations into informative and concise summaries. Although reviews have been conducted on this topic, there is a lack of comprehensive work detailing the challenges of…

Computation and Language · Computer Science 2025-04-25 Frederic Kirstein , Jan Philip Wahle , Bela Gipp , Terry Ruas

Recent advances in deep learning, and especially the invention of encoder-decoder architectures, has significantly improved the performance of abstractive summarization systems. The majority of research has focused on written documents,…

Computation and Language · Computer Science 2023-12-11 Virgile Rennard , Guokan Shang , Damien Grari , Julie Hunter , Michalis Vazirgiannis

The development of deep neural networks and the emergence of pre-trained language models such as BERT allow to increase performance on many NLP tasks. However, these models do not meet the same popularity for tweet summarization, which can…

Information Retrieval · Computer Science 2021-06-17 Alexis Dusart , Karen Pinel-Sauvagnat , Gilles Hubert

Dialogue summarization aims to provide a concise and coherent summary of conversations between multiple speakers. While recent advancements in language models have enhanced this process, summarizing dialogues accurately and faithfully…

Computation and Language · Computer Science 2024-09-17 Eunice Akani , Benoit Favre , Frederic Bechet , Romain Gemignani

Conventional dialogue summarization methods directly generate summaries and do not consider user's specific interests. This poses challenges in cases where the users are more focused on particular topics or aspects. With the advancement of…

Computation and Language · Computer Science 2024-08-02 Bin Wang , Zhengyuan Liu , Nancy F. Chen

Current dialogue summarization systems usually encode the text with a number of general semantic features (e.g., keywords and topics) to gain more powerful dialogue modeling capabilities. However, these features are obtained via open-domain…

Computation and Language · Computer Science 2021-05-31 Xiachong Feng , Xiaocheng Feng , Libo Qin , Bing Qin , Ting Liu

Current language models are usually trained using a self-supervised scheme, where the main focus is learning representations at the word or sentence level. However, there has been limited progress in generating useful discourse-level…

Computation and Language · Computer Science 2021-09-13 Vladimir Araujo , Andrés Villa , Marcelo Mendoza , Marie-Francine Moens , Alvaro Soto

A system that could reliably identify and sum up the most important points of a conversation would be valuable in a wide variety of real-world contexts, from business meetings to medical consultations to customer service calls. Recent…

Computation and Language · Computer Science 2023-04-26 Virgile Rennard , Guokan Shang , Julie Hunter , Michalis Vazirgiannis

Automatic text summarization (ATS) has recently achieved impressive performance thanks to recent advances in deep learning and the availability of large-scale corpora. To make the summarization results more faithful, this paper presents an…

Computation and Language · Computer Science 2019-10-15 Shengluan Hou , Ruqian Lu

Abstractive dialogue summarization is to generate a concise and fluent summary covering the salient information in a dialogue among two or more interlocutors. It has attracted great attention in recent years based on the massive emergence…

Computation and Language · Computer Science 2023-08-08 Qi Jia , Yizhu Liu , Siyu Ren , Kenny Q. Zhu

Pre-trained contextual representations like BERT have achieved great success in natural language processing. However, the sentence embeddings from the pre-trained language models without fine-tuning have been found to poorly capture…

Computation and Language · Computer Science 2020-11-12 Bohan Li , Hao Zhou , Junxian He , Mingxuan Wang , Yiming Yang , Lei Li

Unsupervised dialogue structure learning is an important and meaningful task in natural language processing. The extracted dialogue structure and process can help analyze human dialogue, and play a vital role in the design and evaluation of…

Computation and Language · Computer Science 2021-11-10 Bingkun Chen , Shaobing Dai , Shenghua Zheng , Lei Liao , Yang Li

Abstractive conversation summarization has received much attention recently. However, these generated summaries often suffer from insufficient, redundant, or incorrect content, largely due to the unstructured and complex characteristics of…

Computation and Language · Computer Science 2021-04-20 Jiaao Chen , Diyi Yang

Automatic text summarization extracts important information from texts and presents the information in the form of a summary. Abstractive summarization approaches progressed significantly by switching to deep neural networks, but results…

Computation and Language · Computer Science 2021-09-03 Aleš Žagar , Marko Robnik-Šikonja

Abstractive dialogue summarization is the task of capturing the highlights of a dialogue and rewriting them into a concise version. In this paper, we present a novel multi-speaker dialogue summarizer to demonstrate how large-scale…

Computation and Language · Computer Science 2020-10-21 Xiachong Feng , Xiaocheng Feng , Bing Qin , Ting Liu

Dialogue summarization aims to condense the original dialogue into a shorter version covering salient information, which is a crucial way to reduce dialogue data overload. Recently, the promising achievements in both dialogue systems and…

Computation and Language · Computer Science 2022-04-29 Xiachong Feng , Xiaocheng Feng , Bing Qin

Multi-turn dialogues are characterized by their extended length and the presence of turn-taking conversations. Traditional language models often overlook the distinct features of these dialogues by treating them as regular text. In this…

Computation and Language · Computer Science 2024-02-01 Sangwoo Cho , Kaiqiang Song , Chao Zhao , Xiaoyang Wang , Dong Yu

We propose SUMART, a method for summarizing and compressing the volume of verbose subtitle translations. SUMART is designed for understanding translated captions (e.g., interlingual conversations via subtitle translation or when watching…

Human-Computer Interaction · Computer Science 2025-04-15 Naoto Nishida , Jun Rekimoto

Summarization has usually relied on gold standard summaries to train extractive or abstractive models. Social media brings a hurdle to summarization techniques since it requires addressing a multi-document multi-author approach. We address…

Computation and Language · Computer Science 2021-06-22 Ignacio Tampe Palma , Marcelo Mendoza , Evangelos Milios