English
Related papers

Related papers: Socratic Pretraining: Question-Driven Pretraining …

200 papers

Automatic meeting summarization is becoming increasingly popular these days. The ability to automatically summarize meetings and to extract key information could greatly increase the efficiency of our work and life. In this paper, we…

Computation and Language · Computer Science 2021-11-17 Andras Huebner , Wei Ji , Xiang Xiao

With the rapid increase in the volume of dialogue data from daily life, there is a growing demand for dialogue summarization. Unfortunately, training a large summarization model is generally infeasible due to the inadequacy of dialogue data…

Computation and Language · Computer Science 2021-09-14 Yicheng Zou , Bolin Zhu , Xingwu Hu , Tao Gui , Qi Zhang

Abstractive text summarization is a highly difficult problem, and the sequence-to-sequence model has shown success in improving the performance on the task. However, the generated summaries are often inconsistent with the source content in…

Computation and Language · Computer Science 2018-05-11 Bingzhen Wei , Xuancheng Ren , Xu Sun , Yi Zhang , Xiaoyan Cai , Qi Su

When employing the Socratic method of teaching, instructors guide students toward solving a problem on their own rather than providing the solution directly. While this strategy can substantially improve learning outcomes, it is usually…

Computation and Language · Computer Science 2023-10-06 Erfan Al-Hossami , Razvan Bunescu , Justin Smith , Ryan Teehan

Despite recent advancements in automatic summarization, state-of-the-art models do not summarize all documents equally well, raising the question: why? While prior research has extensively analyzed summarization models, little attention has…

Computation and Language · Computer Science 2025-04-09 Steven Koniaev , Ori Ernst , Jackie Chi Kit Cheung

The proliferation of video content on platforms like YouTube and Vimeo presents significant challenges in efficiently locating relevant information. Automatic video summarization aims to address this by extracting and presenting key content…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Jia-Hong Huang

In recent years, automatic text summarization has witnessed significant advancement, particularly with the development of transformer-based models. However, the challenge of controlling the readability level of generated summaries remains…

Computation and Language · Computer Science 2025-03-17 Mehmet Samet Duran , Tevfik Aytekin

Dialogue is an essential part of human communication and cooperation. Existing research mainly focuses on short dialogue scenarios in a one-on-one fashion. However, multi-person interactions in the real world, such as meetings or…

Computation and Language · Computer Science 2022-01-07 Ming Zhong , Yang Liu , Yichong Xu , Chenguang Zhu , Michael Zeng

Highlighting while reading is a natural behavior for people to track salient content of a document. It would be desirable to teach an extractive summarizer to do the same. However, a major obstacle to the development of a supervised…

Computation and Language · Computer Science 2019-04-05 Kristjan Arumae , Fei Liu

Complex visual reasoning remains a key challenge today. Typically, the challenge is tackled using methodologies such as Chain of Thought (COT) and visual instruction tuning. However, how to organically combine these two methodologies for…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Wanpeng Hu , Haodi Liu , Lin Chen , Feng Zhou , Changming Xiao , Qi Yang , Changshui Zhang

Existing datasets for manually labelled query-based video summarization are costly and thus small, limiting the performance of supervised deep video summarization models. Self-supervision can address the data sparsity challenge by using a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Jia-Hong Huang , Luka Murn , Marta Mrak , Marcel Worring

Pretraining techniques leveraging enormous datasets have driven recent advances in text summarization. While folk explanations suggest that knowledge transfer accounts for pretraining's benefits, little is known about why it works or what…

Computation and Language · Computer Science 2021-09-13 Kundan Krishna , Jeffrey Bigham , Zachary C. Lipton

Data-driven approaches to sequence-to-sequence modelling have been successfully applied to short text summarization of news articles. Such models are typically trained on input-summary pairs consisting of only a single or a few sentences,…

Computation and Language · Computer Science 2018-04-25 Nikola I. Nikolov , Michael Pfeiffer , Richard H. R. Hahnloser

Generic text summarization approaches often fail to address the specific intent and needs of individual users. Recently, scholarly attention has turned to the development of summarization methods that are more closely tailored and…

Computation and Language · Computer Science 2024-05-29 Ashok Urlana , Pruthwik Mishra , Tathagato Roy , Rahul Mishra

Short video platforms are evolving rapidly, making the identification of inappropriate content increasingly critical. Existing approaches typically train separate and small classification models for each type of issue, which requires…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Zixuan Wang , Yu Sun , Hongwei Wang , Baoyu Jing , Xiang Shen , Xin Dong , Zhuolin Hao , Hongyu Xiong , Yang Song

Current models for document summarization disregard user preferences such as the desired length, style, the entities that the user might be interested in, or how much of the document the user has already read. We present a neural…

Computation and Language · Computer Science 2018-05-22 Angela Fan , David Grangier , Michael Auli

Graph-based semi-supervised learning has proven to be an effective approach for query-focused multi-document summarization. The problem of previous semi-supervised learning is that sentences are ranked without considering the higher level…

Computation and Language · Computer Science 2014-01-03 Jiwei Li , Sujian Li

Domain adaptation for large neural language models (NLMs) is coupled with massive amounts of unstructured data in the pretraining phase. In this study, however, we show that pretrained NLMs learn in-domain information more effectively and…

Computation and Language · Computer Science 2022-08-30 Shahriar Golchin , Mihai Surdeanu , Nazgol Tavabi , Ata Kiapour

Table summarization is a crucial task aimed at condensing information from tabular data into concise and comprehensible textual summaries. However, existing approaches often fall short of adequately meeting users' information and quality…

Computation and Language · Computer Science 2024-08-27 Weijia Zhang , Vaishali Pal , Jia-Hong Huang , Evangelos Kanoulas , Maarten de Rijke

State-of-the-art abstractive summarization models generally rely on extensive labeled data, which lowers their generalization ability on domains where such data are not available. In this paper, we present a study of domain adaptation for…

Computation and Language · Computer Science 2021-04-23 Tiezheng Yu , Zihan Liu , Pascale Fung