English
Related papers

Related papers: Reference and Document Aware Semantic Evaluation M…

200 papers

As language models become more powerful, training and evaluation are increasingly bottlenecked by the data and metrics used for a particular task. For example, summarization models are often trained to predict human reference summaries and…

Computation and Language · Computer Science 2022-02-17 Nisan Stiennon , Long Ouyang , Jeff Wu , Daniel M. Ziegler , Ryan Lowe , Chelsea Voss , Alec Radford , Dario Amodei , Paul Christiano

In the rapidly evolving landscape of digital content, the task of summarizing multimedia documents, which encompass textual, visual, and auditory elements, presents intricate challenges. These challenges include extracting pertinent…

Multimedia · Computer Science 2024-12-30 Azze-Eddine Maredj , Madjid Sadallah

Multi-document summarization aims to obtain core information from a collection of documents written on the same topic. This paper proposes a new holistic framework for unsupervised multi-document extractive summarization. Our method…

Computation and Language · Computer Science 2023-09-11 Haopeng Zhang , Sangwoo Cho , Kaiqiang Song , Xiaoyang Wang , Hongwei Wang , Jiawei Zhang , Dong Yu

An important problem of the sequence-to-sequence neural models widely used in abstractive summarization is exposure bias. To alleviate this problem, re-ranking systems have been applied in recent years. Despite some performance…

Computation and Language · Computer Science 2023-05-18 Jeewoo Sul , Yong Suk Choi

This article describes an exclusively resource-based method of morphological annotation of written Korean text. Korean is an agglutinative language. Our annotator is designed to process text before the operation of a syntactic parser. In…

Computation and Language · Computer Science 2007-11-22 Ivan Berlocher , Hyun-Gue Huh , Eric Laporte , Jee-Sun Nam

Document summarization condenses a long document into a short version with salient information and accurate semantic descriptions. The main issue is how to make the output summary semantically consistent with the input document. To reach…

Computation and Language · Computer Science 2022-04-01 Mingyang Song , Liping Jing

Single document summarization generates summary by extracting the representative sentences from the document. In this paper, we presented a novel technique for summarization of domain-specific text from a single web document that uses…

Information Retrieval · Computer Science 2016-11-17 Rushdi Shams , M. M. A. Hashem , Afrina Hossain , Suraiya Rumana Akter , Monika Gope

A law practitioner has to go through numerous lengthy legal case proceedings for their practices of various categories, such as land dispute, corruption, etc. Hence, it is important to summarize these documents, and ensure that summaries…

Computation and Language · Computer Science 2022-05-18 Ankan Mullick , Abhilash Nandy , Manav Nitin Kapadnis , Sohan Patnaik , R Raghav , Roshni Kar

Existing multi-document summarization approaches produce a uniform summary for all users without considering individuals' interests, which is highly impractical. Making a user-specific summary is a challenging task as it requires: i)…

Information Retrieval · Computer Science 2024-08-15 Samira Ghodratnama , Mehrdad Zakershahrak

We present BLANC, a new approach to the automatic estimation of document summary quality. Our goal is to measure the functional performance of a summary with an objective, reproducible, and fully automated method. Our approach achieves this…

Computation and Language · Computer Science 2020-11-13 Oleg Vasilyev , Vedant Dharnidharka , John Bohannon

The creation of a quality summarization dataset is an expensive, time-consuming effort, requiring the production and evaluation of summaries by both trained humans and machines. If such effort is made in one language, it would be beneficial…

Computation and Language · Computer Science 2021-12-09 Spencer Braun , Oleg Vasilyev , Neslihan Iskender , John Bohannon

The technology of automatic document summarization is maturing and may provide a solution to the information overload problem. Nowadays, document summarization plays an important role in information retrieval. With a large volume of…

Information Retrieval · Computer Science 2012-04-10 Mohsen Pourvali , Mohammad Saniee Abadeh

Many Natural Language Processing and Computational Linguistics applications involves the generation of new texts based on some existing texts, such as summarization, text simplification and machine translation. However, there has been a…

Computation and Language · Computer Science 2018-04-12 Ping Chen , Fei Wu , Tong Wang , Wei Ding

Since the advent of the web, the amount of data on wen has been increased several million folds. In recent years web data generated is more than data stored for years. One important data format is text. To answer user queries over the…

Information Retrieval · Computer Science 2018-11-19 Chandra Shekhar Yadav

In this paper, we proposed a multi-document summarization system using semantic role labeling (SRL) and semantic graph for Indonesian news articles. In order to improve existing summarizer, our system modified summarizer that employed…

Computation and Language · Computer Science 2021-03-08 Yuly Haruka Berliana Gunawan , Masayu Leylia Khodra

Evaluation of a document summarization system has been a critical factor to impact the success of the summarization task. Previous approaches, such as ROUGE, mainly consider the informativeness of the assessed summary and require…

Computation and Language · Computer Science 2020-10-06 Hanlu Wu , Tengfei Ma , Lingfei Wu , Tariro Manyumwa , Shouling Ji

Multi-document summarization (MDS) has made significant progress in recent years, in part facilitated by the availability of new, dedicated datasets and capacious language models. However, a standing limitation of these models is that they…

Computation and Language · Computer Science 2022-03-08 Jacob Parnell , Inigo Jauregi Unanue , Massimo Piccardi

Current evaluation metrics to question answering based machine reading comprehension (MRC) systems generally focus on the lexical overlap between the candidate and reference answers, such as ROUGE and BLEU. However, bias may appear when…

Computation and Language · Computer Science 2018-06-12 An Yang , Kai Liu , Jing Liu , Yajuan Lyu , Sujian Li

In the field of multi-document summarization (MDS), transformer-based models have demonstrated remarkable success, yet they suffer an input length limitation. Current methods apply truncation after the retrieval process to fit the context…

Machine Learning · Computer Science 2025-04-24 Shiyin Tan , Jaeeon Park , Dongyuan Li , Renhe Jiang , Manabu Okumura

Scientific peer review is essential for the quality of academic publications. However, the increasing number of paper submissions to conferences has strained the reviewing process. This surge poses a burden on area chairs who have to…

Computation and Language · Computer Science 2024-06-12 Maxime Darrin , Ines Arous , Pablo Piantanida , Jackie CK Cheung
‹ Prev 1 3 4 5 6 7 10 Next ›