English
Related papers

Related papers: Towards Interpretable Summary Evaluation via Alloc…

200 papers

Interpretability has become an important topic of research as more machine learning (ML) models are deployed and widely used to make important decisions. Most of the current explanation methods provide explanations through feature…

Machine Learning · Statistics 2019-10-09 Amirata Ghorbani , James Wexler , James Zou , Been Kim

Keyphrase extraction from a given document is the task of automatically extracting salient phrases that best describe the document. This paper proposes a novel unsupervised graph-based ranking method to extract high-quality phrases from a…

Information Retrieval · Computer Science 2022-01-27 Venktesh V , Mukesh Mohania , Vikram Goyal

A commonly used evaluation metric for text-to-image synthesis is the Inception score (IS) \cite{inceptionscore}, which has been shown to be a quality metric that correlates well with human judgment. However, IS does not reveal properties of…

Machine Learning · Computer Science 2019-11-04 William Lund Sommer , Alexandros Iosifidis

Referring Image Segmentation (RIS) aims to segment target objects expressed in natural language within a scene at the pixel level. Various recent RIS models have achieved state-of-the-art performance by generating contextual tokens to model…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Minhyeok Lee , Dogyoon Lee , Jungho Lee , Suhwan Cho , Heeseung Choi , Ig-Jae Kim , Sangyoun Lee

Answering query with semantic concepts has long been the mainstream approach for video search. Until recently, its performance is surpassed by concept-free approach, which embeds queries in a joint space as videos. Nevertheless, the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Jiaxin Wu , Chong-Wah Ngo

In this paper, we propose FFCI, a framework for fine-grained summarization evaluation that comprises four elements: faithfulness (degree of factual consistency with the source), focus (precision of summary content relative to the…

Computation and Language · Computer Science 2022-03-01 Fajri Koto , Timothy Baldwin , Jey Han Lau

As an ubiquitous method in natural language processing, word embeddings are extensively employed to map semantic properties of words into a dense vector representation. They capture semantic and syntactic relations among words but the…

Computation and Language · Computer Science 2020-07-03 Lutfi Kerem Senel , Ihsan Utlu , Furkan Şahinuç , Haldun M. Ozaktas , Aykut Koç

In the domain of education, the integration of,technology has led to a transformative era, reshaping traditional,learning paradigms. Central to this evolution is the automation,of grading processes, particularly within the STEM domain…

Artificial Intelligence · Computer Science 2024-09-25 Rajlaxmi Patil , Aditya Ashutosh Kulkarni , Ruturaj Ghatage , Sharvi Endait , Geetanjali Kale , Raviraj Joshi

Due to the exponential growth of information and the need for efficient information consumption the task of summarization has gained paramount importance. Evaluating summarization accurately and objectively presents significant challenges,…

Computation and Language · Computer Science 2024-12-31 Dong Yuan , Eti Rastogi , Fen Zhao , Sagar Goyal , Gautam Naik , Sree Prasanna Rajagopal

Black-box deep neural networks excel in text classification, yet their application in high-stakes domains is hindered by their lack of interpretability. To address this, we propose Text Bottleneck Models (TBM), an intrinsically…

Computation and Language · Computer Science 2024-04-04 Josh Magnus Ludan , Qing Lyu , Yue Yang , Liam Dugan , Mark Yatskar , Chris Callison-Burch

Automated Essay Score (AES) is proven to be one of the cutting-edge technologies. Scoring techniques are used for various purposes. Reliable scores are calculated based on influential variables. Such variables can be computed by different…

Machine Learning · Computer Science 2023-10-05 Bagiya Lakshmi S , Sanjjushri Varshini R , Rohith Mahadevan , Raja CSP Raman

Automating the assessment of learner summaries provides a useful tool for assessing learner reading comprehension. We present a summarization task for evaluating non-native reading comprehension and propose three novel approaches to…

Computation and Language · Computer Science 2019-06-19 Menglin Xia , Ekaterina Kochmar , Ted Briscoe

Massively multilingual sentence representation models, e.g., LASER, SBERT-distill, and LaBSE, help significantly improve cross-lingual downstream tasks. However, the use of a large amount of data or inefficient model architectures results…

Computation and Language · Computer Science 2024-05-31 Zhuoyuan Mao , Chenhui Chu , Sadao Kurohashi

Topic modelling is a text mining technique for identifying salient themes from a number of documents. The output is commonly a set of topics consisting of isolated tokens that often co-occur in such documents. Manual effort is often…

Computation and Language · Computer Science 2024-04-26 Lowri Williams , Eirini Anthi , Laura Arman , Pete Burnap

This paper proposes a general interpretable predictive system with shared information. The system is able to perform predictions in a multi-task setting where distinct tasks are not bound to have the same input/output structure. Embeddings…

Machine Learning · Computer Science 2024-07-02 Maciej Żelaszczyk , Jacek Mańdziuk

This paper presents our submission to the SemEval 2020 - Task 10 on emphasis selection in written text. We approach this emphasis selection problem as a sequence labeling task where we represent the underlying text with various contextual…

Computation and Language · Computer Science 2020-09-08 Sarthak Anand , Pradyumna Gupta , Hemant Yadav , Debanjan Mahata , Rakesh Gosangi , Haimin Zhang , Rajiv Ratn Shah

Word embeddings are effective intermediate representations for capturing semantic regularities between words, when learning the representations of text sequences. We propose to view text classification as a label-word joint embedding…

Computation and Language · Computer Science 2018-05-14 Guoyin Wang , Chunyuan Li , Wenlin Wang , Yizhe Zhang , Dinghan Shen , Xinyuan Zhang , Ricardo Henao , Lawrence Carin

Applying machine learning algorithms to large-scale, text-based corpora (embeddings) presents a unique opportunity to investigate at scale how human semantic knowledge is organized and how people use it to judge fundamental relationships,…

Computation and Language · Computer Science 2020-07-17 Marius Cătălin Iordan , Tyler Giallanza , Cameron T. Ellis , Nicole M. Beckage , Jonathan D. Cohen

Clinical trials are central to medical progress because they help improve understanding of human health and the healthcare system. They play a key role in discovering new ways to detect, prevent, or treat diseases, and it is essential that…

Computation and Language · Computer Science 2025-10-16 Surya Tejaswi Yerramsetty , Almas Fathimah

This paper outlines a theoretical framework using which different automatic metrics can be designed for evaluation of Machine Translation systems. It introduces the concept of {\em cognitive ease} which depends on {\em adequacy} and {\em…

Computation and Language · Computer Science 2022-02-14 Rajeev Sangal