English
Related papers

Related papers: Towards Explainable Evaluation Metrics for Machine…

200 papers

Interpretable Machine Learning (IML) has become increasingly important in many real-world applications, such as autonomous cars and medical diagnosis, where explanations are significantly preferred to help people better understand how…

Machine Learning · Computer Science 2019-08-19 Fan Yang , Mengnan Du , Xia Hu

The paper focuses on the interpretability of Grammatical Error Correction (GEC) evaluation metrics, which received little attention in previous studies. To bridge the gap, we introduce **CLEME2.0**, a reference-based metric describing four…

Computation and Language · Computer Science 2025-05-30 Jingheng Ye , Zishan Xu , Yinghui Li , Linlin Song , Qingyu Zhou , Hai-Tao Zheng , Ying Shen , Wenhao Jiang , Hong-Gee Kim , Ruitong Liu , Xin Su , Zifei Shan

In recent years, automatic speech-to-speech and speech-to-text translation has gained momentum thanks to advances in artificial intelligence, especially in the domains of speech recognition and machine translation. The quality of such…

Computation and Language · Computer Science 2021-07-02 Claudio Fantinuoli , Bianca Prandi

New machine translations (MT) technologies are emerging rapidly and with them, bold claims of achieving human parity such as: (i) the results produced approach "accuracy achieved by average bilingual human translators" (Wu et al., 2017b) or…

Computation and Language · Computer Science 2020-04-01 Eva Vanmassenhove

Reasoning-oriented large language models (RLMs) achieve strong gains on tasks such as mathematics and coding by generating explicit intermediate reasoning. However, their impact on machine translation (MT) remains underexplored. We…

Computation and Language · Computer Science 2026-02-17 Sara Rajaee , Sebastian Vincent , Alexandre Berard , Marzieh Fadaee , Kelly Marchisio , Tom Kocmi

This paper does not aim at introducing a novel model for document-level neural machine translation. Instead, we head back to the original Transformer model and hope to answer the following question: Is the capacity of current models strong…

Computation and Language · Computer Science 2022-03-15 Zewei Sun , Mingxuan Wang , Hao Zhou , Chengqi Zhao , Shujian Huang , Jiajun Chen , Lei Li

Automatically evaluating the quality of language generation is critical. Although recent learned metrics show high correlation with human judgement, these metrics can not explain their verdict or associate the scores with defects in…

Computation and Language · Computer Science 2023-10-30 Wenda Xu , Danqing Wang , Liangming Pan , Zhenqiao Song , Markus Freitag , William Yang Wang , Lei Li

Modern predictive analytics underpinned by machine learning techniques has become a key enabler to the automation of data-driven decision making. In the context of business process management, predictive analytics has been applied to making…

Machine Learning · Computer Science 2020-06-09 Renuka Sindhgatta , Chun Ouyang , Catarina Moreira

Chatbots have long been capable of answering basic questions and even responding to obscure prompts, but recently their improvements have been far more significant. Modern chatbots like Open AIs ChatGPT3 not only have the ability to answer…

Computation and Language · Computer Science 2023-03-22 Grant Rosario , David Noever

Deep Learning and Machine Learning based models have become extremely popular in text processing and information retrieval. However, the non-linear structures present inside the networks make these models largely inscrutable. A significant…

Information Retrieval · Computer Science 2026-03-12 Sourav Saha , Debapriyo Majumdar , Mandar Mitra

In this review, we examine the problem of designing interpretable and explainable machine learning models. Interpretability and explainability lie at the core of many machine learning and statistical applications in medicine, economics,…

Machine Learning · Computer Science 2023-03-02 Ričards Marcinkevičs , Julia E. Vogt

Different from the traditional translation tasks, classical Chinese poetry translation requires both adequacy and fluency in translating culturally and historically significant content and linguistic poetic elegance. Large language models…

Computation and Language · Computer Science 2024-12-31 Andong Chen , Lianzhang Lou , Kehai Chen , Xuefeng Bai , Yang Xiang , Muyun Yang , Tiejun Zhao , Min Zhang

Machine learning is currently undergoing an explosion in capability, popularity, and sophistication. However, one of the major barriers to widespread acceptance of machine learning (ML) is trustworthiness: most ML models operate as black…

Interpretability is an elusive but highly sought-after characteristic of modern machine learning methods. Recent work has focused on interpretability via $\textit{explanations}$, which justify individual model predictions. In this work, we…

Machine Learning · Computer Science 2019-10-31 David Alvarez-Melis , Hal Daumé , Jennifer Wortman Vaughan , Hanna Wallach

The rapid development of large pretrained language models has revolutionized not only the field of Natural Language Generation (NLG) but also its evaluation. Inspired by the recent work of BARTScore: a metric leveraging the BART language…

Computation and Language · Computer Science 2022-10-14 Moussa Kamal Eddine , Guokan Shang , Michalis Vazirgiannis

The currently dominating artificial intelligence and machine learning technology, neural networks, builds on inductive statistical learning. Neural networks of today are information processing systems void of understanding and reasoning…

Artificial Intelligence · Computer Science 2022-08-26 Lars Holmberg

In recent years, machine learning (ML) has become a key enabling technology for the sciences and industry. Especially through improvements in methodology, the availability of large databases and increased computational power, today's ML…

Artificial Intelligence · Computer Science 2019-09-27 Wojciech Samek , Klaus-Robert Müller

Automatic sign language processing is gaining popularity in Natural Language Processing (NLP) research (Yin et al., 2021). In machine translation (MT) in particular, sign language translation based on glosses is a prominent approach. In…

Computation and Language · Computer Science 2022-11-29 Mathias Müller , Zifan Jiang , Amit Moryossef , Annette Rios , Sarah Ebling

The rapid evolution of machine learning (ML) has led to the widespread adoption of complex "black box" models, such as deep neural networks and ensemble methods. These models exhibit exceptional predictive performance, making them…

Machine Learning · Computer Science 2025-03-28 Moncef Garouani , Josiane Mothe , Ayah Barhrhouj , Julien Aligon

Machine-translated benchmark datasets reduce costs and offer scale, but noise, loss of structure, and uneven quality weaken confidence. What matters is not merely whether we can translate, but also whether we can measure and verify…

Computation and Language · Computer Science 2026-04-03 Klaudia Thellmann , Bernhard Stadler , Michael Färber