English
Related papers

Related papers: A Survey on Explainability in Machine Reading Comp…

200 papers

Though the community has made great progress on Machine Reading Comprehension (MRC) task, most of the previous works are solving English-based MRC problems, and there are few efforts on other languages mainly due to the lack of large-scale…

Computation and Language · Computer Science 2019-11-05 Yiming Cui , Wanxiang Che , Ting Liu , Bing Qin , Shijin Wang , Guoping Hu

Several researchers have argued that a machine learning system's interpretability should be defined in relation to a specific agent or task: we should not ask if the system is interpretable, but to whom is it interpretable. We describe a…

Artificial Intelligence · Computer Science 2018-06-21 Richard Tomsett , Dave Braines , Dan Harborne , Alun Preece , Supriyo Chakraborty

The interpretability of ML models is important, but it is not clear what it amounts to. So far, most philosophers have discussed the lack of interpretability of black-box models such as neural networks, and methods such as explainable AI…

Machine Learning · Computer Science 2024-01-05 Tim Räz

Understanding AI systems' inner workings is critical for ensuring value alignment and safety. This review explores mechanistic interpretability: reverse engineering the computational mechanisms and representations learned by neural networks…

Artificial Intelligence · Computer Science 2024-08-27 Leonard Bereska , Efstratios Gavves

Machine learning plays a role in many deployed decision systems, often in ways that are difficult or impossible to understand by human stakeholders. Explaining, in a human-understandable way, the relationship between the input and output of…

Machine Learning · Computer Science 2022-11-17 Sahil Verma , Varich Boonsanong , Minh Hoang , Keegan E. Hines , John P. Dickerson , Chirag Shah

We present a brief history of the field of interpretable machine learning (IML), give an overview of state-of-the-art interpretation methods, and discuss challenges. Research in IML has boomed in recent years. As young as the field is, it…

Machine Learning · Statistics 2022-01-24 Christoph Molnar , Giuseppe Casalicchio , Bernd Bischl

The lack of transparency in the decision-making processes of deep learning systems presents a significant challenge in modern artificial intelligence (AI), as it impairs users' ability to rely on and verify these systems. To address this…

Artificial Intelligence · Computer Science 2024-11-18 David Debot , Pietro Barbiero , Francesco Giannini , Gabriele Ciravegna , Michelangelo Diligenti , Giuseppe Marra

Large language models have exhibited impressive performance across a broad range of downstream tasks in natural language processing. However, how a language model predicts the next token and generates content is not generally understandable…

Reading comprehension is one of the crucial tasks for furthering research in natural language understanding. A lot of diverse reading comprehension datasets have recently been introduced to study various phenomena in natural language,…

Computation and Language · Computer Science 2020-01-01 Dheeru Dua , Ananth Gottumukkala , Alon Talmor , Sameer Singh , Matt Gardner

Machine reading comprehension have been intensively studied in recent years, and neural network-based models have shown dominant performances. In this paper, we present a Sogou Machine Reading Comprehension (SMRC) toolkit that can be used…

Computation and Language · Computer Science 2019-04-02 Jindou Wu , Yunlun Yang , Chao Deng , Hongyi Tang , Bingning Wang , Haoze Sun , Ting Yao , Qi Zhang

Current evaluation metrics to question answering based machine reading comprehension (MRC) systems generally focus on the lexical overlap between the candidate and reference answers, such as ROUGE and BLEU. However, bias may appear when…

Computation and Language · Computer Science 2018-06-12 An Yang , Kai Liu , Jing Liu , Yajuan Lyu , Sujian Li

There has recently been a surge of work in explanatory artificial intelligence (XAI). This research area tackles the important problem that complex machines and algorithms often cannot provide insights into their behavior and thought…

Artificial Intelligence · Computer Science 2019-02-05 Leilani H. Gilpin , David Bau , Ben Z. Yuan , Ayesha Bajwa , Michael Specter , Lalana Kagal

Machine Learning has been successfully applied in systems applications such as memory prefetching and caching, where learned models have been shown to outperform heuristics. However, the lack of understanding the inner workings of these…

Machine Learning · Computer Science 2022-02-14 Leon Sixt , Evan Zheran Liu , Marie Pellat , James Wexler , Milad Hashemi , Been Kim , Martin Maas

New technologies have led to vast troves of large and complex datasets across many scientific domains and industries. People routinely use machine learning techniques to not only process, visualize, and make predictions from this big data,…

Machine Learning · Statistics 2023-08-04 Genevera I. Allen , Luqin Gan , Lili Zheng

Machine Reading Comprehension (MRC) is an active field in natural language processing with many successful developed models in recent years. Despite their high in-distribution accuracy, these models suffer from two issues: high training…

Computation and Language · Computer Science 2021-07-16 Razieh Baradaran , Hossein Amirkhani

A major requirement for credit scoring models is to provide a maximally accurate risk prediction. Additionally, regulators demand these models to be transparent and auditable. Thus, in credit scoring, very simple predictive models such as…

Machine Learning · Statistics 2020-09-30 Michael Bücker , Gero Szepannek , Alicja Gosiewska , Przemyslaw Biecek

The multi-answer phenomenon, where a question may have multiple answers scattered in the document, can be well handled by humans but is challenging enough for machine reading comprehension (MRC) systems. Despite recent progress in…

Computation and Language · Computer Science 2023-06-02 Chen Zhang , Jiuheng Lin , Xiao Liu , Yuxuan Lai , Yansong Feng , Dongyan Zhao

The lack of interpretability has hindered the large-scale adoption of AI technologies. However, the fundamental idea of interpretability, as well as how to put it into practice, remains unclear. We provide notions of interpretability based…

Machine Learning · Computer Science 2021-11-18 Hangcheng Dong , Bingguo Liu , Fengdong Chen , Dong Ye , Guodong Liu

Continual Machine Reading Comprehension aims to incrementally learn from a continuous data stream across time without access the previous seen data, which is crucial for the development of real-world MRC systems. However, it is a great…

Computation and Language · Computer Science 2022-08-11 Zhijing Wu , Hua Xu , Jingliang Fang , Kai Gao

As machine learning (ML) systems increasingly permeate high-stakes settings such as healthcare, transportation, military, and national security, concerns regarding their reliability have emerged. Despite notable progress, the performance of…

Machine Learning · Computer Science 2023-08-01 Anthony Corso , David Karamadian , Romeo Valentin , Mary Cooper , Mykel J. Kochenderfer