English
Related papers

Related papers: Explaining Drift using Shapley Values

200 papers

Concept drift refers to changes in the distribution of underlying data and is an inherent property of evolving data streams. Ensemble learning, with dynamic classifiers, has proved to be an efficient method of handling concept drift.…

Machine Learning · Computer Science 2020-04-14 Anjin Liu , Jie Lu , Guangquan Zhang

Concept drift in learning and classification occurs when the statistical properties of either the data features or target change over time; evidence of drift has appeared in search data, medical research, malware, web data, and video. Drift…

Machine Learning · Computer Science 2019-10-03 Abhijit Suprem

ML models deployed in production often have to face unknown domain changes, fundamentally different from their training settings. Performance prediction models carry out the crucial task of measuring the impact of these changes on model…

Machine Learning · Computer Science 2022-06-23 Simona Maggio , Victor Bouvier , Léo Dreyfus-Schmidt

We review the application of Statistical Mechanics methods to the study of online learning of a drifting concept in the limit of large systems. The model where a feed-forward network learns from examples generated by a time dependent…

Disordered Systems and Neural Networks · Physics 2007-05-23 Renato Vicente , Osame Kinouchi , Nestor Caticha

In many real-world applications, continuous machine learning (ML) systems are crucial but prone to data drift, a phenomenon where discrepancies between historical training data and future test data lead to significant performance…

Machine Learning · Computer Science 2024-11-26 Vennela Yarabolu , Govind Waghmare , Sonia Gupta , Siddhartha Asthana

Machine Learning (ML) is becoming increasingly popular in fluid dynamics. Powerful ML algorithms such as neural networks or ensemble methods are notoriously difficult to interpret. Here, we introduce the novel Shapley Additive Explanations…

Fluid Dynamics · Physics 2022-05-20 Martin Lellep , Jonathan Prexl , Bruno Eckhardt , Moritz Linkmann

Most machine learning models operate under the assumption that the training, testing and deployment data is independent and identically distributed (i.i.d.). This assumption doesn't generally hold true in a natural setting. Usually, the…

Machine Learning · Computer Science 2021-12-14 Kumud Lakara , Akshat Bhandari , Pratinav Seth , Ujjwal Verma

We consider the dataset valuation problem, that is, the problem of quantifying the incremental gain, to some relevant pre-defined utility of a machine learning task, of aggregating an individual dataset to others. The Shapley value is a…

Artificial Intelligence · Computer Science 2025-02-25 Felipe Garrido-Lucero , Benjamin Heymann , Maxime Vono , Patrick Loiseau , Vianney Perchet

Data stream mining aims at extracting meaningful knowledge from continually evolving data streams, addressing the challenges posed by nonstationary environments, particularly, concept drift which refers to a change in the underlying data…

Machine Learning · Computer Science 2025-01-03 Kleanthis Malialis , Jin Li , Christos G. Panayiotou , Marios M. Polycarpou

Machine learning on data streams is increasingly more present in multiple domains. However, there is often data distribution shift that can lead machine learning models to make incorrect decisions. While there are automatic methods to…

Machine Learning · Computer Science 2022-05-02 João Palmeiro , Beatriz Malveiro , Rita Costa , David Polido , Ricardo Moreira , Pedro Bizarro

In many real-world applications, data are often collected in the form of stream, and thus the distribution usually changes in nature, which is referred as concept drift in literature. We propose a novel and effective approach to handle…

Machine Learning · Computer Science 2020-07-07 Peng Zhao , Le-Wen Cai , Zhi-Hua Zhou

Camera images are ubiquitous in machine learning research. They also play a central role in the delivery of important services spanning medicine and environmental surveying. However, the application of machine learning models in these…

Learned database components, which deeply integrate machine learning into their design, have been extensively studied in recent years. Given the dynamism of databases, where data and workloads continuously drift, it is crucial for learned…

Databases · Computer Science 2026-04-16 Zhanhao Zhao , Haotian Gao , Naili Xing , Lingze Zeng , Meihui Zhang , Gang Chen , Manuel Rigger , Beng Chin Ooi

A number of techniques have been proposed to explain a machine learning model's prediction by attributing it to the corresponding input features. Popular among these are techniques that apply the Shapley value method from cooperative game…

Machine Learning · Computer Science 2020-06-29 Luke Merrick , Ankur Taly

Data valuation has found various applications in machine learning, such as data filtering, efficient learning and incentives for data sharing. The most popular current approach to data valuation is the Shapley value. While popular for its…

Machine Learning · Computer Science 2023-11-10 Lauren Watson , Zeno Kujawa , Rayna Andreeva , Hao-Tsung Yang , Tariq Elahi , Rik Sarkar

Urban time series data forecasting featuring significant contributions to sustainable development is widely studied as an essential task of the smart city. However, with the dramatic and rapid changes in the world environment, the…

Machine Learning · Computer Science 2023-11-27 Zekun Cai , Renhe Jiang , Xinyu Yang , Zhaonan Wang , Diansheng Guo , Hiroki Kobayashi , Xuan Song , Ryosuke Shibasaki

As input data distributions evolve, the predictive performance of machine learning models tends to deteriorate. In the past, predictive performance was considered the key indicator to monitor. However, explanation aspects have come to…

Machine Learning · Computer Science 2022-10-25 Carlos Mougan , Klaus Broelemann , Gjergji Kasneci , Thanassis Tiropanis , Steffen Staab

As the adoption of deep learning models has grown beyond human capacity for verification, meta-algorithms are needed to ensure reliable model inference. Concept drift detection is a field dedicated to identifying statistical shifts that is…

Machine Learning · Computer Science 2025-05-08 Jacob Glenn Ayers , Buvaneswari A. Ramanan , Manzoor A. Khan

Humans often juggle multiple, sometimes conflicting objectives and shift their priorities as circumstances change, rather than following a fixed objective function. In contrast, most computational decision-making and multi-objective RL…

Artificial Intelligence · Computer Science 2026-03-25 Xianwei Cao , Dou Quan , Zhenliang Zhang , Shuang Wang

The ability to detect when a system undergoes an incipient fault is of paramount importance in preventing a critical failure. Classic methods for fault detection (including model-based and data-driven approaches) rely on thresholding error…

Signal Processing · Electrical Eng. & Systems 2025-02-13 Camilo Ramírez , Jorge F. Silva , Ferhat Tamssaouet , Tomás Rojas , Marcos E. Orchard