English
Related papers

Related papers: Unified Shapley Framework to Explain Prediction Dr…

200 papers

Feature selection is a classical problem in statistics and machine learning, and it continues to remain an extremely challenging problem especially in the context of unknown non-linear relationships with dependent features. On the other…

Machine Learning · Statistics 2026-04-17 Chenghui Zheng , Garvesh Raskutti

Distribution-free prediction sets play a pivotal role in uncertainty quantification for complex statistical models. Their validity hinges on reliable calibration data, which may not be readily available as real-world environments often…

Methodology · Statistics 2024-06-11 Elise Han , Chengpiao Huang , Kaizheng Wang

As machine learning models are increasingly deployed in dynamic environments, it becomes paramount to assess and quantify uncertainties associated with distribution shifts. A distribution shift occurs when the underlying data-generating…

Methodology · Statistics 2024-10-08 Jiawei Ge , Debarghya Mukherjee , Jianqing Fan

Classical machine learning algorithms often assume that the data are drawn i.i.d. from a stationary probability distribution. Recently, continual learning emerged as a rapidly growing area of machine learning where this assumption is…

Machine Learning · Computer Science 2022-07-12 Timothée Lesort , Massimo Caccia , Irina Rish

Data distributions in streaming environments are usually not stationary. In order to maintain a high predictive quality at all times, online learning models need to adapt to distributional changes, which are known as concept drift. The…

Machine Learning · Computer Science 2022-03-31 Johannes Haug , Gjergji Kasneci

A trained ML model is deployed on another `test' dataset where target feature values (labels) are unknown. Drift is distribution change between the training and deployment data, which is concerning if model performance changes. For a…

Applications · Statistics 2022-09-07 Samuel Ackerman , Eitan Farchi , Orna Raz , Marcel Zalmanovici , Parijat Dube

Most machine learning models operate under the assumption that the training, testing and deployment data is independent and identically distributed (i.i.d.). This assumption doesn't generally hold true in a natural setting. Usually, the…

Machine Learning · Computer Science 2021-12-14 Kumud Lakara , Akshat Bhandari , Pratinav Seth , Ujjwal Verma

Multi-group learning is a learning task that focuses on controlling predictors' conditional losses over specified subgroups. We propose ShakyPrepend, a method that leverages tools inspired by differential privacy to obtain improved…

Machine Learning · Computer Science 2026-03-10 Lujing Zhang , Daniel Hsu , Sivaraman Balakrishnan

Data Shapley provides a principled framework for attributing data's contribution within machine learning contexts. However, existing approaches require re-training models on different data subsets, which is computationally intensive,…

Machine Learning · Computer Science 2025-06-10 Jiachen T. Wang , Prateek Mittal , Dawn Song , Ruoxi Jia

Meteorological factors (MF) are crucial in day-ahead load forecasting as they significantly influence the electricity consumption behaviors of consumers. Numerous studies have incorporated MF into the load forecasting model to achieve…

Machine Learning · Computer Science 2025-01-07 Yangze Zhou , Guoxin Lin , Gonghao Zhang , Yi Wang

The use of machine learning for time series prediction has become increasingly popular across various industries thanks to the availability of time series data and advancements in machine learning algorithms. However, traditional methods…

Machine Learning · Statistics 2023-06-01 Gonçalo Mateus , Cláudia Soares , João Leitão , António Rodrigues

Ensembles of decision trees perform well on many problems, but are not interpretable. In contrast to existing approaches in interpretability that focus on explaining relationships between features and predictions, we propose an alternative…

Machine Learning · Statistics 2020-08-26 Sarah Tan , Matvey Soloviev , Giles Hooker , Martin T. Wells

When analyzing the behavior of machine learning algorithms, it is important to identify specific data subgroups for which the considered algorithm shows different performance with respect to the entire dataset. The intervention of domain…

Machine Learning · Computer Science 2021-08-18 Eliana Pastor , Luca de Alfaro , Elena Baralis

To reduce the heavy computational burden of reactive power optimization of distribution networks, machine learning models are receiving increasing attention. However, most machine learning models (e.g., neural networks) are usually…

Systems and Control · Electrical Eng. & Systems 2023-11-08 Wenlong Liao , Benjamin Schäfer , Dalin Qin , Gonghao Zhang , Zhixian Wang , Zhe Yang

This work introduces a novel framework for dynamic factor model-based group-level analysis of multiple subjects time series data, called GRoup Integrative DYnamic factor (GRIDY) models. The framework identifies and characterizes…

Methodology · Statistics 2024-07-29 Younghoon Kim , Zachary F. Fisher , Vladas Pipiras

Deep neural networks have become the default choice for many of the machine learning tasks such as classification and regression. Dropout, a method commonly used to improve the convergence of deep neural networks, generates an ensemble of…

Machine Learning · Statistics 2019-04-11 Tal Kachman , Michal Moshkovitz , Michal Rosen-Zvi

We investigate the data distribution valuation problem, which aims to quantify the values of data distributions from their samples. This is a recently proposed problem that is related to but different from classical data valuation and can…

Machine Learning · Computer Science 2026-04-08 Cuong N. Nguyen , Cuong V. Nguyen

Conformal prediction is a popular, modern technique for providing valid predictive inference for arbitrary machine learning models. Its validity relies on the assumptions of exchangeability of the data, and symmetry of the given model…

Methodology · Statistics 2023-03-20 Rina Foygel Barber , Emmanuel J. Candes , Aaditya Ramdas , Ryan J. Tibshirani

We introduce a theoretical and practical framework for efficient importance sampling of mini-batch samples for gradient estimation from single and multiple probability distributions. To handle noisy gradients, our framework dynamically…

Machine Learning · Computer Science 2025-01-29 Corentin Salaün , Xingchang Huang , Iliyan Georgiev , Niloy J. Mitra , Gurprit Singh

Graph Neural Networks (GNNs) have demonstrated remarkable performance in various graph-based machine learning tasks, yet evaluating the importance of neighbors of testing nodes remains largely unexplored due to the challenge of assessing…

Machine Learning · Computer Science 2025-03-25 Hongliang Chi , Qiong Wu , Zhengyi Zhou , Yao Ma