English
Related papers

Related papers: Computing AIC for black-box models using Generalis…

200 papers

Federated learning is a private-by-design distributed learning paradigm where clients train local models on their own data before a central server aggregates their local updates to compute a global model. Depending on the aggregation method…

Machine Learning · Computer Science 2022-07-15 Jin Xu , Chi Hong , Jiyue Huang , Lydia Y. Chen , Jérémie Decouchant

We present a methodology for model evaluation and selection where the sampling mechanism violates the i.i.d. assumption. Our methodology involves a formulation of the bias between the standard Cross-Validation (CV) estimator and the mean…

Methodology · Statistics 2025-03-14 Oren Yuval , Saharon Rosset

Generalized Category Discovery (GCD) aims to identify unlabeled samples by leveraging the base knowledge from labeled ones, where the unlabeled set consists of both base and novel classes. Since clustering methods are time-consuming at…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Duo Liu , Zhiquan Tan , Linglan Zhao , Zhongqiang Zhang , Xiangzhong Fang , Weiran Huang

Explaining the behavior of black box machine learning models through human interpretable rules is an important research area. Recent work has focused on explaining model behavior locally i.e. for specific predictions as well as globally…

Machine Learning · Computer Science 2021-05-17 Sukriti Verma , Nikaash Puri , Piyush Gupta , Balaji Krishnamurthy

Machine learning models often degrade when deployed on data distributions different from their training data. Challenging conventional validation paradigms, we demonstrate that higher in-distribution (ID) bias can lead to better…

Machine Learning · Computer Science 2025-06-03 Ruixuan Chen , Wentao Li , Jiahui Xiao , Yuchen Li , Yimin Tang , Xiaonan Wang

Graph neural networks have demonstrated excellent applicability to a wide range of domains, including social networks, biological systems, recommendation systems, and wireless communications. Yet a principled theoretical understanding of…

Machine Learning · Computer Science 2026-04-14 Xinping Yi

The Guide to the Expression of Uncertainty in Measurement advocates the use of an 'effective number of degrees of freedom' for the calculation of an interval of measurement uncertainty. However, it does not describe how this number is to be…

Data Analysis, Statistics and Probability · Physics 2013-11-05 R. Willink , B. D. Hall

The global sensitivity analysis method, used to quantify the influence of uncertain input variables on the response variability of a numerical model, is applicable to deterministic computer code (for which the same set of input variables…

Methodology · Statistics 2009-06-08 Bertrand Iooss , Mathieu Ribatet , Amandine Marrel

Anomaly Detection (AD) focuses on identifying unusual behaviors in complex datasets. Machine Learning (ML) algorithms and Decision Support Systems (DSSs) provide effective solutions for AD, but detecting anomalies alone may not be enough,…

Machine Learning · Statistics 2024-10-10 Alessio Arcudi , Davide Frizzo , Chiara Masiero , Gian Antonio Susto

Machine learning is permeating every conceivable domain to promote data-driven decision support. The focus is often on advanced black-box models due to their assumed performance advantages, whereas interpretable models are often associated…

Machine Learning · Computer Science 2024-09-24 Sven Kruschel , Nico Hambauer , Sven Weinzierl , Sandra Zilker , Mathias Kraus , Patrick Zschech

The intraclass correlation coefficient (ICC) is a classical index of measurement reliability. With the advent of new and complex types of data for which the ICC is not defined, there is a need for new ways to assess reliability. To meet…

Methodology · Statistics 2020-04-29 Meng Xu , Philip T. Reiss , Ivor Cribben

Robust optimization has been widely used in nowadays data science, especially in adversarial training. However, little research has been done to quantify how robust optimization changes the optimizers and the prediction losses comparing to…

Machine Learning · Computer Science 2020-10-06 Zhun Deng , Cynthia Dwork , Jialiang Wang , Linjun Zhang

Machine unlearning (MU) aims to remove the influence of specific data from trained models, addressing privacy concerns and ensuring compliance with regulations such as the ``right to be forgotten.'' Evaluating strong unlearning, where the…

Machine Learning · Computer Science 2025-11-13 Dongjae Jeon , Wonje Jeung , Taeheon Kim , Albert No , Jonghyun Choi

This study introduces GCO-HPIF, a general machine-learning-based framework to predict and explain the computational hardness of combinatorial optimization problems that can be represented on graphs. The framework consists of two stages. In…

Machine Learning · Computer Science 2025-12-25 Bharat Sharman , Elkafi Hassini

This paper presents a general framework for obtaining interpretable multivariate discriminative models that allow efficient statistical inference for neuroimage analysis. The framework, termed generative discriminative machine (GDM),…

Applications · Statistics 2019-06-04 Erdem Varol , Aristeidis Sotiras , Ke Zeng , Christos Davatzikos

Data Attribution (DA) methods quantify the influence of individual training data points on model outputs and have broad applications such as explainability, data selection, and noisy label identification. However, existing DA methods are…

Machine Learning · Computer Science 2024-10-22 Dan Ley , Suraj Srinivas , Shichang Zhang , Gili Rusak , Himabindu Lakkaraju

Most existing methods that address out-of-distribution (OOD) generalization for node classification on graphs primarily focus on a specific type of data biases, such as label selection bias or structural bias. However, anticipating the type…

Machine Learning · Computer Science 2023-11-07 Guoxin Chen , Yongqing Wang , Fangda Guo , Qinglang Guo , Jiangli Shao , Huawei Shen , Xueqi Cheng

Purpose: Hard-to-interpret Black-box Machine Learning (ML) were often used for early Alzheimer's Disease (AD) detection. Methods: To interpret eXtreme Gradient Boosting (XGBoost), Random Forest (RF), and Support Vector Machine (SVM)…

Machine Learning · Computer Science 2022-11-08 Louise Bloch , Christoph M. Friedrich

This paper studies high-dimensional regression with two-way structured data. To estimate the high-dimensional coefficient vector, we propose the generalized matrix decomposition regression (GMDR) to efficiently leverage any auxiliary…

Methodology · Statistics 2023-02-17 Yue Wang , Ali Shojaie , Timothy W. Randolph , Parker Knight , Jing Ma

Building a sustainable burn platform in inertial confinement fusion (ICF) requires an understanding of the complex coupling of physical processes and the effects that key experimental design changes have on implosion performance. While…