English
Related papers

Related papers: Assessing high-order effects in feature importance…

200 papers

Fitting statistical models is computationally challenging when the sample size or the dimension of the dataset is huge. An attractive approach for down-scaling the problem size is to first partition the dataset into subsets and then fit…

Methodology · Statistics 2016-02-15 Xiangyu Wang , David Dunson , Chenlei Leng

Efficient solving of an unseen optimization problem is related to appropriate selection of an optimization algorithm and its hyper-parameters. For this purpose, automated algorithm performance prediction should be performed that in most…

Neural and Evolutionary Computing · Computer Science 2021-10-25 Risto Trajanov , Stefan Dimeski , Martin Popovski , Peter Korošec , Tome Eftimov

Independent component analysis (ICA) is a powerful computational tool for separating independent source signals from their linear mixtures. ICA has been widely applied in neuroimaging studies to identify and characterize underlying brain…

Applications · Statistics 2015-05-01 Ran Shi , Ying Guo

In importance sampling (IS)-based reinforcement learning algorithms such as Proximal Policy Optimization (PPO), IS weights are typically clipped to avoid large variance in learning. However, policy update from clipped statistics induces…

Machine Learning · Computer Science 2019-05-30 Seungyul Han , Youngchul Sung

Top-N recommendation is a challenging problem because complex and sparse user-item interactions should be adequately addressed to achieve high-quality recommendation results. The local latent factor approach has been successfully used with…

Information Retrieval · Computer Science 2021-03-31 Minjin Choi , Yoonki Jeong , Joonseok Lee , Jongwuk Lee

In many studies, we want to determine the influence of certain features on a dependent variable. More specifically, we are interested in the strength of the influence -- i.e., is the feature relevant? -- and, if so, how the feature…

Machine Learning · Statistics 2023-03-03 Yannick Gerstorfer , Lena Krieg , Max Hahn-Klimroth

A trend in all scientific disciplines, based on advances in technology, is the increasing availability of high dimensional data in which are buried important information. A current urgent challenge to statisticians is to develop effective…

Applications · Statistics 2010-09-30 Herman Chernoff , Shaw-Hwa Lo , Tian Zheng

The LETOR website contains three information retrieval datasets used as a benchmark for testing machine learning ideas for ranking. Algorithms participating in the challenge are required to assign score values to search results for a…

Information Retrieval · Computer Science 2008-10-16 Nir Ailon

Higher-order brain connectivity (HOBC), which captures interactions among three or more brain regions, provides richer organizational information than traditional pairwise functional connectivity (FC). Recent studies have begun to infer…

Neurons and Cognition · Quantitative Biology 2025-12-30 Weibin Li , Wendu Li , Quanying Liu

Supervised operator learning is an emerging machine learning paradigm with applications to modeling the evolution of spatio-temporal dynamical systems and approximating general black-box relationships between functional data. We propose a…

Collaborative filtering is a very useful general technique for exploiting the preference patterns of a group of users to predict the utility of items to a particular user. Previous research has studied several probabilistic graphic models…

Information Retrieval · Computer Science 2012-12-12 Rong Jin , Luo Si , ChengXiang Zhai

We introduce a novel framework for decomposing interventional causal effects into synergistic, redundant, and unique components, building on the intuition of Partial Information Decomposition (PID) and the principle of M\"obius inversion.…

Artificial Intelligence · Computer Science 2025-09-22 Abel Jansma

Cook's distance [Technometrics 19 (1977) 15-18] is one of the most important diagnostic tools for detecting influential individual or subsets of observations in linear regression for cross-sectional data. However, for many complex data…

Methodology · Statistics 2012-06-08 Hongtu Zhu , Joseph G. Ibrahim , Hyunsoon Cho

The rapid development of large language model (LLM) alignment algorithms has resulted in a complex and fragmented landscape, with limited clarity on the effectiveness of different methods and their inter-connections. This paper introduces…

We introduce a new principle for model selection in regression and classification. Many regression models are controlled by some smoothness or flexibility or complexity parameter c, e.g. the number of neighbors to be averaged over in k…

Statistics Theory · Mathematics 2007-06-25 Marcus Hutter

Nowadays, feature selection is frequently used in machine learning when there is a risk of performance degradation due to overfitting or when computational resources are limited. During the feature selection process, the subset of features…

Machine Learning · Computer Science 2023-01-02 Sergey A. Saltykov

We introduce an analytical framework to quantify the changes in a machine learning algorithm's output distribution following the inclusion of a few data points in its training set, a notion we define as leave-one-out distinguishability…

Machine Learning · Computer Science 2024-04-18 Jiayuan Ye , Anastasia Borovykh , Soufiane Hayou , Reza Shokri

Modern datasets often contain large subsets of correlated features and nuisance features, which are not or loosely related to the main underlying structures of the data. Nuisance features can be identified using the Laplacian score…

Machine Learning · Statistics 2021-10-12 Uri Shaham , Ofir Lindenbaum , Jonathan Svirsky , Yuval Kluger

It is useful to estimate the expected predictive performance of models planned to be used for prediction. We focus on leave-one-out cross-validation (LOO-CV), which has become a popular method for estimating predictive performance of…

Methodology · Statistics 2025-10-29 Tuomas Sivula , Måns Magnusson , Asael Alonzo Matamoros , Aki Vehtari

Fine-tuning large language models (LLMs) on chain-of-thought (CoT) data shows that a small amount of high-quality data can outperform massive datasets. Yet, what constitutes "quality" remains ill-defined. Existing reasoning methods rely on…

Machine Learning · Computer Science 2025-12-02 Prateek Humane , Paolo Cudrano , Daniel Z. Kaplan , Matteo Matteucci , Supriyo Chakraborty , Irina Rish