English
Related papers

Related papers: A more efficient method for large-sample model-fre…

200 papers

Feature screening for ultrahigh-dimension, in general, proceeds with two essential steps. The first step is measuring and ranking the marginal dependence between response and covariates, and the second is determining the threshold. We…

Methodology · Statistics 2022-07-28 Linsui Deng , Yilin Zhang

Federated Recommendation Systems (FRS) enable privacy-preserving model training by keeping user data on edge devices. However, the practical deployment of FRS in Edge-Cloud environments faces significant challenges due to system and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-26 Jintao Liu , Mohammad Goudarzi , Adel Nadjaran Toosi

Variable selection in ultra-high dimensional regression problems has become an important issue. In such situations, penalized regression models may face computational problems and some pre screening of the variables may be necessary. A…

Methodology · Statistics 2020-05-01 Abhik Ghosh , Magne Thoresen

The varying-coefficient model is an important nonparametric statistical model that allows us to examine how the effects of covariates vary with exposure variables. When the number of covariates is big, the issue of variable selection…

Statistics Theory · Mathematics 2013-03-05 Jianqing Fan , Yunbei Ma , Wei Dai

Selecting the best large language model (LLM) for a fixed benchmark is often expensive, since exhaustive evaluation requires running every model on every example. Multi-armed bandit (MAB) algorithms can reduce the number of LLM calls by…

Machine Learning · Computer Science 2026-05-12 Elad Tolochinsky , Yaniv Tenzer , Yaniv Romano

Screening methods are useful tools for variable selection in regression analysis when the number of predictors is much larger than the sample size. Factor analysis is used to eliminate multicollinearity among predictors, which improves the…

Methodology · Statistics 2025-10-28 Shuntaro Tanaka , Hidetoshi Matsui

Sharpe Ratio (SR) is a critical parameter in characterizing financial time series as it jointly considers the reward and the volatility of any stock/portfolio through its variance. Deriving online algorithms for optimizing the SR is…

Portfolio Management · Quantitative Finance 2024-06-12 Sabrina Khurshid , Mohammed Shahid Abdulla , Gourab Ghatak

Statistical inference can be computationally prohibitive in ultrahigh-dimensional linear models. Correlation-based variable screening, in which one leverages marginal correlations for removal of irrelevant variables from the model prior to…

Statistics Theory · Mathematics 2020-07-07 Talal Ahmed , Waheed U. Bajwa

Fan and Lv (2008) proposed the path-breaking theory of sure independence screening (SIS) and an iterative algorithm (ISIS) to effectively reduce the predictor dimension for further variable selection approaches. Fan et al. (2009) extended…

Statistics Theory · Mathematics 2019-11-19 Ning Zhang , Wenxin Jiang , Yuting Lan

Consider a requester who wishes to crowdsource a series of identical binary labeling tasks to a pool of workers so as to achieve an assured accuracy for each task, in a cost optimal way. The workers are heterogeneous with unknown but fixed…

Computer Science and Game Theory · Computer Science 2015-06-18 Shweta Jain , Sujit Gujar , Satyanath Bhat , Onno Zoeter , Y. Narahari

Approximate Bayesian computation is an established and popular method for likelihood-free inference with applications in many disciplines. The effectiveness of the method depends critically on the availability of well performing summary…

Machine Learning · Statistics 2018-05-23 Prashant Singh , Andreas Hellander

Herein, we propose a Spearman rank correlation based screening procedure for ultrahigh-dimensional data with censored response case. The proposed method is model-free without specifying any regression forms of predictors or response…

Methodology · Statistics 2022-11-28 Hongni Wang , Jingxin Yan , Xiaodong Yan

Variable selection is a widely studied problem in high dimensional statistics, primarily since estimating the precise relationship between the covariates and the response is of great importance in many scientific disciplines. However, most…

Methodology · Statistics 2018-03-12 Kashif Yousuf

Data cleansing aims to improve model performance by removing a set of harmful instances from the training dataset. Data Shapley is a common theoretically guaranteed method to evaluate the contribution of each instance to model performance;…

Machine Learning · Computer Science 2024-02-14 Hiroyuki Namba , Shota Horiguchi , Masaki Hamamoto , Masashi Egi

In data sets with many more features than observations, independent screening based on all univariate regression models leads to a computationally convenient variable selection method. Recent efforts have shown that in the case of…

Machine Learning · Statistics 2011-08-12 Anders Gorst-Rasmussen , Thomas H. Scheike

Constraint-based causal discovery (CCD) algorithms require fast and accurate conditional independence (CI) testing. The Kernel Conditional Independence Test (KCIT) is currently one of the most popular CI tests in the non-parametric setting,…

Methodology · Statistics 2017-04-14 Eric V. Strobl , Kun Zhang , Shyam Visweswaran

Existing frameworks for evaluating and comparing generative models consider an offline setting, where the evaluator has access to large batches of data produced by the models. However, in practical scenarios, the goal is often to identify…

Machine Learning · Computer Science 2025-03-12 Xiaoyan Hu , Ho-fung Leung , Farzan Farnia

We present a novel approach to address the multi-agent sparse contextual linear bandit problem, in which the feature vectors have a high dimension $d$ whereas the reward function depends on only a limited set of features - precisely $s_0…

Machine Learning · Computer Science 2023-05-31 Haniyeh Barghi , Xiaotong Cheng , Setareh Maghsudi

We propose a flexible nonparametric regression method for ultrahigh-dimensional data. As a first step, we propose a fast screening method based on the favored smoothing bandwidth of the marginal local constant regression. Then, an iterative…

Methodology · Statistics 2018-07-30 Yang Feng , Yichao Wu , Leonard Stefanski

Data mining algorithms are increasingly used in automated decision making across all walks of daily life. Unfortunately, as reported in several studies these algorithms inject bias from data and environment leading to inequitable and unfair…

Machine Learning · Computer Science 2020-11-16 Qian Hu , Huzefa Rangwala