中文
相关论文

相关论文: Asymptotically Optimal Knockoff Statistics via the…

200 篇论文

In this paper, we demonstrate a surprising capability of large language models (LLMs): given only input feature names and a description of a prediction task, they are capable of selecting the most predictive features, with performance…

机器学习 · 计算机科学 2025-04-21 Daniel P. Jeong , Zachary C. Lipton , Pradeep Ravikumar

Recent advancements in Mixed Integer Optimization (MIO) algorithms, paired with hardware enhancements, have led to significant speedups in resolving MIO problems. These strategies have been utilized for optimal subset selection,…

统计方法学 · 统计学 2024-03-27 Madhav Sankaranarayanan , Intekhab Hossain , Tom Chen

A common strategy for sparse linear regression is to introduce regularization, which eliminates irrelevant features by letting the corresponding weights be zeros. However, regularization often shrinks the estimator for relevant features,…

机器学习 · 统计学 2015-10-07 Yohei Kondo , Kohei Hayashi , Shin-ichi Maeda

This paper investigates, from information theoretic grounds, a learning problem based on the principle that any regularity in a given dataset can be exploited to extract compact features from data, i.e., using fewer bits than needed to…

机器学习 · 统计学 2018-11-14 Matías Vera , Leonardo Rey Vega , Pablo Piantanida

Ranking and comparing items is crucial for collecting information about preferences in many areas, from marketing to politics. The Mallows rank model is among the most successful approaches to analyse rank data, but its computational…

统计方法学 · 统计学 2017-04-28 Valeria Vitelli , Øystein Sørensen , Marta Crispino , Arnoldo Frigessi , Elja Arjas

One popular method for dealing with large-scale data sets is sampling. For example, by using the empirical statistical leverage scores as an importance sampling distribution, the method of algorithmic leveraging samples and rescales…

统计方法学 · 统计学 2013-06-25 Ping Ma , Michael W. Mahoney , Bin Yu

Feature selection is crucial for pinpointing relevant features in high-dimensional datasets, mitigating the 'curse of dimensionality,' and enhancing machine learning performance. Traditional feature selection methods for classification use…

机器学习 · 计算机科学 2025-04-08 Rittwika Kansabanik , Adrian Barbu

This paper targets the efficient construction of a safety shield for decision making in scenarios that incorporate uncertainty. Markov decision processes (MDPs) are prominent models to capture such planning problems. Reinforcement learning…

人工智能 · 计算机科学 2019-11-26 Nils Jansen , Bettina Könighofer , Sebastian Junges , Alexandru C. Serban , Roderick Bloem

Feature selection plays a crucial role in improving predictive accuracy by identifying relevant features while filtering out irrelevant ones. This study investigates the importance of effective feature selection in enhancing the performance…

机器学习 · 计算机科学 2024-03-12 Younes Ghazagh Jahed , Seyyed Ali Sadat Tavana

In this article, we propose a novel strategy for conducting variable selection without prior model topology knowledge using the knockoff method with boosted tree models. Our method is inspired by the original knockoff method, where the…

统计方法学 · 统计学 2020-02-24 Tao Jiang , Yuanyuan Li , Alison A. Motsinger-Reif

The change-plane Cox model is a popular tool for the subgroup analysis of survival data. Despite the rich literature on this model, there has been limited investigation into the asymptotic properties of the estimators of the…

统计理论 · 数学 2023-02-14 Shota Takeishi

The false discovery rate (FDR)---the expected fraction of spurious discoveries among all the discoveries---provides a popular statistical assessment of the reproducibility of scientific studies in various disciplines. In this work, we…

机器学习 · 统计学 2015-11-10 Weijie Su , Junyang Qian , Linxi Liu

We present a novel method for controlling the $k$-familywise error rate ($k$-FWER) in the linear regression setting using the knockoffs framework first introduced by Barber and Cand\`es. Our procedure, which we also refer to as knockoffs,…

统计方法学 · 统计学 2015-11-10 Lucas Janson , Weijie Su

Factor analysis, a classical multivariate statistical technique is popularly used as a fundamental tool for dimensionality reduction in statistics, econometrics and data science. Estimation is often carried out via the Maximum Likelihood…

最优化与控制 · 数学 2018-01-19 Koulik Khamaru , Rahul Mazumder

Leading methods for support recovery in high-dimensional regression, such as Lasso, have been well-studied and their limitations in the context of correlated design have been characterized with precise incoherence conditions. In this work,…

统计理论 · 数学 2019-03-25 S. Jalil Kazemitabar , Arash A. Amini , Ameet Talwalkar

Dynamic real-time optimization (DRTO) is a challenging task due to the fact that optimal operating conditions must be computed in real time. The main bottleneck in the industrial application of DRTO is the presence of uncertainty. Many…

The arrival of AI techniques in computations, with the potential for hallucinations and non-robustness, has made trustworthiness of algorithms a focal point. However, trustworthiness of the many classical approaches are not well understood.…

最优化与控制 · 数学 2023-12-19 Alexander Bastounis , Felipe Cucker , Anders C. Hansen

We propose a new approach for sparse regression and marginal testing, for data with correlated features. Our procedure first clusters the features, and then chooses as the cluster prototype the most informative feature in that cluster. Then…

统计方法学 · 统计学 2015-03-16 Stephen Reid , Robert Tibshirani

Identifying truly predictive covariates while strictly controlling false discoveries remains a fundamental challenge in nonlinear, highly correlated, and low signal-to-noise regimes, where deep learning based feature selection methods are…

机器学习 · 计算机科学 2026-02-03 Bob Junyi Zou , Lu Tian

We propose a feature screening method that integrates both feature-feature and feature-target relationships. Inactive features are identified via a penalized minimum Redundancy Maximum Relevance (mRMR) procedure, which is the continuous…

机器学习 · 统计学 2025-08-27 Peter Naylor , Benjamin Poignard , Héctor Climente-González , Makoto Yamada