English
Related papers

Related papers: Aggregated Sure Independence Screening for Variabl…

200 papers

Illumination effects cause problems for many computer vision algorithms. We present a user-friendly interactive system for robust illumination-invariant image generation. Compared with the previous automated illumination-invariant image…

Computer Vision and Pattern Recognition · Computer Science 2016-07-21 Han Gong , Graham Finlayson

Intelligent test requires efficient and effective analysis of high-dimensional data in a large scale. Traditionally, the analysis is often conducted by human experts, but it is not scalable in the era of big data. To tackle this challenge,…

Machine Learning · Computer Science 2022-07-04 Yiwen Liao , Tianjie Ge , Raphaël Latty , Bin Yang

Due to the privacy protection or the difficulty of data collection, we cannot observe individual outputs for each instance, but we can observe aggregated outputs that are summed over multiple instances in a set in some real-world…

Machine Learning · Statistics 2022-10-05 Tomoharu Iwata

Variable selection is a procedure to attain the truly important predictors from inputs. Complex nonlinear dependencies and strong coupling pose great challenges for variable selection in high-dimensional data. In addition, real-world…

Methodology · Statistics 2023-07-04 Keyao Wang , Huiwen Wang , Jichang Zhao , Lihong Wang

Variable selection for optimal treatment regime in a clinical trial or an observational study is getting more attention. Most existing variable selection techniques focused on selecting variables that are important for prediction, therefore…

Methodology · Statistics 2014-05-22 Ailin Fan , Wenbin Lu , Rui Song

Although there is growing interest in measuring integrated information in computational and cognitive systems, current methods for doing so in practice are computationally unfeasible. Existing and novel integration measures are investigated…

Neurons and Cognition · Quantitative Biology 2017-02-08 Max Tegmark

We present a robust framework with computational algorithms to support decision makers in sequential games. Our framework includes methods to solve games with complete information, assess the robustness of such solutions and, finally,…

Computation · Statistics 2024-02-22 Tahir Ekin , Roi Naveiro , Alberto Torres-Barrán , David Ríos-Insua

With rapid advances in information technology, massive datasets are collected in all fields of science, such as biology, chemistry, and social science. Useful or meaningful information is extracted from these data often through statistical…

Methodology · Statistics 2021-09-22 Wenxuan Zhong , Yiwen Liu , Peng Zeng

In recent years, Ising prior with the network information for the "in" or "out" binary random variable in Bayesian variable selections has received more and more attentions. In this paper, we discover that even without the informative prior…

Methodology · Statistics 2012-06-14 Zaili Fang , Inyoung Kim

In this paper, we consider estimating sparse inverse covariance of a Gaussian graphical model whose conditional independence is assumed to be partially known. Similarly as in [5], we formulate it as an $l_1$-norm penalized maximum…

Methodology · Statistics 2009-04-07 Zhaosong Lu

It has long been observed that for practically any computational problem that has been intensely studied, different instances are best solved using different algorithms. This is particularly pronounced for computationally hard problems,…

Machine Learning · Computer Science 2018-11-29 Pascal Kerschke , Holger H. Hoos , Frank Neumann , Heike Trautmann

The paper considers variable selection in linear regression models where the number of covariates is possibly much larger than the number of observations. High dimensionality of the data brings in many complications, such as (possibly…

Methodology · Statistics 2016-11-29 Haeran Cho , Piotr Fryzlewicz

Constraint-based causal discovery from limited data is a notoriously difficult challenge due to the many borderline independence test decisions. Several approaches to improve the reliability of the predictions by exploiting redundancy in…

Machine Learning · Computer Science 2017-01-27 Sara Magliacane , Tom Claassen , Joris M. Mooij

Consider $n$ independent and identically distributed $p$-dimensional Gaussian random vectors with covariance matrix $\Sigma.$ The problem of estimating $\Sigma$ when $p$ is much larger than $n$ has received a lot of attention in recent…

Statistics Theory · Mathematics 2016-03-07 Danning Li , Hui Zou

The notion that cooperation can aid a group of agents to solve problems more efficiently than if those agents worked in isolation is prevalent, despite the little quantitative groundwork to support it. Here we consider a primordial form of…

Adaptation and Self-Organizing Systems · Physics 2014-10-22 José F. Fontanari

A structured variable selection problem is considered in which the covariates, divided into predefined groups, activate according to sparse patterns with few nonzero entries per group. Capitalizing on the concept of atomic norm, a composite…

Machine Learning · Computer Science 2023-11-03 David Gregoratti , Xavier Mestre , Carlos Buelga

We propose an iterative variable selection scheme for high-dimensional data with binary outcomes. The scheme adopts a structured screen-and-select framework and uses non-local prior-based Bayesian model selection within the same. The…

Methodology · Statistics 2022-11-08 Nilotpal Sanyal

We study the optimal sample complexity of variable selection in linear regression under general design covariance, and show that subset selection is optimal while under standard complexity assumptions, efficient algorithms for this problem…

Statistics Theory · Mathematics 2025-10-07 Ming Gao , Bryon Aragam

Social choice has become a foundational component of modern machine learning systems. From auctions and resource allocation to the alignment of large generative models, machine learning pipelines increasingly aggregate heterogeneous…

Artificial Intelligence · Computer Science 2026-02-24 Zhiyu An , Wan Du

Estimating causal interactions in complex dynamical systems is an important problem encountered in many fields of current science. While a theoretical solution for detecting the causal interactions has been previously formulated in the…

Data Analysis, Statistics and Probability · Physics 2020-01-20 Jakub Kořenek , Jaroslav Hlinka