English
Related papers

Related papers: Factor selection in screening experiments by aggre…

200 papers

Existing manual labeling of micro-expressions is subject to errors in accuracy, especially in cross-cultural scenarios where deviation in labeling of key frames is more prominent. To address this issue, this paper presents a novel Global…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Feng Liu , Bingyu Nan , Xuezhong Qian , Xiaolan Fu

Feature selection is important for high-dimensional data analysis and is non-trivial in unsupervised learning problems such as dimensionality reduction and clustering. The goal of unsupervised feature selection is finding a subset of…

Machine Learning · Computer Science 2024-11-26 Ziheng Sun , Chris Ding , Jicong Fan

Factor analysis and principal component analysis (PCA) are used in many application areas. The first step, choosing the number of components, remains a serious challenge. Our work proposes improved methods for this important problem. One of…

Methodology · Statistics 2019-09-17 Edgar Dobriban , Art B. Owen

Learning energy-based models (EBMs) is known to be difficult especially on discrete data where gradient-based learning strategies cannot be applied directly. Although ratio matching is a sound method to learn discrete EBMs, it suffers from…

Machine Learning · Computer Science 2023-02-28 Meng Liu , Haoran Liu , Shuiwang Ji

Unsupervised feature selection is an important method to reduce dimensions of high dimensional data without labels, which is benefit to avoid ``curse of dimensionality'' and improve the performance of subsequent machine learning tasks, like…

Machine Learning · Computer Science 2020-12-29 Yanyong Huang , Zongxin Shen , Fuxu Cai , Tianrui Li , Fengmao Lv

High-dimensional variable selection, with many more covariates than observations, is widely documented in standard regression models, but there are still few tools to address it in non-linear mixed-effects models where data are collected…

Statistics Theory · Mathematics 2024-04-08 Marion Naveau , Guillaume Kon Kam King , Renaud Rincent , Laure Sansonnet , Maud Delattre

We propose a method based on the Wang-Landau algorithm to numerically generate the spectral densities of random matrix ensembles. The method employs Dyson's log-gas formalism for random matrix eigenvalues and also enables one to…

Statistical Mechanics · Physics 2013-01-28 Santosh Kumar

The problem of selecting a handful of truly relevant variables in supervised machine learning algorithms is a challenging problem in terms of untestable assumptions that must hold and unavailability of theoretical assurances that selection…

Methodology · Statistics 2023-11-10 Mehdi Rostami , Olli Saarela

Importance sampling is a Monte Carlo technique for efficiently estimating the likelihood of rare events by biasing the sampling distribution towards the rare event of interest. By drawing weighted samples from a learned proposal…

Machine Learning · Statistics 2025-05-20 Liam A. Kruse , Marc R. Schlichting , Mykel J. Kochenderfer

We propose a method for detecting significant interactions in very large multivariate spatial point patterns. This methodology develops high dimensional data understanding in the point process setting. The method is based on modelling the…

Methodology · Statistics 2017-10-25 Tuomas Rajala , David Murrell , Sofia Olhede

High-dimensional data is commonly encountered in numerous data analysis tasks. Feature selection techniques aim to identify the most representative features from the original high-dimensional data. Due to the absence of class label…

Machine Learning · Computer Science 2024-10-29 Yunhui Liang , Jianwen Gan , Yan Chen , Peng Zhou , Liang Du

We consider the problem of clustering data points in high dimensions, i.e. when the number of data points may be much smaller than the number of dimensions. Specifically, we consider a Gaussian mixture model (GMM) with non-spherical…

Statistics Theory · Mathematics 2014-06-10 Martin Azizyan , Aarti Singh , Larry Wasserman

Thul et al. (2020) called attention to problems that arise when chronometric experiments implementing specific factorial designs are analysed with the generalized additive mixed model (GAMM), using factor smooths to capture trial-to-trial…

Methodology · Statistics 2021-11-19 R. Harald Baayen , Matteo Fasiolo , Simon Wood , Yu-Ying Chuang

Advances in data collecting technologies in genomics have significantly increased the need for tools designed to study the genetic basis of many diseases. Effective statistical methods should excel in both prediction accuracy and biomarker…

Methodology · Statistics 2025-11-13 Anthony-Alexander Christidis , Stefan Van Aelst , Ruben Zamar

In this paper we address the problem of building a class of robust factorization algorithms that solve for the shape and motion parameters with both affine (weak perspective) and perspective camera models. We introduce a Gaussian/uniform…

Computer Vision and Pattern Recognition · Computer Science 2020-12-16 Andrei Zaharescu , Radu Horaud

Unsupervised anomaly detection aims to identify anomalous samples from highly complex and unstructured data, which is pervasive in both fundamental research and industrial applications. However, most existing methods neglect the complex…

Machine Learning · Computer Science 2020-10-20 Haoyi Fan , Fengbin Zhang , Ruidong Wang , Liang Xi , Zuoyong Li

A feature selection algorithm should ideally satisfy four conditions: reliably extract relevant features; be able to identify non-linear feature interactions; scale linearly with the number of features and dimensions; allow the…

Machine Learning · Computer Science 2019-01-15 Zhixiang Eddie Xu , Gao Huang , Kilian Q. Weinberger , Alice X. Zheng

Similar to variable selection in the linear regression model, selecting significant components in the popular additive regression model is of great interest. However, such components are unknown smooth functions of independent variables,…

Methodology · Statistics 2011-01-04 Xia Cui , Heng Peng , Songqiao Wen , Lixing Zhu

Large Language Models (LLMs) have shown remarkable capabilities across tasks, yet they often require additional prompting techniques when facing complex problems. While approaches like self-correction and response selection have emerged as…

Computation and Language · Computer Science 2025-04-15 Zichong Li , Xinyu Feng , Yuheng Cai , Zixuan Zhang , Tianyi Liu , Chen Liang , Weizhu Chen , Haoyu Wang , Tuo Zhao

Large-dimensional factor model has drawn much attention in the big-data era, in order to reduce the dimensionality and extract underlying features using a few latent common factors. Conventional methods for estimating the factor model…

Methodology · Statistics 2020-06-02 Yong He , Xinbing Kong , Long Yu , Xinsheng Zhang