English
Related papers

Related papers: A robust variable screening procedure for ultra-hi…

200 papers

Sliced inverse regression (SIR, Li 1991) is a pioneering work and the most recognized method in sufficient dimension reduction. While promising progress has been made in theory and methods of high-dimensional SIR, two remaining challenges…

Methodology · Statistics 2023-04-14 Qing Mai , Xiaofeng Shao , Runmin Wang , Xin Zhang

We consider the problem of high-dimensional non-linear variable selection for supervised learning. Our approach is based on performing linear selection among exponentially many appropriately defined positive definite kernels that…

Machine Learning · Computer Science 2009-09-08 Francis Bach

Forward regression is a classical and effective tool for variable screening in ultra-high dimensional linear models, but its standard projection-based implementation can be computationally costly and numerically unstable when predictors are…

Methodology · Statistics 2026-03-20 Jialuo Chen , Zhaoxing Gao , Yifan Jiang , Ruey S. Tsay

An exploit of the Sequential Importance Sampling (SIS) algorithm using Differential Algebra (DA) techniques is derived to develop an efficient particle filter. The filter creates an original kind of particles, called scout particles, that…

Information Theory · Computer Science 2024-08-21 Simone Servadio

Variable selection in ultrahigh-dimensional linear regression is challenging due to its high computational cost. Therefore, a screening step is usually conducted before variable selection to significantly reduce the dimension. Here we…

Methodology · Statistics 2025-04-29 Run Wang , An Nguyen , Somak Dutta , Vivekananda Roy

Misalignment angle will result in a considerable error for the integration of Doppler Velocity Log (DVL) and of Strapdown Inertial Navigation System (SINS). In this paper, a robust initial alignment method for SINS/DVL is proposed to solve…

Signal Processing · Electrical Eng. & Systems 2020-02-19 Xiang Xu , Jing Gui , Yifan Sun , Yiqing Yao , Tao Zhang

We propose a cautious Bayesian variable selection routine by investigating the sensitivity of a hierarchical model, where the regression coefficients are specified by spike and slab priors. We exploit the use of latent variables to…

Methodology · Statistics 2022-06-20 Tathagata Basu , Matthias C. M. Troffaes , Jochen Einbeck

Due to the size and nature of intrusion detection datasets, intrusion detection systems (IDS) typically take high computational complexity to examine features of data and identify intrusive patterns. Data preprocessing techniques such as…

Cryptography and Security · Computer Science 2020-09-29 Mubarak Albarka Umar , Chen Zhanfang , Yan Liu

Background. Fully automatic analysis of myocardial perfusion MRI datasets enables rapid and objective reporting of stress/rest studies in patients with suspected ischemic heart disease. Developing deep learning techniques that can analyze…

Modern neural networks are known to give overconfident prediction for out-of-distribution inputs when deployed in the open world. It is common practice to leverage a surrogate outlier dataset to regularize the model during training, and…

Machine Learning · Computer Science 2024-02-27 Wenyu Jiang , Hao Cheng , Mingcai Chen , Chongjun Wang , Hongxin Wei

Past few years have witnessed a growing recognition of intelligent techniques for the construction of efficient and reliable intrusion detection systems. Due to increasing incidents of cyber attacks, building effective intrusion detection…

Artificial Intelligence · Computer Science 2007-05-23 Srinivas Mukkamala , Andrew H. Sung , Ajith Abraham , Vitorino Ramos

Machine learning methods are used to discover complex nonlinear relationships in biological and medical data. However, sophisticated learning models are computationally unfeasible for data with millions of features. Here we introduce the…

Multi-Instance Learning (MIL) has shown impressive performance for histopathology whole slide image (WSI) analysis using bags or pseudo-bags. It involves instance sampling, feature representation, and decision-making. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Tingting Zheng , Kui Jiang , Hongxun Yao

Challenges with data in the big-data era include (i) the dimension $p$ is often larger than the sample size $n$ (ii) outliers or contaminated points are frequently hidden and more difficult to detect. Challenge (i) renders most conventional…

Machine Learning · Statistics 2023-09-06 Yijun Zuo

High dimension low sample size statistical analysis is important in a wide range of applications. In such situations, the highly appealing discrimination method, support vector machine, can be improved to alleviate data piling at the…

Optimization and Control · Mathematics 2017-08-18 Xin Yee Lam , J. S. Marron , Defeng Sun , Kim-Chuan Toh

Ensuring safety of nonlinear systems under model uncertainty and external disturbances is crucial, especially for real-world control tasks. Predictive methods such as robust model predictive control (RMPC) require solving nonconvex…

Systems and Control · Electrical Eng. & Systems 2023-11-14 Zeyang Li , Chuxiong Hu , Weiye Zhao , Changliu Liu

Investigating molecular heterogeneity provides insights about tumor origin and metabolomics. The increasing amount of data gathered makes manual analyses infeasible - therefore, automated unsupervised learning approaches are utilized for…

Quantitative Methods · Quantitative Biology 2023-01-19 Grzegorz Mrukwa , Joanna Polanska

Efficiently managing and utilizing large-scale medical imaging datasets with limited resources presents significant challenges. While coreset selection helps reduce computational costs, its effectiveness in medical data remains limited due…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Yan Liang , Ziyuan Yang , Zhuxin Lei , Mengyu Sun , Yingyu Chen , Yi Zhang

This paper proposes a new robust smooth-threshold estimating equation to select important variables and automatically estimate parameters for high dimensional longitudinal data. A novel working correlation matrix is proposed to capture…

Methodology · Statistics 2021-11-30 Liya Fu , Jiaqi Li , You-Gan Wang

High-dimensional data poses unique challenges in outlier detection process. Most of the existing algorithms fail to properly address the issues stemming from a large number of features. In particular, outlier detection algorithms perform…

Machine Learning · Computer Science 2020-09-22 Firuz Kamalov , Ho Hon Leung