English
Related papers

Related papers: Robust Ultra-High-Dimensional Variable Selection W…

200 papers

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

Optimization and Control · Mathematics 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone

In recent years, deep neural network (DNN) compression systems have proved to be highly effective for designing source codes for many natural sources. However, like many other machine learning systems, these compressors suffer from…

Machine Learning · Computer Science 2021-10-15 Eric Lei , Hamed Hassani , Shirin Saeedi Bidokhti

We introduce an efficient and robust auto-tuning framework for hyperparameter selection in dimension reduction (DR) algorithms, focusing on large-scale datasets and arbitrary performance metrics. By leveraging Bayesian optimization (BO)…

Machine Learning · Statistics 2023-06-02 Yin-Ting Liao , Hengrui Luo , Anna Ma

This paper proposes a novel meta-learning approach to optimize a robust portfolio ensemble. The method uses a deep generative model to generate diverse and high-quality sub-portfolios combined to form the ensemble portfolio. The generative…

Neural and Evolutionary Computing · Computer Science 2023-07-18 Kamer Ali Yuksel

In developing data-driven modeling methodologies, there is an ongoing need to reconcile the strong predictive performance of opaque black-box models with the transparency required for critical applications. This work introduces an…

Machine Learning · Statistics 2026-05-21 Xin Huang , Jia Li , Jun Yu

Modern network data analysis often involves analyzing network structures alongside covariate features to gain deeper insights into underlying patterns. However, traditional covariate-assisted statistical network models may not adequately…

Methodology · Statistics 2025-05-07 Peng Zhao , Yabo Niu

Gene expression data represents a unique challenge in predictive model building, because of the small number of samples $(n)$ compared to the huge amount of features $(p)$. This "$n<<p$" property has hampered application of deep learning…

Machine Learning · Statistics 2018-02-13 Yunchuan Kong , Tianwei Yu

Deep Learning has a hierarchical network architecture to represent the complicated feature of input patterns. The adaptive structural learning method of Deep Belief Network (DBN) has been developed. The method can discover an optimal number…

Neural and Evolutionary Computing · Computer Science 2018-08-28 Shin Kamada , Takumi Ichimura , Toshihide Harada

Motivation: Gene selection has become a common task in most gene expression studies. The objective of such research is often to identify the smallest possible set of genes that can still achieve good predictive performance. The problem of…

Dynamic feature selection (DFS) is a machine learning framework in which features are acquired sequentially for individual samples under budget constraints. The exponential growth in the number of possible feature acquisition paths forces a…

Machine Learning · Computer Science 2026-05-13 Javier Fumanal-Idocin , Raquel Fernandez-Peralta , Javier Andreu-Perez

The recent proliferation of high-dimensional data, such as electronic health records and genetics data, offers new opportunities to find novel predictors of outcomes. Presented with a large set of candidate features, interest often lies in…

Methodology · Statistics 2024-09-24 Michael J. Martens , Anjishnu Banerjee , Xinran Qi , Yushu Shi

Evolutionary computation methods have been successfully applied to neural networks since two decades ago, while those methods cannot scale well to the modern deep neural networks due to the complicated architectures and large quantities of…

Neural and Evolutionary Computing · Computer Science 2019-03-12 Yanan Sun , Bing Xue , Mengjie Zhang , Gary G. Yen

Community detection, which focuses on clustering vertex interactions, plays a significant role in network analysis. However, it also faces numerous challenges like missing data and adversarial attack. How to further improve the performance…

Social and Information Networks · Computer Science 2021-07-02 Jiajun Zhou , Zhi Chen , Min Du , Lihong Chen , Shanqing Yu , Guanrong Chen , Qi Xuan

Background and objective Risk prediction models aim at identifying people at higher risk of developing a target disease. Feature selection is particularly important to improve the prediction model performance avoiding overfitting and to…

Machine Learning · Computer Science 2024-02-09 N. Cueto-López , M. T. García-Ordás , V. Dávila-Batista , V. Moreno , N. Aragonés , R. Alaiz-Rodríguez

Deep Learning is considered to be a quite young in the area of machine learning research, found its effectiveness in dealing complex yet high dimensional dataset that includes but limited to images, text and speech etc. with multiple levels…

Computer Vision and Pattern Recognition · Computer Science 2016-10-19 Mrutyunjaya Panda

We propose a compressive classification framework for settings where the data dimensionality is significantly higher than the sample size. The proposed method, referred to as compressive regularized discriminant analysis (CRDA) is based on…

Machine Learning · Statistics 2020-11-13 Muhammad Naveed Tabassum , Esa Ollila

Extreme learning machine (ELM) as an emerging branch of shallow networks has shown its excellent generalization and fast learning speed. However, for blended data, the robustness of ELM is weak because its weights and biases of hidden nodes…

Machine Learning · Computer Science 2014-09-24 Bo Han , Bo He , Mengmeng Ma , Tingting Sun , Tianhong Yan , Amaury Lendasse

Many statistical machine approaches could ultimately highlight novel features of the etiology of complex diseases by analyzing multi-omics data. However, they are sensitive to some deviations in distribution when the observed samples are…

Machine Learning · Statistics 2022-01-14 Md Ashad Alam , Hui Shen , Hong-Wen Deng

Deep convolutional neural network (CNN) based models are vulnerable to the adversarial attacks. One of the possible reasons is that the embedding space of CNN based model is sparse, resulting in a large space for the generation of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Haozhe Liu , Haoqin Ji , Yuexiang Li , Nanjun He , Haoqian Wu , Feng Liu , Linlin Shen , Yefeng Zheng

DBSCAN, a well-known density-based clustering algorithm, has gained widespread popularity and usage due to its effectiveness in identifying clusters of arbitrary shapes and handling noisy data. However, it encounters challenges in producing…

Machine Learning · Computer Science 2025-05-09 Hao Peng , Xiang Huang , Shuo Sun , Ruitong Zhang , Philip S. Yu