English
Related papers

Related papers: Feature Augmentation via Nonparametrics and Select…

200 papers

Many real-world machine learning applications are characterized by a huge number of features, leading to computational and memory issues, as well as the risk of overfitting. Ideally, only relevant and non-redundant features should be…

Machine Learning · Computer Science 2023-06-21 Paolo Bonetti , Alberto Maria Metelli , Marcello Restelli

High-dimensional feature selection is a central problem in a variety of application domains such as machine learning, image analysis, and genomics. In this paper, we propose graph-based tests as a useful basis for feature selection. We…

Methodology · Statistics 2024-08-13 Swarnadip Ghosh , Somabha Mukherjee , Divyansh Agarwal , Yichen He , Mingzhi Song , Xuejiao Pei

We introduce an approach to bias deep generative models, such as GANs and diffusion models, towards generating data with either enhanced fidelity or increased diversity. Our approach involves manipulating the distribution of training and…

Machine Learning · Computer Science 2024-10-07 Shuangqi Li , Chen Liu , Tong Zhang , Hieu Le , Sabine Süsstrunk , Mathieu Salzmann

This paper proposes a novel model-free screening procedure for ultrahigh dimensional data analysis. By utilizing slicing technique which has been successfully ap- plied to continuous variables, we construct a new index called the fused…

Methodology · Statistics 2016-12-28 Yan Xiao-Dong , Xie Jin-Han , Ding Xian-Wen , Wang Zhi-Qiang , Tang Nian-Sheng

Quality control is a crucial activity performed by manufacturing companies to ensure their products conform to the requirements and specifications. The introduction of artificial intelligence models enables to automate the visual quality…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Jože M. Rožanec , Patrik Zajec , Spyros Theodoropoulos , Erik Koehorst , Blaž Fortuna , Dunja Mladenić

The ratio between two probability density functions is an important component of various tasks, including selection bias correction, novelty detection and classification. Recently, several estimators of this ratio have been proposed. Most…

Methodology · Statistics 2014-04-30 Rafael Izbicki , Ann B. Lee , Chad M. Schafer

Unsupervised node representations learnt using contrastive learning-based methods have shown good performance on downstream tasks. However, these methods rely on augmentations that mimic low-pass filters, limiting their performance on tasks…

Machine Learning · Computer Science 2023-12-05 Chanakya Ekbote , Ajinkya Pankaj Deshpande , Arun Iyer , Ramakrishna Bairi , Sundararajan Sellamanickam

Despite consistent advancement in powerful deep learning techniques in recent years, large amounts of training data are still necessary for the models to avoid overfitting. Synthetic datasets using generative adversarial networks (GAN) have…

Sound · Computer Science 2023-04-05 Yunhao Chen , Yunjie Zhu , Zihui Yan , Jianlu Shen , Zhen Ren , Yifan Huang

User-curated item lists, such as video-based playlists on Youtube and book-based lists on Goodreads, have become prevalent for content sharing on online platforms. Item list continuation is proposed to model the overall trend of a list and…

Information Retrieval · Computer Science 2023-04-04 Qijiong Liu , Jieming Zhu , Jiahao Wu , Tiandeng Wu , Zhenhua Dong , Xiao-Ming Wu

Neural additive models (NAMs) enhance the transparency of deep neural networks by handling input features in separate additive sub-networks. However, they lack inherent mechanisms that provide calibrated uncertainties and enable selection…

Machine Learning · Statistics 2024-10-29 Kouroche Bouchiat , Alexander Immer , Hugo Yèche , Gunnar Rätsch , Vincent Fortuin

Supervised training of an automated medical image analysis system often requires a large amount of expert annotations that are hard to collect. Moreover, the proportions of data available across different classes may be highly imbalanced…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Yuan Xue , Jiarong Ye , Rodney Long , Sameer Antani , Zhiyun Xue , Xiaolei Huang

High-dimensional classification has become an increasingly important problem. In this paper we propose a "Multivariate Adaptive Stochastic Search" (MASS) approach which first reduces the dimension of the data space and then applies a…

Applications · Statistics 2010-10-08 Tian Siva Tian , Gareth M. James , Rand R. Wilcox

Functional regression analysis is an established tool for many contemporary scientific applications. Regression problems involving large and complex data sets are ubiquitous, and feature selection is crucial for avoiding overfitting and…

Methodology · Statistics 2024-10-18 Tobia Boschi , Lorenzo Testa , Francesca Chiaromonte , Matthew Reimherr

Deep neural networks have achieved unprecedented success on diverse vision tasks. However, they are vulnerable to adversarial noise that is imperceptible to humans. This phenomenon negatively affects their deployment in real-world…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Jianping Zhang , Jen-tse Huang , Wenxuan Wang , Yichen Li , Weibin Wu , Xiaosen Wang , Yuxin Su , Michael R. Lyu

We study the phenomenon of bias amplification in classifiers, wherein a machine learning model learns to predict classes with a greater disparity than the underlying ground truth. We demonstrate that bias amplification can arise via an…

Machine Learning · Computer Science 2019-10-22 Klas Leino , Emily Black , Matt Fredrikson , Shayak Sen , Anupam Datta

Feature selection is a critical step in data-driven applications, reducing input dimensionality to enhance learning accuracy, computational efficiency, and interpretability. Existing state-of-the-art methods often require post-selection…

Machine Learning · Computer Science 2025-08-18 Pedram Pad , Hadi Hammoud , Mohamad Dia , Nadim Maamari , L. Andrea Dunbar

As a widely-used and practical tool, feature engineering transforms raw data into discriminative features to advance AI model performance. However, existing methods usually apply feature selection and generation separately, failing to…

Machine Learning · Computer Science 2025-05-22 Nanxu Gong , Sixun Dong , Haoyue Bai , Xinyuan Wang , Wangyang Ying , Yanjie Fu

Feature selection, as a critical pre-processing step for machine learning, aims at determining representative predictors from a high-dimensional feature space dataset to improve the prediction accuracy. However, the increase in feature…

Machine Learning · Statistics 2020-11-16 Fatemeh Amini , Guiping Hu

We present a new class of methods for high-dimensional nonparametric regression and classification called sparse additive models (SpAM). Our methods combine ideas from sparse linear modeling and additive nonparametric regression. We derive…

Statistics Theory · Mathematics 2008-04-09 Pradeep Ravikumar , John Lafferty , Han Liu , Larry Wasserman

This paper studies face recognition (FR) and normalization in surveillance imagery. Surveillance FR is a challenging problem that has great values in law enforcement. Despite recent progress in conventional FR, less effort has been devoted…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Xi Yin , Ying Tai , Yuge Huang , Xiaoming Liu