English
Related papers

Related papers: Principal Feature Detection via $\Phi$-Sobolev Ine…

200 papers

We develop a flexible feature selection framework based on deep neural networks that approximately controls the false discovery rate (FDR), a measure of Type-I error. The method applies to architectures whose first layer is fully connected.…

Machine Learning · Statistics 2026-02-10 Kazuma Sawaya

Image-based inspection systems have been widely deployed in manufacturing production lines. Due to the scarcity of defective samples, unsupervised anomaly detection that only leverages normal samples during training to detect various…

Image and Video Processing · Electrical Eng. & Systems 2024-11-22 Chengyu Tao , Hao Xu , Juan Du

Parity functions are fundamental Boolean operations with critical applications across machine learning, cryptography, and error correction. Yet, learning high-dimensional parity functions poses significant challenges: in a general setting,…

Machine Learning · Computer Science 2026-05-28 Guillaume Larue , Louis-Adrien Dufrène , Quentin Lampin , Hadi Ghauch , Ghaya Rekaya

The goal of Feature Selection - comprising filter, wrapper, and embedded approaches - is to find the optimal feature subset for designated downstream tasks. Nevertheless, current feature selection methods are limited by: 1) the selection…

Machine Learning · Computer Science 2023-09-18 Meng Xiao , Dongjie Wang , Min Wu , Pengfei Wang , Yuanchun Zhou , Yanjie Fu

Robust parameter estimation is a crucial task in several 3D computer vision pipelines such as Structure from Motion (SfM). State-of-the-art algorithms for robust estimation, however, still suffer from difficulties in converging to…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Huu Le , Christopher Zach

Fully symmetric learning rules for principal component analysis can be derived from a novel objective function suggested in our previous work. We observed that these learning rules suffer from slow convergence for covariance matrices where…

Machine Learning · Statistics 2020-07-21 Ralf Möller

Spectral dimensionality reduction methods enable linear separations of complex data with high-dimensional features in a reduced space. However, these methods do not always give the desired results due to irregularities or uncertainties of…

Machine Learning · Statistics 2018-05-21 Momo Matsuda , Keiichi Morikuni , Tetsuya Sakurai

Most biological data are multidimensional, posing a major challenge to human comprehension and computational analysis. Principal component analysis is the most popular approach to rendering two- or three-dimensional representations of the…

Methodology · Statistics 2016-09-13 Tom M. W. Nye , Xiaoxian Tang , Grady Weyenberg , Ruriko Yoshida

We consider the problem of reducing the dimensions of parameters and data in non-Gaussian Bayesian inference problems. Our goal is to identify an "informed" subspace of the parameters and an "informative" subspace of the data so that a…

Computation · Statistics 2022-07-19 Ricardo Baptista , Youssef Marzouk , Olivier Zahm

This work focuses on mitigating two limitations in the joint learning of local feature detectors and descriptors. First, the ability to estimate the local shape (scale, orientation, etc.) of feature points is often neglected during dense…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Zixin Luo , Lei Zhou , Xuyang Bai , Hongkai Chen , Jiahui Zhang , Yao Yao , Shiwei Li , Tian Fang , Long Quan

Data acquisition, storage and management have been improved, while the key factors of many phenomena are not well known. Consequently, irrelevant and redundant features artificially increase the size of datasets, which complicates learning…

Machine Learning · Statistics 2017-04-05 Jean Golay , Michael Leuenberger , Mikhail Kanevski

Approximate dynamic programming has been used successfully in a large variety of domains, but it relies on a small set of provided approximation features to calculate solutions reliably. Large and rich sets of features can cause existing…

Artificial Intelligence · Computer Science 2015-03-17 Marek Petrik , Gavin Taylor , Ron Parr , Shlomo Zilberstein

Deep neural networks have emerged as powerful tools for learning operators defined over infinite-dimensional function spaces. However, existing theories frequently encounter difficulties related to dimensionality and limited…

Machine Learning · Computer Science 2026-05-12 Jianfei Li , Shuo Huang , Han Feng , Ding-Xuan Zhou , Gitta Kutyniok

We consider the problem of recovering low-rank matrices from random rank-one measurements, which spans numerous applications including covariance sketching, phase retrieval, quantum state tomography, and learning shallow polynomial neural…

Information Theory · Computer Science 2018-12-04 Yuanxin Li , Cong Ma , Yuxin Chen , Yuejie Chi

It is now practically the norm for data to be very high dimensional in areas such as genetics, machine vision, image analysis and many others. When analyzing such data, parametric models are often too inflexible while nonparametric…

Methodology · Statistics 2011-05-31 Abhishek Bhattacharya , Garritt Page , David Dunson

Despite advances in representation learning, high-dimensional classification remains challenging in low-sample-size regimes, where the dominant signal may vary across applications and labeled data are often limited. We propose a…

Methodology · Statistics 2026-05-18 Xiangbo Mo , Hao Chen

Despite a variety of available techniques the issue of the proper regularization parameter choice for inverse problems still remains one of the biggest challenges. The main difficulty lies in constructing a rule, allowing to compute the…

Numerical Analysis · Mathematics 2017-10-13 Ernesto De Vito , Massimo Fornasier , Valeriya Naumova

Accurate approximation of a real-valued function depends on two aspects of the available data: the density of inputs within the domain of interest and the variation of the outputs over that domain. There are few methods for assessing…

Numerical Analysis · Mathematics 2024-11-11 Andrew Gillette , Eugene Kur

In many real-world scenarios where data is high dimensional, test time acquisition of features is a non-trivial task due to costs associated with feature acquisition and evaluating feature value. The need for highly confident models with an…

Machine Learning · Computer Science 2019-09-17 Orpaz Goldstein , Mohammad Kachuee , Kimmo Karkkainen , Majid Sarrafzadeh

Small target detection is inherently challenging due to the minimal size, lack of distinctive features, and the presence of complex backgrounds. Heavy noise further complicates the task by both obscuring and imitating the target appearance.…

Signal Processing · Electrical Eng. & Systems 2025-12-15 Nicholas Bampton , Tian J. Ma , Minh N. Do