English
Related papers

Related papers: Deep Variational Sufficient Dimensionality Reducti…

200 papers

Dynamic Mode Decomposition (DMD) has emerged as a powerful tool for analyzing the dynamics of non-linear systems from experimental datasets. Recently, several attempts have extended DMD to the context of low-rank approximations. This…

Machine Learning · Statistics 2018-05-18 Patrick Héas , Cédric Herzet

Anomaly detection algorithms find extensive use in various fields. This area of research has recently made great advances thanks to deep learning. A recent method, the deep Support Vector Data Description (deep SVDD), which is inspired by…

Machine Learning · Computer Science 2021-01-20 Penny Chong , Lukas Ruff , Marius Kloft , Alexander Binder

How to improve discriminative feature learning is central in classification. Existing works address this problem by explicitly increasing inter-class separability and intra-class similarity, whether by constructing positive and negative…

Machine Learning · Computer Science 2024-08-21 Qingsong Zhao , Yi Wang , Shuguang Dou , Chen Gong , Yin Wang , Cairong Zhao

This work presents an independent reproducibility study of a lossy image compression technique that integrates singular value decomposition (SVD) and wavelet difference reduction (WDR). The original paper claims that combining SVD and WDR…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Alena Makarova

Low-dimensional embeddings for data from disparate sources play critical roles in multi-modal machine learning, multimedia information retrieval, and bioinformatics. In this paper, we propose a supervised dimensionality reduction method…

Machine Learning · Computer Science 2021-01-15 Yanjun Li , Bihan Wen , Hao Cheng , Yoram Bresler

Recent deep reinforcement learning (DRL) successes rely on end-to-end learning from fixed-size observational inputs (e.g. image, state-variables). However, many challenging and interesting problems in decision making involve observations or…

Machine Learning · Computer Science 2022-06-08 Vince Jankovics , Michael Garcia Ortiz , Eduardo Alonso

Dimension reduction techniques, such as Sufficient Dimension Reduction (SDR), are indispensable for analyzing high-dimensional datasets. This paper introduces a novel SDR method named Principal Square Response Forward Regression (PSRFR) for…

Methodology · Statistics 2024-09-05 Zheng Li , Yunhao Wang , Wei Gao , Hon Keung Tony Ng

Sufficient dimension reduction is a powerful tool to extract core information hidden in the high-dimensional data and has potentially many important applications in machine learning tasks. However, the existing nonlinear sufficient…

Machine Learning · Computer Science 2022-10-11 Siqi Liang , Yan Sun , Faming Liang

In this paper, we consider a deep learning approach to the limited aperture inverse obstacle scattering problem. It is well known that traditional deep learning relies solely on data, which may limit its performance for the inverse problem…

Numerical Analysis · Mathematics 2024-11-05 Yunwen Yin , Liang Yan

In this paper we propose the Structured Deep Neural Network (Structured DNN) as a structured and deep learning algorithm, learning to find the best structured object (such as a label sequence) given a structured input (such as a vector…

Machine Learning · Computer Science 2015-06-04 Yi-Hsiu Liao , Hung-Yi Lee , Lin-shan Lee

Assuming that neither source data nor source model parameters are accessible, black-box domain adaptation (BBDA) represents a highly practical yet challenging setting, where transferable knowledge is limited to the predictions of a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Zhe Zhang , Jing Li , Wanli Xue , Xu Cheng , Jianhua Zhang , Qinghua Hu , Shengyong Chen

Symbolic regression (SR) aims to discover explicit mathematical expressions that explain observed data and is widely used in domains where interpretability is essential. Because interpretability requires expressions to reflect meaningful…

Neural and Evolutionary Computing · Computer Science 2026-05-18 Koki Ikeda , Masahiro Nomura , Ryoki Hamano

Reducing acquisition time is a crucial challenge for many imaging techniques. Compressed Sensing (CS) theory offers an appealing framework to address this issue since it provides theoretical guarantees on the reconstruction of sparse…

Applications · Statistics 2014-07-17 Nicolas Chauffert , Philippe Ciuciu , Jonas Kahn , Pierre Weiss

Weakly supervised person search aims to jointly detect and match persons with only bounding box annotations. Existing approaches typically focus on improving the features by exploring relations of persons. However, scale variation problem…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Benzhi Wang , Yang Yang , Jinlin Wu , Guo-jun Qi , Zhen Lei

We propose an algorithmic framework, that employs active subspace techniques, for scalable global optimization of functions with low effective dimension (also referred to as low-rank functions). This proposal replaces the original…

Optimization and Control · Mathematics 2024-02-01 Coralia Cartis , Xinzhu Liang , Estelle Massart , Adilet Otemissov

Continual learning (CL) has shown promising results and comparable performance to learning at once in a fully supervised manner. However, CL strategies typically require a large number of labeled samples, making their real-life deployment…

Machine Learning · Computer Science 2025-01-15 Yan Fan , Yu Wang , Pengfei Zhu , Qinghua Hu

Sliced inverse regression (SIR, Li 1991) is a pioneering work and the most recognized method in sufficient dimension reduction. While promising progress has been made in theory and methods of high-dimensional SIR, two remaining challenges…

Methodology · Statistics 2023-04-14 Qing Mai , Xiaofeng Shao , Runmin Wang , Xin Zhang

We derive a new margin-based regularization formulation, termed multi-margin regularization (MMR), for deep neural networks (DNNs). The MMR is inspired by principles that were applied in margin analysis of shallow linear classifiers, e.g.,…

Machine Learning · Computer Science 2020-09-15 Berry Weinstein , Shai Fine , Yacov Hel-Or

Symbolic regression discovers explicit, interpretable equations without assuming a functional form in advance. A Bayesian approach strengthens this through probability distributions over candidate expressions, thus quantifying uncertainty…

Machine Learning · Computer Science 2026-05-05 James Butterworth , Gevik Grigorian , Alejandro DiazDelaO

Generative diffusion models have achieved remarkable success in producing high-quality images. However, these models typically operate in continuous intensity spaces, diffusing independently across pixels and color channels. As a result,…

Graphics · Computer Science 2025-05-20 Javier E. Santos , Agnese Marcato , Roman Colman , Nicholas Lubbers , Yen Ting Lin