English
Related papers

Related papers: Deep Variational Sufficient Dimensionality Reducti…

200 papers

Existing convolutional neural networks (CNN) based image super-resolution (SR) methods have achieved impressive performance on bicubic kernel, which is not valid to handle unknown degradations in real-world applications. Recent blind SR…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Feng Li , Yixuan Wu , Huihui Bai , Weisi Lin , Runmin Cong , Yao Zhao

Dimension reduction (DR) is inherently non-unique: multiple embeddings can preserve the structure of high-dimensional data equally well while differing in layout or geometry. In this paper, we formally define the Rashomon set for DR -- the…

Machine Learning · Computer Science 2026-04-29 Yiyang Sun , Haiyang Huang , Gaurav Rajesh Parikh , Cynthia Rudin

Neoteric works have shown that modern deep learning models can exhibit a sparse double descent phenomenon. Indeed, as the sparsity of the model increases, the test performance first worsens since the model is overfitting the training data;…

Machine Learning · Computer Science 2024-02-09 Victor Quétu , Enzo Tartaglione

Most conventional supervised super-resolution (SR) algorithms assume that low-resolution (LR) data is obtained by downscaling high-resolution (HR) data with a fixed known kernel, but such an assumption often does not hold in real scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Suyoung Lee , Myungsub Choi , Kyoung Mu Lee

Self-supervised learning (SSL) has emerged as a crucial technique in image processing, encoding, and understanding, especially for developing today's vision foundation models that utilize large-scale datasets without annotations to enhance…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Chuang Niu , Wenjun Xia , Hongming Shan , Ge Wang

Dimensionality reduction (DR) is often used as a preprocessing step in classification, but usually one first fixes the DR mapping, possibly using label information, and then learns a classifier (a filter approach). Best performance would be…

Machine Learning · Computer Science 2014-05-27 Weiran Wang , Miguel Á. Carreira-Perpiñán

Sufficient dimension reduction aims for reduction of dimensionality of a regression without loss of information by replacing the original predictor with its lower-dimensional subspace. Partial (sufficient) dimension reduction arises when…

Methodology · Statistics 2019-09-27 Lu Li , Kai Tan , Xuerong Meggie Wen , Zhou Yu

Land cover maps generated from semantic segmentation of high-resolution remotely sensed images have drawn mucon in the photogrammetry and remote sensing research community. Currently, massive fine-resolution remotely sensed (FRRS) images…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Naftaly Wambugu , Ruisheng Wang , Bo Guo , Tianshu Yu , Sheng Xu , Mohammed Elhassan

Single image super-resolution traditionally assumes spatially-invariant degradation models, yet real-world imaging systems exhibit complex distance-dependent effects including atmospheric scattering, depth-of-field variations, and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Tianhao Guo , Bingjie Lu , Feng Wang , Zhengyang Lu

In recent years, deep learning technology has been maturely applied in the field of object detection, and most algorithms tend to be supervised learning. However, a large amount of labeled data requires high costs of human resources, which…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Yanyang Wang , Zhaoxiang Liu , Shiguo Lian

The Minimum Variance Distortionless Response (MVDR) beamforming technique is widely applied in array systems to mitigate interference. However, applying MVDR to large arrays is computationally challenging; its computational complexity…

Signal Processing · Electrical Eng. & Systems 2025-10-17 Sanjaya Herath , Armin Gerami , Kevin Wagner , Ramani Duraiswami , Christopher A. Metzler

One of the fundamental problems in machine learning is the estimation of a probability distribution from data. Many techniques have been proposed to study the structure of data, most often building around the assumption that observations…

Machine Learning · Statistics 2013-02-22 Oren Rippel , Ryan Prescott Adams

Data-driven problem solving in many real-world applications involves analysis of time-dependent multivariate data, for which dimensionality reduction (DR) methods are often used to uncover the intrinsic structure and features of the data.…

Human-Computer Interaction · Computer Science 2021-10-28 Takanori Fujiwara , Shilpika , Naohisa Sakamoto , Jorji Nonaka , Keiji Yamamoto , Kwan-Liu Ma

Variational dimensionality reduction methods are widely used for their accuracy, generative capabilities, and robustness. We introduce a unifying framework that generalizes both such as traditional and state-of-the-art methods. The…

Machine Learning · Computer Science 2025-09-04 Eslam Abdelaleem , Ilya Nemenman , K. Michael Martini

Power distribution networks are approaching their voltage stability boundaries due to the severe voltage violations and the inadequate reactive power reserves caused by the increasing renewable generations and dynamic loads. In the broad…

Optimization and Control · Mathematics 2022-08-18 Wanjun Huang , Changhong Zhao

Deep learning models for vision tasks are trained on large datasets under the assumption that there exists a universal representation that can be used to make predictions for all samples. Whereas high complexity models are proven to be…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Botos Csaba , Adel Bibi , Yanwei Li , Philip Torr , Ser-Nam Lim

Support vector regression (SVR) is one of the most popular machine learning algorithms aiming to generate the optimal regression curve through maximizing the minimal margin of selected training samples, i.e., support vectors. Recent…

Machine Learning · Computer Science 2019-05-07 Gaoyang Li , Jinyu Yang , Chunguo Wu , Qin Ma

We present structured domain randomization (SDR), a variant of domain randomization (DR) that takes into account the structure and context of the scene. In contrast to DR, which places objects and distractors randomly according to a uniform…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Aayush Prakash , Shaad Boochoon , Mark Brophy , David Acuna , Eric Cameracci , Gavriel State , Omer Shapira , Stan Birchfield

Most data sets comprise of measurements on continuous and categorical variables. In regression and classification Statistics literature, modeling high-dimensional mixed predictors has received limited attention. In this paper we study the…

Statistics Theory · Mathematics 2021-10-26 Efstathia Bura , Liliana Forzani , Rodrigo García Arancibia , Pamela Llop , Diego Tomassi

Many discriminative natural language understanding (NLU) tasks have large label spaces. Learning such a process of large-space decision making is particularly challenging due to the lack of training instances per label and the difficulty of…

Computation and Language · Computer Science 2023-10-31 Nan Xu , Fei Wang , Mingtao Dong , Muhao Chen