English
Related papers

Related papers: Deep Nonparametric Estimation of Intrinsic Data St…

200 papers

Nonlinear manifold learning from unorganized data points is a very challenging unsupervised learning and data visualization problem with a great variety of applications. In this paper we present a new algorithm for manifold learning and…

Machine Learning · Computer Science 2016-08-31 Zhenyue Zhang , Hongyuan Zha

Many physical processes in science and engineering are naturally represented by operators between infinite-dimensional function spaces. The problem of operator learning, in this context, seeks to extract these physical processes from…

Machine Learning · Computer Science 2024-01-22 Hao Liu , Biraj Dahal , Rongjie Lai , Wenjing Liao

Visualization is a crucial step in exploratory data analysis. One possible approach is to train an autoencoder with low-dimensional latent space. Large network depth and width can help unfolding the data. However, such expressive networks…

Machine Learning · Computer Science 2023-07-03 Philipp Nazari , Sebastian Damrich , Fred A. Hamprecht

A big mystery in deep learning continues to be the ability of methods to generalize when the number of model parameters is larger than the number of training examples. In this work, we take a step towards a better understanding of the…

Machine Learning · Computer Science 2021-11-25 Romain Cosentino , Randall Balestriero , Richard Baraniuk , Behnaam Aazhang

Despite their great success in practical applications, there is still a lack of theoretical and systematic methods to analyze deep neural networks. In this paper, we illustrate an advanced information theoretic methodology to understand the…

Machine Learning · Computer Science 2019-05-09 Shujian Yu , Jose C. Principe

Dimensionality reduction is a crucial first step for many unsupervised learning tasks including anomaly detection and clustering. Autoencoder is a popular mechanism to accomplish dimensionality reduction. In order to make dimensionality…

Machine Learning · Computer Science 2021-03-12 Imtiaz Ahmed , Travis Galoppo , Xia Hu , Yu Ding

Deep learning is playing an instrumental role in the design of the next generation of communication systems. In this letter, we address the massive MIMO interconnect's bandwidth constraint relaxation using autoencoders. The autoencoder is…

Signal Processing · Electrical Eng. & Systems 2019-09-20 Messaoud Ahmed Ouameur , Daniel Massicotte

Unsupervised dimensionality reduction is one of the commonly used techniques in the field of high dimensional data recognition problems. The deep autoencoder network which constrains the weights to be non-negative, can learn a low…

Computer Vision and Pattern Recognition · Computer Science 2020-09-18 Anyong Qin , Zhaowei Shang , Zhuolin Tan , Taiping Zhang , Yuan Yan Tang

Weakly-supervised anomaly detection aims at learning an anomaly detector from a limited amount of labeled data and abundant unlabeled data. Recent works build deep neural networks for anomaly detection by discriminatively mapping the normal…

Machine Learning · Computer Science 2021-08-29 Yingjie Zhou , Xucheng Song , Yanru Zhang , Fanxing Liu , Ce Zhu , Lingqiao Liu

This paper aims to develop a new and robust approach to feature representation. Motivated by the success of Auto-Encoders, we first theoretical summarize the general properties of all algorithms that are based on traditional Auto-Encoders:…

Machine Learning · Computer Science 2018-10-24 Zeng Yu , Tianrui Li , Ning Yu , Yi Pan , Hongmei Chen , Bing Liu

Non-linear manifold learning enables high-dimensional data analysis, but requires out-of-sample-extension methods to process new data points. In this paper, we propose a manifold learning algorithm based on deep learning to create an…

Machine Learning · Statistics 2015-06-26 Gal Mishne , Uri Shaham , Alexander Cloninger , Israel Cohen

3D point clouds are often perturbed by noise due to the inherent limitation of acquisition equipments, which obstructs downstream tasks such as surface reconstruction, rendering and so on. Previous works mostly infer the displacement of…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Shitong Luo , Wei Hu

The presence of noise is common in signal processing regardless the signal type. Deep neural networks have shown good performance in noise removal, especially on the image domain. In this work, we consider deep neural networks as a…

Machine Learning · Computer Science 2020-07-07 Leslie Casas , Attila Klimmek , Nassir Navab , Vasileios Belagiannis

Channel charting has emerged as a powerful tool for user equipment localization and wireless environment sensing. Its efficacy lies in mapping high-dimensional channel data into low-dimensional features that preserve the relative…

Signal Processing · Electrical Eng. & Systems 2025-09-17 Ge Chen , Panqi Chen , Lei Cheng

Denoising autoencoders (DAEs) have proven useful for unsupervised representation learning, but a thorough theoretical understanding is still lacking of how the input noise influences learning. Here we develop theory for how noise influences…

Machine Learning · Statistics 2018-07-31 Arnu Pretorius , Steve Kroon , Herman Kamper

Denoising autoencoders (DAEs) are powerful deep learning models used for feature extraction, data generation and network pre-training. DAEs consist of an encoder and decoder which may be trained simultaneously to minimise a loss (function)…

Computer Vision and Pattern Recognition · Computer Science 2017-10-10 Antonia Creswell , Kai Arulkumaran , Anil A. Bharath

Principal component analysis, dictionary learning, and auto-encoders are all unsupervised methods for learning representations from a large amount of training data. In all these methods, the higher the dimensions of the input data, the…

Machine Learning · Computer Science 2019-08-27 Thomas Chang , Bahareh Tolooshams , Demba Ba

Deep networks can be trained to map images into a low-dimensional latent space. In many cases, different images in a collection are articulated versions of one another; for example, same object with different lighting, background, or pose.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Rakib Hyder , M. Salman Asif

We present a new deep unfolding network for analysis-sparsity-based Compressed Sensing. The proposed network coined Decoding Network (DECONET) jointly learns a decoder that reconstructs vectors from their incomplete, noisy measurements and…

Information Theory · Computer Science 2023-06-21 Vicky Kouni , Yannis Panagakis

We apply a Machine Learning technique known as Convolutional Denoising Autoencoder to denoise synthetic images of state-of-the-art radio telescopes, with the goal of detecting the faint, diffused radio sources predicted to characterise the…

Instrumentation and Methods for Astrophysics · Physics 2021-11-03 Claudio Gheller , Franco Vazza