English
Related papers

Related papers: Learning a Wavelet-like Auto-Encoder to Accelerate…

200 papers

Transformer-based image denoising methods have achieved encouraging results in the past year. However, it must uses linear operations to model long-range dependencies, which greatly increases model inference time and consumes GPU storage…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Juncheng Li , Bodong Cheng , Ying Chen , Guangwei Gao , Tieyong Zeng

Recently learned image compression (LIC) has achieved great progress and even outperformed the traditional approach using DCT or discrete wavelet transform (DWT). However, LIC mainly reduces spatial redundancy in the autoencoder networks…

Applications · Statistics 2024-07-16 Haisheng Fu , Jie Liang , Zhenman Fang , Jingning Han , Feng Liang , Guohe Zhang

We propose a novel way to measure and understand convolutional neural networks by quantifying the amount of input signal they let in. To do this, an autoencoder (AE) was fine-tuned on gradients from a pre-trained classifier with fixed…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Sebastian Palacio , Joachim Folz , Jörn Hees , Federico Raue , Damian Borth , Andreas Dengel

Generally, the performance of deep neural networks (DNNs) heavily depends on the quality of data representation learning. Our preliminary work has emphasized the significance of deep representation learning (DRL) in the context of speech…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-18 Yang Xiang , Jingguang Tian , Xinhui Hu , Xinkang Xu , ZhaoHui Yin

Inspired by recent advances in diffusion models, which are reminiscent of denoising autoencoders, we investigate whether they can acquire discriminative representations for classification via generative pre-training. This paper shows that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Weilai Xiang , Hongyu Yang , Di Huang , Yunhong Wang

Chest radiographs are used for the diagnosis of multiple critical illnesses (e.g., Pneumonia, heart failure, lung cancer), for this reason, systems for the automatic or semi-automatic analysis of these data are of particular interest. An…

Image and Video Processing · Electrical Eng. & Systems 2022-05-10 Declan McIntosh , Tunai Porto Marques , Alexandra Branzan Albu

We present a novel method for constructing Variational Autoencoder (VAE). Instead of using pixel-by-pixel loss, we enforce deep feature consistency between the input and the output of a VAE, which ensures the VAE's output to preserve the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Xianxu Hou , Linlin Shen , Ke Sun , Guoping Qiu

Deep neural networks are known to be vulnerable to adversarial attacks. This exposes them to potential exploits in security-sensitive applications and highlights their lack of robustness. This paper uses a variational auto-encoder (VAE) to…

Computer Vision and Pattern Recognition · Computer Science 2018-12-10 Yi Luo , Henry Pfister

A novel variational autoencoder is developed to model images, as well as associated labels or captions. The Deep Generative Deconvolutional Network (DGDN) is used as a decoder of the latent image features, and a deep Convolutional Neural…

Machine Learning · Statistics 2016-09-29 Yunchen Pu , Zhe Gan , Ricardo Henao , Xin Yuan , Chunyuan Li , Andrew Stevens , Lawrence Carin

Neuromorphic hardware equipped with learning capabilities can adapt to new, real-time data. While models of Spiking Neural Networks (SNNs) can now be trained using gradient descent to reach an accuracy comparable to equivalent conventional…

Neural and Evolutionary Computing · Computer Science 2022-03-09 Kenneth Stewart , Andreea Danielescu , Timothy Shea , Emre Neftci

Recent years have witnessed the great success of deep convolutional neural networks (CNNs) in image denoising. Albeit deeper network and larger model capacity generally benefit performance, it remains a challenging practical issue to train…

Image and Video Processing · Electrical Eng. & Systems 2020-10-26 Yali Peng , Yue Cao , Shigang Liu , Jian Yang , Wangmeng Zuo

Graph structured data are abundant in the real world. Among different graph types, directed acyclic graphs (DAGs) are of particular interest to machine learning researchers, as many machine learning models are realized as computations on…

Machine Learning · Computer Science 2019-10-30 Muhan Zhang , Shali Jiang , Zhicheng Cui , Roman Garnett , Yixin Chen

Deploying deep learning neural networks on edge devices, to accomplish task specific objectives in the real-world, requires a reduction in their memory footprint, power consumption, and latency. This can be realized via efficient model…

Machine Learning · Computer Science 2023-07-20 Carl Shneider , Peyman Rostami , Anis Kacem , Nilotpal Sinha , Abd El Rahman Shabayek , Djamila Aouada

Variational Autoencoders (VAEs) have become a popular approach for dimensionality reduction. However, despite their ability to identify latent low-dimensional structures embedded within high-dimensional data, these latent representations…

Machine Learning · Statistics 2020-08-27 Kaspar Märtens , Christopher Yau

The edge computing paradigm places compute-capable devices - edge servers - at the network edge to assist mobile devices in executing data analysis tasks. Intuitively, offloading compute-intense tasks to edge servers can reduce their…

Computer Vision and Pattern Recognition · Computer Science 2021-11-17 Yoshitomo Matsubara , Marco Levorato

Graph autoencoders (AE) and variational autoencoders (VAE) are powerful node embedding methods, but suffer from scalability issues. In this paper, we introduce FastGAE, a general framework to scale graph AE and VAE to large graphs with…

Machine Learning · Computer Science 2021-04-14 Guillaume Salha , Romain Hennequin , Jean-Baptiste Remy , Manuel Moussallam , Michalis Vazirgiannis

We propose a quantum implicit neural representation (QINR)-based autoencoder (AE) and variational autoencoder (VAE) for image reconstruction and generation tasks. Our purpose is to demonstrate that the QINR in VAEs and AEs can transform…

Machine Learning · Computer Science 2026-03-17 Saadet Müzehher Eren

Deep convolutional neural networks (CNNs) are used for image denoising via automatically mining accurate structure information. However, most of existing CNNs depend on enlarging depth of designed networks to obtain better denoising…

Image and Video Processing · Electrical Eng. & Systems 2022-10-04 Chunwei Tian , Menghua Zheng , Wangmeng Zuo , Bob Zhang , Yanning Zhang , David Zhang

The use of deep neural network (DNN) autoencoders (AEs) has recently exploded due to their wide applicability. However, the embedding representation produced by a standard DNN AE that is trained to minimize only the reconstruction error…

Machine Learning · Computer Science 2020-11-20 Mark Alan Matties

We demonstrate a new deep learning autoencoder network, trained by a nonnegativity constraint algorithm (NCAE), that learns features which show part-based representation of data. The learning algorithm is based on constraining negative…

Machine Learning · Computer Science 2016-01-13 Ehsan Hosseini-Asl , Jacek M. Zurada , Olfa Nasraoui