English
Related papers

Related papers: Creation of a Deep Convolutional Auto-Encoder in C…

200 papers

We introduce a sparse scattering deep convolutional neural network, which provides a simple model to analyze properties of deep representation learning for classification. Learning a single dictionary matrix with a classifier yields a…

Machine Learning · Computer Science 2020-02-21 John Zarka , Louis Thiry , Tomás Angles , Stéphane Mallat

This work introduces a new unsupervised representation learning technique called Deep Convolutional Transform Learning (DCTL). By stacking convolutional transforms, our approach is able to learn a set of independent kernels at different…

Machine Learning · Computer Science 2020-10-05 Jyoti Maggu , Angshul Majumdar , Emilie Chouzenoux , Giovanni Chierchia

Currently, analysis of microscopic In Situ Hybridization images is done manually by experts. Precise evaluation and classification of such microscopic images can ease experts' work and reveal further insights about the data. In this work,…

Image and Video Processing · Electrical Eng. & Systems 2023-12-21 Aleksandar A. Yanev , Galina D. Momcheva , Stoyan P. Pavlov

Deep Learning models enjoy considerable success in Natural Language Processing. While deep architectures produce useful representations that lead to improvements in various tasks, they are often difficult to interpret. This makes the…

Computation and Language · Computer Science 2013-04-29 Christian Scheible , Hinrich Schuetze

We introduce a class of auto-encoder neural networks tailored to data from the natural exponential family (e.g., count data). The architectures are inspired by the problem of learning the filters in a convolutional generative model with…

Machine Learning · Computer Science 2020-06-30 Bahareh Tolooshams , Andrew H. Song , Simona Temereanca , Demba Ba

Convolutional neural networks (CNNs) have achieved state-of-the-art results on many visual recognition tasks. However, current CNN models still exhibit a poor ability to be invariant to spatial transformations of images. Intuitively, with…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Xu Shen , Xinmei Tian , Anfeng He , Shaoyan Sun , Dacheng Tao

Yes, they do. This paper provides the first empirical demonstration that deep convolutional models really need to be both deep and convolutional, even when trained with methods such as distillation that allow small or shallow models of high…

Functional magnetic resonance imaging produces high dimensional data, with a less then ideal number of labelled samples for brain decoding tasks (predicting brain states). In this study, we propose a new deep temporal convolutional neural…

Machine Learning · Computer Science 2015-01-13 Orhan Firat , Emre Aksan , Ilke Oztekin , Fatos T. Yarman Vural

The idea of using a deep autoencoder to encode seismic waveform features and then use them in different seismological applications is appealing. In this paper, we designed tests to evaluate this idea of using autoencoders as feature…

Transformer is the state-of-the-art model in recent machine translation evaluations. Two strands of research are promising to improve models of this kind: the first uses wide networks (a.k.a. Transformer-Big) and has been the de facto…

Computation and Language · Computer Science 2019-06-06 Qiang Wang , Bei Li , Tong Xiao , Jingbo Zhu , Changliang Li , Derek F. Wong , Lidia S. Chao

Even though convolutional neural networks have become the method of choice in many fields of computer vision, they still lack interpretability and are usually designed manually in a cumbersome trial-and-error process. This paper aims at…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Maria Ximena Bastidas Rodriguez , Adrien Gruson , Luisa F. Polania , Shin Fujieda , Flavio Prieto Ortiz , Kohei Takayama , Toshiya Hachisuka

In this paper, we present an in-depth investigation of the convolutional autoencoder (CAE) bottleneck. Autoencoders (AE), and especially their convolutional variants, play a vital role in the current deep learning toolbox. Researchers and…

Machine Learning · Computer Science 2020-05-14 Ilja Manakov , Markus Rohm , Volker Tresp

In this work, we introduce a deep-learning framework designed for estimating dense image correspondences. Our fully convolutional model generates dense feature maps for images, where each pixel is associated with a descriptor that can be…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Monika Kwiatkowski , Simon Matern , Olaf Hellwich

We propose a novel visual context-aware filter generation module which incorporates contextual information present in images into Convolutional Neural Networks (CNNs). In contrast to traditional CNNs, we do not employ the same set of…

Computer Vision and Pattern Recognition · Computer Science 2019-06-25 Suraj Tripathi , Abhay Kumar , Chirag Singh

In this paper, we build autoencoder based pipelines for extreme end-to-end image compression based on Ball\'e's approach, which is the state-of-the-art open source implementation in image compression using deep learning. We deepened the…

Image and Video Processing · Electrical Eng. & Systems 2020-03-02 Licheng Xiao , Hairong Wang , Nam Ling

Learning latent representations of registered meshes is useful for many 3D tasks. Techniques have recently shifted to neural mesh autoencoders. Although they demonstrate higher precision than traditional methods, they remain unable to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Yi Zhou , Chenglei Wu , Zimo Li , Chen Cao , Yuting Ye , Jason Saragih , Hao Li , Yaser Sheikh

We introduce a new approach to systematically map features discovered by sparse autoencoder across consecutive layers of large language models, extending earlier work that examined inter-layer feature links. By using a data-free cosine…

Machine Learning · Computer Science 2025-07-28 Daniil Laptev , Nikita Balagansky , Yaroslav Aksenov , Daniil Gavrilov

Image restoration, including image denoising, super resolution, inpainting, and so on, is a well-studied problem in computer vision and image processing, as well as a test bed for low-level image modeling algorithms. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2016-08-31 Xiao-Jiao Mao , Chunhua Shen , Yu-Bin Yang

We propose a learned-structured unfolding neural network for the problem of compressive sparse multichannel blind-deconvolution. In this problem, each channel's measurements are given as convolution of a common source signal and sparse…

Signal Processing · Electrical Eng. & Systems 2021-02-15 Bahareh Tolooshams , Satish Mulleti , Demba Ba , Yonina C. Eldar

Capsule Network is a promising concept in deep learning, yet its true potential is not fully realized thus far, providing sub-par performance on several key benchmark datasets with complex data. Drawing intuition from the success achieved…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Jathushan Rajasegaran , Vinoj Jayasundara , Sandaru Jayasekara , Hirunima Jayasekara , Suranga Seneviratne , Ranga Rodrigo