English
Related papers

Related papers: Learning Sensor Multiplexing Design through Back-p…

200 papers

A discriminatively trained neural net classifier can fit the training data perfectly if all information about its input other than class membership has been discarded prior to the output layer. Surprisingly, past research has discovered…

Machine Learning · Computer Science 2021-07-23 Piotr Teterwak , Chiyuan Zhang , Dilip Krishnan , Michael C. Mozer

Predictive coding networks are neural models that perform inference through an iterative energy minimization process, whose operations are local in space and time. While effective in shallow architectures, they suffer significant…

Machine Learning · Computer Science 2025-10-13 Chang Qi , Matteo Forasassi , Thomas Lukasiewicz , Tommaso Salvatori

The de facto algorithm for training the back pass of a feedforward neural network is backpropagation (BP). The use of almost-everywhere differentiable activation functions made it efficient and effective to propagate the gradient backwards…

Neural and Evolutionary Computing · Computer Science 2022-06-14 John Waldo

This paper introduces a new encoder-decoder architecture that is trained to reconstruct images by disentangling the salient information of the image and the values of attributes directly in the latent space. As a result, after training, our…

Computer Vision and Pattern Recognition · Computer Science 2018-01-30 Guillaume Lample , Neil Zeghidour , Nicolas Usunier , Antoine Bordes , Ludovic Denoyer , Marc'Aurelio Ranzato

Deep Neural Networks (DNNs) have been widely used for illumination estimation, which is time-consuming and requires sensor-specific data collection. Our proposed method uses a dual-mapping strategy and only requires a simple white point…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Shuwei Yue , Minchen Wei

Underwater images suffer from color casts and low contrast due to wavelength- and distance-dependent attenuation and scattering. To solve these two degradation issues, we present an underwater image enhancement network via medium…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Chongyi Li , Saeed Anwar , Junhui Hou , Runmin Cong , Chunle Guo , Wenqi Ren

The back-propagation algorithm has long been the de-facto standard in optimizing weights and biases in neural networks, particularly in cutting-edge deep learning models. Its widespread adoption in fields like natural language processing,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Sidike Paheding , Abel A. Reyes-Angulo

Learning-based single image super-resolution (SISR) methods are continuously showing superior effectiveness and efficiency over traditional model-based methods, largely due to the end-to-end training. However, different from model-based…

Image and Video Processing · Electrical Eng. & Systems 2020-03-24 Kai Zhang , Luc Van Gool , Radu Timofte

Sequence modelling requires determining which past tokens are causally relevant from the context and their importance: a process inherent to the attention layers in transformers, yet whose underlying learned mechanisms remain poorly…

Machine Learning · Computer Science 2026-04-14 Francesco D'Angelo , Nicolas Flammarion

We show how to train a fully convolutional neural network to perform inverse rendering from a single, uncontrolled image. The network takes an RGB image as input, regresses albedo and normal maps from which we compute lighting coefficients.…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Ye Yu , William A. P. Smith

Underwater imagery often exhibits distorted coloration as a result of light-water interactions, which complicates the study of benthic environments in marine biology and geography. In this research, we propose an algorithm to restore the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Tianyi Zhang , Matthew Johnson-Roberson

Learning color mixing is difficult for novice painters. In order to support novice painters in learning color mixing, we propose a prediction model for semitransparent pigment mixtures and use its prediction results to create a Smart…

Machine Learning · Computer Science 2019-04-02 Mei-Yun Chen , Ya-Bo Huang , Sheng-Ping Chang , Ming Ouhyoung

Over the last decade, robotic perception algorithms have significantly benefited from the rapid advances in deep learning (DL). Indeed, a significant amount of the autonomy stack of different commercial and research platforms relies on DL…

Robotics · Computer Science 2022-03-09 Yu Xianjia , Sahar Salimpour , Jorge Peña Queralta , Tomi Westerlund

The remarkable performance of deep neural networks (DNNs) currently makes them the method of choice for solving linear inverse problems. They have been applied to super-resolve and restore images, as well as to reconstruct MR and CT images.…

Image and Video Processing · Electrical Eng. & Systems 2021-06-01 Marija Vella , João F. C. Mota

Image recovery from compressive measurements requires a signal prior for the images being reconstructed. Recent work has explored the use of deep generative models with low latent dimension as signal priors for such problems. However, their…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Niklas Smedemark-Margulies , Jung Yeon Park , Max Daniels , Rose Yu , Jan-Willem van de Meent , Paul Hand

The back-propagation (BP) algorithm has been considered the de-facto method for training deep neural networks. It back-propagates errors from the output layer to the hidden layers in an exact manner using the transpose of the feedforward…

Neural and Evolutionary Computing · Computer Science 2018-05-01 Hongyin Luo , Jie Fu , James Glass

We present a new "learning-to-learn"-type approach that enables rapid learning of concepts from small-to-medium sized training sets and is primarily designed for web-initialized image retrieval. At the core of our approach is a deep…

Computer Vision and Pattern Recognition · Computer Science 2017-10-30 A. Vakhitov , A. Kuzmin , V. Lempitsky

In multi-contrast magnetic resonance imaging (MRI), compressed sensing theory can accelerate imaging by sampling fewer measurements within each contrast. The conventional optimization-based models suffer several limitations: strict…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Liyan Sun , Zhiwen Fan , Yue Huang , Xinghao Ding , John Paisley

We introduce a novel deep-learning architecture for image upscaling by large factors (e.g. 4x, 8x) based on examples of pristine high-resolution images. Our target is to reconstruct high-resolution images from their downscale versions. The…

Image and Video Processing · Electrical Eng. & Systems 2019-01-31 Pablo Navarrete Michelini , Hanwen Liu , Dan Zhu

Recent research in the design of end to end communication system using deep learning has produced models which can outperform traditional communication schemes. Most of these architectures leveraged autoencoders to design the encoder at the…

Information Theory · Computer Science 2020-01-28 Vishnu Raj , Sheetal Kalyani