English
Related papers

Related papers: Are Deep Neural Architectures Losing Information? …

200 papers

Designing effective architectures is one of the key factors behind the success of deep neural networks. Existing deep architectures are either manually designed or automatically searched by some Neural Architecture Search (NAS) methods.…

Machine Learning · Computer Science 2020-01-14 Yong Guo , Yin Zheng , Mingkui Tan , Qi Chen , Jian Chen , Peilin Zhao , Junzhou Huang

Learned inverse problem solvers exhibit remarkable performance in applications like image reconstruction tasks. These data-driven reconstruction methods often follow a two-step scheme. First, one trains the often neural network-based…

Estimation of intrinsic images still remains a challenging task due to weaknesses of ground-truth datasets, which either are too small or present non-realistic issues. On the other hand, end-to-end deep learning architectures start to…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Hassan Sial , Ramon Baldrich , Maria Vanrell

Neural machine learning methods, such as deep neural networks (DNN), have achieved remarkable success in a number of complex data processing tasks. These methods have arguably had their strongest impact on tasks such as image and audio…

Deep feedforward and recurrent networks have achieved impressive results in many perception and language processing applications. This success is partially attributed to architectural innovations such as convolutional and long short-term…

Machine Learning · Statistics 2015-11-24 Arvind Neelakantan , Luke Vilnis , Quoc V. Le , Ilya Sutskever , Lukasz Kaiser , Karol Kurach , James Martens

Image denoising is an essential tool in computational photography. Standard denoising techniques, which use deep neural networks at their core, require pairs of clean and noisy images for its training. If we do not possess the clean…

Image and Video Processing · Electrical Eng. & Systems 2020-08-26 David Honzátko , Siavash A. Bigdeli , Engin Türetken , L. Andrea Dunbar

A neural language model can be conditioned into generating descriptions for images by providing visual information apart from the sentence prefix. This visual information can be included into the language model through different points of…

Neural and Evolutionary Computing · Computer Science 2019-11-12 Marc Tanti , Albert Gatt , Kenneth P. Camilleri

Infrared images captured under turbulent conditions are degraded by complex geometric distortions and blur. We address infrared deturbulence as an image restoration task, proposing DparNet, a parameter-assisted multi-frame network with a…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Yi Lu , Yadong Wang , Xingbo Jiang , Xiangzhi Bai

The goal of attribute manipulation is to control specified attribute(s) in given images. Prior work approaches this problem by learning disentangled representations for each attribute that enables it to manipulate the encoded source…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Nannan Li , Bryan A. Plummer

In this paper, we demonstrate how deep autoencoders can be generalized to the case of inpainting and denoising, even when no clean training data is available. In particular, we show how neural networks can be trained to perform all of these…

Image and Video Processing · Electrical Eng. & Systems 2021-01-27 Rasika Karkare , Randy Paffenroth , Gunjan Mahindre

An important goal in deep learning is to learn versatile, high-level feature representations of input data. However, standard networks' representations seem to possess shortcomings that, as we illustrate, prevent them from fully realizing…

Machine Learning · Statistics 2019-09-30 Logan Engstrom , Andrew Ilyas , Shibani Santurkar , Dimitris Tsipras , Brandon Tran , Aleksander Madry

Recovering high-resolution images from limited sensory data typically leads to a serious ill-posed inverse problem, demanding inversion algorithms that effectively capture the prior information. Learning a good inverse mapping from training…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Morteza Mardani , Qingyun Sun , Shreyas Vasawanala , Vardan Papyan , Hatef Monajemi , John Pauly , David Donoho

All-in-one image restoration tackles different types of degradations with a unified model instead of having task-specific, non-generic models for each degradation. The requirement to tackle multiple degradations using the same model can…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Akshay Dudhane , Omkar Thawakar , Syed Waqas Zamir , Salman Khan , Fahad Shahbaz Khan , Ming-Hsuan Yang

There are two big unsolved mathematical questions in artificial intelligence (AI): (1) Why is deep learning so successful in classification problems and (2) why are neural nets based on deep learning at the same time universally unstable,…

Machine Learning · Statistics 2019-06-05 Laura Thesing , Vegard Antun , Anders C. Hansen

Deep neural networks can be effective means to automatically classify aerial images but is easy to overfit to the training data. It is critical for trained neural networks to be robust to variations that exist between training and test…

Computer Vision and Pattern Recognition · Computer Science 2019-09-25 Jiayun Wang , Patrick Virtue , Stella X. Yu

Deep convolutional networks have become a popular tool for image generation and restoration. Generally, their excellent performance is imputed to their ability to learn realistic image priors from a large number of example images. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Dmitry Ulyanov , Andrea Vedaldi , Victor Lempitsky

Recently, deep learning (DL) based image transmission at the physical layer (PL) has become a rising trend due to its ability to significantly outperform conventional separation-based digital transmissions. However, implementing solutions…

Information Theory · Computer Science 2024-09-06 Cenk M. Yetis

Recent advances in learning-based image compression typically come at the cost of high complexity. Designing computationally efficient architectures remains an open challenge. In this paper, we empirically investigate the impact of…

Image and Video Processing · Electrical Eng. & Systems 2024-06-18 Yichi Zhang , Zhihao Duan , Fengqing Zhu

Deep learning and deep architectures are emerging as the best machine learning methods so far in many practical applications such as reducing the dimensionality of data, image classification, speech recognition or object segmentation. In…

Machine Learning · Computer Science 2018-07-10 The-Hien Dang-Ha

Neural Architecture Search is a costly practice. The fact that a search space can span a vast number of design choices with each architecture evaluation taking nontrivial overhead makes it hard for an algorithm to sufficiently explore…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Keith G. Mills , Fred X. Han , Mohammad Salameh , Shengyao Lu , Chunhua Zhou , Jiao He , Fengyu Sun , Di Niu