English
Related papers

Related papers: Are Deep Neural Architectures Losing Information? …

200 papers

Due to the advent of modern embedded systems and mobile devices with constrained resources, there is a great demand for incredibly efficient deep neural networks for machine learning purposes. There is also a growing concern of privacy and…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Priyank Kalgaonkar , Mohamed El-Sharkawy

Deep neural networks (DNN) have achieved unprecedented performance in computer-vision tasks almost ubiquitously in business, technology, and science. While substantial efforts are made to engineer highly accurate architectures and provide…

Image and Video Processing · Electrical Eng. & Systems 2022-09-08 Sumedha Singla

Deep learning models are nowadays broadly deployed to solve an incredibly large variety of tasks. Commonly, leveraging over the availability of "big data", deep neural networks are trained as black-boxes, minimizing an objective function at…

Machine Learning · Computer Science 2022-10-04 Enzo Tartaglione

Deep residual networks (ResNets) made a recent breakthrough in deep learning. The core idea of ResNets is to have shortcut connections between layers that allow the network to be much deeper while still being easy to optimize avoiding…

Computer Vision and Pattern Recognition · Computer Science 2018-04-30 Sam Leroux , Pavlo Molchanov , Pieter Simoens , Bart Dhoedt , Thomas Breuel , Jan Kautz

Deep neural networks excel in supervised learning tasks but are constrained by the need for extensive labeled data. Self-supervised learning emerges as a promising alternative, allowing models to learn without explicit labels. Information…

Machine Learning · Computer Science 2023-11-22 Ravid Shwartz-Ziv , Yann LeCun

We present a deep neural network-based approach to image quality assessment (IQA). The network is trained end-to-end and comprises ten convolutional layers and five pooling layers for feature extraction, and two fully connected layers for…

Computer Vision and Pattern Recognition · Computer Science 2017-12-11 Sebastian Bosse , Dominique Maniry , Klaus-Robert Müller , Thomas Wiegand , Wojciech Samek

Deep learning has made breakthroughs and substantial in many fields due to its powerful automatic representation capabilities. It has been proven that neural architecture design is crucial to the feature representation of data and the final…

Machine Learning · Computer Science 2021-03-03 Pengzhen Ren , Yun Xiao , Xiaojun Chang , Po-Yao Huang , Zhihui Li , Xiaojiang Chen , Xin Wang

A critical component to enabling intelligent reasoning in partially observable environments is memory. Despite this importance, Deep Reinforcement Learning (DRL) agents have so far used relatively simple memory architectures, with the main…

Machine Learning · Computer Science 2017-02-28 Emilio Parisotto , Ruslan Salakhutdinov

Deep learning models have proven to be successful in a wide range of machine learning tasks. Yet, they are often highly sensitive to perturbations on the input data which can lead to incorrect decisions with high confidence, hampering their…

Machine Learning · Computer Science 2023-06-13 Steffen Jung , Jovita Lukasik , Margret Keuper

Deep neural networks for computer vision are deployed in increasingly safety-critical and socially-impactful applications, motivating the need to close the gap in model performance under varied, naturally occurring imaging conditions.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Nathan Drenkow , Numair Sani , Ilya Shpitser , Mathias Unberath

One major challenge of disentanglement learning with variational autoencoders is the trade-off between disentanglement and reconstruction fidelity. Previous studies, which increase the information bottleneck during training, tend to lose…

Machine Learning · Computer Science 2023-10-05 Jiantao Wu , Shentong Mo , Xiang Yang , Muhammad Awais , Sara Atito , Xingshen Zhang , Lin Wang , Xiang Yang

Interleaving learning is a human learning technique where a learner interleaves the studies of multiple topics, which increases long-term retention and improves ability to transfer learned knowledge. Inspired by the interleaving learning…

Machine Learning · Computer Science 2021-03-15 Hao Ban , Pengtao Xie

Inverse problems exist in many domains such as phase imaging, image processing, and computer vision. These problems are often solved with application-specific algorithms, even though their nature remains the same: mapping input image(s) to…

Computational Physics · Physics 2021-10-22 Feng Wang , Alberto Eljarrat , Johannes Müller , Trond Henninen , Erni Rolf , Christoph Koch

We propose to learn a fully-convolutional network model that consists of a Chain of Identity Mapping Modules and residual on the residual architecture for image denoising. Our network structure possesses three distinctive features that are…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Saeed Anwar , Cong Phuoc Huynh , Fatih Porikli

Photoacoustic imaging (PAI) can image high-resolution structures of clinical interest such as vascularity in cancerous tumor monitoring. When imaging human subjects, geometric restrictions force limited-view data retrieval causing imaging…

Image and Video Processing · Electrical Eng. & Systems 2022-04-27 Rafael Orozco , Mathias Louboutin , Felix J. Herrmann

Classification using multimodal data arises in many machine learning applications. It is crucial not only to model cross-modal relationship effectively but also to ensure robustness against loss of part of data or modalities. In this paper,…

Machine Learning · Computer Science 2019-04-22 Jun-Ho Choi , Jong-Seok Lee

The influence of deep learning is continuously expanding across different domains, and its new applications are ubiquitous. The question of neural network design thus increases in importance, as traditional empirical approaches are reaching…

Neural and Evolutionary Computing · Computer Science 2021-01-29 Anton Muravev , Jenni Raitoharju , Moncef Gabbouj

Autoencoders are able to learn useful data representations in an unsupervised matter and have been widely used in various machine learning and computer vision tasks. In this work, we present methods to train Invertible Neural Networks…

Machine Learning · Computer Science 2023-03-22 The-Gia Leo Nguyen , Lynton Ardizzone , Ullrich Köthe

Recurrent neural networks are important tools for sequential data processing. However, they are notorious for problems regarding their training. Challenges include capturing complex relations between consecutive states and stability and…

Neural and Evolutionary Computing · Computer Science 2023-04-18 Łukasz Neumann , Łukasz Lepak , Paweł Wawrzyński

We consider the generic deep image enhancement problem where an input image is transformed into a perceptually better-looking image. Recent methods for image enhancement consider the problem by performing style transfer and image…

Computer Vision and Pattern Recognition · Computer Science 2020-12-14 Indra Deep Mastan , Shanmuganathan Raman