English
Related papers

Related papers: Optimal Density Functions for Weighted Convolution…

200 papers

Generally, convolutional neural networks (CNNs) process data on a regular grid, e.g. data generated by ordinary cameras. Designing CNNs for sparse and irregularly spaced input data is still an open research problem with numerous…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Abdelrahman Eldesokey , Michael Felsberg , Fahad Shahbaz Khan

The rise of machine learning in image processing has created a gap between trainable data-driven and classical model-driven approaches: While learning-based models often show superior performance, classical ones are often more transparent.…

Image and Video Processing · Electrical Eng. & Systems 2020-04-15 Tobias Alt , Joachim Weickert

In this survey paper, we review recent uses of convolution neural networks (CNNs) to solve inverse problems in imaging. It has recently become feasible to train deep CNNs on large databases of images, and they have shown outstanding…

Image and Video Processing · Electrical Eng. & Systems 2018-09-11 Michael T. McCann , Kyong Hwan Jin , Michael Unser

Deep learning based methods have seen a massive rise in popularity for hyperspectral image classification over the past few years. However, the success of deep learning is attributed greatly to numerous labeled samples. It is still very…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Bing Liu , Anzhu Yu , Pengqiang Zhang , Lei Ding , Wenyue Guo , Kuiliang Gao , Xibing Zuo

Deepening and widening convolutional neural networks (CNNs) significantly increases the number of trainable weight parameters by adding more convolutional layers and feature maps per layer, respectively. By imposing inter- and intra-group…

Computer Vision and Pattern Recognition · Computer Science 2019-12-18 Kevin Bui , Fredrick Park , Shuai Zhang , Yingyong Qi , Jack Xin

With the development of deep learning, the performance of hyperspectral image (HSI) classification has been greatly improved in recent years. The shortage of training samples has become a bottleneck for further improvement of performance.…

Computer Vision and Pattern Recognition · Computer Science 2018-03-01 Yanan Luo , Jie Zou , Chengfei Yao , Tao Li , Gang Bai

It is always a hot and difficult point to improve the accuracy of convolutional neural network model and speed up its convergence. Based on the idea of small world network, a random edge adding algorithm is proposed to improve the…

Neural and Evolutionary Computing · Computer Science 2020-09-01 Xuanyu Shu , Jin Zhang , Sen Tian , Sheng chen , Lingyu Chen

We propose a fast and scalable algorithm to project a given density on a set of structured measures defined over a compact 2D domain. The measures can be discrete or supported on curves for instance. The proposed principle and algorithm are…

Numerical Analysis · Mathematics 2019-02-05 Frédéric de Gournay , Jonas Kahn , Léo Lebrat , Pierre Weiss

The convolution operation is a central building block of neural network architectures widely used in computer vision. The size of the convolution kernels determines both the expressiveness of convolutional neural networks (CNN), as well as…

Image and Video Processing · Electrical Eng. & Systems 2022-10-10 Tianyu Ma , Adrian V. Dalca , Mert R. Sabuncu

Weight-sharing is ubiquitous in deep learning. Motivated by this, we propose a "weight-sharing regularization" penalty on the weights $w \in \mathbb{R}^d$ of a neural network, defined as $\mathcal{R}(w) = \frac{1}{d - 1}\sum_{i > j}^d |w_i…

Machine Learning · Computer Science 2024-03-12 Mehran Shakerinava , Motahareh Sohrabi , Siamak Ravanbakhsh , Simon Lacoste-Julien

Visual error metrics play a fundamental role in the quantification of perceived image similarity. Most recently, use cases for them in real-time applications have emerged, such as content-adaptive shading and shading reuse to increase…

Graphics · Computer Science 2023-10-16 João Libório Cardoso , Bernhard Kerbl , Lei Yang , Yury Uralsky , Michael Wimmer

Convolutional Neural Networks (CNNs) do not have a predictable recognition behavior with respect to the input resolution change. This prevents the feasibility of deployment on different input image resolutions for a specific model. To…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Duo Li , Anbang Yao , Qifeng Chen

The history of deep learning has shown that human-designed problem-specific networks can greatly improve the classification performance of general neural models. In most practical cases, however, choosing the optimal architecture for a…

Machine Learning · Computer Science 2020-09-14 Nicolo Colombo , Yang Gao

This paper seeks to answer the question: as the (near-) orthogonality of weights is found to be a favorable property for training deep convolutional neural networks, how can we enforce it in more effective and easy-to-use ways? We develop…

Machine Learning · Computer Science 2018-10-23 Nitin Bansal , Xiaohan Chen , Zhangyang Wang

Neural networks have shown tremendous potential for reconstructing high-resolution images in inverse problems. The non-convex and opaque nature of neural networks, however, hinders their utility in sensitive applications such as medical…

Machine Learning · Computer Science 2020-12-10 Arda Sahiner , Morteza Mardani , Batu Ozturkler , Mert Pilanci , John Pauly

Saliency prediction can be of great benefit for 360-degree image/video applications, including compression, streaming , rendering and viewpoint guidance. It is therefore quite natural to adapt the 2D saliency prediction methods for…

Image and Video Processing · Electrical Eng. & Systems 2020-02-24 Ibrahim Djemai , Sid Fezza , Wassim Hamidouche , Olivier Deforges

Deep Neural Networks (DNNs) are computationally and memory intensive, which makes their hardware implementation a challenging task especially for resource constrained devices such as IoT nodes. To address this challenge, this paper…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Mohammed F. Tolba , Huruy Tekle Tesfai , Hani Saleh , Baker Mohammad , Mahmoud Al-Qutayri

Image denoising is an essential tool in computational photography. Standard denoising techniques, which use deep neural networks at their core, require pairs of clean and noisy images for its training. If we do not possess the clean…

Image and Video Processing · Electrical Eng. & Systems 2020-08-26 David Honzátko , Siavash A. Bigdeli , Engin Türetken , L. Andrea Dunbar

In this paper, we consider reinforcement learning of nonlinear systems with continuous state and action spaces. We present an episodic learning algorithm, where we for each episode use convex optimization to find a two-layer neural network…

Optimization and Control · Mathematics 2024-06-25 Ather Gattami

The purpose of feature extraction on convolutional neural networks is to reuse deep representations learnt for a pre-trained model to solve a new, potentially unrelated problem. However, raw feature extraction from all layers is unfeasible…

Neural and Evolutionary Computing · Computer Science 2019-11-11 Victor Gimenez-Abalos , Armand Vilalta , Dario Garcia-Gasulla , Jesus Labarta , Eduard Ayguadé