English
Related papers

Related papers: Understanding Deep Neural Networks via Linear Sepa…

200 papers

Deep neural networks (DNNs) have achieved the state of the art performance in numerous fields. However, DNNs need high computation times, and people always expect better performance in a lower computation. Therefore, we study the human…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 H M Dipu Kabir , Moloud Abdar , Seyed Mohammad Jafar Jalali , Abbas Khosravi , Amir F Atiya , Saeid Nahavandi , Dipti Srinivasan

LBP is a successful hand-crafted feature descriptor in computer vision. However, in the deep learning era, deep neural networks, especially convolutional neural networks (CNNs) can automatically learn powerful task-aware features that are…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Zhuo Su , Matti Pietikäinen , Li Liu

While deep neural networks have succeeded in several visual applications, such as object recognition, detection, and localization, by reaching very high classification accuracies, it is important to note that many real-world applications…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Yu-An Chung , Shao-Wen Yang , Hsuan-Tien Lin

Neural networks are powerful models that solve a variety of complex real-world problems. However, the stochastic nature of training and large number of parameters in a typical neural model makes them difficult to evaluate via inspection.…

Machine Learning · Computer Science 2021-04-22 John Clemens

Deep networks for Monocular Depth Estimation (MDE) have achieved promising performance recently and it is of great importance to further understand the interpretability of these networks. Existing methods attempt to provide posthoc…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Zunzhi You , Yi-Hsuan Tsai , Wei-Chen Chiu , Guanbin Li

Deep Convolutional Neural Networks (CNN) enforces supervised information only at the output layer, and hidden layers are trained by back propagating the prediction error from the output layer without explicit supervision. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2016-06-07 Zhuolin Jiang , Yaming Wang , Larry Davis , Walt Andrews , Viktor Rozgic

Neural networks use their hidden layers to transform input data into linearly separable data clusters, with a linear or a perceptron type output layer making the final projection on the line perpendicular to the discriminating hyperplane.…

Machine Learning · Computer Science 2018-07-10 Wlodzislaw Duch

Convolutional neural networks have been proven effective in a variety of image restoration tasks. Most state-of-the-art solutions, however, are trained using images with a single particular degradation level, and their performance…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Yiwen Guo , Ming Lu , Wangmeng Zuo , Changshui Zhang , Yurong Chen

Nowadays, deep learning can be employed to a wide ranges of fields including medicine, engineering, etc. In deep learning, Convolutional Neural Network (CNN) is extensively used in the pattern and sequence recognition, video analysis,…

Computer Vision and Pattern Recognition · Computer Science 2019-02-06 Rezoana Bente Arif , Md. Abu Bakr Siddique , Mohammad Mahmudur Rahman Khan , Mahjabin Rahman Oishe

Depth separation results propose a possible theoretical explanation for the benefits of deep neural networks over shallower architectures, establishing that the former possess superior approximation capabilities. However, there are no known…

Machine Learning · Computer Science 2023-02-03 Itay Safran , Jason D. Lee

This paper reviews recent studies in understanding neural-network representations and learning neural networks with interpretable/disentangled middle-layer representations. Although deep neural networks have exhibited superior performance…

Computer Vision and Pattern Recognition · Computer Science 2018-02-08 Quanshi Zhang , Song-Chun Zhu

Deep neural networks have demonstrated highly competitive performance in super-resolution (SR) for natural images by learning mappings from low-resolution (LR) to high-resolution (HR) images. However, hyperspectral super-resolution remains…

Image and Video Processing · Electrical Eng. & Systems 2025-05-02 Usman Muhammad , Jorma Laaksonen , Lyudmila Mihaylova

With the rise of big data analytics, multi-layer neural networks have surfaced as one of the most powerful machine learning methods. However, their theoretical mathematical properties are still not fully understood. Training a neural…

Machine Learning · Computer Science 2021-01-01 Victor Luo , Yazhen Wang , Glenn Fung

Supervised training of neural networks for classification is typically performed with a global loss function. The loss function provides a gradient for the output layer, and this gradient is back-propagated to hidden layers to dictate an…

Machine Learning · Statistics 2019-05-09 Arild Nøkland , Lars Hiller Eidnes

Previous literature suggests that perceptual similarity is an emergent property shared across deep visual representations. Experiments conducted on a dataset of human-judged image distortions have proven that deep features outperform…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Simone Bianco , Luigi Celona , Paolo Napoletano

Deep kernel learning aims at designing nonlinear combinations of multiple standard elementary kernels by training deep networks. This scheme has proven to be effective, but intractable when handling large-scale datasets especially when the…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Mingyuan Jiu , Hichem Sahbi

In this paper, we consider the use of deep neural networks in the context of Multiple-Input-Multiple-Output (MIMO) detection. We give a brief introduction to deep learning and propose a modern neural network architecture suitable for this…

Machine Learning · Statistics 2017-06-06 Neev Samuel , Tzvi Diskin , Ami Wiesel

Deep neural networks (DNNs) demonstrate outstanding performance across most computer vision tasks. Some critical applications, such as autonomous driving or medical imaging, also require investigation into their behavior and the reasons…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Edouard Yvinec , Arnaud Dapogny , Kevin Bailly , Xavier Fischer

Title: Comparison between layer-to-layer network training and conventional network training using Deep Convolutional Neural Networks Abstract: Convolutional neural networks (CNNs) are widely used in various applications due to their…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Kiran Kumar Ashish Bhyravabhottla , WonSook Lee

Neural networks with at least two hidden layers are called deep networks. Recent developments in AI and computer programming in general has led to development of tools such as Tensorflow, Keras, NumPy etc. making it easier to model and draw…

Signal Processing · Electrical Eng. & Systems 2021-03-30 Ruthvik Vaila , Denver Lloyd , Kevin Tetz