English
Related papers

Related papers: Widely Linear Kernels for Complex-Valued Kernel Ac…

200 papers

A novel convolution neural network model, abbreviated NL-CNN is proposed, where nonlinear convolution is emulated in a cascade of convolution + nonlinearity layers. The code for its implementation and some trained models are made publicly…

Machine Learning · Computer Science 2021-02-03 Radu Dogaru , Ioana Dogaru

Different activation functions work best for different deep learning models. To exploit this, we leverage recent advancements in gradient-based search techniques for neural architectures to efficiently identify high-performing activation…

Machine Learning · Computer Science 2024-08-14 Lukas Strack , Mahmoud Safari , Frank Hutter

Deep learning models often function as black boxes, providing no straightforward reasoning for their predictions. This is particularly true for computer vision models, which process tensors of pixel values to generate outcomes in tasks such…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Sachin Karmani , Thanushon Sivakaran , Gaurav Prasad , Mehmet Ali , Wenbo Yang , Sheyang Tang

Deep convolutional neural networks (CNNs) have shown excellent performance in object recognition tasks and dense classification problems such as semantic segmentation. However, training deep neural networks on large and sparse datasets is…

Computer Vision and Pattern Recognition · Computer Science 2017-12-25 Lorenz Berger , Eoin Hyde , M. Jorge Cardoso , Sebastien Ourselin

The interpretation of deep learning models is a challenge due to their size, complexity, and often opaque internal state. In addition, many systems, such as image classifiers, operate on low-level features rather than high-level concepts.…

Machine Learning · Statistics 2019-04-05 Been Kim , Martin Wattenberg , Justin Gilmer , Carrie Cai , James Wexler , Fernanda Viegas , Rory Sayres

During the last years, Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance in image classification. Their architectures have largely drawn inspiration by models of the primate visual system. However, while recent…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Georgios Zoumpourlis , Alexandros Doumanoglou , Nicholas Vretos , Petros Daras

In recent years, deep neural networks (DNNs) achieved unprecedented performance in many low-level vision tasks. However, state-of-the-art results are typically achieved by very deep networks, which can reach tens of layers with tens of…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Idan Kligvasser , Tamar Rott Shaham , Tomer Michaeli

Binary neural networks (BNNs) have 1-bit weights and activations. Such networks are well suited for FPGAs, as their dominant computations are bitwise arithmetic and the memory requirement is also significantly reduced. However, compared to…

Machine Learning · Computer Science 2020-12-23 Yichi Zhang , Junhao Pan , Xinheng Liu , Hongzheng Chen , Deming Chen , Zhiru Zhang

Deep learning has been widely applied and brought breakthroughs in speech recognition, computer vision, and many other domains. The involved deep neural network architectures and computational issues have been well studied in machine…

Machine Learning · Computer Science 2018-07-23 Ding-Xuan Zhou

Deep Neural Networks (DNNs) are powerful algorithms that have been proven capable of extracting non-Gaussian information from weak lensing (WL) data sets. Understanding which features in the data determine the output of these nested,…

Cosmology and Nongalactic Astrophysics · Physics 2021-04-14 José Manuel Zorrilla Matilla , Manasi Sharma , Daniel Hsu , Zoltán Haiman

We propose a \emph{hybrid} real- and complex-valued \emph{neural network} (HNN) architecture, designed to combine the computational efficiency of real-valued processing with the ability to effectively handle complex-valued data. We…

Machine Learning · Computer Science 2025-04-07 Alex Young , Luan Vinícius Fiorio , Bo Yang , Boris Karanov , Wim van Houtum , Ronald M. Aarts

Convolutional Neural Networks (CNNs) are powerful models that achieve impressive results for image classification. In addition, pre-trained CNNs are also useful for other computer vision tasks as generic feature extractors. This paper aims…

Computer Vision and Pattern Recognition · Computer Science 2015-07-10 Ben Athiwaratkun , Keegan Kang

In this paper, we develop a wavelet-based theoretical framework for analyzing the universal approximation capabilities of neural networks over a wide range of activation functions. Leveraging wavelet frame theory on the spaces of…

Machine Learning · Computer Science 2025-04-24 Youngmi Hur , Hyojae Lim , Mikyoung Lim

Kernel matrices are crucial in many learning tasks such as support vector machines or kernel ridge regression. The kernel matrix is typically dense and large-scale. Depending on the dimension of the feature space even the computation of all…

Machine Learning · Computer Science 2023-12-04 Franziska Nestler , Martin Stoll , Theresa Wagner

Deep learning models suffer from opaqueness. For Convolutional Neural Networks (CNNs), current research strategies for explaining models focus on the target classes within the associated training dataset. As a result, the understanding of…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Xuehao Liu , Sarah Jane Delany , Susan McKeever

Networks are a powerful tool to model complex systems, and the definition of many Graph Neural Networks (GNN), Deep Learning algorithms that can handle networks, has opened a new way to approach many real-world problems that would be hardly…

Machine Learning · Computer Science 2021-09-28 Marco Grassia , Manlio De Domenico , Giuseppe Mangioni

Despite recent advances in multi-scale deep representations, their limitations are attributed to expensive parameters and weak fusion modules. Hence, we propose an efficient approach to fuse multi-scale deep representations, called…

Computer Vision and Pattern Recognition · Computer Science 2016-11-18 Yu Liu , Yanming Guo , Michael S. Lew

In this paper, the flexibility, versatility and predictive power of kernel regression are combined with now lavishly available network data to create regression models with even greater predictive performances. Building from previous work…

Machine Learning · Statistics 2020-11-05 E. Pei , E. Fokoué

Markov Random Fields (MRFs), a formulation widely used in generative image modeling, have long been plagued by the lack of expressive power. This issue is primarily due to the fact that conventional MRFs formulations tend to use simplistic…

Computer Vision and Pattern Recognition · Computer Science 2016-09-08 Zhirong Wu , Dahua Lin , Xiaoou Tang

Joint image filters are used to transfer structural details from a guidance picture used as a prior to a target image, in tasks such as enhancing spatial resolution and suppressing noise. Previous methods based on convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Beomjun Kim , Jean Ponce , Bumsub Ham