English
Related papers

Related papers: The role of invariance in spectral complexity-base…

200 papers

Convolutional Neural Networks (CNN) have been pivotal to the success of many state-of-the-art classification problems, in a wide variety of domains (for e.g. vision, speech, graphs and medical imaging). A commonality within those domains is…

Machine Learning · Computer Science 2019-12-02 Rohan Ghosh , Anupam K. Gupta , Mehul Motani

Systematic relations between multiple objects that occur in various fields can be represented as networks. Real-world networks typically exhibit complex topologies whose structural properties are key factors in characterizing and further…

Physics and Society · Physics 2021-04-09 Yoshihisa Tanaka , Ryosuke Kojima , Shoichi Ishida , Fumiyoshi Yamashita , Yasushi Okuno

One hypothesis for the success of deep neural networks (DNNs) is that they are highly expressive, which enables them to be applied to many problems, and they have a strong inductive bias towards solutions that are simple, known as…

Quantum Physics · Physics 2024-07-04 Jessica Pointing

In this proceeding we give an overview of the idea of covariance (or equivariance) featured in the recent development of convolutional neural networks (CNNs). We study the similarities and differences between the use of covariance in…

Machine Learning · Computer Science 2019-06-07 Miranda C. N. Cheng , Vassilis Anagiannis , Maurice Weiler , Pim de Haan , Taco S. Cohen , Max Welling

Convolutional neural networks (CNN) have been successful in machine learning applications. Their success relies on their ability to consider space invariant local features. We consider the use of CNN to fit nuisance models in semiparametric…

Machine Learning · Statistics 2025-09-08 Mohammad Ghasempour , Niloofar Moosavi , Xavier de Luna

Graph Neural Networks (GNNs) are able to achieve high classification accuracy on many important real world datasets, but provide no rigorous notion of predictive uncertainty. Quantifying the confidence of GNN models is difficult due to the…

Machine Learning · Statistics 2024-01-10 Jase Clarkson

Infinite width limits of deep neural networks often have tractable forms. They have been used to analyse the behaviour of finite networks, as well as being useful methods in their own right. When investigating infinitely wide convolutional…

Machine Learning · Statistics 2021-06-15 Adrià Garriga-Alonso , Mark van der Wilk

Modern convolutional neural networks (CNNs) are able to achieve human-level object classification accuracy on specific tasks, and currently outperform competing models in explaining complex human visual representations. However, the…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Joshua C. Peterson , Paul Soulos , Aida Nematzadeh , Thomas L. Griffiths

Graph spectra are an important class of structural features on graphs that have shown promising results in enhancing Graph Neural Networks (GNNs). Despite their widespread practical use, the theoretical understanding of the power of…

Machine Learning · Computer Science 2025-03-04 Jingchu Gai , Yiheng Du , Bohang Zhang , Haggai Maron , Liwei Wang

Convolutional neural networks (CNNs) tend to become a standard approach to solve a wide array of computer vision problems. Besides important theoretical and practical advances in their design, their success is built on the existence of…

Computer Vision and Pattern Recognition · Computer Science 2015-12-08 Adrian Popescu , Etienne Gadeski , Hervé Le Borgne

Recent reports suggest that a generic supervised deep CNN model trained on a large-scale dataset reduces, but does not remove, dataset bias on a standard benchmark. Fine-tuning deep models in a new domain can require a significant amount of…

Computer Vision and Pattern Recognition · Computer Science 2014-12-12 Eric Tzeng , Judy Hoffman , Ning Zhang , Kate Saenko , Trevor Darrell

While the success of deep neural networks (DNNs) is well-established across a variety of domains, our ability to explain and interpret these methods is limited. Unlike previously proposed local methods which try to explain particular…

Machine Learning · Statistics 2020-04-29 Jonathan Ish-Horowicz , Dana Udwin , Seth Flaxman , Sarah Filippi , Lorin Crawford

We study the phenomenon that some modules of deep neural networks (DNNs) are more critical than others. Meaning that rewinding their parameter values back to initialization, while keeping other modules fixed at the trained parameters,…

Machine Learning · Computer Science 2020-02-18 Niladri S. Chatterji , Behnam Neyshabur , Hanie Sedghi

Steerable convolutional neural networks (SCNNs) enhance task performance by modelling geometric symmetries through equivariance constraints on weights. Yet, unknown or varying symmetries can lead to overconstrained weights and decreased…

Machine Learning · Computer Science 2025-05-09 Lars Veefkind , Gabriele Cesa

Convolutional Neural Network (CNN) features have been successfully employed in recent works as an image descriptor for various vision tasks. But the inability of the deep CNN features to exhibit invariance to geometric transformations and…

Computer Vision and Pattern Recognition · Computer Science 2015-04-27 Konda Reddy Mopuri , R. Venkatesh Babu

Neural networks, especially convolutional neural networks (CNN), are one of the most common tools these days used in computer vision. Most of these networks work with real-valued data using real-valued features. Complex-valued convolutional…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Soumick Chatterjee , Pavan Tummala , Oliver Speck , Andreas Nürnberger

Convolutional Neural Networks (CNNs) work very well for supervised learning problems when the training dataset is representative of the variations expected to be encountered at test time. In medical image segmentation, this premise is…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Neerav Karani , Ertunc Erdil , Krishna Chaitanya , Ender Konukoglu

Deep neural networks (DNNs) have the capacity to fit extremely noisy labels nonetheless they tend to learn data with clean labels first and then memorize those with noisy labels. We examine this behavior in light of the Shannon entropy of…

Machine Learning · Computer Science 2021-04-28 Hao Wu , Jiangchao Yao , Jiajie Wang , Yinru Chen , Ya Zhang , Yanfeng Wang

We conduct an empirical study to test the ability of Convolutional Neural Networks (CNNs) to reduce the effects of nuisance transformations of the input data, such as location, scale and aspect ratio. We isolate factors by adopting a common…

Computer Vision and Pattern Recognition · Computer Science 2016-04-29 Nikolaos Karianakis , Jingming Dong , Stefano Soatto

The usual figure of merit characterizing the performance of neural networks applied to problems in the quantum domain is their accuracy, being the probability of a correct answer on a previously unseen input. Here we append this parameter…

Quantum Physics · Physics 2022-12-29 Jan Wasilewski , Tomasz Paterek , Karol Horodecki