English
Related papers

Related papers: Neural Echos: Depthwise Convolutional Filters Repl…

200 papers

Artificial neural networks show promising performance in detecting correlations within data that are associated with specific outcomes. However, the black-box nature of such models can hinder the knowledge advancement in research fields by…

Machine Learning · Computer Science 2023-10-09 Jonas C. Ditz , Bernhard Reuter , Nico Pfeifer

Recently, deep feedforward neural networks have achieved considerable success in modeling biological sensory processing, in terms of reproducing the input-output map of sensory neurons. However, such models raise profound questions about…

Neurons and Cognition · Quantitative Biology 2019-12-16 Hidenori Tanaka , Aran Nayebi , Niru Maheswaranathan , Lane McIntosh , Stephen A. Baccus , Surya Ganguli

Deep learning is currently playing a crucial role toward higher levels of artificial intelligence. This paradigm allows neural networks to learn complex and abstract representations, that are progressively obtained by combining simpler…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-12 Mirco Ravanelli , Yoshua Bengio

We propose a novel approach to image classification inspired by complex nonlinear biological visual processing, whereby classical convolutional neural networks (CNNs) are equipped with learnable higher-order convolutions. Our model…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Simone Azeglio , Olivier Marre , Peter Neri , Ulisse Ferrari

Following the traditional paradigm of convolutional neural networks (CNNs), modern CNNs manage to keep pace with more recent, for example transformer-based, models by not only increasing model depth and width but also the kernel size. This…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Paul Gavrikov , Janis Keuper

Deep neural networks have recently achieved state of the art performance thanks to new training algorithms for rapid parameter estimation and new regularization methods to reduce overfitting. However, in practice the network architecture…

Machine Learning · Computer Science 2016-03-04 Minyoung Kim , Luca Rigazio

Deep neural network has been ensured as a key technology in the field of many challenging and vigorously researched computer vision tasks. Furthermore, classical ResNet is thought to be a state-of-the-art convolutional neural network (CNN)…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Prathibha Varghese , G. Arockia Selva Saroja

Substring kernels are classical tools for representing biological sequences or text. However, when large amounts of annotated data are available, models that allow end-to-end training such as neural networks are often preferred. Links…

Machine Learning · Statistics 2019-10-18 Dexiong Chen , Laurent Jacob , Julien Mairal

Deep convolutional neural networks (CNNs) trained on objects and scenes have shown intriguing ability to predict some response properties of visual cortical neurons. However, the factors and computations that give rise to such ability, and…

Neurons and Cognition · Quantitative Biology 2018-06-11 Md Nasir Uddin Laskar , Luis G Sanchez Giraldo , Odelia Schwartz

The visual system is hierarchically organized to process visual information in successive stages. Neural representations vary drastically across the first stages of visual processing: at the output of the retina, ganglion cell receptive…

Neurons and Cognition · Quantitative Biology 2019-01-07 Jack Lindsey , Samuel A. Ocko , Surya Ganguli , Stephane Deny

Deep convolutional neural networks have achieved impressive performance on a broad range of problems, beating prior art on established benchmarks, but it often remains unclear what are the representations learnt by those systems and how…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Sen He , Nicolas Pugeault

Neural implicit functions have achieved impressive results for reconstructing 3D shapes from single images. However, the image features for describing 3D point samplings of implicit functions are less effective when significant variations…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Yixin Zhuang , Yunzhe Liu , Yujie Wang , Baoquan Chen

Understanding how convolutional neural networks (CNNs) can efficiently learn high-dimensional functions remains a fundamental challenge. A popular belief is that these models harness the local and hierarchical structure of natural data such…

Machine Learning · Statistics 2023-06-02 Francesco Cagnetta , Alessandro Favero , Matthieu Wyart

Image reconstruction for positron emission tomography (PET) is challenging because of the ill-conditioned tomographic problem and low counting statistics. Kernel methods address this challenge by using kernel representation to incorporate…

Image and Video Processing · Electrical Eng. & Systems 2022-05-26 Siqi Li , Guobao Wang

Deep convolutional neural networks (DCNNs) have revolutionized computer vision and are often advocated as good models of the human visual system. However, there are currently many shortcomings of DCNNs, which preclude them as a model of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-19 Harshitha Machiraju , Oh-Hyeon Choung , Michael H. Herzog , Pascal Frossard

Exploiting data invariances is crucial for efficient learning in both artificial and biological neural circuits. Understanding how neural networks can discover appropriate representations capable of harnessing the underlying symmetries of…

Disordered Systems and Neural Networks · Physics 2022-10-17 Alessandro Ingrosso , Sebastian Goldt

Deep learning models have shown their superior performance in various vision tasks. However, the lack of precisely interpreting kernels in convolutional neural networks (CNNs) is becoming one main obstacle to wide applications of deep…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Jia-Xin Zhuang , Wanying Tao , Jianfei Xing , Wei Shi , Ruixuan Wang , Wei-shi Zheng

We present first empirical results from our ongoing investigation of distribution shifts in image data used for various computer vision tasks. Instead of analyzing the original training and test data, we propose to study shifts in the…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Paul Gavrikov , Janis Keuper

When optimizing convolutional neural networks (CNN) for a specific image-based task, specialists commonly overshoot the number of convolutional layers in their designs. By implication, these CNNs are unnecessarily resource intensive to…

Machine Learning · Computer Science 2022-06-23 Mats L. Richter , Julius Schöning , Anna Wiedenroth , Ulf Krumnack

Recognizing objects in natural images is an intricate problem involving multiple conflicting objectives. Deep convolutional neural networks, trained on large datasets, achieve convincing results and are currently the state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2017-10-09 Lars Hertel , Erhardt Barth , Thomas Käster , Thomas Martinetz