English
Related papers

Related papers: Understanding Invariance via Feedforward Inversion…

200 papers

In this contribution, we show how to incorporate prior knowledge to a deep neural network architecture in a principled manner. We enforce feature space invariances using a novel layer based on invariant integration. This allows us to…

Machine Learning · Computer Science 2020-04-21 Matthias Rath , Alexandru Paul Condurache

Despite the growing use of transformer models in computer vision, a mechanistic understanding of these networks is still needed. This work introduces a method to reverse-engineer Vision Transformers trained to solve image classification…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Martina G. Vilas , Timothy Schaumlöffel , Gemma Roig

We introduce a model-based image reconstruction framework with a convolution neural network (CNN) based regularization prior. The proposed formulation provides a systematic approach for deriving deep architectures for inverse problems with…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Hemant Kumar Aggarwal , Merry P. Mani , Mathews Jacob

To generalize well, classifiers must learn to be invariant to nuisance transformations that do not alter an input's class. Many problems have "class-agnostic" nuisance transformations that apply similarly to all classes, such as lighting…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Allan Zhou , Fahim Tajwar , Alexander Robey , Tom Knowles , George J. Pappas , Hamed Hassani , Chelsea Finn

Despite having excellent performances for a wide variety of tasks, modern neural networks are unable to provide a reliable confidence value allowing to detect misclassifications. This limitation is at the heart of what is known as an…

Machine Learning · Computer Science 2019-05-23 Jonathan Aigrain , Marcin Detyniecki

Deep-predictive-coding networks (DPCNs) are hierarchical, generative models. They rely on feed-forward and feed-back connections to modulate latent feature representations of stimuli in a dynamic and context-sensitive manner. A crucial…

Artificial Intelligence · Computer Science 2021-09-27 Isaac J. Sledge , Jose C. Principe

Deep convolutional networks have become a popular tool for image generation and restoration. Generally, their excellent performance is imputed to their ability to learn realistic image priors from a large number of example images. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Dmitry Ulyanov , Andrea Vedaldi , Victor Lempitsky

Despite the remarkable success of deep learning systems over the last decade, a key difference still remains between neural network and human decision-making: As humans, we cannot only form a decision on the spot, but also ponder,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Gregor Koehler , Tassilo Wald , Constantin Ulrich , David Zimmerer , Paul F. Jaeger , Jörg K. H. Franke , Simon Kohl , Fabian Isensee , Klaus H. Maier-Hein

Neural networks have emerged as powerful tools across various applications, yet their decision-making process often remains opaque, leading to them being perceived as "black boxes." This opacity raises concerns about their interpretability…

Machine Learning · Computer Science 2024-11-28 Pirzada Suhail , Hao Tang , Amit Sethi

Vision classifiers are often trained on proprietary datasets containing sensitive information, yet the models themselves are frequently shared openly under the privacy-preserving assumption. Although these models are assumed to protect…

Machine Learning · Computer Science 2025-02-04 Pirzada Suhail , Amit Sethi

Deep networks have shown great performance in classification tasks. However, the parameters learned by the classifier networks usually discard stylistic information of the input, in favour of information strictly relevant to classification.…

Neural and Evolutionary Computing · Computer Science 2018-03-07 Rey Wiyatno , Jeff Orchard

We present a new latent model of natural images that can be learned on large-scale datasets. The learning process provides a latent embedding for every image in the training dataset, as well as a deep convolutional network that maps the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 ShahRukh Athar , Evgeny Burnaev , Victor Lempitsky

Interferometric closure invariants, constructed from triangular loops of mixed Fourier components, capture calibration-independent information on source morphology. While a complete set of closure invariants is directly obtainable from…

Instrumentation and Methods for Astrophysics · Physics 2024-11-20 Samuel Lai , Nithyanandan Thyagarajan , O. Ivy Wong , Foivos Diakogiannis , Lucas Hoefs

During the training process, deep neural networks implicitly learn to represent the input data samples through a hierarchy of features, where the size of the hierarchy is determined by the number of layers. In this paper, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Florinel-Alin Croitoru , Diana-Nicoleta Grigore , Radu Tudor Ionescu

Convolutional Neural Networks are a well-known staple of modern image classification. However, it can be difficult to assess the quality and robustness of such models. Deep models are known to perform well on a given training and estimation…

Machine Learning · Statistics 2018-02-06 Alexey Chaplygin , Joshua Chacksfield

Features, logits, and labels are the three primary data when a sample passes through a deep neural network. Feature perturbation and label perturbation receive increasing attention in recent years. They have been proven to be useful in…

Machine Learning · Computer Science 2022-09-27 Mengyang Li , Fengguang Su , Ou Wu , Ji Zhang

Deep neural networks are vulnerable to adversarial attacks and hard to interpret because of their black-box nature. The recently proposed invertible network is able to accurately reconstruct the inputs to a layer from its outputs, thus has…

Machine Learning · Computer Science 2019-10-16 Juntang Zhuang , Nicha C. Dvornek , Xiaoxiao Li , Junlin Yang , James S. Duncan

Convolutional Neural Networks (CNNs) define an exceptionally powerful class of models for image classification, but the theoretical background and the understanding of how invariances to certain transformations are learned is limited. In a…

Computer Vision and Pattern Recognition · Computer Science 2018-03-19 Charlotte Bunne , Lukas Rahmann , Thomas Wolf

Fine-grained image search is still a challenging problem due to the difficulty in capturing subtle differences regardless of pose variations of objects from fine-grained categories. In practice, a dynamic inventory with new fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2018-07-09 Kevin Lin , Fan Yang , Qiaosong Wang , Robinson Piramuthu

This paper tackles the problem of learning a finer representation than the one provided by training labels. This enables fine-grained category retrieval of images in a collection annotated with coarse labels only. Our network is learned…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Hugo Touvron , Alexandre Sablayrolles , Matthijs Douze , Matthieu Cord , Hervé Jégou