English
Related papers

Related papers: Depth and Representation in Vision Models

200 papers

Deep learning models extract, before a final classification layer, features or patterns which are key for their unprecedented advantageous performance. However, the process of complex nonlinear feature extraction is not well understood, a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Roozbeh Yousefzadeh , Furong Huang

Visual scene understanding often requires the processing of human-object interactions. Here we seek to explore if and how well Deep Neural Network (DNN) models capture features similar to the brain's representation of humans, objects, and…

Neurons and Cognition · Quantitative Biology 2019-11-07 Aditi Jha , Sumeet Agarwal

Artificial neural networks have recently shown great results in many disciplines and a variety of applications, including natural language understanding, speech processing, games and image data generation. One particular application in…

Computer Vision and Pattern Recognition · Computer Science 2018-03-07 Felix Altenberger , Claus Lenz

Learning the manifold structure of remote sensing images is of paramount relevance for modeling and understanding processes, as well as to encapsulate the high dimensionality in a reduced set of informative features for subsequent…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Gulsen Taskin , Gustau Camps-Valls

Many vision-related tasks benefit from reasoning over multiple modalities to leverage complementary views of data in an attempt to learn robust embedding spaces. Most deep learning-based methods rely on a late fusion technique whereby…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Austin Reiter , Menglin Jia , Pu Yang , Ser-Nam Lim

Vision Transformers (ViTs) are increasingly utilized in various computer vision tasks due to their powerful representation capabilities. However, it remains understudied how ViTs process information layer by layer. Numerous studies have…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Teresa Dorszewski , Lenka Tětková , Robert Jenssen , Lars Kai Hansen , Kristoffer Knutsen Wickstrøm

Despite tremendous progress over the past decade, deep learning methods generally fall short of human-level systematic generalization. It has been argued that explicitly capturing the underlying structure of data should allow connectionist…

Machine Learning · Computer Science 2023-04-26 Andrea Dittadi

Recently, Convolutional Neural Networks (CNNs) have achieved tremendous performances on face recognition, and one popular perspective regarding CNNs' success is that CNNs could learn discriminative face representations from face images with…

Machine Learning · Computer Science 2019-10-23 Qiulei Dong , Jiayin Sun , Zhanyi Hu

While visual imitation learning offers one of the most effective ways of learning from visual demonstrations, generalizing from them requires either hundreds of diverse demonstrations, task specific priors, or large, hard-to-train…

Robotics · Computer Science 2021-12-07 Jyothish Pari , Nur Muhammad Shafiullah , Sridhar Pandian Arunachalam , Lerrel Pinto

An evolving area of research in deep learning is the study of architectures and inductive biases that support the learning of relational feature representations. In this paper, we address the challenge of learning representations of…

Machine Learning · Computer Science 2024-09-30 Awni Altabaa , John Lafferty

Deep networks have shown impressive performance in the image restoration tasks, such as image colorization. However, we find that previous approaches rely on the digital representation from single color model with a specific mapping…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Xiangcheng Du , Zhao Zhou , Yanlong Wang , Zhuoyao Wang , Yingbin Zheng , Cheng Jin

Neural image classification models typically consist of two components. The first is an image encoder, which is responsible for encoding a given raw image into a representative vector. The second is the classification component, which is…

Machine Learning · Computer Science 2020-12-01 Gabi Shalev , Gal-Lev Shalev , Joseph Keshet

In this paper, we propose to exploit the rich hierarchical features of deep convolutional neural networks to improve the accuracy and robustness of visual tracking. Deep neural networks trained on object recognition datasets consist of…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Chao Ma , Jia-Bin Huang , Xiaokang Yang , Ming-Hsuan Yang

Implicit surface representations, such as signed-distance functions, combined with deep learning have led to impressive models which can represent detailed shapes of objects with arbitrary topology. Since a continuous function is learned,…

Computer Vision and Pattern Recognition · Computer Science 2021-02-08 Edgar Tretschk , Ayush Tewari , Vladislav Golyanik , Michael Zollhöfer , Carsten Stoll , Christian Theobalt

Visual localization techniques rely upon some underlying scene representation to localize against. These representations can be explicit such as 3D SFM map or implicit, such as a neural network that learns to encode the scene. The former…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Maxime Pietrantoni , Gabriela Csurka , Martin Humenberger , Torsten Sattler

Large transformers are powerful architectures used for self-supervised data analysis across various data types, including protein sequences, images, and text. In these models, the semantic structure of the dataset emerges from a sequence of…

Machine Learning · Computer Science 2023-10-31 Lucrezia Valeriani , Diego Doimo , Francesca Cuturello , Alessandro Laio , Alessio Ansuini , Alberto Cazzaniga

The paper proposes a novel technique for representing templates and instances of concept classes. A template representation refers to the generic representation that captures the characteristics of an entire class. The proposed technique…

Machine Learning · Computer Science 2020-07-08 Graham Spinks , Marie-Francine Moens

Deep neural networks have shown the ability to extract universal feature representations from data such as images and text that have been useful for a variety of learning tasks. However, the fruits of representation learning have yet to be…

Machine Learning · Computer Science 2023-03-28 Liam Collins , Hamed Hassani , Aryan Mokhtari , Sanjay Shakkottai

In an effort to understand the meaning of the intermediate representations captured by deep networks, recent papers have tried to associate specific semantic concepts to individual neural network filter responses, where interesting…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Ruth Fong , Andrea Vedaldi

Human visual perception carves a scene at its physical joints, decomposing the world into objects, which are selectively attended, tracked, and predicted as we engage our surroundings. Object representations emancipate perception from the…

Neurons and Cognition · Quantitative Biology 2021-09-09 Benjamin Peters , Nikolaus Kriegeskorte