English
Related papers

Related papers: Learning 1D Causal Visual Representation with De-f…

200 papers

Learning an effective speaker representation is crucial for achieving reliable performance in speaker verification tasks. Speech signals are high-dimensional, long, and variable-length sequences containing diverse information at each…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-25 Wei Xia , John H. L. Hansen

Convolutional networks have been the paradigm of choice in many computer vision applications. The convolution operation however has a significant weakness in that it only operates on a local neighborhood, thus missing global information.…

Computer Vision and Pattern Recognition · Computer Science 2020-09-11 Irwan Bello , Barret Zoph , Ashish Vaswani , Jonathon Shlens , Quoc V. Le

Vision Transformer(ViT) is one of the most widely used models in the computer vision field with its great performance on various tasks. In order to fully utilize the ViT-based architecture in various applications, proper visualization…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Saebom Leem , Hyunseok Seo

Visual explanation enables human to understand the decision making of Deep Convolutional Neural Network (CNN), but it is insufficient to contribute the performance improvement. In this paper, we focus on the attention map for visual…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Hiroshi Fukui , Tsubasa Hirakawa , Takayoshi Yamashita , Hironobu Fujiyoshi

Causal Representation Learning (CRL) aims at identifying high-level causal factors and their relationships from high-dimensional observations, e.g., images. While most CRL works focus on learning causal representations in a single…

Machine Learning · Computer Science 2024-03-18 Davide Talon , Phillip Lippe , Stuart James , Alessio Del Bue , Sara Magliacane

Deep neural networks are able to solve tasks across a variety of domains and modalities of data. Despite many empirical successes, we lack the ability to clearly understand and interpret the learned internal mechanisms that contribute to…

Artificial Intelligence · Computer Science 2018-01-03 Christopher Grimm , Dilip Arumugam , Siddharth Karamcheti , David Abel , Lawson L. S. Wong , Michael L. Littman

Recently, learning-based approaches for 3D reconstruction from 2D images have gained popularity due to its modern applications, e.g., 3D printers, autonomous robots, self-driving cars, virtual reality, and augmented reality. The computer…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Andrey Salvi , Nathan Gavenski , Eduardo Pooch , Felipe Tasoniero , Rodrigo Barros

Learning disentangled representations from visual data, where different high-level generative factors are independently encoded, is of importance for many computer vision tasks. Solving this problem, however, typically requires to…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Adria Ruiz , Oriol Martinez , Xavier Binefa , Jakob Verbeek

Eye movements have been widely investigated to study the atypical visual attention in Autism Spectrum Disorder (ASD). The majority of these studies have been focused on limited eye movement features by statistical comparisons between ASD…

Image and Video Processing · Electrical Eng. & Systems 2019-11-27 Jin Xie , Longfei Wang , Paula Webster , Yang Yao , Jiayao Sun , Shuo Wang , Huihui Zhou

Visual attention has been extensively studied for learning fine-grained features in both facial expression recognition (FER) and Action Unit (AU) detection. A broad range of previous research has explored how to use attention modules to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Xiaotian Li , Zhihua Li , Huiyuan Yang , Geran Zhao , Lijun Yin

Autoregressive (AR) language models rely on causal tokenization, but extending this paradigm to vision remains non-trivial. Current visual tokenizers either flatten 2D patches into non-causal sequences or enforce heuristic orderings that…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Yitong Chen , Zuxuan Wu , Xipeng Qiu , Yu-Gang Jiang

Scene text recognition has been a hot topic in computer vision. Recent methods adopt the attention mechanism for sequence prediction which achieve convincing results. However, we argue that the existing attention mechanism faces the problem…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Zhi Qiao , Xugong Qin , Yu Zhou , Fei Yang , Weiping Wang

Causal representation learning aims to unveil latent high-level causal representations from observed low-level data. One of its primary tasks is to provide reliable assurance of identifying these latent causal models, known as…

Machine Learning · Computer Science 2024-12-02 Yuhang Liu , Zhen Zhang , Dong Gong , Mingming Gong , Biwei Huang , Anton van den Hengel , Kun Zhang , Javen Qinfeng Shi

In many problems, the measured variables (e.g., image pixels) are just mathematical functions of the latent causal variables (e.g., the underlying concepts or objects). For the purpose of making predictions in changing environments or…

Machine Learning · Computer Science 2024-08-13 Kun Zhang , Shaoan Xie , Ignavier Ng , Yujia Zheng

The latest generation of transformer-based vision models has proven to be superior to Convolutional Neural Network (CNN)-based models across several vision tasks, largely attributed to their remarkable prowess in relation modeling.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Quazi Mishkatul Alam , Bilel Tarchoun , Ihsen Alouani , Nael Abu-Ghazaleh

In this paper, we propose a Counterfactually Decoupled Attention Learning (CDAL) method for open-world model attribution. Existing methods rely on handcrafted design of region partitioning or feature space, which could be confounded by the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Yu Zheng , Boyang Gong , Fanye Kong , Yueqi Duan , Bingyao Yu , Wenzhao Zheng , Lei Chen , Jiwen Lu , Jie Zhou

When it comes to classifying child sexual abuse images, managing similar inter-class correlations and diverse intra-class correlations poses a significant challenge. Vision transformer models, unlike conventional deep convolutional network…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Hanxian He , Campbell Wilson , Thanh Thi Nguyen , Janis Dalins

Although group convolutional networks are able to learn powerful representations based on symmetry patterns, they lack explicit means to learn meaningful relationships among them (e.g., relative positions and poses). In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 David W. Romero , Erik J. Bekkers , Jakub M. Tomczak , Mark Hoogendoorn

We propose a novel framework to learn 3D point cloud semantics from 2D multi-view image observations containing pose error. On the one hand, directly learning from the massive, unstructured and unordered 3D point cloud is computationally…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Yuhang He , Lin Chen , Junkun Xie , Long Chen

One of the crucial challenges taken in document analysis is mathematical expression recognition. Unlike text recognition which only focuses on one-dimensional structure images, mathematical expression recognition is a much more complicated…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Anh Duy Le , Van Linh Pham , Vinh Loi Ly , Nam Quan Nguyen , Huu Thang Nguyen , Tuan Anh Tran