English
Related papers

Related papers: Shortcut Learning Susceptibility in Vision Classif…

200 papers

Vision transformers (ViTs) have found only limited practical use in processing images, in spite of their state-of-the-art accuracy on certain benchmarks. The reason for their limited use include their need for larger training datasets and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-26 Pranav Jeevan , Amit sethi

It is known that humans display "shape bias" when classifying new items, i.e., they prefer to categorize objects based on their shape rather than color. Convolutional Neural Networks (CNNs) are also designed to take into account the spatial…

Computer Vision and Pattern Recognition · Computer Science 2018-03-22 Hossein Hosseini , Baicen Xiao , Mayoore Jaiswal , Radha Poovendran

Vision Transformers, ViTs, have emerged as a powerful alternative to convolutional neural networks, CNNs, in a variety of image-based tasks. While CNNs have previously been evaluated for their ability to perform graphical perception tasks,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Poonam Poonam , Pere-Pau Vázquez , Timo Ropinski

Learning harmful shortcuts such as spurious correlations and biases prevents deep neural networks from learning the meaningful and useful representations, thus jeopardizing the generalizability and interpretability of the learned…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Chong Ma , Lin Zhao , Yuzhong Chen , Lu Zhang , Zhenxiang Xiao , Haixing Dai , David Liu , Zihao Wu , Zhengliang Liu , Sheng Wang , Jiaxing Gao , Changhe Li , Xi Jiang , Tuo Zhang , Qian Wang , Dinggang Shen , Dajiang Zhu , Tianming Liu

We apply pre-trained architectures, originally developed for the ImageNet Large Scale Visual Recognition Challenge, for periocular recognition. These architectures have demonstrated significant success in various computer vision tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Fernando Alonso-Fernandez , Kevin Hernandez-Diaz , Prayag Tiwari , Josef Bigun

Convolutional Neural Networks (CNNs) have recently achieved remarkably strong performance on the practically important task of sentence classification (kim 2014, kalchbrenner 2014, johnson 2014). However, these models require practitioners…

Computation and Language · Computer Science 2016-04-08 Ye Zhang , Byron Wallace

Vision Transformer (ViT) has demonstrated significant potential in various vision tasks due to its strong ability in modelling long-range dependencies. However, such success is largely fueled by training on massive samples. In real…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Bowei Zhang , Yi Zhang

Deep learning models often rely only on a small set of features even when there is a rich set of predictive signals in the training data. This makes models brittle and sensitive to distribution shifts. In this work, we first examine vision…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Armand Mihai Nicolicioiu , Andrei Liviu Nicolicioiu , Bogdan Alexe , Damien Teney

Vision-language models (VLMs) have significantly improved the generalization capabilities of robotic manipulation. However, VLM-based systems often suffer from a lack of robustness, leading to unpredictable errors, particularly in scenarios…

Robotics · Computer Science 2026-03-17 Yayun He , Zuheng Kang , Botao Zhao , Zhouyin Wu , Junqing Peng , Jianzong Wang

Vision Transformer (ViT), a radically different architecture than convolutional neural networks offers multiple advantages including design simplicity, robustness and state-of-the-art performance on many vision tasks. However, in contrast…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Hanan Gani , Muzammal Naseer , Mohammad Yaqub

Recently, vision Transformers (ViTs) are developing rapidly and starting to challenge the domination of convolutional neural networks (CNNs) in the realm of computer vision (CV). With the general-purpose Transformer architecture replacing…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Haofei Zhang , Jiarui Duan , Mengqi Xue , Jie Song , Li Sun , Mingli Song

Although deep learning models in medical imaging often achieve excellent classification performance, they can rely on shortcut learning, exploiting spurious correlations or confounding factors that are not causally related to the target…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Sarah Müller , Philipp Berens

Place recognition is one of the most challenging problems in computer vision, and has become a key part in mobile robotics and autonomous driving applications for performing loop closure in visual SLAM systems. Moreover, the difficulty of…

Computer Vision and Pattern Recognition · Computer Science 2015-05-28 Ruben Gomez-Ojeda , Manuel Lopez-Antequera , Nicolai Petkov , Javier Gonzalez-Jimenez

Although convolutional neural networks (CNNs) showed remarkable results in many vision tasks, they are still strained by simple yet challenging visual reasoning problems. Inspired by the recent success of the Transformer network in computer…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Nicola Messina , Giuseppe Amato , Fabio Carrara , Claudio Gennaro , Fabrizio Falchi

Vision Transformers (ViTs) are increasingly utilized in various computer vision tasks due to their powerful representation capabilities. However, it remains understudied how ViTs process information layer by layer. Numerous studies have…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Teresa Dorszewski , Lenka Tětková , Robert Jenssen , Lars Kai Hansen , Kristoffer Knutsen Wickstrøm

Semantic segmentation has a broad range of applications in a variety of domains including land coverage analysis, autonomous driving, and medical image analysis. Convolutional neural networks (CNN) and Vision Transformers (ViTs) provide the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Hans Thisanke , Chamli Deshan , Kavindu Chamith , Sachith Seneviratne , Rajith Vidanaarachchi , Damayanthi Herath

Visual interpretability of Convolutional Neural Networks (CNNs) has gained significant popularity because of the great challenges that CNN complexity imposes to understanding their inner workings. Although many techniques have been proposed…

Computer Vision and Pattern Recognition · Computer Science 2021-02-01 Alexandros Stergiou

While existing social bot detectors perform well on benchmarks, their robustness across diverse real-world scenarios remains limited due to unclear ground truth and varied misleading cues. In particular, the impact of shortcut learning,…

Computation and Language · Computer Science 2026-03-24 Shiyan Zheng , Herun Wan , Minnan Luo , Junhang Huang

Common deep neural networks (DNNs) for image classification have been shown to rely on shortcut opportunities (SO) in the form of predictive and easy-to-represent visual factors. This is known as shortcut learning and leads to impaired…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Elias Eulig , Piyapat Saranrittichai , Chaithanya Kumar Mummadi , Kilian Rambach , William Beluch , Xiahan Shi , Volker Fischer

Understanding how humans and machines learn from sparse data is central to cognitive science and machine learning. Using a species-fair design, we compare children and convolutional neural networks (CNNs) in a few-shot semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Fanxiao Wani Qiu , Oscar Leong