English
Related papers

Related papers: An Impartial Take to the CNN vs Transformer Robust…

200 papers

Deep Convolutional Neural Networks (DCNNs) have demonstrated impressive robustness to recognize objects under transformations (eg. blur or noise) when these transformations are included in the training set. A hypothesis to explain such…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Hojin Jang , Syed Suleman Abbas Zaidi , Xavier Boix , Neeraj Prasad , Sharon Gilad-Gutnick , Shlomit Ben-Ami , Pawan Sinha

ConvNets and Imagenet have driven the recent success of deep learning for image classification. However, the marked slowdown in performance improvement combined with the lack of robustness of neural networks to adversarial examples and…

Machine Learning · Computer Science 2018-07-23 Pierre Stock , Moustapha Cisse

Deep neural networks (DNNs) have gained prominence in various applications, such as classification, recognition, and prediction, prompting increased scrutiny of their properties. A fundamental attribute of traditional DNNs is their…

Machine Learning · Computer Science 2023-08-15 Roman Garaev , Bader Rasheed , Adil Khan

Convolutional neural network (CNN) has drawn increasing interest in visual tracking owing to its powerfulness in feature extraction. Most existing CNN-based trackers treat tracking as a classification problem. However, these trackers are…

Computer Vision and Pattern Recognition · Computer Science 2017-05-02 Heng Fan , Haibin Ling

Most objects in the visual world are partially occluded, but humans can recognize them without difficulty. However, it remains unknown whether object recognition models like convolutional neural networks (CNNs) can handle real-world…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Hongru Zhu , Peng Tang , Jeongho Park , Soojin Park , Alan Yuille

Convolutional neural networks (CNNs) are able to attain better visual recognition performance than fully connected neural networks despite having much fewer parameters due to their parameter sharing principle. Modern architectures usually…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Ilke Cugu , Emre Akbas

A counter-intuitive property of convolutional neural networks (CNNs) is their inherent susceptibility to adversarial examples, which severely hinders the application of CNNs in security-critical fields. Adversarial examples are similar to…

Machine Learning · Computer Science 2022-07-27 Jiebao Zhang , Wenhua Qian , Rencan Nie , Jinde Cao , Dan Xu

Recently vision transformers have been shown to be competitive with convolution-based methods (CNNs) broadly across multiple vision tasks. The less restrictive inductive bias of transformers endows greater representational capacity in…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Farrukh Rahman , Ömer Mubarek , Zsolt Kira

In the realm of resource-constrained mobile vision tasks, the pursuit of efficiency and performance consistently drives innovation in lightweight Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs). While ViTs excel at…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Mingshu Zhao , Yi Luo , Yong Ouyang

As clean ImageNet accuracy nears its ceiling, the research community is increasingly more concerned about robust accuracy under distributional shifts. While a variety of methods have been proposed to robustify neural networks, these…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Yutaro Yamada , Mayu Otani

The rapid evolution of digital image manipulation techniques poses significant challenges for content verification, with models such as stable diffusion and mid-journey producing highly realistic, yet synthetic, images that can deceive…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Alejandro Marco Montejano , Angela Sanchez Perez , Javier Barrachina , David Ortiz-Perez , Manuel Benavent-Lledo , Jose Garcia-Rodriguez

Convolutional Neural Networks have achieved impressive results in various tasks, but interpreting the internal mechanism is a challenging problem. To tackle this problem, we exploit a multi-channel attention mechanism in feature space. Our…

Computer Vision and Pattern Recognition · Computer Science 2019-05-22 Masanari Kimura , Masayuki Tanaka

Convolutional Neural Networks (CNNs) have greatly influenced the field of Embedded Vision and Edge Artificial Intelligence (AI), enabling powerful machine learning capabilities on resource-constrained devices. This article explores the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Dwith Chenna

With neural networks being used to control safety-critical systems, they increasingly have to be both accurate (in the sense of matching inputs to outputs) and robust. However, these two properties are often at odds with each other and a…

Systems and Control · Electrical Eng. & Systems 2024-05-30 Ross Drummond , Chris Guiver , Matthew C. Turner

Convolutional neural networks (CNNs) have shown very promising performance in recent years for different problems, including object recognition, face recognition, medical image analysis, etc. However, generally the trained CNN models are…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Roshan Reddy Yedla , Shiv Ram Dubey

Connectivity robustness, a crucial aspect for understanding, optimizing, and repairing complex networks, has traditionally been evaluated through time-consuming and often impractical simulations. Fortunately, machine learning provides a new…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Wenjun Jiang , Tianlong Fan , Changhao Li , Chuanfu Zhang , Tao Zhang , Zong-fu Luo

Existing image recognition techniques based on convolutional neural networks (CNNs) basically assume that the training and test datasets are sampled from i.i.d distributions. However, this assumption is easily broken in the real world…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Kazuki Adachi , Shin'ya Yamaguchi

Transformers achieve state-of-the-art accuracy and robustness across many tasks, but an understanding of their inductive biases and how those biases differ from other neural network architectures remains elusive. In this work, we identify…

Machine Learning · Computer Science 2025-02-14 Bhavya Vasudeva , Deqing Fu , Tianyi Zhou , Elliott Kau , Youqi Huang , Vatsal Sharan

Convolutional neural networks (CNNs) trained on object recognition achieve high task performance but continue to exhibit vulnerability under a range of visual perturbations and out-of-domain images, when compared with biological vision.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Lucas Piper , Arlindo L. Oliveira , Tiago Marques

Vision Transformers have been rapidly uprising in computer vision thanks to their outstanding scaling trends, and gradually replacing convolutional neural networks (CNNs). Recent works on self-supervised learning (SSL) introduce siamese…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Tianjin Huang , Tianlong Chen , Zhangyang Wang , Shiwei Liu