English
Related papers

Related papers: Generalisation in humans and deep neural networks

200 papers

Deep Convolutional Neural Networks (CNNs) have long been the architecture of choice for computer vision tasks. Recently, Transformer-based architectures like Vision Transformer (ViT) have matched or even surpassed ResNets for image…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Srinadh Bhojanapalli , Ayan Chakrabarti , Daniel Glasner , Daliang Li , Thomas Unterthiner , Andreas Veit

Due to object detection's close relationship with video analysis and image understanding, it has attracted much research attention in recent years. Traditional object detection methods are built on handcrafted features and shallow trainable…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Zhong-Qiu Zhao , Peng Zheng , Shou-tao Xu , Xindong Wu

Deep neural networks (DNNs) are known to have a fundamental sensitivity to adversarial attacks, perturbations of the input that are imperceptible to humans yet powerful enough to change the visual decision of a model. Adversarial attacks…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Drew Linsley , Pinyuan Feng , Thibaut Boissin , Alekh Karkada Ashok , Thomas Fel , Stephanie Olaiya , Thomas Serre

Convolutional Neural Networks have become state of the art methods for image classification over the last couple of years. By now they perform better than human subjects on many of the image classification datasets. Most of these datasets…

Computer Vision and Pattern Recognition · Computer Science 2017-08-28 Sebastian Stabinger , Antonio Rodriguez-Sanchez

Training deep networks that generalize to a wide range of variations in test data is essential to building accurate and robust image classifiers. One standard strategy is to apply data augmentation to synthetically enlarge the training set.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-29 Yunhan Zhao , Ye Tian , Charless Fowlkes , Wei Shen , Alan Yuille

Adaptive gradient methods such as Adam have gained increasing popularity in deep learning optimization. However, it has been observed that compared with (stochastic) gradient descent, Adam can converge to a different solution with a…

Machine Learning · Computer Science 2021-08-26 Difan Zou , Yuan Cao , Yuanzhi Li , Quanquan Gu

Modern deep neural networks tend to be evaluated on static test sets. One shortcoming of this is the fact that these deep neural networks cannot be easily evaluated for robustness issues with respect to specific scene variations. For…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Nataniel Ruiz , Sarah Adel Bargal , Cihang Xie , Kate Saenko , Stan Sclaroff

Convolutional Neural Networks (CNNs) are commonly thought to recognise objects by learning increasingly complex representations of object shapes. Some recent studies suggest a more important role of image textures. We here put these…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Robert Geirhos , Patricia Rubisch , Claudio Michaelis , Matthias Bethge , Felix A. Wichmann , Wieland Brendel

Graph neural networks (GNNs) are an emerging model for learning graph embeddings and making predictions on graph structured data. However, robustness of graph neural networks is not yet well-understood. In this work, we focus on node…

Machine Learning · Computer Science 2019-12-24 James Fox , Sivasankaran Rajamanickam

Deep convolutional neural networks (DCNNs) have rivaled humans on many visual tasks, yet they remain vulnerable to near-imperceptible perturbations generated by adversarial attacks. Recent work shows that aligning DCNN representations with…

Neurons and Cognition · Quantitative Biology 2026-05-07 Zhenan Shao , Tianyu Ren , Chengxiao Wang , Leyla Isik , Diane M. Beck

Just like many other topics in computer vision, image classification has achieved significant progress recently by using deep-learning neural networks, especially the Convolutional Neural Networks (CNN). Most of the existing works are…

Computer Vision and Pattern Recognition · Computer Science 2018-10-15 Yanting Pei , Yaping Huang , Qi Zou , Hao Zang , Xingyuan Zhang , Song Wang

Despite the appeal of deep neural networks that largely replace the traditional handmade filters, they still suffer from isolated cases that cannot be properly handled only by the training of convolutional filters. Abnormal factors,…

Computer Vision and Pattern Recognition · Computer Science 2017-10-19 Jonghwa Yim , Kyung-Ah Sohn

Artificial neural networks have recently shown great results in many disciplines and a variety of applications, including natural language understanding, speech processing, games and image data generation. One particular application in…

Computer Vision and Pattern Recognition · Computer Science 2018-03-07 Felix Altenberger , Claus Lenz

The learning mechanisms by which humans acquire internal representations of objects are not fully understood. Deep neural networks (DNNs) have emerged as a useful tool for investigating this question, as they have internal representations…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Soh Takahashi , Masaru Sasaki , Ken Takeda , Masafumi Oizumi

Deep Convolutional Neural Networks (DCNNs) have demonstrated impressive robustness to recognize objects under transformations (eg. blur or noise) when these transformations are included in the training set. A hypothesis to explain such…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Hojin Jang , Syed Suleman Abbas Zaidi , Xavier Boix , Neeraj Prasad , Sharon Gilad-Gutnick , Shlomit Ben-Ami , Pawan Sinha

Visual object recognition systems need to generalize from a set of 2D training views to novel views. The question of how the human visual system can generalize to novel views has been studied and modeled in psychology, computer vision, and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Shoaib Ahmed Siddiqui , David Krueger , Thomas Breuel

The capability of Deep Neural Networks (DNNs) to recognize objects in orientations outside the distribution of the training data is not well understood. We present evidence that DNNs are capable of generalizing to objects in novel…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 Avi Cooper , Xavier Boix , Daniel Harari , Spandan Madan , Hanspeter Pfister , Tomotake Sasaki , Pawan Sinha

Advanced Driver Assistance Systems (ADAS) based on deep neural networks (DNNs) are widely used in autonomous vehicles for critical perception tasks such as object detection, semantic segmentation, and lane recognition. However, these…

Software Engineering · Computer Science 2025-01-22 Stefano Carlo Lambertenghi , Hannes Leonhard , Andrea Stocco

Deep learning models operating in the image domain are vulnerable to small input perturbations. For years, robustness to such perturbations was pursued by training models from scratch (i.e., with random initializations) using specialized…

Adversarial images are designed to mislead deep neural networks (DNNs), attracting great attention in recent years. Although several defense strategies achieved encouraging robustness against adversarial samples, most of them fail to…

Machine Learning · Computer Science 2020-02-25 Hang Yu , Aishan Liu , Xianglong Liu , Gengchao Li , Ping Luo , Ran Cheng , Jichen Yang , Chongzhi Zhang