English
Related papers

Related papers: Generalisation in humans and deep neural networks

200 papers

Deep convolutional neural networks are generally regarded as robust function approximators. So far, this intuition is based on perturbations to external stimuli such as the images to be classified. Here we explore the robustness of…

Machine Learning · Computer Science 2017-03-27 Nicholas Cheney , Martin Schrimpf , Gabriel Kreiman

State-of-the art vision models can achieve superhuman performance on image classification tasks when testing and training data come from the same distribution. However, when models are tested on corrupted images (e.g. due to scale changes,…

Machine Learning · Computer Science 2019-06-11 Luke Metz , Niru Maheswaranathan , Jonathon Shlens , Jascha Sohl-Dickstein , Ekin D. Cubuk

While it is nearly effortless for humans to quickly assess the perceptual similarity between two images, the underlying processes are thought to be quite complex. Despite this, the most widely used perceptual metrics today, such as PSNR and…

Computer Vision and Pattern Recognition · Computer Science 2018-04-12 Richard Zhang , Phillip Isola , Alexei A. Efros , Eli Shechtman , Oliver Wang

Increasingly more similarities between human vision and convolutional neural networks (CNNs) have been revealed in the past few years. Yet, vanilla CNNs often fall short in generalizing to adversarial or out-of-distribution (OOD) examples…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Peijie Chen , Chirag Agarwal , Anh Nguyen

Deep neural networks (DNNs) have demonstrated impressive performance on a wide array of tasks, but they are usually considered opaque since internal structure and learned parameters are not interpretable. In this paper, we re-examine the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-21 Yinpeng Dong , Hang Su , Jun Zhu , Fan Bao

With the great capabilities of deep classifiers for radar data processing come the risks of learning dataset-specific features that do not generalize well. In this work, the robustness of two deep convolutional architectures, trained and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Mikolaj Czerkawski , Carmine Clemente , Craig Michie , Christos Tachtatzis

Complex visual scenes that are composed of multiple objects, each with attributes, such as object name, location, pose, color, etc., are challenging to describe in order to train neural networks. Usually,deep learning networks are trained…

Neural and Evolutionary Computing · Computer Science 2023-03-27 E. Paxon Frady , Spencer Kent , Quinn Tran , Pentti Kanerva , Bruno A. Olshausen , Friedrich T. Sommer

Modern artificial neural networks, including convolutional neural networks and vision transformers, have mastered several computer vision tasks, including object recognition. However, there are many significant differences between the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-26 Tiago Oliveira , Tiago Marques , Arlindo L. Oliveira

Image classification has achieved unprecedented advance with the the rapid development of deep learning. However, the classification of tiny object images is still not well investigated. In this paper, we first briefly review the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Ao Chen , Chen Li , Haoyuan Chen , Hechen Yang , Peng Zhao , Weiming Hu , Wanli Liu , Shuojia Zou , Marcin Grzegorzek

Although deep neural networks can achieve human-level performance on many object recognition benchmarks, prior work suggests that these same models fail to learn simple abstract relations, such as determining whether two objects are the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Alexa R. Tartaglini , Sheridan Feucht , Michael A. Lepori , Wai Keen Vong , Charles Lovering , Brenden M. Lake , Ellie Pavlick

With the proliferation of Deep Machine Learning into real-life applications, a particular property of this technology has been brought to attention: robustness Neural Networks notoriously present low robustness and can be highly sensitive…

Computation and Language · Computer Science 2022-07-14 Marco Casadio , Ekaterina Komendantskaya , Verena Rieser , Matthew L. Daggitt , Daniel Kienitz , Luca Arnaboldi , Wen Kokke

Computer vision using deep neural networks (DNNs) has brought about seminal changes in people's lives. Applications range from automotive, face recognition in the security industry, to industrial process monitoring. In some cases, DNNs…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Patrick Müller , Alexander Braun , Margret Keuper

Convolutional neural networks (CNNs) apply well with food image recognition due to the ability to learn discriminative visual features. Nevertheless, recognizing distorted images is challenging for existing CNNs. Hence, the study modelled a…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Ghalib Ahmed Tahir , Chu Kiong Loo , Zongying Liu

3D reconstruction is a longstanding ill-posed problem, which has been explored for decades by the computer vision, computer graphics, and machine learning communities. Since 2015, image-based 3D reconstruction using convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2019-11-28 Xian-Feng Han , Hamid Laga , Mohammed Bennamoun

A deep learning approach to blind denoising of images without complete knowledge of the noise statistics is considered. We propose DN-ResNet, which is a deep convolutional neural network (CNN) consisting of several residual blocks…

Image and Video Processing · Electrical Eng. & Systems 2019-04-12 Haoyu Ren , Mostafa El-Khamy , Jungwon Lee

Training deep neural models in the presence of corrupted supervision is challenging as the corrupted data points may significantly impact the generalization performance. To alleviate this problem, we present an efficient robust algorithm…

Machine Learning · Computer Science 2021-02-16 Boyang Liu , Mengying Sun , Ding Wang , Pang-Ning Tan , Jiayu Zhou

Deep neural networks have achieved remarkable results across many language processing tasks, however these methods are highly sensitive to noise and adversarial attacks. We present a regularization based method for limiting network…

Computation and Language · Computer Science 2016-09-21 Yitong Li , Trevor Cohn , Timothy Baldwin

Representation learning, i.e. the generation of representations useful for downstream applications, is a task of fundamental importance that underlies much of the success of deep neural networks (DNNs). Recently, robustness to adversarial…

Machine Learning · Computer Science 2022-09-16 Christian Cianfarani , Arjun Nitin Bhagoji , Vikash Sehwag , Ben Y. Zhao , Prateek Mittal , Haitao Zheng

Training images with data transformations have been suggested as contrastive examples to complement the testing set for generalization performance evaluation of deep neural networks (DNNs). In this work, we propose a practical framework…

Machine Learning · Computer Science 2021-06-22 Xuanyu Wu , Xuhong Li , Haoyi Xiong , Xiao Zhang , Siyu Huang , Dejing Dou

Learning-based methods especially with convolutional neural networks (CNN) are continuously showing superior performance in computer vision applications, ranging from image classification to restoration. For image classification, most…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Xiaoyu Lin