English
Related papers

Related papers: Learning robust visual representations using data …

200 papers

Despite the high performance achieved by deep neural networks on various tasks, extensive studies have demonstrated that small tweaks in the input could fail the model predictions. This issue of deep neural networks has led to a number of…

Machine Learning · Computer Science 2022-02-22 Ming-Chang Chiu , Xuezhe Ma

Deep artificial neural networks require a large corpus of training data in order to effectively learn, where collection of such training data is often expensive and laborious. Data augmentation overcomes this issue by artificially inflating…

Machine Learning · Computer Science 2017-08-22 Luke Taylor , Geoff Nitschke

Supervised deep convolutional neural networks (DCNNs) are currently one of the best computational models that can explain how the primate ventral visual stream solves object recognition. However, embodied cognition has not been considered…

Machine Learning · Computer Science 2021-06-21 Maytus Piriyajitakonkij , Sirawaj Itthipuripat , Theerawit Wilaiprasitporn , Nat Dilokthanakul

Achieving invariance to nuisance transformations is a fundamental challenge in the construction of robust and reliable vision systems. Existing approaches to invariance scale exponentially with the dimension of the family of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Sam Buchanan , Jingkai Yan , Ellie Haber , John Wright

Data augmentation is commonly applied to improve performance of deep learning by enforcing the knowledge that certain transformations on the input preserve the output. Currently, the data augmentation parameters are chosen by human effort…

In many classification problems, we want a classifier that is robust to a range of non-semantic transformations. For example, a human can identify a dog in a picture regardless of the orientation and pose in which it appears. There is…

Machine Learning · Computer Science 2021-12-20 Scott Mahan , Tim Doster , Henry Kvinge

To perform well on unseen and potentially out-of-distribution samples, it is desirable for machine learning models to have a predictable response with respect to transformations affecting the factors of variation of the input. Here, we…

Computer Vision and Pattern Recognition · Computer Science 2021-11-17 Diane Bouchacourt , Mark Ibrahim , Ari S. Morcos

Equivariance w.r.t. geometric transformations in neural networks improves data efficiency, parameter efficiency and robustness to out-of-domain perspective shifts. When equivariance is not designed into a neural network, the network can…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Robert-Jan Bruintjes , Tomasz Motyka , Jan van Gemert

Self-supervised learning is a powerful paradigm for representation learning on unlabelled images. A wealth of effective new methods based on instance matching rely on data-augmentation to drive learning, and these have reached a rough…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Linus Ericsson , Henry Gouk , Timothy M. Hospedales

Previous robustness approaches for deep learning models such as data augmentation techniques via data transformation or adversarial training cannot capture real-world variations that preserve the semantics of the input, such as a change in…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Shuo Wang , Lingjuan Lyu , Surya Nepal , Carsten Rudolph , Marthie Grobler , Kristen Moore

In this work, we address the problem of improvement of robustness of feature representations learned using convolutional neural networks (CNNs) to image deformation. We argue that higher moment statistics of feature distributions could be…

Computer Vision and Pattern Recognition · Computer Science 2017-07-26 Zhun Sun , Mete Ozay , Takayuki Okatani

While agents trained by Reinforcement Learning (RL) can solve increasingly challenging tasks directly from visual observations, generalizing learned skills to novel environments remains very challenging. Extensive use of data augmentation…

Machine Learning · Computer Science 2021-12-10 Nicklas Hansen , Hao Su , Xiaolong Wang

Data augmentation is a popular technique largely used to enhance the training of convolutional neural networks. Although many of its benefits are well known by deep learning researchers and practitioners, its implicit regularization…

Computer Vision and Pattern Recognition · Computer Science 2019-06-27 Alex Hernández-García , Peter König

Despite the impressive progress brought by deep network in visual object recognition, robot vision is still far from being a solved problem. The most successful convolutional architectures are developed starting from ImageNet, a large scale…

Computer Vision and Pattern Recognition · Computer Science 2017-05-08 Antonio D'Innocente , Fabio Maria Carlucci , Mirco Colosi , Barbara Caputo

While some convolutional neural networks (CNNs) have achieved great success in object recognition, they struggle to identify objects in images corrupted with different types of common noise patterns. Recently, it was shown that simulating…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Ruxandra Barbulescu , Tiago Marques , Arlindo L. Oliveira

The primate visual system achieves remarkable visual object recognition performance even in brief presentations and under changes to object exemplar, geometric transformations, and background variation (a.k.a. core visual object…

Neurons and Cognition · Quantitative Biology 2015-06-19 Charles F. Cadieu , Ha Hong , Daniel L. K. Yamins , Nicolas Pinto , Diego Ardila , Ethan A. Solomon , Najib J. Majaj , James J. DiCarlo

Transformation invariances are present in many real-world problems. For example, image classification is usually invariant to rotation and color transformation: a rotated car in a different color is still identified as a car. Data…

Machine Learning · Computer Science 2022-11-04 Han Shao , Omar Montasser , Avrim Blum

Deep neural networks set the state-of-the-art across many tasks in computer vision, but their generalization ability to image distortions is surprisingly fragile. In contrast, the mammalian visual system is robust to a wide range of…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Shahd Safarani , Arne Nix , Konstantin Willeke , Santiago A. Cadena , Kelli Restivo , George Denfield , Andreas S. Tolias , Fabian H. Sinz

Decades of psychological research have been aimed at modeling how people learn features and categories. The empirical validation of these theories is often based on artificial stimuli with simple representations. Recently, deep neural…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Joshua C. Peterson , Joshua T. Abbott , Thomas L. Griffiths

Humans effortlessly navigate the dynamic visual world, yet deep neural networks (DNNs), despite excelling at many visual tasks, are surprisingly vulnerable to minor image perturbations. Past theories suggest that human visual robustness…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Zhenan Shao , Linjian Ma , Yiqing Zhou , Yibo Jacky Zhang , Sanmi Koyejo , Bo Li , Diane M. Beck