English
Related papers

Related papers: Unveiling the Backbone-Optimizer Coupling Bias in …

200 papers

While adversarial training is generally used as a defense mechanism, recent works show that it can also act as a regularizer. By co-training a neural network on clean and adversarial inputs, it is possible to improve classification accuracy…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Sylvestre-Alvise Rebuffi , Francesco Croce , Sven Gowal

Deep neural networks used in computer vision have been shown to exhibit many social biases such as gender bias. Vision Transformers (ViTs) have become increasingly popular in computer vision applications, outperforming Convolutional Neural…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Abhishek Mandal , Susan Leavy , Suzanne Little

Bird's-Eye-View (BEV) is critical to connected and automated vehicles (CAVs) as it can provide unified and precise representation of vehicular surroundings. However, quality of the raw sensing data may degrade in occluded or distant…

Networking and Internet Architecture · Computer Science 2025-12-23 Jiawei Hou , Peng Yang , Xiangxiang Dai , Mingliu Liu , Conghao Zhou

Predictive coding-inspired deep networks for visual computing integrate classification and reconstruction processes in shared intermediate layers. Although synergy between these processes is commonly assumed, it has yet to be convincingly…

Machine Learning · Computer Science 2024-01-18 Jan Rathjens , Laurenz Wiskott

The idea of using the recurrent neural network for visual attention has gained popularity in computer vision community. Although the recurrent attention model (RAM) leverages the glimpses with more large patch size to increasing its scope,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Gang Chen

Correlation filter has been proven to be an effective tool for a number of approaches in visual tracking, particularly for seeking a good balance between tracking accuracy and speed. However, correlation filter based models are susceptible…

Computer Vision and Pattern Recognition · Computer Science 2018-11-09 Yanchun Xie , Jimin Xiao , Kaizhu Huang , Jeyarajan Thiyagalingam , Yao Zhao

Deep neural networks set the state-of-the-art across many tasks in computer vision, but their generalization ability to image distortions is surprisingly fragile. In contrast, the mammalian visual system is robust to a wide range of…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Shahd Safarani , Arne Nix , Konstantin Willeke , Santiago A. Cadena , Kelli Restivo , George Denfield , Andreas S. Tolias , Fabian H. Sinz

Self-supervised monocular depth estimation has been widely studied recently. Most of the work has focused on improving performance on benchmark datasets, such as KITTI, but has offered a few experiments on generalization performance. In…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Jinwoo Bae , Sungho Moon , Sunghoon Im

Convolutional Neural Networks (CNNs) have dominated computer vision for years, due to its ability in capturing locality and translation invariance. Recently, many vision transformer architectures have been proposed and they show promising…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Pichao Wang , Xue Wang , Fan Wang , Ming Lin , Shuning Chang , Hao Li , Rong Jin

While deep learning models often achieve strong task performance, their successes are hampered by their inability to disentangle spurious correlations from causative factors, such as when they use protected attributes (e.g., race, gender,…

Machine Learning · Computer Science 2020-11-17 Kurtis Evan David , Qiang Liu , Ruth Fong

Bayesian optimization is a powerful method for optimizing black-box functions with limited function evaluations. Recent works have shown that optimization in a latent space through deep generative models such as variational autoencoders…

Machine Learning · Computer Science 2023-11-21 Seunghun Lee , Jaewon Chu , Sihyeon Kim , Juyeon Ko , Hyunwoo J. Kim

Deep convolutional neural networks (DCNNs) have dominated the recent developments in computer vision through making various record-breaking models. However, it is still a great challenge to achieve powerful DCNNs in resource-limited…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Jiaxin Gu , Junhe Zhao , Xiaolong Jiang , Baochang Zhang , Jianzhuang Liu , Guodong Guo , Rongrong Ji

Although transformer networks are recently employed in various vision tasks with outperforming performance, extensive training data and a lengthy training time are required to train a model to disregard an inductive bias. Using trainable…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Heegon Jin , Jongwon Choi

It is a challenging task to learn discriminative representation from images and videos, due to large local redundancy and complex global dependency in these visual data. Convolution neural networks (CNNs) and vision transformers (ViTs) have…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Kunchang Li , Yali Wang , Junhao Zhang , Peng Gao , Guanglu Song , Yu Liu , Hongsheng Li , Yu Qiao

Training vision transformer networks on small datasets poses challenges. In contrast, convolutional neural networks (CNNs) can achieve state-of-the-art performance by leveraging their architectural inductive bias. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Jianqiao Zheng , Xueqian Li , Simon Lucey

Since Convolutional Neural Networks (CNNs) have become the leading learning paradigm in visual recognition, Naive Bayes Nearest Neighbour (NBNN)-based classifiers have lost momentum in the community. This is because (1) such algorithms…

Computer Vision and Pattern Recognition · Computer Science 2015-11-18 Ilja Kuzborskij , Fabio Maria Carlucci , Barbara Caputo

Conventional learning methods simplify the bilinear model by regarding two intrinsically coupled factors independently, which degrades the optimization procedure. One reason lies in the insufficient training due to the asynchronous gradient…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Li'an Zhuo , Baochang Zhang , Linlin Yang , Hanlin Chen , Qixiang Ye , David Doermann , Guodong Guo , Rongrong Ji

Supervised deep convolutional neural networks (DCNNs) are currently one of the best computational models that can explain how the primate ventral visual stream solves object recognition. However, embodied cognition has not been considered…

Machine Learning · Computer Science 2021-06-21 Maytus Piriyajitakonkij , Sirawaj Itthipuripat , Theerawit Wilaiprasitporn , Nat Dilokthanakul

We propose a way to learn visual features that are compatible with previously computed ones even when they have different dimensions and are learned via different neural network architectures and loss functions. Compatible means that, if…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Yantao Shen , Yuanjun Xiong , Wei Xia , Stefano Soatto

It is now a standard for neural network representations to be trained on large, publicly available datasets, and used for new problems. The reasons for why neural network representations have been so successful for transfer, however, are…

Machine Learning · Computer Science 2022-09-20 Ehsan Imani , Wei Hu , Martha White