English
Related papers

Related papers: Pretraining boosts out-of-domain robustness for po…

200 papers

This work considers the problem of domain shift in person re-identification.Being trained on one dataset, a re-identification model usually performs much worse on unseen data. Partially this gap is caused by the relatively small scale of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Vladislav Sovrasov , Dmitry Sidnev

Arguably one of the top success stories of deep learning is transfer learning. The finding that pre-training a network on a rich source set (eg., ImageNet) can help boost performance once fine-tuned on a usually much smaller target set, has…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Saining Xie , Jiatao Gu , Demi Guo , Charles R. Qi , Leonidas J. Guibas , Or Litany

Training large neural networks is possible by training a smaller hypernetwork that predicts parameters for the large ones. A recently released Graph HyperNetwork (GHN) trained this way on one million smaller ImageNet architectures is able…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Boris Knyazev

Adversarial patches are optimized contiguous pixel blocks in an input image that cause a machine-learning model to misclassify it. However, their optimization is computationally demanding, and requires careful hyperparameter tuning,…

Cryptography and Security · Computer Science 2025-01-16 Maura Pintor , Daniele Angioni , Angelo Sotgiu , Luca Demetrio , Ambra Demontis , Battista Biggio , Fabio Roli

For human pose estimation in still images, this paper proposes three semi- and weakly-supervised learning schemes. While recent advances of convolutional neural networks improve human pose estimation using supervised training data, our…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Norimichi Ukita , Yusuke Uematsu

Since the introduction of modern deep learning methods for object pose estimation, test accuracy and efficiency has increased significantly. For training, however, large amounts of annotated training data are required for good performance.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Frederik Hagelskjaer , Anders Glent Buch

The goal of 3D pose transfer is to transfer the pose from the source mesh to the target mesh while preserving the identity information (e.g., face, body shape) of the target mesh. Deep learning-based methods improved the efficiency and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Chaoyue Song , Jiacheng Wei , Ruibo Li , Fayao Liu , Guosheng Lin

Transfer learning is widely used to adapt large pretrained models to new tasks with only a small amount of new data. However, a challenge persists -- the features from the original task often do not fully cover what is needed for unseen…

Machine Learning · Computer Science 2026-02-10 Xingyu Alice Yang , Jianyu Zhang , Léon Bottou

ConvNets and Imagenet have driven the recent success of deep learning for image classification. However, the marked slowdown in performance improvement combined with the lack of robustness of neural networks to adversarial examples and…

Machine Learning · Computer Science 2018-07-23 Pierre Stock , Moustapha Cisse

Solving 6D pose estimation is non-trivial to cope with intrinsic appearance and shape variation and severe inter-object occlusion, and is made more challenging in light of extrinsic large illumination changes and low quality of the acquired…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Zelin Xu , Ke Chen , Kui Jia

Pose Machines provide a sequential prediction framework for learning rich implicit spatial models. In this work we show a systematic design for how convolutional networks can be incorporated into the pose machine framework for learning…

Computer Vision and Pattern Recognition · Computer Science 2016-04-13 Shih-En Wei , Varun Ramakrishna , Takeo Kanade , Yaser Sheikh

Deep neural networks demonstrate to have a high performance on image classification tasks while being more difficult to train. Due to the complexity and vanishing gradient problem, it normally takes a lot of time and more computational…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Mohammad Sadegh Ebrahimi , Hossein Karkeh Abadi

Deep neural networks are widely used in image classification problems. However, little work addresses how features from different deep neural networks affect the domain adaptation problem. Existing methods often extract deep features from…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Youshan Zhang , Brian D. Davison

Many real-world applications require recognition models that are robust to different operational conditions and modalities, but at the same time run on small embedded devices, with limited hardware. While for normal size models,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Srikanth Muralidharan , Heitor R. Medeiros , Masih Aminbeidokhti , Eric Granger , Marco Pedersoli

Computer vision applications predict on digital images acquired by a camera from physical scenes through light. However, conventional robustness benchmarks rely on perturbations in digitized images, diverging from distribution shifts…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Eunsu Baek , Keondo Park , Jiyoon Kim , Hyung-Sin Kim

This paper proposes a transfer learning approach to recalibrate our previously developed Wheel Odometry Neural Network (WhONet) for vehicle positioning in environments where Global Navigation Satellite Systems (GNSS) are unavailable. The…

Robotics · Computer Science 2022-09-14 Uche Onyekpe , Alicja Szkolnik , Vasile Palade , Stratis Kanarachos , Michael E. Fitzpatrick

The generalization capability of neural networks across domains is crucial for real-world applications. We argue that a generalized object recognition system should well understand the relationships among different images and also the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Shujun Wang , Lequan Yu , Caizi Li , Chi-Wing Fu , Pheng-Ann Heng

Transfer learning from supervised ImageNet models has been frequently used in medical image analysis. Yet, no large-scale evaluation has been conducted to benchmark the efficacy of newly-developed pre-training techniques for medical image…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Mohammad Reza Hosseinzadeh Taher , Fatemeh Haghighi , Ruibin Feng , Michael B. Gotway , Jianming Liang

In medical image segmentation tasks, the scarcity of labeled training data poses a significant challenge when training deep neural networks. When using U-Net-style architectures, it is common practice to address this problem by pretraining…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Gábor Hidy , Bence Bakos , András Lukács

This paper revisits camera pose estimation through the lens of self-supervised pretraining, focusing on inverse-dynamics pretraining as a scalable alternative to the current trend of fully supervised training with 3D annotations.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Zhengqing Wang , Saurabh Nair , Prajwal Chidananda , Pujith Kachana , Samuel Li , Matthew Brown , Yasutaka Furukawa