English
Related papers

Related papers: Adapt, But Don't Forget: Fine-Tuning and Contrasti…

200 papers

This paper focuses on two crucial issues in domain-adaptive lane detection, i.e., how to effectively learn discriminative features and transfer knowledge across domains. Existing lane detection methods usually exploit a pixel-wise…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Kunyang Zhou , Yunjian Feng , Jun Li

Foundation models have recently gained attention within the field of machine learning thanks to its efficiency in broad data processing. While researchers had attempted to extend this success to time series models, the main challenge is…

Machine Learning · Computer Science 2023-11-22 Trang H. Tran , Lam M. Nguyen , Kyongmin Yeo , Nam Nguyen , Roman Vaculin

Deep learning models obtain impressive accuracy in road scenes understanding, however they need a large quantity of labeled samples for their training. Additionally, such models do not generalise well to environments where the statistical…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Francesco Barbato , Umberto Michieli , Marco Toldo , Pietro Zanuttigh

While deep neural networks are being utilized heavily for autonomous driving, they need to be adapted to new unseen environmental conditions for which they were not trained. We focus on a safety critical application of lane detection, and…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Kshitij Bhardwaj , Zishen Wan , Arijit Raychowdhury , Ryan Goldhahn

Distribution shifts are problems where the distribution of data changes between training and testing, which can significantly degrade the performance of a model deployed in the real world. Recent studies suggest that one reason for the…

Machine Learning · Computer Science 2023-04-10 Takuro Kutsuna

We consider the problem of domain adaptation in LiDAR-based 3D object detection. Towards this, we propose a simple yet effective training strategy called Gradual Batch Alternation that can adapt from a large labeled source domain to an…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Mrigank Rochan , Xingxin Chen , Alaap Grandhi , Eduardo R. Corral-Soto , Bingbing Liu

Generic object detection has been immensely promoted by the development of deep convolutional neural networks in the past decade. However, in the domain shift circumstance, the changes in weather, illumination, etc., often cause domain gap,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Hang Yang , Shan Jiang , Xinge Zhu , Mingyang Huang , Zhiqiang Shen , Chunxiao Liu , Jianping Shi

In recent years, object detection has shown impressive results using supervised deep learning, but it remains challenging in a cross-domain environment. The variations of illumination, style, scale, and appearance in different domains can…

Computer Vision and Pattern Recognition · Computer Science 2019-08-12 Rongchang Xie , Fei Yu , Jiachao Wang , Yizhou Wang , Li Zhang

Contrastive learning is among the most popular and powerful approaches for self-supervised representation learning, where the goal is to map semantically similar samples close together while separating dissimilar ones in the latent space.…

Machine Learning · Statistics 2025-12-03 Ali Alvandi , Mina Rezaei

The creation of large-scale open domain reading comprehension data sets in recent years has enabled the development of end-to-end neural comprehension models with promising results. To use these models for domains with limited training…

Computation and Language · Computer Science 2020-11-23 Y. Xu , X. Zhong , A. J. J. Yepes , J. H. Lau

Accurate road surface classification is crucial for autonomous vehicles (AVs) to optimize driving conditions, enhance safety, and enable advanced road mapping. However, deep learning models for road surface classification suffer from poor…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Paolo Cudrano , Matteo Bellusci , Giuseppe Macino , Matteo Matteucci

A common approach to transfer learning under distribution shift is to fine-tune the last few layers of a pre-trained model, preserving learned features while also adapting to the new task. This paper shows that in such settings, selectively…

Machine Learning · Computer Science 2023-06-07 Yoonho Lee , Annie S. Chen , Fahim Tajwar , Ananya Kumar , Huaxiu Yao , Percy Liang , Chelsea Finn

We propose an approach for unsupervised adaptation of object detectors from label-rich to label-poor domains which can significantly reduce annotation costs associated with detection. Recently, approaches that align distributions of source…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Kuniaki Saito , Yoshitaka Ushiku , Tatsuya Harada , Kate Saenko

The essence of unsupervised anomaly detection is to learn the compact distribution of normal samples and detect outliers as anomalies in testing. Meanwhile, the anomalies in real-world are usually subtle and fine-grained in a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Ye Zheng , Xiang Wang , Rui Deng , Tianpeng Bao , Rui Zhao , Liwei Wu

In neutrino physics, analyses often depend on large simulated datasets, making it essential for models to generalise effectively to real-world detector data. Contrastive learning, a well-established technique in deep learning, offers a…

High Energy Physics - Experiment · Physics 2025-05-23 Alex Wilkinson , Radi Radev , Saul Alonso-Monsalve

Contrastive learning has emerged as a competitive pretraining method for object detection. Despite this progress, there has been minimal investigation into the robustness of contrastively pretrained detectors when faced with domain shifts.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Kyle Buettner , Adriana Kovashka

We study linear regression under covariate shift, where the marginal distribution over the input covariates differs in the source and the target domains, while the conditional distribution of the output given the input covariates is similar…

Machine Learning · Computer Science 2022-08-04 Jingfeng Wu , Difan Zou , Vladimir Braverman , Quanquan Gu , Sham M. Kakade

Deep neural networks can be powerful tools, but require careful application-specific design to ensure that the most informative relationships in the data are learnable. In this paper, we apply deep neural networks to the nonlinear…

Machine Learning · Computer Science 2019-12-04 Matthew A. Wright , Simon F. G. Ehlers , Roberto Horowitz

Achieving a universally high accuracy in object detection is quite challenging, and the mainstream focus in the industry currently lies on detecting specific classes of objects. However, deploying one or multiple object detection networks…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Feng Chen

Recently, contrastive self-supervised learning has become a key component for learning visual representations across many computer vision tasks and benchmarks. However, contrastive learning in the context of domain adaptation remains…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Mamatha Thota , Georgios Leontidis
‹ Prev 1 2 3 10 Next ›