English
Related papers

Related papers: CLIP-driven rain perception: Adaptive deraining wi…

200 papers

Rain precipitation prediction is a challenging task as it depends on weather and meteorological features which vary from location to location. As a result, a prediction model that performs well at one location does not perform well at other…

For the single image rain removal (SIRR) task, the performance of deep learning (DL)-based methods is mainly affected by the designed deraining models and training datasets. Most of current state-of-the-art focus on constructing powerful…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Hong Wang , Zongsheng Yue , Qi Xie , Qian Zhao , Yefeng Zheng , Deyu Meng

Open-Set Domain Adaptation (OSDA) confronts the dual challenge of aligning known-class distributions across domains while identifying target-domain-specific unknown categories. Current approaches often fail to leverage semantic…

Machine Learning · Computer Science 2025-05-21 Haoyang Chen

Domain Generalization (DG) aims to learn a model from multiple source domains to achieve satisfactory performance on unseen target domains. Recent works introduce CLIP to DG tasks due to its superior image-text alignment and zeros-shot…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Yingfan Wang , Guoliang Kang

Rain streaks bring complicated pixel intensity changes and additional gradients, greatly obstructing the extraction of image features from background. This causes serious performance degradation in feature-based applications. Thus, it is…

Image and Video Processing · Electrical Eng. & Systems 2023-11-02 Wei Wu , Hao Chang , Zhu Li

Class-incremental learning is a challenging problem, where the goal is to train a model that can classify data from an increasing number of classes over time. With the advancement of vision-language pre-trained models such as CLIP, they…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Linlan Huang , Xusheng Cao , Haori Lu , Xialei Liu

Multimodal models, such as the Contrastive Language-Image Pre-training (CLIP) model, have demonstrated remarkable success in aligning visual and linguistic representations. However, these models exhibit limitations when applied to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Hiroshi Sasaki

Removing rain streaks from a single image has been drawing considerable attention as rain streaks can severely degrade the image quality and affect the performance of existing outdoor vision tasks. While recent CNN-based derainers have…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Tianyu Wang , Xin Yang , Ke Xu , Shaozhe Chen , Qiang Zhang , Rynson Lau

To tackle the difficulties in fitting paired real-world data for single image deraining (SID), recent unsupervised methods have achieved notable success. However, these methods often struggle to generate high-quality, rain-free images due…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Chen Zhao , Weiling Cai , ChengWei Hu , Zheng Yuan

Images acquired from rainy scenes usually suffer from bad visibility which may damage the performance of computer vision applications. The rainy scenarios can be categorized into two classes: moderate rain and heavy rain scenes. Moderate…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Wei-Ting Chen , Cheng-Che Tsai , Hao-Yu Fang , I-Hsiang Chen , Jian-Jiun Ding , Sy-Yen Kuo

With the advent of large-scale pre-trained models, interest in adapting and exploiting them for continual learning scenarios has grown. In this paper, we propose an approach to exploiting pre-trained vision-language models (e.g. CLIP) that…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Xialei Liu , Xusheng Cao , Haori Lu , Jia-wen Xiao , Andrew D. Bagdanov , Ming-Ming Cheng

This paper presents a novel method of landslide detection by exploiting the Mask R-CNN capability of identifying an object layout by using a pixel-based segmentation, along with transfer learning used to train the proposed model. A data set…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Silvia Liberata Ullo , Amrita Mohan , Alessandro Sebastianelli , Shaik Ejaz Ahamed , Basant Kumar , Ramji Dwivedi , G. R. Sinha

Large-scale pre-trained Vision-Language Models (VLMs), such as CLIP, establish the correlation between texts and images, achieving remarkable success on various downstream tasks with fine-tuning. In existing fine-tuning methods, the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Yi Zhang , Ce Zhang , Yushun Tang , Zhihai He

Precipitation nowcasting, which aims to precisely predict the short-term rainfall intensity of a local region, is gaining increasing attention in the artificial intelligence community. Existing deep learning-based algorithms use a single…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Yuan Cao , Qiuying Li , Hongming Shan , Zhizhong Huang , Lei Chen , Leiming Ma , Junping Zhang

Adaptive network coding schemes provide a promising approach to bridging the gap between high data rates and low delay in real-time streaming applications. However, their effectiveness often relies on accurate channel prediction, which is…

Information Theory · Computer Science 2026-03-24 Adina Waxman , Nir Shlezinger , Alejandro Cohen

Single image rain removal is a typical inverse problem in computer vision. The deep learning technique has been verified to be effective for this task and achieved state-of-the-art performance. However, previous deep learning methods need…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Wei Wei , Deyu Meng , Qian Zhao , Zongben Xu , Ying Wu

Rainfall prediction remains a persistent challenge due to the highly nonlinear and complex nature of meteorological data. Existing approaches lack systematic utilization of grid search for optimal hyperparameter tuning, relying instead on…

Machine Learning · Computer Science 2025-01-29 Zhenqi Li , Junhao Zhong , Hewei Wang , Jinfeng Xu , Yijie Li , Jinjiang You , Jiayi Zhang , Runzhi Wu , Soumyabrata Dev

Significant progress has been achieved on the improvement and downstream usages of the Contrastive Language-Image Pre-training (CLIP) vision-language model, while less attention is paid to the interpretation of CLIP. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Chenyang Zhao , Kun Wang , Janet H. Hsiao , Antoni B. Chan

Precipitation from tropical cyclones (TCs) can cause disasters such as flooding, mudslides, and landslides. Predicting such precipitation in advance is crucial, giving people time to prepare and defend against these precipitation-induced…

Machine Learning · Computer Science 2025-05-20 Cheng Huang , Pan Mu , Cong Bai , Peter AG Watson

CLIP is one of the most popular foundational models and is heavily used for many vision-language tasks. However, little is known about the inner workings of CLIP. To bridge this gap we propose a study to quantify the interpretability in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Avinash Madasu , Yossi Gandelsman , Vasudev Lal , Phillip Howard