English
Related papers

Related papers: F-ViTA: Foundation Model Guided Visible to Thermal…

200 papers

Real-world vision tasks frequently suffer from the appearance of unexpected adverse weather conditions, including rain, haze, snow, and raindrops. In the last decade, convolutional neural networks and vision transformers have yielded…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Yijun Yang , Hongtao Wu , Angelica I. Aviles-Rivero , Yulun Zhang , Jing Qin , Lei Zhu

Thermal facial imagery offers valuable insight into physiological states such as inflammation and stress by detecting emitted radiation in the infrared spectrum, which is unseen in the visible spectra. Telemedicine applications could…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Catherine Ordun , Edward Raff , Sanjay Purushotham

Diffusion-based image translation guided by semantic texts or a single target image has enabled flexible style transfer which is not limited to the specific domains. Unfortunately, due to the stochastic nature of diffusion models, it is…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Gihyun Kwon , Jong Chul Ye

Unsupervised visual object tracking is a challenging task that requires following arbitrary targets in videos without training on ground-truth annotations. Despite considerable progress, existing state-of-the-art unsupervised trackers often…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Zhengbo Zhang , Zhigang Tu , Junsong Yuan , De Wen Soh , Bo Du

Nature is infinitely resolution-free. In the context of this reality, existing diffusion models, such as Diffusion Transformers, often face challenges when processing image resolutions outside of their trained domain. To overcome this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Zeyu Lu , Zidong Wang , Di Huang , Chengyue Wu , Xihui Liu , Wanli Ouyang , Lei Bai

The Vision-Language Foundation Model has recently shown outstanding performance in various perception learning tasks. The outstanding performance of the vision-language model mainly relies on large-scale pre-training datasets and different…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Thanh-Dat Truong , Xin Li , Bhiksha Raj , Jackson Cothren , Khoa Luu

Vision-based approaches have become the dominant paradigm for traversability estimation in unstructured outdoor environments, typically adapting vision foundation models (VFMs) via semantic segmentation supervision. However, this paradigm…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Ji-Hoon Hwang , Jisung Bae , Dong-Wook Kim , Yeonkyu Lee , Seung-Woo Seo

Recent advances in text-to-image generation have enabled the creation of high-quality images with diverse applications. However, accurately describing desired visual attributes can be challenging, especially for non-experts in art and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Tong Wu , Yinghao Xu , Ryan Po , Mengchen Zhang , Guandao Yang , Jiaqi Wang , Ziwei Liu , Dahua Lin , Gordon Wetzstein

The correct insertion of virtual objects in images of real-world scenes requires a deep understanding of the scene's lighting, geometry and materials, as well as the image formation process. While recent large-scale diffusion models have…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Ruofan Liang , Zan Gojcic , Merlin Nimier-David , David Acuna , Nandita Vijaykumar , Sanja Fidler , Zian Wang

We introduce Diff-Tracker, a novel approach for the challenging unsupervised visual tracking task leveraging the pre-trained text-to-image diffusion model. Our main idea is to leverage the rich knowledge encapsulated within the pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Zhengbo Zhang , Li Xu , Duo Peng , Hossein Rahmani , Jun Liu

Recently, diffusion models were applied to a wide range of image analysis tasks. We build on a method for image-to-image translation using denoising diffusion implicit models and include a regression problem and a segmentation problem for…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Julia Wolleb , Robin Sandkühler , Florentin Bieder , Philippe C. Cattin

In challenging low light and adverse weather conditions,thermal vision algorithms,especially object detection,have exhibited remarkable potential,contrasting with the frequent struggles encountered by visible vision algorithms.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Guoqing Zhu , Honghu Pan , Qiang Wang , Chao Tian , Chao Yang , Zhenyu He

Transferability estimation identifies the best pre-trained models for downstream tasks without incurring the high computational cost of full fine-tuning. This capability facilitates deployment and advances the pre-training and fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Yaoyan Zheng , Huiqun Wang , Nan Zhou , Di Huang

Recent text-guided diffusion models provide powerful image generation capabilities. Currently, a massive effort is given to enable the modification of these images using text only as means to offer intuitive and versatile editing. To edit a…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Ron Mokady , Amir Hertz , Kfir Aberman , Yael Pritch , Daniel Cohen-Or

Image-based fashion design with AI techniques has attracted increasing attention in recent years. We focus on a new fashion design task, where we aim to transfer a reference appearance image onto a clothing image while preserving the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Shidong Cao , Wenhao Chai , Shengyu Hao , Yanting Zhang , Hangyue Chen , Gaoang Wang

Infrared imagery enables temperature-based scene understanding using passive sensors, particularly under conditions of low visibility where traditional RGB imaging fails. Yet, developing downstream vision models for infrared applications is…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Kai A. Horstmann , Maxim Clouser , Kia Khezeli

Purely RGB-based vision models often fail to provide reliable cues in challenging scenarios such as nighttime and fog, leading to degraded performance and safety risks. Infrared imaging captures heat-emitting sources and provides critical…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Yuchen Guo , Junli Gong , Wenjun Dong , Yiuming Cheung , Weifeng Su

Visible-infrared object detection has gained sufficient attention due to its detection performance in low light, fog, and rain conditions. However, visible and infrared modalities captured by different sensors exist the information…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Wencong Wu , Xiuwei Zhang , Hanlin Yin , Shun Dai , Hongxi Zhang , Yanning Zhang

Diffusion models are generative models with impressive text-to-image synthesis capabilities and have spurred a new wave of creative methods for classical machine learning tasks. However, the best way to harness the perceptual knowledge of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Neehar Kondapaneni , Markus Marks , Manuel Knott , Rogerio Guimaraes , Pietro Perona

Image translation is one of the crucial approaches for mitigating information deficiencies in the infrared and visible modalities, while also facilitating the enhancement of modality-specific datasets. However, existing methods for infrared…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Bin Hu , Chenqiang Gao , Shurui Liu , Junjie Guo , Fang Chen , Fangcen Liu , Junwei Han