中文
相关论文

相关论文: Diffusion Model is Secretly a Training-free Open V…

200 篇论文

Recent advances in image generation have made diffusion models powerful tools for creating high-quality images. However, their iterative denoising process makes understanding and interpreting their semantic latent spaces more challenging…

计算与语言 · 计算机科学 2024-11-06 E. Zhixuan Zeng , Yuhao Chen , Alexander Wong

Diffusion models (DMs) have become the new trend of generative models and have demonstrated a powerful ability of conditional synthesis. Among those, text-to-image diffusion models pre-trained on large-scale image-text pairs are highly…

计算机视觉与模式识别 · 计算机科学 2023-03-06 Wenliang Zhao , Yongming Rao , Zuyan Liu , Benlin Liu , Jie Zhou , Jiwen Lu

The emergence of CLIP has opened the way for open-world image perception. The zero-shot classification capabilities of the model are impressive but are harder to use for dense tasks such as image segmentation. Several methods have proposed…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Monika Wysoczańska , Michaël Ramamonjisoa , Tomasz Trzciński , Oriane Siméoni

Recently, diffusion-based image generation methods are credited for their remarkable text-to-image generation capabilities, while still facing challenges in accurately generating multilingual scene text images. To tackle this problem, we…

计算机视觉与模式识别 · 计算机科学 2023-12-20 Lingjun Zhang , Xinyuan Chen , Yaohui Wang , Yue Lu , Yu Qiao

Diffusion models have fundamentally transformed the field of generative models, making the assessment of similarity between customized model outputs and reference inputs critically important. However, traditional perceptual similarity…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Yiren Song , Xiaokang Liu , Mike Zheng Shou

The recent advancements in Generative Adversarial Networks (GANs) and the emergence of Diffusion models have significantly streamlined the production of highly realistic and widely accessible synthetic content. As a result, there is a…

计算机视觉与模式识别 · 计算机科学 2024-02-21 Sohail Ahmed Khan , Duc-Tien Dang-Nguyen

Diffusion models, such as Stable Diffusion, have shown incredible performance on text-to-image generation. Since text-to-image generation often requires models to generate visual concepts with fine-grained details and attributes specified…

计算机视觉与模式识别 · 计算机科学 2024-04-26 Xuehai He , Weixi Feng , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

Unsupervised visual object tracking is a challenging task that requires following arbitrary targets in videos without training on ground-truth annotations. Despite considerable progress, existing state-of-the-art unsupervised trackers often…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Zhengbo Zhang , Zhigang Tu , Junsong Yuan , De Wen Soh , Bo Du

Event cameras offer advantages in object detection tasks due to high-speed response, low latency, and robustness to motion blur. However, event cameras lack texture and color information, making open-vocabulary detection particularly…

计算机视觉与模式识别 · 计算机科学 2026-03-12 Jinchang Zhang , Zijun Li , Jiakai Lin , Guoyu Lu

Open-vocabulary semantic segmentation (OVSS) aims to segment objects from arbitrary text categories without requiring densely annotated datasets. Although contrastive learning based models enable zero-shot segmentation, they often lose fine…

计算机视觉与模式识别 · 计算机科学 2026-04-30 Huy Che , Vinh-Tiep Nguyen

Constructing high-definition (HD) maps is a crucial requirement for enabling autonomous driving. In recent years, several map segmentation algorithms have been developed to address this need, leveraging advancements in Bird's-Eye View (BEV)…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Peijin Jia , Tuopu Wen , Ziang Luo , Mengmeng Yang , Kun Jiang , Zhiquan Lei , Xuewei Tang , Ziyuan Liu , Le Cui , Bo Zhang , Long Huang , Diange Yang

Diffusion probabilistic models have achieved enormous success in the field of image generation and manipulation. In this paper, we explore a novel paradigm of using the diffusion model and classifier guidance in the latent semantic space…

计算机视觉与模式识别 · 计算机科学 2023-05-25 Changhao Shi , Haomiao Ni , Kai Li , Shaobo Han , Mingfu Liang , Martin Renqiang Min

Open-Vocabulary Semantic Segmentation (OVSS) has advanced with recent vision-language models (VLMs), enabling segmentation beyond predefined categories through various learning schemes. Notably, training-free methods offer scalable, easily…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Chanyoung Kim , Dayun Ju , Woojung Han , Ming-Hsuan Yang , Seong Jae Hwang

Generative models have enabled intuitive image creation and manipulation using natural language. In particular, diffusion models have recently shown remarkable results for natural image editing. In this work, we propose to apply diffusion…

Diffusion models have demonstrated exceptional capabilities in generating a broad spectrum of visual content, yet their proficiency in rendering text is still limited: they often generate inaccurate characters or words that fail to blend…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Jianyi Zhang , Yufan Zhou , Jiuxiang Gu , Curtis Wigington , Tong Yu , Yiran Chen , Tong Sun , Ruiyi Zhang

Open-world semantic segmentation presently relies significantly on extensive image-text pair datasets, which often suffer from a lack of fine-grained pixel annotations on sufficient categories. The acquisition of such data is rendered…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Kaixin Cai , Pengzhen Ren , Jianhua Han , Yi Zhu , Hang Xu , Jianzhuang Liu , Xiaodan Liang

Recently, the contrastive language-image pre-training, e.g., CLIP, has demonstrated promising results on various downstream tasks. The pre-trained model can capture enriched visual concepts for images by learning from a large scale of…

计算机视觉与模式识别 · 计算机科学 2023-06-21 Huaishao Luo , Junwei Bao , Youzheng Wu , Xiaodong He , Tianrui Li

Diffusion models have become prominent in creating high-quality images. However, unlike GAN models celebrated for their ability to edit images in a disentangled manner, diffusion-based text-to-image models struggle to achieve the same level…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Hidir Yesiltepe , Yusuf Dalva , Pinar Yanardag

Automated semantic segmentation of cell nuclei in microscopic images is crucial for disease diagnosis and tissue microenvironment analysis. Nonetheless, this task presents challenges due to the complexity and heterogeneity of cells. While…

图像与视频处理 · 电气工程与系统科学 2023-08-10 Zhuchen Shao , Sourya Sengupta , Hua Li , Mark A. Anastasio

Recently, diffusion models have increasingly demonstrated their capabilities in vision understanding. By leveraging prompt-based learning to construct sentences, these models have shown proficiency in classification and visual grounding…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Danni Yang , Ruohan Dong , Jiayi Ji , Yiwei Ma , Haowei Wang , Xiaoshuai Sun , Rongrong Ji