中文
相关论文

相关论文: FreeCus: Free Lunch Subject-driven Customization i…

200 篇论文

The diffusion model has demonstrated superior performance in synthesizing diverse and high-quality images for text-guided image translation. However, there remains room for improvement in both the formulation of text prompts and the…

计算机视觉与模式识别 · 计算机科学 2025-03-27 Qi Si , Bo Wang , Zhao Zhang

The recent wave of large-scale text-to-image diffusion models has dramatically increased our text-based image generation abilities. These models can generate realistic images for a staggering variety of prompts and exhibit impressive…

机器学习 · 计算机科学 2023-09-14 Alexander C. Li , Mihir Prabhudesai , Shivam Duggal , Ellis Brown , Deepak Pathak

Diffusion model has demonstrated remarkable capability in video generation, which further sparks interest in introducing trajectory control into the generation process. While existing works mainly focus on training-based methods (e.g.,…

计算机视觉与模式识别 · 计算机科学 2024-06-25 Haonan Qiu , Zhaoxi Chen , Zhouxia Wang , Yingqing He , Menghan Xia , Ziwei Liu

Text-to-image (T2I) research has grown explosively in the past year, owing to the large-scale pre-trained diffusion models and many emerging personalization and editing approaches. Yet, one pain point persists: the text prompt engineering,…

计算机视觉与模式识别 · 计算机科学 2023-06-02 Xingqian Xu , Jiayi Guo , Zhangyang Wang , Gao Huang , Irfan Essa , Humphrey Shi

The rapid development of large-scale text-to-speech (TTS) models has led to significant advancements in modeling diverse speaker prosody and voices. However, these models often face issues such as slow inference speeds, reliance on complex…

音频与语音处理 · 电气工程与系统科学 2024-09-17 Yinghao Aaron Li , Xilin Jiang , Cong Han , Nima Mesgarani

Recent progress in 4D representations, such as Dynamic NeRF and 4D Gaussian Splatting (4DGS), has enabled dynamic 4D scene reconstruction. However, text-driven 4D scene editing remains under-explored due to the challenge of ensuring both…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Dong In Lee , Hyungjun Doh , Seunggeun Chi , Runlin Duan , Sangpil Kim , Karthik Ramani

Synthesizing images with user-specified subjects has received growing attention due to its practical applications. Despite the recent success in single subject customization, existing algorithms suffer from high training cost and low…

计算机视觉与模式识别 · 计算机科学 2023-06-01 Zhiheng Liu , Yifei Zhang , Yujun Shen , Kecheng Zheng , Kai Zhu , Ruili Feng , Yu Liu , Deli Zhao , Jingren Zhou , Yang Cao

Diffusion transformers (DiTs) have emerged as a powerful architecture for high-fidelity image generation, yet the quadratic cost of self-attention poses a major scalability bottleneck. To address this, linear attention mechanisms have been…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Boyuan Cao , Xingbo Yao , Chenhui Wang , Jiaxin Ye , Yujie Wei , Hongming Shan

Adapting Large Language Models (LLMs) to specialized domains requires high-quality instruction tuning datasets, which are expensive to create through human annotation. Existing data synthesis methods focus on general-purpose tasks and fail…

计算与语言 · 计算机科学 2026-03-17 Ruiyao Xu , Noelle I. Samia , Han Liu

Diffusion models have become the dominant paradigm in text-to-image generation, and test-time scaling (TTS) improves sample quality by allocating additional computation at inference. Existing TTS methods, however, resample the entire image,…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Qin Ren , Yufei Wang , Lanqing Guo , Wen Zhang , Zhiwen Fan , Chenyu You

Text-guided diffusion models have advanced image editing by enabling intuitive control through language. However, despite their strong capabilities, we surprisingly find that SOTA methods struggle with simple, everyday transformations such…

图像与视频处理 · 电气工程与系统科学 2026-03-27 Omar Elezabi , Eduard Zamfir , Zongwei Wu , Radu Timofte

Recent advances in generative models, such as diffusion and flow matching, have shown strong performance in audio tasks. However, speech enhancement (SE) models are typically trained on limited datasets and evaluated under narrow…

音频与语音处理 · 电气工程与系统科学 2026-03-24 Tianyu Cao , Helin Wang , Ari Frummer , Yuval Sieradzki , Adi Arbel , Laureano Moro Velazquez , Jesus Villalba , Oren Gal , Thomas Thebaud , Najim Dehak

In autonomous driving, deep models have shown remarkable performance across various visual perception tasks with the demand of high-quality and huge-diversity training datasets. Such datasets are expected to cover various driving scenarios…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Jiahang Tu , Wei Ji , Hanbin Zhao , Chao Zhang , Roger Zimmermann , Hui Qian

Recent diffusion-based text-to-image customization methods have achieved significant success in understanding concrete concepts to control generation processes, such as styles and shapes. However, few efforts dive into the realistic yet…

计算机视觉与模式识别 · 计算机科学 2025-12-03 Fan Wu , Cheng Chen , Zhoujie Fu , Jiacheng Wei , Yi Xu , Deheng Ye , Guosheng Lin

Fine-tuning Stable Diffusion enables subject-driven image synthesis by adapting the model to generate images containing specific subjects. However, existing fine-tuning methods suffer from two key issues: underfitting, where the model fails…

图形学 · 计算机科学 2025-06-10 Yao Ni , Song Wen , Piotr Koniusz , Anoop Cherian

Diffusion models have demonstrated remarkable performance in image generation, particularly within the domain of style transfer. Prevailing style transfer approaches typically leverage pre-trained diffusion models' robust feature extraction…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Yeqi He , Liang Li , Zhiwen Yang , Xichun Sheng , Zhidong Zhao , Chenggang Yan

Text-to-image (T2I) generation models often struggle with multi-instance synthesis (MIS), where they must accurately depict multiple distinct instances in a single image based on complex prompts detailing individual features. Traditional…

计算机视觉与模式识别 · 计算机科学 2025-04-22 Chunyang Zhang , Zhenhong Sun , Zhicheng Zhang , Junyan Wang , Yu Zhang , Dong Gong , Huadong Mo , Daoyi Dong

Do the rich representations of multi-modal diffusion transformers (DiTs) exhibit unique properties that enhance their interpretability? We introduce ConceptAttention, a novel method that leverages the expressive power of DiT attention…

计算机视觉与模式识别 · 计算机科学 2025-07-03 Alec Helbling , Tuna Han Salih Meral , Ben Hoover , Pinar Yanardag , Duen Horng Chau

Recently, the multimedia community has witnessed the rise of diffusion models trained on large-scale multi-modal data for visual content creation, particularly in the field of text-to-image generation. In this paper, we propose a new task…

计算机视觉与模式识别 · 计算机科学 2023-11-10 Jingwen Chen , Yingwei Pan , Ting Yao , Tao Mei

Text-to-image diffusion models have an unprecedented ability to generate diverse and high-quality images. However, they often struggle to faithfully capture the intended semantics of complex input prompts that include multiple subjects.…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Omer Dahary , Or Patashnik , Kfir Aberman , Daniel Cohen-Or