English
Related papers

Related papers: ReDiStory: Region-Disentangled Diffusion for Consi…

200 papers

Recent advancements in image synthesis are fueled by the advent of large-scale diffusion models. Yet, integrating realistic object visualizations seamlessly into new or existing backgrounds without extensive training remains a challenge.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Phillip Mueller , Jannik Wiese , Ioan Craciun , Lars Mikelsons

Lifelong person re-identification attempts to recognize people across cameras and integrate new knowledge from continuous data streams. Key challenges involve addressing catastrophic forgetting caused by parameter updating and domain shift,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Hongyu Chen , Bingliang Jiao , Wenxuan Wang , Peng Wang

Image restoration is a classic low-level problem aimed at recovering high-quality images from low-quality images with various degradations such as blur, noise, rain, haze, etc. However, due to the inherent complexity and non-uniqueness of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yuhong Zhang , Hengsheng Zhang , Xinning Chai , Zhengxue Cheng , Rong Xie , Li Song , Wenjun Zhang

The recent innovations and breakthroughs in diffusion models have significantly expanded the possibilities of generating high-quality videos for the given prompts. Most existing works tackle the single-scene scenario with only one video…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Fuchen Long , Zhaofan Qiu , Ting Yao , Tao Mei

Purely RGB-based vision models often fail to provide reliable cues in challenging scenarios such as nighttime and fog, leading to degraded performance and safety risks. Infrared imaging captures heat-emitting sources and provides critical…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Yuchen Guo , Junli Gong , Wenjun Dong , Yiuming Cheung , Weifeng Su

Personalizing generative models offers a way to guide image generation with user-provided references. Current personalization methods can invert an object or concept into the textual conditioning space and compose new natural sentences for…

Recent advancements in diffusion models have showcased their impressive capacity to generate visually striking images. Nevertheless, ensuring a close match between the generated image and the given prompt remains a persistent challenge. In…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Yupeng Zhou , Daquan Zhou , Zuo-Liang Zhu , Yaxing Wang , Qibin Hou , Jiashi Feng

Text-to-image diffusion models excel at generating high-quality images from natural language descriptions but often fail to preserve subject consistency across multiple outputs, limiting their use in visual storytelling. Existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Shangxun Li , Youngjung Uh

Story visualization has become a popular task where visual scenes are generated to depict a narrative across multiple panels. A central challenge in this setting is maintaining visual consistency, particularly in how characters and objects…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Kiymet Akdemir , Tahira Kazimi , Pinar Yanardag

Training-free diffusion models have achieved remarkable progress in generating multi-subject consistent images within open-domain scenarios. The key idea of these methods is to incorporate reference subject information within the attention…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Huiguo He , Qiuyue Wang , Yuan Zhou , Yuxuan Cai , Hongyang Chao , Jian Yin , Huan Yang

Text-to-image generation models have made significant progress in producing high-quality images from textual descriptions, yet they continue to struggle with maintaining subject consistency across multiple images, a fundamental requirement…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Mingxiao Li , Mang Ning , Marie-Francine Moens

Recently, large-scale diffusion models, e.g., Stable diffusion and DallE2, have shown remarkable results on image synthesis. On the other hand, large-scale cross-modal pre-trained models (e.g., CLIP, ALIGN, and FILIP) are competent for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Runhui Huang , Jianhua Han , Guansong Lu , Xiaodan Liang , Yihan Zeng , Wei Zhang , Hang Xu

Recent advances in text-to-image diffusion models have spurred significant interest in continuous story image generation. In this paper, we introduce Storynizor, a model capable of generating coherent stories with strong inter-frame…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Yuhang Ma , Wenting Xu , Chaoyi Zhao , Keqiang Sun , Qinfeng Jin , Zeng Zhao , Changjie Fan , Zhipeng Hu

Diffusion Transformer has shown remarkable abilities in generating high-fidelity videos, delivering visually coherent frames and rich details over extended durations. However, existing video generation models still fall short in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Zhaoyang Li , Dongjun Qian , Kai Su , Qishuai Diao , Xiangyang Xia , Chang Liu , Wenfei Yang , Tianzhu Zhang , Zehuan Yuan

The latest developments in Face Restoration have yielded significant advancements in visual quality through the utilization of diverse diffusion priors. Nevertheless, the uncertainty of face identity introduced by identity-obscure inputs…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Yushun Fang , Lu Liu , Xiang Gao , Qiang Hu , Ning Cao , Jianghe Cui , Gang Chen , Xiaoyun Zhang

Story Visualization aims to generate a sequence of images that faithfully depicts a textual narrative that preserve character identity, spatial configuration, and stylistic coherence as the narratives unfold. Maintaining such cross-frame…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Aditya Arora , Akshita Gupta , Pau Rodriguez , Marcus Rohrbach

Part of the success of diffusion models stems from their ability to perform iterative refinement, i.e., repeatedly correcting outputs during generation. However, modern masked discrete diffusion lacks this capability: when a token is…

Machine Learning · Computer Science 2026-02-10 Guanghan Wang , Yair Schiff , Subham Sekhar Sahoo , Volodymyr Kuleshov

State-of-the-art text-to-image models suffer from a persistent identity crisis when generating scenes with multiple humans: producing duplicate faces, merging identities, and miscounting individuals. We present DisCo (Reinforcement with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Shubhankar Borse , Farzad Farhadzadeh , Munawar Hayat , Fatih Porikli

We introduce OneDiffusion, a versatile, large-scale diffusion model that seamlessly supports bidirectional image synthesis and understanding across diverse tasks. It enables conditional generation from inputs such as text, depth, pose,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Duong H. Le , Tuan Pham , Sangho Lee , Christopher Clark , Aniruddha Kembhavi , Stephan Mandt , Ranjay Krishna , Jiasen Lu

Recent advances in large-scale text-to-image diffusion models (e.g., FLUX.1) have greatly improved visual fidelity in consistent character generation and editing. However, existing methods rarely unify these tasks within a single framework.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Benjia Zhou , Bin Fu , Pei Cheng , Yanru Wang , Jiayuan Fan , Tao Chen