English
Related papers

Related papers: MIGC: Multi-Instance Generation Controller for Tex…

200 papers

Multi-attribute conditional image generation is a challenging problem in computervision. We propose Multi-attribute Pizza Generator (MPG), a conditional Generative Neural Network (GAN) framework for synthesizing images from a trichotomy of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Fangda Han , Guoyao Hao , Ricardo Guerrero , Vladimir Pavlovic

Recently, the application of deep learning in image colorization has received widespread attention. The maturation of diffusion models has further advanced the development of image colorization models. However, current mainstream image…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Yanru An , Ling Gui , Chunlei Cai , Tianxiao Ye , JIangchao Yao , Guangtao Zhai , Qiang Hu , Xiaoyun Zhang

Multi-aspect controllable text generation aims to control the generated texts in attributes from multiple aspects (e.g., "positive" from sentiment and "sport" from topic). For ease of obtaining training samples, existing works neglect…

Computation and Language · Computer Science 2024-05-31 Yi Liu , Xiangyu Liu , Xiangrong Zhu , Wei Hu

In the current era of generative AI breakthroughs, generating panoramic scenes from a single input image remains a key challenge. Most existing methods use diffusion-based iterative or simultaneous multi-view inpainting. However, the lack…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Zhipeng Cai , Matthias Mueller , Reiner Birkl , Diana Wofk , Shao-Yen Tseng , JunDa Cheng , Gabriela Ben-Melech Stan , Vasudev Lal , Michael Paulitsch

Multi-aspect controllable text generation is a more challenging and practical task than single-aspect control. Existing methods achieve complex multi-aspect control by fusing multiple controllers learned from single-aspect, but suffer from…

Computation and Language · Computer Science 2022-10-20 Yuxuan Gu , Xiaocheng Feng , Sicheng Ma , Lingyuan Zhang , Heng Gong , Bing Qin

With the rapid development of AI-generated content (AIGC), video generation has emerged as one of its most dynamic and impactful subfields. In particular, the advancement of video generation foundation models has led to growing demand for…

Generative modeling has recently shown great promise in computer vision, but it has mostly focused on synthesizing visually realistic images. In this paper, motivated by multi-task learning of shareable feature representations, we consider…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Zhipeng Bao , Martial Hebert , Yu-Xiong Wang

We introduce MIGS (Multi-Identity Gaussian Splatting), a novel method that learns a single neural representation for multiple identities, using only monocular videos. Recent 3D Gaussian Splatting (3DGS) approaches for human avatars require…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Aggelina Chatziagapi , Grigorios G. Chrysos , Dimitris Samaras

Masked generative models (MGMs) have shown impressive generative ability while providing an order of magnitude efficient sampling steps compared to continuous diffusion models. However, MGMs still underperform in image synthesis compared to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Jiwan Hur , Dong-Jae Lee , Gyojin Han , Jaehyun Choi , Yunho Jeon , Junmo Kim

State-of-the-art text-to-image models suffer from a persistent identity crisis when generating scenes with multiple humans: producing duplicate faces, merging identities, and miscounting individuals. We present DisCo (Reinforcement with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Shubhankar Borse , Farzad Farhadzadeh , Munawar Hayat , Fatih Porikli

In the digital age, advanced image editing tools pose a serious threat to the integrity of visual content, making image forgery detection and localization a key research focus. Most existing Image Manipulation Localization (IML) methods…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Yachun Mi , Xingyang He , Shixin Sun , Yu Li , Yanting Li , Zhixuan Li , Jian Jin , Chen Hui , Shaohui Liu

Modeling realistic and interactive multi-agent behavior is critical to autonomous driving and traffic simulation. However, existing diffusion and autoregressive approaches are limited by iterative sampling, sequential decoding, or…

Robotics · Computer Science 2025-11-24 Zhiyu Huang , Zewei Zhou , Tianhui Cai , Yun Zhang , Jiaqi Ma

Incomplete Multi-View Clustering aims to enhance clustering performance by using data from multiple modalities. Despite the fact that several approaches for studying this issue have been proposed, the following drawbacks still persist: 1)…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Jiatai Wang , Zhiwei Xu , Xuewen Yang , Dongjin Guo , Limin Liu

Text-to-3D generation from a single-view image is a popular but challenging task in 3D vision. Although numerous methods have been proposed, existing works still suffer from the inconsistency issues, including 1) semantic inconsistency, 2)…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Yichen Ouyang , Wenhao Chai , Jiayi Ye , Dapeng Tao , Yibing Zhan , Gaoang Wang

Text-to-image generation has achieved astonishing results, yet precise spatial controllability and prompt fidelity remain highly challenging. This limitation is typically addressed through cumbersome prompt engineering, scene layout…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Petru-Daniel Tudosiu , Yongxin Yang , Shifeng Zhang , Fei Chen , Steven McDonagh , Gerasimos Lampouras , Ignacio Iacobacci , Sarah Parisot

Advancements in generative models have sparked significant interest in generating images while adhering to specific structural guidelines. Scene graph to image generation is one such task of generating images which are consistent with the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Rameshwar Mishra , A V Subramanyam

Text-to-image diffusion models have shown remarkable capabilities of generating high-quality images closely aligned with textual inputs. However, the effectiveness of text guidance heavily relies on the CLIP text encoder, which is trained…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Zexi Jia , Chuanwei Huang , Hongyan Fei , Yeshuang Zhu , Zhiqiang Yuan , Jinchao Zhang , Jie Zhou

We present CoMoGen, a controllable video generation framework that generates realistic interactive dynamics from a single binary mask sequence conditioned on an input image. CoMoGen introduces a lightweight MaskAdapter that encodes binary…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Adil Meric , Lin Geng Foo , Mert Kiray , Benjamin Busam , Rishabh Dabral , Christian Theobalt

Existing approaches for controlling text-to-image diffusion models, while powerful, do not allow for explicit 3D object-centric control, such as precise control of object orientation. In this work, we address the problem of multi-object…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Rishubh Parihar , Vaibhav Agrawal , Sachidanand VS , R. Venkatesh Babu

Subject-driven image generation (SDIG) aims to manipulate specific subjects within images while adhering to textual instructions, a task crucial for advancing text-to-image diffusion models. SDIG requires reconciling the tension between…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Jibai Lin , Bo Ma , Yating Yang , Xi Zhou , Rong Ma , Turghun Osman , Ahtamjan Ahmat , Rui Dong , Lei Wang