English
Related papers

Related papers: InnoAds-Composer: Efficient Condition Composition …

200 papers

Graphic design plays a crucial role in both commercial and personal contexts, yet creating high-quality, editable, and aesthetically pleasing graphic compositions remains a time-consuming and skill-intensive task, especially for beginners.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Zhao Zhang , Yutao Cheng , Dexiang Hong , Maoke Yang , Gonglei Shi , Lei Ma , Hui Zhang , Jie Shao , Xinglong Wu

Lifestyle images are photographs that capture environments and objects in everyday settings. In furniture product marketing, advertisers often create lifestyle images containing products to resonate with potential buyers, allowing buyers to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jialu Gao , Mithun Das Gupta , Qun Li , Raveena Kshatriya , Andrew D. Wilson , Keng-hao Chang , Balasaravanan Thoravi Kumaravel

The notable gap between user-provided and model-preferred prompts poses a significant challenge for generating high-quality images with text-to-image models, compelling the need for prompt engineering. Current studies on prompt engineering…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Shiyu Wu , Mingzhen Sun , Weining Wang , Yequan Wang , Jing Liu

With rapid advances in generative artificial intelligence, the text-to-music synthesis task has emerged as a promising direction for music generation. Nevertheless, achieving precise control over multi-track generation remains an open…

Sound · Computer Science 2024-12-18 Yao Yao , Peike Li , Boyu Chen , Alex Wang

Recent text-to-image diffusion models are able to learn and synthesize images containing novel, personalized concepts (e.g., their own pets or specific items) with just a few examples for training. This paper tackles two interconnected…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Chun-Hsiao Yeh , Ta-Ying Cheng , He-Yen Hsieh , Chuan-En Lin , Yi Ma , Andrew Markham , Niki Trigoni , H. T. Kung , Yubei Chen

Text-to-image diffusion models have demonstrated an impressive ability to produce high-quality outputs. However, they often struggle to accurately follow fine-grained spatial information in an input text. To this end, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Ran Galun , Sagie Benaim

Recent advances in diffusion-based text-to-image generation have demonstrated promising results through visual condition control. However, existing ControlNet-like methods struggle with compositional visual conditioning - simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Yanjie Pan , Qingdong He , Zhengkai Jiang , Pengcheng Xu , Chaoyi Wang , Jinlong Peng , Haoxuan Wang , Yun Cao , Zhenye Gan , Mingmin Chi , Bo Peng , Yabiao Wang

Recent advancements in leveraging pre-trained 2D diffusion models achieve the generation of high-quality novel views from a single in-the-wild image. However, existing works face challenges in producing controllable novel views due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Yunhan Yang , Shuo Chen , Yukun Huang , Xiaoyang Wu , Yuan-Chen Guo , Edmund Y. Lam , Hengshuang Zhao , Tong He , Xihui Liu

Token-based masked generative models are gaining popularity for their fast inference time with parallel decoding. While recent token-based approaches achieve competitive performance to diffusion-based models, their generation performance is…

Machine Learning · Computer Science 2023-04-05 Jaewoong Lee , Sangwon Jang , Jaehyeong Jo , Jaehong Yoon , Yunji Kim , Jin-Hwa Kim , Jung-Woo Ha , Sung Ju Hwang

We propose Composition Sampling, a simple but effective method to generate diverse outputs for conditional generation of higher quality compared to previous stochastic decoding strategies. It builds on recently proposed plan-based neural…

Computation and Language · Computer Science 2022-03-30 Shashi Narayan , Gonçalo Simões , Yao Zhao , Joshua Maynez , Dipanjan Das , Michael Collins , Mirella Lapata

Text design is one of the most critical procedures in poster design, as it relies heavily on the creativity and expertise of humans to design text images considering the visual harmony and text-semantic. This study introduces TextPainter, a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Yifan Gao , Jinpeng Lin , Min Zhou , Chuanbin Liu , Hongtao Xie , Tiezheng Ge , Yuning Jiang

Text-conditioned molecular generation aims to translate natural-language descriptions into chemical structures, enabling scientists to specify functional groups, scaffolds, and physicochemical constraints without handcrafted rules.…

Machine Learning · Computer Science 2025-11-18 Lingxiao Li , Haobo Zhang , Bin Chen , Jiayu Zhou

Generating high-fidelity images of humans with fine-grained control over attributes such as hairstyle and clothing remains a core challenge in personalized text-to-image synthesis. While prior methods emphasize identity preservation from a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Guocheng Gordon Qian , Daniil Ostashev , Egor Nemchinov , Avihay Assouline , Sergey Tulyakov , Kuan-Chieh Jackson Wang , Kfir Aberman

With the rapid development of diffusion models in image generation, the demand for more powerful and flexible controllable frameworks is increasing. Although existing methods can guide generation beyond text prompts, the challenge of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Haoxuan Wang , Jinlong Peng , Qingdong He , Hao Yang , Ying Jin , Jiafu Wu , Xiaobin Hu , Yanjie Pan , Zhenye Gan , Mingmin Chi , Bo Peng , Yabiao Wang

Image extrapolation aims at expanding the narrow field of view of a given image patch. Existing models mainly deal with natural scene images of homogeneous regions and have no control of the content generation process. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Yijun Li , Lu Jiang , Ming-Hsuan Yang

We present "Narrative Weaver", a novel framework that addresses a fundamental challenge in generative AI: achieving multi-modal controllable, long-range, and consistent visual content generation. While existing models excel at generating…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Zhengjian Yao , Yongzhi Li , Xinyuan Gao , Quan Chen , Peng Jiang , Yanye Lu

Generating consistent long videos is a complex challenge: while diffusion-based generative models generate visually impressive short clips, extending them to longer durations often leads to memory bottlenecks and long-term inconsistency. In…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Wenqi Ouyang , Zeqi Xiao , Danni Yang , Yifan Zhou , Shuai Yang , Lei Yang , Jianlou Si , Xingang Pan

Controllable TTS models with natural language prompts often lack the ability for fine-grained control and face a scarcity of high-quality data. We propose a two-stage style-controllable TTS system with language models, utilizing a quantized…

Multimedia · Computer Science 2025-06-04 Yongqi Wang , Chunlei Zhang , Hangting Chen , Zhou Zhao , Dong Yu

Recent research work on fashion outfit generation focuses on promoting visual consistency of garments by leveraging key information from reference image and text prompt. However, the potential of outfit generation remains underexplored,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Yu He , Ting Zhu , Yichun Liu , Lichen Ma , Xinyuan Shan , Jingling Fu , Yu Shi , Junshi Huang , Yan Li

Recent advancements in generative models have significantly improved novel view synthesis (NVS) from multi-view data. However, existing methods depend on external multi-view alignment processes, such as explicit pose estimation or…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Lingen Li , Zhaoyang Zhang , Yaowei Li , Jiale Xu , Wenbo Hu , Xiaoyu Li , Weihao Cheng , Jinwei Gu , Tianfan Xue , Ying Shan