English
Related papers

Related papers: Anywhere: A Multi-Agent Framework for User-Guided,…

200 papers

Conditional text-to-image generation is an active area of research, with many possible applications. Existing research has primarily focused on generating a single image from available conditioning information in one step. One practical…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Alaaeldin El-Nouby , Shikhar Sharma , Hannes Schulz , Devon Hjelm , Layla El Asri , Samira Ebrahimi Kahou , Yoshua Bengio , Graham W. Taylor

Real-world perception and interaction are inherently multimodal, encompassing not only language but also vision and speech, which motivates the development of "Omni" MLLMs that support both multimodal inputs and multimodal outputs. While a…

Machine Learning · Computer Science 2026-01-27 Dongjie Cheng , Ruifeng Yuan , Yongqi Li , Runyang You , Wenjie Wang , Liqiang Nie , Lei Zhang , Wenjie Li

Existing generative approaches for guided image synthesis of multi-object scenes typically rely on 2D controls in the image or text space. As a result, these methods struggle to maintain and respect consistent three-dimensional geometric…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Léopold Maillard , Tom Durand , Adrien Ramanana Rahary , Maks Ovsjanikov

Identity-preserving video generation offers powerful tools for creative expression, allowing users to customize videos featuring their beloved characters. However, prevailing methods are typically designed and optimized for a single…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Jiahao Wang , Hualian Sheng , Sijia Cai , Yuxiao Yang , Weizhan Zhang , Caixia Yan , Bing Deng , Jieping Ye

The image-to-image generation task aims to produce controllable images by leveraging conditional inputs and prompt instructions. However, existing methods often train separate control branches for each type of condition, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Guoqing Zhang , Xingtong Ge , Lu Shi , Xin Zhang , Muqing Xue , Wanru Xu , Yigang Cen , Yidong Li

Diffusion models have emerged as powerful tools for high-quality image generation and editing, but guiding these models to produce specific outputs remains a challenge. Conventional approaches rely on conditioning mechanisms, such as text…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Nithesh Chandher Karthikeyan , Jonas Unger , Gabriel Eilertsen

The field of controllable human-centric video generation has witnessed remarkable progress, particularly with the advent of diffusion models. However, achieving precise and localized control over human motion in videos, such as replacing or…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Xiang Wang , Shiwei Zhang , Haonan Qiu , Ruihang Chu , Zekun Li , Yingya Zhang , Changxin Gao , Yuehuan Wang , Chunhua Shen , Nong Sang

Visual compliance verification is a critical yet underexplored problem in computer vision, especially in domains such as media, entertainment, and advertising where content must adhere to complex and evolving policy rules. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Rahul Ghosh , Baishali Chaudhury , Hari Prasanna Das , Meghana Ashok , Ryan Razkenari , Long Chen , Sungmin Hong , Chun-Hao Liu

The rapid advancement of AI-generated image (AIGI) models presents new challenges for evaluating image quality, particularly across three aspects: perceptual quality, prompt correspondence, and authenticity. To address these challenges, we…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Chuan Cui , Kejiang Chen , Zhihua Wei , Wen Shen , Weiming Zhang , Nenghai Yu

Embodied agents for creative tasks like photography must bridge the semantic gap between high-level language commands and geometric control. We introduce PhotoAgent, an agent that achieves this by integrating Large Multimodal Models (LMMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Lirong Che , Zhenfeng Gan , Yanbo Chen , Junbo Tan , Xueqian Wang

Metamaterials, renowned for their exceptional mechanical, electromagnetic, and thermal properties, hold transformative potential across diverse applications, yet their design remains constrained by labor-intensive trial-and-error methods…

With the advancement of AIGC (AI-generated content) technologies, an increasing number of generative models are revolutionizing fields such as video editing, music generation, and even film production. However, due to the limitations of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Daoan Zhang , Wenlin Yao , Xiaoyang Wang , Yebowen Hu , Jiebo Luo , Dong Yu

The proliferation of generative AI systems creates unprecedented opportunities for content creation while raising critical concerns about controllability, copyright infringement, and content provenance. Current generative models operate as…

Cryptography and Security · Computer Science 2026-01-13 Haris Khan , Sadia Asif , Shumaila Asif

In this paper, we study the problem of generating a set ofrealistic and diverse backgrounds when given only a smallforeground region. We refer to this task as image outpaint-ing. The technical challenge of this task is to synthesize notonly…

Computer Vision and Pattern Recognition · Computer Science 2019-10-28 Lingzhi Zhang , Jiancong Wang , Jianbo Shi

This study investigates identity-preserving image synthesis, an intriguing task in image generation that seeks to maintain a subject's identity while adding a personalized, stylistic touch. Traditional methods, such as Textual Inversion and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Yuxuan Yan , Chi Zhang , Rui Wang , Yichao Zhou , Gege Zhang , Pei Cheng , Gang Yu , Bin Fu

Adaptive and flexible image editing is a desirable function of modern generative models. In this work, we present a generative model with auto-encoder architecture for per-region style manipulation. We apply a code consistency loss to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Ansheng You , Chenglin Zhou , Qixuan Zhang , Lan Xu

Generative Adversarial Networks (GANs) have become the de-facto standard in image synthesis. However, without considering the foreground-background decomposition, existing GANs tend to capture excessive content correlation between…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Kaiwen Cui , Gongjie Zhang , Fangneng Zhan , Jiaxing Huang , Shijian Lu

We present a self-supervised method to improve an agent's abilities in describing arbitrary objects while actively exploring a generic environment. This is a challenging problem, as current models struggle to obtain coherent image captions…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Tommaso Galliena , Tommaso Apicella , Stefano Rosa , Pietro Morerio , Alessio Del Bue , Lorenzo Natale

Recent text-to-image models produce high-quality results but still struggle with precise visual control, balancing multimodal inputs, and requiring extensive training for complex multimodal image generation. To address these limitations, we…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Haozhe Zhao , Zefan Cai , Shuzheng Si , Liang Chen , Jiuxiang Gu , Wen Xiao , Minjia Zhang , Junjie Hu

Large foundation models have recently emerged as a prominent focus of interest, attaining superior performance in widespread scenarios. Due to the scarcity of 3D data, many efforts have been made to adapt pre-trained transformers from…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Yiwen Tang , Ray Zhang , Jiaming Liu , Zoey Guo , Dong Wang , Zhigang Wang , Bin Zhao , Shanghang Zhang , Peng Gao , Hongsheng Li , Xuelong Li