English
Related papers

Related papers: LightMover: Generative Light Movement with Color a…

200 papers

Colour is one of the most perceptually salient yet least controllable attributes in image generation. Although recent diffusion models can modify object colours from user instructions, their results often deviate from the intended hue,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yuqi Yang , Dongliang Chang , Yijia Ling , Ruoyi Du , Zhanyu Ma

Enabling image generation models to be spatially controlled is an important area of research, empowering users to better generate images according to their own fine-grained specifications via e.g. edge maps, poses. Although this task has…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Guoxuan Xia , Harleen Hanspal , Petru-Daniel Tudosiu , Shifeng Zhang , Sarah Parisot

Generative diffusion models have advanced image editing with high-quality results and intuitive interfaces such as prompts and semantic drawing. However, these interfaces lack precise control, and the associated methods typically specialize…

Image animation has seen significant progress, driven by the powerful generative capabilities of diffusion models. However, maintaining appearance consistency with static input images and mitigating abrupt motion transitions in generated…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Xin Ma , Yaohui Wang , Genyun Jia , Xinyuan Chen , Tien-Tsin Wong , Cunjian Chen

Recent deep generative models are able to provide photo-realistic images as well as visual or textual content embeddings useful to address various tasks of computer vision and natural language processing. Their usefulness is nevertheless…

Machine Learning · Computer Science 2020-01-29 Antoine Plumerault , Hervé Le Borgne , Céline Hudelot

Visual-prompt-guided edit transfer aims to learn image transformations directly from example pairs, offering more precise and controllable editing than purely text-driven approaches. However, existing diffusion transformer-based methods…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Lan Chen , Qi Mao , Yiren Song , Yuchao Gu , Siwei Ma

We propose a generative model that, given a coarsely edited image, synthesizes a photorealistic output that follows the prescribed layout. Our method transfers fine details from the original image and preserve the identity of its parts.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Hadi Alzayer , Zhihao Xia , Xuaner Zhang , Eli Shechtman , Jia-Bin Huang , Michael Gharbi

Human motion stylization aims to revise the style of an input motion while keeping its content unaltered. Unlike existing works that operate directly in pose space, we leverage the latent space of pretrained autoencoders as a more…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Chuan Guo , Yuxuan Mu , Xinxin Zuo , Peng Dai , Youliang Yan , Juwei Lu , Li Cheng

Recent advances in illumination control extend image-based methods to video, yet still facing a trade-off between lighting fidelity and temporal consistency. Moving beyond relighting, a key step toward generative modeling of real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Tianqi Liu , Zhaoxi Chen , Zihao Huang , Shaocong Xu , Saining Zhang , Chongjie Ye , Bohan Li , Zhiguo Cao , Wei Li , Hao Zhao , Ziwei Liu

Diffusion models have achieved remarkable progress in video generation, but their controllability remains a major limitation. Key scene factors such as layout, lighting, and camera trajectory are often entangled or only weakly modeled,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Ziqi Cai , Taoyu Yang , Zheng Chang , Si Li , Han Jiang , Shuchen Weng , Boxin Shi

Text-to-motion generation is driven by learning motion representations for semantic alignment with language. Existing methods rely on either continuous or discrete motion representations. However, continuous representations entangle…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Dawei Guan , Di Yang , Chengjie Jin , Jiangtao Wang

Adaptive and flexible image editing is a desirable function of modern generative models. In this work, we present a generative model with auto-encoder architecture for per-region style manipulation. We apply a code consistency loss to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Ansheng You , Chenglin Zhou , Qixuan Zhang , Lan Xu

Text-guided image editing is an essential task that enables users to modify images through natural language descriptions. Recent advances in diffusion models and rectified flows have significantly improved editing quality, primarily relying…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yufei Wang , Lanqing Guo , Zhihao Li , Jiaxing Huang , Pichao Wang , Bihan Wen , Jian Wang

We study the problem of generating intermediate images from image pairs with large motion while maintaining semantic consistency. Due to the large motion, the intermediate semantic information may be absent in input images. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Liao Shen , Tianqi Liu , Huiqiang Sun , Xinyi Ye , Baopu Li , Jianming Zhang , Zhiguo Cao

This paper strives for image editing via generative models. Flow Matching is an emerging generative modeling technique that offers the advantage of simple and efficient training. Simultaneously, a new transformer-based U-ViT has recently…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Vincent Tao Hu , David W Zhang , Pascal Mettes , Meng Tang , Deli Zhao , Cees G. M. Snoek

Deep learning-based image enhancement methods show significant advantages in reducing noise and improving visibility in low-light conditions. These methods are typically based on one-to-one mapping, where the model learns a direct…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Miao Zhang , Jun Yin , Pengyu Zeng , Yiqing Shen , Shuai Lu , Xueqian Wang

Existing approaches for controlling text-to-image diffusion models, while powerful, do not allow for explicit 3D object-centric control, such as precise control of object orientation. In this work, we address the problem of multi-object…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Rishubh Parihar , Vaibhav Agrawal , Sachidanand VS , R. Venkatesh Babu

This paper introduces a novel approach to illumination manipulation in diffusion models, addressing the gap in conditional image generation with a focus on lighting conditions. We conceptualize the diffusion model as a black-box image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Xiaoyan Xing , Vincent Tao Hu , Jan Hendrik Metzen , Konrad Groh , Sezer Karaoglu , Theo Gevers

Camera control has been actively studied in text or image conditioned video generation tasks. However, altering camera trajectories of a given video remains under-explored, despite its importance in the field of video creation. It is…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Jianhong Bai , Menghan Xia , Xiao Fu , Xintao Wang , Lianrui Mu , Jinwen Cao , Zuozhu Liu , Haoji Hu , Xiang Bai , Pengfei Wan , Di Zhang

Recently, text-to-image generation models have achieved remarkable advancements, particularly with diffusion models facilitating high-quality image synthesis from textual descriptions. However, these models often struggle with achieving…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Lunhao Duan , Shanshan Zhao , Wenjun Yan , Yinglun Li , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang , Mingming Gong , Gui-Song Xia