English
Related papers

Related papers: PaintFlow: A Unified Framework for Interactive Oil…

200 papers

Interactive image editing allows users to modify images through visual interaction operations such as drawing, clicking, and dragging. Existing methods construct such supervision signals from videos, as they capture how objects change with…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Yabo Zhang , Xinpeng Zhou , Yihan Zeng , Hang Xu , Hui Li , Wangmeng Zuo

Drag-based image editing has long suffered from distortions in the target region, largely because the priors of earlier base models, Stable Diffusion, are insufficient to project optimized latents back onto the natural image manifold. With…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zihan Zhou , Shilin Lu , Shuli Leng , Shaocong Zhang , Zhuming Lian , Xinlei Yu , Adams Wai-Kin Kong

This paper proposes a novel and physically interpretable method for face editing based on arbitrary text prompts. Different from previous GAN-inversion-based face editing methods that manipulate the latent space of GANs, or diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Yapeng Meng , Songru Yang , Xu Hu , Rui Zhao , Lincheng Li , Zhenwei Shi , Zhengxia Zou

We introduce $\textit{InteractiveVideo}$, a user-centric framework for video generation. Different from traditional generative approaches that operate based on user-provided images or text, our framework is designed for dynamic interaction,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Yiyuan Zhang , Yuhao Kang , Zhixin Zhang , Xiaohan Ding , Sanyuan Zhao , Xiangyu Yue

Synthetic datasets play a critical role in pre-training CNN models for optical flow, but they are painstaking to generate and hard to adapt to new applications. To automate the process, we present AutoFlow, a simple and effective method to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Deqing Sun , Daniel Vlasic , Charles Herrmann , Varun Jampani , Michael Krainin , Huiwen Chang , Ramin Zabih , William T. Freeman , Ce Liu

Humans paint images incrementally: they plan a global layout, sketch a coarse draft, inspect, and refine details, and most importantly, each step is grounded in the evolving visual states. However, can unified multimodal models trained on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Lei Zhang , Junjiao Tian , Zhipeng Fan , Kunpeng Li , Jialiang Wang , Weifeng Chen , Markos Georgopoulos , Felix Juefei-Xu , Yuxiang Bao , Julian McAuley , Manling Li , Zecheng He

The reproducibility issue in science has come under increased scrutiny. One consistent suggestion lies in the use of scripted methods or workflows for data analysis. Image analysis is one area in science in which little can be done in…

Image and Video Processing · Electrical Eng. & Systems 2017-09-22 Paul A. Thompson , Norm Matloff , Alex Fu , Ariel Shin

The generative AI revolution has recently expanded to videos. Nevertheless, current state-of-the-art video models are still lagging behind image models in terms of visual quality and user control over the generated content. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Michal Geyer , Omer Bar-Tal , Shai Bagon , Tali Dekel

We introduce UniReal, a unified framework designed to address various image generation and editing tasks. Existing solutions often vary by tasks, yet share fundamental principles: preserving consistency between inputs and outputs while…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Xi Chen , Zhifei Zhang , He Zhang , Yuqian Zhou , Soo Ye Kim , Qing Liu , Yijun Li , Jianming Zhang , Nanxuan Zhao , Yilin Wang , Hui Ding , Zhe Lin , Hengshuang Zhao

Immersive authoring provides an intuitive medium for users to create 3D scenes via direct manipulation in Virtual Reality (VR). Recent advances in generative AI have enabled the automatic creation of realistic 3D layouts. However, it is…

Human-Computer Interaction · Computer Science 2024-08-20 Lei Zhang , Jin Pan , Jacob Gettig , Steve Oney , Anhong Guo

Flow matching models have emerged as a strong alternative to diffusion models, but existing inversion and editing methods designed for diffusion are often ineffective or inapplicable to them. The straight-line, non-crossing trajectories of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Guanlong Jiao , Biqing Huang , Kuan-Chieh Wang , Renjie Liao

Recent advancements in Large Language Models (LLMs) have shown significant progress in understanding complex natural language. One important application of LLM is LLM-based AI Agent, which leverages the ability of LLM as well as external…

Computation and Language · Computer Science 2024-07-19 Zelong Li , Shuyuan Xu , Kai Mei , Wenyue Hua , Balaji Rama , Om Raheja , Hao Wang , He Zhu , Yongfeng Zhang

Colorizing line art is a pivotal task in the production of hand-drawn cel animation. This typically involves digital painters using a paint bucket tool to manually color each segment enclosed by lines, based on RGB values predetermined by a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Yuekun Dai , Shangchen Zhou , Qinyue Li , Chongyi Li , Chen Change Loy

The effective communication of procedural knowledge remains a significant challenge in natural language processing (NLP), as purely textual instructions often fail to convey complex physical actions and spatial relationships. We address…

Computation and Language · Computer Science 2025-05-23 Jing Bi , Pinxin Liu , Ali Vosoughi , Jiarui Wu , Jinxi He , Chenliang Xu

Image-to-3D generation faces inherent semantic ambiguity under occlusion, where partial observation alone is often insufficient to determine object category. In this work, we formalize text-driven amodal 3D generation, where text prompts…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Jiayin Zhu , Guoji Fu , Xiaolu Liu , Qiyuan He , Yicong Li , Angela Yao

Existing Flow Matching (FM) text-to-image models suffer from two critical bottlenecks under multi-task alignment: the reward sparsity induced by scalar-valued rewards, and the gradient interference arising from jointly optimizing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Zhen Fang , Wenxuan Huang , Yu Zeng , Yiming Zhao , Shuang Chen , Kaituo Feng , Yunlong Lin , Lin Chen , Zehui Chen , Shaosheng Cao , Feng Zhao

Recently, diffusion models have exhibited superior performance in the area of image inpainting. Inpainting methods based on diffusion models can usually generate realistic, high-quality image content for masked areas. However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Ruichen Wang , Junliang Zhang , Qingsong Xie , Chen Chen , Haonan Lu

In recent years, integrating multimodal understanding and generation into a single unified model has emerged as a promising paradigm. While this approach achieves strong results in text-to-image (T2I) generation, it still struggles with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Ziyun Zeng , David Junhao Zhang , Wei Li , Mike Zheng Shou

Conventional picture-book production imposes substantial physical and temporal demands on creators, often constraining opportunities for high-level artistic exploration. While generative AI can drastically accelerate image generation,…

Human-Computer Interaction · Computer Science 2026-04-07 Cosei Kawa

Medical imaging research is increasingly shifting from controlled benchmark evaluation toward real-world clinical deployment. In such settings, applying analytical methods extends beyond model design to require dataset-aware workflow…