English
Related papers

Related papers: LatentEditor: Text Driven Local Editing of 3D Scen…

200 papers

Diffusion-based point editing methods have gained significant traction in image editing tasks due to their ability to manipulate image semantics and fine details by applying localized perturbations on the manifold of noise latent. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Haoyang Hu , Masataka Seo , Yen-Wei Chen

This paper presents a novel approach to improving text-guided image editing using diffusion-based models. Text-guided image editing task poses key challenge of precisly locate and edit the target semantic, and previous methods fall shorts…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Yihan Hu , Jianing Peng , Yiheng Lin , Ting Liu , Xiaochao Qu , Luoqi Liu , Yao Zhao , Yunchao Wei

Instruction-based image editing enables precise modifications via natural language prompts, but existing methods face a precision-efficiency tradeoff: fine-tuning demands massive datasets (>10M) and computational resources, while…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Zechuan Zhang , Ji Xie , Yu Lu , Zongxin Yang , Yi Yang

Recently, the editing of neural radiance fields (NeRFs) has gained considerable attention, but most prior works focus on static scenes while research on the appearance editing of dynamic scenes is relatively lacking. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Shangzan Zhang , Sida Peng , Yinji ShenTu , Qing Shuai , Tianrun Chen , Kaicheng Yu , Hujun Bao , Xiaowei Zhou

Recent advances in deep learning have inspired numerous works on data-driven solutions to partial differential equation (PDE) problems. These neural PDE solvers can often be much faster than their numerical counterparts; however, each…

Machine Learning · Computer Science 2025-02-06 Anthony Zhou , Zijie Li , Michael Schneier , John R Buchanan , Amir Barati Farimani

Recent advancements in generative models have revolutionized image generation and editing, making these tasks accessible to non-experts. This paper focuses on local image editing, particularly the task of adding new content to a loosely…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Omer Regev , Omri Avrahami , Dani Lischinski

The goal of scene text image super-resolution is to reconstruct high-resolution text-line images from unrecognizable low-resolution inputs. The existing methods relying on the optimization of pixel-level loss tend to yield text edges that…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Baolin Liu , Zongyuan Yang , Pengfei Wang , Junjie Zhou , Ziqi Liu , Ziyi Song , Yan Liu , Yongping Xiong

Latent space-based facial attribute editing methods have gained popularity in applications such as digital entertainment, virtual avatar creation, and human-computer interaction systems due to their potential for efficient and flexible…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Bo Liu , Xuan Cui , Run Zeng , Wei Duan , Chongwen Liu , Jinrui Qian , Lianggui Tang , Hongping Gan

Text-driven 3D stylization is a complex and crucial task in the fields of computer vision (CV) and computer graphics (CG), aimed at transforming a bare mesh to fit a target text. Prior methods adopt text-independent multilayer perceptrons…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Yiwei Ma , Xiaioqing Zhang , Xiaoshuai Sun , Jiayi Ji , Haowei Wang , Guannan Jiang , Weilin Zhuang , Rongrong Ji

The creation of 3D scenes has traditionally been both labor-intensive and costly, requiring designers to meticulously configure 3D assets and environments. Recent advancements in generative AI, including text-to-3D and image-to-3D methods,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Ziyang Yan , Yihua Shao , Minwen Liao , Siyu Chen , Nan Wang , Muyuan Lin , Jenq-Neng Hwang , Hao Zhao , Fabio Remondino , Lei Li

Scene text editing (STE) aims to replace text with the desired one while preserving background and styles of the original text. However, due to the complicated background textures and various text styles, existing methods fall short in…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Yadong Qu , Qingfeng Tan , Hongtao Xie , Jianjun Xu , Yuxin Wang , Yongdong Zhang

This paper proposes a novel and physically interpretable method for face editing based on arbitrary text prompts. Different from previous GAN-inversion-based face editing methods that manipulate the latent space of GANs, or diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Yapeng Meng , Songru Yang , Xu Hu , Rui Zhao , Lincheng Li , Zhenwei Shi , Zhengxia Zou

Text-to-image diffusion models have recently received increasing interest for their astonishing ability to produce high-fidelity images from solely text inputs. Subsequent research efforts aim to exploit and apply their capabilities to real…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Manuel Brack , Felix Friedrich , Katharina Kornmeier , Linoy Tsaban , Patrick Schramowski , Kristian Kersting , Apolinário Passos

We introduce InseRF, a novel method for generative object insertion in the NeRF reconstructions of 3D scenes. Based on a user-provided textual description and a 2D bounding box in a reference viewpoint, InseRF generates new objects in 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Mohamad Shahbazi , Liesbeth Claessens , Michael Niemeyer , Edo Collins , Alessio Tonioni , Luc Van Gool , Federico Tombari

Drawing upon StyleGAN's expressivity and disentangled latent space, existing 2D approaches employ textual prompting to edit facial images with different attributes. In contrast, 3D-aware approaches that generate faces at different target…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Amandeep Kumar , Muhammad Awais , Sanath Narayan , Hisham Cholakkal , Salman Khan , Rao Muhammad Anwer

3D editing has shown remarkable capability in editing scenes based on various instructions. However, existing methods struggle with achieving intuitive, localized editing, such as selectively making flowers blossom. Drag-style editing has…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Chenghao Gu , Zhenzhe Li , Zhengqi Zhang , Yunpeng Bai , Shuzhao Xie , Zhi Wang

Diffusion-based image editing offers strong semantic controllability, but remains computationally expensive due to iterative high-resolution denoising over all spatial tokens. Dynamic-resolution sampling reduces this cost by performing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Zhengan Yan , Shikang Zheng , Haoran Qin , Xiaobing Tu , Yinggui Wang , Jiacheng Liu , Jiaxuan Ren , Yuqi Lin , Peiliang Cai , Jinkui Ren , Xiantao Zhang , Linfeng Zhang

Visual-prompt-guided edit transfer aims to learn image transformations directly from example pairs, offering more precise and controllable editing than purely text-driven approaches. However, existing diffusion transformer-based methods…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Lan Chen , Qi Mao , Yiren Song , Yuchao Gu , Siwei Ma

Scene text editing is a challenging task that involves modifying or inserting specified texts in an image while maintaining its natural and realistic appearance. Most previous approaches to this task rely on style-transfer models that crop…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Jiabao Ji , Guanhua Zhang , Zhaowen Wang , Bairu Hou , Zhifei Zhang , Brian Price , Shiyu Chang

In spite of the rapidly evolving landscape of text-to-image generation, the synthesis and manipulation of multiple entities while adhering to specific relational constraints pose enduring challenges. This paper introduces an innovative…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 YuTeng Ye , Jiale Cai , Hang Zhou , Guanwen Li , Youjia Zhang , Zikai Song , Chenxing Gao , Junqing Yu , Wei Yang