English
Related papers

Related papers: Vinedresser3D: Agentic Text-guided 3D Editing

200 papers

3D object editing is essential for interactive content creation in gaming, animation, and robotics, yet current approaches remain inefficient, inconsistent, and often fail to preserve unedited regions. Most methods rely on editing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Junliang Ye , Shenghao Xie , Ruowen Zhao , Zhengyi Wang , Hongyu Yan , Wenqiang Zu , Lei Ma , Jun Zhu

Perception and prediction are two separate modules in the existing autonomous driving systems. They interact with each other via hand-picked features such as agent bounding boxes and trajectories. Due to this separation, prediction, as a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Junru Gu , Chenxu Hu , Tianyuan Zhang , Xuanyao Chen , Yilun Wang , Yue Wang , Hang Zhao

3D Visual Grounding (3D-VG) aims to localize objects in 3D scenes via natural language descriptions. While recent advancements leveraging Vision-Language Models (VLMs) have explored zero-shot possibilities, they typically suffer from a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Haibo Wang , Zihao Lin , Zhiyang Xu , Lifu Huang

3D generation from natural language offers significant potential to reduce expert manual modeling efforts and enhance accessibility to 3D assets. However, existing methods often yield unstructured meshes and exhibit poor interactivity,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Shuyuan Zhang , Chenhan Jiang , Zuoou Li , Jiankang Deng

Referring-based Video Object Segmentation is a multimodal problem that requires producing fine-grained segmentation results guided by external cues. Traditional approaches to this task typically involve training specialized models, which…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Tuyen Tran , Thao Minh Le , Truyen Tran

Text-guided image editing, fueled by recent advancements in generative AI, is becoming increasingly widespread. This trend highlights the need for a comprehensive framework to verify text-guided edits and assess their quality. To address…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Ron Yosef , Moran Yanuka , Yonatan Bitton , Dani Lischinski

Text-to-image generative models have achieved remarkable visual quality but still struggle with compositionality$-$accurately capturing object relationships, attribute bindings, and fine-grained details in prompts. A key limitation is that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Arman Zarei , Jiacheng Pan , Matthew Gwilliam , Soheil Feizi , Zhenheng Yang

Recently, text-guided image manipulation has received increasing attention in the research field of multimedia processing and computer vision due to its high flexibility and controllability. Its goal is to semantically manipulate parts of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Ryugo Morita , Zhiqiang Zhang , Man M. Ho , Jinjia Zhou

Photo-realistic and controllable 3D avatars are crucial for various applications such as virtual and mixed reality (VR/MR), telepresence, gaming, and film production. Traditional methods for avatar creation often involve time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Keqiang Sun , Amin Jourabloo , Riddhish Bhalodia , Moustafa Meshry , Yu Rong , Zhengyu Yang , Thu Nguyen-Phuoc , Christian Haene , Jiu Xu , Sam Johnson , Hongsheng Li , Sofien Bouaziz

The generation of high-quality, animatable 3D head avatars from text has enormous potential in content creation applications such as games, movies, and embodied virtual assistants. Current text-to-3D generation methods typically combine…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Yiqian Wu , Malte Prinzler , Xiaogang Jin , Siyu Tang

Speech-driven 3D facial animation has been widely studied, yet there is still a gap to achieving realism and vividness due to the highly ill-posed nature and scarcity of audio-visual data. Existing works typically formulate the cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Jinbo Xing , Menghan Xia , Yuechen Zhang , Xiaodong Cun , Jue Wang , Tien-Tsin Wong

Recent advances in text-to-image (T2I) models have enabled training-free regional image editing by leveraging the generative priors of foundation models. However, existing methods struggle to balance text adherence in edited regions,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Weiyan Xie , Han Gao , Didan Deng , Kaican Li , April Hua Liu , Yongxiang Huang , Nevin L. Zhang

Automated metasurface design is increasingly important, and recent advances in language-model systems are opening a route toward agentic optical design. Yet modern metasurface applications, from metalenses and holography to optical…

Optics · Physics 2026-05-25 Bei Wu , Bo Xiong , Haiyao Luo , Yaqi Li , Li Zhang , Qiaolu Chen , Hongsheng Chen , Yihao Yang

Despite recent progress in 3D-LLMs, they remain limited in accurately grounding language to visual and spatial elements in 3D environments. This limitation stems in part from training data that focuses on language reasoning rather than…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Yue Zhang , Zun Wang , Han Lin , Jialu Li , Jianing Yang , Yonatan Bitton , Idan Szpektor , Mohit Bansal

Text driven diffusion models have shown remarkable capabilities in editing images. However, when editing 3D scenes, existing works mostly rely on training a NeRF for 3D editing. Recent NeRF editing methods leverages edit operations by…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Vivek Madhavaram , Shivangana Rawat , Chaitanya Devaguptapu , Charu Sharma , Manohar Kaul

Text-driven video editing aims to modify video content based on natural language instructions. While recent training-free methods have leveraged pretrained diffusion models, they often rely on an inversion-editing paradigm. This paradigm…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Guangzhao Li , Yanming Yang , Chenxi Song , Chi Zhang

3D asset generation is getting massive amounts of attention, inspired by the recent success of text-guided 2D content creation. Existing text-to-3D methods use pretrained text-to-image diffusion models in an optimization problem or…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Lukas Höllein , Aljaž Božič , Norman Müller , David Novotny , Hung-Yu Tseng , Christian Richardt , Michael Zollhöfer , Matthias Nießner

Drag-based editing allows precise object manipulation through point-based control, offering user convenience. However, current methods often suffer from a geometric inconsistency problem by focusing exclusively on matching user-defined…

Graphics · Computer Science 2025-07-14 Gwanhyeong Koo , Sunjae Yoon , Younghwan Lee , Ji Woo Hong , Chang D. Yoo

This paper introduces a pioneering 3D volumetric encoder designed for text-to-3D generation. To scale up the training data for the diffusion model, a lightweight network is developed to efficiently acquire feature volumes from multi-view…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Zhicong Tang , Shuyang Gu , Chunyu Wang , Ting Zhang , Jianmin Bao , Dong Chen , Baining Guo

Scene synthesis and editing has emerged as a promising direction in computer graphics. Current trained approaches for 3D indoor scene generation either oversimplify object semantics through one-hot class encodings (e.g., 'chair' or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Martin JJ. Bucher , Iro Armeni