English
Related papers

Related papers: SmartFreeEdit: Mask-Free Spatial-Aware Image Editi…

200 papers

Modern video editing techniques have achieved high visual fidelity when inserting video objects. However, they focus on optimizing visual fidelity rather than physical causality, leading to edits that are physically inconsistent with their…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Bohai Gu , Taiyi Wu , Dazhao Du , Jian Liu , Shuai Yang , Xiaotong Zhao , Alan Zhao , Song Guo

Pre-trained large language models (LLMs) have demonstrated strong common-sense reasoning abilities, making them promising for robotic navigation and planning tasks. However, despite recent progress, bridging the gap between language…

Robotics · Computer Science 2025-12-29 Mingfeng Yuan , Letian Wang , Steven L. Waslander

Due to the challenges of manually collecting accurate editing data, existing datasets are typically constructed using various automated methods, leading to noisy supervision signals caused by the mismatch between editing instructions and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Ming Li , Xin Gu , Fan Chen , Xiaoying Xing , Longyin Wen , Chen Chen , Sijie Zhu

Recently, semantic segmentation models trained with image-level text supervision have shown promising results in challenging open-world scenarios. However, these models still face difficulties in learning fine-grained semantic alignment at…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Kaixin Cai , Pengzhen Ren , Yi Zhu , Hang Xu , Jianzhuang Liu , Changlin Li , Guangrun Wang , Xiaodan Liang

We propose NeRF-Insert, a NeRF editing framework that allows users to make high-quality local edits with a flexible level of control. Unlike previous work that relied on image-to-image models, we cast scene editing as an in-painting…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Benet Oriol Sabat , Alessandro Achille , Matthew Trager , Stefano Soatto

Multimodal Large Language Models (MLLMs) have shown impressive abilities in understanding and reasoning over conventional images. However, their perception of 360{\deg} images remains largely underexplored. Unlike conventional images,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Huyen T. T. Tran , Van-Quang Nguyen , Farros Alferro , Kang-Jun Liu , Takayuki Okatani

Multimodal large language models (MLLMs) have shown remarkable performance in vision-language tasks. However, existing MLLMs are primarily trained on generic datasets, limiting their ability to reason on domain-specific visual cues such as…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Hatef Otroshi Shahreza , Sébastien Marcel

Humans naturally communicate through abstract concepts like "mood". However, current image editing benchmarks focus primarily on explicit, literal commands, leaving abstract instructions largely underexplored. In this work, we first…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Mor Ventura , Roy Hirsch , Yonatan Bitton , Regev Cohen , Roi Reichart

Recent developments in the field of diffusion models have demonstrated an exceptional capacity to generate high-quality prompt-conditioned image edits. Nevertheless, previous approaches have primarily relied on textual prompts for image…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Goirik Chakrabarty , Aditya Chandrasekar , Ramya Hebbalaguppe , Prathosh AP

Language-driven image editing can significantly save the laborious image editing work and be friendly to the photography novice. However, most similar work can only deal with a specific image domain or can only do global retouching. To…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Jing Shi , Ning Xu , Trung Bui , Franck Dernoncourt , Zheng Wen , Chenliang Xu

Large-scale video diffusion models show strong world simulation and temporal reasoning abilities, but their use as zero-shot image editors remains underexplored. We introduce IF-Edit, a tuning-free framework that repurposes pretrained…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Zechuan Zhang , Zhenyuan Chen , Zongxin Yang , Yi Yang

Multimodal large language models (MLLMs) have achieved impressive performance across various tasks such as image captioning and visual question answer(VQA); however, they often struggle to accurately interpret depth information inherent in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Hao Yang , Hongbo Zhang , Yanyan Zhao , Bing Qin

Recent progress in large language models (LLMs) has shown that reasoning improves when intermediate thoughts are externalized into explicit workspaces, such as chain-of-thought traces or tool-augmented reasoning. Yet, visual language models…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Oindrila Saha , Vojtech Krs , Radomir Mech , Subhransu Maji , Matheus Gadelha , Kevin Blackburn-Matzen

Text-driven image manipulation remains challenging in training or inference flexibility. Conditional generative models depend heavily on expensive annotated training data. Meanwhile, recent frameworks, which leverage pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Yueming Lyu , Tianwei Lin , Fu Li , Dongliang He , Jing Dong , Tieniu Tan

Editing complex visual content from ambiguous or partially specified instructions remains a core challenge in vision-language modeling. Existing models can contextualize content but often fail to infer the underlying intent within a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Umar Khalid , Kashif Munir , Hasan Iqbal , Azib Farooq , Jing Hua , Nazanin Rahnavard , Chen Chen , Victor Zhu , Zhengping Ji

Multimodal Large Language Models (MLLMs) rely on strong linguistic reasoning inherited from their base language models. However, multimodal instruction fine-tuning paradoxically degrades this text's reasoning capability, undermining…

Computation and Language · Computer Science 2026-01-13 Zijing Wang , Yongkang Liu , Mingyang Wang , Ercong Nie , Deyuan Chen , Zhengjie Zhao , Shi Feng , Daling Wang , Xiaocui Yang , Yifei Zhang , Hinrich Schütze

Spatial intelligence requires multimodal large language models (MLLMs) to move beyond single-view perception and reason consistently about objects, visibility, geometry, and interactions across multiple viewpoints. However, progress in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Wei Wang , Yuqian Yuan , Tianwei Lin , Wenqiao Zhang , Siliang Tang , Jun Xiao , Yueting Zhuang

Text-driven image editing has achieved remarkable success in following single instructions. However, real-world scenarios often involve complex, multi-step instructions, particularly ``chain'' instructions where operations are…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Chenglin Wang , Yucheng Zhou , Qianning Wang , Zhe Wang , Kai Zhang

Image spatial editing performs geometry-driven transformations, allowing precise control over object layout and camera viewpoints. Current models are insufficient for fine-grained spatial manipulations, motivating a dedicated assessment…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Yicheng Xiao , Wenhu Zhang , Lin Song , Yukang Chen , Wenbo Li , Nan Jiang , Tianhe Ren , Haokun Lin , Wei Huang , Haoyang Huang , Xiu Li , Nan Duan , Xiaojuan Qi

The scarcity of annotated data in specialized domains such as medical imaging presents significant challenges to training robust vision models. While self-supervised masked image modeling (MIM) offers a promising solution, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Ruilang Wang , Shuotong Xu , Bowen Liu , Runlin Huang , Donglong Chen , Weifeng Su