English
Related papers

Related papers: PICABench: How Far Are We from Physically Realisti…

200 papers

Recent advances in text-driven image editing have been significant, yet the task of accurately evaluating these edited images continues to pose a considerable challenge. Different from the assessment of text-driven image generation,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Shangkun Sun , Bowen Qu , Xiaoyu Liang , Songlin Fan , Wei Gao

Instruction-guided video editing has emerged as a rapidly advancing research direction, offering new opportunities for intuitive content transformation while also posing significant challenges for systematic evaluation. Existing video…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Yinan Chen , Jiangning Zhang , Teng Hu , Yuxiang Zeng , Zhucun Xue , Qingdong He , Chengjie Wang , Yong Liu , Xiaobin Hu , Shuicheng Yan

Instruction-based image editing has achieved remarkable success in semantic alignment, yet state-of-the-art models frequently fail to render physically plausible results when editing involves complex causal dynamics, such as refraction or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Liangbing Zhao , Le Zhuo , Sayak Paul , Hongsheng Li , Mohamed Elhoseiny

Existing image editing models struggle to meet real-world demands. Despite excelling in academic benchmarks, they have yet to be widely adopted for real user needs. Datasets that power these models use artificial edits, lacking the scale…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Peter Sushko , Ayana Bharadwaj , Zhi Yang Lim , Vasily Ilin , Ben Caffee , Dongping Chen , Mohammadreza Salehi , Cheng-Yu Hsieh , Ranjay Krishna

Recent advances in multi-modal generative models have driven substantial improvements in image editing. However, current generative models still struggle with handling diverse and complex image editing tasks that require implicit reasoning,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Feng Han , Yibin Wang , Chenglin Li , Zheming Liang , Dianyi Wang , Yang Jiao , Zhipeng Wei , Chao Gong , Cheng Jin , Jingjing Chen , Jiaqi Wang

Recent advancements in image editing have enabled highly controllable and semantically-aware alteration of visual content, posing unprecedented challenges to manipulation localization. However, existing AI-generated forgery localization…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Shiyu Wu , Shuyan Li , Jing Li , Jing Liu , Yequan Wang

While Vision-Language Models (VLMs) achieve near-perfect scores on digital document benchmarks like OmniDocBench, their performance in the unpredictable physical world remains largely unknown due to the lack of controlled yet realistic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Changda Zhou , Ziyue Gao , Xueqing Wang , Tingquan Gao , Cheng Cui , Jing Tang , Yi Liu

In recent years, image editing models have made significant progress, enabling users to manipulate visual content in a flexible and interactive manner through natural language instructions. However, an important yet underexplored research…

Text-to-image (T2I) models have made substantial progress in generating images from textual prompts. However, they frequently fail to produce images consistent with physical commonsense, a vital capability for applications in world…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Fanqing Meng , Wenqi Shao , Lixin Luo , Yahong Wang , Yiran Chen , Quanfeng Lu , Yue Yang , Tianshuo Yang , Kaipeng Zhang , Yu Qiao , Ping Luo

Accurately generating images of human bodies from text remains a challenging problem for state of the art text-to-image models. Commonly observed body-related artifacts include extra or missing limbs, unrealistic poses, blurred body parts,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Nefeli Andreou , Varsha Vivek , Ying Wang , Alex Vorobiov , Tiffany Deng , Raja Bala , Larry Davis , Betty Mohler Tesch

Text-to-Image (T2I) generative models are becoming increasingly crucial due to their ability to generate high-quality images, but also raise concerns about social biases, particularly in human image generation. Sociological research has…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Hanjun Luo , Haoyu Huang , Ziye Deng , Xinfeng Li , Hewei Wang , Yingbin Jin , Yang Liu , Wenyuan Xu , Zuozhu Liu

Text-guided image editing has seen significant progress in natural image domains, but its application in medical imaging remains limited and lacks standardized evaluation frameworks. Such editing could revolutionize clinical practices by…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Minghao Liu , Zhitao He , Zhiyuan Fan , Qingyun Wang , Yi R. Fung

Despite recent advances in inversion and instruction-based image editing, existing approaches primarily excel at editing single, prominent objects but significantly struggle when applied to complex scenes containing multiple entities. To…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Bimsara Pathiraja , Maitreya Patel , Shivam Singh , Yezhou Yang , Chitta Baral

Editing images with instructions to reflect non-rigid motions, camera viewpoint shifts, object deformations, human articulations, and complex interactions, poses a challenging yet underexplored problem in computer vision. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Di Chang , Mingdeng Cao , Yichun Shi , Bo Liu , Shengqu Cai , Shijie Zhou , Weilin Huang , Gordon Wetzstein , Mohammad Soleymani , Peng Wang

Current benchmarks for evaluating the reasoning capabilities of Large Language Models (LLMs) face significant limitations: task oversimplification, data contamination, and flawed evaluation items. These deficiencies necessitate more…

Natural language instructions are a powerful interface for editing the outputs of text-to-image diffusion models. However, several challenges need to be addressed: 1) underspecification (the need to model the implicit meaning of…

Computation and Language · Computer Science 2023-10-31 Tuhin Chakrabarty , Kanishk Singh , Arkadiy Saakyan , Smaranda Muresan

In this paper, we present LookBench (We use the term "look" to reflect retrieval that mirrors how people shop -- finding the exact item, a close substitute, or a visually consistent alternative.), a live, holistic and challenging benchmark…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Gensmo. ai , Chao Gao , Siqiao Xue , Jiwen Fu , Tingyi Gu , Shanshan Li , Fan Zhou

Can general-purpose image editors predict physical maps from a single RGB image? General-purpose image editors differ from standard task-specific dense-prediction models: they do not directly take an image and output a physical map.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Jiaxin Yang , Yu Hou , Muxin Liu , Weixuan Liu , Ze Yuan , Zeming Chen , Zhongrui Wang , Xiaojuan Qi

An image editing model should be able to perform diverse edits, ranging from object replacement, changing attributes or style, to performing actions or movement, which require many forms of reasoning. Current general instruction-guided…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Benno Krojer , Dheeraj Vattikonda , Luis Lara , Varun Jampani , Eva Portelance , Christopher Pal , Siva Reddy

In an era where numerous studies claim to achieve almost photorealism with real-time automated environment capture, there is a need for assessments and reproducibility in this domain. This paper presents a transparent and reproducible user…

Human-Computer Interaction · Computer Science 2024-07-03 Sven Kluge , Oliver Staadt