English
Related papers

Related papers: UniREditBench: A Unified Reasoning-based Image Edi…

200 papers

We present UniModel, a unified generative model that jointly supports visual understanding and visual generation within a single pixel-to-pixel diffusion framework. Our goal is to achieve unification along three axes: the model, the tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Chi Zhang , Jiepeng Wang , Youming Wang , Yuanzhi Liang , Xiaoyan Yang , Zuoxin Li , Haibin Huang , Xuelong Li

Beneath the stunning visual fidelity of modern AIGC models lies a "logical desert", where systems fail tasks that require physical, causal, or complex spatial reasoning. Current evaluations largely rely on superficial metrics or fragmented…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Haonan Han , Jiancheng Huang , Xiaopeng Sun , Junyan He , Rui Yang , Jie Hu , Xiaojiang Peng , Lin Ma , Xiaoming Wei , Xiu Li

Text-driven image editing has achieved remarkable success in following single instructions. However, real-world scenarios often involve complex, multi-step instructions, particularly ``chain'' instructions where operations are…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Chenglin Wang , Yucheng Zhou , Qianning Wang , Zhe Wang , Kai Zhang

Instruction-driven image editing with unified multimodal generative models has advanced rapidly, yet their underlying visual reasoning remains limited, leading to suboptimal performance on reasoning-centric edits. Reinforcement learning…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Hengjia Li , Liming Jiang , Qing Yan , Yizhi Song , Hao Kang , Zichuan Liu , Xin Lu , Boxi Wu , Deng Cai

In-context image generation and editing (ICGE) enables users to specify visual concepts through interleaved image-text prompts, demanding precise understanding and faithful execution of user intent. Although recent unified multimodal models…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Runze He , Yiji Cheng , Tiankai Hang , Zhimin Li , Yu Xu , Zijin Yin , Shiyi Zhang , Wenxun Dai , Penghui Du , Ao Ma , Chunyu Wang , Qinglin Lu , Jizhong Han , Jiao Dai

Real-world design documents (e.g., posters) are inherently multi-layered, combining decoration, text, and images. Editing them from natural-language instructions requires fine-grained, layer-aware reasoning to identify relevant layers and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Zihao Lin , Wanrong Zhu , Jiuxiang Gu , Jihyung Kil , Christopher Tensmeyer , Lin Zhang , Shilong Liu , Ruiyi Zhang , Lifu Huang , Vlad I. Morariu , Tong Sun

The advent of Unified Multimodal Models (UMMs) signals a paradigm shift in artificial intelligence, moving from passive perception to active, cross-modal generation. Despite their unprecedented ability to synthesize information, a critical…

Artificial Intelligence · Computer Science 2026-01-15 Jingxuan Wei , Caijun Jia , Xi Bai , Xinglong Xu , Siyuan Li , Linzhuang Sun , Bihui Yu , Conghui He , Lijun Wu , Cheng Tan

Recent advancements in large language models (LLMs) have led to remarkable performance across a wide range of language understanding and mathematical tasks. As a result, increasing attention has been given to assessing the true reasoning…

Computation and Language · Computer Science 2025-03-14 Jonas Golde , Patrick Haller , Fabio Barth , Alan Akbik

Recent years have seen impressive advances in text-to-image generation, with image generative or unified models producing high-quality images from text. Yet these models still struggle with fine-grained color controllability, often failing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Muhammad Atif Butt , Alexandra Gomez-Villa , Tao Wu , Javier Vazquez-Corral , Joost Van De Weijer , Kai Wang

The remarkable success of diffusion models in text-to-image generation has sparked growing interest in expanding their capabilities to a variety of multi-modal tasks, including image understanding, manipulation, and perception. These tasks…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Xinyang Song , Libin Wang , Weining Wang , Shaozhen Liu , Dandan Zheng , Jingdong Chen , Qi Li , Zhenan Sun

Editing images using natural language instructions has become a natural and expressive way to modify visual content; yet, evaluating the performance of such models remains challenging. Existing evaluation approaches often rely on image-text…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Yusu Qian , Jiasen Lu , Tsu-Jui Fu , Xinze Wang , Chen Chen , Yinfei Yang , Wenze Hu , Zhe Gan

Recent advances in Retrieval-Augmented Generation (RAG) have significantly improved response accuracy and relevance by incorporating external knowledge into Large Language Models (LLMs). However, existing RAG methods primarily focus on…

Machine Learning · Computer Science 2025-04-22 Qinhan Yu , Zhiyou Xiao , Binghui Li , Zhengren Wang , Chong Chen , Wentao Zhang

Unified multimodal models have recently attracted considerable attention for their remarkable abilities in jointly understanding and generating diverse content. However, as contexts integrate increasingly numerous interleaved multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Yanzuo Lu , Xin Xia , Manlin Zhang , Huafeng Kuang , Jianbin Zheng , Yuxi Ren , Xuefeng Xiao

Recent text-to-video generation models have made remarkable progress in visual realism, motion fidelity, and text-video alignment, yet they still struggle to produce socially coherent behavior. Unlike humans, who readily infer intentions,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Wenshuo Peng , Gongxuan Wang , Tianmeng Yang , Chuanhao Li , Xiaojie Xu , Hui He , Kaipeng Zhang

Current multimodal models aim to transcend the limitations of single-modality representations by unifying understanding and generation, often using text-to-image (T2I) tasks to calibrate semantic consistency. However, their reliance on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Juanxi Tian , Siyuan Li , Conghui He , Lijun Wu , Cheng Tan

Generation of images containing multiple humans, performing complex actions, while preserving their facial identities, is a significant challenge. A major factor contributing to this is the lack of a dedicated benchmark. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Shubhankar Borse , Seokeon Choi , Sunghyun Park , Jeongho Kim , Shreya Kadambi , Risheek Garrepalli , Sungrack Yun , Munawar Hayat , Fatih Porikli

With the rapid advancement of generative models, highly realistic image synthesis has posed new challenges to digital security and media credibility. Although AI-generated image detection methods have partially addressed these concerns, a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Chunxiao Li , Xiaoxiao Wang , Meiling Li , Boming Miao , Peng Sun , Yunjian Zhang , Xiangyang Ji , Yao Zhu

In recent years, significant progress has been made in both image generation and generated image detection. Despite their rapid, yet largely independent, development, these two fields have evolved distinct architectural paradigms: the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Yanran Zhang , Wenzhao Zheng , Yifei Li , Bingyao Yu , Yu Zheng , Lei Chen , Jiwen Lu , Jie Zhou

Image editing models are advancing rapidly, yet comprehensive evaluation remains a significant challenge. Existing image editing benchmarks generally suffer from limited task scopes, insufficient evaluation dimensions, and heavy reliance on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Juntong Wang , Jiarui Wang , Huiyu Duan , Jiaxiang Kang , Guangtao Zhai , Xiongkuo Min

Text-to-image (T2I) generation aims to synthesize images from textual prompts, which jointly specify what must be shown and imply what can be inferred, which thus correspond to two core capabilities: \textbf{\textit{composition}} and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Ouxiang Li , Yuan Wang , Xinting Hu , Huijuan Huang , Rui Chen , Jiarong Ou , Xin Tao , Pengfei Wan , Xiaojuan Qi , Fuli Feng