English
Related papers

Related papers: MIRAGE: Benchmarking and Aligning Multi-Instance I…

200 papers

In deep metric learning, the training procedure relies on sampling informative tuples. However, as the training procedure progresses, it becomes nearly impossible to sample relevant hard negative examples without proper mining strategies or…

Computer Vision and Pattern Recognition · Computer Science 2020-06-12 Pierre Jacob , David Picard , Aymeric Histace , Edouard Klein

When applying multi-instance learning (MIL) to make predictions for bags of instances, the prediction accuracy of an instance often depends on not only the instance itself but also its context in the corresponding bag. From the viewpoint of…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Tiancheng Lin , Hongteng Xu , Canqian Yang , Yi Xu

Unified multimodal models integrate the reasoning capacity of large language models with both image understanding and generation, showing great promise for advanced multimodal intelligence. However, the community still lacks a rigorous…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Hongxiang Li , Yaowei Li , Bin Lin , Yuwei Niu , Yuhang Yang , Xiaoshuang Huang , Jiayin Cai , Xiaolong Jiang , Yao Hu , Long Chen

Although natural language instructions offer an intuitive way to guide automated image editing, deep-learning models often struggle to achieve high-quality results, largely due to the difficulty of creating large, high-quality training…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Sherry X. Chen , Misha Sra , Pradeep Sen

Recent advances in text-guided image synthesis has dramatically changed how creative professionals generate artistic and aesthetically pleasing visual assets. To fully support such creative endeavors, the process should possess the ability…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 K J Joseph , Prateksha Udhayanan , Tripti Shukla , Aishwarya Agarwal , Srikrishna Karanam , Koustava Goswami , Balaji Vasan Srinivasan

Multi-Instance Generation has advanced significantly in spatial placement and attribute binding. However, existing approaches still face challenges in fine-grained semantic understanding, particularly when dealing with complex textual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Shiyan Du , Conghan Yue , Xinyu Cheng , Dongyu Zhang

Large-scale text-to-image models enable a wide range of image editing techniques, using text prompts or even spatial controls. However, applying these editing methods to multi-view images depicting a single scene leads to 3D-inconsistent…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Or Patashnik , Rinon Gal , Daniel Cohen-Or , Jun-Yan Zhu , Fernando De la Torre

Text-guided human pose editing has gained significant traction in AIGC applications. However,it remains plagued by structural anomalies and generative artifacts. Existing evaluation metrics often isolate authenticity detection from quality…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Ningyu Sun , Zhaolin Cai , Zitong Xu , Peihang Chen , Huiyu Duan , Yichao Yan , Xiongkuo Min , Xiaokang Yang

Prompt-based models have demonstrated impressive prompt-following capability at image editing tasks. However, the models still struggle with following detailed editing prompts or performing local edits. Specifically, global image quality…

Graphics · Computer Science 2025-10-20 Kenan Tang , Yanhong Li , Yao Qin

Instruction-based image editing enables natural-language control over visual modifications, yet existing models falter under Instruction-Visual Complexity (IV-Complexity), where intricate instructions meet cluttered or ambiguous scenes. We…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Tianyuan Qu , Lei Ke , Xiaohang Zhan , Longxiang Tang , Yuqi Liu , Bohao Peng , Bei Yu , Dong Yu , Jiaya Jia

Advances in image restoration and enhancement techniques have led to discussion about how such algorithmscan be applied as a pre-processing step to improve automatic visual recognition. In principle, techniques like deblurring and…

Computer Vision and Pattern Recognition · Computer Science 2019-01-30 Rosaura G. Vidal , Sreya Banerjee , Klemen Grm , Vitomir Struc , Walter J. Scheirer

Instruction-based image editing exhibits heterogeneous difficulty not only across cases but also across regions of an image, motivating refinement approaches that allocate correction to where the model struggles. Existing refinement signals…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Weitai Kang , Xiaohang Zhan , Yizhou Wang , Mang Tik Chiu , Jason Kuen , Kangning Liu , Yan Yan

Emerging unified editing models have demonstrated strong capabilities in general object editing tasks. However, it remains a significant challenge to perform fine-grained editing in complex multi-entity scenes, particularly those where…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Yecong Wan , Fan Li , Chunwei Wang , Hao Wu , Mingwen Shao , Wangmeng Zuo

We introduce MIRROR, a benchmark comprising eight experiments across four metacognitive levels that evaluates whether large language models can use self-knowledge to make better decisions. We evaluate 16 models from 8 labs across…

Artificial Intelligence · Computer Science 2026-04-23 Jason Z Wang

Recent works have explored text-guided image editing using diffusion models and generated edited images based on text prompts. However, the models struggle to accurately locate the regions to be edited and faithfully perform precise edits.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Qian Wang , Biao Zhang , Michael Birsak , Peter Wonka

Over the past decade, generative models have demonstrated success in enhancing fundus images. However, the evaluation of these models remains a challenge. A benchmark for fundus image enhancement is needed for three main reasons:(1)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Xuanzhao Dong , Wenhui Zhu , Xiwen Chen , Hao Wang , Xin Li , Yujian Xiong , Jiajun Cheng , Zhipeng Wang , Shao Tang , Oana Dumitrascu , Yalin Wang

We introduce MotionEdit, a novel dataset for motion-centric image editing-the task of modifying subject actions and interactions while preserving identity, structure, and physical plausibility. Unlike existing image editing datasets that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Yixin Wan , Lei Ke , Wenhao Yu , Kai-Wei Chang , Dong Yu

Image editing has achieved impressive results with the development of large-scale generative models. However, existing models mainly focus on the editing effects of intended objects and regions, often leading to unwanted changes in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Yuhui Wu , Chenxi Xie , Ruibin Li , Liyi Chen , Qiaosi Yi , Lei Zhang

Existing multi-turn image editing paradigms are often confined to isolated single-step execution. Due to a lack of context-awareness and closed-loop feedback mechanisms, they are prone to error accumulation and semantic drift during…

Graphics · Computer Science 2026-04-01 Fei Shen , Chengyu Xie , Lihong Wang , Zhanyi Zhang , Xin Jiang , Xiaoyu Du , Jinhui Tang

Instruction tuning has empowered large language models (LLMs) to achieve remarkable performance, yet its success heavily depends on the availability of large-scale, high-quality instruction-response pairs. To meet this demand, various…

Computation and Language · Computer Science 2025-12-19 Fanyi Yang , Jianfeng Liu , Xin Zhang , Haoyu Liu , Xixin Cao , Yuefeng Zhan , Hao Sun , Weiwei Deng , Feng Sun , Qi Zhang