English
Related papers

Related papers: PixelCraft: A Multi-Agent System for High-Fidelity…

200 papers

Multimodal Large Language Models (MLLMs) are increasingly used to carry out visual workflows such as navigating GUIs, where the next step depends on verified visual compositional conditions (e.g., "if a permission dialog appears and the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Haozhan Shen , Shilin Yan , Hongwei Xue , Shuaiqi Lu , Xiaojun Tang , Guannan Zhang , Tiancheng Zhao , Jianwei Yin

Recent research on medical MLLMs has gradually shifted its focus from image-level understanding to fine-grained, pixel-level comprehension. Although segmentation serves as the foundation for pixel-level understanding, existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Yankai Jiang , Qiaoru Li , Binlu Xu , Haoran Sun , Chao Ding , Junting Dong , Yuxiang Cai , Xuhong Zhang , Jianwei Yin

Recent multimodal large language models (MLLMs) increasingly rely on visual chain-of-thought to perform region-grounded reasoning over images. However, existing approaches ground regions via either textified coordinates-causing modality…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Kesen Zhao , Beier Zhu , Junbao Zhou , Xingyu Zhu , Zhongqi Yue , Hanwang Zhang

Despite strong performance of Multimodal Large Language Models (MLLMs) on multimodal tasks, predicting whether and why an image is persuasive remains challenging. We first show that prompting MLLMs to reason before prediction does not…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Naeun Lee , Hyunjong Kim , Sunghwan Choi , Injin Kong , Yohan Jo

Multimodal Large Language Models (MLLMs) are increasingly applied in real-world scenarios where user-provided images are often imperfect, requiring active image manipulations such as cropping, editing, or enhancement to uncover salient…

Pre-trained on extensive text and image corpora, current Multi-Modal Large Language Models (MLLM) have shown strong capabilities in general visual reasoning tasks. However, their performance is still lacking in physical domains that require…

Artificial Intelligence · Computer Science 2025-07-04 Erle Zhu , Yadi Liu , Zhe Zhang , Xujun Li , Jin Zhou , Xinjie Yu , Minlie Huang , Hongning Wang

The rapid advancing of Multimodal Large Language Models (MLLMs) has spurred interest in complex multimodal reasoning tasks in the real-world and virtual environment, which require coordinating multiple abilities, including visual…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Ziyue Wang , Yurui Dong , Fuwen Luo , Minyuan Ruan , Zhili Cheng , Chi Chen , Peng Li , Yang Liu

Detecting AI-generated images with multimodal large language models (MLLMs) has gained increasing attention, due to their rich world knowledge, common-sense reasoning, and potential for explainability. However, naively applying those MLLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Kaiqing Lin , Zhiyuan Yan , Ruoxin Chen , Junyan Ye , Ke-Yue Zhang , Yue Zhou , Peng Jin , Bin Li , Taiping Yao , Shouhong Ding

Multimodal large language models (MLLMs) have shown considerable potential in chart understanding and reasoning tasks. However, they still struggle with high information density (HID) charts characterized by multiple subplots, legends, and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Hongkun Pan , Yuwei Wu , Wanyi Hong , Shenghui Hu , Qitong Yan , Yi Yang , Rufei Han , Changju Zhou , Minfeng Zhu , Dongming Han , Wei Chen

Current multimodal LLMs encode images as static visual prefixes and rely on text-based reasoning, lacking goal-driven and adaptive visual access. Inspired by human visual perception-where attention is selectively and sequentially shifted…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Guangfu Guo , Xiaoqian Lu , Yue Feng , Mingming Sun

While previous multimodal slow-thinking methods have demonstrated remarkable success in single-image understanding scenarios, their effectiveness becomes fundamentally constrained when extended to more complex multi-image comprehension…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Guanghao Zhang , Tao Zhong , Yan Xia , Mushui Liu , Zhelun Yu , Haoyuan Li , Wanggui He , Fangxun Shu , Dong She , Yi Wang , Hao Jiang

The rapid technical progress of generative art (GenArt) has democratized the creation of visually appealing imagery. However, achieving genuine artistic impact - the kind that resonates with viewers on a deeper, more meaningful level -…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Ruixiang Jiang , Changwen Chen

Large Language Models (LLMs) have achieved remarkable reliability and advanced capabilities through extended test-time reasoning. However, extending these capabilities to Multi-modal Large Language Models (MLLMs) remains a significant…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yuhao Dong , Zuyan Liu , Shulin Tian , Yongming Rao , Ziwei Liu

With the advent of large language models(LLMs) enhanced by the chain-of-thought(CoT) methodology, visual reasoning problem is usually decomposed into manageable sub-tasks and tackled sequentially with various external tools. However, such a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Timin Gao , Peixian Chen , Mengdan Zhang , Chaoyou Fu , Yunhang Shen , Yan Zhang , Shengchuan Zhang , Xiawu Zheng , Xing Sun , Liujuan Cao , Rongrong Ji

Under pure textual modality, Large Language Models (LLMs) have demonstrated remarkable success in complex reasoning tasks by decomposing them into simpler sub-problems. However, Multimodal Large Language Models (MLLMs) still struggle with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Jingming Liu , Yumeng Li , Boyuan Xiao , Yichang Jian , Ziang Qin , Tianjia Shao , Yao-Xiang Ding , Kun Zhou

Multimodal Large Language Models (MLLMs) have powered Graphical User Interface (GUI) Agents, showing promise in automating tasks on computing devices. Recent works have begun exploring reasoning in GUI tasks with encouraging results.…

Artificial Intelligence · Computer Science 2025-04-22 Yuhang Liu , Pengxiang Li , Congkai Xie , Xavier Hu , Xiaotian Han , Shengyu Zhang , Hongxia Yang , Fei Wu

With the rapid advancement of tool-use capabilities in Large Language Models (LLMs), Retrieval-Augmented Generation (RAG) is shifting from static, one-shot retrieval toward autonomous, multi-turn evidence acquisition. However, existing…

Artificial Intelligence · Computer Science 2026-02-13 Zhanli Li , Huiwen Tian , Lvzhou Luo , Yixuan Cao , Ping Luo

A key trend in Large Reasoning Models (e.g., OpenAI's o3) is the native agentic ability to use external tools such as web browsers for searching and writing/executing code for image manipulation to think with images. In the open-source…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Ziyu Liu , Yuhang Zang , Yushan Zou , Zijian Liang , Xiaoyi Dong , Yuhang Cao , Haodong Duan , Dahua Lin , Jiaqi Wang

The rapid advancement of generative AI has democratized access to powerful tools such as Text-to-Image models. However, to generate high-quality images, users must still craft detailed prompts specifying scene, style, and context-often…

Multiagent Systems · Computer Science 2025-09-25 Dawei Xiang , Wenyan Xu , Kexin Chu , Tianqi Ding , Zixu Shen , Yiming Zeng , Jianchang Su , Wei Zhang

Recent advancements in large language models (LLMs) underscore the need for stronger reasoning capabilities to solve complex problems effectively. While Chain-of-Thought (CoT) reasoning has been a step forward, it remains insufficient for…

Computation and Language · Computer Science 2025-07-14 Matan Vetzler , Koren Lazar , Guy Uziel , Eran Hirsch , Ateret Anaby-Tavor , Leshem Choshen