English
Related papers

Related papers: Marmot: Object-Level Self-Correction via Multi-Age…

200 papers

The rapid technical progress of generative art (GenArt) has democratized the creation of visually appealing imagery. However, achieving genuine artistic impact - the kind that resonates with viewers on a deeper, more meaningful level -…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Ruixiang Jiang , Changwen Chen

Recent advancements in Multimodal Large Language Models (MLLMs) have incentivized models to ``think with images'' by actively invoking visual tools during multi-turn reasoning. The common Reinforcement Learning (RL) practice of relying on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Wenhao Yang , Yu Xia , Jinlong Huang , Shiyin Lu , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang , Yuchen Zhou , Xiaobo Xia , Yuanyu Wan , Lijun Zhang , Tat-Seng Chua

MLLMs exhibit strong reasoning on isolated queries, yet they operate de novo -- solving each problem independently and often repeating the same mistakes. Existing memory-augmented agents mainly store past trajectories for reuse. However,…

Artificial Intelligence · Computer Science 2026-05-05 Weihao Bo , Shan Zhang , Yanpeng Sun , Jingjing Wu , Qunyi Xie , Xiao Tan , Kunbin Chen , Wei He , Xiaofan Li , Na Zhao , Jingdong Wang , Zechao Li

Language-based object detection (LOD) aims to align visual objects with language expressions. A large amount of paired data is utilized to improve LOD model generalizations. During the training process, recent studies leverage…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yuming Chen , Jiangyan Feng , Haodong Zhang , Lijun Gong , Feng Zhu , Rui Zhao , Qibin Hou , Ming-Ming Cheng , Yibing Song

Large language model (LLM)-based agents are increasingly employed to interact with external environments (e.g., games, APIs, world models) to solve user-provided tasks. However, current frameworks often lack the ability to collaborate…

Computation and Language · Computer Science 2025-04-22 Vardhan Dongre , Xiaocheng Yang , Emre Can Acikgoz , Suvodip Dey , Gokhan Tur , Dilek Hakkani-Tür

Recent advancements have enhanced the capability of Multimodal Large Language Models (MLLMs) to comprehend multi-image information. However, existing benchmarks primarily evaluate answer correctness, overlooking whether models genuinely…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Pengfei Wang , Guohai Xu , Weinong Wang , Junjie Yang , Jie Lou , Yunhua Xue

Unified multimodal models aim to integrate understanding and generation within a single framework, yet bridging the gap between discrete semantic reasoning and high-fidelity visual synthesis remains challenging. We present MammothModa2…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Tao Shen , Xin Wan , Taicai Chen , Rui Zhang , Junwen Pan , Dawei Lu , Fanding Lei , Zhilin Lu , Yunfei Yang , Chen Cheng , Qi She , Chang Liu , Zhenbang Sun

Complex image restoration aims to recover high-quality images from inputs affected by multiple degradations such as blur, noise, rain, and compression artifacts. Recent restoration agents, powered by vision-language models and large…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Jianglin Lu , Yuanwei Wu , Ziyi Zhao , Hongcheng Wang , Felix Jimenez , Abrar Majeedi , Yun Fu

Recent advancements in Unified Multimodal Models (UMMs) have enabled remarkable image understanding and generation capabilities. However, while models like Gemini-2.5-Flash-Image show emerging abilities to reason over multiple related…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Mingrui Wu , Hang Liu , Jiayi Ji , Xiaoshuai Sun , Rongrong Ji

Current Large Language Model (LLM) agents demonstrate strong reasoning and tool use capabilities, but often lack self-awareness, failing to balance these approaches effectively. This imbalance leads to Tool Overuse, where models…

Artificial Intelligence · Computer Science 2025-05-27 Cheng Qian , Emre Can Acikgoz , Hongru Wang , Xiusi Chen , Avirup Sil , Dilek Hakkani-Tür , Gokhan Tur , Heng Ji

Recent advances in multimodal question answering have primarily focused on combining heterogeneous modalities or fine-tuning multimodal large language models. While these approaches have shown strong performance, they often rely on a…

Computation and Language · Computer Science 2026-04-22 Krishna Singh Rajput , Tejas Anvekar , Chitta Baral , Vivek Gupta

Despite significant advancements in Large Language Models (LLMs) and Large Vision-Language Models (LVLMs), current models still face substantial challenges in handling complex, multi-turn, and visually-grounded tasks that demand deep…

Computation and Language · Computer Science 2025-08-22 Seungmin Han , Haeun Kwon , Ji-jun Park , Taeyang Yoon

Layered image generation and editing is a fundamental capability that enables layer-wise reuse, editing, and composition of generated visual content, analogous to word-level editing in natural language. Despite its importance, this remains…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Zhicong Tang , Zhao Zhang , Jingye Chen , Mohan Zhou , Yifan Pu , Yuchi Liu , Yalong Bai , Ethan Smith , Yuhui Yuan

Multimodal Large Language Models (MLLMs) struggle with accurately capturing camera-object relations, especially for object orientation, camera viewpoint, and camera shots. This stems from the fact that existing MLLMs are trained on images…

We propose a visual-linguistic representation learning approach within a self-supervised learning framework by introducing a new operation, loss, and data augmentation strategy. First, we generate diverse features for the image-text…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Jaeyoo Park , Bohyung Han

Background: Cognitive biases in clinical decision-making significantly contribute to errors in diagnosis and suboptimal patient outcomes. Addressing these biases presents a formidable challenge in the medical field. Objective: This study…

Computation and Language · Computer Science 2024-05-14 Yu He Ke , Rui Yang , Sui An Lie , Taylor Xin Yi Lim , Hairil Rizal Abdullah , Daniel Shu Wei Ting , Nan Liu

Modern large language models become multimodal, analyzing various data formats like text and images. While fine-tuning is effective for adapting these multimodal language models (MLMs) to downstream tasks, full fine-tuning is…

Computation and Language · Computer Science 2025-12-01 Alexander Sergeev , Evgeny Kotelnikov

While vision-language models (VLMs) have demonstrated remarkable performance across various tasks combining textual and visual information, they continue to struggle with fine-grained visual perception tasks that require detailed…

Computation and Language · Computer Science 2025-11-12 Zhehao Zhang , Ryan Rossi , Tong Yu , Franck Dernoncourt , Ruiyi Zhang , Jiuxiang Gu , Sungchul Kim , Xiang Chen , Zichao Wang , Nedim Lipka

Multimodal large language models (MLLMs) and diffusion models have each reached remarkable maturity: MLLMs excel at reasoning over heterogeneous multimodal inputs with strong semantic grounding, while diffusion models synthesize images and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Bernini Team , Chenchen Liu , Junyi Chen , Lei Li , Lu Chi , Mingzhen Sun , Zhuoying Li , Yi Fu , Ruoyu Guo , Yiheng Wu , Ge Bai , Zehuan Yuan

As the number of installed cameras grows, so do the compute resources required to process and analyze all the images captured by these cameras. Video analytics enables new use cases, such as smart cities or autonomous driving. At the same…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Daniel Rivas , Francesc Guim , Jordà Polo , David Carrera