English
Related papers

Related papers: Pixel-SAIL: Single Transformer For Pixel-Grounded …

200 papers

Recent advances in multimodal large language models (MLLMs) have enabled impressive progress in vision-language understanding, yet their high computational cost limits deployment in resource-constrained scenarios such as personal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Quoc-Huy Trinh , Mustapha Abdullahi , Bo Zhao , Debesh Jha

Multi-modal Large Language Models (MLLMs) have made significant strides in expanding the capabilities of Large Language Models (LLMs) through the incorporation of visual perception interfaces. Despite the emergence of exciting applications…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Dongsheng Jiang , Yuchen Liu , Songlin Liu , Jin'e Zhao , Hao Zhang , Zhen Gao , Xiaopeng Zhang , Jin Li , Hongkai Xiong

Spatial intelligence requires multimodal large language models (MLLMs) to move beyond single-view perception and reason consistently about objects, visibility, geometry, and interactions across multiple viewpoints. However, progress in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Wei Wang , Yuqian Yuan , Tianwei Lin , Wenqiao Zhang , Siliang Tang , Jun Xiao , Yueting Zhuang

Interpretability in Vision-Language Models (VLMs) is crucial for trust, debugging, and decision-making in high-stakes applications. We introduce PixelSHAP, a model-agnostic framework extending Shapley-based analysis to structured visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Roni Goldshmidt

Self-supervised learning (SSL) has produced a diverse landscape of vision transformers (ViTs) whose pretrained representations support a wide range of downstream tasks. Towards a better understanding of these models, a body of work has…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Xiaoyan Yu , Lisa Mais , Jannik Franzen , Peter Hirsch , Nick Lechtenbörger , Andreas Mardt , Dagmar Kainmüller

Recent work has shown that, while large language models (LLMs) demonstrate strong word translation or bilingual lexicon induction (BLI) capabilities in few-shot setups, they still cannot match the performance of 'traditional' mapping-based…

Computation and Language · Computer Science 2024-06-06 Yaoyiran Li , Anna Korhonen , Ivan Vulić

Current multimodal large language models (MLLMs) face significant challenges in visual document understanding (VDU) tasks due to the high resolution, dense text, and complex layouts typical of document images. These characteristics demand a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Jiaxin Zhang , Wentao Yang , Songxuan Lai , Zecheng Xie , Lianwen Jin

Recent multimodal large language models (MLLMs) have shown promising instruction following capabilities on vision-language tasks. In this work, we introduce VISUAL MODALITY INSTRUCTION (VIM), and investigate how well multimodal models can…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Xiujun Li , Yujie Lu , Zhe Gan , Jianfeng Gao , William Yang Wang , Yejin Choi

Vision-language pre-training (VLP) on large-scale image-text pairs has recently witnessed rapid progress for learning cross-modal representations. Existing pre-training methods either directly concatenate image representation and text…

Computation and Language · Computer Science 2021-03-16 Chenliang Li , Ming Yan , Haiyang Xu , Fuli Luo , Wei Wang , Bin Bi , Songfang Huang

Multimodal large language models (MLLMs) have achieved remarkable progress across a range of vision-language tasks and demonstrate strong potential for traffic accident understanding. However, existing MLLMs in this domain primarily focus…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Zihao Sheng , Zilin Huang , Yansong Qu , Jiancong Chen , Yuhao Luo , Yen-Jung Chen , Yue Leng , Sikai Chen

Large language models (LLMs) have shown promising capabilities in visually interpreting medical time-series data. However, their general-purpose design can limit domain-specific precision, and the proprietary nature of many models poses…

Artificial Intelligence · Computer Science 2025-07-22 Huayu Li , Zhengxiao He , Xiwen Chen , Ci Zhang , Stuart F. Quan , William D. S. Killgore , Shu-Fen Wung , Chen X. Chen , Geng Yuan , Jin Lu , Ao Li

Large Language Model-based Vision-Language Models (LLM-based VLMs) have demonstrated impressive results in various vision-language understanding tasks. However, how well these VLMs can see image detail beyond the semantic level remains…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Chenhui Gou , Abdulwahab Felemban , Faizan Farooq Khan , Deyao Zhu , Jianfei Cai , Hamid Rezatofighi , Mohamed Elhoseiny

Existing reasoning segmentation approaches typically fine-tune multimodal large language models (MLLMs) using image-text pairs and corresponding mask labels. However, they exhibit limited generalization to out-of-distribution scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Song Wang , Gongfan Fang , Lingdong Kong , Xiangtai Li , Jianyun Xu , Sheng Yang , Qiang Li , Jianke Zhu , Xinchao Wang

Modular vision-language models (Vision-LLMs) align pretrained image encoders with (frozen) large language models (LLMs) and post-hoc condition LLMs to `understand' the image input. With the abundance of readily available high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Gregor Geigle , Abhay Jain , Radu Timofte , Goran Glavaš

Existing semantic segmentation approaches are often limited by costly pixel-wise annotations and predefined classes. In this work, we present CLIP-S$^4$ that leverages self-supervised pixel representation learning and vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Wenbin He , Suphanut Jamonnak , Liang Gou , Liu Ren

We present PrismSSL, a Python library that unifies state-of-the-art self-supervised learning (SSL) methods across audio, vision, graphs, and cross-modal settings in a single, modular codebase. The goal of the demo is to show how researchers…

Machine Learning · Computer Science 2025-11-25 Melika Shirian , Kianoosh Vadaei , Kian Majlessi , Audrina Ebrahimi , Arshia Hemmat , Peyman Adibi , Hossein Karshenas

In this paper, we present the Draw-and-Understand framework, exploring how to integrate visual prompting understanding capabilities into Multimodal Large Language Models (MLLMs). Visual prompts allow users to interact through multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Weifeng Lin , Xinyu Wei , Ruichuan An , Peng Gao , Bocheng Zou , Yulin Luo , Siyuan Huang , Shanghang Zhang , Hongsheng Li

The rapid development of Multi-modality Large Language Models (MLLMs) has navigated a paradigm shift in computer vision, moving towards versatile foundational models. However, evaluating MLLMs in low-level visual perception and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Zicheng Zhang , Haoning Wu , Erli Zhang , Guangtao Zhai , Weisi Lin

Multimodal large language models (MLLMs) trained with visual instruction tuning have achieved strong performance across diverse tasks, yet they remain limited in vision-centric tasks such as object counting or spatial reasoning. We…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Heeji Yoon , Jaewoo Jung , Junwan Kim , Hyungyu Choi , Heeseong Shin , Sangbeom Lim , Honggyu An , Chaehyun Kim , Jisang Han , Donghyun Kim , Chanho Eom , Sunghwan Hong , Seungryong Kim

PSALM is a powerful extension of the Large Multi-modal Model (LMM) to address the segmentation task challenges. To overcome the limitation of the LMM being limited to textual output, PSALM incorporates a mask decoder and a well-designed…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Zheng Zhang , Yeyao Ma , Enming Zhang , Xiang Bai