English
Related papers

Related papers: Small Vision-Language Models: A Survey on Compact …

200 papers

Recent advances in multimodal large language models (MLLMs) have enabled impressive progress in vision-language understanding, yet their high computational cost limits deployment in resource-constrained scenarios such as personal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Quoc-Huy Trinh , Mustapha Abdullahi , Bo Zhao , Debesh Jha

As multimodal large language models (MLLMs) advance, their large-scale architectures pose challenges for deployment in resource-constrained environments. In the age of large models, where energy efficiency, computational scalability and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Sike Xiang , Shuang Chen , Amir Atapour-Abarghouei

The advent of real-time large multimodal models (LMMs) like GPT-4o has sparked considerable interest in efficient LMMs. LMM frameworks typically encode visual inputs into vision tokens (continuous representations) and integrate them and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Shaolei Zhang , Qingkai Fang , Zhe Yang , Yang Feng

Large language models (LLMs) have shown promise in robotic procedural planning, yet their human-centric reasoning often omits the low-level, grounded details needed for robotic execution. Vision-language models (VLMs) offer a path toward…

Robotics · Computer Science 2025-07-22 Chan Young Park , Jillian Fisher , Marius Memmel , Dipika Khullar , Seoho Yun , Abhishek Gupta , Yejin Choi

This paper provides a comprehensive review of the integration of Large Language Models (LLMs) with visual analytics, addressing their foundational concepts, capabilities, and wide-ranging applications. It begins by outlining the theoretical…

Human-Computer Interaction · Computer Science 2025-03-20 Navya Sonal Agarwal , Sanjay Kumar Sonbhadra

Despite substantial progress in healthcare applications driven by large language models (LLMs), growing concerns around data privacy, and limited resources; the small language models (SLMs) offer a scalable and clinically viable solution…

Computation and Language · Computer Science 2025-04-28 Muskan Garg , Shaina Raza , Shebuti Rayana , Xingyi Liu , Sunghwan Sohn

Multimodal Large Language Models (MLLMs) often struggle to accurately perceive fine-grained visual details, especially when targets are tiny or visually subtle. This challenge can be addressed through semantic-visual information fusion,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Yuxiang Shen , Hailong Huang , Zhenkun Gao , Xueheng Li , Man Zhou , Chengjun Xie , Haoxuan Che , Xuanhua He , Jie Zhang

Vision-language models (VLMs) have advanced multimodal reasoning but still face challenges in spatial reasoning for 3D scenes and complex object configurations. To address this, we introduce SpatialViLT, an enhanced VLM that integrates…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Chashi Mahiul Islam , Oteo Mamo , Samuel Jacob Chacko , Xiuwen Liu , Weikuan Yu

The rapid advancement of Transformer-based models has reshaped the landscape of uncrewed aerial vehicle (UAV) systems by enhancing perception, decision-making, and autonomy. This review paper systematically categorizes and evaluates recent…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Hamza Kheddar , Yassine Habchi , Mohamed Chahine Ghanem , Mustapha Hemis , Dusit Niyato

In recent years, the application of multimodal large language models (MLLM) in various fields has achieved remarkable success. However, as the foundation model for many downstream tasks, current MLLMs are composed of the well-known…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Han Zhao , Min Zhang , Wei Zhao , Pengxiang Ding , Siteng Huang , Donglin Wang

We introduce Xmodel-VLM, a cutting-edge multimodal vision language model. It is designed for efficient deployment on consumer GPU servers. Our work directly confronts a pivotal industry issue by grappling with the prohibitive service costs…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Wanting Xu , Yang Liu , Langping He , Xucheng Huang , Ling Jiang

Recent advancements in Large Vision-Language Models (LVLMs) have demonstrated significant progress in tackling complex multimodal tasks. Among these cutting-edge developments, Google's Bard stands out for its remarkable multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Wenqi Shao , Meng Lei , Yutao Hu , Peng Gao , Kaipeng Zhang , Fanqing Meng , Peng Xu , Siyuan Huang , Hongsheng Li , Yu Qiao , Ping Luo

This paper introduces MiniGPT4-Video, a multimodal Large Language Model (LLM) designed specifically for video understanding. The model is capable of processing both temporal visual and textual data, making it adept at understanding the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Kirolos Ataallah , Xiaoqian Shen , Eslam Abdelrahman , Essam Sleiman , Deyao Zhu , Jian Ding , Mohamed Elhoseiny

We study architectural and optimization techniques for sample-efficient language modeling under the constraints of the BabyLM 2025 shared task. Our model, BLaLM, replaces self-attention with a linear-time mLSTM token mixer and explores…

Computation and Language · Computer Science 2025-11-11 Patrick Haller , Jonas Golde , Alan Akbik

Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) have made significant advancements in reasoning capabilities. However, they still face challenges such as high computational demands and privacy concerns. This paper…

In the past few years, the emergence of pre-training models has brought uni-modal fields such as computer vision (CV) and natural language processing (NLP) to a new era. Substantial works have shown they are beneficial for downstream…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Feilong Chen , Duzhen Zhang , Minglun Han , Xiuyi Chen , Jing Shi , Shuang Xu , Bo Xu

Large vision-language models (LVLMs) have shown premise in a broad range of vision-language tasks with their strong reasoning and generalization capabilities. However, they require considerable computational resources for training and…

Computation and Language · Computer Science 2024-06-18 Guiming Hardy Chen , Shunian Chen , Ruifei Zhang , Junying Chen , Xiangbo Wu , Zhiyi Zhang , Zhihong Chen , Jianquan Li , Xiang Wan , Benyou Wang

Multi-modal Large Language Models (MLLMs) have demonstrated remarkable capabilities in understanding and generating content across various modalities, such as images and text. However, their interpretability remains a challenge, hindering…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Loris Giulivi , Giacomo Boracchi

Recently, large language and vision models (LLVMs) have received significant attention and development efforts due to their remarkable generalization performance across a wide range of tasks requiring perception and cognitive abilities. A…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Young-Jun Lee , Byungsoo Ko , Han-Gyu Kim , Yechan Hwang , Ho-Jin Choi

The rapid development of large Vision-Language Models (VLMs) has led to impressive results on academic benchmarks, primarily in widely spoken languages. However, significant gaps remain in the ability of current VLMs to handle low-resource…