English
Related papers

Related papers: Leveraging Vision Language Models for Specialized …

200 papers

Foundation vision-language models (VLMs) excel on natural images, but their utility for biomedical microscopy remains underexplored. In this paper, we investigate how in-context learning enables state-of-the-art VLMs to perform few-shot…

Vision-language models (VLMs) have recently been integrated into multiple instance learning (MIL) frameworks to address the challenge of few-shot, weakly supervised classification of whole slide images (WSIs). A key trend involves…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Bryan Wong , Jong Woo Kim , Huazhu Fu , Mun Yong Yi

Active learning aims to reduce annotation cost by selectively querying informative samples for supervision under a limited labeling budget. In this work, we investigate how vision-language models (VLMs) can be leveraged to further reduce…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Phuong Ngoc Nguyen , Kaito Shiku , Ryoma Bise , Seiichi Uchida , Shinnosuke Matsuo

With the growth of high-quality data and advancement in visual pre-training paradigms, Video Foundation Models (VFMs) have made significant progress recently, demonstrating their remarkable performance on traditional video understanding…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Xinhao Li , Zhenpeng Huang , Jing Wang , Kunchang Li , Limin Wang

Fine-grained attribute prediction is essential for fashion retail applications including catalog enrichment, visual search, and recommendation systems. Vision-Language Models (VLMs) offer zero-shot prediction without task-specific training,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Shubham Shukla , Kunal Sonalkar

Few-shot classification (FSC) is a fundamental yet challenging task in computer vision that involves recognizing novel classes from limited data. While previous methods have focused on enhancing visual features or incorporating additional…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Fan Liu , Wenwen Cai , Jian Huo , Chuanyi Zhang , Delong Chen , Jun Zhou

Multimodal large language models (MLLMs) have emerged as powerful tools for visual question answering (VQA), enabling reasoning and contextual understanding across visual and textual modalities. Despite their advancements, the evaluation of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Nikitha SR

Recent advancements in Vision Language Models (VLMs) have expanded their capabilities to interactive agent tasks, yet existing benchmarks remain limited to single-agent or text-only environments. In contrast, real-world scenarios often…

Artificial Intelligence · Computer Science 2026-04-14 Zelai Xu , Zhexuan Xu , Xiangmin Yi , Huining Yuan , Mo Guang , Kaiwen Long , Xinlei Chen , Yi Wu , Chao Yu , Yu Wang

When answering questions about images, humans naturally point, label, and draw to explain their reasoning. In contrast, modern vision-language models (VLMs) such as Gemini-3-Pro and GPT-5 only respond with text, which can be difficult for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Brandon Collins , Logan Bolton , Hung Huy Nguyen , Mohammad Reza Taesiri , Trung Bui , Anh Totti Nguyen

Vision-Language Models (VLMs) have shown remarkable capabilities across diverse visual tasks, including image recognition, video understanding, and Visual Question Answering (VQA) when explicitly trained for these tasks. Despite these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Sivan Doveh , Nimrod Shabtay , Wei Lin , Eli Schwartz , Hilde Kuehne , Raja Giryes , Rogerio Feris , Leonid Karlinsky , James Glass , Assaf Arbelle , Shimon Ullman , M. Jehanzeb Mirza

Human age estimation from facial images represents a challenging computer vision task with significant applications in biometrics, healthcare, and human-computer interaction. While traditional deep learning approaches require extensive…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Rakib Hossain Sajib , Md Kishor Morol , Rajan Das Gupta , Mohammad Sakib Mahmood , Shuvra Smaran Das

Large Language Models (LLMs) have so far impressed the world, with unprecedented capabilities that emerge in models at large scales. On the vision side, transformer models (i.e., ViT) are following the same trend, achieving the best…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Mustafa Shukor , Corentin Dancette , Matthieu Cord

Language-aligned vision foundation models (VFMs) enable versatile visual understanding for always-on contextual AI, but their deployment on edge devices is hindered by strict latency and power constraints. We present AdaVFM, an adaptive…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Yiwei Zhao , Yi Zheng , Huapeng Su , Jieyu Lin , Stefano Ambrogio , Cijo Jose , Michael Ramamonjisoa , Patrick Labatut , Barbara De Salvo , Chiao Liu , Phillip B. Gibbons , Ziyun Li

Recent vision-language (VL) studies have shown remarkable progress by learning generic representations from massive image-text pairs with transformer models and then fine-tuning on downstream VL tasks. While existing research has been…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Jianfeng Wang , Xiaowei Hu , Pengchuan Zhang , Xiujun Li , Lijuan Wang , Lei Zhang , Jianfeng Gao , Zicheng Liu

Agricultural robots have emerged as powerful members in agricultural tasks, nevertheless, still heavily rely on manual operation or untransportable railway for movement, resulting in limited mobility and poor adaptability.…

Robotics · Computer Science 2025-08-12 Xiaobei Zhao , Xingqi Lyu , Xiang Li

Vision-language models (VLMs) have recently shown promise in general-purpose reasoning tasks, yet their applicability to domain-specific scientific workflows remains largely unexplored. In this work, we evaluated a series of open-weight and…

Instrumentation and Methods for Astrophysics · Physics 2026-02-10 S. Riggi

Significant progress has been made in advancing large multimodal conversational models (LMMs), capitalizing on vast repositories of image-text data available online. Despite this progress, these models often encounter substantial domain…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Muhammad Awais , Ali Husain Salem Abdulla Alharthi , Amandeep Kumar , Hisham Cholakkal , Rao Muhammad Anwer

Vision-language models (VLMs) and the recent surge of Multimodal Large Language Models (MLLMs) have revolutionized artificial intelligence with unprecedented cross-modal alignment and zero-shot generalization. However, enabling them to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Yuyang Liu , Qiuhe Hong , Linlan Huang , Alexandra Gomez-Villa , Dipam Goswami , Xialei Liu , Joost van de Weijer , Yonghong Tian

Foundation models and vision-language pre-training have notably advanced Vision Language Models (VLMs), enabling multimodal processing of visual and linguistic data. However, their performance has been typically assessed on general scene…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Shravan Nayak , Kanishk Jain , Rabiul Awal , Siva Reddy , Sjoerd van Steenkiste , Lisa Anne Hendricks , Karolina Stańczak , Aishwarya Agrawal

E-commerce product understanding demands by nature, strong multimodal comprehension from text, images, and structured attributes. General-purpose Vision-Language Models (VLMs) enable generalizable multimodal latent modelling, yet there is…