English
Related papers

Related papers: Systematic Evaluation of Large Vision-Language Mod…

200 papers

Vision-language models (VLMs) have demonstrated remarkable performance across a wide range of computer-vision tasks, sparking interest in their potential for digital health applications. Here, we apply VLMs to two fundamental challenges in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Victor Li , Naveenraj Kamalakannan , Avinash Parnandi , Heidi Schambra , Carlos Fernandez-Granda

The emergence of large language models (LLM) and, consequently, vision language models (VLM) has ignited new imaginations among robotics researchers. At this point, the range of applications to which LLM and VLM can be applied in…

Robotics · Computer Science 2024-11-28 Jesse Atuhurra

Artificial Intelligence have profoundly transformed the technological landscape in recent years. Large Language Models (LLMs) have demonstrated impressive abilities in reasoning, text comprehension, contextual pattern recognition, and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Efthymios Tsaprazlis , Tiantian Feng , Anil Ramakrishna , Rahul Gupta , Shrikanth Narayanan

Inevitable domain and task discrepancies in real-world scenarios can impair the generalization performance of the pre-trained deep models for medical data. Therefore, we audaciously propose that we should build a general-purpose medical AI…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Huahui Yi , Ziyuan Qin , Qicheng Lao , Wei Xu , Zekun Jiang , Dequan Wang , Shaoting Zhang , Kang Li

Recent developments in large language models (LLMs) have unlocked new opportunities for healthcare, from information synthesis to clinical decision support. These new LLMs are not just capable of modeling language, but can also act as…

Human-Computer Interaction · Computer Science 2023-09-21 Nikita Mehandru , Brenda Y. Miao , Eduardo Rodriguez Almaraz , Madhumita Sushil , Atul J. Butte , Ahmed Alaa

Accurate disease interpretation from radiology remains challenging due to imaging heterogeneity. Achieving expert-level diagnostic decisions requires integration of subtle image features with clinical knowledge. Yet major vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Difei Gu , Yunhe Gao , Mu Zhou , Dimitris Metaxas

Several recent works seek to adapt general-purpose large language models (LLMs) and vision-language models (VLMs) for medical applications through continued pretraining on publicly available biomedical corpora. These works typically claim…

Computation and Language · Computer Science 2025-07-01 Daniel P. Jeong , Pranav Mani , Saurabh Garg , Zachary C. Lipton , Michael Oberst

The integration of Large Language Models (LLMs) into medical applications has sparked widespread interest across the healthcare industry, from drug discovery and development to clinical decision support, assisting telemedicine, medical…

Computation and Language · Computer Science 2024-12-03 Zifeng Wang , Hanyin Wang , Benjamin Danek , Ying Li , Christina Mack , Hoifung Poon , Yajuan Wang , Pranav Rajpurkar , Jimeng Sun

Recent breakthroughs in large language models (LLMs) offer unprecedented natural language understanding and generation capabilities. However, existing surveys on LLMs in biomedicine often focus on specific applications or model…

Vision Language Models (VLMs) play a crucial role in robotic manipulation by enabling robots to understand and interpret the visual properties of objects and their surroundings, allowing them to perform manipulation based on this multimodal…

Robotics · Computer Science 2025-05-21 Nurhan Bulus Guran , Hanchi Ren , Jingjing Deng , Xianghua Xie

Several recent works seek to develop foundation models specifically for medical applications, adapting general-purpose large language models (LLMs) and vision-language models (VLMs) via continued pretraining on publicly available biomedical…

Computation and Language · Computer Science 2024-11-21 Daniel P. Jeong , Saurabh Garg , Zachary C. Lipton , Michael Oberst

To utilize Foundation Vision Language Models (VLMs) for robotic tasks and motion planning, the community has proposed different methods for injecting action components into VLMs and building the Vision-Language-Action models (VLAs). In this…

The exponential growth of large language models (LLMs) has opened up numerous possibilities for multimodal AGI systems. However, the progress in vision and vision-language foundation models, which are also critical elements of multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Zhe Chen , Jiannan Wu , Wenhai Wang , Weijie Su , Guo Chen , Sen Xing , Muyan Zhong , Qinglong Zhang , Xizhou Zhu , Lewei Lu , Bin Li , Ping Luo , Tong Lu , Yu Qiao , Jifeng Dai

With the rapid advancement of artificial intelligence and robotics, the integration of Large Language Models (LLMs) with 3D vision is emerging as a transformative approach to enhancing robotic sensing technologies. This convergence enables…

Robotics · Computer Science 2025-11-19 Vinit Mehta , Charu Sharma , Karthick Thiyagarajan

Large language models (LLMs) have made significant advancements in natural language understanding. However, through that enormous semantic representation that the LLM has learnt, is it somehow possible for it to understand images as well?…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Mu Cai , Zeyi Huang , Yuheng Li , Utkarsh Ojha , Haohan Wang , Yong Jae Lee

With the rapid development of artificial intelligence, large language models (LLMs) have shown promising capabilities in mimicking human-level language comprehension and reasoning. This has sparked significant interest in applying LLMs to…

Computation and Language · Computer Science 2023-11-06 Mingze Yuan , Peng Bao , Jiajia Yuan , Yunhao Shen , Zifan Chen , Yi Xie , Jie Zhao , Yang Chen , Li Zhang , Lin Shen , Bin Dong

This paper explores the application of Vision-Language Models (VLMs) as operator agents in the space domain, focusing on both software and hardware operational paradigms. Building on advances in Large Language Models (LLMs) and their…

Artificial Intelligence · Computer Science 2025-01-15 Alejandro Carrasco , Marco Nedungadi , Enrico M. Zucchelli , Amit Jain , Victor Rodriguez-Fernandez , Richard Linares

With the advent of Large Language Models (LLMs), medical artificial intelligence (AI) has experienced substantial technological progress and paradigm shifts, highlighting the potential of LLMs to streamline healthcare delivery and improve…

Computation and Language · Computer Science 2024-12-10 Lei Liu , Xiaoyan Yang , Junchi Lei , Yue Shen , Jian Wang , Peng Wei , Zhixuan Chu , Zhan Qin , Kui Ren

Automatic disease diagnosis has become increasingly valuable in clinical practice. The advent of large language models (LLMs) has catalyzed a paradigm shift in artificial intelligence, with growing evidence supporting the efficacy of LLMs…

Medical image segmentation allows quantifying target structure size and shape, aiding in disease diagnosis, prognosis, surgery planning, and comprehension.Building upon recent advancements in foundation Vision-Language Models (VLMs) from…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Kanchan Poudel , Manish Dhakal , Prasiddha Bhandari , Rabin Adhikari , Safal Thapaliya , Bishesh Khanal