English
Related papers

Related papers: MiniGPT-Med: Large Language Model as a General Int…

200 papers

We introduce Radiology-GPT, a large language model for radiology. Using an instruction tuning approach on an extensive dataset of radiology domain knowledge, Radiology-GPT demonstrates superior performance compared to general language…

Medical image analysis is crucial in modern radiological diagnostics, especially given the exponential growth in medical imaging data. The demand for automated report generation systems has become increasingly urgent. While prior research…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Hao Chen , Wei Zhao , Yingli Li , Tianyang Zhong , Yisong Wang , Youlan Shang , Lei Guo , Junwei Han , Tianming Liu , Jun Liu , Tuo Zhang

Large language models have shown their remarkable capabilities as a general interface for various language-related applications. Motivated by this, we target to build a unified interface for completing many vision-language tasks including…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Jun Chen , Deyao Zhu , Xiaoqian Shen , Xiang Li , Zechun Liu , Pengchuan Zhang , Raghuraman Krishnamoorthi , Vikas Chandra , Yunyang Xiong , Mohamed Elhoseiny

Traditional biomedical artificial intelligence (AI) models, designed for specific tasks or modalities, often exhibit limited flexibility in real-world deployment and struggle to utilize holistic information. Generalist AI holds the…

In this paper, we aimed to provide a review and tutorial for researchers in the field of medical imaging using language models to improve their tasks at hand. We began by providing an overview of the history and concepts of language models,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Mingzhe Hu , Shaoyan Pan , Yuheng Li , Xiaofeng Yang

Generalist Medical AI (GMAI) systems have demonstrated expert-level performance in biomedical perception tasks, yet their clinical utility remains limited by inadequate multi-modal explainability and suboptimal prognostic capabilities.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Honglong Yang , Shanshan Song , Yi Qin , Lehan Wang , Haonan Wang , Xinpeng Ding , Qixiang Zhang , Bodong Du , Xiaomeng Li

The latest breakthroughs in large vision-language models, such as Bard and GPT-4, have showcased extraordinary abilities in performing a wide range of tasks. Such models are trained on massive datasets comprising billions of public…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Omkar Thawakar , Abdelrahman Shaker , Sahal Shaji Mullappilly , Hisham Cholakkal , Rao Muhammad Anwer , Salman Khan , Jorma Laaksonen , Fahad Shahbaz Khan

Large-scale Artificial General Intelligence (AGI) models, including Large Language Models (LLMs) such as ChatGPT/GPT-4, have achieved unprecedented success in a variety of general domain tasks. Yet, when applied directly to specialized…

Vision-language models have been extensively explored across a wide range of tasks, achieving satisfactory performance; however, their application in medical imaging remains underexplored. In this work, we propose a unified framework -…

Image and Video Processing · Electrical Eng. & Systems 2024-07-18 Khai Le-Duc , Ryan Zhang , Ngoc Son Nguyen , Tan-Hanh Pham , Anh Dao , Ba Hung Ngo , Anh Totti Nguyen , Truong-Son Hy

Large language models (LLMs) constitute a breakthrough state-of-the-art Artificial Intelligence technology which is rapidly evolving and promises to aid in medical diagnosis. However, the correctness and the accuracy of their returns has…

Computation and Language · Computer Science 2024-02-07 Dimitrios P. Panagoulias , Maria Virvou , George A. Tsihrintzis

Large language models (LLMs) have recently demonstrated their potential in clinical applications, providing valuable medical knowledge and advice. For example, a large dialog LLM like ChatGPT has successfully passed part of the US medical…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Sheng Wang , Zihao Zhao , Xi Ouyang , Qian Wang , Dinggang Shen

Artificial Intelligence (AI) has demonstrated significant potential in healthcare, particularly in disease diagnosis and treatment planning. Recent progress in Medical Large Vision-Language Models (Med-LVLMs) has opened up new possibilities…

Machine Learning · Computer Science 2025-03-04 Peng Xia , Kangyu Zhu , Haoran Li , Tianze Wang , Weijia Shi , Sheng Wang , Linjun Zhang , James Zou , Huaxiu Yao

The large language model called ChatGPT has drawn extensively attention because of its human-like expression and reasoning abilities. In this study, we investigate the feasibility of using ChatGPT in experiments on using ChatGPT to…

Computation and Language · Computer Science 2024-10-22 Qing Lyu , Josh Tan , Michael E. Zapadka , Janardhana Ponnatapura , Chuang Niu , Kyle J. Myers , Ge Wang , Christopher T. Whitlow

Recent advances in AI combine large language models (LLMs) with vision encoders that bring forward unprecedented technical capabilities to leverage for a wide range of healthcare applications. Focusing on the domain of radiology,…

Medical Visual Language Models have shown great potential in various healthcare applications, including medical image captioning and diagnostic assistance. However, most existing models rely on text-based instructions, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Tan-Hanh Pham , Chris Ngo , Trong-Duong Bui , Minh Luu Quang , Tan-Huong Pham , Truong-Son Hy

Pathology images are crucial for diagnosing and managing various diseases by visualizing cellular and tissue-level abnormalities. Recent advancements in artificial intelligence (AI), particularly multimodal models like ChatGPT, have shown…

Human-Computer Interaction · Computer Science 2024-09-25 Mianxin Liu , Jianfeng Wu , Fang Yan , Hongjun Li , Wei Wang , Shaoting Zhang , Zhe Wang

Influenced by ChatGPT, artificial intelligence (AI) large models have witnessed a global upsurge in large model research and development. As people enjoy the convenience by this AI large model, more and more large models in subdivided…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Liangrui Pan , Zhenyu Zhao , Ying Lu , Kewei Tang , Liyong Fu , Qingchun Liang , Shaoliang Peng

The global demand for radiologists is increasing rapidly due to a growing reliance on medical imaging services, while the supply of radiologists is not keeping pace. Advances in computer vision and image processing technologies present…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Shehroz S. Khan , Petar Przulj , Ahmed Ashraf , Ali Abedi

Large language models (LLMs), such as ChatGPT, have demonstrated impressive capabilities in various tasks and attracted an increasing interest as a natural language interface across many domains. Recently, large vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Zhihao Chen , Bin Hu , Chuang Niu , Tao Chen , Yuxin Li , Hongming Shan , Ge Wang

Radiology report generation, as a key step in medical image analysis, is critical to the quantitative analysis of clinically informed decision-making levels. However, complex and diverse radiology reports with cross-source heterogeneity…

‹ Prev 1 2 3 10 Next ›