English
Related papers

Related papers: ECG-Chat: A Large ECG-Language Model for Cardiac D…

200 papers

Large language models (LLMs) have shown amazing capabilities in knowledge memorization and the present. However, when it comes to domain-specific knowledge and downstream tasks like medical, general LLMs are often unable to give precise…

Computation and Language · Computer Science 2024-06-06 Maojun Sun

There is an increasing interest in developing LLMs for medical diagnosis to improve diagnosis efficiency. Despite their alluring technological potential, there is no unified and comprehensive evaluation criterion, leading to the inability…

Computation and Language · Computer Science 2023-08-16 Xiaoming Shi , Jie Xu , Jinru Ding , Jiali Pang , Sichen Liu , Shuqing Luo , Xingwei Peng , Lu Lu , Haihong Yang , Mingtao Hu , Tong Ruan , Shaoting Zhang

While recent multimodal large language models (MLLMs) have advanced automated ECG interpretation, they still face two key limitations: (1) insufficient multimodal synergy between time series signals and visual ECG representations, and (2)…

Computation and Language · Computer Science 2025-10-21 Xiang Lan , Feng Wu , Kai He , Qinghao Zhao , Shenda Hong , Mengling Feng

Multimodal Large Language Models (MLLMs) have shown success in various general image processing tasks, yet their application in medical imaging is nascent, lacking tailored models. This study investigates the potential of MLLMs in improving…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Ling Yang , Zhanyu Wang , Zhenghao Chen , Xinyu Liang , Luping Zhou

The primary aim of this research was to address the limitations observed in the medical knowledge of prevalent large language models (LLMs) such as ChatGPT, by creating a specialized language model with enhanced accuracy in medical advice.…

Computation and Language · Computer Science 2023-06-27 Yunxiang Li , Zihan Li , Kai Zhang , Ruilong Dan , Steve Jiang , You Zhang

The electrocardiogram (ECG) is the gold standard for non-invasive diagnosis of cardiac pathologies and is a fundamental pillar of cardiovascular medicine. Recent progress in deep learning has led to the development of robust automated…

The integration of Large Language Models (LLMs) into the healthcare domain has the potential to significantly enhance patient care and support through the development of empathetic, patient-facing chatbots. This study investigates an…

Computation and Language · Computer Science 2024-05-28 Man Luo , Christopher J. Warren , Lu Cheng , Haidar M. Abdul-Muhsin , Imon Banerjee

Echocardiography records ultrasound videos of the heart, enabling clinicians to assess cardiac function. Recent advances in large-scale vision-language models (VLMs) have spurred interest in automating echocardiographic interpretation.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Ryo Takizawa , Satoshi Kodera , Tempei Kabayama , Ryo Matsuoka , Yuta Ando , Yuto Nakamura , Haruki Settai , Norihiko Takeda

Recent advances in large language models (LLMs) have enabled the development of multimodal medical AI. While models such as MedGemini achieve high accuracy on VQA tasks like USMLE MM, their performance on ECG based tasks remains limited,…

Machine Learning · Computer Science 2026-02-12 Junichiro Takahashi , Masataka Sato , Satoshi Kodeta , Norihiko Takeda

Cross-lingual cross-modal retrieval (CCR) aims to retrieve visually relevant content based on non-English queries, without relying on human-labeled cross-modal data pairs during training. One popular approach involves utilizing machine…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Yabing Wang , Le Wang , Qiang Zhou , Zhibin Wang , Hao Li , Gang Hua , Wei Tang

The electrocardiogram (ECG) is an essential non-invasive diagnostic tool for assessing cardiac conditions. Existing automatic interpretation methods suffer from limited generalizability, focusing on a narrow range of cardiac conditions, and…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Ruoqi Liu , Yuelin Bai , Xiang Yue , Ping Zhang

Large language models (LLMs) have exhibited remarkable capabilities across a variety of domains and tasks, challenging our understanding of learning and cognition. Despite the recent success, current LLMs are not capable of processing…

Recently, Large Language Models (LLMs) have showcased remarkable capabilities in natural language understanding. While demonstrating proficiency in everyday conversations and question-answering situations, these models frequently struggle…

Computation and Language · Computer Science 2023-08-28 Chaoyi Wu , Weixiong Lin , Xiaoman Zhang , Ya Zhang , Yanfeng Wang , Weidi Xie

Large Language Models (LLMs) have shown remarkable progress in medical question answering (QA), yet their effectiveness remains predominantly limited to English due to imbalanced multilingual training data and scarce medical resources for…

Electroencephalography (EEG) interpretation using multimodal large language models (MLLMs) offers a novel approach for analyzing brain signals. However, the complex nature of brain activity introduces critical challenges: EEG signals…

Signal Processing · Electrical Eng. & Systems 2025-10-02 Ziyi Zeng , Zhenyang Cai , Yixi Cai , Xidong Wang , Junying Chen , Rongsheng Wang , Yipeng Liu , Siqi Cai , Benyou Wang , Zhiguo Zhang , Haizhou Li

Recent advancements in large language models (LLMs) like ChatGPT and LLaMA show promise in medical applications, yet challenges remain in medical language comprehension. This study presents Me-LLaMA, a new medical LLM family based on…

In recent advancements, multimodal large language models (MLLMs) have been fine-tuned on specific medical image datasets to address medical visual question answering (Med-VQA) tasks. However, this common approach of task-specific…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Lai Wei , Wenkai Wang , Xiaoyu Shen , Yu Xie , Zhihao Fan , Xiaojin Zhang , Zhongyu Wei , Wei Chen

Emotional and cognitive factors are essential for understanding mental health disorders. However, existing methods often treat multi-modal data as classification tasks, limiting interpretability especially for emotion and cognition.…

Multimedia · Computer Science 2026-03-03 Zhiyuan Zhou , Yanrong Guo , Shijie Hao

Background: Large language models (LLMs) have seen extraordinary advances with applications in clinical decision support. However, high-quality evidence is urgently needed on the potential and limitation of LLMs in providing accurate…

Artificial Intelligence · Computer Science 2024-09-24 Yuxing Zhi , Yuan Guo , Kai Yuan , Hesong Wang , Heng Xu , Haina Yao , Albert C Yang , Guangrui Huang , Yuping Duan

The development of large language models (LLMs) has brought unprecedented possibilities for artificial intelligence (AI) based medical diagnosis. However, the application perspective of LLMs in real diagnostic scenarios is still unclear…

Computation and Language · Computer Science 2024-05-21 Zhoujian Sun , Cheng Luo , Ziyi Liu , Zhengxing Huang