English
Related papers

Related papers: ECG-Chat: A Large ECG-Language Model for Cardiac D…

200 papers

Electrocardiogram (ECG) is one of the most convenient and non-invasive tools for monitoring peoples' heart condition, which can use for diagnosing a wide range of heart diseases, including Cardiac Arrhythmia, Acute Coronary Syndrome, et al.…

Signal Processing · Electrical Eng. & Systems 2020-07-08 Shenda Hong , Zhaoji Fu , Rongbo Zhou , Jie Yu , Yongkui Li , Kai Wang , Guanlin Cheng

This paper focuses on the challenge of answering questions in scenarios that are composed of rich and complex dynamic audio-visual components. Although existing Multimodal Large Language Models (MLLMs) can respond to audio-visual content,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Qilang Ye , Zitong Yu , Rui Shao , Xinyu Xie , Philip Torr , Xiaochun Cao

Electrocardiogram (ECG) plays a foundational role in modern cardiovascular care, enabling non-invasive diagnosis of arrhythmias, myocardial ischemia, and conduction disorders. While machine learning has achieved expert-level performance in…

Signal Processing · Electrical Eng. & Systems 2025-07-22 Deyun Zhang , Xiang Lan , Shijia Geng , Qinghao Zhao , Sumei Fan , Mengling Feng , Shenda Hong

The rapid advancements in Artificial Intelligence, specifically Machine Learning (ML) and Deep Learning (DL), have opened new prospects in medical sciences for improved diagnosis, prognosis, and treatment of severe health conditions. This…

Machine Learning · Computer Science 2024-12-11 Atit Pokharel , Shashank Dahal , Pratik Sapkota , Bhupendra Bimal Chhetri

Large Language Models (LLMs) have brought huge improvements to Artificial Intelligence (AI), which can be applied to general-purpose tasks. However, their application to textual or spoken medical consultations is still an open research…

Artificial Intelligence · Computer Science 2026-05-27 Heriberto Cuayahuitl , Grace Jang

The development of large language models (LLMs) such as ChatGPT has brought a lot of attention recently. However, their evaluation in the benchmark academic datasets remains under-explored due to the difficulty of evaluating the generative…

Computation and Language · Computer Science 2023-07-07 Md Tahmid Rahman Laskar , M Saiful Bari , Mizanur Rahman , Md Amran Hossen Bhuiyan , Shafiq Joty , Jimmy Xiangji Huang

Medical report generation is the task of automatically writing radiology reports for chest X-ray images. Manually composing these reports is a time-consuming process that is also prone to human errors. Generating medical reports can…

Computation and Language · Computer Science 2024-10-22 Abdullah , Ameer Hamza , Seong Tae Kim

Recent advances in deep learning and natural language generation have significantly improved image captioning, enabling automated, human-like descriptions for visual content. In this work, we apply these captioning techniques to generate…

Computation and Language · Computer Science 2024-12-06 Amnon Bleich , Antje Linnemann , Bjoern H. Diem , Tim OF Conrad

Research on large language models (LLMs) has shown remarkable performance in domains such as mathematics, programming, and literary creation. However, most studies have focused on semantic memory-based question answering, neglecting LLMs'…

Computation and Language · Computer Science 2025-02-25 WenTao Liu , Ruohua Zhang , Aimin Zhou , Feng Gao , JiaLi Liu

There is a significant gap between patient needs and available mental health support today. In this paper, we aim to thoroughly examine the potential of using Large Language Models (LLMs) to assist professional psychotherapy. To this end,…

Computation and Language · Computer Science 2025-01-28 Mian Zhang , Xianjun Yang , Xinlu Zhang , Travis Labrum , Jamie C. Chiu , Shaun M. Eack , Fei Fang , William Yang Wang , Zhiyu Zoey Chen

Large Language Models (LLMs) have been shown to encode clinical knowledge. Many evaluations, however, rely on structured question-answer benchmarks, overlooking critical challenges of interpreting and reasoning about unstructured clinical…

Computation and Language · Computer Science 2026-04-01 Meghal Dani , Muthu Jeyanthi Prakash , Filip Rosa , Zeynep Akata , Stefanie Liebe

In this technical report, we present TeleChat, a collection of large language models (LLMs) with parameters of 3 billion, 7 billion and 12 billion. It includes pretrained language models as well as fine-tuned chat models that is aligned…

The application of the Multi-modal Large Language Models (MLLMs) in medical clinical scenarios remains underexplored. Previous benchmarks only focus on the capacity of the MLLMs in medical visual question-answering (VQA) or report…

Computation and Language · Computer Science 2024-08-19 Hongcheng Liu , Yusheng Liao , Siqv Ou , Yuhao Wang , Heyang Liu , Yanfeng Wang , Yu Wang

Effective patient-provider communication is crucial in clinical care, directly impacting patient outcomes and quality of life. Traditional evaluation methods, such as human ratings, patient feedback, and provider self-assessments, are often…

Computation and Language · Computer Science 2024-09-25 Zhiyuan Wang , Fangxu Yuan , Virginia LeBaron , Tabor Flickinger , Laura E. Barnes

Speech therapy is essential for rehabilitating speech disorders caused by neurological impairments such as stroke. However, traditional manual and computer-assisted systems are limited in real-time accessibility and articulatory motion…

Sound · Computer Science 2025-11-03 Yudong Yang , Xiaokang Liu , Shaofeng zhao , Rongfeng Su , Nan Yan , Lan Wang

Recent advancements for large-scale pre-training with neural signals such as electroencephalogram (EEG) have shown promising results, significantly boosting the development of brain-computer interfaces (BCIs) and healthcare. However, these…

Signal Processing · Electrical Eng. & Systems 2025-03-21 Wei-Bang Jiang , Yansen Wang , Bao-Liang Lu , Dongsheng Li

Electrocardiogram (ECG) interpretation is essential for cardiovascular disease diagnosis, but current automated systems often struggle with transparency and generalization to unseen conditions. To address this, we introduce ZETA, a…

Machine Learning · Computer Science 2025-10-27 Jialu Tang , Hung Manh Pham , Ignace De Lathauwer , Henk S. Schipper , Yuan Lu , Dong Ma , Aaqib Saeed

Large-scale multimodal language models (LMMs) have achieved remarkable success in general domains. However, the exploration of diagnostic language models based on multimodal cephalometric medical data remains limited. In this paper, we…

Artificial Intelligence · Computer Science 2023-07-18 Lei Ma , Jincong Han , Zhaoxin Wang , Dian Zhang

Multimodal Affective Computing (MAC) aims to recognize and interpret human emotions by integrating information from diverse modalities such as text, video, and audio. Recent advancements in Multimodal Large Language Models (MLLMs) have…

Artificial Intelligence · Computer Science 2025-08-05 Miaosen Luo , Jiesen Long , Zequn Li , Yunying Yang , Yuncheng Jiang , Sijie Mai

Electronic Health Records (EHRs) offer considerable potential for clinical prediction, but their complexity and heterogeneity challenge traditional machine learning. Domain-specific EHR foundation models trained on unlabeled EHR data have…