English
Related papers

Related papers: EchoQA: A Large Collection of Instruction Tuning D…

200 papers

Purpose: Echocardiographic interpretation requires video-level reasoning and guideline-based measurement analysis, which current deep learning models for cardiac ultrasound do not support. We present EchoAgent, a framework that enables…

How to better evaluate the capabilities of Large Language Models (LLMs) is the focal point and hot topic in current LLMs research. Previous work has noted that due to the extremely high cost of iterative updates of LLMs, they are often…

Computation and Language · Computer Science 2024-03-05 Zhikun Xu , Yinghui Li , Ruixue Ding , Xinyu Wang , Boli Chen , Yong Jiang , Hai-Tao Zheng , Wenlian Lu , Pengjun Xie , Fei Huang

Extractive reading comprehension question answering (QA) datasets are typically evaluated using Exact Match (EM) and F1-score, but these metrics often fail to fully capture model performance. With the success of large language models…

Computation and Language · Computer Science 2025-04-23 Xanh Ho , Jiahao Huang , Florian Boudin , Akiko Aizawa

Large audio language models (LALMs) leverage multimodal representations to generate open-ended answers to natural language queries about audio. In this paper, we (1) provide empirical evidence that assessment of LALMs using the popular…

Sound · Computer Science 2026-05-28 Daniel Chenyu Lin , Michael Freeman , John Thickstun

Low-dose computed tomography (CT) represents a significant improvement in patient safety through lower radiation doses, but increased noise, blur, and contrast loss can diminish diagnostic quality. Therefore, consistency and robustness in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Kagan Celik , Mehmet Ozan Unal , Metin Ertas , Isa Yildirim

Retrieval-augmented Large Language Models (LLMs) have reshaped traditional query-answering systems, offering unparalleled user experiences. However, existing retrieval techniques often struggle to handle multi-modal query contexts. In this…

Databases · Computer Science 2024-07-08 Mengzhao Wang , Haotian Wu , Xiangyu Ke , Yunjun Gao , Xiaoliang Xu , Lu Chen

Large Language Models (LLMs) constitute a breakthrough state-of-the-art Artificial Intelligence (AI) technology which is rapidly evolving and promises to aid in medical diagnosis either by assisting doctors or by simulating a doctor's…

Medical question answering (QA) benchmarks often focus on multiple-choice or fact-based tasks, leaving open-ended answers to real patient questions underexplored. This gap is particularly critical in mental health, where patient questions…

Computation and Language · Computer Science 2026-05-15 Yahan Li , Jifan Yao , John Bosco S. Bunyi , Adam C. Frank , Angel Hsing-Chi Hwang , Ruishan Liu

Recent advances in large language models (LLMs) offer new opportunities for scalable, interactive mental health assessment, but excessive querying by LLMs burdens users and is inefficient for real-world screening across transdiagnostic…

Computation and Language · Computer Science 2025-11-21 Vasudha Varadarajan , Hui Xu , Rebecca Astrid Boehme , Mariam Marlan Mirstrom , Sverker Sikstrom , H. Andrew Schwartz

The adoption of deep learning-based healthcare decision support systems such as the detection of irregular cardiac rhythm is hindered by challenges such as lack of access to quality data and the high costs associated with the collection and…

Machine Learning · Computer Science 2022-05-31 Sagnik Dakshit , Barbara Mukami Maweu , Sristi Dakshit , Balakrishnan Prabhakaran

Objective: Electronic health records (EHR) data are prone to missingness and errors. Previously, we devised an "enriched" chart review protocol where a "roadmap" of auxiliary diagnoses (anchors) was used to recover missing values in EHR…

Machine Learning · Computer Science 2025-10-07 Sarah C. Lotspeich , Abbey Collins , Brian J. Wells , Ashish K. Khanna , Joseph Rigdon , Lucy D'Agostino McGowan

Generative large language models (LLMs) have shown great success in various applications, including question-answering (QA) and dialogue systems. However, in specialized domains like traditional Chinese medical QA, these models may perform…

Computation and Language · Computer Science 2023-09-06 Yang Tan , Mingchen Li , Zijie Huang , Huiqun Yu , Guisheng Fan

While Large Language Models (LLMs) have demonstrated commendable performance across a myriad of domains and tasks, existing LLMs still exhibit a palpable deficit in handling multimodal functionalities, especially for the Spoken Question…

Computation and Language · Computer Science 2024-04-19 Zihan Zhao , Yiyang Jiang , Heyang Liu , Yanfeng Wang , Yu Wang

This paper investigates the use of artificial intelligence chatbots for patient-specific question answering (QA) from clinical notes using several large language model (LLM) based systems: ChatGPT (versions 3.5 and 4), Google Bard, and…

Computation and Language · Computer Science 2023-06-06 Alaleh Hamidi , Kirk Roberts

Large language models (LLMs) show promise for improving the efficiency of qualitative analysis in large, multi-site health-services research. Yet methodological guidance for LLM integration into qualitative analysis and evidence of their…

Computation and Language · Computer Science 2026-01-22 Sasha Ronaghi , Emma-Louise Aveling , Maria Levis , Rachel Lauren Ross , Emily Alsentzer , Sara Singer

Artificial intelligence is making significant strides in the finance industry, revolutionizing how data is processed and interpreted. Among these technologies, large language models (LLMs) have demonstrated substantial potential to…

Computation and Language · Computer Science 2024-07-02 Cehao Yang , Chengjin Xu , Yiyan Qi

We introduce GQA, a new dataset for real-world visual reasoning and compositional question answering, seeking to address key shortcomings of previous VQA datasets. We have developed a strong and robust question engine that leverages scene…

Computation and Language · Computer Science 2019-07-12 Drew A. Hudson , Christopher D. Manning

Online medical forums have long served as vital platforms where patients seek professional healthcare advice, generating vast amounts of valuable knowledge. However, the informal nature and linguistic complexity of forum interactions pose…

Computation and Language · Computer Science 2025-10-22 Antonio Romano , Giuseppe Riccio , Mariano Barone , Marco Postiglione , Vincenzo Moscato

This study leverages optimized context retrieval to enhance open-source Large Language Models (LLMs) for cost-effective, high performance healthcare AI. We demonstrate that this approach achieves state-of-the-art accuracy on medical…

Artificial Intelligence · Computer Science 2025-04-04 Jordi Bayarri-Planas , Ashwin Kumar Gururajan , Dario Garcia-Gasulla

Most large language models (LLMs) are trained once and never updated; thus, they lack the ability to dynamically adapt to our ever-changing world. In this work, we perform a detailed study of the factuality of LLM-generated text in the…

Computation and Language · Computer Science 2023-11-23 Tu Vu , Mohit Iyyer , Xuezhi Wang , Noah Constant , Jerry Wei , Jason Wei , Chris Tar , Yun-Hsuan Sung , Denny Zhou , Quoc Le , Thang Luong