English
Related papers

Related papers: Evaluating GPT-5 as a Multimodal Clinical Reasoner…

200 papers

Large Language Models (LLMs) and Large Multimodal Models (LMMs) exhibit impressive problem-solving skills in many tasks and domains, but their ability in mathematical reasoning in visual contexts has not been systematically studied. To…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Pan Lu , Hritik Bansal , Tony Xia , Jiacheng Liu , Chunyuan Li , Hannaneh Hajishirzi , Hao Cheng , Kai-Wei Chang , Michel Galley , Jianfeng Gao

Driven by the large foundation models, the development of artificial intelligence has witnessed tremendous progress lately, leading to a surge of general interest from the public. In this study, we aim to assess the performance of OpenAI's…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Chaoyi Wu , Jiayu Lei , Qiaoyu Zheng , Weike Zhao , Weixiong Lin , Xiaoman Zhang , Xiao Zhou , Ziheng Zhao , Ya Zhang , Yanfeng Wang , Weidi Xie

This study assesses the ability of state-of-the-art large language models (LLMs) including GPT-3.5, GPT-4, Falcon, and LLaMA 2 to identify patients with mild cognitive impairment (MCI) from discharge summaries and examines instances where…

In this paper, we critically evaluate the capabilities of the state-of-the-art multimodal large language model, i.e., GPT-4 with Vision (GPT-4V), on Visual Question Answering (VQA) task. Our experiments thoroughly assess GPT-4V's…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Zhiling Yan , Kai Zhang , Rong Zhou , Lifang He , Xiang Li , Lichao Sun

Predicting cancer treatment outcomes requires models that are both accurate and interpretable, particularly in the presence of heterogeneous clinical data. While large language models (LLMs) have shown strong performance in biomedical NLP,…

Computation and Language · Computer Science 2025-10-21 Raghu Vamshi Hemadri , Geetha Krishna Guruju , Kristi Topollai , Anna Ewa Choromanska

Use of large language models such as ChatGPT (GPT-4/GPT-5) for mental health support has grown rapidly, emerging as a promising route to assess and help people with mood disorders like depression. However, we have a limited understanding of…

Generative AI based on foundation models provides a first glimpse into the world represented by machines trained on vast amounts of multimodal data ingested by these models during training. If we consider the resulting models as knowledge…

Computers and Society · Computer Science 2024-04-12 Zilong Liu , Krzysztof Janowicz , Kitty Currier , Meilin Shi

This paper investigates the emotional reasoning abilities of the GPT family of large language models via a component perspective. The paper first examines how the model reasons about autobiographical memories. Second, it systematically…

Computation and Language · Computer Science 2023-07-27 Ala N. Tak , Jonathan Gratch

Background: Artificial intelligence language models have shown promise in various applications, including assisting with clinical decision-making as demonstrated by strong performance of large language models on medical licensure exams.…

Computation and Language · Computer Science 2023-05-10 Timothy Poterucha , Pierre Elias , Christopher M. Haggerty

Large multimodal models (LMMs) extend large language models (LLMs) with multi-sensory skills, such as visual understanding, to achieve stronger generic intelligence. In this paper, we analyze the latest model, GPT-4V(ision), to deepen the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Zhengyuan Yang , Linjie Li , Kevin Lin , Jianfeng Wang , Chung-Ching Lin , Zicheng Liu , Lijuan Wang

Recent work has demonstrated substantial gains in pre-training large-language models (LLMs) followed by supervised fine-tuning on the downstream task. In this paper, we evaluate the performance of the GPT-neo model using $6$ commonsense…

Computation and Language · Computer Science 2023-09-28 Rohan Kashyap , Vivek Kashyap , Narendra C. P.

Multimodal large language models (MLLMs) have recently demonstrated remarkable reasoning abilities with reinforcement learning paradigm. Although several multimodal reasoning models have been explored in the medical domain, most of them…

Artificial Intelligence · Computer Science 2025-09-11 Ruiqi Wu , Yuang Yao , Tengfei Ma , Chenran Zhang , Na Su , Tao Zhou , Geng Chen , Wen Fan , Yi Zhou

Recent advances in vision-language models (VLMs) have achieved remarkable performance on standard medical benchmarks, yet their true clinical reasoning ability remains unclear. Existing datasets predominantly emphasize classification…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Miao Jing , Mengting Jia , Junling Lin , Zhongxia Shen , Huan Gao , Mingkun Xu , Shangyang Li

Traditional evaluations of reasoning capabilities of language models are dominated by adult-centric benchmarks that presuppose broad world knowledge, complex instruction following, and mature pragmatic competence. These assumptions are…

Computation and Language · Computer Science 2026-03-17 Kaustubh D. Dhole

This study extends previous research on spatial representations in multimodal AI systems. Although current models demonstrate a rich understanding of spatial information from images, this information is rooted in propositional…

Artificial Intelligence · Computer Science 2024-09-24 Bridget Leonard , Kristin Woodard , Scott O. Murray

Harnessing logical reasoning ability is a comprehensive natural language understanding endeavor. With the release of Generative Pretrained Transformer 4 (GPT-4), highlighted as "advanced" at reasoning tasks, we are eager to learn the GPT-4…

Computation and Language · Computer Science 2023-05-08 Hanmeng Liu , Ruoxi Ning , Zhiyang Teng , Jian Liu , Qiji Zhou , Yue Zhang

With the rise of multimodal large language models, GPT-4o stands out as a pioneering model, driving us to evaluate its capabilities. This report assesses GPT-4o across various tasks to analyze its audio processing and reasoning abilities.…

Computation and Language · Computer Science 2025-02-17 Yu-Xiang Lin , Chih-Kai Yang , Wei-Chih Chen , Chen-An Li , Chien-yu Huang , Xuanjun Chen , Hung-yi Lee

The rapid advancement of large language models (LLMs) has led to significant breakthroughs in automated mathematical reasoning and scientific discovery. Georgiev, G${\'o}$mez-Serrano, Tao, and Wagner [GGSTW+25] demonstrate that AI systems…

Artificial Intelligence · Computer Science 2025-12-17 Yang Cao , Yubin Chen , Xuyang Guo , Zhao Song , Song Yue , Jiahao Zhang , Jiale Zhao

Artificial intelligence has demonstrated significant potential in clinical decision-making; however, developing models capable of adapting to diverse real-world scenarios and performing complex diagnostic reasoning remains a major…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Ronghao Xu , Zhen Huang , Yangbo Wei , Xiaoqian Zhou , Zikang Xu , Ting Liu , Zihang Jiang , S. Kevin Zhou

Background: The rapid integration of foundation models into clinical practice and public health necessitates a rigorous evaluation of their true clinical reasoning capabilities beyond narrow examination success. Current benchmarks,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Dingyu Wang , Zimu Yuan , Jiajun Liu , Shanggui Liu , Nan Zhou , Tianxing Xu , Di Huang , Dong Jiang