English
Related papers

Related papers: Automatic Interactive Evaluation for Large Languag…

200 papers

Standardized patients (SPs) play a central role in clinical communication training but are costly, difficult to scale, and inconsistent. Large language model (LLM) based AI standardized patients (AI-SPs) promise flexible, on-demand…

Human-Computer Interaction · Computer Science 2026-04-07 Zhiqi Gao , Guo Zhu , Huarui Luo , Dongyijie Primo Pan , Haoming Tang , Bingquan Zhang , Jiahuan Pei , Jie Li , Benyou Wang

Large language models (LLMs) constitute a breakthrough state-of-the-art Artificial Intelligence technology which is rapidly evolving and promises to aid in medical diagnosis. However, the correctness and the accuracy of their returns has…

Computation and Language · Computer Science 2024-02-07 Dimitrios P. Panagoulias , Maria Virvou , George A. Tsihrintzis

Psychological consultation is essential for improving mental health and well-being, yet challenges such as the shortage of qualified professionals and scalability issues limit its accessibility. To address these challenges, we explore the…

Computation and Language · Computer Science 2024-08-30 Rafael Souza , Jia-Hao Lim , Alexander Davis

We propose a multi-agent framework for modeling artificial consciousness in large language models (LLMs), grounded in psychoanalytic theory. Our \textbf{Psychodynamic Model} simulates self-awareness, preconsciousness, and unconsciousness…

Computation and Language · Computer Science 2025-10-22 Sang Hun Kim , Jongmin Lee , Dongkyu Park , So Young Lee , Yosep Chong

Integration of artificial intelligence (AI) into life cycle assessment (LCA) has accelerated in recent years, with numerous studies successfully adapting machine learning algorithms to support various stages of LCA. Despite this rapid…

Artificial Intelligence · Computer Science 2026-02-27 Anastasija Mensikova , Donna M. Rizzo , Kathryn Hinkelman

We are witnessing a bloom of AI-powered software driven by Large Language Models (LLMs). Although the applications of these LLMs are impressive and seemingly countless, their unreliability hinders adoption. In fact, the tendency of LLMs to…

Software Engineering · Computer Science 2025-10-30 Vincenzo Scotti , Jan Keim , Tobias Hey , Andreas Metzger , Anne Koziolek , Raffaela Mirandola

Objectives: Despite the recent adoption of large language models (LLMs) for biomedical information extraction, challenges in prompt engineering and algorithms persist, with no dedicated software available. To address this, we developed…

Machine Learning · Computer Science 2025-04-02 Enshuo Hsu , Kirk Roberts

Autonomous agents have long been a prominent research focus in both academic and industry communities. Previous research in this field often focuses on training agents with limited knowledge within isolated environments, which diverges…

Artificial Intelligence · Computer Science 2025-03-04 Lei Wang , Chen Ma , Xueyang Feng , Zeyu Zhang , Hao Yang , Jingsen Zhang , Zhiyuan Chen , Jiakai Tang , Xu Chen , Yankai Lin , Wayne Xin Zhao , Zhewei Wei , Ji-Rong Wen

Large language models (LLMs) have attracted significant attention for potential applications in digital health, while their application in mental health is subject to ongoing debate. This systematic review aims to evaluate the usage of LLMs…

Computers and Society · Computer Science 2024-08-14 Zhijun Guo , Alvina Lai , Johan Hilge Thygesen , Joseph Farrington , Thomas Keen , Kezhi Li

Artificial intelligence (AI) and large language models (LLMs) in healthcare require advanced clinical skills (CS), yet current benchmarks fail to evaluate these comprehensively. We introduce MedQA-CS, an AI-SCE framework inspired by medical…

Artificial Intelligence · Computer Science 2026-01-21 Zonghai Yao , Zihao Zhang , Chaolong Tang , Xingyu Bian , Youxia Zhao , Zhichao Yang , Junda Wang , Huixue Zhou , Won Seok Jang , Feiyun Ouyang , Hong Yu

Medical Large language models achieve strong scores on standard benchmarks; however, the transfer of those results to safe and reliable performance in clinical workflows remains a challenge. This survey reframes evaluation through a…

Background: Large Language Models (LLMs) are transforming artificial intelligence applications in healthcare due to their ability to understand, generate, and summarize complex medical text. They offer valuable support to clinicians,…

Computation and Language · Computer Science 2026-04-14 Subin Santhosh , Farwa Abbas , Hussain Ahmad , Claudia Szabo

This study presents the first comprehensive evaluation of Multimodal Large Language Models (MLLMs) for Adolescent Idiopathic Scoliosis (AIS) self-management. We constructed a database of approximately 3,000 anteroposterior X-rays with…

Artificial Intelligence · Computer Science 2025-10-14 Zhaolong Wu , Pu Luo , Nan Meng , Jason Pui Yin Cheung , Teng Zhang

Medical Decision-Making (MDM) is a multi-faceted process that requires clinicians to assess complex multi-modal patient data patient, often collaboratively. Large Language Models (LLMs) promise to streamline this process by synthesizing…

Agent-based models (ABMs) stand as an essential paradigm for proposing and validating hypothetical solutions or policies aimed at addressing challenges posed by complex systems and achieving various objectives. This process demands…

Computation and Language · Computer Science 2024-04-02 Tong Niu , Weihao Zhang , Rong Zhao

Modeling & Simulation (M&S) approaches such as agent-based models hold significant potential to support decision-making activities in health, with recent examples including the adoption of vaccines, and a vast literature on healthy eating…

Artificial Intelligence · Computer Science 2025-09-08 Philippe J. Giabbanelli , Ameeta Agrawal

In the face of rapidly expanding online medical literature, automated systems for aggregating and summarizing information are becoming increasingly crucial for healthcare professionals and patients. Large Language Models (LLMs), with their…

Computation and Language · Computer Science 2024-03-07 Niraj Yagnik , Jay Jhaveri , Vivek Sharma , Gabriel Pila

Recent advancements in AI have reinvigorated Agent-Based Models (ABMs), as the integration of Large Language Models (LLMs) has led to the emergence of ``generative ABMs'' as a novel approach to simulating social systems. While ABMs offer…

Multiagent Systems · Computer Science 2025-04-07 Maik Larooij , Petter Törnberg

The scarcity of subspecialist medical expertise, particularly in rare, complex and life-threatening diseases, poses a significant challenge for healthcare delivery. This issue is particularly acute in cardiology where timely, accurate…

Systematic reviews are fundamental to evidence-based medicine. Creating one is time-consuming and labour-intensive, mainly due to the need to screen, or assess, many studies for inclusion in the review. Several tools have been developed to…

Information Retrieval · Computer Science 2025-04-08 Xinyu Mao , Teerapong Leelanupab , Martin Potthast , Harrisen Scells , Guido Zuccon