English
Related papers

Related papers: Towards Automatic Evaluation for LLMs' Clinical Ca…

200 papers

Large language models (LLMs) show promise for improving the efficiency of qualitative analysis in large, multi-site health-services research. Yet methodological guidance for LLM integration into qualitative analysis and evidence of their…

Computation and Language · Computer Science 2026-01-22 Sasha Ronaghi , Emma-Louise Aveling , Maria Levis , Rachel Lauren Ross , Emily Alsentzer , Sara Singer

Medical Decision-Making (MDM) is a multi-faceted process that requires clinicians to assess complex multi-modal patient data patient, often collaboratively. Large Language Models (LLMs) promise to streamline this process by synthesizing…

The rapid rise in popularity of Large Language Models (LLMs) with emerging capabilities has spurred public curiosity to evaluate and compare different LLMs, leading many researchers to propose their own LLM benchmarks. Noticing preliminary…

Artificial Intelligence · Computer Science 2025-05-15 Timothy R. McIntosh , Teo Susnjak , Nalin Arachchilage , Tong Liu , Paul Watters , Malka N. Halgamuge

Business processes are fundamental to organizational operations, yet their optimization remains challenging due to the timeconsuming nature of manual process analysis. Our paper harnesses Large Language Models (LLMs) to automate value-added…

Computation and Language · Computer Science 2025-04-10 William De Michele , Abel Armas Cervantes , Lea Frermann

Serendipity plays a pivotal role in enhancing user satisfaction within recommender systems, yet its evaluation poses significant challenges due to its inherently subjective nature and conceptual ambiguity. Current algorithmic approaches…

Information Retrieval · Computer Science 2025-07-24 Li Kang , Yuhan Zhao , Li Chen

Recent advancements in medical Large Language Models (LLMs) have showcased their powerful reasoning and diagnostic capabilities. Despite their success, current unified multimodal medical LLMs face limitations in knowledge update costs,…

Computation and Language · Computer Science 2025-06-25 Yucheng Zhou , Lingran Song , Jianbing Shen

Objectives: To evaluate the current limitations of large language models (LLMs) in medical question answering, focusing on the quality of datasets used for their evaluation. Materials and Methods: Widely-used benchmark datasets, including…

Computation and Language · Computer Science 2025-07-15 Mahmoud Alwakeel , Aditya Nagori , Vijay Krishnamoorthy , Rishikesan Kamaleswaran

The rapid advancement of large language models (LLMs) has opened new boundaries in the extraction and synthesis of medical knowledge, particularly within evidence synthesis. This paper reviews the state-of-the-art applications of LLMs in…

Accurate and reliable search on online healthcare platforms is critical for user safety and service efficacy. Traditional methods, however, often fail to comprehend complex and nuanced user queries, limiting their effectiveness. Large…

Computation and Language · Computer Science 2025-12-04 Chuyue Wang , Jie Feng , Yuxi Wu , Hang Zhang , Zhiguo Fan , Bing Cheng , Wei Lin

Psychological support hotlines provide critical support for individuals experiencing mental health emergencies, yet current assessments largely rely on human operators whose judgments may vary with professional experience and are…

Computation and Language · Computer Science 2026-05-12 Terumi Chiba , Yang Luo , Ziyun Cui , Yongsheng Tong , Chao Zhang

There are two main barriers to using large language models (LLMs) in clinical reasoning. Firstly, while LLMs exhibit significant promise in Natural Language Processing (NLP) tasks, their performance in complex reasoning and planning falls…

Artificial Intelligence · Computer Science 2024-12-31 Shengxin Hong , Liang Xiao , Xin Zhang , Jianxia Chen

Recent advancements in reasoning-enhanced large language models (LLMs), such as DeepSeek-R1 and OpenAI-o3, have demonstrated significant progress. However, their application in professional medical contexts remains underexplored,…

Computation and Language · Computer Science 2025-03-11 Pengcheng Qiu , Chaoyi Wu , Shuyu Liu , Weike Zhao , Zhuoxia Chen , Hongfei Gu , Chuanjin Peng , Ya Zhang , Yanfeng Wang , Weidi Xie

The integration of Large Language Models (LLMs) into medical applications has sparked widespread interest across the healthcare industry, from drug discovery and development to clinical decision support, assisting telemedicine, medical…

Computation and Language · Computer Science 2024-12-03 Zifeng Wang , Hanyin Wang , Benjamin Danek , Ying Li , Christina Mack , Hoifung Poon , Yajuan Wang , Pranav Rajpurkar , Jimeng Sun

Using Large Language Models (LLMs) for relevance assessments offers promising opportunities to improve Information Retrieval (IR), Natural Language Processing (NLP), and related fields. Indeed, LLMs hold the promise of allowing IR…

The application of large language models (LLMs) in healthcare has gained significant attention due to their ability to process complex medical data and provide insights for clinical decision-making. These models have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Amna Khalid , Ayma Khalid , Umar Khalid

Evaluating Large Language Models (LLMs) for mental health support is challenging due to the emotionally and cognitively complex nature of therapeutic dialogue. Existing benchmarks are limited in scale, reliability, often relying on…

As LLMs are increasingly integrated into human-in-the-loop content moderation systems, a central challenge is deciding when their outputs can be trusted versus when escalation for human review is preferable. We propose a novel framework for…

Artificial Intelligence · Computer Science 2026-01-13 Or Bachar , Or Levi , Sardhendu Mishra , Adi Levi , Manpreet Singh Minhas , Justin Miller , Omer Ben-Porat , Eilon Sheetrit , Jonathan Morra

The increasing complexity of clinical decision-making, alongside the rapid expansion of electronic health records (EHR), presents both opportunities and challenges for delivering data-informed care. This paper proposes a clinical decision…

Artificial Intelligence · Computer Science 2025-10-03 Leon Garza , Anantaa Kotal , Michael A. Grasso , Emre Umucu

Recommender systems are essential components of many online platforms, yet traditional approaches still struggle with understanding complex user preferences and providing explainable recommendations. The emergence of Large Language Model…

Information Retrieval · Computer Science 2025-03-05 Qiyao Peng , Hongtao Liu , Hua Huang , Qing Yang , Minglai Shao

Large language models (LLMs) are emerging as promising tools for mental health care, offering scalable support through their ability to generate human-like responses. However, the effectiveness of these models in clinical settings remains…

Artificial Intelligence · Computer Science 2024-08-22 Yining Hua , Hongbin Na , Zehan Li , Fenglin Liu , Xiao Fang , David Clifton , John Torous