English
Related papers

Related papers: Almanac Copilot: Towards Autonomous Electronic Hea…

200 papers

We introduce ColaCare, a framework that enhances Electronic Health Record (EHR) modeling through multi-agent collaboration driven by Large Language Models (LLMs). Our approach seamlessly integrates domain-specific expert models with LLMs to…

The large amount of time clinicians spend sifting through patient notes and documenting in electronic health records (EHRs) is a leading cause of clinician burnout. By proactively and dynamically retrieving relevant notes during the…

Information Retrieval · Computer Science 2023-08-17 Sharon Jiang , Shannon Shen , Monica Agrawal , Barbara Lam , Nicholas Kurtzman , Steven Horng , David Karger , David Sontag

Regular documentation of progress notes is one of the main contributors to clinician burden. The abundance of structured chart information in medical records further exacerbates the burden, however, it also presents an opportunity to…

Computation and Language · Computer Science 2024-10-18 Sarvesh Soni , Dina Demner-Fushman

Rich Electronic Health Records (EHR), have created opportunities to improve clinical processes using machine learning methods. Prediction of the same patient events at different time horizons can have very different applications and…

Machine Learning · Computer Science 2023-03-07 Hao Liu , Muhan Zhang , Zehao Dong , Lecheng Kong , Yixin Chen , Bradley Fritz , Dacheng Tao , Christopher King

The copilot framework, which aims to enhance and tailor large language models (LLMs) for specific complex tasks without requiring fine-tuning, is gaining increasing attention from the community. In this paper, we introduce the construction…

Computation and Language · Computer Science 2024-02-22 Zhiyao Ren , Yibing Zhan , Baosheng Yu , Liang Ding , Dacheng Tao

Electronic Health Records (EHRs) provide a rich, longitudinal view of patient health and hold significant potential for advancing clinical decision support, risk prediction, and data-driven healthcare research. However, most artificial…

AI-based interactive assistants are advancing human-augmenting technology, yet their effects on users' mental and physiological states remain under-explored. We address this gap by analyzing how Copilot for Microsoft Word, a LLM-based…

Human-Computer Interaction · Computer Science 2025-06-05 Matthew Russell , Aman Shah , Giles Blaney , Judith Amores , Mary Czerwinski , Robert J. K. Jacob

Text-based telemedicine has become increasingly common, yet the quality of medical advice in doctor-patient interactions is often judged more on how advice is communicated rather than its clinical accuracy. To address this, we introduce Dr.…

Computation and Language · Computer Science 2025-07-22 Andrei Niculae , Adrian Cosma , Cosmin Dumitrache , Emilian Rǎdoi

Healthcare administration accounts for over $1 trillion in annual spending, making it a promising target for LLM-based computer-use agents (CUAs). While clinical applications of LLMs have received significant attention, no benchmark exists…

Electronic health records (EHRs), which contain patients' medical histories, tend to be written in freely formatted (unstructured) text because they are complicated by their nature. Quickly understanding a patient's history is challenging…

Human-Computer Interaction · Computer Science 2023-06-27 Shuntaro Yada , Eiji Aramaki

We analyze over 500,000 de-identified health-related conversations with Microsoft Copilot from January 2026 to characterize what people ask conversational AI about health. We develop a hierarchical intent taxonomy of 12 primary categories…

Clinical AI systems require not just point-in-time evaluation but continuous governance: the ongoing practice of monitoring, evaluating, iterating, and re-evaluating performance throughout deployment. We present an end-to-end framework of…

Artificial Intelligence · Computer Science 2026-05-01 Aaryan Shah , Andrew Hines , Alexia Downs , Denis Bajet , Paulius Mui , Fabiano Araujo , Laura Offutt , Aida Rutledge , Elizabeth Jimenez

Multimodal agentic pipelines are transforming human-computer interaction by enabling efficient and accessible automation of complex, real-world tasks. However, recent efforts have focused on short-horizon or general-purpose applications…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Akash Ghosh , Tajamul Ashraf , Rishu Kumar Singh , Numan Saeed , Sriparna Saha , Xiuying Chen , Salman Khan

The allostatic load index (ALI) is a 10-component measure of whole-person health. Data from electronic health records (EHR) present a huge opportunity to operationalize the ALI in learning health systems; however, these data are prone to…

In the fields of affective computing (AC) and brain-machine interface (BMI), the analysis of physiological and behavioral signals to discern individual emotional states has emerged as a critical research frontier. While deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Hongyu Chen , Weiming Zeng , Chengcheng Chen , Luhui Cai , Fei Wang , Yuhu Shi , Lei Wang , Wei Zhang , Yueyang Li , Hongjie Yan , Wai Ting Siok , Nizhuan Wang

Autonomous agents utilizing Large Language Models (LLMs) have demonstrated remarkable capabilities in isolated medical tasks like diagnosis and image analysis, but struggle with integrated clinical workflows that connect diagnostic…

Artificial Intelligence · Computer Science 2025-10-14 Hongjie Zheng , Zesheng Shi , Ping Yi

Electronic health records (EHRs) are designed to synthesize diverse data types, including unstructured clinical notes, structured lab tests, and time-series visit data. Physicians draw on these multimodal and temporal sources of EHR data to…

The presence of detailed clinical information in electronic health record (EHR) systems presents promising prospects for enhancing patient care through automated retrieval techniques. Nevertheless, it is widely acknowledged that accessing…

Information Retrieval · Computer Science 2024-09-13 Abderrahim Oussama Batouche , Eugen Czeizler , Miika Koskinen , Tuomas Mirtti , Antti Sakari Rannikko

Physicians work at a very tight schedule and need decision-making support tools to help on improving and doing their work in a timely and dependable manner. Examining piles of sheets with test results and using systems with little…

Electronic Health Records (EHRs) provide crucial information for clinical decision-making. However, their high-dimensionality, heterogeneity, and sparsity make clinical prediction challenging. Large Language Models (LLMs) allowed progress…

Computation and Language · Computer Science 2026-01-28 Jesus Lovon-Melgarejo , Jose G. Moreno , Christine Damase-Michel , Lynda Tamine