English
Related papers

Related papers: Eligibility-Aware Evidence Synthesis: An Agentic F…

200 papers

We present a scalable, AI-powered system that identifies and extracts evidence-based behavioral nudges from unstructured biomedical literature. Nudges are subtle, non-coercive interventions that influence behavior without limiting choice,…

The LLM-as-a-Judge paradigm offers a scalable, reference-free approach for evaluating language models. Although several calibration techniques have been proposed to better align these evaluators with human judgment, prior studies focus…

Computation and Language · Computer Science 2025-05-23 Roland Daynauth , Christopher Clarke , Krisztian Flautner , Lingjia Tang , Jason Mars

Accuracy-based evaluation of Large Language Models (LLMs) measures benchmark-specific performance rather than underlying medical competency: it treats all questions as equally informative, conflates model ability with item characteristics,…

Computation and Language · Computer Science 2026-04-07 Zhimeng Luo , Lixin Wu , Adam Frisch , Daqing He

Multimodal large language models (MLLMs) have demonstrated strong capabilities in visual understanding, yet they remain limited in complex, multi-step reasoning that requires deep searching and integrating visual evidence with external…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Xiangyu Peng , Can Qin , An Yan , Xinyi Yang , Zeyuan Chen , Ran Xu , Chien-Sheng Wu

Evaluating medical AI systems using expert clinician panels is costly and slow, motivating the use of large language models (LLMs) as alternative adjudicators. Here, we evaluate an LLM jury composed of three frontier AI models scoring 3333…

Thematic analysis (TA) is widely used in health research to extract patterns from patient interviews, yet manual TA faces challenges in scalability and reproducibility. LLM-based automation can help, but existing approaches produce…

Evaluating the quality of search, ranking and RAG systems traditionally requires a significant number of human relevance annotations. In recent times, several deployed systems have explored the usage of Large Language Models (LLMs) as…

Machine Learning · Computer Science 2026-01-27 Abhishek Divekar , Anirban Majumder

Large Language Models (LLMs) are increasingly being deployed as the reasoning engines for agentic AI systems, yet they exhibit a critical flaw: a rigid adherence to explicit rules that leads to decisions misaligned with human common sense…

Artificial Intelligence · Computer Science 2025-10-16 Imran Khan

Large language models (LLMs) have shown impressive potential in helping with numerous medical challenges. Deploying LLMs in high-stakes applications such as medicine, however, brings in many concerns. One major area of concern relates to…

Computation and Language · Computer Science 2025-04-15 Hamed Fayyaz , Raphael Poulain , Rahmatollah Beheshti

Conventional algorithmic trading systems are grounded in deterministic heuristics or offline-trained statistical models that cannot adapt to the semantic complexity of rapidly shifting market regimes. This paper introduces AGENTICAITA, an…

Trading and Market Microstructure · Quantitative Finance 2026-05-14 Ivan Letteri

Recent advances in large language models (LLMs) have enabled promising progress in diagnosis prediction from electronic health records (EHRs). However, existing LLM-based approaches tend to overfit to historically observed diagnoses, often…

Computation and Language · Computer Science 2026-04-14 Hengyu Zhang , Xuyun Zhang , Pengxiang Zhan , Linhao Luo , Hang Lv , Yanchao Tan , Shirui Pan , Carl Yang

The emergence of Large Language Models (LLMs) presents transformative opportunities for education, generating numerous novel application scenarios. However, significant challenges remain: evaluation metrics vary substantially across…

Computers and Society · Computer Science 2025-08-01 Shou'ang Wei , Xinyun Wang , Shuzhen Bi , Jian Chen , Ruijia Li , Bo Jiang , Xin Lin , Min Zhang , Yu Song , BingDong Li , Aimin Zhou , Hao Hao

When addressing professional questions in the biomedical domain, humans typically acquire multiple pieces of information as evidence and engage in multifaceted analysis to provide high-quality answers. Current LLM-based question answering…

Computation and Language · Computer Science 2025-09-03 Chang Zong , Jian Wan , Siliang Tang , Lei Zhang

Adapting Large Language Models in complex technical service domains is constrained by the absence of explicit cognitive chains in human demonstrations and the inherent ambiguity arising from the diversity of valid responses. These…

Tabular data synthesis is crucial in machine learning, yet existing general methods-primarily based on statistical or deep learning models-are highly data-dependent and often fall short in recommender systems. This limitation arises from…

Information Retrieval · Computer Science 2025-02-12 Jingtong Gao , Zhaocheng Du , Xiaopeng Li , Yichao Wang , Xiangyang Li , Huifeng Guo , Ruiming Tang , Xiangyu Zhao

Target trial emulation (TTE) is a popular framework for observational studies based on electronic health records (EHR). A key component of this framework is determining the patient population eligible for inclusion in both a target trial of…

The rapid evolution of neural architectures - from multilayer perceptrons to large-scale Transformer-based models - has enabled language models (LLMs) to exhibit emergent agentic behaviours when equipped with memory, planning, and external…

Artificial Intelligence · Computer Science 2025-09-22 Andrejs Sorstkins , Josh Bailey , Dr Alistair Baron

Despite rapid advances in large language models (LLMs), their integration with traditional supervised machine learning (ML) techniques that have proven applicability to medical data remains underexplored. This is particularly true for…

Computation and Language · Computer Science 2025-05-28 Yuxin Zhu , Yuting Guo , Noah Marchuck , Abeed Sarker , Yun Wang

The exponential growth of scientific literature poses unprecedented challenges for researchers attempting to synthesize knowledge across rapidly evolving fields. We present \textbf{Agentic AutoSurvey}, a multi-agent framework for automated…

Information Retrieval · Computer Science 2025-09-24 Yixin Liu , Yonghui Wu , Denghui Zhang , Lichao Sun

Corpus distillation for biomedical large language models (LLMs) seeks to address the pressing challenge of insufficient quantity and quality in open-source annotated scientific corpora, which remains a bottleneck for effective LLM training…

Computation and Language · Computer Science 2025-12-19 Meng Xiao , Xunxin Cai , Qingqing Long , Chengrui Wang , Yuanchun Zhou , Hengshu Zhu