English
Related papers

Related papers: H-DDx: A Hierarchical Evaluation Framework for Dif…

200 papers

Universal healthcare access is critically needed, especially in resource-limited settings. Large Language Models (LLMs) offer promise for democratizing healthcare with advanced diagnostics, but their reliability requires thorough…

Computation and Language · Computer Science 2025-03-17 Krishna Subedi

Assigning a set of labels to a given text is a classification problem with many real-world applications, such as recommender systems. Two separate research streams address this issue. Hierarchical Text Classification (HTC) focuses on…

Computation and Language · Computer Science 2026-01-27 Nerijus Bertalis , Paul Granse , Ferhat Gül , Florian Hauss , Leon Menkel , David Schüler , Tom Speier , Lukas Galke , Ansgar Scherp

Background: Recent advancements in large language models (LLMs) offer potential benefits in healthcare, particularly in processing extensive patient records. However, existing benchmarks do not fully assess LLMs' capability in handling…

The rapid advancement of large language models (LLMs) in biological-medical applications has highlighted a gap between their potential and the limited scale and often low quality of available open-source annotated textual datasets. In…

Computation and Language · Computer Science 2025-12-19 Xunxin Cai , Chengrui Wang , Qingqing Long , Yuanchun Zhou , Meng Xiao

Speech disfluency modeling is the bottleneck for both speech therapy and language learning. However, there is no effective AI solution to systematically tackle this problem. We solidify the concept of disfluent speech and disfluent speech…

Computation and Language · Computer Science 2024-01-23 Jiachen Lian , Gopala Anumanchipalli

Large Language Models (LLMs) are increasingly serving as evaluators in Natural Language Generation (NLG) tasks; this is often referred to as ``LLM-as-a-judge'' paradigm. However, the capabilities of LLMs in evaluating NLG quality remain…

Computation and Language · Computer Science 2025-02-26 Yicheng Wang , Jiayi Yuan , Yu-Neng Chuang , Zhuoer Wang , Yingchi Liu , Mark Cusick , Param Kulkarni , Zhengping Ji , Yasser Ibrahim , Xia Hu

With the rapid advancement of Large Language Models (LLMs), there is an increasing need for challenging benchmarks to evaluate their capabilities in handling complex tabular data. However, existing benchmarks are either based on outdated…

Computation and Language · Computer Science 2025-12-16 Pengzuo Wu , Yuhang Yang , Guangcheng Zhu , Chao Ye , Hong Gu , Xu Lu , Ruixuan Xiao , Bowen Bao , Yijing He , Liangyu Zha , Wentao Ye , Junbo Zhao , Haobo Wang

Long-form mental health assessments pose unique challenges for large language models (LLMs), which often exhibit hallucinations or inconsistent reasoning when handling extended, domain-specific contexts. We introduce Stacked Multi-Model…

Computation and Language · Computer Science 2025-09-22 Jinwen Tang , Qiming Guo , Wenbo Sun , Yi Shang

With the unprecedented advancements in Large Language Models (LLMs), their application domains have expanded to include code generation tasks across various programming languages. While significant progress has been made in enhancing LLMs…

Software Engineering · Computer Science 2024-06-10 Prashanth Vijayaraghavan , Luyao Shi , Stefano Ambrogio , Charles Mackin , Apoorva Nitsure , David Beymer , Ehsan Degan

Large language models (LLMs) have achieved strong performance on medical exam-style tasks, motivating growing interest in their deployment in real-world clinical settings. However, clinical decision-making is inherently safety-critical,…

Computation and Language · Computer Science 2026-04-13 Xiaohan Ren , Chenxiao Fan , Wenyin Ma , Hongliang He , Chongming Gao , Xiaoyan Zhao , Fuli Feng

Large Language Models (LLMs) have attracted significant attention in recommender systems for their excellent world knowledge capabilities. However, existing methods that rely on Euclidean space struggle to capture the rich hierarchical…

Information Retrieval · Computer Science 2025-04-22 Wentao Cheng , Zhida Qin , Zexue Wu , Pengzhan Zhou , Tianyu Huang

Can the rapid advances in code generation, function calling, and data analysis using large language models (LLMs) help automate the search and verification of hypotheses purely from a set of provided datasets? To evaluate this question, we…

Cognitive Diagnosis Models (CDMs) are a special family of discrete latent variable models that are widely used in modern educational, psychological, social and biological sciences. A key component of CDMs is a binary $Q$-matrix…

Methodology · Statistics 2025-01-08 Chenchen Ma , Gongjun Xu

Large Language Models (LLMs) offer natural language explanations as an alternative to feature attribution methods for model interpretability. However, despite their plausibility, they may not reflect the model's true reasoning faithfully.…

Computation and Language · Computer Science 2025-12-29 Kerem Zaman , Shashank Srivastava

Large language models (LLMs) are increasingly used to support the analysis of complex financial disclosures, yet their reliability, behavioral consistency, and transparency remain insufficiently understood in high-stakes settings. This…

Computation and Language · Computer Science 2026-01-21 Md Talha Mohsin

Large language models (LLMs) have shown potential in assisting scientific research, yet their ability to discover high-quality research hypotheses remains unexamined due to the lack of a dedicated benchmark. To address this gap, we…

Computation and Language · Computer Science 2026-04-21 Yujie Liu , Zonglin Yang , Tong Xie , Jinjie Ni , Ben Gao , Yuqiang Li , Shixiang Tang , Wanli Ouyang , Erik Cambria , Dongzhan Zhou

Large Language Models (LLMs) are important tools for reasoning and problem-solving, while they often operate passively, answering questions without actively discovering new ones. This limitation reduces their ability to simulate human-like…

Computational Engineering, Finance, and Science · Computer Science 2025-09-26 Hong Su

Building trustworthy clinical AI systems requires not only accurate predictions but also transparent, biologically grounded explanations. We present \texttt{DiagnoLLM}, a hybrid framework that integrates Bayesian deconvolution, eQTL-guided…

Artificial Intelligence · Computer Science 2025-11-18 Bowen Xu , Xinyue Zeng , Jiazhen Hu , Tuo Wang , Adithya Kulkarni

Objective: Electronic health records (EHR) data are prone to missingness and errors. Previously, we devised an "enriched" chart review protocol where a "roadmap" of auxiliary diagnoses (anchors) was used to recover missing values in EHR…

Machine Learning · Computer Science 2025-10-07 Sarah C. Lotspeich , Abbey Collins , Brian J. Wells , Ashish K. Khanna , Joseph Rigdon , Lucy D'Agostino McGowan

Drug repurposing is often framed as a candidate identification task, but existing approaches provide limited guidance for distinguishing biologically plausible candidates from historically well-connected ones. Here we introduce DrugKLM, a…

‹ Prev 1 4 5 6 7 8 10 Next ›