English
Related papers

Related papers: Internal Representation, Not Clinical Knowledge: W…

200 papers

Sparse Autoencoders (SAEs) are widely used to steer large language models (LLMs), based on the assumption that their interpretable features naturally enable effective model behavior steering. Yet, a fundamental question remains unanswered:…

Machine Learning · Computer Science 2025-10-07 Xu Wang , Yan Hu , Benyou Wang , Difan Zou

Clinical document classification is essential for converting unstructured medical texts into standardised ICD-10 diagnoses, yet it faces challenges due to complex medical language, privacy constraints, and limited annotated datasets. Large…

Computation and Language · Computer Science 2026-02-03 Akram Mustafa , Usman Naseem , Mostafa Rahimi Azghadi

Online health resources and large language models (LLMs) are increasingly used as a first point of contact for medical decision-making, yet their reliability in healthcare remains limited by low accuracy, lack of transparency, and…

Artificial Intelligence · Computer Science 2026-04-22 Yujia Liu , Sophia Yu , Hongyue Jin , Jessica Wen , Alexander Qian , Terrence Lee , Mattheus Ramsis , Gi Won Choi , Lianhui Qin , Xin Liu , Edward J. Wang

Sparse autoencoders (SAEs) improve interpretability in multimodal models, but it remains unclear whether SAE features form modular, composable units for reasoning-an assumption underlying many intervention-based steering methods. We test…

Artificial Intelligence · Computer Science 2026-03-27 Yunpeng Zhou

Self-evaluation using large language models (LLMs) has proven valuable not only in benchmarking but also methods like reward modeling, constitutional AI, and self-refinement. But new biases are introduced due to the same LLM acting as both…

Computation and Language · Computer Science 2024-04-23 Arjun Panickssery , Samuel R. Bowman , Shi Feng

Large language models (LLMs) are increasingly used in emotionally sensitive human-AI applications, yet little is known about how emotion recognition is internally represented. In this work, we investigate the internal mechanisms of emotion…

Computation and Language · Computer Science 2026-04-29 Bangzhao Shu , Arinjay Singh , Mai ElSherief

Edge applications increasingly demand custom hardware, yet Field-Programmable Gate Array (FPGA) design requires expertise that domain engineers lack. Large Language Models (LLMs) promise to bridge this gap through zero-knowledge hardware…

Hardware Architecture · Computer Science 2026-04-21 Weimin Fu , Zeng Wang , Minghao Shao , Johann Knechtel , Ozgur Sinanoglu , Ramesh Karri , Muhammad Shafique , Xiaolong Guo

Deterministically controlling the target generation language of large multilingual language models (LLMs) remains a fundamental challenge, particularly in zero-shot settings where neither explicit language prompts nor fine-tuning are…

Computation and Language · Computer Science 2025-10-17 Cheng-Ting Chou , George Liu , Jessica Sun , Cole Blondin , Kevin Zhu , Vasu Sharma , Sean O'Brien

Recent developments in Large Language Model (LLM) capabilities have brought great potential but also posed new risks. For example, LLMs with knowledge of bioweapons, advanced chemistry, or cyberattacks could cause violence if placed in the…

Machine Learning · Computer Science 2025-03-17 Matthew Khoriaty , Andrii Shportko , Gustavo Mercier , Zach Wood-Doughty

Large language models (LLMs) are now ubiquitous in user-facing applications, yet they still generate undesirable toxic outputs, including profanity, vulgarity, and derogatory remarks. Although numerous detoxification methods exist, most…

Computation and Language · Computer Science 2025-10-24 Agam Goyal , Vedant Rathi , William Yeh , Yian Wang , Yuen Chen , Hari Sundaram

LLMs have marked a revolutonary shift, yet they falter when faced with compositional reasoning tasks. Our research embarks on a quest to uncover the root causes of compositional reasoning failures of LLMs, uncovering that most of them stem…

Computation and Language · Computer Science 2024-06-07 Zhaoyi Li , Gangwei Jiang , Hong Xie , Linqi Song , Defu Lian , Ying Wei

Research on emergency and mass casualty incident (MCI) triage has been limited by the absence of openly usable, reproducible benchmarks. Yet these scenarios demand rapid identification of the patients most in need, where accurate…

Machine Learning · Computer Science 2026-03-31 Joshua Sebastian , Karma Tobden , KMA Solaiman

Large language models (LLMs) exhibit strikingly conflicting behaviors: they can appear steadfastly overconfident in their initial answers whilst at the same time being prone to excessive doubt when challenged. To investigate this apparent…

The standard sparse-autoencoder (SAE) interpretability protocol labels each feature from its top-activating contexts and validates by single-feature steering. We propose the pairwise matrix protocol, co-varying steering coefficient with…

Machine Learning · Computer Science 2026-05-06 Michael A. Riegler , Birk Sebastian Frostelid Torpmann-Hagen

Despite the wide adoption of Large Language Models (LLM)s, clinical decision support systems face a critical challenge: achieving high predictive accuracy while generating explanations aligned with the predictions. Current approaches suffer…

Artificial Intelligence · Computer Science 2026-05-07 H M Quamran Hasan , Housam Khalifa Bashier , Jiayi Dai , Mi-Young Kim , Randy Goebel

Recent advances in Large Language Models (LLMs) have brought significant improvements to various service domains, including chatbots and medical pre-consultation applications. In the healthcare domain, the most common approach for adapting…

Computation and Language · Computer Science 2025-10-07 Seungseop Lim , Gibaeg Kim , Wooseok Han , Jean Seo , Hyunkyung Lee , Jaehyo Yoo , Eunho Yang

Recent studies have demonstrated that large language models (LLMs) exhibit significant biases in evaluation tasks, particularly in preferentially rating and favoring self-generated content. However, the extent to which this bias manifests…

Computation and Language · Computer Science 2025-12-09 Yen-Shan Chen , Jing Jin , Peng-Ting Kuo , Chao-Wei Huang , Yun-Nung Chen

Performance of Large Language Models (LLMs) on multiple-choice tasks differs markedly between symbol-based and cloze-style evaluation formats. The observed discrepancies are systematically attributable to task characteristics: natural…

Computation and Language · Computer Science 2026-02-02 Joonhak Lee , Sungmok Jung , Jongyeon Park , Jaejin Lee

The rise of multimodal large language models (MLLMs) has sparked an unprecedented wave of applications in the field of medical imaging analysis. However, as one of the earliest and most fundamental tasks integrated into this paradigm,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Xun Zhu , Fanbin Mo , Xi Chen , Kaili Zheng , Shaoshuai Yang , Yiming Shi , Jian Gao , Miao Li , Ji Wu

Large language models can be uncertain yet correct, or confident yet wrong, raising the question of whether their output-level uncertainty and their actual correctness are driven by the same internal mechanisms or by distinct feature…

Machine Learning · Computer Science 2026-04-23 Het Patel , Tiejin Chen , Hua Wei , Evangelos E. Papalexakis , Jia Chen