English
Related papers

Related papers: Reliability of Large Language Model Generated Clin…

200 papers

Fine-tuning Large Language Models (LLMs) with reinforcement learning to produce an explicit Chain-of-Thought (CoT) before answering produces models that consistently raise overall performance on code, math, and general-knowledge benchmarks.…

Computation and Language · Computer Science 2025-08-25 Arne Vanhoyweghen , Brecht Verbeken , Andres Algaba , Vincent Ginis

Large language models (LLMs) have recently attracted considerable interest for their ability to perform complex reasoning tasks, such as chain-of-thought (CoT) reasoning. However, most of the existing approaches to enhance this ability rely…

Computation and Language · Computer Science 2024-08-08 Xinyi Wang , Lucas Caccia , Oleksiy Ostapenko , Xingdi Yuan , William Yang Wang , Alessandro Sordoni

Chain of Thought (CoT) was introduced in recent research as a method for improving step-by-step reasoning in Large Language Models. However, CoT has limited applications such as its need for hand-crafted few-shot exemplar prompts and no…

Computation and Language · Computer Science 2024-12-11 Arda Sevinc , Abdurrahman Gumus

The rapid advancement of large language models (LLMs) calls for a rigorous theoretical framework to explain their empirical success. While significant progress has been made in understanding LLM behaviors, existing theoretical frameworks…

Machine Learning · Computer Science 2025-05-22 Jun Wan , Lingrui Mei

Chain-of-Thought (CoT) prompting has emerged as a foundational technique for eliciting reasoning from Large Language Models (LLMs), yet the robustness of this approach to corruptions in intermediate reasoning steps remains poorly…

Computation and Language · Computer Science 2026-04-20 Ashwath Vaithinathan Aravindan , Mayank Kejriwal

Machine Translation (MT) plays a pivotal role in cross-lingual information access, public policy communication, and equitable knowledge dissemination. However, critical meaning errors, such as factual distortions, intent reversals, or…

Computation and Language · Computer Science 2026-02-13 Muskaan Chopra , Lorenz Sparrenberg , Rafet Sifa

The purpose of this study is to assess how large language models (LLMs) can be used for fact-checking and contribute to the broader debate on the use of automated means for veracity identification. To achieve this purpose, we use AI…

Computation and Language · Computer Science 2025-03-12 Elizaveta Kuznetsova , Ilaria Vitulano , Mykola Makhortykh , Martha Stolze , Tomas Nagy , Victoria Vziatysheva

Recent advances in large language models (LLMs) have fueled the vision of automated scientific discovery, often called AI Co-Scientists. To date, prior work casts these systems as generative co-authors responsible for crafting hypotheses,…

Computation and Language · Computer Science 2025-05-20 Guijin Son , Jiwoo Hong , Honglu Fan , Heejeong Nam , Hyunwoo Ko , Seungwon Lim , Jinyeop Song , Jinha Choi , Gonçalo Paulo , Youngjae Yu , Stella Biderman

Large language models (LLMs) are currently aligned using techniques such as reinforcement learning from human feedback (RLHF). However, these methods use scalar rewards that can only reflect user preferences on average. Pluralistic…

Computation and Language · Computer Science 2025-08-13 Jadie Adams , Brian Hu , Emily Veenhuis , David Joy , Bharadwaj Ravichandran , Aaron Bray , Anthony Hoogs , Arslan Basharat

Chain-of-thought (CoT) monitoring has been proposed as a promising safety mechanism for detecting misaligned behavior in large language models. However, its reliability remains largely unexplored beyond English and across diverse model…

Computation and Language · Computer Science 2026-05-28 Eric Onyame , Runtao Zhou , Kowshik Thopalli , Bhavya Kailkhura , Chirag Agarwal

Test-time scaling has enabled Large Language Models (LLMs) to tackle complex reasoning, yet the limitations of current Chain-of-Thought (CoT) evaluation obscures whether performance gains stem from genuine reasoning or mere verbosity. To…

Artificial Intelligence · Computer Science 2026-01-08 Zhizhang Fu , Yuancheng Gu , Chenkai Hu , Hanmeng Liu , Yue Zhang

Large language models (LLMs), including zero-shot and few-shot paradigms, have shown promising capabilities in clinical text generation. However, real-world applications face two key challenges: (1) patient data is highly unstructured,…

Computation and Language · Computer Science 2025-07-10 Garapati Keerthana , Manik Gupta

Recently, data-driven task-oriented dialogue systems have achieved promising performance in English. However, developing dialogue systems that support low-resource languages remains a long-standing challenge due to the absence of…

Computation and Language · Computer Science 2019-11-22 Zihan Liu , Genta Indra Winata , Zhaojiang Lin , Peng Xu , Pascale Fung

Cancer clinical trials often face challenges in recruitment and engagement due to a lack of participant-facing informational and educational resources. This study investigated the potential of Large Language Models (LLMs), specifically…

Unit testing is essential for verifying the functional correctness of code modules (e.g., classes, methods), but manually writing unit tests is often labor-intensive and time-consuming. Unit tests generated by tools that employ traditional…

Software Engineering · Computer Science 2026-02-13 Alex Chudic , Gül Çalıklı

The growing demand for cognitive remediation therapy, combined with limited speech therapist availability, has accelerated the adoption of remote rehabilitation tools. These systems generate large volumes of interaction data that are…

Computation and Language · Computer Science 2026-05-08 Yongxin Zhou , Fabien Ringeval , François Portet

Prompting strategies affect LLM reasoning performance, but their role in chart-based QA remains underexplored. We present a systematic evaluation of four widely used prompting paradigms (Zero-Shot, Few-Shot, Zero-Shot Chain-of-Thought, and…

Computation and Language · Computer Science 2026-03-25 Ruthuparna Naikar , Ying Zhu

This work introduces Symbolic-Aided Chain-of-Thought (CoT), an improved approach to standard CoT, for logical reasoning in large language models (LLMs). The key idea is to integrate lightweight symbolic representations into few-shot…

Artificial Intelligence · Computer Science 2025-10-07 Phuong Minh Nguyen , Tien Huu Dang , Naoya Inoue

In this study, we investigate the use of large language models (LLMs), specifically ChatGPT, for structured deductive qualitative coding. While most current research emphasizes inductive coding applications, we address the underexplored…

Human-Computer Interaction · Computer Science 2025-07-22 Angjelin Hila , Elliott Hauser

Large Language Models (LLMs) rely on various decoding strategies to generate text, and these choices can significantly affect output quality. In healthcare, where accuracy is critical, the impact of decoding strategies remains…

Computation and Language · Computer Science 2025-08-20 Oriana Presacan , Alireza Nik , Vajira Thambawita , Bogdan Ionescu , Michael Riegler