English
Related papers

Related papers: Intention Collapse: Intention-Level Metrics for Re…

200 papers

Test-time scaling has emerged as a widely adopted inference-time strategy for boosting reasoning performance. However, its effectiveness has been studied almost exclusively in English, leaving its behavior in other languages largely…

Computation and Language · Computer Science 2025-05-22 Prasoon Bajpai , Tanmoy Chakraborty

Large Language Models (LLMs) have achieved remarkable success in tasks requiring complex reasoning, such as code generation, mathematical problem solving, and algorithmic synthesis -- especially when aided by reasoning tokens and…

Computation and Language · Computer Science 2025-06-13 Jaechul Roh , Varun Gandhi , Shivani Anilkumar , Arin Garg

Voice-controlled dialog systems have become immensely popular due to their ability to perform a wide range of actions in response to diverse user queries. These agents possess a predefined set of skills or intents to fulfill specific user…

Computation and Language · Computer Science 2026-03-17 Ankan Mullick , Sukannya Purkayastha , Saransh Sharma , Pawan Goyal , Niloy Ganguly

Recursive learning -- where models are trained on data generated by previous versions of themselves -- is increasingly common in large language models, autonomous agents, and self-supervised systems. However, standard performance metrics…

Machine Learning · Computer Science 2026-05-20 Zhipeng Zhang

Aligning large language models (LLMs) with human values, particularly when facing complex and stealthy jailbreak attacks, presents a formidable challenge. Unfortunately, existing methods often overlook this intrinsic nature of jailbreaks,…

Computation and Language · Computer Science 2024-12-17 Yuqi Zhang , Liang Ding , Lefei Zhang , Dacheng Tao

Recent advancements in large language models have showcased their remarkable generalizability across various domains. However, their reasoning abilities still have significant room for improvement, especially when confronted with scenarios…

Computation and Language · Computer Science 2024-03-27 Xufeng Zhao , Mengdi Li , Wenhao Lu , Cornelius Weber , Jae Hee Lee , Kun Chu , Stefan Wermter

Large Language Models (LLMs) are increasingly deployed in medical settings, yet their sensitivity to prompt formatting remains poorly characterized. We evaluate MedGemma (4B and 27B parameters) on MedMCQA (4,183 questions) and PubMedQA…

Computation and Language · Computer Science 2026-03-30 Binesh Sadanandan , Vahid Behzadan

Stance detection aims to identify the attitude expressed in a document towards a given target. Techniques such as Chain-of-Thought (CoT) prompting have advanced this task, enhancing a model's reasoning capabilities through the derivation of…

Computation and Language · Computer Science 2023-09-08 Kairui Hu , Ming Yan , Joey Tianyi Zhou , Ivor W. Tsang , Wen Haw Chong , Yong Keong Yap

Decoding speaker's intent is a crucial part of spoken language understanding (SLU). The presence of noise or errors in the text transcriptions, in real life scenarios make the task more challenging. In this paper, we address the spoken…

Computation and Language · Computer Science 2019-10-24 Prashanth Gurunath Shivakumar , Mu Yang , Panayiotis Georgiou

Intent Classification (IC) and Slot Labeling (SL) models, which form the basis of dialogue systems, often encounter noisy data in real-word environments. In this work, we investigate how robust IC/SL models are to noisy data. We collect and…

Computation and Language · Computer Science 2021-11-03 Sailik Sengupta , Jason Krone , Saab Mansour

Hallucinations in Large Language Models (LLMs) -- generations that are plausible but factually unfaithful -- remain a critical barrier to high-stakes deployment. Current detection methods typically rely on computationally expensive external…

Artificial Intelligence · Computer Science 2026-01-23 Manish Bhatt

Natural language understanding (NLU) has two core tasks: intent classification and slot filling. The success of pre-training language models resulted in a significant breakthrough in the two tasks. One of the promising solutions called BERT…

Computation and Language · Computer Science 2023-02-03 Yu Guo , Zhilong Xie , Xingyan Chen , Huangen Chen , Leilei Wang , Huaming Du , Shaopeng Wei , Yu Zhao , Qing Li , Gang Wu

As chain-of-thought (CoT) has become central to scaling reasoning capabilities in large language models (LLMs), it has also emerged as a promising tool for interpretability, suggesting the opportunity to understand model decisions through…

Artificial Intelligence · Computer Science 2026-03-03 Kyle Cox , Darius Kianersi , Adrià Garriga-Alonso

Large language models (LLMs) have shown strong performance across natural language reasoning tasks, yet their reasoning processes remain brittle and difficult to interpret. Prompting techniques like Chain-of-Thought (CoT) enhance…

Computation and Language · Computer Science 2025-08-01 Samir Abdaljalil , Hasan Kurban , Khalid Qaraqe , Erchin Serpedin

Recent advancements in large language models (LLMs) have significantly advanced complex reasoning capabilities, particularly through extended chain-of-thought (CoT) reasoning that incorporates mechanisms such as backtracking,…

Computation and Language · Computer Science 2025-10-21 Baohao Liao , Xinyi Chen , Sara Rajaee , Yuhui Xu , Christian Herold , Anders Søgaard , Maarten de Rijke , Christof Monz

Do reasoning models have "Aha!" moments? Prior work suggests that models like DeepSeek-R1-Zero undergo sudden mid-trace realizations that lead to accurate outputs, implying an intrinsic capacity for self-correction. Yet, it remains unclear…

Artificial Intelligence · Computer Science 2026-04-21 Liv G. d'Aliberti , Manoel Horta Ribeiro

We present ChatR1, a reasoning framework based on reinforcement learning (RL) for conversational question answering (CQA). Reasoning plays an important role in CQA, where user intent evolves across dialogue turns, and utterances are often…

Computation and Language · Computer Science 2026-04-28 Simon Lupart , Mohammad Aliannejadi , Evangelos Kanoulas

Large language models achieve strong performance on many complex reasoning tasks, yet their accuracy degrades sharply on benchmarks that require compositional reasoning, including ARC-AGI-2, GPQA, MATH, BBH, and HLE. Existing methods…

Artificial Intelligence · Computer Science 2026-02-18 Sarim Chaudhry

Large language models frequently exhibit hallucinations: fluent and confident outputs that are factually incorrect or unsupported by the input context. While recent hallucination detection methods have explored various features derived from…

Computation and Language · Computer Science 2026-04-14 Jakub Binkowski , Kamil Adamczewski , Tomasz Kajdanowicz

Open reasoning language models are often compared under mixed sample sizes, partially standardized prompts, and accuracy-centered summaries, which makes practical model selection difficult to interpret. We present a unified evaluation of…

Computation and Language · Computer Science 2026-05-20 Md Motaleb Hossen Manik , Ge Wang