English
Related papers

Related papers: Beyond Language: Format-Agnostic Reasoning Subspac…

200 papers

Large language models demonstrate strong reasoning capabilities through chain-of-thought prompting, but whether this reasoning quality transfers across languages remains underexplored. We introduce a human-validated framework to evaluate…

Computation and Language · Computer Science 2026-03-31 Anaelia Ovalle , Candace Ross , Sebastian Ruder , Adina Williams , Karen Ullrich , Mark Ibrahim , Levent Sagun

Abstract concepts - justice, theory, availability - have no single perceivable referent; in the human brain, their meaning emerges from a web of experiences, affect, and social context. Do large language models (LLMs) ground abstract…

Computation and Language · Computer Science 2026-05-12 Odysseas S. Chlapanis , Orfeas Menis Mastromichalakis , Christos H. Papadimitriou

Argumentation frameworks ($AF$s) have been extensively developed, but existing higher-order bipolar $AF$s suffer from critical limitations: attackers and supporters are restricted to arguments, multi-valued and fuzzy semantics lack unified…

Logic · Mathematics 2025-12-30 Shuai Tang

While current Automated Essay Scoring (AES) methods demonstrate high scoring agreement with human raters, their decision-making mechanisms are not fully understood. Our proposed method, using counterfactual intervention assisted by Large…

Computation and Language · Computer Science 2024-10-10 Yupei Wang , Renfen Hu , Zhe Zhao

Large Language Models (LLMs) still struggle with multi-step logical reasoning. Existing approaches either purely refine the reasoning chain in natural language form or attach a symbolic solver as an external module. In this work, we instead…

Computation and Language · Computer Science 2026-04-22 Feihao Fang , My T. Thai , Yuanyuan Lei

Large language models (LLMs) often demonstrate strong safety performance in high-resource languages, yet exhibit severe vulnerabilities when queried in low-resource languages. We attribute this gap to a mismatch between language-agnostic…

Machine Learning · Computer Science 2026-04-24 Junxiao Yang , Haoran Liu , Jinzhe Tu , Jiale Cheng , Zhexin Zhang , Shiyao Cui , Jiaqi Weng , Jialing Tao , Hui Xue , Hongning Wang , Han Qiu , Minlie Huang

Large Language Models (LLMs) challenge conventional automated programming assessment because students can now produce functionally correct code without demonstrating corresponding understanding. This paper makes two contributions. First, it…

Software Engineering · Computer Science 2026-04-09 Eduard Frankford , Erik Cikalleshi , Ruth Breu

This paper studies the relationship between the surface form of a mathematical problem and its solvability by large language models. We find that subtle alterations in the surface form can significantly impact the answer distribution and…

Computation and Language · Computer Science 2024-04-18 Yue Zhou , Yada Zhu , Diego Antognini , Yoon Kim , Yang Zhang

Humans naturally interpret numbers non-literally, effortlessly combining context, world knowledge, and speaker intent. We investigate whether large language models (LLMs) interpret numbers similarly, focusing on hyperbole and pragmatic halo…

Computation and Language · Computer Science 2025-06-03 Polina Tsvilodub , Kanishk Gandhi , Haoran Zhao , Jan-Philipp Fränken , Michael Franke , Noah D. Goodman

Despite their remarkable ability to capture linguistic nuances across diverse languages, questions persist regarding the degree of alignment between languages in multilingual embeddings. Drawing inspiration from research on high-dimensional…

Computation and Language · Computer Science 2024-05-24 Basel Mousi , Nadir Durrani , Fahim Dalvi , Majd Hawasly , Ahmed Abdelali

A fundamental challenge in reasoning is navigating hypothetical, counterfactual worlds where logic may conflict with ingrained knowledge. We investigate this frontier for Large Language Models (LLMs) by asking: Can LLMs reason logically…

Recently, Diffusion Large Language Models (DLLMs) have offered high throughput and effective sequential reasoning, making them a competitive alternative to autoregressive LLMs (ALLMs). However, parallel decoding, which enables simultaneous…

Computation and Language · Computer Science 2025-10-13 Qiguang Chen , Hanjing Li , Libo Qin , Dengyun Peng , Jinhao Liu , Jiangyi Wang , Chengyue Wu , Xie Chen , Yantao Du , Wanxiang Che

When copies of the same language model are prompted to debate, they produce diverse phrasings of one perspective rather than diverse perspectives. Multi-agent debate (MAD), and more broadly closed-system reasoning where agents iteratively…

Computation and Language · Computer Science 2026-05-07 Kwan Soo Shin

Face anti-spoofing (FAS) has recently advanced in multimodal fusion, cross-domain generalization, and interpretability. With large language models and reinforcement learning (RL), strategy-based training offers new opportunities to jointly…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Yingjie Ma , Xun Lin , Yong Xu , Weicheng Xie , Zitong Yu

Alignment with high-resource standard languages is often assumed to aid the modeling of related low-resource varieties. We challenge this assumption by demonstrating that excessive representational entanglement with a dominant variety, such…

Computation and Language · Computer Science 2025-08-19 Ahmed Elshabrawy , Hour Kaing , Haiyue Song , Alham Fikri Aji , Hideki Tanaka , Masao Utiyama , Raj Dabre

Structured reasoning over natural language inputs remains a core challenge in artificial intelligence, as it requires bridging the gap between unstructured linguistic expressions and formal logical representations. In this paper, we propose…

Artificial Intelligence · Computer Science 2025-07-14 Keying Yang , Hao Wang , Kai Yang

Large language models demonstrate strong performance on mathematical reasoning benchmarks, yet remain surprisingly fragile to meaning-preserving surface perturbations. We systematically evaluate three open-weight LLMs, Mistral-7B,…

Computation and Language · Computer Science 2026-04-03 Shou-Tzu Han , Rodrigue Rizk , KC Santosh

Understanding whether large language models (LLMs) capture structured meaning requires examining how they represent concept relationships. In this work, we study three models of increasing scale: Pythia-70M, GPT-2, and Llama 3.1 8B,…

Computation and Language · Computer Science 2026-04-01 Andor Diera , Ansgar Scherp

Large language models (LLMs) exhibit emergent behaviors suggestive of human-like reasoning. While recent work has identified structured conceptual representations within these models, it remains unclear whether they functionally rely on…

Computation and Language · Computer Science 2026-04-21 Ningyu Xu , Qi Zhang , Xipeng Qiu , Xuanjing Huang

Large Language Models (LLMs) have been touted as AI models possessing advanced reasoning abilities. However, recent works have shown that LLMs often bypass true reasoning using shortcuts, sparking skepticism. To study the reasoning…

Artificial Intelligence · Computer Science 2024-10-24 Rishi Hazra , Gabriele Venturato , Pedro Zuidberg Dos Martires , Luc De Raedt