English
Related papers

Related papers: Beneath the Surface: Investigating LLMs' Capabilit…

200 papers

Large language models (LLMs) exhibiting test-time scaling behavior, such as extended reasoning traces and self-verification, have demonstrated remarkable performance on complex, long-term reasoning tasks. However, the robustness of these…

Machine Learning · Computer Science 2026-04-02 Gleb Rodionov

Previous work indicates that large language models exhibit a significant "English bias", i.e. they often perform better when tasks are presented in English. Interestingly, we have observed that using certain other languages in reasoning…

Computation and Language · Computer Science 2025-04-17 Changjiang Gao , Xu Huang , Wenhao Zhu , Shujian Huang , Lei Li , Fei Yuan

Visual language is a system of communication that conveys information through symbols, shapes, and spatial arrangements. Diagrams are a typical example of a visual language depicting complex concepts and their relationships in the form of…

Computation and Language · Computer Science 2025-05-27 Yifan Hou , Buse Giledereli , Yilei Tu , Mrinmaya Sachan

This study examines how Large Language Models (LLMs) perform when tackling quantitative management decision problems in a zero-shot setting. Drawing on 900 responses generated by five leading models across 20 diverse managerial scenarios,…

Computation and Language · Computer Science 2025-02-25 Jonathan Kuzmanko

In this work, we study a critical research problem regarding the trustworthiness of large language models (LLMs): how LLMs behave when encountering ambiguous narrative text, with a particular focus on Chinese textual ambiguity. We created a…

Computation and Language · Computer Science 2026-04-17 Xinwei Wu , Haojie Li , Hongyu Liu , Xinyu Ji , Ruohan Li , Yule Chen , Yigeng Zhang

LLMs are increasingly used to support qualitative research, yet existing systems produce outputs that vary widely--from trace-faithful summaries to theory-mediated explanations and system models. To make these differences explicit, we…

Computation and Language · Computer Science 2026-01-21 Xinyu Pi , Qisen Yang , Chuong Nguyen , Hua Shen

Large Language Models (LLMs) have become foundational in modern language-driven software applications, profoundly influencing daily life. A critical technique in leveraging their potential is role-playing, where LLMs simulate diverse roles…

Computers and Society · Computer Science 2026-04-23 Xinyue Li , Zhenpeng Chen , Jie M. Zhang , Ying Xiao , Tianlin Li , Weisong Sun , Yang Liu , Yiling Lou , Xuanzhe Liu

Large language models (LLMs) are increasingly used as epistemic partners in everyday reasoning, yet their errors remain predominantly analyzed through predictive metrics rather than through their interpretive effects on human judgment. This…

Human-Computer Interaction · Computer Science 2025-12-19 Claudia Vale Oliveira , Nelson Zagalo , Filipe Silva , Anabela Brandao , Syeda Faryal Hussain Khurrum , Joaquim Santos

Agentic reinforcement learning increasingly relies on experience-driven scaling, yet real-world environments remain non-adaptive, limited in coverage, and difficult to scale. World models offer a potential way to improve learning efficiency…

Computation and Language · Computer Science 2026-03-06 Yixia Li , Hongru Wang , Jiahao Qiu , Zhenfei Yin , Dongdong Zhang , Cheng Qian , Zeping Li , Pony Ma , Guanhua Chen , Heng Ji

Much of human communication depends on implication, conveying meaning beyond literal words to express a wider range of thoughts, intentions, and feelings. For models to better understand and facilitate human communication, they must be…

Computation and Language · Computer Science 2025-01-20 Shreya Havaldar , Hamidreza Alvari , John Palowitch , Mohammad Javad Hosseini , Senaka Buthpitiya , Alex Fabrikant

Implicit content plays a crucial role in political discourse, where speakers systematically employ pragmatic strategies such as implicatures and presuppositions to influence their audiences. Large Language Models (LLMs) have demonstrated…

Computation and Language · Computer Science 2025-06-10 Walter Paci , Alessandro Panunzi , Sandro Pezzelle

As large language models (LLMs) start interacting with each other and generating an increasing amount of text online, it becomes crucial to better understand how information is transformed as it passes from one LLM to the next. While…

Large language models (LLMs) can perform reasoning computations both internally within their latent space and externally by generating explicit token sequences like chains of thought. Significant progress in enhancing reasoning abilities…

Computation and Language · Computer Science 2025-04-16 Thilo Hagendorff , Sarah Fabi

Large Language Models (LLMs) have become foundational to modern AI agent systems, enabling autonomous agents to reason and plan. In most existing systems, inter-agent communication relies primarily on natural language. While this design…

Artificial Intelligence · Computer Science 2025-06-04 Pengcheng Zhou , Yinglun Feng , Halimulati Julaiti , Zhongliang Yang

In recent years, large language models (LLMs) have made significant advancements in developing human-like and engaging dialogue systems. However, in tasks such as consensus-building and persuasion, LLMs often struggle to resolve conflicts…

Artificial Intelligence · Computer Science 2025-11-14 Zhaoqun Li , Xiaotong Fang , Chen Chen , Mengze Li , Beishui Liao

Human understanding of text depends on general semantic concepts of words rather than their superficial forms. To what extent does our human intuition transfer to language models? In this work, we study the degree to which current…

Computation and Language · Computer Science 2025-11-20 Crystina Zhang , Jing Lu , Vinh Q. Tran , Tal Schuster , Donald Metzler , Jimmy Lin

As large language models (LLMs) increasingly permeate daily lives, there is a growing demand for real-time interactions that mirror human conversations. Traditional turn-based chat systems driven by LLMs prevent users from verbally…

Computation and Language · Computer Science 2026-01-14 Xinrong Zhang , Yingfa Chen , Shengding Hu , Xu Han , Zihang Xu , Yuanwei Xu , Weilin Zhao , Maosong Sun , Zhiyuan Liu

Large Language Models (LLMs) are prone to generating fluent but incorrect content, known as confabulation, which poses increasing risks in multi-turn or agentic applications where outputs may be reused as context. In this work, we…

Computation and Language · Computer Science 2026-03-18 Tianyi Zhou , Johanne Medina , Sanjay Chawla

Large Language Models (LLMs) have demonstrated impressive capabilities in role-playing scenarios, particularly in simulating domain-specific experts using tailored prompts. This ability enables LLMs to adopt the persona of individuals with…

Artificial Intelligence · Computer Science 2025-01-14 Xinyao Ma , Rui Zhu , Zihao Wang , Jingwei Xiong , Qingyu Chen , Haixu Tang , L. Jean Camp , Lucila Ohno-Machado

Driven by vast and diverse textual data, large language models (LLMs) have demonstrated impressive performance across numerous natural language processing (NLP) tasks. Yet, a critical question persists: does their generalization arise from…

Computation and Language · Computer Science 2025-09-08 Boxiang Ma , Ru Li , Yuanlong Wang , Hongye Tan , Xiaoli Li