English
Related papers

Related papers: No Universal Prompt: Unifying Reasoning through Ad…

200 papers

Reasoning about time and temporal relations is an integral aspect of human cognition, essential for perceiving the world and navigating our experiences. Though large language models (LLMs) have demonstrated impressive performance in many…

Computation and Language · Computer Science 2024-11-19 Xinliang Frederick Zhang , Nick Beauchamp , Lu Wang

Tabular reasoning involves interpreting natural language queries about tabular data, which presents a unique challenge of combining language understanding with structured data analysis. Existing methods employ either textual reasoning,…

Databases · Computer Science 2025-04-08 Nikhil Abhyankar , Vivek Gupta , Dan Roth , Chandan K. Reddy

Recent works on large language models (LLMs) have demonstrated the impact of prompting strategies and fine-tuning techniques on their reasoning capabilities. Yet, their effectiveness on clinical natural language inference (NLI) remains…

Computation and Language · Computer Science 2025-07-08 Mael Jullien , Marco Valentino , Leonardo Ranaldi , Andre Freitas

Recent advances in large language models (LLMs) have accelerated progress toward artificial general intelligence, with inference-time scaling emerging as a key technique. Contemporary approaches leverage either sequential reasoning…

Computation and Language · Computer Science 2025-07-10 Zenan Xu , Zexuan Qiu , Guanhua Huang , Kun Li , Siheng Li , Chenchen Zhang , Kejiao Li , Qi Yi , Yuhao Jiang , Bo Zhou , Fengzong Lian , Zhanhui Kang

Building upon large language models (LLMs), recent large multimodal models (LMMs) unify cross-model understanding and generation into a single framework. However, LMMs still struggle to achieve accurate vision-language alignment, prone to…

Artificial Intelligence · Computer Science 2025-09-09 Jixiang Hong , Yiran Zhang , Guanzhong Wang , Yi Liu , Ji-Rong Wen , Rui Yan

Mathematical reasoning is a primary indicator of large language models (LLMs) intelligence. However, existing LLMs exhibit failures of robustness and generalization. This paper attributes these deficiencies to spurious reasoning, i.e.,…

Artificial Intelligence · Computer Science 2025-10-14 Zhejian Lai , Xiang Geng , Zhijun Wang , Yang Bai , Jiahuan Li , Rongxiang Weng , Jingang Wang , Xuezhi Cao , Xunliang Cai , Shujian Huang

Reasoning-oriented Large Language Models (LLMs) have achieved remarkable progress with Chain-of-Thought (CoT) prompting, yet they remain fundamentally limited by a \emph{blind self-thinking} paradigm: performing extensive internal reasoning…

Computation and Language · Computer Science 2026-05-29 Xin Chen , Feng Jiang , Yiqian Zhang , Hardy Chen , Shuo Yan , Wenya Xie , Min Yang , Shujian Huang

Prompt optimization has become a practical way to improve the performance of Large Language Models (LLMs) without retraining. However, most existing frameworks treat evaluation as a black box, relying solely on outcome scores without…

Multiagent Systems · Computer Science 2026-04-01 Wonduk Seo , Juhyeon Lee , Junseo Koh , Wonseok Choi , Hyunjin An , Jian Park , Seunghyun lee , Haihua Chen , Yi Bu

Recent large reasoning models (LRMs) have made substantial progress in complex reasoning tasks, yet they often generate lengthy reasoning paths for every query, incurring unnecessary computation and latency. Existing speed-up approaches…

Computation and Language · Computer Science 2026-01-08 Zhaofeng Zhong , Wei Yuan , Tong Chen , Xiangyu Zhao , Quoc Viet Hung Nguyen , Hongzhi Yin

We introduce Meta-Reasoning Prompting (MRP), a novel and efficient system prompting method for large language models (LLMs) inspired by human meta-reasoning. Traditional in-context learning-based reasoning techniques, such as…

Computation and Language · Computer Science 2024-06-18 Peizhong Gao , Ao Xie , Shaoguang Mao , Wenshan Wu , Yan Xia , Haipeng Mi , Furu Wei

Scaling inference-time computation has substantially improved the reasoning capabilities of language models. However, existing methods have significant limitations: serialized chain-of-thought approaches generate overly long outputs,…

Artificial Intelligence · Computer Science 2025-08-19 Jiayi Pan , Xiuyu Li , Long Lian , Charlie Snell , Yifei Zhou , Adam Yala , Trevor Darrell , Kurt Keutzer , Alane Suhr

Prompting has become a practical method for utilizing pre-trained language models (LMs). This approach offers several advantages. It allows an LM to adapt to new tasks with minimal training and parameter updates, thus achieving efficiency…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-26 Kai-Wei Chang , Haibin Wu , Yu-Kai Wang , Yuan-Kuei Wu , Hua Shen , Wei-Cheng Tseng , Iu-thing Kang , Shang-Wen Li , Hung-yi Lee

Large language models (LLMs) exhibit strong reasoning capabilities when guided by high-quality demonstrations, yet such data is often distributed across organizations that cannot centralize it due to regulatory, proprietary, or…

Computation and Language · Computer Science 2026-05-13 Ruhan Wang , Chengkai Huang , Zhiyong Wang , Junda Wu , Rui Wang , Tong Yu , Julian McAuley , Lina Yao , Dongruo Zhou

Large Language Models (LLMs) have made notable progress in mathematical reasoning, yet often rely on single-paradigm reasoning, limiting their effectiveness across diverse tasks. We introduce Chain-of-Reasoning (CoR), a novel unified…

Table Structure Recognition (TSR) requires the logical reasoning ability of large language models (LLMs) to handle complex table layouts, but current datasets are limited in scale and quality, hindering effective use of this reasoning…

Databases · Computer Science 2026-04-16 Ruilin Zhang , Kai Yang

The inherent capabilities of a language model (LM) and the reasoning strategies it employs jointly determine its performance in reasoning tasks. While test-time scaling is regarded as an effective approach to tackling complex reasoning…

Computation and Language · Computer Science 2025-05-27 Zhihong Pan , Kai Zhang , Yuze Zhao , Yupeng Han

Although Large Language Models (LLMs) excel at addressing straightforward reasoning tasks, they frequently struggle with difficulties when confronted by more complex multi-step reasoning due to a range of factors. Firstly, natural language…

Computation and Language · Computer Science 2024-02-22 Kewei Cheng , Nesreen K. Ahmed , Theodore Willke , Yizhou Sun

Large Language Models (LLMs) have demonstrated remarkable reasoning capabilities under the widely adopted SFT+RLVR paradigm, which first performs Supervised Fine-Tuning (SFT) on human-annotated reasoning trajectories (rationales) to…

Computation and Language · Computer Science 2025-10-15 Chaoxu Pang , Yixuan Cao , Ping Luo

The paradigm of large language model (LLM) reasoning is shifting from parameter scaling to test-time compute scaling, yet many existing approaches still rely on uniform brute-force sampling (for example, fixed best-of-N or self-consistency)…

Artificial Intelligence · Computer Science 2026-03-02 Siyuan Ma , Bo Gao , Xiaojun Jia , Simeng Qin , Tianlin Li , Ke Ma , Xiaoshuang Jia , Wenqi Ren , Yang Liu

Recent advances in large language models (LLMs) have propelled research in natural language interfaces to databases. However, most state-of-the-art text-to-SQL systems still depend on complex, multi-stage pipelines. This work proposes a…

Artificial Intelligence · Computer Science 2025-06-03 Fernando Granado , Roberto Lotufo , Jayr Pereira