English
Related papers

Related papers: AdaCtrl: Towards Adaptive and Controllable Reasoni…

200 papers

Due to complexity and dynamics of construction work, resource, and cash flows, poor management of them usually leads to time and cost overruns, bankruptcy, even project failure. Existing approaches in construction failed to achieve optimal…

Artificial Intelligence · Computer Science 2023-08-17 Can Jiang , Xin Li , Jia-Rui Lin , Ming Liu , Zhiliang Ma

Ensuring safe and contextually appropriate behaviour in Large Language Models (LLMs) remains a critical challenge for real-world deployment. We present \textbf{SafeCtrl-RL}, an inference-time behavioural control framework that enables…

Computation and Language · Computer Science 2026-05-26 Michael Orme , Yanchao Yu , Zhiyuan Tan

Recent advancements in Large Language Models (LLMs) have significantly enhanced their ability to perform complex reasoning tasks, transitioning from fast and intuitive thinking (System 1) to slow and deep reasoning (System 2). While System…

Computation and Language · Computer Science 2025-04-01 Rui Wang , Hongru Wang , Boyang Xue , Jianhui Pang , Shudong Liu , Yi Chen , Jiahao Qiu , Derek Fai Wong , Heng Ji , Kam-Fai Wong

Large Language Models (LLMs) solve many reasoning tasks via chain-of-thought (CoT) prompting, but smaller models (about 7 to 8B parameters) still struggle with multi-step reasoning under tight compute and token budgets. Existing test time…

Computation and Language · Computer Science 2026-04-29 Sagnik Chatterjee , Atharva Patil , Sricharan Ramesh

Large reasoning models (LRMs) achieve strong mathematical reasoning performance in English, but remain much less reliable in many low- and medium-resource languages. This gap is often explained as a failure to understand non-English problem…

Computation and Language · Computer Science 2026-05-28 Jiaqiao Zhang , Zhoujun Li , Raoyuan Zhao , Jian Lan , Thomas Seidl , Michael A. Hedderich , Hinrich Schütze , Yihong Liu

Large Language Models (LLMs) have demonstrated impressive reasoning capabilities, yet their performance is highly dependent on the prompting strategy and model scale. While reinforcement learning and fine-tuning have been deployed to boost…

Artificial Intelligence · Computer Science 2025-02-10 Tushar Pandey , Ara Ghukasyan , Oktay Goktas , Santosh Kumar Radha

The reasoning pattern of Large language models (LLMs) remains opaque, and Reinforcement learning (RL) typically applies uniform credit across an entire generation, blurring the distinction between pivotal and routine steps. This work…

Computation and Language · Computer Science 2025-10-16 Yang Li , Zhichen Dong , Yuhan Sun , Weixun Wang , Shaopan Xiong , Yijia Luo , Jiashun Liu , Han Lu , Jiamang Wang , Wenbo Su , Bo Zheng , Junchi Yan

While Large Language Models (LLMs) have significantly advanced code generation efficiency, they face inherent challenges in balancing performance and inference costs across diverse programming tasks. Dynamically selecting the optimal LLM…

Software Engineering · Computer Science 2025-06-13 Junhang Cheng , Fang Liu , Chengru Wu , Li Zhang

We propose an adversarial deep reinforcement learning (ADRL) algorithm for high-dimensional stochastic control problems. Inspired by the information relaxation duality, ADRL reformulates the control problem as a min-max optimization between…

Optimization and Control · Mathematics 2025-07-03 Nan Chen , Mengzhou Liu , Xiaoyan Wang , Nanyi Zhang

Large Language Models (LLMs) have demonstrated impressive capabilities in reasoning tasks, yet their reliance on static prompt structures and limited adaptability to complex scenarios remains a significant challenge. In this paper, we…

Artificial Intelligence · Computer Science 2025-07-09 Chengkun Cai , Xu Zhao , Haoliang Liu , Zhongyu Jiang , Tianfang Zhang , Zongkai Wu , Jenq-Neng Hwang , Lei Li

Large Language Models employing Chain-of-Thought reasoning achieve strong performance but suffer from excessive token consumption that inflates inference costs. Existing efficiency methods such as explicit length penalties, difficulty…

Machine Learning · Computer Science 2026-04-03 Bangji Yang , Hongbo Ma , Jiajun Fan , Ge Liu

Recent successes in natural language processing have led to the proliferation of large language models (LLMs) by multiple providers. Each LLM offering has different inference accuracy, monetary cost, and latency, and their accuracy further…

Computation and Language · Computer Science 2024-11-21 Xuechen Zhang , Zijian Huang , Ege Onur Taga , Carlee Joe-Wong , Samet Oymak , Jiasi Chen

Large Reasoning Models (LRMs) have demonstrated remarkable capabilities in complex problem-solving through Chain-of-Thought (CoT) reasoning. However, the multi-step nature of CoT introduces new safety challenges that extend beyond…

Artificial Intelligence · Computer Science 2025-09-30 Zihao Zhu , Xinyu Wu , Gehan Hu , Siwei Lyu , Ke Xu , Baoyuan Wu

Despite recent advancements in large language models (LLMs), their performance on complex reasoning problems requiring multi-step thinking and combining various skills is still limited. To address this, we propose a novel framework HDFlow…

Computation and Language · Computer Science 2024-09-27 Wenlin Yao , Haitao Mi , Dong Yu

Large Language Models (LLMs) have demonstrated significant success across various domains. However, their application in complex decision-making tasks frequently necessitates intricate prompt engineering or fine-tuning, leading to…

Artificial Intelligence · Computer Science 2024-05-06 Wanpeng Zhang , Zongqing Lu

Recent advancements in reasoning have significantly enhanced the capabilities of Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) across diverse tasks. However, excessive reliance on chain-of-thought (CoT) reasoning…

Computation and Language · Computer Science 2025-05-22 Jinghui Lu , Haiyang Yu , Siliang Xu , Shiwei Ran , Guozhi Tang , Siqi Wang , Bin Shan , Teng Fu , Hao Feng , Jingqun Tang , Han Wang , Can Huang

Recent developments in reasoning capabilities have enabled large language models to solve increasingly complex mathematical, symbolic, and logical tasks. Interestingly, while reasoning models are often trained to generate monolingual text,…

Computation and Language · Computer Science 2026-04-20 Eleanor M. Lin , David Jurgens

Despite rapid advancements in large language models (LLMs), the token-level autoregressive nature constrains their complex reasoning capabilities. To enhance LLM reasoning, inference-time techniques, including…

Artificial Intelligence · Computer Science 2026-01-28 Qianyue Hao , Sibo Li , Jian Yuan , Yong Li

Recent large language models have shown promising capabilities in long-form reasoning, following structured chains of thought before arriving at a final answer. However, we observe that these reasoning paths tend to include substantial…

In real-world continual learning (CL) scenarios, tasks often exhibit intricate and unpredictable semantic shifts, posing challenges for fixed prompt management strategies which are tailored to only handle semantic shifts of uniform degree…

Machine Learning · Computer Science 2024-07-23 Doyoung Kim , Susik Yoon , Dongmin Park , Youngjun Lee , Hwanjun Song , Jihwan Bang , Jae-Gil Lee