English
Related papers

Related papers: Beyond 'Aha!': Toward Systematic Meta-Abilities Al…

200 papers

Large language models (LLMs) have shown significant progress in reasoning tasks. However, recent studies show that transformers and LLMs fail catastrophically once reasoning problems exceed modest complexity. We revisit these findings…

Artificial Intelligence · Computer Science 2025-10-28 Revanth Rameshkumar , Jimson Huang , Yunxin Sun , Fei Xia , Abulhair Saparov

Time-series reasoning remains a significant challenge in multimodal large language models (MLLMs) due to the dynamic temporal patterns, ambiguous semantics, and lack of temporal priors. In this work, we introduce TimeMaster, a reinforcement…

Machine Learning · Computer Science 2025-06-17 Junru Zhang , Lang Feng , Xu Guo , Yuhan Wu , Yabo Dong , Duanqing Xu

Although Long Reasoning Models (LRMs) have achieved superior performance on various reasoning scenarios, they often suffer from increased computational costs and inference latency caused by overthinking. To address these limitations, we…

Artificial Intelligence · Computer Science 2025-10-15 Yujian Zhang , Keyu Chen , Zhifeng Shen , Ruizhi Qiao , Xing Sun

Contemporary progress in large language models (LLMs) has revealed notable inferential capacities via reinforcement learning (RL) employing verifiable reward, facilitating the development of O1 and R1-like reasoning models. Directly…

Machine Learning · Computer Science 2025-10-21 Zexu Sun , Yongcheng Zeng , Erxue Min , Heyang Gao , Bokai Ji , Xu Chen

Existing large language models (LLMs) face challenges of following complex instructions, especially when multiple constraints are present and organized in paralleling, chaining, and branching structures. One intuitive solution, namely…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yulei Qin , Gang Li , Zongyi Li , Zihan Xu , Yuchen Shi , Zhekai Lin , Xiao Cui , Ke Li , Xing Sun

Large language models (LLMs) can transform education, but their optimization for direct question-answering often undermines effective pedagogy which requires strategically withholding answers. To mitigate this, we propose an online…

Computation and Language · Computer Science 2025-10-14 David Dinucu-Jianu , Jakub Macina , Nico Daheim , Ido Hakimi , Iryna Gurevych , Mrinmaya Sachan

Despite the rapid expansion of Large Language Models (LLMs) in healthcare, robust and explainable evaluation of their ability to assess clinical trial reporting according to CONSORT standards remains an open challenge. In particular,…

Artificial Intelligence · Computer Science 2026-02-26 Sohyeon Jeon , Hyung-Chul Lee

Predictive autoscaling (autoscaling with workload forecasting) is an important mechanism that supports autonomous adjustment of computing resources in accordance with fluctuating workload demands in the Cloud. In recent works, Reinforcement…

While large language models (LLMs) have shown great potential across various domains, their applications in robotics remain largely limited to static prompt-based behaviors and still face challenges in complex tasks under zero-shot or…

The application of reinforcement learning (RL) to enhance the reasoning capabilities of Multimodal Large Language Models (MLLMs) constitutes a rapidly advancing research area. While MLLMs extend Large Language Models (LLMs) to handle…

Artificial Intelligence · Computer Science 2025-05-22 Guanghao Zhou , Panjia Qiu , Cen Chen , Jie Wang , Zheming Yang , Jian Xu , Minghui Qiu

Large reasoning models (LRMs) are proficient at generating explicit, step-by-step reasoning sequences before producing final answers. However, such detailed reasoning can introduce substantial computational overhead and latency,…

Computation and Language · Computer Science 2025-10-10 Songjun Tu , Jiahao Lin , Qichao Zhang , Xiangyu Tian , Linjing Li , Xiangyuan Lan , Dongbin Zhao

Previous research has primarily focused on the cognitive error detection capabilities of Large Language Models (LLMs), often prompting them to analyze mistakes in reasoning chains. However, few studies have examined the meta-cognitive…

Computation and Language · Computer Science 2025-10-31 Ziyang Ma , Qingyue Yuan , Zhenglin Wang , Deyu Zhou

Reinforcement Learning from Human Feedback (\textbf{RLHF}) has emerged as a dominant approach for aligning LLM outputs with human preferences. Inspired by the success of RLHF, we study the performance of multiple algorithms that learn from…

Intelligent agents should have the ability to leverage knowledge from previously learned tasks in order to learn new ones quickly and efficiently. Meta-learning approaches have emerged as a popular solution to achieve this. However,…

Machine Learning · Computer Science 2023-02-17 Zhao Mandi , Pieter Abbeel , Stephen James

While Aspect-based Sentiment Analysis (ABSA) systems have achieved high accuracy in identifying sentiment polarities, they often operate as "black boxes," lacking the explicit reasoning capabilities characteristic of human affective…

Computation and Language · Computer Science 2026-04-16 Shihao Zhang , Ziwei Wang , Jie Zhou , Yulan Wu , Qin Chen , Zhikai Lei , Liyang Yu , Liang Dou , Liang He

Through reinforcement learning (RL) with outcome correctness rewards, large reasoning models (LRMs) with scaled inference computation have demonstrated substantial success on complex reasoning tasks. However, the one-sided reward, focused…

Computation and Language · Computer Science 2025-11-21 Jiashu Yao , Heyan Huang , Shuang Zeng , Chuwei Luo , WangJie You , Jie Tang , Qingsong Liu , Yuhang Guo , Yangyang Kang

Most reinforcement learning (RL) methods for training large language models (LLMs) require ground-truth labels or task-specific verifiers, limiting scalability when correctness is ambiguous or expensive to obtain. We introduce Reinforcement…

Neural and Evolutionary Computing · Computer Science 2026-01-30 Micah Rentschler , Jesse Roberts

Enhancing the reasoning capabilities of large language models (LLMs) typically relies on massive computational resources and extensive datasets, limiting accessibility for resource-constrained settings. Our study investigates the potential…

Machine Learning · Computer Science 2026-01-21 Quy-Anh Dang , Chris Ngo

Large language models (LLMs) have achieved substantial progress in processing long contexts but still struggle with long-context reasoning. Existing approaches typically involve fine-tuning LLMs with synthetic data, which depends on…

Computation and Language · Computer Science 2024-11-14 Siheng Li , Cheng Yang , Zesen Cheng , Lemao Liu , Mo Yu , Yujiu Yang , Wai Lam

Large language models (LLMs) are advanced artificial intelligence (AI) systems that can perform a variety of tasks commonly found in human intelligence tests, such as defining words, performing calculations, and engaging in verbal…

Computation and Language · Computer Science 2024-09-12 David Ilić , Gilles E. Gignac