English
Related papers

Related papers: From Intent to Execution: Multimodal Chain-of-Thou…

200 papers

Reinforcement Learning (RL) has demonstrated excellent decision-making potential in platoon coordination problems. However, due to the variability of coordination goals, the complexity of the decision problem, and the time-consumption of…

Machine Learning · Computer Science 2025-04-29 Dixiao Wei , Peng Yi , Jinlong Lei , Yiguang Hong , Yuchuan Du

Designing effective reward functions is a cornerstone of reinforcement learning (RL), yet it remains a challenging and labor-intensive process due to the inefficiencies and inconsistencies inherent in traditional methods. Existing methods…

Machine Learning · Computer Science 2026-04-16 Shentong Mo

Reinforcement Learning (RL) has shown great potential in refining robotic manipulation policies, yet its efficacy remains strongly bottlenecked by the difficulty of designing generalizable reward functions. In this paper, we propose a…

Robotics · Computer Science 2026-03-24 Yanru Wu , Weiduo Yuan , Ang Qi , Vitor Guizilini , Jiageng Mao , Yue Wang

Chain-of-thought (CoT) prompting has become central to mathematical reasoning in large language models, yet models remain brittle to early errors: a single arithmetic slip or unjustified inference typically propagates uncorrected to an…

Machine Learning · Computer Science 2025-12-22 Saraswathy Amjith , Mihika Dusad , Neha Muramalla , Shweta Shah

While Chain-of-Thought prompting is popular in reasoning tasks, its application to Large Language Models (LLMs) in Natural Language Understanding (NLU) is under-explored. Motivated by multi-step reasoning of LLMs, we propose Coarse-to-Fine…

Computation and Language · Computer Science 2023-10-24 Hoang H. Nguyen , Ye Liu , Chenwei Zhang , Tao Zhang , Philip S. Yu

Large Language Models (LLMs) are changing the coding paradigm, known as vibe coding, yet synthesizing algorithmically sophisticated and robust code still remains a critical challenge. Incentivizing the deep reasoning capabilities of LLMs is…

Computation and Language · Computer Science 2026-02-18 Chansung Park , Juyong Jiang , Fan Wang , Sayak Paul , Jiasi Shen , Jing Tang , Jianguo Li

Multimodal Large Language Models (MLLMs) perform well in single-image visual grounding but struggle with real-world tasks that demand cross-image reasoning and multi-modal instructions. To address this, we adopt a reinforcement learning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Bob Zhang , Haoran Li , Tao Zhang , Jianan Li , Cilin Yan , Xikai Liu , Jiayin Cai , Yanbin Hao

Large language models (LLMs) increasingly rely on chain-of-thought (CoT) reasoning to solve complex tasks. Yet ensuring that the reasoning trace both contributes to and faithfully reflects the processes underlying the model's final answer,…

Computation and Language · Computer Science 2026-04-20 Max Henning Höth , Kristian Kersting , Björn Deiseroth , Letitia Parcalabescu

Predicting program behavior and reasoning about code execution remain significant challenges in software engineering, particularly for large language models (LLMs) designed for code analysis. While these models excel at understanding static…

Software Engineering · Computer Science 2025-02-11 Cuong Chi Le , Hoang-Chau Truong-Vinh , Huy Nhat Phan , Dung Duy Le , Tien N. Nguyen , Nghi D. Q. Bui

Recent advancements in large language models (LLMs) have been driven by their emergent reasoning capabilities, particularly through long chain-of-thought (CoT) prompting, which enables thorough exploration and deliberation. Despite these…

Computation and Language · Computer Science 2026-04-09 Junnan Liu , Hongwei Liu , Songyang Zhang , Kai Chen

Building on the success of text-based reasoning models like DeepSeek-R1, extending these capabilities to multimodal reasoning holds great promise. While recent works have attempted to adapt DeepSeek-R1-style reinforcement learning (RL)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Jie Yang , Feipeng Ma , Zitian Wang , Dacheng Yin , Kang Rong , Fengyun Rao , Ruimao Zhang

The rapid evolution of Large Language Models (LLMs) has driven a growing demand for automated, high-performance system kernels to accelerate machine learning workloads. We introduce TritonRL, a domain-specialized 8B-scale LLM for Triton…

Software Engineering · Computer Science 2026-02-10 Jiin Woo , Shaowei Zhu , Allen Nie , Zhen Jia , Yida Wang , Youngsuk Park

Code completion aims to enhance programming productivity by predicting potential code based on the current programming context. Recently, pretrained language models (LMs) have become prominent in this field. Various approaches have been…

Software Engineering · Computer Science 2024-02-23 Bolun Li , Zhihong Sun , Tao Huang , Hongyu Zhang , Yao Wan , Ge Li , Zhi Jin , Chen Lyu

Code reasoning refers to the task of predicting the output of a program given its source code and specific inputs. It can measure the reasoning capability of large language models (LLMs) and also benefit downstream tasks such as code…

Machine Learning · Computer Science 2026-05-19 Zhanyue Qin , Jia Feng , Yibo Lyu , Yun Peng , Dianbo Sui , Cuiyun Gao , Qing Liao

Recent advances in mathematical problem-solving with language models (LMs) integrate chain-of-thought (CoT) reasoning and code execution to harness their complementary strengths. However, existing hybrid frameworks exhibit a critical…

Artificial Intelligence · Computer Science 2025-07-21 Haozhe Wang , Long Li , Chao Qu , Fengming Zhu , Weidi Xu , Wei Chu , Fangzhen Lin

The growing disparity between the exponential scaling of computational resources and the finite growth of high-quality text data now constrains conventional scaling approaches for large language models (LLMs). To address this challenge, we…

Reinforcement Learning (RL) has become a pivotal approach for enhancing the reasoning capabilities of Large Language Models (LLMs). However, a significant theoretical gap persists, as traditional token-level RL frameworks fail to align with…

Artificial Intelligence · Computer Science 2025-09-26 Zeyu Gan , Hao Yi , Yong Liu

A long-standing goal of AI systems is to perform complex multimodal reasoning like humans. Recently, large language models (LLMs) have made remarkable strides in such multi-step reasoning on the language modality solely by leveraging the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Ge Zheng , Bin Yang , Jiajin Tang , Hong-Yu Zhou , Sibei Yang

In this work, we address the task of table image to LaTeX code generation, with the goal of automating the reconstruction of high-quality, publication-ready tables from visual inputs. A central challenge of this task lies in accurately…

Artificial Intelligence · Computer Science 2025-09-23 Jun Ling , Yao Qi , Tao Huang , Shibo Zhou , Yanqin Huang , Jiang Yang , Ziqi Song , Ying Zhou , Yang Yang , Heng Tao Shen , Peng Wang

Multimodal reasoning is a challenging task that requires models to reason across multiple modalities to answer questions. Existing approaches have made progress by incorporating language and visual modalities into a two-stage reasoning…

Artificial Intelligence · Computer Science 2024-07-04 Cheng Tan , Jingxuan Wei , Zhangyang Gao , Linzhuang Sun , Siyuan Li , Ruifeng Guo , Bihui Yu , Stan Z. Li