English
Related papers

Related papers: Reading or Reasoning? Format Decoupled Reinforceme…

200 papers

Reinforcement Learning with Verifiable Rewards (RLVR) has significantly advanced reasoning capabilities in Large Language Models. However, adapting RLVR to multimodal domains suffers from a critical \textit{perception-reasoning decoupling}.…

Artificial Intelligence · Computer Science 2026-01-13 Shujian Gao , Yuan Wang , Jiangtao Yan , Zuxuan Wu , Yu-Gang Jiang

We study constrained reinforcement learning (CRL) from a novel perspective by setting constraints directly on state density functions, rather than the value functions considered by previous works. State density has a clear physical and…

Machine Learning · Computer Science 2021-06-25 Zengyi Qin , Yuxiao Chen , Chuchu Fan

Recently, two-stage fine-tuning strategies, e.g., acquiring essential driving knowledge through supervised fine-tuning (SFT) and further enhancing decision-making and planning via reinforcement fine-tuning (RFT), have shown strong potential…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Songyan Zhang , Wenhui Huang , Zhan Chen , Chua Jiahao Collister , Qihang Huang , Chen Lv

Learning to rank (LTR) plays a crucial role in various Information Retrieval (IR) tasks. Although supervised LTR methods based on fine-grained relevance labels (e.g., document-level annotations) have achieved significant success, their…

Information Retrieval · Computer Science 2025-08-21 Yiteng Tu , Zhichao Xu , Tao Yang , Weihang Su , Yujia Zhou , Yiqun Liu , Fen Lin , Qin Liu , Qingyao Ai

Recent works on structured text translation remain limited to the sentence level, as they struggle to effectively handle the complex document-level XML or HTML structures. To address this, we propose \textbf{Format Reinforcement Learning…

Computation and Language · Computer Science 2025-12-05 Haiyue Song , Johannes Eschbach-Dymanus , Hour Kaing , Sumire Honda , Hideki Tanaka , Bianka Buschbeck , Masao Utiyama

The effective training of Large Language Models (LLMs) for function calling faces a critical challenge: balancing exploration of complex reasoning paths with stable policy optimization. Standard methods like Supervised Fine-Tuning (SFT)…

Reinforcement learning (RL) has become a standard technique for post-training diffusion-based image synthesis models, as it enables learning from reward signals to explicitly improve desirable aspects such as image quality and prompt…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 David McAllister , Miika Aittala , Tero Karras , Janne Hellsten , Angjoo Kanazawa , Timo Aila , Samuli Laine

Reinforcement Learning (RL) has achieved tremendous development in recent years, but still faces significant obstacles in addressing complex real-life problems due to the issues of poor system generalization, low sample efficiency as well…

Artificial Intelligence · Computer Science 2025-02-25 Chao Yu , Shicheng Ye , Hankz Hankui Zhuo

Visual paragraph generation aims to automatically describe a given image from different perspectives and organize sentences in a coherent way. In this paper, we address three critical challenges for this task in a reinforcement learning…

Computer Vision and Pattern Recognition · Computer Science 2019-08-30 Yadan Luo , Zi Huang , Zheng Zhang , Ziwei Wang , Jingjing Li , Yang Yang

Current reinforcement learning (RL) methods can successfully learn single tasks but often generalize poorly to modest perturbations in task domain or training procedure. In this work, we present a decoupled learning strategy for RL that…

Machine Learning · Computer Science 2018-05-10 Amy Zhang , Harsh Satija , Joelle Pineau

Existing document OCR largely targets plain text or Markdown, discarding the structural and executable properties that make LaTeX essential for scientific publishing. We study page-level reconstruction of scientific PDFs into compilable…

Computation and Language · Computer Science 2026-04-28 Chengye Wang , Lin Fu , Zexi Kuang , Yilun Zhao

Diagnosis-Related Group (DRG) codes are essential for hospital reimbursement and operations but require labor-intensive assignment. Large Language Models (LLMs) struggle with DRG coding due to the out-of-distribution (OOD) nature of the…

Machine Learning · Computer Science 2025-10-16 Hanyin Wang , Zhenbang Wu , Gururaj Kolar , Hariprasad Korsapati , Brian Bartlett , Bryan Hull , Jimeng Sun

Augmenting Large Language Models (LLMs) with retrieved external knowledge has proven effective for improving the factual accuracy of generated responses. Despite their success, retrieval-augmented LLMs still face the distractibility issue,…

Computation and Language · Computer Science 2025-02-18 Zexuan Qiu , Zijing Ou , Bin Wu , Jingjing Li , Aiwei Liu , Irwin King

Current image-based reinforcement learning (RL) algorithms typically operate on the whole image without performing object-level reasoning. This leads to inefficient goal sampling and ineffective reward functions. In this paper, we improve…

Machine Learning · Computer Science 2020-11-16 Yufei Wang , Gautham Narayan Narasimhan , Xingyu Lin , Brian Okorn , David Held

The increasing prevalence of large language models (LLMs) such as GPT-4 in various applications has led to a surge in the size of prompts required for optimal performance, leading to challenges in computational efficiency. Prompt…

Computation and Language · Computer Science 2024-12-19 Shivam Shandilya , Menglin Xia , Supriyo Ghosh , Huiqiang Jiang , Jue Zhang , Qianhui Wu , Victor Rühle

This paper proposes a novel reinforcement learning (RL) framework for credit underwriting that tackles ungeneralizable contextual challenges. We adapt RL principles for credit scoring, incorporating action space renewal and multi-choice…

Reinforcement learning (RL) is often credited with improving language model reasoning and generalization at the expense of degrading memorized knowledge. We challenge this narrative by observing that RL-enhanced models consistently…

Computation and Language · Computer Science 2025-11-11 Renfei Zhang , Manasa Kaniselvan , Niloofar Mireshghallah

Large language models are increasingly used for complex reasoning tasks where high-quality offline data such as expert-annotated solutions and distilled reasoning traces are often available. However, in environments with sparse rewards,…

Artificial Intelligence · Computer Science 2025-08-11 Yihao Liu , Shuocheng Li , Lang Cao , Yuhang Xie , Mengyu Zhou , Haoyu Dong , Xiaojun Ma , Shi Han , Dongmei Zhang

Controlled text generation tasks such as unsupervised text style transfer have increasingly adopted the use of Reinforcement Learning (RL). A major challenge in applying RL to such tasks is the sparse reward, which is available only after…

Computation and Language · Computer Science 2022-04-19 Bhargav Upadhyay , Akhilesh Sudhakar , Arjun Maheswaran

While Large Language Models (LLMs) demonstrate exceptional performance in surface-level text generation, their nature in handling complex multi-step reasoning tasks often remains one of ``statistical fitting'' rather than systematic logical…

Machine Learning · Computer Science 2026-01-27 Lianlei Shan , Han Chen , Yixuan Wang , Zhenjie Liu , Wei Li