中文
相关论文

相关论文: QaRL: Rollout-Aligned Quantization-Aware RL for Fa…

200 篇论文

Quantum machine learning (QML), which combines quantum computing with machine learning, is widely believed to hold the potential to outperform traditional machine learning in the era of noisy intermediate-scale quantum (NISQ). As one of the…

量子物理 · 物理学 2025-01-14 Yu-Xin Jin , Zi-Wei Wang , Hong-Ze Xu , Wei-Feng Zhuang , Meng-Jun Hu , Dong E. Liu

Active flow control remains a significant challenge due to the high-dimensional, nonlinear nature of fluid dynamics. Quantum machine learning may prove effective in addressing these issues, given that quantum computing possesses superiority…

流体动力学 · 物理学 2026-01-27 Hongfu Zhang , Hui Tang

Classical reinforcement learning (RL) aims to optimize the expected cumulative reward. In this work, we consider the RL setting where the goal is to optimize the quantile of the cumulative reward. We parameterize the policy controlling…

机器学习 · 计算机科学 2023-05-15 Jinyang Jiang , Jiaqiao Hu , Yijie Peng

Self-supervised reinforcement learning (RL) presents a promising approach for enhancing the reasoning capabilities of Large Language Models (LLMs) without reliance on expensive human-annotated data. However, we find that existing methods…

人工智能 · 计算机科学 2025-12-16 Bizhe Bai , Hongming Wu , Peng Ye , Tao Chen

A compelling use case of offline reinforcement learning (RL) is to obtain a policy initialization from existing datasets followed by fast online fine-tuning with limited interaction. However, existing offline RL methods tend to behave…

We propose a reinforcement learning (RL) scheme for feedback quantum control within the quan-tum approximate optimization algorithm (QAOA). QAOA requires a variational minimization for states constructed by applying a sequence of unitary…

量子物理 · 物理学 2020-09-23 Matteo M. Wauters , Emanuele Panizon , Glen B. Mbeng , Giuseppe E. Santoro

Offline reinforcement learning (RL) has garnered significant interest due to its safe and easily scalable paradigm. However, training under this paradigm presents its own challenge: the extrapolation error stemming from out-of-distribution…

机器学习 · 计算机科学 2026-02-24 Thanh Nguyen , Tung Luu , Tri Ton , Sungwoong Kim , Chang D. Yoo

Recent studies show that the reasoning capabilities of Large Language Models (LLMs) can be improved by applying Reinforcement Learning (RL) to question-answering (QA) tasks in areas such as math and coding. With a long context length, LLMs…

计算与语言 · 计算机科学 2025-10-17 Stephen Chung , Wenyu Du , Jie Fu

Modular quantum architectures have emerged as a promising approach for scaling quantum computing systems by connecting multiple Quantum Processing Units (QPUs). However, this approach introduces significant challenges due to costly…

量子物理 · 物理学 2026-05-12 Sokea Sang , Leanghok Hour , Youngsun Han

Training tool-calling agents with reinforcement learning on multi-turn tasks remains challenging due to sparse outcome rewards and difficult credit assignment across conversation turns. We present the first application of MT-GRPO…

人工智能 · 计算机科学 2026-04-06 Wachiravit Modecrua , Krittanon Kaewtawee , Krittin Pachtrachai , Touchapon Kraisingkorn

Post-Training Quantization (PTQ) has become the de-facto standard for efficient LLM deployment, yet its optimization objective remains fundamentally incomplete. Standard PTQ methods minimize reconstruction error (e.g., MSE or KL divergence)…

人工智能 · 计算机科学 2026-03-19 Sunghyun Wee , Suyoung Kim , Hyeonjin Kim , Kyomin Hwang , Nojun Kwak

Reinforcement Learning (RL) is a pivotal post-training technique for enhancing the reasoning capabilities of Large Language Models (LLMs). However, synchronous RL post-training often suffers from significant GPU underutilization, referred…

分布式、并行与集群计算 · 计算机科学 2025-09-26 Wei Gao , Yuheng Zhao , Dakai An , Tianyuan Wu , Lunxi Cao , Shaopan Xiong , Ju Huang , Weixun Wang , Siran Yang , Wenbo Su , Jiamang Wang , Lin Qu , Bo Zheng , Wei Wang

Learning representations for reinforcement learning (RL) has shown much promise for continuous control. We propose an efficient representation learning method using only a self-supervised latent-state consistency loss. Our approach employs…

机器学习 · 计算机科学 2024-06-06 Aidan Scannell , Kalle Kujanpää , Yi Zhao , Mohammadreza Nakhaei , Arno Solin , Joni Pajarinen

Network quantization has gained increasing attention with the rapid growth of large pre-trained language models~(PLMs). However, most existing quantization methods for PLMs follow quantization-aware training~(QAT) that requires end-to-end…

计算与语言 · 计算机科学 2021-10-01 Haoli Bai , Lu Hou , Lifeng Shang , Xin Jiang , Irwin King , Michael R. Lyu

The application of quantum reinforcement learning (QRL) to real-time control systems faces significant challenges regarding hardware latency, noise susceptibility, and learning convergence. This work presents an end-to-end investigation of…

Deep Reinforcement Learning (RL) has considerably advanced over the past decade. At the same time, state-of-the-art RL algorithms require a large computational budget in terms of training time to converge. Recent work has started to…

Reinforcement learning (RL) plays a central role in large language model (LLM) post-training. Among existing approaches, Group Relative Policy Optimization (GRPO) is widely used, especially for RL with verifiable rewards (RLVR) fine-tuning.…

Model compression methods are used to reduce the computation and energy requirements for Large Language Models (LLMs). Quantization Aware Training (QAT), an effective model compression method, is proposed to reduce performance degradation…

机器学习 · 计算机科学 2024-10-16 He Li , Jianhang Hong , Yuanzhuo Wu , Snehal Adbol , Zonglin Li

Reinforcement-Learning-based post-training has recently emerged as a promising paradigm for aligning text-to-image diffusion models with human preferences. In recent studies, increasing the rollout group size yields pronounced performance…

Reinforcement Learning (RL) has become essential for eliciting complex reasoning capabilities in Large Language Models (LLMs). However, the substantial memory overhead of storing Key-Value (KV) caches during long-horizon rollouts acts as a…

机器学习 · 计算机科学 2026-03-31 Sijia Luo , Xiaokang Zhang , Yuxuan Hu , Bohan Zhang , Ke Wang , Jinbo Su , Mengshu Sun , Lei Liang , Jing Zhang