English
Related papers

Related papers: QaRL: Rollout-Aligned Quantization-Aware RL for Fa…

200 papers

Reinforcement Learning (RL) plays a crucial role in aligning large language models (LLMs) with human preferences and improving their ability to perform complex tasks. However, current approaches either require significant computational…

Machine Learning · Computer Science 2025-02-12 Kaixuan Ji , Guanlin Liu , Ning Dai , Qingping Yang , Renjie Zheng , Zheng Wu , Chen Dun , Quanquan Gu , Lin Yan

Although post-training quantization (PTQ) provides an efficient numerical compression scheme for deploying large language models (LLMs) on resource-constrained devices, the representativeness and universality of calibration data remain a…

Machine Learning · Computer Science 2026-01-19 Haiyang Xiao , Weiqing Li , Jinyue Guo , Guochao Jiang , Guohua Liu , Yuewei Zhang

Reinforcement Learning (RL) has outperformed other counterparts in sequential decision-making and dynamic environment control. However, FPGA deployment is significantly resource-expensive, as associated with large number of computations in…

Hardware Architecture · Computer Science 2025-06-10 Anushka Jha , Tanushree Dewangan , Mukul Lokhande , Santosh Kumar Vishvakarma

As Large Language Models (LLMs) become increasingly computationally complex, developing efficient deployment strategies, such as quantization, becomes crucial. State-of-the-art Post-training Quantization (PTQ) techniques often rely on…

Machine Learning · Computer Science 2025-01-17 Alireza Ghaffari , Sharareh Younesian , Boxing Chen , Vahid Partovi Nia , Masoud Asgharian

The scaling of quantum processors is currently limited by technical challenges such as decoherence and cross-talk. As the number of qubits grows, interference increases the computational noise. Distributed quantum computing addresses these…

Machine Learning · Computer Science 2026-05-27 Víctor Carballo , Júlia López-Closa , Mario Martin

Identifying optimal join orders (JOs) stands out as a key challenge in database research and engineering. Owing to the large search space, established classical methods rely on approximations and heuristics. Recent efforts have successfully…

Quantum Physics · Physics 2025-02-24 Maja Franz , Tobias Winker , Sven Groppe , Wolfgang Mauerer

Modular, distributed and multi-core architectures are currently considered a promising approach for scalability of quantum computing systems. The integration of multiple Quantum Processing Units necessitates classical and quantum-coherent…

Quantum Physics · Physics 2026-04-28 Enrico Russo , Maurizio Palesi , Davide Patti , Giuseppe Ascia , Vincenzo Catania

Reinforcement Learning (RL) has emerged as a crucial paradigm for unlocking the advanced reasoning capabilities of Large Language Models (LLMs), encompassing frameworks like RLHF and RLAIF. Regardless of the specific optimization algorithm…

Machine Learning · Computer Science 2026-05-11 Rui Zhu , Weiheng Bai , Qiushi Wu , Yang Ren , Haixu Tang , Yuchu Liu

Decoupled PPO has been a successful reinforcement learning (RL) algorithm to deal with the high data staleness under the asynchronous RL setting. Decoupled loss used in decoupled PPO improves coupled-loss style of algorithms' (e.g.,…

Machine Learning · Computer Science 2026-03-09 Xiaocan Li , Shiliang Wu , Zheng Shen

Reinforcement learning (RL) provides a principled framework for decision-making in partially observable environments, which can be modeled as Markov decision processes and compactly represented through dynamic decision Bayesian networks.…

Quantum Physics · Physics 2025-07-25 Gilberto Cunha , Alexandra Ramôa , André Sequeira , Michael de Oliveira , Luís Barbosa

Reinforcement learning (RL) has become a cornerstone for fine-tuning Large Language Models (LLMs), with Proximal Policy Optimization (PPO) serving as the de facto standard algorithm. Despite its ubiquity, we argue that the core ratio…

Machine Learning · Computer Science 2026-05-27 Penghui Qi , Xiangxin Zhou , Zichen Liu , Tianyu Pang , Chao Du , Min Lin , Wee Sun Lee

The ability to prepare a physical system in a desired quantum state is central to many areas of physics such as nuclear magnetic resonance, cold atoms, and quantum computing. Yet, preparing states quickly and with high fidelity remains a…

Quantum reinforcement learning utilizes quantum layers to process information within a machine learning model. However, both pure and hybrid quantum reinforcement learning face challenges such as data encoding and the use of quantum…

Extending the context window support of large language models (LLMs) is crucial for tasks with long-distance dependencies. RoPE-based interpolation and extrapolation methods, such as linear scaling and frequency-aware schemes, enable longer…

Machine Learning · Computer Science 2025-10-02 Ye Qiao , Haocheng Xu , Xiaofan Zhang , Sitao Huang

Reinforcement learning (RL) post-training has become a trending paradigm for enhancing the capabilities of large language models (LLMs). Most existing RL systems for LLMs operate in a fully synchronous manner, where training must wait for…

Machine Learning · Computer Science 2025-11-11 Zekai Qu , Yinxu Pan , Ao Sun , Chaojun Xiao , Xu Han

Post-training quantization (PTQ) is crucial for deploying efficient object detection models, like YOLO, on resource-constrained devices. However, the impact of reduced precision on model robustness to real-world input degradations such as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Toghrul Karimov , Hassan Imani , Allan Kazakov

Low-bit post-training quantization (PTQ) is a practical route to deploy reasoning-capable LLMs under tight memory and latency budgets, yet it can markedly impair mathematical reasoning (drops up to 69.81% in our harder settings). We address…

Machine Learning · Computer Science 2026-01-21 Zhen Li , Yupeng Su , Songmiao Wang , Runming Yang , Congkai Xie , Aofan Liu , Ming Li , Jiannong Cao , Yuan Xie , Ngai Wong , Hongxia Yang

Looped language models (LoopLMs) improve parameter efficiency by recursively reusing Transformer blocks, enabling deeper computation under a fixed model size. However, this reuse makes LoopLMs more fragile under post-training quantization…

Machine Learning · Computer Science 2026-05-19 Rui Fang , Hsi-Wen Chen , Ming-Syan Chen

Deep Reinforcement Learning (DRL) is gaining attention as a potential approach to design trajectories for autonomous unmanned aerial vehicles (UAV) used as flying access points in the context of cellular or Internet of Things (IoT)…

Information Theory · Computer Science 2022-02-07 Omid Esrafilian , Harald Bayerlein , David Gesbert

Reinforcement learning (RL) is one of the most practical ways to learn from real-life use-cases. Motivated from the cognitive methods used by humans makes it a widely acceptable strategy in the field of artificial intelligence. Most of the…

Artificial Intelligence · Computer Science 2026-04-14 Abhishek Sawaika , Samuel Yen-Chi Chen , Udaya Parampalli , Rajkumar Buyya