English
Related papers

Related papers: QeRL: Beyond Efficiency -- Quantization-enhanced R…

200 papers

Reinforcement learning (RL) enables agents to learn optimal policies through environmental interaction. However, RL suffers from reduced learning efficiency due to the curse of dimensionality in high-dimensional spaces. Quantum…

Machine Learning · Computer Science 2025-07-02 Seok Bin Son , Joongheon Kim

The scaling of quantum processors is currently limited by technical challenges such as decoherence and cross-talk. As the number of qubits grows, interference increases the computational noise. Distributed quantum computing addresses these…

Machine Learning · Computer Science 2026-05-27 Víctor Carballo , Júlia López-Closa , Mario Martin

Recent advances in large language models (LLMs) have highlighted the potential of reinforcement learning with verifiable rewards (RLVR) to enhance reasoning capabilities through extended output sequences. However, traditional RL frameworks…

Computation and Language · Computer Science 2025-07-29 Dong Du , Shulin Liu , Tao Yang , Shaohua Chen , Yang Li

This paper presents a novel approach to fine-tuning the Qwen2-1.5B model for Arabic language processing using Quantized Low-Rank Adaptation (QLoRA) on a system with only 4GB VRAM. We detail the process of adapting this large language model…

Computation and Language · Computer Science 2024-12-24 Prakash Aryan

The emergence of LLMs has ignited a fresh surge of breakthroughs in NLP applications, particularly in domains such as question-answering systems and text generation. As the need for longer context grows, a significant bottleneck in model…

Computation and Language · Computer Science 2024-04-15 Shichen Dong , Wen Cheng , Jiayu Qin , Wei Wang

Optimizing quantum circuits is challenging due to the very large search space of functionally equivalent circuits and the necessity of applying transformations that temporarily decrease performance to achieve a final performance…

Quantum Physics · Physics 2023-07-20 Zikun Li , Jinjun Peng , Yixuan Mei , Sina Lin , Yi Wu , Oded Padon , Zhihao Jia

Reinforcement learning (RL) is one of the most practical ways to learn from real-life use-cases. Motivated from the cognitive methods used by humans makes it a widely acceptable strategy in the field of artificial intelligence. Most of the…

Artificial Intelligence · Computer Science 2026-04-14 Abhishek Sawaika , Samuel Yen-Chi Chen , Udaya Parampalli , Rajkumar Buyya

Reinforcement learning (RL) for large language models (LLMs) is increasingly bottlenecked by rollout (generation), where long output sequence lengths make attention and KV-cache memory dominate end-to-end step time. FP8 offers an attractive…

Machine Learning · Computer Science 2026-04-13 Zhaopeng Qiu , Shuang Yu , Jingqi Zhang , Shuai Zhang , Xue Huang , Jingyi Yang , Junjie Lai

Deploying Large Language Models (LLMs) on resource-constrained edge devices like the Raspberry Pi presents challenges in computational efficiency, power consumption, and response latency. This paper explores quantization-based optimization…

Machine Learning · Computer Science 2025-04-04 Mahsa Ardakani , Jinendra Malekar , Ramtin Zand

Generative Large Language Models (LLMs) have demonstrated remarkable results for a wide range of tasks. However, deploying these models for inference has been a significant challenge due to their unprecedented resource requirements. This…

Computation and Language · Computer Science 2024-06-06 Sehoon Kim , Coleman Hooper , Amir Gholami , Zhen Dong , Xiuyu Li , Sheng Shen , Michael W. Mahoney , Kurt Keutzer

Recent advancements in quantum computing (QC) and machine learning (ML) have sparked considerable interest in the integration of these two cutting-edge fields. Among the various ML techniques, reinforcement learning (RL) stands out for its…

Quantum Physics · Physics 2024-09-10 Samuel Yen-Chi Chen

Quantum Reinforcement Learning (QRL) offers potential advantages over classical Reinforcement Learning, such as compact state space representation and faster convergence in certain scenarios. However, practical benefits require further…

Quantum Physics · Physics 2024-08-05 Michael Kölle , Daniel Seidl , Maximilian Zorn , Philipp Altmann , Jonas Stein , Thomas Gabor

Today, large language models have demonstrated their strengths in various tasks ranging from reasoning, code generation, and complex problem solving. However, this advancement comes with a high computational cost and memory requirements,…

Machine Learning · Computer Science 2026-03-26 Meriem Bouzouad , Yuan-Hao Chang , Jalil Boukhobza

We present BenchRL-QAS, a unified benchmarking framework for reinforcement learning (RL) in quantum architecture search (QAS) across a spectrum of variational quantum algorithm tasks on 2- to 8-qubit systems. Our study systematically…

Quantum Physics · Physics 2025-09-30 Azhar Ikhtiarudin , Aditi Das , Param Thakkar , Akash Kundu

Post-Training Quantization (PTQ) is essential for deploying Large Language Models (LLMs) on memory-constrained devices, yet it renders models static and difficult to fine-tune. Standard fine-tuning paradigms, including Reinforcement…

Machine Learning · Computer Science 2026-02-04 Yinggan Xu , Risto Miikkulainen , Xin Qiu

Large Language Models (LLMs) have advanced rapidly but face significant memory demands. While quantization has shown promise for LLMs, current methods typically require lengthy training to alleviate the performance degradation from…

Artificial Intelligence · Computer Science 2024-05-31 Ke Yi , Yuhui Xu , Heng Chang , Chen Tang , Yuan Meng , Tong Zhang , Jia Li

The Qwen series has emerged as a leading family of open-source Large Language Models (LLMs), demonstrating remarkable capabilities in natural language understanding tasks. With the recent release of Qwen3, which exhibits superior…

Machine Learning · Computer Science 2025-05-06 Xingyu Zheng , Yuye Li , Haoran Chu , Yue Feng , Xudong Ma , Jie Luo , Jinyang Guo , Haotong Qin , Michele Magno , Xianglong Liu

As inference on Large Language Models (LLMs) emerges as an important workload in machine learning applications, weight quantization has become a standard technique for efficient GPU deployment. Quantization not only reduces model size, but…

Machine Learning · Computer Science 2024-08-22 Elias Frantar , Roberto L. Castro , Jiale Chen , Torsten Hoefler , Dan Alistarh

Inspired by the power of large language models (LLMs), our research adapts them to quantum federated learning (QFL) to boost efficiency and performance. We propose a federated fine-tuning method that distills an LLM within QFL, allowing…

Machine Learning · Computer Science 2025-05-27 Dev Gurung , Shiva Raj Pokhrel

One approach to reducing the massive costs of large language models (LLMs) is the use of quantized or sparse representations for training or deployment. While post-training compression methods are very popular, the question of obtaining…

Machine Learning · Computer Science 2025-06-12 Andrei Panferov , Jiale Chen , Soroush Tabesh , Roberto L. Castro , Mahdi Nikdan , Dan Alistarh