中文
相关论文

相关论文: QeRL: Beyond Efficiency -- Quantization-enhanced R…

200 篇论文

Reinforcement learning (RL) enables agents to learn optimal policies through environmental interaction. However, RL suffers from reduced learning efficiency due to the curse of dimensionality in high-dimensional spaces. Quantum…

机器学习 · 计算机科学 2025-07-02 Seok Bin Son , Joongheon Kim

The scaling of quantum processors is currently limited by technical challenges such as decoherence and cross-talk. As the number of qubits grows, interference increases the computational noise. Distributed quantum computing addresses these…

机器学习 · 计算机科学 2026-05-27 Víctor Carballo , Júlia López-Closa , Mario Martin

Recent advances in large language models (LLMs) have highlighted the potential of reinforcement learning with verifiable rewards (RLVR) to enhance reasoning capabilities through extended output sequences. However, traditional RL frameworks…

计算与语言 · 计算机科学 2025-07-29 Dong Du , Shulin Liu , Tao Yang , Shaohua Chen , Yang Li

This paper presents a novel approach to fine-tuning the Qwen2-1.5B model for Arabic language processing using Quantized Low-Rank Adaptation (QLoRA) on a system with only 4GB VRAM. We detail the process of adapting this large language model…

计算与语言 · 计算机科学 2024-12-24 Prakash Aryan

The emergence of LLMs has ignited a fresh surge of breakthroughs in NLP applications, particularly in domains such as question-answering systems and text generation. As the need for longer context grows, a significant bottleneck in model…

计算与语言 · 计算机科学 2024-04-15 Shichen Dong , Wen Cheng , Jiayu Qin , Wei Wang

Optimizing quantum circuits is challenging due to the very large search space of functionally equivalent circuits and the necessity of applying transformations that temporarily decrease performance to achieve a final performance…

量子物理 · 物理学 2023-07-20 Zikun Li , Jinjun Peng , Yixuan Mei , Sina Lin , Yi Wu , Oded Padon , Zhihao Jia

Reinforcement learning (RL) is one of the most practical ways to learn from real-life use-cases. Motivated from the cognitive methods used by humans makes it a widely acceptable strategy in the field of artificial intelligence. Most of the…

人工智能 · 计算机科学 2026-04-14 Abhishek Sawaika , Samuel Yen-Chi Chen , Udaya Parampalli , Rajkumar Buyya

Reinforcement learning (RL) for large language models (LLMs) is increasingly bottlenecked by rollout (generation), where long output sequence lengths make attention and KV-cache memory dominate end-to-end step time. FP8 offers an attractive…

机器学习 · 计算机科学 2026-04-13 Zhaopeng Qiu , Shuang Yu , Jingqi Zhang , Shuai Zhang , Xue Huang , Jingyi Yang , Junjie Lai

Deploying Large Language Models (LLMs) on resource-constrained edge devices like the Raspberry Pi presents challenges in computational efficiency, power consumption, and response latency. This paper explores quantization-based optimization…

机器学习 · 计算机科学 2025-04-04 Mahsa Ardakani , Jinendra Malekar , Ramtin Zand

Generative Large Language Models (LLMs) have demonstrated remarkable results for a wide range of tasks. However, deploying these models for inference has been a significant challenge due to their unprecedented resource requirements. This…

计算与语言 · 计算机科学 2024-06-06 Sehoon Kim , Coleman Hooper , Amir Gholami , Zhen Dong , Xiuyu Li , Sheng Shen , Michael W. Mahoney , Kurt Keutzer

Recent advancements in quantum computing (QC) and machine learning (ML) have sparked considerable interest in the integration of these two cutting-edge fields. Among the various ML techniques, reinforcement learning (RL) stands out for its…

量子物理 · 物理学 2024-09-10 Samuel Yen-Chi Chen

Quantum Reinforcement Learning (QRL) offers potential advantages over classical Reinforcement Learning, such as compact state space representation and faster convergence in certain scenarios. However, practical benefits require further…

量子物理 · 物理学 2024-08-05 Michael Kölle , Daniel Seidl , Maximilian Zorn , Philipp Altmann , Jonas Stein , Thomas Gabor

Today, large language models have demonstrated their strengths in various tasks ranging from reasoning, code generation, and complex problem solving. However, this advancement comes with a high computational cost and memory requirements,…

机器学习 · 计算机科学 2026-03-26 Meriem Bouzouad , Yuan-Hao Chang , Jalil Boukhobza

We present BenchRL-QAS, a unified benchmarking framework for reinforcement learning (RL) in quantum architecture search (QAS) across a spectrum of variational quantum algorithm tasks on 2- to 8-qubit systems. Our study systematically…

量子物理 · 物理学 2025-09-30 Azhar Ikhtiarudin , Aditi Das , Param Thakkar , Akash Kundu

Post-Training Quantization (PTQ) is essential for deploying Large Language Models (LLMs) on memory-constrained devices, yet it renders models static and difficult to fine-tune. Standard fine-tuning paradigms, including Reinforcement…

机器学习 · 计算机科学 2026-02-04 Yinggan Xu , Risto Miikkulainen , Xin Qiu

Large Language Models (LLMs) have advanced rapidly but face significant memory demands. While quantization has shown promise for LLMs, current methods typically require lengthy training to alleviate the performance degradation from…

人工智能 · 计算机科学 2024-05-31 Ke Yi , Yuhui Xu , Heng Chang , Chen Tang , Yuan Meng , Tong Zhang , Jia Li

The Qwen series has emerged as a leading family of open-source Large Language Models (LLMs), demonstrating remarkable capabilities in natural language understanding tasks. With the recent release of Qwen3, which exhibits superior…

机器学习 · 计算机科学 2025-05-06 Xingyu Zheng , Yuye Li , Haoran Chu , Yue Feng , Xudong Ma , Jie Luo , Jinyang Guo , Haotong Qin , Michele Magno , Xianglong Liu

As inference on Large Language Models (LLMs) emerges as an important workload in machine learning applications, weight quantization has become a standard technique for efficient GPU deployment. Quantization not only reduces model size, but…

机器学习 · 计算机科学 2024-08-22 Elias Frantar , Roberto L. Castro , Jiale Chen , Torsten Hoefler , Dan Alistarh

Inspired by the power of large language models (LLMs), our research adapts them to quantum federated learning (QFL) to boost efficiency and performance. We propose a federated fine-tuning method that distills an LLM within QFL, allowing…

机器学习 · 计算机科学 2025-05-27 Dev Gurung , Shiva Raj Pokhrel

One approach to reducing the massive costs of large language models (LLMs) is the use of quantized or sparse representations for training or deployment. While post-training compression methods are very popular, the question of obtaining…

机器学习 · 计算机科学 2025-06-12 Andrei Panferov , Jiale Chen , Soroush Tabesh , Roberto L. Castro , Mahdi Nikdan , Dan Alistarh