English
Related papers

Related papers: An FPGA-Based On-Device Reinforcement Learning App…

200 papers

The goal of robust reinforcement learning (RL) is to learn a policy that is robust against the uncertainty in model parameters. Parameter uncertainty commonly occurs in many real-world RL applications due to simulator modeling errors,…

Machine Learning · Computer Science 2022-10-19 Kishan Panaganti , Zaiyan Xu , Dileep Kalathil , Mohammad Ghavamzadeh

Despite the proliferation of diverse hardware accelerators (e.g., NPU, TPU, DPU), deploying deep learning models on edge devices with fixed-point hardware is still challenging due to complex model quantization and conversion. Existing model…

Machine Learning · Computer Science 2023-08-07 Manasa Manohara , Sankalp Dayal , Tariq Afzal , Rahul Bakshi , Kahkuen Fu

This paper introduces the problem of learning to place logic blocks in Field-Programmable Gate Arrays (FPGAs) and a learning-based method. In contrast to previous search-based placement algorithms, we instead employ Reinforcement Learning…

Hardware Architecture · Computer Science 2024-04-23 Shang Wang , Deepak Ranganatha Sastry Mamillapalli , Tianpei Yang , Matthew E. Taylor

Deep Q-learning algorithms often suffer from poor gradient estimations with an excessive variance, resulting in unstable training and poor sampling efficiency. Stochastic variance-reduced gradient methods such as SVRG have been applied to…

Machine Learning · Computer Science 2020-07-28 Haonan Jia , Xiao Zhang , Jun Xu , Wei Zeng , Hao Jiang , Xiaohui Yan , Ji-Rong Wen

Extreme Learning Machine (ELM) is an efficient and effective least-square-based learning algorithm for classification, regression problems based on single hidden layer feed-forward neural network (SLFN). It has been shown in the literature…

Machine Learning · Computer Science 2020-11-05 Ramesh Ragala , Bharadwaja kumar

Deep reinforcement learning has successfully been applied for molecular discovery as shown by the Molecule Deep Q-network (MolDQN) algorithm. This algorithm has challenges when applied to optimizing new molecules: training such a model is…

Machine Learning · Computer Science 2023-12-05 Huanyi Qin , Denis Akhiyarov , Sophie Loehle , Kenneth Chiu , Mauricio Araya-Polo

Deep Reinforcement Learning (DRL) is gaining attention as a potential approach to design trajectories for autonomous unmanned aerial vehicles (UAV) used as flying access points in the context of cellular or Internet of Things (IoT)…

Information Theory · Computer Science 2022-02-07 Omid Esrafilian , Harald Bayerlein , David Gesbert

Reinforcement learning is time-consuming for complex tasks due to the need for large amounts of training data. Recent advances in GPU-based simulation, such as Isaac Gym, have sped up data collection thousands of times on a commodity GPU.…

Machine Learning · Computer Science 2023-07-25 Zechu Li , Tao Chen , Zhang-Wei Hong , Anurag Ajay , Pulkit Agrawal

Model-based offline reinforcement learning (RL) is a compelling approach that addresses the challenge of learning from limited, static data by generating imaginary trajectories using learned models. However, these approaches often struggle…

Machine Learning · Computer Science 2024-12-04 Kwanyoung Park , Youngwoon Lee

To realize the full potential of quantum technologies, finding good strategies to control quantum information processing devices in real time becomes increasingly important. Usually these strategies require a precise understanding of the…

In this work, we present two Deep Reinforcement Learning (Deep-RL) approaches to enhance the problem of mapless navigation for a terrestrial mobile robot. Our methodology focus on comparing a Deep-RL technique based on the Deep Q-Network…

Thanks to its robust learning and search stabilities,the reinforcement learning (RL) algorithm has garnered increasingly significant attention and been exten-sively applied in Automated Guided Vehicle (AGV) path planning. However, RL-based…

Robotics · Computer Science 2024-05-24 Shao Shuo

Deep learning-based image compression (LIC) has achieved state-of-the-art rate-distortion (RD) performance, yet deploying these models on resource-constrained FPGAs remains a major challenge. This work presents a complete, multi-stage…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Jiaxun Fang , Li Chen

Huge computational costs brought by convolution and batch normalization (BN) have caused great challenges for the online training and corresponding applications of deep neural networks (DNNs), especially in resource-limited devices.…

Machine Learning · Computer Science 2021-05-31 Yukuan Yang , Xiaowei Chi , Lei Deng , Tianyi Yan , Feng Gao , Guoqi Li

Instability and variability of Deep Reinforcement Learning (DRL) algorithms tend to adversely affect their performance. Averaged-DQN is a simple extension to the DQN algorithm, based on averaging previously learned Q-values estimates, which…

Artificial Intelligence · Computer Science 2017-03-13 Oron Anschel , Nir Baram , Nahum Shimkin

We study reinforcement learning (RL) in high dimensional episodic Markov decision processes (MDP). We consider value-based RL when the optimal Q-value is a linear function of d-dimensional state-action feature representation. For instance,…

Artificial Intelligence · Computer Science 2019-09-10 Kamyar Azizzadenesheli , Animashree Anandkumar

Rotation-based Post-Training Quantization (PTQ) has emerged as a promising solution for mitigating activation outliers in the quantization of Large Language Models (LLMs). Global rotation methods achieve inference efficiency by fusing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Suyoung Kim , Sunghyun Wee , Hyeonjin Kim , Kyomin Hwang , Hyunho Lee , Nojun Kwak

This paper proposes an Improved Noisy Deep Q-Network (Noisy DQN) to enhance the exploration and stability of Unmanned Aerial Vehicle (UAV) when applying deep reinforcement learning in simulated environments. This method enhances the…

Systems and Control · Electrical Eng. & Systems 2026-02-06 Zhang Hengyu , Maryam Cheraghy , Liu Wei , Armin Farhadi , Meysam Soltanpour , Zhong Zhuoqing

In mobile edge computing systems, an edge node may have a high load when a large number of mobile devices offload their tasks to it. Those offloaded tasks may experience large processing delay or even be dropped when their deadlines expire.…

Networking and Internet Architecture · Computer Science 2020-05-07 Ming Tang , Vincent W. S. Wong

In human decision-making tasks, individuals learn through trials and prediction errors. When individuals learn the task, some are more influenced by good outcomes, while others weigh bad outcomes more heavily. Such confirmation bias can…

Machine Learning · Computer Science 2024-08-09 Jiacheng Shen , Lihan Feng