English
Related papers

Related papers: Trend-Based SAC Beam Control Method with Zero-Shot…

200 papers

Adopting reasonable strategies is challenging but crucial for an intelligent agent with limited resources working in hazardous, unstructured, and dynamic environments to improve the system's utility, decrease the overall cost, and increase…

Artificial Intelligence · Computer Science 2023-12-06 Qin Yang , Ramviyas Parasuraman

We present GuidedSAC, a novel reinforcement learning (RL) algorithm that facilitates efficient exploration in vast state-action spaces. GuidedSAC leverages large language models (LLMs) as intelligent supervisors that provide action-level…

Machine Learning · Computer Science 2026-03-19 Hao Ma , Zhiqiang Pu , Xiaolin Ai , Huimu Wang

This paper proposes a new Reinforcement Learning (RL) based control architecture for quadrotors. With the literature focusing on controlling the four rotors' RPMs directly, this paper aims to control the quadrotor's thrust vector. The RL…

Robotics · Computer Science 2025-12-23 Youssef Mahran , Zeyad Gamal , Ayman El-Badawy

High-precision control tasks present substantial challenges for reinforcement learning (RL) algorithms, frequently resulting in suboptimal performance attributed to network approximation inaccuracies and inadequate sample quality.These…

Machine Learning · Computer Science 2025-02-05 Donghe Chen , Yubin Peng , Tengjie Zheng , Han Wang , Chaoran Qu , Lin Cheng

Beam management, including initial access (IA) and beam tracking, is essential to the millimeter-wave Unmanned Aerial Vehicle (UAV) network. However, conventional communication-only and feedback-based schemes suffer a high delay and low…

Signal Processing · Electrical Eng. & Systems 2023-10-13 Yanpeng Cui , Qixun Zhang , Zhiyong Feng , Qin Wen , Ying Zhou , Zhiqing Wei , Ping Zhang

In this paper, we explore cooperative sensing and communication within cell-free integrated sensing and communication (ISAC) systems. Specifically, multiple transmit access points (APs) collaboratively serve multiple communication users…

Signal Processing · Electrical Eng. & Systems 2025-02-17 Rang Liu , Ming Li , Qian Liu

Plasma shape control in tokamaks requires a real-time controller that tracks dynamically changing shape targets while tolerating diagnostic failures. Classical approaches decompose the problem into equilibrium reconstruction followed by a…

Reinforcement learning (RL) is a core approach for robot control when expert demonstrations are unavailable. On-policy methods such as Proximal Policy Optimization (PPO) are widely used for their stability, but their reliance on narrowly…

Recent advances in deep Reinforcement Learning (RL) have created unprecedented opportunities for intelligent automation, where a machine can autonomously learn an optimal policy for performing a given task. However, current deep RL…

Machine Learning · Computer Science 2021-05-27 Zohreh Raziei , Mohsen Moghaddam

Recent works have validated the possibility of improving energy efficiency in radio access networks (RANs), achieved by dynamically turning on/off some base stations (BSs). In this paper, we extend the research over BS switching operations,…

Networking and Internet Architecture · Computer Science 2014-04-07 Rongpeng Li , Zhifeng Zhao , Xianfu Chen , Jacques Palicot , Honggang Zhang

This paper proposes a sliding mode controller with smooth control effort for a class of nonlinear plants. The proposed controller is created by allowing some constant parameters of the earlier smooth sliding control (SSC) to vary as a…

Systems and Control · Electrical Eng. & Systems 2023-10-31 Alessandro Jacoud Peixoto , Wenderson G. Serrantola , Fernando Lizarralde

This paper presents the Relaxed Continuous-Time Actor-critic (RCTAC) algorithm, a method for finding the nearly optimal policy for nonlinear continuous-time (CT) systems with known dynamics and infinite horizon, such as the path-tracking…

Systems and Control · Electrical Eng. & Systems 2023-03-31 Jingliang Duan , Jie Li , Qiang Ge , Shengbo Eben Li , Monimoy Bujarbaruah , Fei Ma , Dezhao Zhang

The performance of deep reinforcement learning methods prone to degenerate when applied to environments with non-stationary dynamics. In this paper, we utilize the latent context recurrent encoders motivated by recent Meta-RL materials, and…

Machine Learning · Computer Science 2021-05-11 Yuan Pu , Shaochen Wang , Xin Yao , Bin Li

Advances in Reinforcement Learning (RL) have demonstrated data efficiency and optimal control over large state spaces at the cost of scalable performance. Genetic methods, on the other hand, provide scalability but depict hyperparameter…

Machine Learning · Computer Science 2021-01-19 Karush Suri , Xiao Qi Shi , Konstantinos N. Plataniotis , Yuri A. Lawryshyn

When creating new reinforcement learning tasks, practitioners often accelerate the learning process by incorporating into the task several accessory components, such as breaking the environment interaction into independent episodes and…

Machine Learning · Computer Science 2025-12-09 Homayoon Farrahi , A. Rupam Mahmood

This paper presents iterative Sequential Action Control (iSAC), a receding horizon approach for control of nonlinear systems. The iSAC method has a closed-form open-loop solution, which is iteratively updated between time steps by…

Robotics · Computer Science 2018-11-01 Emmanouil Tzorakoleftherakis , Todd Murphey

The synthetic control method (SCM) estimates causal effects in panel data with a single-treated unit by constructing a counterfactual outcome as a weighted combination of untreated control units that matches the pre-treatment trajectory. In…

Machine Learning · Statistics 2026-05-13 Yuxin Wang , Dennis Frauen , Emil Javurek , Konstantin Hess , Yuchen Ma , Stefan Feuerriegel

Traditional reinforcement learning (RL) methods typically employ a fixed control loop, where each cycle corresponds to an action. This rigidity poses challenges in practical applications, as the optimal control frequency is task-dependent.…

Machine Learning · Computer Science 2024-06-04 Dong Wang , Giovanni Beltrame

Existing FEL facilities often suffer from stability issues: so electron orbit, transverse electron optics, electron bunch compression and other parameters have to be readjusted often to account for drifts in performance of various…

Accelerator Physics · Physics 2017-04-11 I. Agapov , G. Geloni , S. Tomin , I. Zagorodnov

Teleoperation of low-cost manipulators is attracting increasing attention as a practical means of collecting demonstration data for imitation learning. However, most existing systems rely on unilateral control without force feedback, which…

Robotics · Computer Science 2026-03-06 Koki Yamane , Yunhan Li , Masashi Konosu , Koki Inami , Junji Oaki , Toshiaki Tsuji , Sho Sakaino