English
Related papers

Related papers: Reinforcement Learning-enabled Satellite Constella…

200 papers

Reinforcement learning (RL) in continuous state-action spaces remains challenging in scientific computing due to poor sample efficiency and lack of pathwise physical consistency. We introduce Differential Reinforcement Learning…

Machine Learning · Computer Science 2026-02-06 Minh Nguyen , Chandrajit Bajaj

Offline reinforcement learning (RL) is challenged by the distributional shift between learning policies and datasets. To address this problem, existing works mainly focus on designing sophisticated algorithms to explicitly or implicitly…

Machine Learning · Computer Science 2022-10-18 Yang Yue , Bingyi Kang , Xiao Ma , Zhongwen Xu , Gao Huang , Shuicheng Yan

This research introduces a novel application of a masked Proximal Policy Optimization (PPO) algorithm from the field of deep reinforcement learning (RL), for determining the most efficient sequence of space debris visitation, utilizing the…

Machine Learning · Computer Science 2024-09-26 Agni Bandyopadhyay , Guenther Waxenegger-Wilfing

In sequential decision-making problems, Return-Conditioned Supervised Learning (RCSL) has gained increasing recognition for its simplicity and stability in modern decision-making tasks. Unlike traditional offline reinforcement learning (RL)…

Machine Learning · Computer Science 2025-06-11 Zhishuai Liu , Yu Yang , Ruhan Wang , Pan Xu , Dongruo Zhou

Satellite constellations equipped with Inter-Satellite Links and onboard packet switching enable real-time Operation and Management across globally distributed satellites, but also broaden the attack surface and introduce unprecedented…

Computational Engineering, Finance, and Science · Computer Science 2026-05-26 Linan Huang , Peilong Liu , Xi Chen , Zhiyuan Lin , Jian Yan , Linling Kuang

The development of robotic systems for palletization in logistics scenarios is of paramount importance, addressing critical efficiency and precision demands in supply chain management. This paper investigates the application of…

Robotics · Computer Science 2024-04-09 Zheng Wu , Yichuan Li , Wei Zhan , Changliu Liu , Yun-Hui Liu , Masayoshi Tomizuka

Advancements in artificial intelligence (AI) and low-earth orbit (LEO) satellites have promoted the application of large remote sensing foundation models for various downstream tasks. However, direct downloading of these models for…

Machine Learning · Computer Science 2025-08-01 Yan Zhu , Jingyang Zhu , Ting Wang , Yuanming Shi , Chunxiao Jiang , Khaled Ben Letaief

This study investigates the effectiveness of reinforcement learning (RL) fine-tuning techniques on a compact language model (Qwen2.5-0.5B Base) for two challenging tasks: instruction following and mathematical reasoning. We compare…

Computation and Language · Computer Science 2025-07-29 Yifu Han , Geo Zhang

Reinforcement Learning (RL) approaches are lately deployed for orchestrating wireless communications empowered by Reconfigurable Intelligent Surfaces (RISs), leveraging their online optimization capabilities. Most commonly, in RL-based…

Information Theory · Computer Science 2022-04-19 Kyriakos Stylianopoulos , George C. Alexandropoulos

The challenge of spatial resource allocation is pervasive across various domains such as transportation, industry, and daily life. As the scale of real-world issues continues to expand and demands for real-time solutions increase,…

Machine Learning · Computer Science 2024-03-08 Di Zhang , Moyang Wang , Joseph Mango , Xiang Li , Xianrui Xu

While deep reinforcement learning (RL) has fueled multiple high-profile successes in machine learning, it is held back from more widespread adoption by its often poor data efficiency and the limited generality of the policies it produces. A…

Machine Learning · Computer Science 2025-05-30 Jacob Beck , Risto Vuorio , Evan Zheran Liu , Zheng Xiong , Luisa Zintgraf , Chelsea Finn , Shimon Whiteson

Assemblies of modular subsystems are being pressed into service to perform sensing, reasoning, and decision making in high-stakes, time-critical tasks in such areas as transportation, healthcare, and industrial automation. We address the…

Machine Learning · Computer Science 2019-05-15 Aditya Modi , Debadeepta Dey , Alekh Agarwal , Adith Swaminathan , Besmira Nushi , Sean Andrist , Eric Horvitz

Reinforcement learning (RL) algorithms are designed to optimize problem-solving by learning actions that maximize rewards, a task that becomes particularly challenging in random and nonstationary environments. Even advanced RL algorithms…

Machine Learning · Computer Science 2025-10-31 Sebastian Zieglmeier , Niklas Erdmann , Narada D. Warakagoda

In this work, we study model-based reinforcement learning (RL) in unknown stabilizable linear dynamical systems. When learning a dynamical system, one needs to stabilize the unknown dynamics in order to avoid system blow-ups. We propose an…

Machine Learning · Computer Science 2022-06-06 Sahin Lale , Kamyar Azizzadenesheli , Babak Hassibi , Anima Anandkumar

This paper investigates a lightweight deep reinforcement learning (DRL)-assisted weighting framework for CSI-free multi-satellite positioning in LEO constellations, where each visible satellite provides one serving beam (one pilot response)…

Signal Processing · Electrical Eng. & Systems 2026-03-18 Po-Heng Chou , Chiapin Wang , Kuan-Hao Chen , Wei-Chen Hsiao

This work studies reinforcement learning (RL) in the context of multi-period supply chains subject to constraints, e.g., on production and inventory. We introduce Distributional Constrained Policy Optimization (DCPO), a novel approach for…

Machine Learning · Computer Science 2023-02-06 Jaime Sabal Bermúdez , Antonio del Rio Chanona , Calvin Tsay

In this paper, we study the outage minimization problem in a decode-and-forward cooperative network with relay uncertainty. To reduce the outage probability and improve the quality of service, existing researches usually rely on the…

Information Theory · Computer Science 2022-05-19 Yuanzhe Geng , Erwu Liu , Rui Wang , Pengcheng Sun , Binyu Lu

The use of reinforcement learning (RL) in scientific applications, such as materials design and automated chemistry, is increasing. A major challenge, however, lies in fact that measuring the state of the system is often costly and time…

Machine Learning · Computer Science 2022-04-08 Colin Bellinger , Andriy Drozdyuk , Mark Crowley , Isaac Tamblyn

The recent growing trend to develop large-scale satellite constellations (i.e., mega-constellation) with low-cost small satellites has brought the need for an efficient and scalable maintenance strategy decision plan. Traditional spare…

Optimization and Control · Mathematics 2019-11-28 Pauline C. M. Jakob , Seiichi Shimizu , Shoji Yoshikawa , Koki Ho

This paper investigates the use of Reinforcement Learning for the robust design of low-thrust interplanetary trajectories in presence of severe disturbances, modeled alternatively as Gaussian additive process noise, observation noise,…

Machine Learning · Computer Science 2020-08-20 Alessandro Zavoli , Lorenzo Federici