English
Related papers

Related papers: DCoPilot: Generative AI-Empowered Policy Adaptatio…

200 papers

To alleviate hardware scarcity in training large deep neural networks (DNNs), particularly large language models (LLMs), we present FusionLLM, a decentralized training system designed and implemented for training DNNs using geo-distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-17 Zhenheng Tang , Xueze Kang , Yiming Yin , Xinglin Pan , Yuxin Wang , Xin He , Qiang Wang , Rongfei Zeng , Kaiyong Zhao , Shaohuai Shi , Amelie Chi Zhou , Bo Li , Bingsheng He , Xiaowen Chu

Retrieval-Augmented Generation (RAG) has significantly advanced large language models (LLMs) by grounding their outputs in external tools and knowledge sources. However, existing RAG systems are typically constrained to static, single-turn…

Computation and Language · Computer Science 2025-07-22 Jubin Abhishek Soni , Amit Anand , Rajesh Kumar Pandey , Aniket Abhishek Soni

In this chapter, the regulation of Unmanned Aerial Vehicle (UAV) communication network is investigated in the presence of dynamic changes in the UAV lineup and user distribution. We target an optimal UAV control policy which is capable of…

Systems and Control · Electrical Eng. & Systems 2021-08-26 Ran Zhang , Duc Minh , Nguyen , Miao Wang , Lin X. Cai , Xuemin , Shen

Inter-Cell Interference Coordination (ICIC) is a promising way to improve energy efficiency in wireless networks, especially where small base stations are densely deployed. However, traditional optimization based ICIC schemes suffer from…

Networking and Internet Architecture · Computer Science 2019-02-22 Yujiao Lu , Hancheng Lu , Liangliang Cao , Feng Wu , Daren Zhu

The theory of continuous-time reinforcement learning (RL) has progressed rapidly in recent years. While the ultimate objective of RL is typically to learn deterministic control policies, most existing continuous-time RL methods rely on…

Machine Learning · Computer Science 2026-03-17 Ziheng Cheng , Xin Guo , Yufei Zhang

Rather than learning new control policies for each new task, it is possible, when tasks share some structure, to compose a "meta-policy" from previously learned policies. This paper reports results from experiments using Deep Reinforcement…

Artificial Intelligence · Computer Science 2017-11-07 Richard Liaw , Sanjay Krishnan , Animesh Garg , Daniel Crankshaw , Joseph E. Gonzalez , Ken Goldberg

Recent advancements in reinforcement learning (RL) demonstrate the significant potential in autonomous driving. Despite this promise, challenges such as the manual design of reward functions and low sample efficiency in complex environments…

Robotics · Computer Science 2025-01-10 Zengqi Peng , Yubin Wang , Xu Han , Lei Zheng , Jun Ma

Lane change is a challenging task which requires delicate actions to ensure safety and comfort. Some recent studies have attempted to solve the lane-change control problem with Reinforcement Learning (RL), yet the action is confined to…

Robotics · Computer Science 2019-06-07 Pin Wang , Hanhan Li , Ching-Yao Chan

The development of control policies for multi-robot systems traditionally follows a complex and labor-intensive process, often lacking the flexibility to adapt to dynamic tasks. This has motivated research on methods to automatically create…

Robotics · Computer Science 2025-11-03 Wenkang Ji , Huaben Chen , Mingyang Chen , Guobin Zhu , Lufeng Xu , Roderich Groß , Rui Zhou , Ming Cao , Shiyu Zhao

Autonomous Vehicles (AVs) are poised to revolutionize emergency services by enabling faster, safer, and more efficient responses. This transformation is driven by advances in Artificial Intelligence (AI), particularly Reinforcement Learning…

Artificial Intelligence · Computer Science 2026-02-23 Yousef Emami , Radha Reddy , Azadeh Pourkabirian , Miguel Gutierrez Gaitan

Many reinforcement learning (RL) tasks have discrete action spaces, but most generative policy methods based on diffusion and flow matching are designed for continuous control. Meanwhile, generative policies usually rely heavily on offline…

Machine Learning · Computer Science 2026-05-13 Fairoz Nower Khan , Nabuat Zaman Nahim , Peizhong Ju

In the dynamic landscape of Industry 4.0, achieving efficiency, precision, and adaptability is essential to optimize manufacturing operations. Industries suffer due to supply chain disruptions caused by anomalies, which are being detected…

Artificial Intelligence · Computer Science 2025-05-13 Chathurangi Shyalika , Renjith Prasad , Alaa Al Ghazo , Darssan Eswaramoorthi , Harleen Kaur , Sara Shree Muthuselvam , Amit Sheth

As machine learning workloads significantly increase energy consumption, sustainable data centers with low carbon emissions are becoming a top priority for governments and corporations worldwide. This requires a paradigm shift in optimizing…

Large language model (LLM) agents often suffer from high reasoning overhead, excessive token consumption, unstable execution, and inability to reuse past experiences in complex tasks like business queries, tool use, and workflow…

Machine Learning · Computer Science 2026-04-23 Ruocan Wei , Shufeng Wang , Ziwei Shi

Robot learning in high-dimensional control settings, such as humanoid locomotion, presents persistent challenges for reinforcement learning (RL) algorithms due to unstable dynamics, complex contact interactions, and sensitivity to…

Robotics · Computer Science 2025-05-21 Khang Nguyen , Khai Nguyen , An T. Le , Jan Peters , Manfred Huber , Ngo Anh Vien , Minh Nhat Vu

The growing scale and complexity of modern data centers present major challenges in balancing energy efficiency with outage risk. Although Deep Reinforcement Learning (DRL) shows strong potential for intelligent control, its deployment in…

Artificial Intelligence · Computer Science 2026-04-10 Qingang Zhang , Yuejun Yan , Guangyu Wu , Siew-Chien Wong , Jimin Jia , Zhaoyang Wang , Yonggang Wen

In robotics, contemporary strategies are learning-based, characterized by a complex black-box nature and a lack of interpretability, which may pose challenges in ensuring stability and safety. To address these issues, we propose integrating…

Robotics · Computer Science 2024-08-23 Mehdi Heydari Shahna , Seyed Adel Alizadeh Kolagar , Jouni Mattila

Collecting large amounts of real-world interaction data to train general robotic policies is often prohibitively expensive, thus motivating the use of simulation data. However, existing methods for data generation have generally focused on…

Machine Learning · Computer Science 2024-01-23 Lirui Wang , Yiyang Ling , Zhecheng Yuan , Mohit Shridhar , Chen Bao , Yuzhe Qin , Bailin Wang , Huazhe Xu , Xiaolong Wang

The growing complexity of cyber threats has rendered static firewalls increasingly ineffective for dynamic, real-time intrusion prevention. This paper proposes a novel AI-driven dynamic firewall optimization framework that leverages deep…

Cryptography and Security · Computer Science 2025-06-09 Taimoor Ahmad

We present differentiable predictive control (DPC), a method for learning constrained neural control policies for linear systems with probabilistic performance guarantees. We employ automatic differentiation to obtain direct policy…

Systems and Control · Electrical Eng. & Systems 2022-01-28 Jan Drgona , Aaron Tuor , Draguna Vrabie