English
Related papers

Related papers: IA2: Leveraging Instance-Aware Index Advisor with …

200 papers

Evolutionary Algorithms (EAs) and Deep Reinforcement Learning (DRL) have recently been integrated to take the advantage of the both methods for better exploration and exploitation.The evolutionary part in these hybrid methods maintains a…

Neural and Evolutionary Computing · Computer Science 2022-09-19 Yan Ma , Tianxing Liu , Bingsheng Wei , Yi Liu , Kang Xu , Wei Li

While a powerful and promising approach, deep reinforcement learning (DRL) still suffers from sample inefficiency, which can be notably improved by resorting to more sophisticated techniques to address the exploration-exploitation dilemma.…

Machine Learning · Computer Science 2024-09-10 Jianshu Hu , Paul Weng , Yutong Ban

This paper investigates the resilience and robustness of Deep Reinforcement Learning (DRL) policies to adversarial perturbations in the state space. We first present an approach for the disentanglement of vulnerabilities caused by…

Machine Learning · Computer Science 2024-09-23 Vahid Behzadan , William Hsu

Hierarchical Reinforcement Learning (HRL) is well-suitedd for solving complex tasks by breaking them down into structured policies. However, HRL agents often struggle with efficient exploration and quick adaptation. To overcome these…

Machine Learning · Computer Science 2025-03-18 Arash Khajooeinejad , Fatemeh Sadat Masoumi , Masoumeh Chapariniya

Mobile edge computing (MEC) is a promising paradigm for real-time applications with intensive computational needs (e.g., autonomous driving), as it can reduce the processing delay. In this work, we focus on the timeliness of…

Machine Learning · Computer Science 2023-12-20 Lyudong Jin , Ming Tang , Meng Zhang , Hao Wang

Service Function Chaining (SFC) requires efficient placement of Virtual Network Functions (VNFs) to satisfy diverse service requirements while maintaining high resource utilization in Data Centers (DCs). Conventional static resource…

Networking and Internet Architecture · Computer Science 2026-01-29 Parisa Fard Moshiri , Poonam Lohan , Burak Kantarci , Emil Janulewicz

The efficient deployment and fine-tuning of foundation models are pivotal in contemporary artificial intelligence. In this study, we present a groundbreaking paradigm integrating Mobile Edge Computing (MEC) with foundation models,…

Artificial Intelligence · Computer Science 2023-10-27 Wenhan Yu , Terence Jie Chua , Jun Zhao

Integrating artificial intelligence (AI) into wireless networks has drawn significant interest in both industry and academia. A common solution is to replace partial or even all modules in the conventional systems, which is often lack of…

Information Theory · Computer Science 2019-07-24 Jian Wang , Chen Xu , Yourui Huangfu , Rong Li , Yiqun Ge , Jun Wang

In this paper, the downlink packet scheduling problem for cellular networks is modeled, which jointly optimizes throughput, fairness and packet drop rate. Two genie-aided heuristic search methods are employed to explore the solution space.…

Information Theory · Computer Science 2019-11-14 Chen Xu , Jian Wang , Tianhang Yu , Chuili Kong , Yourui Huangfu , Rong Li , Yiqun Ge , Jun Wang

Learned Index Structures (LIS) have significantly advanced data management by leveraging machine learning models to optimize data indexing. However, designing these structures often involves critical trade-offs, making it challenging for…

Databases · Computer Science 2025-02-19 Taiyi Wang , Liang Liang , Guang Yang , Thomas Heinis , Eiko Yoneki

The options framework in Hierarchical Reinforcement Learning breaks down overall goals into a combination of options or simpler tasks and associated policies, allowing for abstraction in the action space. Ideally, these options can be…

Machine Learning · Computer Science 2022-06-14 Kushal Chauhan , Soumya Chatterjee , Akash Reddy , Balaraman Ravindran , Pradeep Shenoy

Learning from demonstrations has made great progress over the past few years. However, it is generally data hungry and task specific. In other words, it requires a large amount of data to train a decent model on a particular task, and the…

Machine Learning · Computer Science 2021-03-29 Pin Wang , Hanhan Li , Ching-Yao Chan

Efficient job scheduling on data centers under heterogeneous complexity is crucial but challenging since it involves the allocation of multi-dimensional resources over time and space. To adapt the complex computing environment in data…

Operating Systems · Computer Science 2020-03-03 Sisheng Liang , Zhou Yang , Fang Jin , Yong Chen

We propose a novel offline reinforcement learning (offline RL) approach, introducing the Diffusion-model-guided Implicit Q-learning with Adaptive Revaluation (DIAR) framework. We address two key challenges in offline RL: out-of-distribution…

Machine Learning · Computer Science 2024-10-16 Jaehyun Park , Yunho Kim , Sejin Kim , Byung-Jun Lee , Sundong Kim

This article proposes a model-based deep reinforcement learning (DRL) method to design emergency control strategies for short-term voltage stability problems in power systems. Recent advances show promising results in model-free DRL-based…

Systems and Control · Electrical Eng. & Systems 2022-12-07 Ramij R. Hossain , Tianzhixi Yin , Yan Du , Renke Huang , Jie Tan , Wenhao Yu , Yuan Liu , Qiuhua Huang

In delay-sensitive industrial internet of things (IIoT) applications, the age of information (AoI) is employed to characterize the freshness of information. Meanwhile, the emerging network function virtualization provides flexibility and…

Signal Processing · Electrical Eng. & Systems 2021-05-11 Mohammad Akbari , Mohammad Reza Abedi , Roghayeh Joda , Mohsen Pourghasemian , Nader Mokari , Melike Erol-Kantarci

Continuous-action policies trained on a single demonstrated trajectory per scene suffer from mode collapse: samples cluster around the demonstrated maneuver and the policy cannot represent semantically distinct alternatives. Under…

Robotics · Computer Science 2026-05-15 Hengtong Lu , Victor Shea-Jay Huang , Chengmin Yang , Pengfei Jing , Jifeng Dai , Yan Xie , Benjin Zhu

In this paper, we investigate a resource allocation and model retraining problem for dynamic wireless networks by utilizing incremental learning, in which the digital twin (DT) scheme is employed for decision making. A two-timescale…

Signal Processing · Electrical Eng. & Systems 2024-11-28 Jiayi Cong , Guoliang Cheng , Changsheng You , Xinyu Huang , Wen Wu

Researchers have demonstrated that Deep Reinforcement Learning (DRL) is a powerful tool for finding policies that perform well on complex robotic systems. However, these policies are often unpredictable and can induce highly variable…

Robotics · Computer Science 2022-03-08 Sean Gillen , Asutay Ozmen , Katie Byl

With the continuous increase of IoT applications, their effective scheduling in edge and cloud computing has become a critical challenge. The inherent dynamism and stochastic characteristics of edge and cloud computing, along with IoT…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-01 Zhiyu Wang , Mohammad Goudarzi , Rajkumar Buyya