English
Related papers

Related papers: Exploration and Anti-Exploration with Distribution…

200 papers

Dynamic spectrum access (DSA) is regarded as an effective and efficient technology to share radio spectrum among different networks. As a secondary user (SU), a DSA device will face two critical problems: avoiding causing harmful…

Machine Learning · Computer Science 2018-10-30 Hao-Hsuan Chang , Hao Song , Yang Yi , Jianzhong Zhang , Haibo He , Lingjia Liu

Unsupervised learning has been extensively adopted to train deep neural networks (DNNs) for learning wireless resource allocation. Yet, the performance of DNNs is vulnerable to distribution shifts between training and test data, e.g.,…

Signal Processing · Electrical Eng. & Systems 2026-03-03 Shengjie Liu , Chenyang Yang

We propose a distributional framework for offline Inverse Reinforcement Learning (IRL) that jointly models uncertainty over reward functions and full distributions of returns. Unlike conventional IRL approaches that recover a deterministic…

Machine Learning · Computer Science 2026-05-29 Feiyang Wu , Ye Zhao , Anqi Wu

Deep neural networks (DNNs) have been widely used in many fields such as images processing, speech recognition; however, they are vulnerable to adversarial examples, and this is a security issue worthy of attention. Because the training…

Cryptography and Security · Computer Science 2019-08-08 Wenjian Luo , Chenwang Wu , Nan Zhou , Li Ni

In this paper, we introduce DistDD, a novel approach within the federated learning framework that reduces the need for repetitive communication by distilling data directly on clients' devices. Unlike traditional federated learning that…

Machine Learning · Computer Science 2024-10-14 Peiran Wang , Haohan Wang

The explore{exploit dilemma is one of the central challenges in Reinforcement Learning (RL). Bayesian RL solves the dilemma by providing the agent with information in the form of a prior distribution over environments; however, full…

Machine Learning · Computer Science 2012-03-19 Jonathan Sorg , Satinder Singh , Richard L. Lewis

Exploration is a crucial and distinctive aspect of reinforcement learning (RL) that remains a fundamental open problem. Several methods have been proposed to tackle this challenge. Commonly used methods inject random noise directly into the…

Machine Learning · Computer Science 2024-11-06 Sebastian Griesbach , Carlo D'Eramo

Dynamic distribution network reconfiguration (DNR) algorithms perform hourly status changes of remotely controllable switches to improve distribution system performance. The problem is typically solved by physical model-based control…

Systems and Control · Electrical Eng. & Systems 2020-06-24 Yuanqi Gao , Wei Wang , Jie Shi , Nanpeng Yu

This paper studies the potential of the return distribution for exploration in deterministic reinforcement learning (RL) environments. We study network losses and propagation mechanisms for Gaussian, Categorical and Gaussian mixture…

Machine Learning · Computer Science 2018-07-04 Thomas M. Moerland , Joost Broekens , Catholijn M. Jonker

Building robust online content recommendation systems requires learning complex interactions between user preferences and content features. The field has evolved rapidly in recent years from traditional multi-arm bandit and collaborative…

Information Retrieval · Computer Science 2018-05-08 Yoel Zeldes , Stavros Theodorakis , Efrat Solodnik , Aviv Rotman , Gil Chamiel , Dan Friedman

Stock trend forecasting has become a popular research direction that attracts widespread attention in the financial field. Though deep learning methods have achieved promising results, there are still many limitations, for example, how to…

Machine Learning · Computer Science 2020-12-14 Hongshun Tang , Lijun Wu , Weiqing Liu , Jiang Bian

Fine-tuning diffusion models via online reinforcement learning (RL) has shown great potential for enhancing text-to-image alignment. However, since precisely specifying a ground-truth objective for visual tasks remains challenging, the…

Machine Learning · Computer Science 2026-01-01 Haoran He , Yuxiao Ye , Jie Liu , Jiajun Liang , Zhiyong Wang , Ziyang Yuan , Xintao Wang , Hangyu Mao , Pengfei Wan , Ling Pan

Network slicing enables operators to efficiently support diverse applications on a common physical infrastructure. The ever-increasing densification of network deployment leads to complex and non-trivial inter-cell interference, which…

Networking and Internet Architecture · Computer Science 2023-06-21 Tianlun Hu , Qi Liao , Qiang Liu , Georg Carle

Despite the close connection between exploration and sample efficiency, most state of the art reinforcement learning algorithms include no considerations for exploration beyond maximizing the entropy of the policy. In this work we address…

In this paper, we propose a deep reinforcement learning (DRL) based mobility load balancing (MLB) algorithm along with a two-layer architecture to solve the large-scale load balancing problem for ultra-dense networks (UDNs). Our…

Machine Learning · Computer Science 2020-03-03 Yue Xu , Wenjun Xu , Zhi Wang , Jiaru Lin , Shuguang Cui

Traditional distributed deep reinforcement learning (RL) commonly relies on exchanging the experience replay memory (RM) of each agent. Since the RM contains all state observations and action policy history, it may incur huge communication…

Machine Learning · Computer Science 2020-05-18 Han Cha , Jihong Park , Hyesung Kim , Mehdi Bennis , Seong-Lyun Kim

Although deep reinforcement learning (DRL) algorithms have made important achievements in many control tasks, they still suffer from the problems of sample inefficiency and unstable training process, which are usually caused by sparse…

Robotics · Computer Science 2020-02-28 Ke Lin , Liang Gong , Xudong Li , Te Sun , Binhao Chen , Chengliang Liu , Zhengfeng Zhang , Jian Pu , Junping Zhang

Branch-and-bound is a systematic enumerative method for combinatorial optimization, where the performance highly relies on the variable selection strategy. State-of-the-art handcrafted heuristic strategies suffer from relatively slow…

Machine Learning · Computer Science 2022-06-15 Tianyu Zhang , Amin Banitalebi-Dehkordi , Yong Zhang

In online reinforcement learning (RL), efficient exploration remains particularly challenging in high-dimensional environments with sparse rewards. In low-dimensional environments, where tabular parameterization is possible, count-based…

Machine Learning · Computer Science 2021-06-21 Tianjun Zhang , Paria Rashidinejad , Jiantao Jiao , Yuandong Tian , Joseph Gonzalez , Stuart Russell

Despite their outstanding performance in a broad spectrum of real-world tasks, deep artificial neural networks are sensitive to input noises, particularly adversarial perturbations. On the contrary, human and animal brains are much less…

Neural and Evolutionary Computing · Computer Science 2022-05-23 Xiyuan Chen , Xingyu Li , Yi Zhou , Tianming Yang