English
Related papers

Related papers: Conservative quantum offline model-based optimizat…

200 papers

Reinforcement learning (RL) provides a principled framework for decision-making in partially observable environments, which can be modeled as Markov decision processes and compactly represented through dynamic decision Bayesian networks.…

Quantum Physics · Physics 2025-07-25 Gilberto Cunha , Alexandra Ramôa , André Sequeira , Michael de Oliveira , Luís Barbosa

In offline model-based reinforcement learning (offline MBRL), we learn a dynamic model from historically collected data, and subsequently utilize the learned model and fixed datasets for policy learning, without further interacting with the…

Machine Learning · Computer Science 2022-10-13 Shentao Yang , Shujian Zhang , Yihao Feng , Mingyuan Zhou

Offline Reinforcement Learning (RL), which operates solely on static datasets without further interactions with the environment, provides an appealing alternative to learning a safe and promising control policy. The prevailing methods…

Machine Learning · Computer Science 2025-03-18 Kun Wu , Yinuo Zhao , Zhiyuan Xu , Zhengping Che , Chengxiang Yin , Chi Harold Liu , Feiferi Feng , Jian Tang

In this work, we introduce a novel Quadratic Binary Optimization (QBO) framework for training a quantized neural network. The framework enables the use of arbitrary activation and loss functions through spline interpolation, while Forward…

Machine Learning · Computer Science 2025-12-09 Wenxin Li , Chuan Wang , Hongdong Zhu , Qi Gao , Yin Ma , Hai Wei , Kai Wen

Model-based reinforcement learning (RL), which learns an environment model from the offline dataset and generates more out-of-distribution model data, has become an effective approach to the problem of distribution shift in offline RL. Due…

Recent progress in Meta-Black-Box-Optimization (MetaBBO) has demonstrated that using RL to learn a meta-level policy for dynamic algorithm configuration (DAC) over an optimization task distribution could significantly enhance the…

Neural and Evolutionary Computing · Computer Science 2025-05-06 Zeyuan Ma , Zhiguang Cao , Zhou Jiang , Hongshu Guo , Yue-Jiao Gong

In this work we revisit the Mobility Robustness Optimisation (MRO) algorithm and study the possibility of learning the optimal Cell Individual Offset tuning using offline Reinforcement Learning. Such methods make use of collected offline…

Networking and Internet Architecture · Computer Science 2025-07-01 Pegah Alizadeh , Anastasios Giovanidis , Pradeepa Ramachandra , Vasileios Koutsoukis , Osama Arouk

Offline multi-agent reinforcement learning is challenging due to the coupling effect of both distribution shift issue common in offline setting and the high dimension issue common in multi-agent setting, making the action…

Artificial Intelligence · Computer Science 2023-09-25 Jianzhun Shao , Yun Qu , Chen Chen , Hongchang Zhang , Xiangyang Ji

Quantum machine learning (QML) leverages quantum states for data encoding, with key approaches being explicit models that use parameterized quantum circuits and implicit models that use quantum kernels. Implicit models often have lower…

Quantum Physics · Physics 2025-12-08 Akimoto Nakayama , Hayata Morisaki , Kosuke Mitarai , Hiroshi Ueda , Keisuke Fujii

In this paper, we propose a model-based offline reinforcement learning method that integrates count-based conservatism, named $\texttt{Count-MORL}$. Our method utilizes the count estimates of state-action pairs to quantify model estimation…

Machine Learning · Computer Science 2023-07-24 Byeongchan Kim , Min-hwan Oh

Model-based optimization, in concert with conventional black-box methods, can quickly solve large-scale combinatorial problems. Recently, quantum-inspired modeling schemes based on tensor networks have been developed which have the…

Offline reinforcement learning (RL) aims to find performant policies from logged data without further environment interaction. Model-based algorithms, which learn a model of the environment from the dataset and perform conservative policy…

Machine Learning · Computer Science 2022-10-12 Marc Rigter , Bruno Lacerda , Nick Hawes

Black box optimization (BBO) focuses on optimizing unknown functions in high-dimensional spaces. In many applications, sampling the unknown function is expensive, imposing a tight sample budget. Ongoing work is making progress on reducing…

Machine Learning · Computer Science 2025-07-29 Rajalaxmi Rajagopalan , Yu-Lin Wei , Romit Roy Choudhury

Offline or batch reinforcement learning seeks to learn a near-optimal policy using history data without active exploration of the environment. To counter the insufficient coverage and sample scarcity of many offline datasets, the principle…

Machine Learning · Computer Science 2022-06-14 Laixi Shi , Gen Li , Yuting Wei , Yuxin Chen , Yuejie Chi

Model-based offline reinforcement learning (RL), which builds a supervised transition model with logging dataset to avoid costly interactions with the online environment, has been a promising approach for offline policy optimization. As the…

Machine Learning · Computer Science 2023-09-06 Junming Yang , Xingguo Chen , Shengyuan Wang , Bolei Zhang

Reinforcement learning (RL) has been widely adopted for controlling and optimizing complex engineering systems such as next-generation wireless networks. An important challenge in adopting RL is the need for direct access to the physical…

Machine Learning · Computer Science 2024-11-19 Eslam Eldeeb , Houssem Sifaou , Osvaldo Simeone , Mohammad Shehab , Hirley Alves

Online black-box optimization (BBO) aims to optimize an objective function by iteratively querying a black-box oracle in a sample-efficient way. While prior studies focus on forward approaches such as Gaussian Processes (GPs) to learn a…

Machine Learning · Computer Science 2025-02-04 Dongxia Wu , Nikki Lijing Kuang , Ruijia Niu , Yi-An Ma , Rose Yu

Bayesian optimization (BO) is a sequential approach for optimizing black-box objective functions using zeroth-order noisy observations. In BO, Gaussian processes (GPs) are employed as probabilistic surrogate models to estimate the objective…

Machine Learning · Computer Science 2025-04-02 Dongwon Kim , Matteo Zecchin , Sangwoo Park , Joonhyuk Kang , Osvaldo Simeone

Black-Box Optimization (BBO) methods can find optimal policies for systems that interact with complex environments with no analytical representation. As such, they are of interest in many Artificial Intelligence (AI) domains. Yet classical…

Machine Learning · Computer Science 2020-06-17 Mor Sinay , Elad Sarafian , Yoram Louzoun , Noa Agmon , Sarit Kraus

For a wide range of applications the structure of systems like Neural Networks or complex simulations, is unknown and approximation is costly or even impossible. Black-box optimization seeks to find optimal (hyper-) parameters for these…

Machine Learning · Computer Science 2023-09-06 Janina Schreiber , Damar Wicaksono , Michael Hecht