English
Related papers

Related papers: Black-Box Combinatorial Optimization with Order-In…

200 papers

Model-based algorithms, which learn a dynamics model from logged experience and perform some sort of pessimistic planning under the learned model, have emerged as a promising paradigm for offline reinforcement learning (offline RL).…

Machine Learning · Computer Science 2022-01-28 Tianhe Yu , Aviral Kumar , Rafael Rafailov , Aravind Rajeswaran , Sergey Levine , Chelsea Finn

We propose an ensemble method to improve the generalization performance of trading strategies trained by deep reinforcement learning algorithms in a highly stochastic environment of intraday cryptocurrency portfolio trading. We adopt a…

Trading and Market Microstructure · Quantitative Finance 2023-09-06 Shuyang Wang , Diego Klabjan

This work concerns the evolutionary approaches to distributed stochastic black-box optimization, in which each worker can individually solve an approximation of the problem with nature-inspired algorithms. We propose a distributed evolution…

Neural and Evolutionary Computing · Computer Science 2022-04-12 Xiaoyu He , Zibin Zheng , Chuan Chen , Yuren Zhou , Chuan Luo , Qingwei Lin

Decision-making in complex, continuous multi-task environments is often hindered by the difficulty of obtaining accurate models for planning and the inefficiency of learning purely from trial and error. While precise environment dynamics…

Machine Learning · Computer Science 2025-03-20 Jeff Jewett , Sandhya Saisubramanian

This work proposes a unified control architecture that couples a Reinforcement Learning (RL)-driven controller with a disturbance-rejection Extended State Observer (ESO), complemented by an Event-Triggered Mechanism (ETM) to limit…

Optimization and Control · Mathematics 2026-01-01 Ningwei Bai , Chi Pui Chan , Qichen Yin , Tengyang Gong , Yunda Yan , Zezhi Tang

A practical challenge in reinforcement learning are combinatorial action spaces that make planning computationally demanding. For example, in cooperative multi-agent reinforcement learning, a potentially large number of agents jointly…

Distributionally robust policy learning aims to find a policy that performs well under the worst-case distributional shift, and yet most existing methods for robust policy learning consider the worst-case joint distribution of the covariate…

Machine Learning · Computer Science 2025-06-03 Jingyuan Wang , Zhimei Ren , Ruohan Zhan , Zhengyuan Zhou

Recent self-supervised contrastive methods have been able to produce impressive transferable visual representations by learning to be invariant to different data augmentations. However, these methods implicitly assume a particular set of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Tete Xiao , Xiaolong Wang , Alexei A. Efros , Trevor Darrell

Derivative-free optimization has become an important technique used in machine learning for optimizing black-box models. To conduct updates without explicitly computing gradient, most current approaches iteratively sample a random search…

Machine Learning · Statistics 2018-08-03 Liu Liu , Minhao Cheng , Cho-Jui Hsieh , Dacheng Tao

We tackle the blackbox issue of deep neural networks in the settings of reinforcement learning (RL) where neural agents learn towards maximizing reward gains in an uncontrollable way. Such learning approach is risky when the interacting…

Machine Learning · Computer Science 2018-11-13 John Yang , Gyujeong Lee , Minsung Hyun , Simyung Chang , Nojun Kwak

Distributionally robust offline reinforcement learning (RL) aims to find a policy that performs the best under the worst environment within an uncertainty set using an offline dataset collected from a nominal model. While recent advances in…

Machine Learning · Computer Science 2025-01-07 Ruiquan Huang , Yingbin Liang , Jing Yang

As black-box models increasingly power high-stakes applications, a variety of data-driven explanation methods have been introduced. Meanwhile, machine learning models are constantly challenged by distributional shifts. A question naturally…

Machine Learning · Computer Science 2023-03-30 Tang Li , Fengchun Qiao , Mengmeng Ma , Xi Peng

Decision-based methods have shown to be effective in black-box adversarial attacks, as they can obtain satisfactory performance and only require to access the final model prediction. Gradient estimation is a critical step in black-box…

Machine Learning · Computer Science 2023-10-31 Han Liu , Xingshuo Huang , Xiaotong Zhang , Qimai Li , Fenglong Ma , Wei Wang , Hongyang Chen , Hong Yu , Xianchao Zhang

Evolution Strategies (ES) are a powerful class of blackbox optimization techniques that recently became a competitive alternative to state-of-the-art policy gradient (PG) algorithms for reinforcement learning (RL). We propose a new method…

Neural and Evolutionary Computing · Computer Science 2020-03-16 Yunhao Tang , Krzysztof Choromanski , Alp Kucukelbir

Robust reinforcement learning aims to produce policies that have strong guarantees even in the face of environments/transition models whose parameters have strong uncertainty. Existing work uses value-based methods and the usual primitive…

Artificial Intelligence · Computer Science 2018-02-12 Daniel J. Mankowitz , Timothy A. Mann , Pierre-Luc Bacon , Doina Precup , Shie Mannor

Creating impact in real-world settings requires artificial intelligence techniques to span the full pipeline from data, to predictive models, to decisions. These components are typically approached separately: a machine learning model is…

Machine Learning · Computer Science 2018-11-22 Bryan Wilder , Bistra Dilkina , Milind Tambe

Much of the recent success of deep reinforcement learning has been driven by regularized policy optimization (RPO) algorithms with strong performance across multiple domains. In this family of methods, agents are trained to maximize…

Machine Learning · Computer Science 2022-03-24 Ted Moskovitz , Michael Arbel , Jack Parker-Holder , Aldo Pacchiano

Implicit generative models have the capability to learn arbitrary complex data distributions. On the downside, training requires telling apart real data from artificially-generated ones using adversarial discriminators, leading to unstable…

Machine Learning · Computer Science 2024-02-27 José Manuel de Frutos , Pablo M. Olmos , Manuel A. Vázquez , Joaquín Míguez

Reinforcement Learning with Verifiable Rewards (RLVR) has proven effective for Large Language Model (LLM) reasoning, yet current methods face key challenges in resource allocation and policy optimization dynamics: (i) uniform rollout…

Machine Learning · Computer Science 2026-04-24 Yangyi Fang , Jiaye Lin , Xiaoliang Fu , Cong Qin , Haolin Shi , Chaowen Hu , Lu Pan , Ke Zeng , Xunliang Cai

In the random-order model for online learning, the sequence of losses is chosen upfront by an adversary and presented to the learner after a random permutation. Any random-order input is \emph{asymptotically} equivalent to a stochastic…

Machine Learning · Computer Science 2025-10-06 Martino Bernasconi , Andrea Celli , Riccardo Colini-Baldeschi , Federico Fusco , Stefano Leonardi , Matteo Russo