English
Related papers

Related papers: Incorporating Surrogate Gradient Norm to Improve O…

200 papers

Most theoretically motivated work in the offline reinforcement learning setting requires precise uncertainty estimates. This requirement restricts the algorithms derived in that work to the tabular and linear settings where such estimates…

Machine Learning · Computer Science 2022-06-03 David Brandfonbrener , Remi Tachet des Combes , Romain Laroche

We study distributed multiagent optimization over (directed, time-varying) graphs. We consider the minimization of $F+G$ subject to convex constraints, where $F$ is the smooth strongly convex sum of the agent's losses and $G$ is a nonsmooth…

Optimization and Control · Mathematics 2020-10-13 Ying Sun , Amir Daneshmand , Gesualdo Scutari

Global optimization of large-scale, complex systems such as multi-physics black-box simulations and real-world industrial systems is important but challenging. This work presents a novel Surrogate-Based Optimization framework based on…

Machine Learning · Computer Science 2026-01-13 Maaz Ahmad , Iftekhar A. Karimi

The central task in modeling complex dynamical systems is parameter estimation. This task involves numerous evaluations of a computationally expensive objective function. Surrogate-based optimization introduces a computationally efficient…

Machine Learning · Computer Science 2019-12-19 Žiga Lukšič , Jovan Tanevski , Sašo Džeroski , Ljupčo Todorovski

Recent developments in surrogate construction predominantly focused on two strategies to improve surrogate accuracy. Firstly, component-wise domain scaling informed by cross-validation. Secondly, regression to construct response surfaces…

Optimization and Control · Mathematics 2023-04-03 Johann Bouwer , Daniel N. Wilke , Schalk Kok

Surrogate gradients are a standard tool for training spiking neural networks (SNNs), but conventional hard forward or surrogate backward training couples a nonsmooth forward model with a biased gradient estimator. We study sharpness aware…

Neural and Evolutionary Computing · Computer Science 2026-03-20 Maximilian Nicholson

With the ability to learn from static datasets, Offline Reinforcement Learning (RL) emerges as a compelling avenue for real-world applications. However, state-of-the-art offline RL algorithms perform sub-optimally when confronted with…

Machine Learning · Computer Science 2024-06-12 Briti Gangopadhyay , Zhao Wang , Jia-Fong Yeh , Shingo Takamatsu

Solving complex problems requires continuous effort in developing theory and practice to cope with larger, more difficult scenarios. Working with surrogates is normal for creating a proxy that realistically models the problem into the…

Neural and Evolutionary Computing · Computer Science 2026-02-10 Tomohiro Harada , Enrique Alba , Gabriel Luque

Machine learning models play a vital role in time series forecasting. These models, however, often overlook an important element: point uncertainty estimates. Incorporating these estimates is crucial for effective risk management, informed…

Machine Learning · Computer Science 2024-09-11 Leonid Erlygin , Vladimir Zholobov , Valeriia Baklanova , Evgeny Sokolovskiy , Alexey Zaytsev

We consider a new and general online resource allocation problem, where the goal is to maximize a function of a positive semidefinite (PSD) matrix with a scalar budget constraint. The problem data arrives online, and the algorithm needs to…

Optimization and Control · Mathematics 2019-04-09 Reza Eghbali , James Saunderson , Maryam Fazel

Existing work on data-driven optimization focuses on problems in static environments, but little attention has been paid to problems in dynamic environments. This paper proposes a data-driven optimization algorithm to deal with the…

Neural and Evolutionary Computing · Computer Science 2020-12-29 Cuie Yang , Jinliang Ding , Yaochu Jin , Tianyou Chai

The increased penetration of wind power introduces more operational changes of critical corridors and the traditional time-consuming transient stability constrained total transfer capability (TTC) operational planning is unable to meet the…

Systems and Control · Electrical Eng. & Systems 2020-06-30 Gao Qiu , Youbo Liu , Junyong Liu , Junbo Zhao , Lingfeng Wang , Tingjian Liu , Hongjun Gao

Offline reinforcement learning enables sample-efficient policy acquisition without risky online interaction, yet policies trained on static datasets remain brittle under action-space perturbations such as actuator faults. This study…

Robotics · Computer Science 2026-03-02 Shingo Ayabe , Hiroshi Kera , Kazuhiko Kawamoto

We propose a novel gradient-based online optimization framework for solving stochastic programming problems that frequently arise in the context of cyber-physical and robotic systems. Our problem formulation accommodates constraints that…

Machine Learning · Computer Science 2026-01-06 Hao Ma , Melanie Zeilinger , Michael Muehlebach

Deep neural networks are vulnerable to adversarial examples -- minor perturbations added to a model's input which cause the model to output an incorrect prediction. We introduce a new method for improving the efficacy of adversarial attacks…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Chris Miller , Soroush Vosoughi

We study the problem of offline policy optimization in stochastic contextual bandit problems, where the goal is to learn a near-optimal policy based on a dataset of decision data collected by a suboptimal behavior policy. Rather than making…

Machine Learning · Computer Science 2023-09-28 Germano Gabbianelli , Gergely Neu , Matteo Papini

Recently, a surrogate model was proposed that employs a factorization machine to approximate the underlying input-output mapping of the original system, with quantum annealing used to optimize the resulting surrogate function. Inspired by…

Machine Learning · Computer Science 2026-01-21 Anbang Wang , Dunbo Cai , Yu Zhang , Yangqing Huang , Xiangyang Feng , Zhihong Zhang

Recent RGB-guided depth super-resolution methods have achieved impressive performance under the assumption of fixed and known degradation (e.g., bicubic downsampling). However, in real-world scenarios, captured depth data often suffer from…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Zhengxue Wang , Zhiqiang Yan , Jinshan Pan , Guangwei Gao , Kai Zhang , Jian Yang

We present an approach towards convex optimization that relies on a novel scheme which converts online adaptive algorithms into offline methods. In the offline optimization setting, our derived methods are shown to obtain favourable…

Machine Learning · Computer Science 2017-06-01 Kfir Y. Levy

Commonly used classification algorithms in machine learning, such as support vector machines, minimize a convex surrogate loss on training examples. In practice, these algorithms are surprisingly robust to errors in the training data. In…

Machine Learning · Computer Science 2020-12-03 Kunal Talwar