English
Related papers

Related papers: A Derivative-Free Trust-Region Algorithm for Relia…

200 papers

This paper introduces new perspectives on analog design space search. To minimize the time-to-market, this endeavor better cast as constraint satisfaction problem than global optimization defined in prior arts. We incorporate model-based…

We present an algorithm to perform trust-region-based optimization for nonlinear unconstrained problems. The method selectively uses function and gradient evaluations at different floating-point precisions to reduce the overall energy…

Optimization and Control · Mathematics 2022-02-18 Richard J Clancy , Matt Menickelly , Jan Hückelheim , Paul Hovland , Prani Nalluri , Rebecca Gjini

We consider optimal transport based distributionally robust optimization (DRO) problems with locally strongly convex transport cost functions and affine decision rules. Under conventional convexity assumptions on the underlying loss…

Optimization and Control · Mathematics 2021-04-27 Jose Blanchet , Karthyek Murthy , Fan Zhang

Distributionally robust optimization (DRO) problems are increasingly seen as a viable method to train machine learning models for improved model generalization. These min-max formulations, however, are more difficult to solve. We therefore…

Machine Learning · Statistics 2020-11-03 Soumyadip Ghosh , Mark Squillante , Ebisa Wollega

By leveraging differentiable dynamics, Reparameterization Policy Gradient (RPG) achieves high sample efficiency. However, current approaches are hindered by two critical limitations: the under-utilization of computationally expensive…

Machine Learning · Computer Science 2026-02-09 Hai Zhong , Xun Wang , Zhuoran Li , Longbo Huang

The goal of robust constrained reinforcement learning (RL) is to optimize an agent's performance under the worst-case model uncertainty while satisfying safety or resource constraints. In this paper, we demonstrate that strong duality does…

Machine Learning · Computer Science 2025-09-23 Shaocong Ma , Ziyi Chen , Yi Zhou , Heng Huang

Recently, (Blanchet, Kang, and Murhy 2016, and Blanchet, and Kang 2017) showed that several machine learning algorithms, such as square-root Lasso, Support Vector Machines, and regularized logistic regression, among many others, can be…

Machine Learning · Statistics 2020-02-25 Jose Blanchet , Yang Kang , Fan Zhang , Karthyek Murthy

We consider minimizing functions for which it is expensive to compute the (possibly stochastic) gradient. Such functions are prevalent in reinforcement learning, imitation learning and adversarial training. Our target optimization framework…

Machine Learning · Computer Science 2023-06-09 Jonathan Wilder Lavington , Sharan Vaswani , Reza Babanezhad , Mark Schmidt , Nicolas Le Roux

Robust optimization(RO) is an important tool for handling optimization problem with uncertainty. The main objective of RO is to solve optimization problems due to uncertainty associated with constraints satisfying all realizations of…

Optimization and Control · Mathematics 2025-04-02 Parthasarathi Mondal , Akshay Kumar Ojha

Preferential Bayesian Optimization (PBO) aims to find a decision-maker's most preferred solution in as few pairwise comparisons as possible. Existing approaches rely on Gaussian Process (GP) surrogates, which provide strong performance but…

Machine Learning · Computer Science 2026-05-11 Nick Leenders , Thomas Quadt , Boris Cule , Roy Lindelauf , Herman Monsuur , Joost van Oijen , Mark Voskuijl

It is known that the set of perturbed data is key in robust optimization (RO) modelling. Distributionally robust optimization (DRO) is a methodology used for optimization problems affected by random parameters with uncertain probability…

Optimization and Control · Mathematics 2022-05-09 Yueyao Li , Wenxun Xing

In this contribution, we are concerned with model order reduction in the context of iterative regularization methods for the solution of inverse problems arising from parameter identification in elliptic partial differential equations. Such…

Numerical Analysis · Mathematics 2024-10-14 Michael Kartmann , Tim Keil , Mario Ohlberger , Stefan Volkwein , Barbara Kaltenbacher

Proximal policy optimization (PPO) is one of the most successful deep reinforcement-learning methods, achieving state-of-the-art performance across a wide range of challenging tasks. However, its optimization behavior is still far from…

Machine Learning · Computer Science 2020-01-15 Yuhui Wang , Hao He , Chao Wen , Xiaoyang Tan

This paper presents an algorithm for reliability-based topology optimization of linear elastic continua under random-field material model. The modelling random field is discretized into a small number of random variables, and then the…

Optimization and Control · Mathematics 2022-01-03 Trung Pham , Christopher Hoyle

Stochastic Optimization (SO) is a classical approach for optimization under uncertainty that typically requires knowledge about the probability distribution of uncertain parameters. As the latter is often unknown, Distributionally Robust…

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an important paradigm for unlocking reasoning capabilities in large language models, exemplified by the success of OpenAI o1 and DeepSeek-R1. Currently, Group Relative…

Machine Learning · Computer Science 2026-01-08 Shijie Zhang , Kevin Zhang , Zheyuan Gu , Xiang Guo , Rujun Guo , Shaoyu Liu , Guanjun Jiang , Xiaozhao Wang

We propose a nonsmooth trust-region method for solving optimization problems with locally Lipschitz continuous functions, with application to problems constrained by variational inequalities of the second kind. Under suitable assumptions on…

Optimization and Control · Mathematics 2018-01-17 Constantin Christof , Juan Carlos De Los Reyes , Christian Meyer

This paper proposes distributed algorithms to solve robust convex optimization (RCO) when the constraints are affected by nonlinear uncertainty. We adopt a scenario approach by randomly sampling the uncertainty set. To facilitate the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-16 Keyou You , Roberto Tempo , Pei Xie

Several fundamental problems in science and engineering consist of global optimization tasks involving unknown high-dimensional (black-box) functions that map a set of controllable variables to the outcomes of an expensive experiment.…

Machine Learning · Computer Science 2023-09-15 Mohamed Aziz Bhouri , Michael Joly , Robert Yu , Soumalya Sarkar , Paris Perdikaris

We propose a stochastic trust-region method for unconstrained nonconvex optimization that incorporates stochastic variance-reduced gradients (SVRG) to accelerate convergence. Unlike classical trust-region methods, the proposed algorithm…

Optimization and Control · Mathematics 2026-01-22 Yuchen Fang , Xinshou Zheng , Javad Lavaei