中文
相关论文

相关论文: Optimization of Discrete Parameters Using the Adap…

200 篇论文

This paper explores numerical methods for solving a convex differentiable semi-infinite program. We introduce a primal-dual gradient method which performs three updates iteratively: a momentum gradient ascend step to update the constraint…

最优化与控制 · 数学 2024-07-23 Yao Yao , Qihang Lin , Tianbao Yang

This paper tackles the challenge of parameter calibration in stochastic models, particularly in scenarios where the likelihood function is unavailable in an analytical form. We introduce a gradient-based simulated parameter estimation…

机器学习 · 统计学 2025-03-25 Zehao Li , Yijie Peng

Real-world experiments involve batched & delayed feedback, non-stationarity, multiple objectives & constraints, and (often some) personalization. Tailoring adaptive methods to address these challenges on a per-problem basis is infeasible,…

机器学习 · 计算机科学 2024-11-11 Ethan Che , Daniel R. Jiang , Hongseok Namkoong , Jimmy Wang

In the Knapsack problem, one is given the task of packing a knapsack of a given size with items in order to gain a packing with a high profit value. An important connection to the $(\max,+)$-convolution problem has been established, where…

数据结构与算法 · 计算机科学 2025-08-12 Kilian Grage , Klaus Jansen , Björn Schumacher

In this work we are interested in stochastic particle methods for multi-objective optimization. The problem is formulated using parametrized, single-objective sub-problems which are solved simultaneously. To this end a consensus based…

最优化与控制 · 数学 2022-08-03 Giacomo Borghi , Michael Herty , Lorenzo Pareschi

The chance-constrained knapsack problem is a variant of the classical knapsack problem where each item has a weight distribution instead of a deterministic weight. The objective is to maximize the total profit of the selected items under…

神经与进化计算 · 计算机科学 2020-04-09 Yue Xie , Aneta Neumann , Frank Neumann

A scaled conjugate gradient method that accelerates existing adaptive methods utilizing stochastic gradients is proposed for solving nonconvex optimization problems with deep neural networks. It is shown theoretically that, whether with…

机器学习 · 计算机科学 2024-12-17 Naoki Sato , Koshiro Izumi , Hideaki Iiduka

In this note, we extend an evolutionary stochastic portfolio optimization framework to include probabilistic constraints. Both the stochastic programming-based modeling environment as well as the evolutionary optimization environment are…

投资组合管理 · 定量金融 2014-01-21 Ronald Hochreiter

We study computational and statistical consequences of problem geometry in stochastic and online optimization. By focusing on constraint set and gradient geometry, we characterize the problem families for which stochastic- and…

最优化与控制 · 数学 2025-07-17 Chen Cheng , Daniel Levy , John C. Duchi

We introduce a new adaptive step-size strategy for convex optimization with stochastic gradient that exploits the local geometry of the objective function only by means of a first-order stochastic oracle and without any hyper-parameter…

机器学习 · 计算机科学 2025-09-19 Jean-François Aujol , Jérémie Bigot , Camille Castera

The problem of designing adaptive stepsize sequences for the gradient descent method applied to convex and locally smooth functions is studied. We take an adaptive control perspective and design update rules for the stepsize that make use…

最优化与控制 · 数学 2025-08-27 Andrea Iannelli

In learning from demonstrations, many generative models of trajectories make simplifying assumptions of independence. Correctness is sacrificed in the name of tractability and speed of the learning phase. The ignored dependencies, which…

机器人学 · 计算机科学 2020-11-09 Emmanuel Pignat , Hakan Girgin , Sylvain Calinon

Gradient-related first-order methods have become the workhorse of large-scale numerical optimization problems. Many of these problems involve nonconvex objective functions with multiple saddle points, which necessitates an understanding of…

最优化与控制 · 数学 2022-03-10 Rishabh Dixit , Mert Gurbuzbalaban , Waheed U. Bajwa

An optimal guidance method is developed that reduces sensitivity to parameters in the dynamic model. The method combines a previously developed method for guidance and control using adaptive Legendre-Gauss-Radau (LGR) collocation and a…

最优化与控制 · 数学 2024-08-09 Katrina L. Winkler , Anil V. Rao

In randomized trials involving multiple treatments, bivariate survival outcomes present significant analytical challenges for making decisions. This paper addresses the problem of deriving optimal individualized treatment rules to maximize…

机器学习 · 统计学 2026-05-29 Kun Ren , Yifan Cui , Wen Su

The extremely sensitive and highly nonlinear search space of interplanetary transfer trajectory design bring about big challenges on global optimization. As a representative, the current known best solution of the global trajectory…

人工智能 · 计算机科学 2021-04-14 Mingcheng Zuo , Guangming Dai , Lei Peng , Zhe Tang

Bayesian optimization works effectively optimizing parameters in black-box problems. However, this method did not work for high-dimensional parameters in limited trials. Parameters can be efficiently explored by nonlinearly embedding them…

机器学习 · 计算机科学 2022-06-14 Shoki Miyagawa , Atsuyoshi Yano , Naoko Sawada , Isamu Ogawa

This investigation is motivated by the problem of optimal design of cooling elements in modern battery systems. We consider a simple model of two-dimensional steady-state heat conduction described by elliptic partial differential equations…

数值分析 · 数学 2013-07-05 Xiaohui Peng , Katsiaryna Niakhai , Bartosz Protas

We study the convergence rate of Bregman gradient methods for convex optimization in the space of measures on a $d$-dimensional manifold. Under basic regularity assumptions, we show that the suboptimality gap at iteration $k$ is in…

最优化与控制 · 数学 2023-03-15 Lénaïc Chizat

Increasing effort is put into the development of methods for learning mechanistic models from data. This task entails not only the accurate estimation of parameters but also a suitable model structure. Recent work on the discovery of…

机器学习 · 计算机科学 2024-07-01 Justin N. Kreikemeyer , Philipp Andelfinger , Adelinde M. Uhrmacher