中文
相关论文

相关论文: An Adaptive Penalty Method for Inequality Constrai…

200 篇论文

We address the open problem of training hypernetworks for Controllable Pareto Front Learning (CPFL) under split feasibility conditions with rigorous theoretical guarantees. We reformulate the constrained Pareto problem as a Bi-Level…

机器学习 · 计算机科学 2026-05-20 Nguyen Viet Hoang , Dung D. Le , Tran Ngoc Thang

In this paper, we present a semi-proximal alternating direction method of multipliers (ADMM) for solving $3$-block separable convex minimization problems with the second block in the objective being a strongly convex function and one…

最优化与控制 · 数学 2015-06-24 Min Li , Defeng Sun , Kim-Chuan Toh

We propose an adaptive sequential framework for testing two simple hypotheses that analytically ensures finite exposure to the less effective treatment. Our proposed procedure employs a likelihood ratio-driven adaptive allocation rule,…

统计理论 · 数学 2025-11-26 Sampurna Kundu , Jayant Jha , Subir Kumar Bhandari

In this work we present an adaptive Newton-type method to solve nonlinear constrained optimization problems in which the constraint is a system of partial differential equations discretized by the finite element method. The adaptive…

最优化与控制 · 数学 2017-06-05 Thomas Carraro , Simon Dörsam , Stefan Frei , Daniel Schwarz

Recent literature on online learning has focused on developing adaptive algorithms that take advantage of a regularity of the sequence of observations, yet retain worst-case performance guarantees. A complementary direction is to develop…

机器学习 · 计算机科学 2015-01-27 Ali Jadbabaie , Alexander Rakhlin , Shahin Shahrampour , Karthik Sridharan

A Newton-type active set algorithm for large-scale minimization subject to polyhedral constraints is proposed. The algorithm consists of a gradient projection step, a second-order Newton-type step in the null space of the constraint matrix,…

最优化与控制 · 数学 2021-01-12 William W. Hager , Davoud Ataee Tarzanagh

This paper presents a majorized alternating direction method of multipliers (ADMM) with indefinite proximal terms for solving linearly constrained $2$-block convex composite optimization problems with each block in the objective being the…

最优化与控制 · 数学 2015-06-24 Min Li , Defeng Sun , Kim-Chuan Toh

We describe an approximate dynamic programming (ADP) approach to compute approximations of the optimal strategies and of the minimal losses that can be guaranteed in discounted repeated games with vector-valued losses. Such games…

计算机科学与博弈论 · 计算机科学 2020-10-27 Vijay Kamble , Patrick Loiseau , Jean Walrand

Community detection is an important problem in unsupervised learning. This paper proposes to solve a projection matrix approximation problem with an additional entrywise bounded constraint. Algorithmically, we introduce a new differentiable…

社会与信息网络 · 计算机科学 2023-08-16 Zheng Zhai , Hengchao Chen , Qiang Sun

A learning based method for obtaining feedback laws for nonlinear optimal control problems is proposed. The learning problem is posed such that the open loop value function is its optimal solution. This infinite dimensional, function space,…

最优化与控制 · 数学 2022-10-26 Karl Kunisch , Donato Vásquez-Varas , Daniel Walter

In this paper, we give a new approximate dynamic programming (ADP) method to solve large-scale Markov decision programming (MDP) problem. In comparison with many classic ADP methods which have large number of constraints, we formulate an…

最优化与控制 · 数学 2025-07-15 Di Zhang

Conformal prediction (CP) is a distribution-free method to construct reliable prediction intervals that has gained significant attention in recent years. Despite its success and various proposed extensions, a significant practical feature…

统计理论 · 数学 2026-02-02 Louis Allain , Sébastien Da Veiga , Brian Staber

We implement the adaptive step size scheme from the optimization methods AdaGrad and Adam in a novel variant of the Proximal Gradient Method (PGM). Our algorithm, dubbed AdaProx, avoids the need for explicit computation of the Lipschitz…

最优化与控制 · 数学 2020-07-06 Peter Melchior , Rémy Joseph , Fred Moolekamp

In recent years, the Deep Learning Alternating Minimization (DLAM), which is actually the alternating minimization applied to the penalty form of the deep neutral networks training, has been developed as an alternative algorithm to overcome…

机器学习 · 计算机科学 2021-02-02 Linbo Qiao , Tao Sun , Hengyue Pan , Dongsheng Li

This paper presents adaptive boundary element methods for positive, negative, as well as zero order operator equations, together with proofs that they converge at certain rates. The convergence rates are quasi-optimal in a certain sense…

数值分析 · 数学 2012-12-21 Tsogtgerel Gantumur

The parameters of a neural network are naturally organized in groups, some of which might not contribute to its overall performance. To prune out unimportant groups of parameters, we can include some non-differentiable penalty to the…

机器学习 · 计算机科学 2023-01-06 Tristan Deleu , Yoshua Bengio

This paper considers an opportunistic scheduling problem over a renewal system. A controller observes a random event at the beginning of each renewal frame and then chooses an action in response to the event, which affects the duration of…

最优化与控制 · 数学 2019-06-10 Xiaohan Wei , Michael J. Neely

This paper presents a novel distributed active set method for model predictive control of linear systems. The method combines a primal active set strategy with a decentralized conjugate gradient method to solve convex quadratic programs. An…

最优化与控制 · 数学 2021-03-24 Gösta Stomberg , Alexander Engelmann , Timm Faulwasser

In light of the increased focus on distributed methods, this paper proposes two accelerated subgradient methods and an adaptive penalty parameter scheme to speed-up the convergence of ADMM on the component-based dual decomposition of the…

计算工程、金融与科学 · 计算机科学 2018-08-14 Sleiman Mhanna , Archie Chapman , Gregor Verbic

Stochastic versions of proximal methods have gained much attention in statistics and machine learning. These algorithms tend to admit simple, scalable forms, and enjoy numerical stability via implicit updates. In this work, we propose and…

机器学习 · 统计学 2024-09-09 Haoyu Jiang , Jason Xu