中文
相关论文

相关论文: Newton-type algorithms for inverse optimization II…

200 篇论文

The use of min-max optimization in adversarial training of deep neural network classifiers and training of generative adversarial networks has motivated the study of nonconvex-nonconcave optimization objectives, which frequently arise in…

最优化与控制 · 数学 2021-03-02 Jelena Diakonikolas , Constantinos Daskalakis , Michael I. Jordan

We introduce a new second order stochastic algorithm to estimate the entropically regularized optimal transport cost between two probability measures. The source measure can be arbitrary chosen, either absolutely continuous or discrete,…

统计理论 · 数学 2022-03-03 Bernard Bercu , Jérémie Bigot , Sébastien Gadat , Emilia Siviero

We consider solving large scale nonconvex optimisation problems with nonnegativity constraints. Such problems arise frequently in machine learning, such as nonnegative least-squares, nonnegative matrix factorisation, as well as problems…

最优化与控制 · 数学 2024-05-22 Oscar Smee , Fred Roosta

Adaptive nuclear-norm penalization is proposed for low-rank matrix approximation, by which we develop a new reduced-rank estimation method for the general high-dimensional multivariate regression problems. The adaptive nuclear norm of a…

统计方法学 · 统计学 2012-09-25 Kun Chen , Hongbo Dong , Kung-Sik Chan

This paper describes a method for solving smooth nonconvex minimization problems subject to bound constraints with good worst-case complexity guarantees and practical performance. The method contains elements of two existing methods: the…

最优化与控制 · 数学 2023-06-08 Yue Xie , Stephen J. Wright

This paper proposes a nonmonotone proximal quasi-Newton algorithm for unconstrained convex multiobjective composite optimization problems. To design the search direction, we minimize the max-scalarization of the variations of the Hessian…

最优化与控制 · 数学 2023-10-04 Xiaoxue Jiang

In many contexts, customized and weighted classification scores are designed in order to evaluate the goodness of the predictions carried out by neural networks. However, there exists a discrepancy between the maximization of such scores…

机器学习 · 计算机科学 2023-05-24 Francesco Marchetti , Sabrina Guastavino , Cristina Campi , Federico Benvenuto , Michele Piana

We propose and study a weakly convergent variant of the forward--backward algorithm for solving structured monotone inclusion problems. Our algorithm features a per-iteration deviation vector which provides additional degrees of freedom.…

最优化与控制 · 数学 2022-08-15 Hamed Sadeghi , Sebastian Banert , Pontus Giselsson

Leverage scores have become essential in statistics and machine learning, aiding regression analysis, randomized matrix computations, and various other tasks. This paper delves into the inverse problem, aiming to recover the intrinsic model…

机器学习 · 计算机科学 2024-08-22 Chenyang Li , Zhao Song , Zhaoxing Xu , Junze Yin

A smoothing algorithm is presented for solving the soft-margin Support Vector Machine (SVM) optimization problem with an $\ell^{1}$ penalty. This algorithm is designed to require a modest number of passes over the data, which is an…

最优化与控制 · 数学 2024-01-19 Ibrahim Emirahmetoglu , Jeffrey Hajewski , Suely Oliveira , David E. Stewart

Inverse classification is the process of manipulating an instance such that it is more likely to conform to a specific class. Past methods that address such a problem have shortcomings. Greedy methods make changes that are overly radical,…

机器学习 · 计算机科学 2017-06-12 Michael T. Lash , Qihang Lin , W. Nick Street , Jennifer G. Robinson

A known first order method to find a feasible solution to a conic problem is an adapted von Neumann algorithm. We improve the distance reduction step there by projecting onto the convex hull of previously generated points using a primal…

最优化与控制 · 数学 2014-08-15 C. H. Jeffrey Pang

Target imbalance affects the performance of recent deep learning methods in many medical image segmentation tasks. It is a twofold problem: class imbalance - positive class (lesion) size compared to negative class (non-lesion) size; lesion…

图像与视频处理 · 电气工程与系统科学 2020-07-21 Boris Shirokikh , Alexey Shevtsov , Anvar Kurmukov , Alexandra Dalechina , Egor Krivov , Valery Kostjuchenko , Andrey Golanov , Mikhail Belyaev

This document introduces a strategy to solve linear optimization problems. The strategy is based on the bounding condition each constraint produces on each one of the problem's dimension. The solution of a linear optimization problem is…

最优化与控制 · 数学 2018-09-24 Gerardo L. Febres

The paper is devoted to the solution of a weighted nonlinear least-squares problem for low-rank signal estimation, which is related to Hankel structured low-rank approximation problems. A modified weighted Gauss-Newton method, which uses…

数值分析 · 数学 2020-12-01 N. Zvonarev , N. Golyandina

Statistical inverse learning aims at recovering an unknown function $f$ from randomly scattered and possibly noisy point evaluations of another function $g$, connected to $f$ via an ill-posed mathematical model. In this paper we blend…

统计理论 · 数学 2024-01-22 Tapio Helin

We analyze combinatorial optimization problems with ordinal, i.e., non-additive, objective functions that assign categories (like good, medium and bad) rather than cost coefficients to the elements of feasible solutions. We review different…

最优化与控制 · 数学 2022-04-06 Kathrin Klamroth , Michael Stiglmayr , Julia Sudhoff

We consider optimization algorithms that successively minimize simple Taylor-like models of the objective function. Methods of Gauss-Newton type for minimizing the composition of a convex function and a smooth map are common examples. Our…

最优化与控制 · 数学 2016-10-12 Dmitriy Drusvyatskiy , Alexander D. Ioffe , Adrian S. Lewis

We consider the minimum spanning tree problem with predictions, using the weight-arrival model, i.e., the graph is given, together with predictions for the weights of all edges. Then the actual weights arrive one at a time and an…

数据结构与算法 · 计算机科学 2023-02-24 Magnus Berg , Joan Boyar , Lene M. Favrholdt , Kim S. Larsen

In this paper, we suggest two ways of calculating interpolation models for unconstrained smooth nonlinear optimization when Hessian-vector products are available. The main idea is to interpolate the objective function using a quadratic on a…

数值分析 · 数学 2019-12-24 Lili Song , Luis Nunes Vicente