English
Related papers

Related papers: General Optimization Framework for Robust and Regu…

200 papers

Due to the highly non-convex nature of large-scale robust parameter estimation, avoiding poor local minima is challenging in real-world applications where input data is contaminated by a large or unknown fraction of outliers. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Huu Le , Christopher Zach

In this paper we propose a general algorithmic framework for first-order methods in optimization in a broad sense, including minimization problems, saddle-point problems and variational inequalities. This framework allows to obtain many…

We present a new framework for the analysis and design of randomized algorithms for solving various types of linear systems, including consistent or inconsistent, full rank or rank-deficient. Our method is formulated with four randomized…

Optimization and Control · Mathematics 2022-08-25 Deren Han , Jiaxin Xie

Supervised learning is all about the ability to generalize knowledge. Specifically, the goal of the learning is to train a classifier using training data, in such a way that it will be capable of classifying new unseen data correctly. In…

Machine Learning · Computer Science 2011-04-04 Ido Ginodi , Amir Globerson

The pooling problem has applications, e.g., in petrochemical refining, water networks, and supply chains and is widely studied in global optimization. To date, it has largely been treated deterministically, neglecting the influence of…

Optimization and Control · Mathematics 2019-06-19 Johannes Wiebe , Inês Cecílio , Ruth Misener

Adaptive cubic regularization methods have emerged as a credible alternative to linesearch and trust-region for smooth nonconvex optimization, with optimal complexity amongst second-order methods. Here we consider a general/new class of…

Optimization and Control · Mathematics 2018-11-20 Coralia Cartis , Nicholas I. M. Gould , Philippe L. Toint

We study statistical inference and distributionally robust solution methods for stochastic optimization problems, focusing on confidence intervals for optimal values and solutions that achieve exact coverage asymptotically. We develop a…

Machine Learning · Statistics 2018-07-03 John Duchi , Peter Glynn , Hongseok Namkoong

We introduce a general framework for large-scale model-based derivative-free optimization based on iterative minimization within random subspaces. We present a probabilistic worst-case complexity analysis for our method, where in particular…

Optimization and Control · Mathematics 2021-02-25 Coralia Cartis , Lindon Roberts

An optimization framework is presented for minimizing the energy functional developed around a generalized equation governing physical systems such as fluid dynamics, particle transport, phase transition, and other related systems. The…

Fluid Dynamics · Physics 2024-04-25 Varsha Gupta

The task of atom rearrangement has emerged in the last decade as a fundamental building block for the development of neutral atom-based quantum processors. However, despite many recent efforts to develop algorithms with favorable asymptotic…

Quantum Physics · Physics 2025-08-05 Nikhil K Harle , Bo-Yu Chen , Bob Bao , Hannes Bernien

While neural networks have made significant strides in many AI tasks, they remain vulnerable to a range of noise types, including natural corruptions, adversarial noise, and low-resolution artifacts. Many existing approaches focus on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Zhiling Zhou , Zirui Liu , Chengming Xu , Yanwei Fu , Xinwei Sun

This paper presents a novel algorithm integrating global and robust optimization methods to solve continuous non-convex quadratic problems under convex uncertainty sets. The proposed Robust spatial branch-and-bound (RsBB) algorithm combines…

Optimization and Control · Mathematics 2025-11-18 Asimina Marousi , Vassilis M. Charitopoulos

This paper introduces a weighted generalized inverse framework for Fourier extensions, designed to suppress spurious oscillations in the extended region while maintaining high approximation accuracy on the original interval. By formulating…

Numerical Analysis · Mathematics 2026-01-13 Zhenyu Zhao , Yanfei Wang , Anatoly G. Yagola , Xusheng Li

Solving inverse problems involving measurement noise and modeling errors requires regularization in order to avoid data overfit. Geophysical inverse problems, in which the Earth's highly heterogeneous structure is unknown, present a…

Geophysics · Physics 2022-03-31 Ali Siahkoohi , Rafael Orozco , Gabrio Rizzuti , Felix J. Herrmann

We propose a scalable, efficient and statistically motivated computational framework for Graphical Lasso (Friedman et al., 2007b) - a covariance regularization framework that has received significant attention in the statistics community…

Machine Learning · Statistics 2011-10-26 Rahul Mazumder , Deepak K. Agarwal

A regularization algorithm using inexact function values and inexact derivatives is proposed and its evaluation complexity analyzed. This algorithm is applicable to unconstrained problems and to problems with inexpensive constraints (that…

Optimization and Control · Mathematics 2019-04-22 S. Bellavia , G. Gurioli , B. Morini , Ph. L. Toint

This paper presents a novel variational formulation to simulate linear free-surface flow. The variational formulation is suitable for higher-order finite elements and higher-order and higher-continuity shape functions as employed in…

Numerical Analysis · Mathematics 2020-03-12 I. Akkerman , J. H. A. Meijer , M. ten Eikelder

We introduce a new general framework for the approximation of evolution equations at low regularity and develop a new class of schemes for a wide range of equations under lower regularity assumptions than classical methods require. In…

Numerical Analysis · Mathematics 2021-02-16 Frédéric Rousset , Katharina Schratz

A variety of approaches has been developed to deal with uncertain optimization problems. Often, they start with a given set of uncertainties and then try to minimize the influence of these uncertainties. Depending on the approach used, the…

Optimization and Control · Mathematics 2023-07-14 Holger Berthold , Till Heller , Tobias Seidel

Subsurface ore detection is of paramount importance given the gradual depletion of shallow mineral resources in recent years. It is crucial to explore approaches that go beyond the limitations of traditional geological exploration methods.…

Machine Learning · Computer Science 2026-03-10 Dhruman Gupta , Yashas Shende , Aritra Das , Chanda Grover Kamra , Debayan Gupta