English
Related papers

Related papers: Improving and benchmarking of algorithms for decis…

200 papers

Due to the highly non-convex nature of large-scale robust parameter estimation, avoiding poor local minima is challenging in real-world applications where input data is contaminated by a large or unknown fraction of outliers. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Huu Le , Christopher Zach

This paper describes three methods for carrying out non-asymptotic inference on partially identified parameters that are solutions to a class of optimization problems. Applications in which the optimization problems arise include estimation…

Methodology · Statistics 2022-12-02 Joel L. Horowitz , Sokbae Lee

Optimization methods are at the core of many problems in signal/image processing, computer vision, and machine learning. For a long time, it has been recognized that looking at the dual of an optimization problem may drastically simplify…

Numerical Analysis · Computer Science 2014-12-04 Nikos Komodakis , Jean-Christophe Pesquet

Robust discrete optimization is a highly active field of research where a plenitude of combinations between decision criteria, uncertainty sets and underlying nominal problems are considered. Usually, a robust problem becomes harder to…

Optimization and Control · Mathematics 2022-01-14 Marc Goerigk , Mohammad Khosravi

This paper focuses on stochastic saddle point problems with decision-dependent distributions. These are problems whose objective is the expected value of a stochastic payoff function and whose data distribution drifts in response to…

Optimization and Control · Mathematics 2022-11-15 Killian Wood , Emiliano Dall'Anese

The domain of online algorithms with predictions has been extensively studied for different applications such as scheduling, caching (paging), clustering, ski rental, etc. Recently, Bamas et al., aiming for an unified method, have provided…

Data Structures and Algorithms · Computer Science 2021-10-04 Nguyen Kim Thang , Christoph Durr

Stochastic dominance serves as a general framework for modeling a broad spectrum of decision preferences under uncertainty, with risk aversion as one notable example, as it naturally captures the intrinsic structure of the underlying…

Machine Learning · Computer Science 2026-01-06 Shicong Cen , Jincheng Mei , Hanjun Dai , Dale Schuurmans , Yuejie Chi , Bo Dai

In the problem of online unweighted interval selection, the objective is to maximize the number of non-conflicting intervals accepted by the algorithm. In the conventional online model of irrevocable decisions, there is an Omega(n) lower…

Data Structures and Algorithms · Computer Science 2025-06-03 Allan Borodin , Christodoulos Karavasilis

Influence maximization in networks is a central problem in machine learning and causal inference, where an intervention on a subset of individuals triggers a diffusion process through the network. Existing approaches typically optimize…

Methodology · Statistics 2026-03-13 Renjie Cao , Zhuoxin Yan , Xinyan Su , Zhiheng Zhang

This paper proposes a primal-dual framework to learn a stable estimator for linear constrained estimation problems leveraging the moving horizon approach. To avoid the online computational burden in most existing methods, we learn a…

Systems and Control · Electrical Eng. & Systems 2022-04-07 Wenhan Cao , Jingliang Duan , Shengbo Eben Li , Chen Chen , Chang Liu , Yu Wang

An algorithm based on the interior-point methodology for solving continuous nonlinearly constrained optimization problems is proposed, analyzed, and tested. The distinguishing feature of the algorithm is that it presumes that only noisy…

Optimization and Control · Mathematics 2025-02-18 Frank E. Curtis , Shima Dezfulian , Andreas Waechter

Early stopping of iterative algorithms is an algorithmic regularization method to avoid over-fitting in estimation and classification. In this paper, we show that early stopping can also be applied to obtain the minimax optimal testing in a…

Statistics Theory · Mathematics 2018-09-18 Meimei Liu , Guang Cheng

Much recent research has been conducted in the area of Bayesian learning, particularly with regard to the optimization of hyper-parameters via Gaussian process regression. The methodologies rely chiefly on the method of maximizing the…

Machine Learning · Statistics 2014-05-13 James Brofos

The initialization of equation-based differential-algebraic system models, and more in general the solution of many engineering and scientific problems, require the solution of systems of nonlinear equations. Newton-Raphson's method is…

Numerical Analysis · Mathematics 2021-02-22 Francesco Casella , Bernhard Bachmann

We propose an algorithm to actively estimate the parameters of a linear dynamical system. Given complete control over the system's input, our algorithm adaptively chooses the inputs to accelerate estimation. We show a finite time bound…

Machine Learning · Computer Science 2020-06-23 Andrew Wagenmaker , Kevin Jamieson

We investigate the maximum caliber variational principle as an inference algorithm used to predict dynamical properties of complex nonequilibrium, stationary, statistical systems in the presence of incomplete information. Specifically, we…

Statistical Mechanics · Physics 2016-12-28 Carlo Cafaro , Sean Alan Ali

The study of online algorithms with machine-learned predictions has gained considerable prominence in recent years. One of the common objectives in the design and analysis of such algorithms is to attain (Pareto) optimal tradeoffs between…

Machine Learning · Computer Science 2024-08-09 Spyros Angelopoulos , Christoph Dürr , Alex Elenter , Yanni Lefki

Distributed and decentralized optimization are key for the control of networked systems. Application examples include distributed model predictive control and distributed sensing or estimation. Non-linear systems, however, lead to problems…

Optimization and Control · Mathematics 2023-07-06 Alexander Engelmann , Gösta Stomberg , Timm Faulwasser

Decision Focused Learning has emerged as a critical paradigm for integrating machine learning with downstream optimisation. Despite its promise, existing methodologies predominantly rely on probabilistic models and focus narrowly on task…

Machine Learning · Computer Science 2025-03-21 Keivan Shariatmadar , Neil Yorke-Smith , Ahmad Osman , Fabio Cuzzolin , Hans Hallez , David Moens

Uncertainty quantification for estimation through stochastic optimization solutions in an online setting has gained popularity recently. This paper introduces a novel inference method focused on constructing confidence intervals with…

Machine Learning · Statistics 2026-03-24 Wanrong Zhu , Zhipeng Lou , Ziyang Wei , Wei Biao Wu