English
Related papers

Related papers: Exploiting Scaling Constants to Facilitate the Con…

200 papers

We develop several efficient algorithms for the classical \emph{Matrix Scaling} problem, which is used in many diverse areas, from preconditioning linear systems to approximation of the permanent. On an input $n\times n$ matrix $A$, this…

Data Structures and Algorithms · Computer Science 2017-04-10 Zeyuan Allen-Zhu , Yuanzhi Li , Rafael Oliveira , Avi Wigderson

The convergence rates for convex and non-convex optimization methods depend on the choice of a host of constants, including step sizes, Lyapunov function constants and momentum constants. In this work we propose the use of factorial powers…

Machine Learning · Computer Science 2023-04-13 Aaron Defazio , Robert M. Gower

Tensor decompositions, which represent an $N$-order tensor using approximately $N$ factors of much smaller dimensions, can significantly reduce the number of parameters. This is particularly beneficial for high-order tensors, as the number…

Machine Learning · Computer Science 2025-06-23 Zhen Qin , Michael B. Wakin , Zhihui Zhu

An effective means for analyzing the impact of novel operating schemes on power systems is time domain simulation, for example for investigating optimization-based curtailment of renewables to alleviate voltage violations. Traditionally,…

Optimization and Control · Mathematics 2016-07-27 Sandro Merkli , Alexander Domahidi , Juan Jerez , Manfred Morari , Roy S. Smith

The recently proposed factor graph optimization (FGO) is adopted to integrate GNSS/INS attracted lots of attention and improved the performance over the existing EKF-based GNSS/INS integrations. However, a comprehensive comparison of those…

Robotics · Computer Science 2020-04-27 Weisong Wen , Tim Pfeifer , Xiwei Bai , Li-Ta Hsu

Test-Time Adaptation (TTA) is essential for enabling deep learning models to handle real-world data distribution shifts. However, current approaches face significant limitations: backpropagation-based methods are not suitable for low-end…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Xingyu Wang , Tao Wang

We study the problem of online convex optimization (OCO) under unknown linear constraints that are either static, or stochastically time-varying. For this problem, we introduce an algorithm that we term Optimistically Safe OCO (OSOCO) and…

Machine Learning · Computer Science 2025-07-16 Spencer Hutchinson , Tianyi Chen , Mahnoosh Alizadeh

In this contribution, we present a variational space-time formulation which generates an optimal feed-forward controller for geometrically exact strings. More concretely, the optimization problem is solved with an indirect approach, and the…

Systems and Control · Electrical Eng. & Systems 2025-01-22 Tobias Thoma , Paul Kotyczka

Second-order dynamical systems are important tools for solving optimization problems, and most of existing works in this field have focused on unconstrained optimization problems. In this paper, we propose an inertial primal-dual dynamical…

Optimization and Control · Mathematics 2022-05-23 Xin He , Rong Hu , Ya-Ping Fang

We study the factor model problem, which aims to uncover low-dimensional structures in high-dimensional datasets. Adopting a robust data-driven approach, we formulate the problem as a saddle-point optimization. Our primary contribution is a…

Optimization and Control · Mathematics 2026-04-13 Shabnam Khodakaramzadeh , Soroosh Shafiee , Gabriel de Albuquerque Gleizer , Peyman Mohajerin Esfahani

We consider stochastic optimization problems with the dual tasks of (i) effectively finding the optimizer and (ii) reliably conducting statistical inference for the optimal objective function value. We find that classical simulation…

Methodology · Statistics 2025-09-15 Yuhang Wu , Zeyu Zheng , Yingfei Wang , Guangyu Zhang , Zuohua Zhang , Chu Wang

We develop methods to solve general optimal stopping problems with opportunities to stop that arrive randomly. Such problems occur naturally in applications with market frictions. Pivotal to our approach is that our methods operate on…

In this paper, we are motivated by two important applications: entropy-regularized optimal transport problem and road or IP traffic demand matrix estimation by entropy model. Both of them include solving a special type of optimization…

Optimization and Control · Mathematics 2017-09-27 Pavel Dvurechensky , Alexander Gasnikov , Sergey Omelchenko , Alexander Tiurin

Optimal Transport (OT) problems arise in a wide range of applications, from physics to economics. Getting numerical approximate solution of these problems is a challenging issue of practical importance. In this work, we investigate the…

Probability · Mathematics 2019-05-15 Aurélien Alfonsi , Rafaël Coyaud , Virginie Ehrlacher , Damiano Lombardi

Solving optimal control problems (OCPs) of autonomous agents operating under spatial and temporal constraints fast and accurately is essential in applications ranging from eco-driving of autonomous vehicles to quadrotor navigation. However,…

Robotics · Computer Science 2026-01-07 Shiying Dong , Zhipeng Shen , Rudolf Reiter , Hailong Huang , Bingzhao Gao , Hong Chen , Wen-Hua Chen

The paper addresses the problem of optimizing a class of composite functions on Riemannian manifolds and a new first order optimization algorithm (FOA) with a fast convergence rate is proposed. Through the theoretical analysis for FOA, it…

Numerical Analysis · Computer Science 2015-12-08 Haoran Chen , Yanfeng Sun , Junbin Gao , Yongli Hu

This paper concerns the application of techniques from optimal transport (OT) to mean field control, in which the probability measures of interest in OT correspond to empirical distributions associated with a large collection of controlled…

Optimization and Control · Mathematics 2025-06-23 Thomas Le Corre , Ana Busic , Sean Meyn

The use of Reinforcement Learning in real-world scenarios is strongly limited by issues of scale. Most RL learning algorithms are unable to deal with problems composed of hundreds or sometimes even dozens of possible actions, and therefore…

Machine Learning · Computer Science 2012-03-02 Gabriel Dulac-Arnold , Ludovic Denoyer , Philippe Preux , Patrick Gallinari

Learning to Optimize (LtO) is a problem setting in which a machine learning (ML) model is trained to emulate a constrained optimization solver. Learning to produce optimal and feasible solutions subject to complex constraints is a difficult…

Machine Learning · Computer Science 2024-03-18 James Kotary , Ferdinando Fioretto

The material presented in this document is intended as a comprehensive, implementation-oriented supplement to the experimental optimization framework presented in a companion document. The issues of physical degradation, unknown Lipschitz…

Optimization and Control · Mathematics 2014-08-25 Gene A. Bunin , Grégory François , Dominique Bonvin