English
Related papers

Related papers: Improved Time of Arrival measurement model for non…

200 papers

Combinatorial optimization problems can be mapped onto Ising models, and their ground state is generally difficult to find. A lot of heuristics for these problems have been proposed, and one promising approach is to use continuous…

Statistical Mechanics · Physics 2022-11-03 Shintaro Sato

In this paper, we study the problem of escaping from saddle points in smooth nonconvex optimization problems subject to a convex set $\mathcal{C}$. We propose a generic framework that yields convergence to a second-order stationary point of…

Machine Learning · Computer Science 2018-10-10 Aryan Mokhtari , Asuman Ozdaglar , Ali Jadbabaie

On the basis of a local-projective (LP) approach we develop a method of noise reduction in time series that makes use of nonlinear constraints appearing due to the deterministic character of the underlying dynamical system. The Delaunay…

Statistical Mechanics · Physics 2007-05-23 Krzysztof Urbanowicz , Janusz A. Holyst , Thomas Stemler , Hartmut Benner

The main challenge of nonconvex optimization is to find a global optimum, or at least to avoid ``bad'' local minima and meaningless stationary points. We study here the extent to which algorithms, as opposed to optimization models and…

Optimization and Control · Mathematics 2025-02-27 Thi Lan Dinh , Wiebke Bennecke , G. S. Matthijs Jansen , D. Russell Luke , Stefan Mathias

We consider a class of models describing an ensemble of identical interacting agents subject to multiplicative noise. In the thermodynamic limit, these systems exhibit continuous and discontinuous phase transitions in a, generally,…

Statistical Mechanics · Physics 2023-10-27 Niccolò Zagli , Grigorios A. Pavliotis , Valerio Lucarini , Alexander Alecio

We study nonparametric change-point estimation from indirect noisy observations. Focusing on the white noise convolution model, we consider two classes of functions that are smooth apart from the change-point. We establish lower bounds on…

Statistics Theory · Mathematics 2007-06-13 A. Goldenshluger , A. Tsybakov , A. Zeevi

Bayesian optimization is an approach to optimizing objective functions that take a long time (minutes or hours) to evaluate. It is best-suited for optimization over continuous domains of less than 20 dimensions, and tolerates stochastic…

Machine Learning · Statistics 2018-07-10 Peter I. Frazier

Minimizing a convex function of a measure with a sparsity-inducing penalty is a typical problem arising, e.g., in sparse spikes deconvolution or two-layer neural networks training. We show that this problem can be solved by discretizing the…

Optimization and Control · Mathematics 2020-11-04 Lenaic Chizat

We propose perturbed proximal algorithms that can provably escape strict saddles for nonsmooth weakly convex functions. The main results are based on a novel characterization of $\epsilon$-approximate local minimum for nonsmooth functions,…

Machine Learning · Computer Science 2025-07-22 Minhui Huang , Weiming Zhu

The nonlinear optimization problem with linear constraints has many applications in engineering fields such as the visual-inertial navigation and localization of an unmanned aerial vehicle maintaining the horizontal flight. In order to…

Numerical Analysis · Mathematics 2020-11-03 Xin-long Luo , Jia-hui Lv , Geng Sun

Noise-induced transitions between multistable states happen in a multitude of systems, such as species extinction in biology, protein folding, or tipping points in climate science. Large deviation theory is the rigorous language to describe…

Probability · Mathematics 2024-09-27 Paolo Bernuzzi , Tobias Grafke

This paper considers time-average stochastic optimization, where a time average decision vector, an average of decision vectors chosen in every time step from a time-varying (possibly non-convex) set, minimizes a convex objective function…

Optimization and Control · Mathematics 2015-01-29 Sucha Supittayapornpong , Michael J. Neely

In this paper, we consider the problem of multi-objective optimal control of a dynamical system with additive and multiplicative noises with given second moments and arbitrary probability distributions. The objectives are given by quadratic…

Optimization and Control · Mathematics 2014-02-17 Ather Gattami

The goal of ordinal embedding is to represent items as points in a low-dimensional Euclidean space given a set of constraints in the form of distance comparisons like "item $i$ is closer to item $j$ than item $k$". Ordinal constraints like…

Machine Learning · Statistics 2016-06-24 Lalit Jain , Kevin Jamieson , Robert Nowak

In a typical optimization problem, the task is to pick one of a number of options with the lowest cost or the highest value. In practice, these cost/value quantities often come through processes such as measurement or machine learning,…

Data Structures and Algorithms · Computer Science 2022-07-20 Mohammad Mahdian , Jieming Mao , Kangning Wang

The paper studies identification of linear systems with multiplicative noise from multiple-trajectory data. An algorithm based on the least-squares method and multiple-trajectory data is proposed for joint estimation of the nominal system…

Systems and Control · Electrical Eng. & Systems 2022-06-07 Yu Xing , Benjamin Gravell , Xingkang He , Karl Henrik Johansson , Tyler Summers

This paper presents a convex optimization-based solution to the design of state-feedback controllers for solving the linear quadratic regulator (LQR) problem of uncertain discrete-time systems with multiplicative noise. To synthesize a…

Systems and Control · Electrical Eng. & Systems 2022-05-17 Majid Mazouchi , Farzaneh Tatari , Hamidreza Modares

Recently, several studies consider the stochastic optimization problem but in a heavy-tailed noise regime, i.e., the difference between the stochastic gradient and the true gradient is assumed to have a finite $p$-th moment (say being upper…

Optimization and Control · Mathematics 2023-05-23 Zijian Liu , Zhengyuan Zhou

Under mild assumptions stochastic gradient methods asymptotically achieve an optimal rate of convergence if the arithmetic mean of all iterates is returned as an approximate optimal solution. However, in the absence of stochastic noise, the…

Optimization and Control · Mathematics 2022-10-06 Melinda Hagedorn , Florian Jarre

Assessing data informativity, determining whether the measured data contains sufficient information for a specific control objective, is a fundamental challenge in data-driven control. In noisy scenarios, existing studies deal with system…

Optimization and Control · Mathematics 2026-04-02 Taira Kaminaga , Hampei Sasahara