English
Related papers

Related papers: Specialized Interior Point Algorithm for Stable No…

200 papers

A multiscale numerical method is proposed for the solution of semi-linear elliptic stochastic partial differential equations with localized uncertainties and non-linearities, the uncertainties being modeled by a set of random parameters. It…

Numerical Analysis · Mathematics 2019-01-23 Anthony Nouy , Florent Pled

In this paper, we propose novel algorithms for inferring the Maximum a Posteriori (MAP) solution of discrete pairwise random field models under multiple constraints. We show how this constrained discrete optimization problem can be…

Machine Learning · Computer Science 2013-08-02 Yongsub Lim , Kyomin Jung , Pushmeet Kohli

This paper presents a theoretical analysis of linear interpolation as a principled method for stabilizing (large-scale) neural network training. We argue that instabilities in the optimization process are often caused by the nonmonotonicity…

Machine Learning · Computer Science 2024-03-15 Thomas Pethick , Wanyun Xie , Volkan Cevher

We consider the variable selection problem of generalized linear models (GLMs). Stability selection (SS) is a promising method proposed for solving this problem. Although SS provides practical variable selection criteria, it is…

Machine Learning · Statistics 2025-08-06 Takashi Takahashi , Yoshiyuki Kabashima

Large-scale optimization problems that seek sparse solutions have become ubiquitous. They are routinely solved with various specialized first-order methods. Although such methods are often fast, they usually struggle with not-so-well…

Optimization and Control · Mathematics 2021-11-29 Valentina De Simone , Daniela di Serafino , Jacek Gondzio , Spyridon Pougkakiotis , Marco Viola

A nonlinear MPC framework is presented that is suitable for dynamical systems with sampling times in the (sub)millisecond range and that allows for an efficient implementation on embedded hardware. The algorithm is based on an augmented…

Optimization and Control · Mathematics 2018-12-10 Tobias Englert , Andreas Völz , Felix Mesmer , Sönke Rhein , Knut Graichen

A new algorithm is presented for reconstructing stochastic nonlinear dynamical models from noisy time-series data. The approach is analytical; consequently, the resulting algorithm does not require an extensive global search for the model…

Other Condensed Matter · Physics 2009-11-10 V. N. Smelyanskiy , D. G. Luchinsky , D. A. Timucin , A. Bandrivskyy

As we aim to control complex systems, use of a simulator in model-based reinforcement learning is becoming more common. However, it has been challenging to overcome the Reality Gap, which comes from nonlinear model bias and susceptibility…

Robotics · Computer Science 2017-05-16 Gilwoo Lee , Siddhartha S. Srinivasa , Matthew T. Mason

Conic optimization plays a crucial role in many machine learning (ML) problems. However, practical algorithms for conic constrained ML problems with large datasets are often limited to specific use cases, as stochastic algorithms for…

Optimization and Control · Mathematics 2025-11-11 Chuan He , Zhanwang Deng

Interior-point methods offer a highly versatile framework for convex optimization that is effective in theory and practice. A key notion in their theory is that of a self-concordant barrier. We give a suitable generalization of…

Optimization and Control · Mathematics 2024-06-26 Hiroshi Hirai , Harold Nieuwboer , Michael Walter

We present new constraint qualification conditions for nonlinear semidefinite programming that extend some of the constant rank-type conditions from nonlinear programming. As an application of these conditions, we provide a unified global…

Optimization and Control · Mathematics 2021-06-08 Roberto Andreani , Gabriel Haeser , Leonardo M. Mito , Héctor Ramírez C

Gaussian process (GP) surrogate modeling for large computer experiments is limited by cubic runtimes, especially with data from stochastic simulations with input-dependent noise. A popular workaround to reduce computational complexity…

Methodology · Statistics 2022-06-01 D Austin Cole , Robert B Gramacy , Mike Ludkovski

Enforcing state and input constraints during reinforcement learning (RL) in continuous state spaces is an open but crucial problem which remains a roadblock to using RL in safety-critical applications. This paper leverages invariant sets to…

Systems and Control · Electrical Eng. & Systems 2019-06-28 Ankush Chakrabarty , Rien Quirynen , Claus Danielson , Weinan Gao

In this paper we generalize the method of Lagrangian descriptors to two dimensional, area preserving, autonomous and nonautonomous discrete time dynamical systems. We consider four generic model problems--a hyperbolic saddle point for a…

Dynamical Systems · Mathematics 2017-06-01 Carlos Lopesino , Francisco Balibrea-Iniesta , Stephen Wiggins , Ana M. Mancho

System identification is of special interest in science and engineering. This article is concerned with a system identification problem arising in stochastic dynamic systems, where the aim is to estimate the parameters of a system along…

Methodology · Statistics 2022-01-27 Christos Merkatas , Simo Särkkä

A recent trend in probabilistic inference emphasizes the codification of models in a formal syntax, with suitable high-level features such as individuals, relations, and connectives, enabling descriptive clarity, succinctness and…

Artificial Intelligence · Computer Science 2016-06-15 Martin Mladenov , Vaishak Belle , Kristian Kersting

We show that the effects of finite-precision arithmetic in forming and solving the linear system that arises at each iteration of primal-dual interior-point algorithms for nonlinear programming are benign, provided that the iterates satisfy…

Optimization and Control · Mathematics 2025-10-20 Stephen J. Wright

In this paper we solve mixed-integer linear programs (MILPs) via distributed asynchronous saddle point computation. This work is motivated by the MILPs being able to model problems in multi-agent autonomy, such as task assignment problems…

Optimization and Control · Mathematics 2024-10-16 Luke Fina , Christopher Petersen , Matthew Hale

We study the problem of controlling linear time-invariant systems with known noisy dynamics and adversarially chosen quadratic losses. We present the first efficient online learning algorithms in this setting that guarantee $O(\sqrt{T})$…

Machine Learning · Computer Science 2018-06-20 Alon Cohen , Avinatan Hassidim , Tomer Koren , Nevena Lazic , Yishay Mansour , Kunal Talwar

This paper provides a new avenue for exploiting deep neural networks to improve physics-based simulation. Specifically, we integrate the classic Lagrangian mechanics with a deep autoencoder to accelerate elastic simulation of deformable…

Machine Learning · Computer Science 2021-02-23 Siyuan Shen , Yang Yin , Tianjia Shao , He Wang , Chenfanfu Jiang , Lei Lan , Kun Zhou