English
Related papers

Related papers: Robust exact differentiators with predefined conve…

200 papers

Deep learning requires regularization mechanisms to reduce overfitting and improve generalization. We address this problem by a new regularization method based on distributional robust optimization. The key idea is to modify the…

Machine Learning · Computer Science 2020-06-08 Aurora Cobo Aguilera , Antonio Artés-Rodríguez , Fernando Pérez-Cruz , Pablo Martínez Olmos

Decentralized optimization is a powerful paradigm that finds applications in engineering and learning design. This work studies decentralized composite optimization problems with non-smooth regularization terms. Most existing gradient-based…

Optimization and Control · Mathematics 2019-10-29 Sulaiman A. Alghunaim , Kun Yuan , Ali H. Sayed

We consider the robust version of items selection problem, in which the goal is to choose representatives from a family of sets, preserving constraints on the allowed items' combinations. We prove NP-hardness of the deterministic version,…

Discrete Mathematics · Computer Science 2019-07-23 Maciej Drwal

The presence of second-order smoothness for objective functions of optimization problems can provide valuable information about their stability properties and help us design efficient numerical algorithms for solving these problems. Such…

Optimization and Control · Mathematics 2023-08-04 N. T. V. Hang , M. E. Sarabi

This paper presents a computationally efficient robust model predictive control law for discrete linear time invariant systems subject to additive disturbances that may depend on the state and/or input norms. Despite the dependency being…

Optimization and Control · Mathematics 2019-08-12 Danylo Malyuta , Behcet Acikmese , Martin Cacan

Robust Reinforcement Learning tries to make predictions more robust to changes in the dynamics or rewards of the system. This problem is particularly important when the dynamics and rewards of the environment are estimated from the data. In…

Machine Learning · Computer Science 2022-06-15 Pierre Clavier , Stéphanie Allassonière , Erwan Le Pennec

This paper addresses the classical problem of determining the sets of possible states of a linear discrete-time system subject to bounded disturbances from measurements corrupted by bounded noise. These so-called uncertainty sets evolve…

Optimization and Control · Mathematics 2014-05-08 Robin Hill , Yousong Luo , Uwe Schwerdtfeger

We study decidability of verification problems for timed automata extended with unbounded discrete data structures. More detailed, we extend timed automata with a pushdown stack. In this way, we obtain a strong model that may for instance…

Logic in Computer Science · Computer Science 2017-01-11 Karin Quaas

Investigation of machine learning algorithms robust to changes between the training and test distributions is an active area of research. In this paper we explore a special type of dataset shift which we call class-dependent domain shift.…

Machine Learning · Computer Science 2020-07-13 Tigran Galstyan , Hrant Khachatrian , Greg Ver Steeg , Aram Galstyan

First order optimization algorithms play a major role in large scale machine learning. A new class of methods, called adaptive algorithms, were recently introduced to adjust iteratively the learning rate for each coordinate. Despite great…

Machine Learning · Computer Science 2019-10-01 André Belotto da Silva , Maxime Gazeau

We extend Robust Optimization to fractional programming, where both the objective and the constraints contain uncertain parameters. Earlier work did not consider uncertainty in both the objective and the constraints, or did not use Robust…

Optimization and Control · Mathematics 2015-08-21 Bram L. Gorissen

This is the second part of study on the optimal convergence rate of the explicit Euler discretization in time for the convection-diffusion equations [Appl. Math. Lett. \textbf{131} (2022) 108048] which focuses on high-dimensional…

Numerical Analysis · Mathematics 2022-05-13 Qifeng Zhang , Jiyuan Zhang , Zhi-zhong Sun

A long-standing open question in Integer Programming is whether integer programs with constraint matrices with bounded subdeterminants are efficiently solvable. An important special case thereof are congruency-constrained integer programs…

Optimization and Control · Mathematics 2023-04-26 Martin Nägele , Richard Santiago , Rico Zenklusen

While robust divergence such as density power divergence and $\gamma$-divergence is helpful for robust statistical inference in the presence of outliers, the tuning parameter that controls the degree of robustness is chosen in a…

Methodology · Statistics 2021-09-15 Shonosuke Sugasawa , Shouto Yonekura

The use of neural networks in safety-critical systems requires safe and robust models, due to the existence of adversarial attacks. Knowing the minimal adversarial perturbation of any input x, or, equivalently, knowing the distance of x…

Machine Learning · Computer Science 2022-09-12 Fabio Brau , Giulio Rossolini , Alessandro Biondi , Giorgio Buttazzo

A novel switching differentiator that has considerably simple form is proposed. Under the assumption that time-derivatives of the signal are norm-bounded, it is shown that estimation errors are convergent to the zeros asymptotically. The…

Systems and Control · Computer Science 2018-05-01 Jang-Hyun Park

We consider recent work of Haber and Ruthotto 2017 and Chang et al. 2018, where deep learning neural networks have been interpreted as discretisations of an optimal control problem subject to an ordinary differential equation constraint. We…

Optimization and Control · Mathematics 2019-10-02 Martin Benning , Elena Celledoni , Matthias J. Ehrhardt , Brynjulf Owren , Carola-Bibiane Schönlieb

This paper deals with the convergence time analysis of a class of fixed-time stable systems with the aim to provide a new non-conservative upper bound for its settling time. Our contribution is fourfold. First, we revisit the well-known…

Optimization and Control · Mathematics 2019-07-23 R. Aldana-López , D. Gómez-Gutiérrez , E. Jiménez-Rodríguez , J. D. Sánchez-Torres , M. Defoort

Diffusion processes arise in many fields, and so simulating the path of a diffusion is an important problem. It is usually necessary to make some sort of approximation via model-discretization, but a recently introduced class of algorithms,…

Methodology · Statistics 2013-11-25 Paul A. Jenkins

This paper concerns the adaptive control of a class of discrete-time nonlinear systems with all states accessible. Recently, a high-order tuner algorithm was developed for the minimization of convex loss functions with time-varying…

Optimization and Control · Mathematics 2023-03-21 Peter A. Fisher , Anuradha M. Annaswamy