English
Related papers

Related papers: Variational Analysis of Composite Models with Appl…

200 papers

The paper is devoted to deriving novel second-order necessary and sufficient optimality conditions for local minimizers in rather general classes of nonsmooth unconstrained and constrained optimization problems in finite-dimensional spaces.…

Optimization and Control · Mathematics 2025-01-07 Pham Duy Khanh , Vu Vinh Huy Khoa , Boris S. Mordukhovich , Vo Thanh Phat

We study a class of nonconvex nonsmooth optimization problems in which the objective is a sum of two functions: One function is the average of a large number of differentiable functions, while the other function is proper, lower…

Optimization and Control · Mathematics 2023-05-12 Duy-Nhat Phan , Sedi Bartz , Nilabja Guha , Hung M. Phan

The study of generic, non-linear, deformations of Special Relativity parametrized by a high-energy scale $M$, which was carried out at first order in $M$ in Phys.Rev. D86, 084032 (2012), is extended to second order. This can be done…

High Energy Physics - Theory · Physics 2016-10-07 J. M. Carmona , J. L. Cortes , J. J. Relancio

This paper continues earlier work and is concerned with the inverse problem of parameter identification in variational inequalities of the second kind that does not only treat the parameter linked to a bilinear form, but importantly also…

Optimization and Control · Mathematics 2021-01-01 Joachim Gwinner

In this paper we combine two powerful computational techniques, well-tempered metadynamics and time lagged independent component analysis. The aim is to develop a new tool for studying rare events and exploring complex free energy…

Statistical Mechanics · Physics 2017-12-08 James McCarty , Michele Parrinello

We study the phenomenon of composite operator renormalization and mixing in systems where time-translational invariance is broken and the evolution is out-of-equilibrium. We show that composite operators mix also through non-local memory…

High Energy Physics - Phenomenology · Physics 2013-07-16 Simone Dresti , Antonio Riotto

Regularization plays a key role in a variety of optimization formulations of inverse problems. A recurring theme in regularization approaches is the selection of regularization parameters, and their effect on the solution and on the optimal…

Optimization and Control · Mathematics 2018-08-23 Aleksandr Y. Aravkin , James V. Burke , Michael P. Friedlander

This paper concerns applications of variational analysis to some local aspects of behavioral science modeling by developing an effective variational rationality approach to these and related issues. Our main attention is paid to local…

Optimization and Control · Mathematics 2018-01-08 Boris Mordukhovich , Antoine Soubeyran

Some classic second-order sufficient optimality conditions in the calculus of variations are shown to be equivalent, while also introducing a new equivalent second-order condition which is extremely easy to apply: simply integrate a linear…

Optimization and Control · Mathematics 2025-02-25 William W. Hager

In several applications such as databases, planning, and sensor networks, parameters such as selectivity, load, or sensed values are known only with some associated uncertainty. The performance of such a system (as captured by some…

Data Structures and Algorithms · Computer Science 2010-01-28 Sudipto Guha , Kamesh Munagala

Compositionality is a key strategy for addressing combinatorial complexity and the curse of dimensionality. Recent work has shown that compositional solutions can be learned and offer substantial gains across a variety of domains, including…

Machine Learning · Computer Science 2019-04-30 Clemens Rosenbaum , Ignacio Cases , Matthew Riemer , Tim Klinger

A general conversion strategy by involving a shifted parameter $\theta$ is proposed to construct high-order accuracy difference formulas for fractional calculus operators. By converting the second-order backward difference formula with such…

Numerical Analysis · Mathematics 2022-04-13 Baoli Yin , Guoyu Zhang , Yang Liu , Hong Li

Optimization problems with an auxiliary latent variable structure in addition to the main model parameters occur frequently in computer vision and machine learning. The additional latent variables make the underlying optimization task…

Machine Learning · Computer Science 2020-03-13 Christopher Zach , Huu Le

A variational framework, initially developed for high-order mesh optimisation, is being extended for r-adaptation. The method is based on the minimisation of a functional of the mesh deformation. To achieve adaptation, elements of the…

Computational Geometry · Computer Science 2019-01-07 Julian Marcon , Michael Turner , David Moxey , Spencer J. Sherwin , Joaquim Peiró

This paper focuses on regularisation methods using models up to the third order to search for up to second-order critical points of a finite-sum minimisation problem. The variant presented belongs to the framework of [3]: it employs random…

Numerical Analysis · Mathematics 2021-04-05 Stefania Bellavia , Gianmarco Gurioli , Benedetta Morini , Philippe L. Toint

Variational inequalities are a universal optimization paradigm that is interesting in itself, but also incorporates classical minimization and saddle point problems. Modern realities encourage to consider stochastic formulations of…

Optimization and Control · Mathematics 2024-03-27 Alexander Pichugin , Maksim Pechin , Aleksandr Beznosikov , Alexander Gasnikov

This article develops variational integrators for a class of underactuated mechanical systems using the theory of discrete mechanics. Further, a discrete optimal control problem is formulated for the considered class of systems and…

Systems and Control · Computer Science 2018-11-16 Siddharth H. Nair , Ravi N. Banavar

In this paper, we propose a new approach to design globally convergent reduced-order observers for nonlinear control systems via contraction analysis and convex optimization. Despite the fact that contraction is a concept naturally suitable…

Optimization and Control · Mathematics 2021-08-17 Bowen Yi , Ruigang Wang , Ian R. Manchester

Recently, much work has been done on extending the scope of online learning and incremental stochastic optimization algorithms. In this paper we contribute to this effort in two ways: First, based on a new regret decomposition and a…

Machine Learning · Computer Science 2017-09-12 Pooria Joulani , András György , Csaba Szepesvári

Stochastic optimization algorithms with variance reduction have proven successful for minimizing large finite sums of functions. Unfortunately, these techniques are unable to deal with stochastic perturbations of input data, induced for…

Machine Learning · Statistics 2017-11-16 Alberto Bietti , Julien Mairal