Related papers: Stochastic $\Sigma$-convergence in Orlicz setting …
We generalize stochastic subgradient descent methods to situations in which we do not receive independent samples from the distribution over which we optimize, but instead receive samples that are coupled over time. We show that as long as…
We analyse the $\Gamma$-convergence of general non-local convolution type functionals with varying densities depending on the space variable and on the symmetrized gradient. The limit is a local free-discontinuity functional, where the bulk…
We develop a quantitative theory of stochastic homogenization in the more general framework of differential forms. Inspired by recent progress in the uniformly elliptic setting, the analysis relies on the study of certain subadditive…
The $\Gamma $-limit of a family of functionals $u\mapsto \int_{\Omega }f\left( \frac{x}{\varepsilon },\frac{x}{\varepsilon ^{2}},D^{s}u\right) dx$ is obtained for $s=1,2$ and when the integrand $f=f\left( y,z,v\right) $ is a continous…
Stochastic differentiable approximation schemes are widely used for solving high dimensional problems. Most of existing methods satisfy some desirable properties, including conditional descent inequalities, and almost sure (a.s.)…
Homogenization of integral functionals is studied under the constraint that admissible maps have to take their values into a given smooth manifold. The notion of tangential homogenization is defined by analogy with the tangential…
Over the past ten years, driven by large scale optimisation problems arising from machine learning, the development of stochastic optimisation methods have witnessed a tremendous growth. However, despite their popularity, the theoretical…
In this paper, we consider stochastic homogenization of elliptic equations with unbounded and non-uniformly elliptic coefficients. Extending subadditive arguments, we get an estimate for the rate of the convergence of the solution of the…
Gradient dominance property is a condition weaker than strong convexity, yet sufficiently ensures global convergence even in non-convex optimization. This property finds wide applications in machine learning, reinforcement learning (RL),…
We consider the variant of stochastic homogenization theory introduced in [X. Blanc, C. Le Bris and P.-L. Lions, C. R. Acad. Sci. Serie I 2006 and Journal de Mathematiques Pures et Appliquees 2007]. The equation under consideration is a…
For finite-dimensional problems, stochastic approximation methods have long been used to solve stochastic optimization problems. Their application to infinite-dimensional problems is less understood, particularly for nonconvex objectives.…
We consider convex-concave saddle-point problems where the objective functions may be split in many components, and extend recent stochastic variance reduction methods (such as SVRG or SAGA) to provide the first large-scale linearly…
This paper focuses on investigating an inexact stochastic model-based optimization algorithm that integrates preconditioning techniques for solving stochastic composite optimization problems. The proposed framework unifies and extends the…
In this paper we study the deterministic and stochastic homogenisation of free-discontinuity functionals under \emph{linear} growth and coercivity conditions. The main novelty of our deterministic result is that we work under very general…
Stochastic optimization naturally appear in many application areas, including machine learning. Our goal is to go further in the analysis of the Stochastic Average Gradient Accelerated (SAGA) algorithm. To achieve this, we introduce a new…
This paper is concerned with a class of stochastic optimization problems defined on a Banach space with almost sure conic-type constraints. For this class of problems, we investigate the consistency of optimal values and solutions…
We introduce a new approach to develop stochastic optimization algorithms for a class of stochastic composite and possibly nonconvex optimization problems. The main idea is to combine two stochastic estimators to create a new hybrid one. We…
We address the deterministic homogenization, in the general context of ergodic algebras, of a doubly nonlinear problem which generalizes the well known Stefan model, and includes the classical porous medium equation. It may be represented…
This paper extends the Concentration-Compactness Principle to Musielak-Orlicz spaces, working in both bounded and unbounded domains. We show that our results include important special cases like classical Orlicz spaces, variable exponent…
Stochastic-periodic homogenization is studied for the Maxwell equations with nonlinear and periodic electric conductivity. It is shown by the stochastic-two-scale convergence method that the sequence of solutions of a class of highly…