English
Related papers

Related papers: A Modified Split Bregman Algorithm for Computing M…

200 papers

In this paper we introduce two conceptual algorithms for minimising abstract convex functions. Both algorithms rely on solving a proximal-type subproblem with an abstract Bregman distance based proximal term. We prove their convergence when…

Optimization and Control · Mathematics 2026-01-09 Reinier Díaz Millán , Julien Ugon

Nonlinear dynamic models are widely used for characterizing functional forms of processes that govern complex biological pathway systems. Over the past decade, validation and further development of these models became possible due to data…

Methodology · Statistics 2019-08-13 Itai Dattner , Shota Gugushvili , Harold Ship , Eberhard O. Voit

We propose a flexible yet interpretable model for high-dimensional data with time-varying second order statistics, motivated and applied to functional neuroimaging data. Motivated by the neuroscience literature, we factorize the covariances…

Machine Learning · Statistics 2021-07-20 Katherine Tsai , Mladen Kolar , Oluwasanmi Koyejo

Estimation of the covariance structure of spatial processes is of fundamental importance in spatial statistics. In the literature, several non-parametric and semi-parametric methods have been developed to estimate the covariance structure…

Methodology · Statistics 2016-11-06 Shu Yang , Zhengyuan Zhu

We analyze stochastic algorithms for optimizing nonconvex, nonsmooth finite-sum problems, where the nonconvex part is smooth and the nonsmooth part is convex. Surprisingly, unlike the smooth case, our knowledge of this fundamental problem…

Optimization and Control · Mathematics 2016-05-24 Sashank J. Reddi , Suvrit Sra , Barnabas Poczos , Alex Smola

In this paper we consider convergence rate problems for stochastic strongly-convex optimization in the non-Euclidean sense with a constraint set over a time-varying multi-agent network. We propose two efficient non-Euclidean stochastic…

Optimization and Control · Mathematics 2018-08-23 Deming Yuan , Yiguang Hong , Daniel W. C. Ho , Guoping Jiang

Non-Gaussianity in the distribution of inflationary perturbations, measurable in statistics of the cosmic microwave background (CMB) and large scale structure fluctuations, can be used to probe non-trivial initial quantum states for these…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-17 Joyce Byun , Nishant Agarwal , Rachel Bean , Richard Holman

The representation of subgrid-scale orography is a challenge in the physical parameterization of orographic gravity-wave sources in weather forecasting. A significant hurdle is encoding as much physical information with as simple a…

Atmospheric and Oceanic Physics · Physics 2025-01-16 Ray Chew , Stamen Dolaptchiev , Maja-Sophie Wedel , Ulrich Achatz

We are interested in exploring the possibility and benefits of structure learning for deep models. As the first step, this paper investigates the matter for Restricted Boltzmann Machines (RBMs). We conduct the study with Replicated Softmax,…

Machine Learning · Computer Science 2018-08-07 Zhourong Chen , Nevin L. Zhang , Dit-Yan Yeung , Peixian Chen

This paper aims at developing novel shuffling gradient-based methods for tackling two classes of minimax problems: nonconvex-linear and nonconvex-strongly concave settings. The first algorithm addresses the nonconvex-linear minimax model…

Optimization and Control · Mathematics 2024-10-30 Quoc Tran-Dinh , Trang H. Tran , Lam M. Nguyen

We introduce a semi-implicit Milstein approximation scheme for some class of non-colliding particle systems modeled by systems of stochastic differential equations with non-constant diffusion coefficients. We show that the scheme converges…

Probability · Mathematics 2019-08-13 Hoang-Long Ngo , Duc-Trong Luong

We develop and analyze a new `relax-and-split' (RS) approach for compositions of separable nonconvex nonsmooth functions with linear maps. RS uses a relaxation technique together with partial minimization, and brings classic techniques…

Optimization and Control · Mathematics 2018-09-27 Peng Zheng , Aleksandr Aravkin

In this paper, we consider the convex and non-convex composition problem with the structure $\frac{1}{n}\sum\nolimits_{i = 1}^n {{F_i}( {G( x )} )}$, where $G( x )=\frac{1}{n}\sum\nolimits_{j = 1}^n {{G_j}( x )} $ is the inner function, and…

Optimization and Control · Mathematics 2018-09-10 Liu Liu , Ji Liu , Cho-Jui Hsieh , Dacheng Tao

This work considers numerical methods for the time-dependent Schr\"{o}dinger equation of incommensurate systems. By using a plane wave method for spatial discretization, the incommensurate problem is lifted to a higher dimension that…

Computational Physics · Physics 2021-03-30 Ting Wang , Huajie Chen , Aihui Zhou , Yuzhi Zhou

Nonlinear control systems with partial information to the decision maker are prevalent in a variety of applications. As a step toward studying such nonlinear systems, this work explores reinforcement learning methods for finding the optimal…

Machine Learning · Computer Science 2025-04-11 Yinbin Han , Meisam Razaviyayn , Renyuan Xu

We present a generalization of the proximal operator defined through a convex combination of convex objectives, where the coefficients are updated in a minimax fashion. We prove that this new operator is Bregman firmly nonexpansive with…

Optimization and Control · Mathematics 2025-04-14 Mastane Achab

Convex nonsmooth optimization problems, whose solutions live in very high dimensional spaces, have become ubiquitous. To solve them, the class of first-order algorithms known as proximal splitting algorithms is particularly adequate: they…

Optimization and Control · Mathematics 2023-02-27 Laurent Condat , Daichi Kitahara , Andrés Contreras , Akira Hirabayashi

Automated model selection is an important application in science and engineering. In this work, we develop a learning approach for identifying structured dynamical systems from undersampled and noisy spatiotemporal data. The learning is…

Machine Learning · Statistics 2023-05-31 Xiaofan Lu , Linan Zhang , Hongjin He

The goal of this work is to develop a novel splitting approach for the numerical solution of multiscale problems involving the coupling between Stokes equations and ODE systems, as often encountered in blood flow modeling applications. The…

Numerical Analysis · Mathematics 2018-04-16 Lucia Carichino , Giovanna Guidoboni , Marcela Szopos

The spectral representation separates the contributions of geometrical arrangement (topology) and intrinsic constituent properties in a composite. The aim of paper is to present a numerical algorithm based on the Monte Carlo integration and…

Other Condensed Matter · Physics 2007-05-23 Enis Tuncer