English
Related papers

Related papers: Semigroup Consistency as a Diagnostic for Learned …

200 papers

Local Stochastic Gradient Descent (SGD) with periodic model averaging (FedAvg) is a foundational algorithm in Federated Learning. The algorithm independently runs SGD on multiple workers and periodically averages the model across all the…

Machine Learning · Computer Science 2022-01-12 Sunwoo Lee , Anit Kumar Sahu , Chaoyang He , Salman Avestimehr

In this paper, we are concerned with regularized regression problems where the prior regularizer is a proper lower semicontinuous and convex function which is also partly smooth relative to a Riemannian submanifold. This encompasses as…

Statistics Theory · Mathematics 2016-02-11 Samuel Vaiter , Charles-Alban Deledalle , Jalal M. Fadili , Gabriel Peyré , Charles Dossal

Turbulence simulation with classical numerical solvers requires high-resolution grids to accurately resolve dynamics. Here we train learned simulators at low spatial and temporal resolutions to capture turbulent dynamics generated at high…

Discrete-time models of non-uniformly sampled nonlinear systems under zero-order hold relate the next state sample to the current state sample, (constant) input value, and sampling interval. The exact discrete-time model, that is, the…

Systems and Control · Computer Science 2018-07-30 Alexis J. Vallarella , Hernan Haimovich

Simulators are a critical component of modern robotics research. Strategies for both perception and decision making can be studied in simulation first before deployed to real world systems, saving on time and costs. Despite significant…

Machine Learning · Computer Science 2020-11-19 Bhairav Mehta , Ankur Handa , Dieter Fox , Fabio Ramos

This paper studies least-square regression penalized with partly smooth convex regularizers. This class of functions is very large and versatile allowing to promote solutions conforming to some notion of low-complexity. Indeed, they force…

Optimization and Control · Mathematics 2014-07-01 Samuel Vaiter , Gabriel Peyré , Jalal M. Fadili

This paper considers optimization problems over networks where agents have individual objectives to meet, or individual parameter vectors to estimate, subject to subspace constraints that require the objectives across the network to lie in…

Multiagent Systems · Computer Science 2020-04-22 Roula Nassif , Stefan Vlaski , Ali H. Sayed

We consider the general class of time-homogeneous stochastic dynamical systems, both discrete and continuous, and study the problem of learning a representation of the state that faithfully captures its dynamics. This is instrumental to…

Machine Learning · Computer Science 2024-03-15 Vladimir R. Kostic , Pietro Novelli , Riccardo Grazzi , Karim Lounici , Massimiliano Pontil

Neural operators have emerged as a powerful tool for learning mappings between infinite-dimensional function spaces. However, their approximation properties in Sobolev norms remain poorly quantified, even though these norms control both…

Machine Learning · Computer Science 2026-05-12 Nicole Hao

(Stochastic) bilevel optimization is a frequently encountered problem in machine learning with a wide range of applications such as meta-learning, hyper-parameter optimization, and reinforcement learning. Most of the existing studies on…

Machine Learning · Computer Science 2023-03-16 Meng Ding , Mingxi Lei , Yunwen Lei , Di Wang , Jinhui Xu

Conformal prediction is widely used to equip black-box machine learning models with uncertainty quantification, offering formal coverage guarantees under exchangeable data. However, these guarantees fail when faced with subpopulation…

Machine Learning · Computer Science 2025-11-10 Nien-Shao Wang , Duygu Nur Yaldiz , Yavuz Faruk Bakman , Sai Praneeth Karimireddy

We consider the consistency properties of a regularised estimator for the simultaneous identification of both changepoints and graphical dependency structure in multivariate time-series. Traditionally, estimation of Gaussian Graphical…

Statistics Theory · Mathematics 2017-12-18 Alex J. Gibberd , Sandipan Roy

Learning with few labeled data has been a longstanding problem in the computer vision and machine learning research community. In this paper, we introduced a new semi-supervised learning framework, SimMatch, which simultaneously considers…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Mingkai Zheng , Shan You , Lang Huang , Fei Wang , Chen Qian , Chang Xu

We consider the least-square regression problem with regularization by a block 1-norm, i.e., a sum of Euclidean norms over spaces of dimensions larger than one. This problem, referred to as the group Lasso, extends the usual regularization…

Machine Learning · Computer Science 2008-01-28 Francis Bach

This note is concerned with accurate and computationally efficient approximations of moments of Gaussian random variables passed through sigmoid or softmax mappings. These approximations are semi-analytical (i.e. they involve the numerical…

Machine Learning · Statistics 2017-03-07 Jean Daunizeau

By revisiting the path-integral formulation of the Hubbard model, we propose a theoretical approach based on a semiclassical approximation employing an unconventional coherent-state representation. Within this framework, a subset of the…

Strongly Correlated Electrons · Physics 2026-04-06 Yuki Yamasaki , Hidemaro Suwa , Cristian D. Batista , Shintaro Hoshino

Iterative self-correction is increasingly deployed in agentic LLM systems, yet whether repeated refinement improves or degrades performance remains inconsistent across models. We recast self-correction as a closed-loop feedback-control…

Artificial Intelligence · Computer Science 2026-05-05 Aofan Liu , Jingxiang Meng

This article addresses the challenge of adapting data-based models over time. We propose a novel two-fold modelling architecture designed to correct plant-model mismatch caused by two types of uncertainty. Out-of-domain uncertainty arises…

Systems and Control · Electrical Eng. & Systems 2025-07-17 Laura Boca de Giuli , Alessio La Bella , Riccardo Scattolini

In this paper the theory of evolution semigroups is developed and used to provide a framework to study the stability of general linear control systems. These include time-varying systems modeled with unbounded state-space operators acting…

Dynamical Systems · Mathematics 2007-05-23 Stephen Clark , Yuri Latushkin , Stephen J. Montgomery-Smith , Tim Randolph

We present a physical interpretation of machine learning functions, opening up the possibility to control properties of statistical systems via the inclusion of these functions in Hamiltonians. In particular, we include the predictive…

High Energy Physics - Lattice · Physics 2021-02-17 Dimitrios Bachtis , Gert Aarts , Biagio Lucini