English
Related papers

Related papers: An Adaptive Random Fourier Features approach Appli…

200 papers

We propose a novel learning framework based on neural mean-field dynamics for inference and estimation problems of diffusion on networks. Our new framework is derived from the Mori-Zwanzig formalism to obtain an exact evolution of the node…

Machine Learning · Computer Science 2021-01-20 Shushan He , Hongyuan Zha , Xiaojing Ye

We propose an adaptive diffusion mechanism to optimize a global cost function in a distributed manner over a network of nodes. The cost function is assumed to consist of a collection of individual components. Diffusion adaptation allows the…

Optimization and Control · Mathematics 2015-06-03 Jianshu Chen , Ali H. Sayed

Stochastic differential equations are an important modeling class in many disciplines. Consequently, there exist many methods relying on various discretization and numerical integration schemes. In this paper, we propose a novel,…

Machine Learning · Computer Science 2019-05-29 Gabriele Abbati , Philippe Wenk , Michael A Osborne , Andreas Krause , Bernhard Schölkopf , Stefan Bauer

Federated learning (FL) aims to train machine learning (ML) models collaboratively using decentralized data, bypassing the need for centralized data aggregation. Standard FL models often assume that all data come from the same unknown…

Machine Learning · Computer Science 2025-03-25 Wen Bai , Yi Wong , Xiao Qiao , Chin Pang Ho

Randomized neural networks (RaNNs) are attractive for partial differential equations (PDEs) because they replace expensive end-to-end training with a linear least-squares solve over randomized hidden features. Their practical performance,…

Numerical Analysis · Mathematics 2026-04-28 You Yang , Fei Wang

Stochastic differential equations (SDEs) are one of the most important representations of dynamical systems. They are notable for the ability to include a deterministic component of the system and a stochastic one to represent random…

Machine Learning · Computer Science 2021-05-19 Noura Dridi , Lucas Drumetz , Ronan Fablet

An adaptive refinement strategy, based on an equilibrated flux a posteriori error estimator, is proposed in the context of defeaturing problems. Defeaturing consists of removing features from complex domains to simplify mesh generation and…

Numerical Analysis · Mathematics 2026-03-04 Annalisa Buffa , Denise Grappein , Rafael Vázquez

Modeling non-stationary processes, where statistical properties vary across the input domain, is a critical challenge in machine learning; yet most scalable methods rely on a simplifying assumption of stationarity. This forces a difficult…

Machine Learning · Computer Science 2026-02-03 Sawan Kumar , Souvik Chakraborty

Existing variance reduction techniques used in stochastic simulations for rare event analysis still require a substantial number of model evaluations to estimate small failure probabilities. In the context of complex, nonlinear finite…

Machine Learning · Computer Science 2025-08-04 Liuyun Xu , Seymour M. J. Spence

Identification of nonlinear dynamical systems is crucial across various fields, facilitating tasks such as control, prediction, optimization, and fault detection. Many applications require methods capable of handling complex systems while…

Machine Learning · Statistics 2024-11-05 Luc Brogat-Motte , Riccardo Bonalli , Alessandro Rudi

In this paper, we propose Stochastic Block-ADMM as an approach to train deep neural networks in batch and online settings. Our method works by splitting neural networks into an arbitrary number of blocks and utilizes auxiliary variables to…

Machine Learning · Computer Science 2021-05-04 Saeed Khorram , Xiao Fu , Mohamad H. Danesh , Zhongang Qi , Li Fuxin

This work develops Monte Carlo Euler adaptive time stepping methods for the weak approximation problem of jump diffusion driven stochastic differential equations. The main result is the derivation of a new expansion for the omputational…

Numerical Analysis · Mathematics 2007-05-23 E. Mordecki , A. Szepessy , R. Tempone , G. E. Zouraris

The Schr\"odinger bridge problem is concerned with finding a stochastic dynamical system bridging two marginal distributions that minimises a certain transportation cost. This problem, which represents a generalisation of optimal transport…

Machine Learning · Computer Science 2026-03-03 Kirill Tamogashev , Nikolay Malkin

Kernel methods are powerful and flexible approach to solve many problems in machine learning. Due to the pairwise evaluations in kernel methods, the complexity of kernel computation grows as the data size increases; thus the applicability…

Machine Learning · Computer Science 2017-11-28 Bharath Bhushan Damodaran , Nicolas Courty , Philippe-Henri Gosselin

We propose a new numerical scheme for approximating level-sets of Lipschitz multivariate functions which is robust to stochastic noise. The algorithm's main feature is an adaptive grid-based stochastic approximation strategy which…

Numerical Analysis · Mathematics 2025-09-19 Matteo Croci , Abdul-Lateef Haji-Ali , Ian C. J. Powell

Finite element discretizations of problems in computational physics often rely on adaptive mesh refinement (AMR) to preferentially resolve regions containing important features during simulation. However, these spatial refinement strategies…

Computational Engineering, Finance, and Science · Computer Science 2022-09-27 Corbin Foucart , Aaron Charous , Pierre F. J. Lermusiaux

When learning from streaming data, a change in the data distribution, also known as concept drift, can render a previously-learned model inaccurate and require training a new model. We present an adaptive learning algorithm that extends…

Machine Learning · Computer Science 2020-08-04 Ashraf Tahmasbi , Ellango Jothimurugesan , Srikanta Tirthapura , Phillip B. Gibbons

In this paper, we describe a general algorithmic framework for solving linear signal or feature fusion optimization problems in a distributed setting, for example in a wireless sensor network (WSN). These problems require linearly combining…

Signal Processing · Electrical Eng. & Systems 2023-05-12 Cem Ates Musluoglu , Alexander Bertrand

Unnormalized probability distributions are central to modeling complex physical systems across various scientific domains. Traditional sampling methods, such as Markov Chain Monte Carlo (MCMC), often suffer from slow convergence, critical…

Machine Learning · Computer Science 2025-10-27 Vikas Kanaujia , Vipul Arora

We describe an adaptive importance sampling algorithm for rare events that is based on a dual stochastic control formulation of a path sampling problem. Specifically, we focus on path functionals that have the form of cumulate generating…

Dynamical Systems · Mathematics 2019-01-30 Omar Kebiri , Lara Neureither , Carsten Hartmann