English
Related papers

Related papers: Uniform-in-time convergence bounds for Persistent …

200 papers

The goal of Continual Learning (CL) is to continuously learn from new data streams and accomplish the corresponding tasks. Previously studied CL assumes that data are given in sequence nose-to-tail for different tasks, thus indeed belonging…

Machine Learning · Computer Science 2024-01-03 Fan Lyu , Wei Feng , Yuepan Li , Qing Sun , Fanhua Shang , Liang Wan , Liang Wang

Recent advances in center-based clustering continue to improve upon the drawbacks of Lloyd's celebrated $k$-means algorithm over $60$ years after its introduction. Various methods seek to address poor local minima, sensitivity to outliers,…

Machine Learning · Statistics 2021-10-28 Debolina Paul , Saptarshi Chakraborty , Swagatam Das , Jason Xu

Parallel stochastic gradient methods are gaining prominence in solving large-scale machine learning problems that involve data distributed across multiple nodes. However, obtaining unbiased stochastic gradients, which have been the focus of…

Machine Learning · Computer Science 2025-01-14 Ali Beikmohammadi , Sarit Khirirat , Sindri Magnússon

We propose a clustering-based approach for identifying coherent flow structures in continuous dynamical systems. We first treat a particle trajectory over a finite time interval as a high-dimensional data point and then cluster these data…

Dynamical Systems · Mathematics 2022-12-27 Wai Ming Chau , Shingyu Leung

Irregular sampling intervals and missing values in real-world time series data present challenges for conventional methods that assume consistent intervals and complete data. Neural Ordinary Differential Equations (Neural ODEs) offer an…

Machine Learning · Computer Science 2025-01-28 YongKyung Oh , Dong-Young Lim , Sungil Kim

The problem of monotone missing data has been broadly studied during the last two decades and has many applications in different fields such as bioinformatics or statistics. Commonly used imputation techniques require multiple iterations…

Machine Learning · Computer Science 2020-09-25 Thu Nguyen , Duy H. M. Nguyen , Huy Nguyen , Binh T. Nguyen , Bruce A. Wade

Improved uniform error bounds on time-splitting methods are rigorously proven for the long-time dynamics of the weakly nonlinear Dirac equation (NLDE), where the nonlinearity strength is characterized by a dimensionless parameter…

Numerical Analysis · Mathematics 2022-03-16 Weizhu Bao , Yongyong Cai , Feng Yue

Application of discrete-time survival methods for continuous-time survival prediction is considered. For this purpose, a scheme for discretization of continuous-time data is proposed by considering the quantiles of the estimated event-time…

Machine Learning · Statistics 2019-10-16 Håvard Kvamme , Ørnulf Borgan

Distributed model predictive control methods for uncertain systems often suffer from considerable conservatism and can tolerate only small uncertainties due to the use of robust formulations that are amenable to distributed design and…

Systems and Control · Electrical Eng. & Systems 2022-03-03 Simon Muntwiler , Kim P. Wabersich , Lukas Hewing , Melanie N. Zeilinger

This paper considers linear discrete-time systems with additive disturbances, and designs a Model Predictive Control (MPC) law to minimise a quadratic cost function subject to a chance constraint. The chance constraint is defined as a…

Systems and Control · Computer Science 2020-07-15 Shuhao Yan , Paul Goulart , Mark Cannon

This paper considers stochastic linear time-invariant systems subject to constraints on the average number of state-constraint violations over time without knowing the disturbance distribution. We present a novel disturbance-adaptive model…

Systems and Control · Electrical Eng. & Systems 2026-05-13 Jicheng Shi , Colin N. Jones

We analyze the recent Multi-index Stochastic Collocation (MISC) method for computing statistics of the solution of a partial differential equation (PDEs) with random data, where the random coefficient is parametrized by means of a countable…

Numerical Analysis · Mathematics 2016-07-22 Abdul-Lateef Haji-Ali , Fabio Nobile , Lorenzo Tamellini , Raul Tempone

In this paper, we aim to develop stochastic hard thresholding algorithms for the important problem of AUC maximization in imbalanced classification. The main challenge is the pairwise loss involved in AUC maximization. We overcome this…

Machine Learning · Computer Science 2020-11-05 Zhenhuan Yang , Baojian Zhou , Yunwen Lei , Yiming Ying

We develop interacting particle algorithms for learning latent variable models with energy-based priors. To do so, we leverage recent developments in particle-based methods for solving maximum marginal likelihood estimation (MMLE) problems.…

Machine Learning · Statistics 2025-10-15 Joanna Marks , Tim Y. J. Wang , O. Deniz Akyildiz

Temporal difference (TD) learning is a foundational algorithm in reinforcement learning (RL). For nearly forty years, TD learning has served as a workhorse for applied RL as well as a building block for more complex and specialized…

Machine Learning · Computer Science 2025-06-24 Hwanwoo Kim , Panos Toulis , Eric Laber

Marginal maximum likelihood estimation (MMLE) in item response theory (IRT) is highly sensitive to aberrant responses, such as careless answering and random guessing, which can reduce estimation accuracy. To address this issue, this study…

Methodology · Statistics 2025-02-18 Yuki Itaya , Kenichi Hayashi

Uncertainty Quantification through Markov Chain Monte Carlo (MCMC) can be prohibitively expensive for target probability densities with expensive likelihood functions, for instance when the evaluation it involves solving a Partial…

Computation · Statistics 2020-12-11 Mikkel B. Lykkegaard , Grigorios Mingas , Robert Scheichl , Colin Fox , Tim J. Dodwell

The present study explores combining machine learning (ML) algorithms with standard optical diagnostics (such as time-integrated emission spectroscopy and imaging) to accurately predict operating conditions and assess the emission…

Diffusion models have achieved huge empirical success in data generation tasks. Recently, some efforts have been made to adapt the framework of diffusion models to discrete state space, providing a more natural approach for modeling…

Machine Learning · Statistics 2024-02-15 Hongrui Chen , Lexing Ying

We propose a stochastic approximation (SA) based method with randomization of samples for policy evaluation using the least squares temporal difference (LSTD) algorithm. Our proposed scheme is equivalent to running regular temporal…

Machine Learning · Computer Science 2020-01-27 L. A. Prashanth , Nathaniel Korda , Rémi Munos