English
Related papers

Related papers: Optimal Design and Analysis of the Exponentially W…

200 papers

We study the selective learning problem introduced by Qiao and Valiant (2019), in which the learner observes $n$ labeled data points one at a time. At a time of its choosing, the learner selects a window length $w$ and a model $\hat\ell$…

Machine Learning · Computer Science 2021-07-01 Mingda Qiao , Gregory Valiant

Quantitative magnetic resonance imaging (qMRI) derives tissue-specific parameters -- such as the apparent transverse relaxation rate R2*, the longitudinal relaxation rate R1 and the magnetisation transfer saturation -- that can be compared…

Image and Video Processing · Electrical Eng. & Systems 2021-05-10 Yaël Balbastre , Mikael Brudfors , Michela Azzarito , Christian Lambert , Martina F. Callaghan , John Ashburner

Many popular adaptive gradient methods such as Adam and RMSProp rely on an exponential moving average (EMA) to normalize their stepsizes. While the EMA makes these methods highly responsive to new gradient information, recent research has…

Machine Learning · Computer Science 2021-10-13 Brett Daley , Christopher Amato

We present a dynamic resource allocation strategy for energy-efficient and Electromagnetic Field (EMF) exposure aware computation offloading at the wireless network edge. The goal is to maximize the overall system sum-rate of offloaded…

Signal Processing · Electrical Eng. & Systems 2022-04-28 Mattia Merluzzi , Serge Bories , Emilio Calvanese Strinati

Motion prediction is a crucial task in autonomous driving, and one of its major challenges lands in the multimodality of future behaviors. Many successful works have utilized mixture models which require identification of positive mixture…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Longzhong Lin , Xuewu Lin , Tianwei Lin , Lichao Huang , Rong Xiong , Yue Wang

The multivariate Hawkes process is a past-dependent point process used to model the relationship of event occurrences between different phenomena.Although the Hawkes process was originally introduced to describe excitation effects, which…

Methodology · Statistics 2023-06-30 Anna Bonnet , Miguel Martinez Herrera , Maxime Sangnier

We propose a single-loop variance-reduced acceleration framework, which relates checkpoint update probabilities to momentum parameters, for solving the composite general convex problem where the smooth part has the finite-sum structure.…

Optimization and Control · Mathematics 2026-02-26 Hai Liu , Tiande Guo , Congying Han

Estimation of Distribution Algorithms (EDAs) are one branch of Evolutionary Algorithms (EAs) in the broad sense that they evolve a probabilistic model instead of a population. Many existing algorithms fall into this category. Analogous to…

Neural and Evolutionary Computing · Computer Science 2023-11-28 Benjamin Doerr , Weijie Zheng

Momentum based optimizers are central to a wide range of machine learning applications. These typically rely on an Exponential Moving Average (EMA) of gradients, which decays exponentially the present contribution of older gradients. This…

Machine Learning · Computer Science 2024-10-01 Matteo Pagliardini , Pierre Ablin , David Grangier

Detecting changes is of fundamental importance when analyzing data streams and has many applications, e.g., in predictive maintenance, fraud detection, or medicine. A principled approach to detect changes is to compare the distributions of…

Machine Learning · Computer Science 2025-02-13 Florian Kalinke , Marco Heyden , Georg Gntuni , Edouard Fouché , Klemens Böhm

Multi-modal trajectory forecasting methods commonly evaluate using single-agent metrics (marginal metrics), such as minimum Average Displacement Error (ADE) and Final Displacement Error (FDE), which fail to capture joint performance of…

Robotics · Computer Science 2023-10-13 Erica Weng , Hana Hoshino , Deva Ramanan , Kris Kitani

We study dynamic algorithms in the model of algorithms with predictions. We assume the algorithm is given imperfect predictions regarding future updates, and we ask how such predictions can be used to improve the running time. This can be…

Data Structures and Algorithms · Computer Science 2023-12-11 Jan van den Brand , Sebastian Forster , Yasamin Nazari , Adam Polak

Chance constrained optimization problems allow to model problems where constraints involving stochastic components should only be violated with a small probability. Evolutionary algorithms have been applied to this scenario and shown to…

Neural and Evolutionary Computing · Computer Science 2024-08-23 Frank Neumann , Carsten Witt

We statistically analyze empirical plug-in estimators for unbalanced optimal transport (UOT) formalisms, focusing on the Kantorovich-Rubinstein distance, between general intensity measures based on observations from spatio-temporal point…

Statistics Theory · Mathematics 2025-09-05 Marina Struleva , Shayan Hundrieser , Dominic Schuhmacher , Axel Munk

The paper addresses a sequential changepoint detection problem for a general stochastic model, assuming that the observed data may be non-i.i.d. (i.e., dependent and non-identically distributed) and the prior distribution of the change…

Statistics Theory · Mathematics 2018-07-25 Alexander G. Tartakovsky

This paper proposes a probabilistic motion prediction method for long motions. The motion is predicted so that it accomplishes a task from the initial state observed in the given image. While our method evaluates the task achievability by…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Takeru Oba , Norimichi Ukita

Simple Exponential Smoothing is a classical technique used for smoothing time series data by assigning exponentially decreasing weights to past observations through a recursive equation; it is sometimes presented as a rule of thumb…

Methodology · Statistics 2024-03-08 Enrico Bernardi , Alberto Lanconelli , Christopher S. A. Lauria

We propose a new inference framework, named MOSAIC, for change-point detection in dynamic networks with the simultaneous low-rank and sparse-change structure. We establish the minimax rate of detection boundary, which relies on the sparsity…

Machine Learning · Statistics 2025-09-09 Yingying Fan , Jingyuan Liu , Jinchi Lv , Ao Sun

We show that the optimal decision policy for several types of Bayesian sequential detection problems has a threshold switching curve structure on the space of posterior distributions. This is established by using lattice programming and…

Information Theory · Computer Science 2015-03-17 Vikram Krishnamurthy

A rigorous empirical comparison of two stochastic solvers is important when one of the solvers is a prototype of a new algorithm such as multiwalk (MWA). When searching for global minima in $\mathbb{R}^p$, the key data structures of MWA…

Artificial Intelligence · Computer Science 2018-12-10 Franc Brglez