English
Related papers

Related papers: Improved Fixed-Budget Results via Drift Analysis

200 papers

Boosted decision trees enjoy popularity in a variety of applications; however, for large-scale datasets, the cost of training a decision tree in each round can be prohibitively expensive. Inspired by ideas from the multi-arm bandit…

Machine Learning · Computer Science 2018-05-22 Maryam Aziz , Jesse Anderton , Javed Aslam

Supervised learning models are one of the most fundamental classes of models. Viewing supervised learning from a probabilistic perspective, the set of training data to which the model is fitted is usually assumed to follow a stationary…

Machine Learning · Statistics 2022-09-14 Kungang Zhang , Anh T. Bui , Daniel W. Apley

We provide a framework for the assignment of multiple robots to goal locations, when robot travel times are uncertain. Our premise is that time is the most valuable asset in the system. Hence, we make use of redundant robots to counter the…

Robotics · Computer Science 2019-04-21 Amanda Prorok

Drift analysis is one of the major tools for analysing evolutionary algorithms and nature-inspired search heuristics. In this chapter we give an introduction to drift analysis and give some examples of how to use it for the analysis of…

Neural and Evolutionary Computing · Computer Science 2018-06-13 Johannes Lengler

Test-time data augmentation$-$averaging the predictions of a machine learning model across multiple augmented samples of data$-$is a widely used technique that improves the predictive performance. While many advanced learnable data…

Machine Learning · Statistics 2020-06-23 Dmitry Molchanov , Alexander Lyzhov , Yuliya Molchanova , Arsenii Ashukha , Dmitry Vetrov

Multi-objective optimization studies the process of seeking multiple competing desiderata in some operation. Solution techniques highlight marginal tradeoffs associated with weighing one objective over others. In this paper, we consider…

Optimization and Control · Mathematics 2026-01-05 Allahkaram Shafiei , Jakub Marecek

The controller of an input-affine system is determined through minimizing a time-varying objective function, where stabilization is ensured via a Lyapunov function decay condition as constraint. This constraint is incorporated into the…

Systems and Control · Electrical Eng. & Systems 2021-10-12 Patrick Schmidt , Thomas Göhrt , Stefan Streif

The problem of computing near-optimal contracts in combinatorial settings has recently attracted significant interest in the computer science community. Previous work has provided a rich body of structural and algorithmic insights into this…

Computer Science and Game Theory · Computer Science 2025-06-26 Michal Feldman , Yoav Gal-Tzur , Tomasz Ponitka , Maya Schlesinger

We consider a non-stationary variant of a sequential stochastic optimization problem, in which the underlying cost functions may change along the horizon. We propose a measure, termed variation budget, that controls the extent of said…

Probability · Mathematics 2019-06-07 O. Besbes , Y. Gur , A. Zeevi

We study the estimation of time-homogeneous drift functions in multivariate stochastic differential equations with known diffusion coefficient, from multiple trajectories observed at high frequency over a fixed time horizon. We formulate…

Machine Learning · Statistics 2026-02-23 Marcos Tapia Costa , Nikolas Kantas , George Deligiannidis

Intent-Based Networking (IBN) simplifies network management, but its reliability is challenged by "intent drift", where the network's state gradually deviates from its intended goal, often leading to silent failures. Conventional approaches…

Networking and Internet Architecture · Computer Science 2026-02-17 Md. Kamrul Hossain , Walid Aljoby

We consider the problem of approximating a given element $f$ from a Hilbert space $\mathcal{H}$ by means of greedy algorithms and the application of such procedures to the regression problem in statistical learning theory. We improve on the…

Statistics Theory · Mathematics 2009-09-29 Andrew R. Barron , Albert Cohen , Wolfgang Dahmen , Ronald A. DeVore

Continuous edge inference necessitates not merely low per-timeslot latency, but sustained timeliness guarantees in the presence of time-varying channels, fluctuating edge workloads, and coupled bandwidth-computing resource constraints.…

Networking and Internet Architecture · Computer Science 2026-05-05 Houyi Qi , Minghui Liwang , Sai Zou , Wei Ni

Owing to the increasing need for massive data analysis and model training at the network edge, as well as the rising concerns about the data privacy, a new distributed training framework called federated learning (FL) has emerged. In each…

Networking and Internet Architecture · Computer Science 2019-11-05 Wenqi Shi , Sheng Zhou , Zhisheng Niu

In many prediction problems, it is not uncommon that the number of variables used to construct a forecast is of the same order of magnitude as the sample size, if not larger. We then face the problem of constructing a prediction in the…

Statistics Theory · Mathematics 2016-02-08 Alessio Sancetta

National statistical institutes currently investigate how to improve the output quality of official statistics based on machine learning algorithms. A key obstacle is concept drift, i.e., when the joint distribution of independent variables…

Methodology · Statistics 2021-03-02 Quinten Meertens , Cees Diks , Jaap van den Herik , Frank Takes

Suboptimal methods in optimal control arise due to a limited computational budget, unknown system dynamics, or a short prediction window among other reasons. Although these methods are ubiquitous, their transient performance remains…

Systems and Control · Electrical Eng. & Systems 2025-04-08 Aren Karapetyan , Efe C. Balta , Andrea Iannelli , John Lygeros

Recently, a new paradigm named \emph{drifting model} has been proposed for mapping distributions, which achieves the SOTA image generation performance over ImageNet via one-step neural functional evaluation (NFE). The basic idea is to…

Machine Learning · Computer Science 2026-05-07 Guoqiang Zhang , Kenta Niwa , W. Bastiaan Kleijn

In multi-fidelity optimization, biased approximations of varying costs of the target function are available. This paper studies the problem of optimizing a locally smooth function with a limited budget, where the learner has to make a…

Machine Learning · Statistics 2026-04-20 Come Fiegel , Victor Gabillon , Michal Valko

We propose Speech Enhancement based on Drifting Models (DriftSE), a novel generative framework that formulates denoising as an equilibrium problem. Rather than relying on iterative sampling, DriftSE natively achieves one-step inference by…