English
Related papers

Related papers: A Stability Principle for Learning under Non-Stati…

200 papers

We present a novel data-driven strategy to choose the hyperparameter $k$ in the $k$-NN regression estimator without using any hold-out data. We treat the problem of choosing the hyperparameter as an iterative procedure (over $k$) and…

Machine Learning · Statistics 2024-07-18 Yaroslav Averyanov , Alain Celisse

I investigate a stronger form of regularization by deactivating neurons for extended periods, a departure from the temporary changes of methods like Dropout. However, this long-term dynamism introduces a critical challenge: severe training…

Machine Learning · Computer Science 2025-09-26 Zichuan Yang

The setting of an agent making decisions under uncertainty and under dynamic constraints is common for the fields of optimal control, reinforcement learning, and recently also for online learning. In the online learning setting, the quality…

Systems and Control · Electrical Eng. & Systems 2023-04-18 Aren Karapetyan , Anastasios Tsiamis , Efe C. Balta , Andrea Iannelli , John Lygeros

We study the problem of determining an effective exploration strategy in static and non-linear optimization problems, which depend on an unknown scalar parameter to be learned from online collected noisy data. An optimal trade-off between…

Optimization and Control · Mathematics 2024-09-13 Ying Wang , Mirko Pasquini , Kévin Colin , Håkan Hjalmarsson

The classical stability margin analysis based on the linearized model is widely used in practice even in nonlinear systems. Although linear analysis techniques are relatively standard and have simple implementation structures, they are…

Systems and Control · Electrical Eng. & Systems 2024-06-25 Jinrui Ren , Quan Quan

We consider the problem of reinforcement learning (RL) with unbounded state space motivated by the classical problem of scheduling in a queueing network. Traditional policies as well as error metric that are designed for finite, bounded or…

Machine Learning · Computer Science 2020-06-09 Devavrat Shah , Qiaomin Xie , Zhi Xu

Neural population activity often exhibits rich variability and temporal structure. This variability is thought to arise from single-neuron stochasticity, neural dynamics on short time-scales, as well as from modulations of neural firing…

Machine Learning · Statistics 2014-10-14 Mijung Park , Jakob H. Macke

We consider the problem of controlling an unknown linear dynamical system in the presence of (nonstochastic) adversarial perturbations and adversarial convex loss functions. In contrast to classical control, the a priori determination of an…

Machine Learning · Computer Science 2020-01-22 Elad Hazan , Sham M. Kakade , Karan Singh

Approximate necessary optimality conditions in terms of Fr\'echet subgradients and normals for a rather general optimization problem with a potentially non-Lipschitzian objective function are established with the aid of Ekeland's…

Optimization and Control · Mathematics 2021-10-15 Alexander Y. Kruger , Patrick Mehlitz

Real-time inference is a challenge of real-world reinforcement learning due to temporal differences in time-varying environments: the system collects data from the past, updates the decision model in the present, and deploys it in the…

Machine Learning · Computer Science 2024-05-28 Hyunin Lee , Ming Jin , Javad Lavaei , Somayeh Sojoudi

We study the numerical solution of nonlinear partially observed optimal stopping problems. The system state is taken to be a multi-dimensional diffusion and drives the drift of the observation process, which is another multi-dimensional…

Optimization and Control · Mathematics 2010-01-20 Mike Ludkovski

Stochastic dominance serves as a general framework for modeling a broad spectrum of decision preferences under uncertainty, with risk aversion as one notable example, as it naturally captures the intrinsic structure of the underlying…

Machine Learning · Computer Science 2026-01-06 Shicong Cen , Jincheng Mei , Hanjun Dai , Dale Schuurmans , Yuejie Chi , Bo Dai

Robust optimization (RO) is a common approach to tractably obtain safeguarding solutions for optimization problems with uncertain constraints. In this paper, we study a statistical framework to integrate data into RO, based on learning a…

Optimization and Control · Mathematics 2020-03-03 L. Jeff Hong , Zhiyuan Huang , Henry Lam

We consider the problem of using observational bandit feedback data from multiple heterogeneous data sources to learn a personalized decision policy that robustly generalizes across diverse target settings. To achieve this, we propose a…

Machine Learning · Computer Science 2024-10-14 Aldo Gael Carranza , Susan Athey

This paper investigates the asymptotic behavior of stochastic recursive inclusions in the presence of non-zero, non-diminishing bias, a setting that frequently arises in zeroth-order optimization, stochastic approximation with…

Optimization and Control · Mathematics 2026-01-19 Anik Kumar Paul , Karthik Shenoy , Arun D. Mahindrakar

This article is devoted to the stability of error bounds (local and global) for semi-infinite convex constraint systems in Banach spaces. We provide primal characterizations of the stability of local and global error bounds when systems are…

Optimization and Control · Mathematics 2023-02-07 Zhou Wei , Michel Théra , Jen-Chih Yao

We quantify the minimax rate for a nonparametric regression model over a star-shaped function class $\mathcal{F}$ with bounded diameter. We obtain a minimax rate of ${\varepsilon^{\ast}}^2\wedge\mathrm{diam}(\mathcal{F})^2$ where…

Statistics Theory · Mathematics 2025-08-20 Akshay Prasadan , Matey Neykov

Optimization under uncertainty and risk is indispensable in many practical situations. Our paper addresses stability of optimization problems using composite risk functionals which are subjected to measure perturbations. Our main focus is…

Optimization and Control · Mathematics 2022-01-06 Darinka Dentcheva , Yang Lin , Spiridon Penev

A system of partial differential equations representing stochastic neural fields was recently proposed with the aim of modelling the activity of noisy grid cells when a mammal travels through physical space. The system was rigorously…

Analysis of PDEs · Mathematics 2023-07-18 José Antonio Carrillo , Pierre Roux , Susanne Solem

In this paper, we address the efficient implementation of moving horizon state estimation of constrained discrete-time linear systems. We propose a novel iteration scheme which employs a proximity-based formulation of the underlying…

Optimization and Control · Mathematics 2021-11-09 Meriem Gharbi , Bahman Gharesifard , Christian Ebenbauer