English
Related papers

Related papers: Moment-Closure Approximations for Discrete Adaptiv…

200 papers

We consider constraint-coupled optimization problems in which agents of a network aim to cooperatively minimize the sum of local objective functions subject to individual constraints and a common linear coupling constraint. We propose a…

Optimization and Control · Mathematics 2019-07-26 Alessandro Falsone , Ivano Notarnicola , Giuseppe Notarstefano , Maria Prandini

To ensure reliable object detection in autonomous systems, the detector must be able to adapt to changes in appearance caused by environmental factors such as time of day, weather, and seasons. Continually adapting the detector to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Anh-Dzung Doan , Bach Long Nguyen , Surabhi Gupta , Ian Reid , Markus Wagner , Tat-Jun Chin

Neural networks struggle on small tabular datasets, where tree-based models remain dominant. We introduce Adaptive Contrastive Approach (AdaCap), a training scheme that combines a permutation-based contrastive loss with a Tikhonov-based…

Machine Learning · Computer Science 2025-11-26 Bruno Belucci , Karim Lounici , Katia Meziani

This paper presents extensions of finite-time stability results to some prototypical adaptive control and estimation frameworks. First, we present a novel scheme of online parameter estimation that guarantees convergence of the estimation…

Optimization and Control · Mathematics 2020-10-20 Kunal Garg , Parag Bobade , Dimitra Panagou

Chance constrained program where one seeks to minimize an objective over decisions which satisfy randomly disturbed constraints with a given probability is computationally intractable. This paper proposes an approximate approach to address…

Computation · Statistics 2019-12-23 Xun Shen , Jiancang Zhuang , Xingguo Zhang

We study decentralized optimization where multiple agents minimize the average of their (strongly) convex, smooth losses over a communication graph. Convergence of the existing decentralized methods generally hinges on an apriori, proper…

Optimization and Control · Mathematics 2025-08-01 Ilya Kuruzov , Xiaokai Chen , Gesualdo Scutari , Alexander Gasnikov

Rejection Sampling is a fundamental Monte-Carlo method. It is used to sample from distributions admitting a probability density function which can be evaluated exactly at any given point, albeit at a high computational cost. However,…

Machine Learning · Statistics 2018-10-23 Juliette Achdou , Joseph C. Lam , Alexandra Carpentier , Gilles Blanchard

Continuous-time neural processes are performant sequential decision-makers that are built by differential equations (DE). However, their expressive power when they are deployed on computers is bottlenecked by numerical DE solvers. This…

In many complex systems, states and interaction structure coevolve towards a dynamic equilibrium. For the adaptive contact process, we obtain approximate expressions for the degree distributions that characterize the interaction network in…

Adaptation and Self-Organizing Systems · Physics 2015-07-01 Stefan Wieland , Ana Nunes

Selecting or designing an appropriate domain adaptation algorithm for a given problem remains challenging. This paper presents a Transformer model that can provably approximate and opt for domain adaptation methods for a given dataset in…

Machine Learning · Computer Science 2024-05-28 Ryuichiro Hataya , Kota Matsui , Masaaki Imaizumi

The problem of detecting correlations from samples of a high-dimensional Gaussian vector has recently received a lot of attention. In most existing work, detection procedures are provided with a full sample. However, following common wisdom…

Statistics Theory · Mathematics 2014-10-24 Rui M. Castro , Gabor Lugosi , Pierre-André Savalle

We consider the problem of online control of systems with time-varying linear dynamics. This is a general formulation that is motivated by the use of local linearization in control of nonlinear dynamical systems. To state meaningful…

Machine Learning · Computer Science 2022-02-15 Paula Gradu , Elad Hazan , Edgar Minasyan

In several applications such as databases, planning, and sensor networks, parameters such as selectivity, load, or sensed values are known only with some associated uncertainty. The performance of such a system (as captured by some…

Data Structures and Algorithms · Computer Science 2010-01-28 Sudipto Guha , Kamesh Munagala

In this article, we introduce an adaptive online model update algorithm designed for predictive control applications in networked systems, particularly focusing on power distribution systems. Unlike traditional methods that depend on…

Systems and Control · Electrical Eng. & Systems 2024-07-18 Vivek Khatana , Chin-Yao Chang , Wenbo Wang

Recurrent neural network architectures can have useful computational properties, with complex temporal dynamics and input-sensitive attractor states. However, evaluation of recurrent dynamic architectures requires solution of systems of…

Neural and Evolutionary Computing · Computer Science 2019-11-18 Dylan Richard Muir

We propose a conceptually novel method of reconstructing the topology of dynamical networks. By examining the correlation between the variable of one node and the derivative of another node, we derive a simple matrix equation yielding the…

Data Analysis, Statistics and Probability · Physics 2015-06-11 Zoran Levnajić

Modularity is a very widely used measure of the level of clustering or community structure in networks. Here we consider a recent generalisation of the definition of modularity to temporal graphs, whose edge-sets change over discrete…

Combinatorics · Mathematics 2025-07-24 Vilhelm Agdur , Jessica Enright , Laura Larios-Jones , Kitty Meeks , Fiona Skerman , Ella Yates

Transition pathways of stochastic dynamical systems are typically approximated by instantons. Here we show, using a dynamical system containing two competing pathways, that at low-to-intermediate temperatures, instantons can fail to capture…

Statistical Mechanics · Physics 2022-08-05 Lukas Kikuchi , Ronojoy Adhikari , Julian Kappler

Recently, much work has been done on extending the scope of online learning and incremental stochastic optimization algorithms. In this paper we contribute to this effort in two ways: First, based on a new regret decomposition and a…

Machine Learning · Computer Science 2017-09-12 Pooria Joulani , András György , Csaba Szepesvári

We provide a unifying approximate dynamic programming framework that applies to a broad variety of problems involving sequential estimation. We consider first the construction of surrogate cost functions for the purposes of optimization,…

Artificial Intelligence · Computer Science 2023-01-02 Dimitri Bertsekas