English
Related papers

Related papers: Capacity-Constrained Continual Learning

200 papers

We study optimal policy learning under combined budget and minimum coverage constraints. We show that the problem admits a knapsack-type structure and that the optimal policy can be characterized by an affine threshold rule involving both…

Machine Learning · Statistics 2026-05-13 Giovanni Cerulli

In this paper, we consider linear quadratic team problems with an arbitrary number of quadratic constraints in both stochastic and deterministic settings. The team consists of players with different measurements about the state of nature.…

Optimization and Control · Mathematics 2012-09-13 Ather Gattami

The problem of statistical inference in its various forms has been the subject of decades-long extensive research. Most of the effort has been focused on characterizing the behavior as a function of the number of available samples, with far…

Machine Learning · Computer Science 2024-11-12 Tomer Berg , Or Ordentlich , Ofer Shayevitz

We propose a learning-based framework for efficient power allocation in ad hoc interference networks under episodic constraints. The problem of optimal power allocation -- for maximizing a given network utility metric -- under instantaneous…

Signal Processing · Electrical Eng. & Systems 2024-01-22 Arindam Chowdhury , Santiago Paternain , Gunjan Verma , Ananthram Swami , Santiago Segarra

We describe a general technique that yields the first {\em Statistical Query lower bounds} for a range of fundamental high-dimensional learning problems involving Gaussian distributions. Our main results are for the problems of (1) learning…

Machine Learning · Computer Science 2017-05-18 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

This paper presents a PAC-Bayes framework for learning controllers for unknown stochastic linear discrete-time systems, where the system parameters are drawn from a fixed but unknown distribution. We derive a data-dependent high probability…

Optimization and Control · Mathematics 2026-05-22 Yujia Luo , Ye Pu , Jonathan H. Manton , Jingge Zhu

A continual learning agent learns online with a non-stationary and never-ending stream of data. The key to such learning process is to overcome the catastrophic forgetting of previously seen data, which is a well known problem of neural…

Machine Learning · Computer Science 2019-11-01 Rahaf Aljundi , Min Lin , Baptiste Goujaud , Yoshua Bengio

We study the problem of adaptive control in partially observable linear quadratic Gaussian control systems, where the model dynamics are unknown a priori. We propose LqgOpt, a novel reinforcement learning algorithm based on the principle of…

Machine Learning · Computer Science 2020-06-25 Sahin Lale , Kamyar Azizzadenesheli , Babak Hassibi , Anima Anandkumar

A central challenge in quantum information science and technology is achieving real-time estimation and feedforward control of quantum systems. This challenge is compounded by the inherent inhomogeneity of quantum resources, such as qubit…

Machine Learning · Computer Science 2024-05-28 Linsen Li , Pratyush Anand , Kaiming He , Dirk Englund

We introduce a class of learning problems where the agent is presented with a series of tasks. Intuitively, if there is relation among those tasks, then the information gained during execution of one task has value for the execution of…

Machine Learning · Computer Science 2012-09-06 Christos Dimitrakakis

We investigate a Linear-Quadratic-Gaussian (LQG) control and sensing co-design problem, where one jointly designs sensing and control policies. We focus on the realistic case where the sensing design is selected among a finite set of…

Optimization and Control · Mathematics 2020-05-20 Vasileios Tzoumas , Luca Carlone , George J. Pappas , Ali Jadbabaie

Artificial neural networks have exceeded human-level performance in accomplishing several individual tasks (e.g. voice recognition, object recognition, and video games). However, such success remains modest compared to human intelligence…

Machine Learning · Computer Science 2019-10-21 Rahaf Aljundi

Deploying neural networks on the edge has become increasingly important as deep learning is being applied in an increasing amount of applications. At the edge computing hardware typically has limited resources disallowing to run neural…

Machine Learning · Computer Science 2025-09-15 Quinten Van Baelen , Peter Karsmakers

This paper investigates the social optimum for a dynamic linear quadratic collective choice problem where a group of agents choose among multiple alternatives or destinations. The agents' common objective is to minimize the average cost of…

Optimization and Control · Mathematics 2025-06-12 Noureddine Toumi , Roland Malhamé , Jérôme Le Ny

In this paper we address distributed learning problems over peer-to-peer networks. In particular, we focus on the challenges of quantized communications, asynchrony, and stochastic gradients that arise in this set-up. We first discuss how…

Optimization and Control · Mathematics 2025-09-04 Nicola Bastianello , Apostolos I. Rikos , Karl H. Johansson

We study a sequential resource allocation problem involving a fixed number of recurring jobs. At each time-step the manager should distribute available resources among the jobs in order to maximise the expected number of completed jobs.…

Machine Learning · Computer Science 2014-06-17 Tor Lattimore , Koby Crammer , Csaba Szepesvári

We address the problem of continual learning in multi-task Gaussian process (GP) models for handling sequential input-output observations. Our approach extends the existing prior-posterior recursion of online Bayesian inference, i.e.\ past…

Machine Learning · Statistics 2019-11-04 Pablo Moreno-Muñoz , Antonio Artés-Rodríguez , Mauricio A. Álvarez

We investigate how to exploit intermittent feedback for interference management by studying the two-user Gaussian interference channel (IC). We approximately characterize (within a universal constant) the capacity region for the Gaussian IC…

Information Theory · Computer Science 2016-11-17 Can Karakus , I-Hsiang Wang , Suhas Diggavi

Efficient continual learning techniques have been a topic of significant research over the last few years. A fundamental problem with such learning is severe degradation of performance on previously learned tasks, known also as catastrophic…

Machine Learning · Computer Science 2024-03-05 Tammuz Dubnov , Vishal Thengane

We study the problem of minimizing the resource capacity of autonomous agents cooperating to achieve a shared task. More specifically, we consider high-level planning for a team of homogeneous agents that operate under resource constraints…

Multiagent Systems · Computer Science 2021-05-05 Murat Cubuktepe , František Blahoudek , Ufuk Topcu