English
Related papers

Related papers: Compositional Online Learning for Multi-Objective …

200 papers

We consider the problem of sequential decision making under uncertainty in which the loss caused by a decision depends on the following binary observation. In competitive on-line learning, the goal is to design decision algorithms that are…

Machine Learning · Computer Science 2007-05-23 Vladimir Vovk

We propose a model-based, automated, bottom-up approach for design, which is applicable to various physical domains, but in this work we focus on the electrical domain. This bottom-up approach is based on a meta-topology in which each link…

Optimization and Control · Mathematics 2023-02-17 Ion Matei , Maksym Zhenirovskyy , John Maxwell , Johan de Kleer

In this paper, we propose a learning approach to analyze dynamic systems with asymmetric information structure. Instead of adopting a game theoretic setting, we investigate an online quadratic optimization problem driven by system noises…

Optimization and Control · Mathematics 2018-11-05 Cheng Tan , Wing Shing Wong

Online Contention Resolution Schemes (OCRS's) represent a modern tool for selecting a subset of elements, subject to resource constraints, when the elements are presented to the algorithm sequentially. OCRS's have led to some of the…

Data Structures and Algorithms · Computer Science 2024-04-03 Calum MacRury , Will Ma , Nathaniel Grammel

We define "decision swap regret" which generalizes both prediction for downstream swap regret and omniprediction, and give algorithms for obtaining it for arbitrary multi-dimensional Lipschitz loss functions in online adversarial settings.…

Machine Learning · Computer Science 2025-02-19 Jiuyao Lu , Aaron Roth , Mirah Shi

We discuss the role of monotonicity in enabling numerically tractable modular control design for networked nonlinear systems. We first show that the variational systems of monotone systems can be embedded into positive systems. Utilizing…

Systems and Control · Electrical Eng. & Systems 2023-03-07 Yu Kawano , Fulvio Forni

Offline model-based optimization (MBO) seeks to discover high-performing designs using only a fixed dataset of past evaluations. Most existing methods rely on learning a surrogate model via regression and implicitly assume that good…

Machine Learning · Computer Science 2026-03-05 Shen-Huan Lyu , Rong-Xi Tan , Ke Xue , Yi-Xiao He , Yu Huang , Qingfu Zhang , Chao Qian

By default neural networks are not robust to changes in data distribution. This has been demonstrated with simple image corruptions, such as blurring or adding noise, degrading image classification performance. Many methods have been…

Machine Learning · Computer Science 2023-06-16 Ian Mason , Anirban Sarkar , Tomotake Sasaki , Xavier Boix

Optimization in the presence of sharp (non-Lipschitz), unpredictable (w.r.t. time and amount) changes is a challenging and largely unexplored problem of great significance. We consider the class of piecewise Lipschitz functions, which is…

Machine Learning · Computer Science 2020-08-10 Maria-Florina Balcan , Travis Dick , Dravyansh Sharma

We study a theoretical and algorithmic framework for structured prediction in the online learning setting. The problem of structured prediction, i.e. estimating function where the output space lacks a vectorial structure, is well studied in…

Machine Learning · Computer Science 2024-06-19 Pierre Boudart , Alessandro Rudi , Pierre Gaillard

Offline reinforcement learning enables agents to leverage large pre-collected datasets of environment transitions to learn control policies, circumventing the need for potentially expensive or unsafe online data collection. Significant…

Machine Learning · Computer Science 2022-03-17 Cong Lu , Philip J. Ball , Jack Parker-Holder , Michael A. Osborne , Stephen J. Roberts

Matching mechanisms play a central role in operations management across diverse fields including education, healthcare, and online platforms. However, experimentally comparing a new matching algorithm against a status quo presents some…

Methodology · Statistics 2026-01-30 Chonghuan Wang

We study the problem of online learning in contextual bandit problems where the loss function is assumed to belong to a known parametric function class. We propose a new analytic framework for this setting that bridges the Bayesian theory…

Machine Learning · Computer Science 2024-06-28 Gergely Neu , Matteo Papini , Ludovic Schwartz

We investigate online kernel algorithms which simultaneously process multiple classification tasks while a fixed constraint is imposed on the size of their active sets. We focus in particular on the design of algorithms that can efficiently…

Machine Learning · Computer Science 2012-10-02 Giovanni Cavallanti , Nicolò Cesa-Bianchi

We propose a set of compositional design patterns to describe a large variety of systems that combine statistical techniques from machine learning with symbolic techniques from knowledge representation. As in other areas of computer science…

Artificial Intelligence · Computer Science 2019-05-30 Frank van Harmelen , Annette ten Teije

The fine-tuning of deep pre-trained models has revealed compositional properties, with multiple specialized modules that can be arbitrarily composed into a single, multi-task model. However, identifying the conditions that promote…

Artificial Intelligence · Computer Science 2025-03-04 Angelo Porrello , Lorenzo Bonicelli , Pietro Buzzega , Monica Millunzi , Simone Calderara , Rita Cucchiara

Mathematical models simulate various events under different conditions, enabling an early overview of the system to be implemented in practice, reducing the waste of resources and in less time. In project optimization, these models play a…

Optimization and Control · Mathematics 2021-05-11 Gustavo Barbosa Libotte , Fran Sérgio Lobato , Francisco Duarte Moura Neto , Gustavo Mendes Platt

Designing effective agentic systems requires the seamless composition and integration of agents, tools, and models within dynamic and uncertain environments. Most existing methods rely on static, semantic retrieval approaches for tool or…

Computation and Language · Computer Science 2025-12-01 Michelle Yuan , Khushbu Pahwa , Shuaichen Chang , Mustafa Kaba , Jiarong Jiang , Xiaofei Ma , Yi Zhang , Monica Sunkara

A simple yet efficient computational algorithm for computing the continuous optimal experimental design for linear models is proposed. An alternative proof the monotonic convergence for $D$-optimal criterion on continuous design spaces are…

Computation · Statistics 2018-04-10 Jiangtao Duan , Wei Gao , Hon Keung Tony Ng

In this paper, we investigate the framework of Online Convex Optimization (OCO) for online learning. OCO offers a very powerful online learning framework for many applications. In this context, we study a specific framework of OCO called…

Machine Learning · Computer Science 2022-11-01 Deepan Muthirayan , Jianjun Yuan , Pramod P. Khargonekar