English
Related papers

Related papers: Beyond Persistent Excitation: Online Experiment De…

200 papers

We propose a new online learning model for learning with preference feedback. The model is especially suited for applications like web search and recommender systems, where preference data is readily available from implicit user feedback…

Machine Learning · Computer Science 2011-11-04 Pannagadatta K. Shivaswamy , Thorsten Joachims

Data-driven predictive control (DPC) is a feedback control method for systems with unknown dynamics. It repeatedly optimizes a system's future trajectories based on past input-output data. We develop a numerical method that computes…

Systems and Control · Electrical Eng. & Systems 2022-11-28 Yue Yu , Ruihan Zhao , Sandeep Chinchali , Ufuk Topcu

Model-free data-driven computational mechanics replaces phenomenological constitutive functions by numerical simulations based on data sets of representative samples in stress-strain space. The distance of strain and stress pairs from the…

Computational Engineering, Finance, and Science · Computer Science 2021-11-29 Kerem Ciftci , Klaus Hackl

Model distillation has emerged as a prominent technique to improve neural search models. To date, distillation taken an offline approach, wherein a new neural model is trained to predict relevance scores between arbitrary queries and…

Information Retrieval · Computer Science 2023-06-19 Sean MacAvaney , Xi Wang

Data-driven, machine learning (ML) models of atomistic interactions are often based on flexible and non-physical functions that can relate nuanced aspects of atomic arrangements into predictions of energies and forces. As a result, these…

Materials Science · Physics 2024-05-15 Bartosz Barzdajn , Christopher P. Race

Traditional model-based RL relies on hand-specified or learned models of transition dynamics of the environment. These methods are sample efficient and facilitate learning in the real world but fail to generalize to subtle variations in the…

Machine Learning · Computer Science 2018-12-11 Christian F. Perez , Felipe Petroski Such , Theofanis Karaletsos

This paper proposes a novel online data-driven adaptive control for unknown linear time-varying systems. Initialized with an empirical feedback gain, the algorithm periodically updates this gain based on the data collected over a short time…

Systems and Control · Electrical Eng. & Systems 2024-01-31 Shenyu Liu , Kaiwen Chen , Jaap Eising

The increasing ease of obtaining and processing data together with the growth in system complexity has sparked the interest in moving from conventional model-based control design towards data-driven concepts. Since in many engineering…

Optimization and Control · Mathematics 2021-07-29 Juan G. Rueda-Escobedo , Emilia Fridman , Johannes Schiffer

This paper offers a step towards research infrastructure, which makes data from experimental economics efficiently usable for analysis of web data. We believe that regularities of human behavior found in experimental data also emerge in…

Computational Engineering, Finance, and Science · Computer Science 2014-12-16 Rustam Tagiew , Dmitry I. Ignatov , Fadi Amroush

Offline reinforcement learning enables agents to leverage large pre-collected datasets of environment transitions to learn control policies, circumventing the need for potentially expensive or unsafe online data collection. Significant…

Machine Learning · Computer Science 2022-03-17 Cong Lu , Philip J. Ball , Jack Parker-Holder , Michael A. Osborne , Stephen J. Roberts

Nowadays, the numerical models of real-world structures are more precise, more complex and, of course, more time-consuming. Despite the growth of a computational effort, the exploration of model behaviour remains a complex task. The…

Computational Engineering, Finance, and Science · Computer Science 2014-10-17 Eliska Janouchova , Anna Kucerova

This paper proposes a data-driven framework to solve time-varying optimization problems associated with unknown linear dynamical systems. Making online control decisions to regulate a dynamical system to the solution of an optimization…

Optimization and Control · Mathematics 2021-09-08 Gianluca Bianchin , Miguel Vaquero , Jorge Cortes , Emiliano Dall'Anese

Self-triggered control, a well-documented technique for reducing the communication overhead while ensuring desired system performance, is gaining increasing popularity. However, existing methods for self-triggered control require explicit…

Systems and Control · Electrical Eng. & Systems 2022-07-19 Wenjie Liu , Jian Sun , Gang Wang , Francesco Bullo , Jie Chen

In this paper, we introduce a data-driven modeling approach for dynamics problems with latent variables. The state-space of the proposed model includes artificial latent variables, in addition to observed variables that can be fitted to a…

Optimization and Control · Mathematics 2024-06-19 Yushuang Luo , Xiantao Li , Wenrui Hao

When the underlying conditional density is known, conditional expectations can be computed analytically or numerically. When, however, such knowledge is not available and instead we are given a collection of training data, the goal of this…

Machine Learning · Statistics 2024-07-19 George V. Moustakides

Online detection of instantaneous changes in the generative process of a data sequence generally focuses on retrospective inference of such change points without considering their future occurrences. We extend the Bayesian Online Change…

Machine Learning · Computer Science 2020-06-25 Diego Agudelo-España , Sebastian Gomez-Gonzalez , Stefan Bauer , Bernhard Schölkopf , Jan Peters

Despite their effectiveness and popularity in offline or model-based reinforcement learning (RL), transformers remain underexplored in online model-free RL due to their sensitivity to training setups and model design decisions such as how…

Machine Learning · Computer Science 2025-10-16 Nikita Kachaev , Daniil Zelezetsky , Egor Cherepanov , Alexey K. Kovelev , Aleksandr I. Panov

With the current trend in Model-Based Systems Engineering towards Digital Engineering and early Validation & Verification, experiments are increasingly used to estimate system parameters and explore design decisions. Managing such…

Software Engineering · Computer Science 2025-09-16 Johan Cederbladh , Loek Cleophas , Eduard Kamburjan , Lucas Lima , Rakshit Mittal , Hans Vangheluwe

Existing methods for distillation do not efficiently utilize the training data. This work presents a novel approach to perform distillation using only a subset of the training data, making it more data-efficient. For this purpose, the…

Machine Learning · Computer Science 2021-04-26 Sourav Mishra , Suresh Sundaram

Experimental continuation encompasses a set of methods that combine control and continuation to obtain the full bifurcation diagram of a nonlinear system experimentally, including responses that would be unstable in the system without…

Dynamical Systems · Mathematics 2025-06-24 Ghislain Raze , Gaëtan Abeloos , Gaëtan Kerschen