English
Related papers

Related papers: Human-in-the-loop: Real-time Preference Optimizati…

200 papers

Motivated by the stringent safety requirements that are often present in real-world applications, we study a safe online convex optimization setting where the player needs to simultaneously achieve sublinear regret and zero constraint…

Machine Learning · Computer Science 2024-07-17 Spencer Hutchinson , Mahnoosh Alizadeh

Reference tracking systems involve a plant that is stabilized by a local feedback controller and a command center that indicates the reference set-point the plant should follow. Typically, these systems are subject to limitations such as…

Systems and Control · Electrical Eng. & Systems 2022-03-03 Maria Angelica Arroyo , Luis Felipe Giraldo

In this paper, we propose a learning approach to analyze dynamic systems with asymmetric information structure. Instead of adopting a game theoretic setting, we investigate an online quadratic optimization problem driven by system noises…

Optimization and Control · Mathematics 2018-11-05 Cheng Tan , Wing Shing Wong

This paper bridges optimization and control, and presents a novel closed-loop control framework based on natural gradient descent, offering a trajectory-oriented alternative to traditional cost-function tuning. By leveraging the Fisher…

Systems and Control · Electrical Eng. & Systems 2025-03-11 Ramin Esmzad , Farnaz Adib Yaghmaie , Hamidreza Modares

Tuning active prostheses for people with amputation is time-consuming and relies on metrics that may not fully reflect user needs. We introduce a human-in-the-loop optimization (HILO) approach that leverages direct user preferences to…

Feedback optimization has emerged as a promising approach for optimizing the steady-state operation of dynamical systems while requiring minimal modeling efforts. Unfortunately, most existing feedback optimization methods rely on knowledge…

Optimization and Control · Mathematics 2025-09-16 Amir Mehrnoosh , Gianluca Bianchin

User preference learning is generally a hard problem. Individual preferences are typically unknown even to users themselves, while the space of choices is infinite. Here we study user preference learning from information-theoretic…

Machine Learning · Computer Science 2023-11-27 Tanya Ignatenko , Kirill Kondrashov , Marco Cox , Bert de Vries

For industrial product design, it is very important to take into account assembly/disassembly and maintenance operations during the conceptual and prototype design stage. For these operations or other similar operations in a constrained…

Robotics · Computer Science 2010-12-21 Liang Ma , Ruina Ma , Damien Chablat , Fouad Bennis

In inverse optimal control, the optimality of a given feedback stabilizing controller is a byproduct of the choice of a meaningful, a posteriori defined, cost functional. This allows for a simple tuning comparable to linear quadratic…

Optimization and Control · Mathematics 2023-05-30 Taouba Jouini , Anders Rantzer , Emma Tegling

Reinforcement Learning from Human Feedback (RLHF) is currently the leading approach for aligning large language models with human preferences. Typically, these models rely on extensive offline preference datasets for training. However,…

Machine Learning · Computer Science 2024-12-17 Avinandan Bose , Zhihan Xiong , Aadirupa Saha , Simon Shaolei Du , Maryam Fazel

This paper considers a bi-level discrete-time control framework with real-time constraints, consisting of several local controllers and a central controller. The objective is to bridge the gap between the online convex optimization and…

Optimization and Control · Mathematics 2017-02-21 Andrey Bernstein

Probabilistic control design is founded on the principle that a rational agent attempts to match modelled with an arbitrary desired closed-loop system trajectory density. The framework was originally proposed as a tractable alternative to…

Machine Learning · Computer Science 2023-11-16 Tom Lefebvre

Feedback controllers for port-Hamiltonian systems reveal an intrinsic inverse optimality property since each passivating state feedback controller is optimal with respect to some specific performance index. Due to the nonlinear…

Optimization and Control · Mathematics 2020-07-20 Lukas Kölsch , Pol Jané Soneira , Felix Strehle , Sören Hohmann

Multi-fidelity methods combine inexpensive low-fidelity simulations with costly but highfidelity simulations to produce an accurate model of a system of interest at minimal cost. They have proven useful in modeling physical systems and have…

Artificial Intelligence · Computer Science 2014-08-12 Erik J. Schlicht , Ritchie Lee , David H. Wolpert , Mykel J. Kochenderfer , Brendan Tracey

In this paper, we will report our efforts in designing closed-loop feedback for the thruster-assisted walking of bipedal robots. We will assume for well-tuned supervisory controllers and will focus on fine-tuning the joints desired…

Robotics · Computer Science 2020-05-04 Pravin Dangol , Alireza Ramezani

In this paper, we explore the interplay between Predictive Control and closed-loop optimality, spanning from Model Predictive Control to Data-Driven Predictive Control. Predictive Control in general relies on some form of prediction scheme…

Optimization and Control · Mathematics 2024-05-29 Akhil S Anand , Shambhuraj Sawant , Dirk Reinhardt , Sebastien Gros

With the introduction of collaborative robots, humans and robots can now work together in close proximity and share the same workspace. However, this collaboration presents various challenges that need to be addressed to ensure seamless…

Robotics · Computer Science 2023-07-24 Ali Noormohammadi-Asl , Ali Ayub , Stephen L. Smith , Kerstin Dautenhahn

Feedback design is an important aspect of person-following robots for older adults. This paper presents a user-centred design approach to ensure the design is focused on the needs and preferences of the users. A sequence of user studies…

Robotics · Computer Science 2021-03-25 Samuel Olatunji , Tal Oron-Gilad , Vardit Sarne-Fleischmann , Yael Edan

In interactions between automated vehicles (AVs) and crossing pedestrians, modeling implicit vehicle communication is crucial. In this work, we present a combined prediction and planning approach that allows to consider the influence of the…

Human-Computer Interaction · Computer Science 2025-09-29 Markus Amann , Malte Probst , Raphael Wenzel , Thomas H. Weisswange , Miguel Ángel Sotelo

This paper investigates a planar tracking problem between a leader and follower agent. We propose a novel feedback speed control law, paired with a constant bearing steering strategy, to maintain an abreast formation between the two agents.…

Systems and Control · Electrical Eng. & Systems 2026-04-14 Xincheng Li , Tengyue Liu , Udit Halder