English
Related papers

Related papers: From Parameter to Representation: A Closed-Form Ap…

200 papers

Multi-objective reinforcement learning (MORL) excels at handling rapidly changing preferences in tasks that involve multiple criteria, even for unseen preferences. However, previous dominating MORL methods typically generate a fixed policy…

Machine Learning · Computer Science 2025-05-09 Ruohong Liu , Yuxin Pan , Linjie Xu , Lei Song , Jiang Bian , Pengcheng You , Yize Chen

We develop an online gradient algorithm for optimizing the performance of product-form networks through online adjustment of control parameters. The use of standard algorithms for finding optimal parameter settings is hampered by the…

Optimization and Control · Mathematics 2012-08-31 Jaron Sanders , Sem C. Borst , Johan S. H. van Leeuwaarden

Model predictive control (MPC) is increasingly being considered for control of fast systems and embedded applications. However, the MPC has some significant challenges for such systems. Its high computational complexity results in high…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Eivind Bøhn , Sebastien Gros , Signe Moe , Tor Arne Johansen

Continual learning (CL) aims to train models sequentially on multiple tasks while mitigating catastrophic forgetting of previously learned knowledge. Recent advances in large pre-trained models (LPMs) and model merging techniques, such as…

Machine Learning · Computer Science 2026-05-21 Kei Hiroshima , Kento Uchida , Shinichi Shirakawa

Recent research has made impressive progress in large-scale multimodal pre-training. In the context of the rapid growth of model size, it is necessary to seek efficient and flexible methods other than finetuning. In this paper, we propose…

Computation and Language · Computer Science 2022-03-16 Sheng Liang , Mengjie Zhao , Hinrich Schütze

This paper tackles the multi-objective optimization of the cost functional of a path-following model predictive control for vehicle longitudinal and lateral control. While the inherent optimal character of the model predictive control and…

Robotics · Computer Science 2021-04-09 Ali Gharib , David Stenger , Robert Ritschel , Rick Voßwinkel

Model merging aims to combine multiple expert models into a more capable single model, offering benefits such as reduced storage and serving costs, improved generalization, and support for decentralized model development. Despite its…

Machine Learning · Computer Science 2024-10-07 Prateek Yadav , Tu Vu , Jonathan Lai , Alexandra Chronopoulou , Manaal Faruqui , Mohit Bansal , Tsendsuren Munkhdalai

Artificial neural networks have gone through a recent rise in popularity, achieving state-of-the-art results in various fields, including image classification, speech recognition, and automated control. Both the performance and…

Neural and Evolutionary Computing · Computer Science 2016-11-08 Sean C. Smithson , Guang Yang , Warren J. Gross , Brett H. Meyer

When designing autonomous systems, we need to consider multiple trade-offs at various abstraction levels, and the choices of single (hardware and software) components need to be studied jointly. In this work we consider the problem of…

Systems and Control · Electrical Eng. & Systems 2022-09-21 Gioele Zardini , Zelio Suter , Andrea Censi , Emilio Frazzoli

Optimizing nonlinear systems involving expensive computer experiments with regard to conflicting objectives is a common challenge. When the number of experiments is severely restricted and/or when the number of objectives increases,…

Machine Learning · Statistics 2019-07-16 David Gaudrie , Rodolphe Le Riche , Victor Picheny , Benoit Enaux , Vincent Herbert

Multi-objective integer or mixed-integer programming problems typically have disconnected feasible domains, making the task of constructing an approximation of the Pareto front challenging. The present paper shows that certain algorithms…

Optimization and Control · Mathematics 2021-05-25 Regina S. Burachik , C. Yalçın Kaya , M. Mustafa Rizvi

The design of mobile autonomous robots is challenging due to the limited on-board resources such as processing power and energy. A promising approach is to generate intelligent schedules that reduce the resource consumption while…

We explore the probabilistic foundations of shared control in complex dynamic environments. In order to do this, we formulate shared control as a random process and describe the joint distribution that governs its behavior. For…

Robotics · Computer Science 2015-08-10 Pete Trautman

Robust optimization provides a principled and unified framework to model many problems in modern operations research and computer science applications, such as risk measures minimization and adversarially robust machine learning. To use a…

Optimization and Control · Mathematics 2024-10-04 Hao Hao , Peter Zhang

We study the classical problem of matching $n$ agents to $n$ objects, where the agents have ranked preferences over the objects. We focus on two popular desiderata from the matching literature: Pareto optimality and rank-maximality. Instead…

Computer Science and Game Theory · Computer Science 2021-04-15 Hadi Hosseini , Vijay Menon , Nisarg Shah , Sujoy Sikdar

Parameter sharing has proven to be a parameter-efficient approach. Previous work on Transformers has focused on sharing parameters in different layers, which can improve the performance of models with limited parameters by increasing model…

Machine Learning · Computer Science 2023-06-19 Ye Lin , Mingxuan Wang , Zhexi Zhang , Xiaohui Wang , Tong Xiao , Jingbo Zhu

In model-predictive control (MPC), achieving the best closed-loop performance under a given computational resource is the underlying design consideration. This paper analyzes the MPC design problem with control performance and required…

Optimization and Control · Mathematics 2016-04-25 Vincent Bachtiar , Chris Manzie , William H. Moase , Eric C. Kerrigan

Application autotuning is a promising path investigated in literature to improve computation efficiency. In this context, the end-users define high-level requirements and an autonomic manager is able to identify and seize optimization…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-21 Tomas Martinovic , Davide Gadioli , Gianluca Palermo , Cristina Silvano

Model predictive control (MPC) has established itself as the primary methodology for constrained control, enabling general-purpose robot autonomy in diverse real-world scenarios. However, for most problems of interest, MPC relies on the…

Hyperparameter optimization is very frequently employed in machine learning. However, an optimization of a large space of parameters could result in overfitting of models. In recent studies on solubility prediction the authors collected…

Machine Learning · Computer Science 2024-11-26 Igor V. Tetko , Ruud van Deursen , Guillaume Godin