English
Related papers

Related papers: Advanced Model Consistency Restoration with Higher…

200 papers

In this paper, we leverage the rapid advances in imitation learning, a topic of intense recent focus in the Reinforcement Learning (RL) literature, to develop new sample complexity results and performance guarantees for data-driven Model…

Optimization and Control · Mathematics 2022-10-18 Kwangjun Ahn , Zakaria Mhammedi , Horia Mania , Zhang-Wei Hong , Ali Jadbabaie

Self-supervised learning (SSL) has proven vital in speech and audio-related applications. The paradigm trains a general model on unlabeled data that can later be used to solve specific downstream tasks. This type of model is costly to train…

Consistency models imitate the multi-step sampling of score-based diffusion in a single forward pass of a neural network. They can be learned in two ways: consistency distillation and consistency training. The former relies on the true…

Machine Learning · Computer Science 2025-07-03 Thibaut Issenhuth , Sangchul Lee , Ludovic Dos Santos , Jean-Yves Franceschi , Chansoo Kim , Alain Rakotomamonjy

Predicting and simulating aerodynamic fields for civil aircraft over wide flight envelopes represent a real challenge mainly due to significant numerical costs and complex flows. Surrogate models and reduced-order models help to estimate…

Fluid Dynamics · Physics 2019-12-11 Romain Dupuis , Jean-Christophe Jouhaud , Pierre Sagaut

Model Predictive Control (MPC) is typically characterized for being computationally demanding, as it requires solving optimization problems online; a particularly relevant point when considering its implementation in embedded systems. To…

Systems and Control · Electrical Eng. & Systems 2023-12-19 Victor Gracia , Pablo Krupa , Teodoro Alamo , Daniel Limon

Differential replication through copying refers to the process of replicating the decision behavior of a machine learning model using another model that possesses enhanced features and attributes. This process is relevant when external…

Machine Learning · Computer Science 2023-02-08 Nahuel Statuto , Irene Unceta , Jordi Nin , Oriol Pujol

Continual learning aims to learn on non-stationary data streams without catastrophically forgetting previous knowledge. Prevalent replay-based methods address this challenge by rehearsing on a small buffer holding the seen data, for which a…

Machine Learning · Computer Science 2023-04-21 Zhicheng Sun , Yadong Mu , Gang Hua

A new machine learning (ML) technique termed as federated learning (FL) aims to preserve data at the edge devices and to only exchange ML model parameters in the learning process. FL not only reduces the communication needs but also helps…

Machine Learning · Computer Science 2021-08-09 Xiang Ma , Haijian Sun , Qun Wang , Rose Qingyang Hu

Machine learning models may involve decision boundaries that change over time due to updates to rules and regulations, such as in loan approvals or claims management. However, in such scenarios, it may take time for sufficient training data…

Machine Learning · Computer Science 2022-01-10 Öznur Alkan , Dennis Wei , Massimiliano Mattetti , Rahul Nair , Elizabeth M. Daly , Diptikalyan Saha

Federated learning (FL) is a promising learning paradigm that can tackle the increasingly prominent isolated data islands problem while keeping users' data locally with privacy and security guarantees. However, FL could result in…

Information Theory · Computer Science 2022-03-30 Peng Yang , Yuning Jiang , Ting Wang , Yong Zhou , Yuanming Shi , Colin N. Jones

Many complex engineering systems consist of multiple subsystems that are developed by different teams of engineers. To analyse, simulate and control such complex systems, accurate yet computationally efficient models are required. Modular…

Systems and Control · Electrical Eng. & Systems 2023-01-02 Lars A. L. Janssen , Bart Besselink , Rob H. B. Fey , Nathan van de Wouw

Machine learning models tend to over-rely on statistical shortcuts. These spurious correlations between parts of the input and the output labels does not hold in real-world settings. We target this issue on the recent open-ended visual…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Corentin Dancette , Remi Cadene , Xinlei Chen , Matthieu Cord

We propose sequential Monte Carlo (SMC) methods for sampling the posterior distribution of state-space models under highly informative observation regimes, a situation in which standard SMC methods can perform poorly. A special case is…

Computation · Statistics 2015-07-10 Pierre Del Moral , Lawrence M. Murray

Feature models are used to specify variability of user-configurable systems as appearing, e.g., in software product lines. Software product lines are supposed to be long-living and, therefore, have to continuously evolve over time to meet…

Software Engineering · Computer Science 2016-04-04 Frederik Deckwerth , Géza Kulcsár , Malte Lochau , Gergely Varró , Andy Schürr

The computational intensity of detector simulation and event reconstruction poses a significant difficulty for data analysis in collider experiments. This challenge inspires the continued development of machine learning techniques to serve…

High Energy Physics - Experiment · Physics 2024-11-22 Dmitrii Kobylianskii , Nathalie Soybelman , Nilotpal Kakati , Etienne Dreyer , Benjamin Nachman , Eilam Gross

ML models are increasingly being pushed to mobile devices, for low-latency inference and offline operation. However, once the models are deployed, it is hard for ML operators to track their accuracy, which can degrade unpredictably (e.g.,…

Machine Learning · Computer Science 2023-05-18 Wei Hao , Zixi Wang , Lauren Hong , Lingxiao Li , Nader Karayanni , Chengzhi Mao , Junfeng Yang , Asaf Cidon

By the recent advances in computer technology leading to the invention of more powerful processors, the importance of creating models using data training is even greater than ever. Given the significance of this issue, this work tries to…

Optimization and Control · Mathematics 2023-12-27 Saman Khoramian

We consider the problem of efficient "on the fly" tuning of existing, or {\it legacy}, Artificial Intelligence (AI) systems. The legacy AI systems are allowed to be of arbitrary class, albeit the data they are using for computing interim or…

Machine Learning · Statistics 2019-02-14 Alexander N. Gorban , Ilya Romanenko , Richard Burton , Ivan Y. Tyukin

This paper firstly show that a recent model (Tian et al., Transpn. Res. B 71, 138-157, 2015) is not able to well replicate the evolution concavity in traffic flow, i.e. the standard deviation of vehicles increases in a concave/linear way…

Cellular Automata and Lattice Gases · Physics 2015-07-16 Junfang Tian , Rui Jiang , Guangyu Li , Martin Treiber , Ning Jia , Shoufeng Ma

Activities such as the movement of passengers and goods, the transfer of physical or digital assets, web navigation and even successive passes in football, result in timestamped paths through a physical or virtual network. The need to…

Physics and Society · Physics 2024-07-30 Kevin Teo , Naomi Arnold , Andrew Hone , István Zoltán Kiss