English
Related papers

Related papers: Fixes That Fail: Self-Defeating Improvements in Ma…

200 papers

Machine Learning approaches are good in solving problems that have less information. In most cases, the software domain problems characterize as a process of learning that depend on the various circumstances and changes accordingly. A…

Software Engineering · Computer Science 2015-06-26 Saiqa Aleem , Luiz Fernando Capretz , Faheem Ahmed

Intelligent instruction-following robots capable of improving from autonomously collected experience have the potential to transform robot learning: instead of collecting costly teleoperated demonstration data, large-scale deployment of…

Robotics · Computer Science 2025-02-26 Zhiyuan Zhou , Pranav Atreya , Abraham Lee , Homer Walke , Oier Mees , Sergey Levine

Autonomous vehicles with a self-evolving ability are expected to cope with unknown scenarios in the real-world environment. Take advantage of trial and error mechanism, reinforcement learning is able to self evolve by learning the optimal…

Robotics · Computer Science 2024-08-23 Shuo Yang , Liwen Wang , Yanjun Huang , Hong Chen

Recent work in language modeling has raised the possibility of self-improvement, where a language models evaluates and refines its own generations to achieve higher performance without external feedback. It is impossible for this…

Artificial Intelligence · Computer Science 2024-12-05 Audrey Huang , Adam Block , Dylan J. Foster , Dhruv Rohatgi , Cyril Zhang , Max Simchowitz , Jordan T. Ash , Akshay Krishnamurthy

Artificial Intelligence has gained a lot of traction in the recent years, with machine learning notably starting to see more applications across a varied range of fields. One specific machine learning application that is of interest to us…

Software Engineering · Computer Science 2023-05-10 Teodor Rares Begu

Continual instruction tuning enables large language models (LLMs) to learn incrementally while retaining past knowledge, whereas existing methods primarily focus on how to retain old knowledge rather than on selecting which new knowledge to…

Computation and Language · Computer Science 2025-03-21 Peiyi Lin , Fukai Zhang , Kai Niu , Hao Fu

Machine learning models are vulnerable to adversarial attacks, including attacks that leak information about the model's training data. There has recently been an increase in interest about how to best address privacy concerns, especially…

Machine Learning · Computer Science 2024-05-30 Keltin Grimes , Collin Abidi , Cole Frank , Shannon Gallagher

Following the development of digitization, a growing number of large Original Equipment Manufacturers (OEMs) are adapting computer vision or natural language processing in a wide range of applications such as anomaly detection and quality…

Machine Learning · Computer Science 2022-12-07 Qiang Li , Chongyu Zhang

Meta-learning algorithms aim to learn two components: a model that predicts targets for a task, and a base learner that quickly updates that model when given examples from a new task. This additional level of learning can be powerful, but…

Machine Learning · Computer Science 2020-11-05 Janarthanan Rajendran , Alex Irpan , Eric Jang

In many real-world decision making problems, reaching an optimal decision requires taking into account a variable number of objects around the agent. Autonomous driving is a domain in which this is especially relevant, since the number of…

Machine Learning · Computer Science 2020-08-13 Maria Hügle , Gabriel Kalweit , Branka Mirchevska , Moritz Werling , Joschka Boedecker

Recent successes of reinforcement learning (RL) in training large reasoning models motivate the question of whether self-training - the process where a model learns from its own judgments - can be sustained within RL. In this work, we study…

Machine Learning · Computer Science 2025-10-10 Sheikh Shafayat , Fahim Tajwar , Ruslan Salakhutdinov , Jeff Schneider , Andrea Zanette

Recently, we have been witnessing an increasing use of machine learning methods in self-adaptive systems. Machine learning methods offer a variety of use cases for supporting self-adaptation, e.g., to keep runtime models up to date, reduce…

Software Engineering · Computer Science 2021-10-28 Omid Gheibi , Danny Weyns , Federico Quin

Machine learning models commonly exhibit unexpected failures post-deployment due to either data shifts or uncommon situations in the training environment. Domain experts typically go through the tedious process of inspecting the failure…

Combining model-based and model-free learning systems has been shown to improve the sample efficiency of learning to perform complex robotic tasks. However, dual-system approaches fail to consider the reliability of the learned model when…

Machine Learning · Computer Science 2020-11-03 Muhammad Burhan Hafez , Cornelius Weber , Matthias Kerzel , Stefan Wermter

This paper addresses the problem of data-driven modeling and verification of perception-based autonomous systems. We assume the perception model can be decomposed into a canonical model (obtained from first principles or a simulator) and a…

Systems and Control · Electrical Eng. & Systems 2023-12-13 Thomas Waite , Alexander Robey , Hassani Hamed , George J. Pappas , Radoslav Ivanov

Intelligent systems have the ability to improve their behaviour over time taking observations, experiences or explicit feedback into account. Traditional approaches separate the learning problem and make isolated use of techniques from…

Machine Learning · Computer Science 2022-01-12 Simon Reichhuber , Sven Tomforde

Autonomous vehicles rely heavily upon their perception subsystems to see the environment in which they operate. Unfortunately, the effect of variable weather conditions presents a significant challenge to object detection algorithms, and…

Artificial intelligence (AI) is increasingly integrated into modern healthcare, offering powerful support for clinical decision-making. However, in real-world settings, AI systems may experience performance degradation over time, due to…

Artificial Intelligence · Computer Science 2026-02-05 Hao Guan , David Bates , Li Zhou

As Large Language Models (LLMs) become increasingly prevalent, their generated outputs are proliferating across the web, risking a future where machine-generated content dilutes human-authored text. Since online data is the primary resource…

Computation and Language · Computer Science 2025-09-23 George Drayson , Emine Yilmaz , Vasileios Lampos

Federated learning is a machine learning protocol that enables a large population of agents to collaborate over multiple rounds to produce a single consensus model. There are several federated learning applications where agents may choose…

Machine Learning · Computer Science 2023-11-30 Minbiao Han , Kumar Kshitij Patel , Han Shao , Lingxiao Wang