English
Related papers

Related papers: Understanding the Safety Requirements for Learning…

200 papers

Defending computer networks from cyber attack requires coordinating actions across multiple nodes based on imperfect indicators of compromise while minimizing disruptions to network operations. Advanced attacks can progress with few…

Cryptography and Security · Computer Science 2021-06-11 John Mern , Kyle Hatch , Ryan Silva , Jeff Brush , Mykel J. Kochenderfer

Reinforcement learning algorithms need exploration to learn. However, unsupervised exploration prevents the deployment of such algorithms on safety-critical tasks and limits real-world deployment. In this paper, we propose a new algorithm…

Machine Learning · Computer Science 2024-02-07 Sven Gronauer , Tom Haider , Felippe Schmoeller da Roza , Klaus Diepold

There has been significant progress in sensing, perception, and localization for automated driving, However, due to the wide spectrum of traffic/road structure scenarios and the long tail distribution of human driver behavior, it has…

Buildings account for approximately 40% of global energy consumption, and with the growing share of intermittent renewable energy sources, enabling demand-side flexibility, particularly in heating, ventilation and air conditioning systems,…

Systems and Control · Electrical Eng. & Systems 2026-04-20 Colin Jüni , Mina Montazeri , Yi Guo , Federica Bellizio , Giovanni Sansavini , Philipp Heer

When deploying autonomous agents in unstructured environments over sustained periods of time, adaptability and robustness oftentimes outweigh optimality as a primary consideration. In other words, safety and survivability constraints play a…

Systems and Control · Electrical Eng. & Systems 2021-04-08 Motoya Ohnishi , Gennaro Notomista , Masashi Sugiyama , Magnus Egerstedt

This position paper argues that achieving robustness, privacy, and efficiency simultaneously in machine learning systems is infeasible under prevailing threat models. The tension between these goals arises not from algorithmic shortcomings…

Machine Learning · Computer Science 2025-06-27 Youssef Allouah , Rachid Guerraoui , John Stephan

Offline reinforcement learning, which learns solely from datasets without environmental interaction, has gained attention. This approach, similar to traditional online deep reinforcement learning, is particularly promising for robot control…

Robotics · Computer Science 2025-07-21 Shingo Ayabe , Takuto Otomo , Hiroshi Kera , Kazuhiko Kawamoto

Safety is a primary concern when applying reinforcement learning to real-world control tasks, especially in the presence of external disturbances. However, existing safe reinforcement learning algorithms rarely account for external…

Machine Learning · Computer Science 2023-10-12 Zeyang Li , Chuxiong Hu , Shengbo Eben Li , Jia Cheng , Yunan Wang

The integration of machine learning into smart grid systems represents a transformative step in enhancing the efficiency, reliability, and sustainability of modern energy networks. By adding advanced data analytics, these systems can better…

Artificial Intelligence · Computer Science 2024-10-22 Abdur Rashid , Parag Biswas , abdullah al masum , MD Abdullah Al Nasim , Kishor Datta Gupta

In this tutorial article, we aim to provide the reader with the conceptual tools needed to get started on research on offline reinforcement learning algorithms: reinforcement learning algorithms that utilize previously collected data,…

Machine Learning · Computer Science 2020-11-03 Sergey Levine , Aviral Kumar , George Tucker , Justin Fu

Reinforcement learning serves as a potent tool for modeling dynamic user interests within recommender systems, garnering increasing research attention of late. However, a significant drawback persists: its poor data efficiency, stemming…

Information Retrieval · Computer Science 2023-08-23 Xiaocong Chen , Siyu Wang , Julian McAuley , Dietmar Jannach , Lina Yao

Autonomous agents trained via reinforcement learning present numerous safety concerns: reward hacking, negative side effects, and unsafe exploration, among others. In the context of near-future autonomous agents, operating in environments…

Artificial Intelligence · Computer Science 2019-02-20 Christopher Frye , Ilya Feige

Electric truck operations require routing decisions that remain feasible under limited battery range, long charging times, travel and energy consumption, and competition for shared charging infrastructure. These features make electric truck…

Systems and Control · Electrical Eng. & Systems 2026-04-30 Stavros Orfanoudakis , Ziyan Li , Ruixiao Yang , Nikolay Aristov , Pedro P. Vergara , Chuchu Fan , Elenna Dugundji

This study presents a novel computer system performance optimization and adaptive workload management scheduling algorithm based on Q-learning. In modern computing environments, characterized by increasing data volumes, task complexity, and…

Machine Learning · Computer Science 2024-11-11 Pochun Li , Yuyang Xiao , Jinghua Yan , Xuan Li , Xiaoye Wang

This paper surveys the field of reinforcement learning from a computer-science perspective. It is written to be accessible to researchers familiar with machine learning. Both the historical basis of the field and a broad selection of…

Artificial Intelligence · Computer Science 2014-11-17 L. P. Kaelbling , M. L. Littman , A. W. Moore

Active learning is a decision-making process. In both abstract and physical settings, active learning demands both analysis and action. This is a review of active learning in robotics, focusing on methods amenable to the demands of embodied…

Robotics · Computer Science 2021-06-28 Annalisa T. Taylor , Thomas A. Berrueta , Todd D. Murphey

Advances in machine learning (ML) in recent years have enabled a dizzying array of applications such as data analytics, autonomous systems, and security diagnostics. ML is now pervasive---new systems and models are being deployed in every…

Cryptography and Security · Computer Science 2016-11-14 Nicolas Papernot , Patrick McDaniel , Arunesh Sinha , Michael Wellman

Reinforcement learning algorithms describe how an agent can learn an optimal action policy in a sequential decision process, through repeated experience. In a given environment, the agent policy provides him some running and terminal…

Theoretical Economics · Economics 2020-03-24 Arthur Charpentier , Romuald Elie , Carl Remlinger

Robotic systems are more present in our society everyday. In human-robot environments, it is crucial that end-users may correctly understand their robotic team-partners, in order to collaboratively complete a task. To increase action…

Artificial Intelligence · Computer Science 2021-09-03 Francisco Cruz , Richard Dazeley , Peter Vamplew , Ithan Moreira

The exponential increase in dependencies between the cyber and physical world leads to an enormous amount of data which must be efficiently processed and stored. Therefore, computing paradigms are evolving towards machine learning…

Machine Learning · Computer Science 2019-04-09 Faiq Khalid , Muhammad Abdullah Hanif , Semeen Rehman , Muhammad Shafique