English
Related papers

Related papers: Environment Imitation: Data-Driven Environment Mod…

200 papers

Validating the behavior of autonomous Cyber-Physical Systems (CPS) and Artificial Intelligence (AI) agents, which rely on automated controllers, is an objective of great importance. In recent years, Neural-Network (NN) controllers have been…

Robotics · Computer Science 2024-12-25 Khen Elimelech , Morteza Lahijanian , Lydia E. Kavraki , Moshe Y. Vardi

Imitation learning is a well-established approach for machine-learning-based control. However, its applicability depends on having access to demonstrations, which are often expensive to collect and/or suboptimal for solving the task. In…

Robotics · Computer Science 2026-04-27 Jon Goikoetxea , Jesús F. Palacián

Visual imitation learning provides a framework for learning complex manipulation behaviors by leveraging human demonstrations. However, current interfaces for imitation such as kinesthetic teaching or teleoperation prohibitively restrict…

Robotics · Computer Science 2020-08-12 Sarah Young , Dhiraj Gandhi , Shubham Tulsiani , Abhinav Gupta , Pieter Abbeel , Lerrel Pinto

Imitation learning field requires expert data to train agents in a task. Most often, this learning approach suffers from the absence of available data, which results in techniques being tested on its dataset. Creating datasets is a…

Machine Learning · Computer Science 2024-03-04 Nathan Gavenski , Michael Luck , Odinaldo Rodrigues

Data scaling has revolutionized fields like natural language processing and computer vision, providing models with remarkable generalization capabilities. In this paper, we investigate whether similar data scaling laws exist in robotics,…

Robotics · Computer Science 2025-10-14 Yingdong Hu , Fanqi Lin , Pingyue Sheng , Chuan Wen , Jiacheng You , Yang Gao

Cyber Physical Systems (CPS) are the conjoining of an entities' physical and computational elements. The development of a typical CPS system follows a sequence from conceptual modeling, testing in simulated (virtual) worlds, testing in…

Computers and Society · Computer Science 2014-08-05 Vijay Gadepally , Ashok Krishnamurthy , Umit Ozguner

Traditional Cyber-physical Systems(CPSs) were not built with cybersecurity in mind. They operated on separate Operational Technology (OT) networks. As these systems now become more integrated with Information Technology (IT) networks based…

Cryptography and Security · Computer Science 2021-03-09 Ameerah-Muhsinah Jamil , Lotfi ben Othmane , Altaz Valani

We present a visual imitation learning framework that enables learning of robot action policies solely based on expert samples without any robot trials. Robot exploration and on-policy trials in a real-world environment could often be…

Robotics · Computer Science 2019-10-09 Alan Wu , AJ Piergiovanni , Michael S. Ryoo

Machine learning components such as deep neural networks are used extensively in Cyber-Physical Systems (CPS). However, such components may introduce new types of hazards that can have disastrous consequences and need to be addressed for…

Machine Learning · Computer Science 2021-10-08 Dimitrios Boursinos , Xenofon Koutsoukos

Learning goal conditioned control in the real world is a challenging open problem in robotics. Reinforcement learning systems have the potential to learn autonomously via trial-and-error, but in practice the costs of manual reward design,…

Imitation learning is a popular paradigm to teach robots new tasks, but collecting robot demonstrations through teleoperation or kinesthetic teaching is tedious and time-consuming. In contrast, directly demonstrating a task using our human…

Robotics · Computer Science 2026-02-16 Nick Heppert , Minh Quang Nguyen , Abhinav Valada

Classical policy search algorithms for robotics typically require performing extensive explorations, which are time-consuming and expensive to implement with real physical platforms. To facilitate the efficient learning of robot…

Robotics · Computer Science 2023-04-25 Shengzeng Huo , Anqing Duan , Lijun Han , Luyin Hu , Hesheng Wang , David Navarro-Alarcon

This paper introduces a novel pipeline for generating large-scale, highly realistic, and automatically labeled datasets for computer vision tasks in robotic environments. Our approach addresses the critical challenges of the domain gap…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Patryk Niżeniec , Marcin Iwanowski

Business process simulation (BPS) is a key tool for analyzing and optimizing organizational workflows, supporting decision-making by estimating the impact of process changes. The reliability of such estimates depends on the ability of a BPS…

Machine Learning · Computer Science 2025-05-29 Konrad Özdemir , Lukas Kirchdorfer , Keyvan Amiri Elyasi , Han van der Aa , Heiner Stuckenschmidt

Imitation learning is a promising approach for training autonomous vehicles (AV) to navigate complex traffic environments by mimicking expert driver behaviors. While existing imitation learning frameworks focus on leveraging expert…

Robotics · Computer Science 2025-09-25 Yasin Sonmez , Hanna Krasowski , Murat Arcak

Imitation learning (IL) has achieved considerable success in solving complex sequential decision-making problems. However, current IL methods mainly assume that the environment for learning policies is the same as the environment for…

Machine Learning · Computer Science 2023-10-24 Siyuan Li , Xun Wang , Rongchang Zuo , Kewu Sun , Lingfei Cui , Jishiyu Ding , Peng Liu , Zhe Ma

The integration of machine learning (ML) into cyber-physical systems (CPS) offers significant benefits, including enhanced efficiency, predictive capabilities, real-time responsiveness, and the enabling of autonomous operations. This…

Software Engineering · Computer Science 2024-05-17 Xi Zheng , Aloysius K. Mok , Ruzica Piskac , Yong Jae Lee , Bhaskar Krishnamachari , Dakai Zhu , Oleg Sokolsky , Insup Lee

Cyber-physical systems (CPS) with reinforcement learning (RL)-based controllers are increasingly being deployed in complex physical environments such as autonomous vehicles, the Internet-of-Things(IoT), and smart cities. An important…

Systems and Control · Electrical Eng. & Systems 2024-06-26 Changjian Zhang , Parv Kapoor , Eunsuk Kang , Romulo Meira-Goes , David Garlan , Akila Ganlath , Shatadal Mishra , Nejib Ammar

Imitation learning (IL) is a simple and powerful way to use high-quality human driving data, which can be collected at scale, to produce human-like behavior. However, policies based on imitation learning alone often fail to sufficiently…

While visuomotor policy has made advancements in recent years, contact-rich tasks still remain a challenge. Robotic manipulation tasks that require continuous contact demand explicit handling of compliance and force. However, most…

Robotics · Computer Science 2026-04-17 Tianyu Li , Yihan Li , Zizhe Zhang , Nadia Figueroa