English
Related papers

Related papers: RAMPA: Robotic Augmented Reality for Machine Progr…

200 papers

Simulating the time evolution of physical systems is pivotal in many scientific and engineering problems. An open challenge in simulating such systems is their multi-resolution dynamics: a small fraction of the system is extremely dynamic,…

Machine Learning · Computer Science 2023-05-03 Tailin Wu , Takashi Maruyama , Qingqing Zhao , Gordon Wetzstein , Jure Leskovec

Manipulation tasks such as preparing a meal or assembling furniture remain highly challenging for robotics and vision. Traditional task and motion planning (TAMP) methods can solve complex tasks but require full state observability and are…

Machine Learning · Computer Science 2020-06-23 Robin Strudel , Alexander Pashevich , Igor Kalevatykh , Ivan Laptev , Josef Sivic , Cordelia Schmid

We introduce Large Language Model-Assisted Preference Prediction (LAPP), a novel framework for robot learning that enables efficient, customizable, and expressive behavior acquisition with minimum human effort. Unlike prior approaches that…

Robotics · Computer Science 2025-04-23 Pingcheng Jian , Xiao Wei , Yanbaihui Liu , Samuel A. Moore , Michael M. Zavlanos , Boyuan Chen

Current research directions in deep reinforcement learning include bridging the simulation-reality gap, improving sample efficiency of experiences in distributed multi-agent reinforcement learning, together with the development of robust…

Machine Learning · Computer Science 2020-08-19 Wenshuai Zhao , Jorge Peña Queralta , Li Qingqing , Tomi Westerlund

The convergence of robotics and virtual reality (VR) has enabled safer and more efficient workflows in high-risk laboratory settings, particularly virology labs. As biohazard complexity increases, minimizing direct human exposure while…

Robotics · Computer Science 2025-06-18 Farha Abdul Wasay , Mohammed Abdul Rahman , Hania Ghouse

We present VASTA, a novel vision and language-assisted Programming By Demonstration (PBD) system for smartphone task automation. Development of a robust PBD automation system requires overcoming three key challenges: first, how to make a…

Human-Computer Interaction · Computer Science 2019-11-06 Alborz Rezazadeh Sereshkeh , Gary Leung , Krish Perumal , Caleb Phillips , Minfan Zhang , Afsaneh Fazly , Iqbal Mohomed

Enabling humanoid robots to perform long-horizon mobile manipulation planning in real-world environments based on embodied perception and comprehension abilities has been a longstanding challenge. With the recent rise of large language…

Robotics · Computer Science 2025-03-12 Fangyuan Wang , Shipeng Lyu , Peng Zhou , Anqing Duan , Guodong Guo , David Navarro-Alarcon

It is desirable for future robots to quickly learn new tasks and adapt learned skills to constantly changing environments. To this end, Probabilistic Movement Primitives (ProMPs) have shown to be a promising framework to learn generalizable…

Robotics · Computer Science 2022-03-09 Joao Carvalho , Dorothea Koert , Marek Daniv , Jan Peters

Pre-trained Vision-Language-Action (VLA) models have achieved remarkable success in improving robustness and generalization for end-to-end robotic manipulation. However, these models struggle with long-horizon tasks due to their lack of…

Robotics · Computer Science 2025-11-13 Runhao Li , Wenkai Guo , Zhenyu Wu , Changyuan Wang , Haoyuan Deng , Zhenyu Weng , Yap-Peng Tan , Ziwei Wang

The field of Augmented Reality (AR) based Human Robot Interaction (HRI) has progressed significantly since its inception more than two decades ago. With more advanced devices, particularly head-mounted displays (HMD), freely available…

Robotics · Computer Science 2019-10-11 David Puljiz , Björn Hein

Large Language Model (LLM) based agents have demonstrated proficiency in multi-step interactions with graphical user interfaces (GUIs). While most research focuses on improving single-task performance, practical scenarios often involve…

Artificial Intelligence · Computer Science 2026-05-21 Minghao Chen , Xinyi Hu , Zhou Yu , Yufei Yin

This paper describes an architecture for robots that combines the complementary strengths of probabilistic graphical models and declarative programming to represent and reason with logic-based and probabilistic descriptions of uncertainty…

Robotics · Computer Science 2018-09-24 Mohan Sridharan , Michael Gelfond , Shiqi Zhang , Jeremy Wyatt

Researching novel user experiences in medicine is challenging due to limited access to equipment and strict ethical protocols. Extended Reality (XR) simulation technologies offer a cost- and time-efficient solution for developing…

Human-Computer Interaction · Computer Science 2024-09-17 Jan Hendrik Plümer , Kevin Yu , Ulrich Eck , Denis Kalkofen , Philipp Steininger , Nassir Navab , Markus Tatzgern

Robotic systems driven by artificial muscles present unique challenges due to the nonlinear dynamics of actuators and the complex designs of mechanical structures. Traditional model-based controllers often struggle to achieve desired…

Robotics · Computer Science 2025-08-12 Jiyue Tao , Yunsong Zhang , Sunil Kumar Rajendran , Feitian Zhang

Recent advances in legged locomotion have enabled quadrupeds to walk on challenging terrains. However, bipedal robots are inherently more unstable and hence it's harder to design walking controllers for them. In this work, we leverage…

Robotics · Computer Science 2022-09-08 Ashish Kumar , Zhongyu Li , Jun Zeng , Deepak Pathak , Koushil Sreenath , Jitendra Malik

Applying pre-trained models to assist point cloud understanding has recently become a mainstream paradigm in 3D perception. However, existing application strategies are straightforward, utilizing only the final output of the pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Yaohua Zha , Yanzi Wang , Hang Guo , Jinpeng Wang , Tao Dai , Bin Chen , Zhihao Ouyang , Xue Yuerong , Ke Chen , Shu-Tao Xia

This work presents the computational design and validation of the Multi-Arm Relocatable Manipulator (MARM), a three-limb robot for space applications, with particular reference to the MIRROR (i.e., the Multi-arm Installation Robot for…

This paper introduces LMRPA, a novel Large Model-Driven Robotic Process Automation (RPA) model designed to greatly improve the efficiency and speed of Optical Character Recognition (OCR) tasks. Traditional RPA platforms often suffer from…

Robotics · Computer Science 2025-06-11 Osama Hosam Abdellaif , Abdelrahman Nader , Ali Hamdi

This paper presents ERPA, an innovative Robotic Process Automation (RPA) model designed to enhance ID data extraction and optimize Optical Character Recognition (OCR) tasks within immigration workflows. Traditional RPA solutions often face…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Osama Abdellaif , Abdelrahman Nader , Ali Hamdi

Enforcing state and input constraints during reinforcement learning (RL) in continuous state spaces is an open but crucial problem which remains a roadblock to using RL in safety-critical applications. This paper leverages invariant sets to…

Systems and Control · Electrical Eng. & Systems 2019-06-28 Ankush Chakrabarty , Rien Quirynen , Claus Danielson , Weinan Gao