English
Related papers

Related papers: PIN-WM: Learning Physics-INformed World Models for…

200 papers

Human activity recognition (HAR) with deep learning models relies on large amounts of labeled data, often challenging to obtain due to associated cost, time, and labor. Self-supervised learning (SSL) has emerged as an effective approach to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Dominique Nshimyimana , Vitor Fortes Rey , Sungho Suh , Bo Zhou , Paul Lukowicz

We consider the problem of estimating an object's physical properties such as mass, friction, and elasticity directly from video sequences. Such a system identification problem is fundamentally ill-posed due to the loss of information…

Physics-Informed Neural Networks (PINNs) and Neural Ordinary Differential Equations (NODEs) represent two distinct machine learning frameworks for modeling nonlinear neuronal dynamics. This study systematically evaluates their performance…

Dynamical Systems · Mathematics 2026-03-31 Nikolaos M. Matzakos , Chrisovalantis Sfyrakis

Learning predictive world models from raw visual observations is a central challenge in reinforcement learning (RL), especially for robotics and continuous control. Conventional model-based RL frameworks directly condition future…

Robotics · Computer Science 2026-03-13 Jseen Zhang , Gabriel Adineera , Jinzhou Tan , Jinoh Kim

Policy Mirror Descent (PMD) is a powerful and theoretically sound methodology for sequential decision-making. However, it is not directly applicable to Reinforcement Learning (RL) due to the inaccessibility of explicit action-value…

Machine Learning · Computer Science 2024-11-01 Pietro Novelli , Marco Pratticò , Massimiliano Pontil , Carlo Ciliberto

Physics-Informed Neural Networks (PINN) are neural networks (NNs) that encode model equations, like Partial Differential Equations (PDE), as a component of the neural network itself. PINNs are nowadays used to solve PDEs, fractional…

Learning predictive world models from visual observations is a core problem in embodied AI, with applications to model-based reinforcement learning and robotic planning. Existing latent world models typically generate future states with…

Machine Learning · Computer Science 2026-05-12 Qixin Xiao , Maani Ghaffari

Imitation learning for robot dexterous manipulation, especially with a real robot setup, typically requires a large number of demonstrations. In this paper, we present a data-efficient learning from demonstration framework which exploits…

Manipulating volumetric deformable objects in the real world, like plush toys and pizza dough, bring substantial challenges due to infinite shape variations, non-rigid motions, and partial observability. We introduce ACID, an…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Bokui Shen , Zhenyu Jiang , Christopher Choy , Leonidas J. Guibas , Silvio Savarese , Anima Anandkumar , Yuke Zhu

Developing foundational world models is a key research direction for embodied intelligence, with the ability to adapt to non-stationary environments being a crucial criterion. In this work, we introduce a new formalism, Hidden…

Machine Learning · Computer Science 2024-11-05 Emiliyan Gospodinov , Vaisakh Shaj , Philipp Becker , Stefan Geyer , Gerhard Neumann

Non-prehensile manipulation, such as pushing objects to a desired target position, is an important skill for robots to assist humans in everyday situations. However, the task is challenging due to the large variety of objects with different…

Robotics · Computer Science 2024-11-14 Lara Bergmann , David Leins , Robert Haschke , Klaus Neumann

For Prognostics and Health Management (PHM) of Lithium-ion (Li-ion) batteries, many models have been established to characterize their degradation process. The existing empirical or physical models can reveal important information regarding…

Signal Processing · Electrical Eng. & Systems 2023-09-12 Pengfei Wen , Zhi-Sheng Ye , Yong Li , Shaowei Chen , Pu Xie , Shuai Zhao

Learning policies in simulation is promising for reducing human effort when training robot controllers. This is especially true for soft robots that are more adaptive and safe but also more difficult to accurately model and control. The…

Robotics · Computer Science 2021-07-27 Kun Wang , Mridul Aanjaneya , Kostas Bekris

This paper presents a rigorous evaluation of Real-to-Sim parameter estimation approaches for fabric manipulation in robotics. The study systematically assesses three state-of-the-art approaches, namely two differential pipelines and a…

Robotics · Computer Science 2025-03-21 Yingdong Ru , Lipeng Zhuang , Zhuo He , Florent P. Audonnet , Gerardo Aragon-Caramasa

Physics-Informed Neural Networks (PINNs) combine deep learning with physical constraints for solving partial differential equations (PDEs), and are widely applied in fluid mechanics, heat transfer, and solid mechanics. However, PINN…

Machine Learning · Computer Science 2026-05-18 Xujia Chen , Xinyue Hu , Letian Chen , Daming Shi , Wenhui Fan

State estimation is a cornerstone of power system control-center operations, and its robust operation is increasingly a cyber-physical security concern as modern grids become more digitalized and communication-intensive. Neural…

Machine Learning · Computer Science 2026-04-28 Solon Falas , Markos Asprou , Charalambos Konstantinou , Maria K. Michael

Physics-informed neural network (PINN) has recently gained increasing interest in computational mechanics. In this work, we present a detailed introduction to programming PINN-based computational solid mechanics. Besides, two prevailingly…

Computational Engineering, Finance, and Science · Computer Science 2023-04-11 Jinshuai Bai , Hyogu Jeong , C. P. Batuwatta-Gamage , Shusheng Xiao , Qingxia Wang , C. M. Rathnayaka , Laith Alzubaidi , Gui-Rong Liu , Yuantong Gu

We study the problem of learning physical object representations for robot manipulation. Understanding object physics is critical for successful object manipulation, but also challenging because physical object properties can rarely be…

Robotics · Computer Science 2019-06-13 Zhenjia Xu , Jiajun Wu , Andy Zeng , Joshua B. Tenenbaum , Shuran Song

Simulation modeling of robots, objects, and environments is the backbone for all model-based control and learning. It is leveraged broadly across dynamic programming and model-predictive control, as well as data generation for imitation,…

Robotics · Computer Science 2022-01-19 Fei Liu , Mingen Li , Jingpei Lu , Entong Su , Michael C. Yip

By the recent spread of machine learning in the robotics field, a humanoid that can act, perceive, and learn in the real world through contact with the environment needs to be developed. In this study, as one of the choices, we propose a…