English
Related papers

Related papers: IntPhys 2: Benchmarking Intuitive Physics Understa…

200 papers

Here we present DeepGaze II, a model that predicts where people look in images. The model uses the features from the VGG-19 deep neural network trained to identify objects in images. Contrary to other saliency models that use deep features,…

Computer Vision and Pattern Recognition · Computer Science 2016-10-06 Matthias Kümmerer , Thomas S. A. Wallis , Matthias Bethge

Perceptual learning enables humans to recognize and represent stimuli invariant to various transformations and build a consistent representation of the self and physical world. Such representations preserve the invariant physical relations…

Neural and Evolutionary Computing · Computer Science 2020-07-02 Du Xiaorui , Yavuzhan Erdem , Immanuel Schweizer , Cristian Axenie

Video representation learning has recently attracted attention in computer vision due to its applications for activity and scene forecasting or vision-based planning and control. Video prediction models often learn a latent representation…

Computer Vision and Pattern Recognition · Computer Science 2020-09-18 Rama Krishna Kandukuri , Jan Achterhold , Michael Möller , Jörg Stückler

We consider the use of Deep Learning methods for modeling complex phenomena like those occurring in natural physical processes. With the large amount of data gathered on these phenomena the data intensive paradigm could begin to challenge…

Artificial Intelligence · Computer Science 2018-01-10 Emmanuel de Bezenac , Arthur Pajot , Patrick Gallinari

We present PhysInOne, a large-scale synthetic dataset addressing the critical scarcity of physically-grounded training data for AI systems. Unlike existing datasets limited to merely hundreds or thousands of examples, PhysInOne provides 2…

This document is a hands-on, comprehensive guide to deep learning in the realm of physical simulations. Rather than just theory, we emphasize practical application: every concept is paired with interactive Jupyter notebooks to get you up…

Machine Learning · Computer Science 2025-03-28 N. Thuerey , B. Holzschuh , P. Holl , G. Kohl , M. Lino , Q. Liu , P. Schnell , F. Trost

Simulating physical systems is a core component of scientific computing, encompassing a wide range of physical domains and applications. Recently, there has been a surge in data-driven methods to complement traditional numerical simulations…

Machine Learning · Computer Science 2021-08-19 Karl Otness , Arvi Gjoka , Joan Bruna , Daniele Panozzo , Benjamin Peherstorfer , Teseo Schneider , Denis Zorin

Physical intuition is pivotal for intelligent agents to perform complex tasks. In this paper we investigate the passive acquisition of an intuitive understanding of physical principles as well as the active utilisation of this intuition in…

Computer Vision and Pattern Recognition · Computer Science 2018-07-09 Oliver Groth , Fabian B. Fuchs , Ingmar Posner , Andrea Vedaldi

Recent advances in generative video modeling, driven by large-scale datasets and powerful architectures, have yielded remarkable visual realism. However, emerging evidence suggests that simply scaling data and model size does not endow…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Ying Shen , Jerry Xiong , Tianjiao Yu , Ismini Lourentzou

Inverse design is a central goal in much of science and engineering, including frequency-selective surfaces (FSS) that are critical to microelectronics for telecommunications and optical metamaterials. Traditional surrogate-assisted…

Physics-based reinforcement learning tasks can benefit from simplified physics simulators as they potentially allow near-optimal policies to be learned in simulation. However, such simulators require the latent factors (e.g. mass, friction…

Machine Learning · Computer Science 2022-02-14 Buddhika Laknath Semage , Thommen George Karimpanal , Santu Rana , Svetha Venkatesh

The rapid advancement of embodied intelligence and world models has intensified efforts to integrate physical laws into AI systems, yet physical perception and symbolic physics reasoning have developed along separate trajectories without a…

Existing single-image 3D indoor scene generators often produce results that look visually plausible but fail to obey real-world physics, limiting their reliability in robotics, embodied AI, and design. To examine this gap, we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Dongli Wu , Jingyu Hu , Ka-Hei Hui , Xiaobao Wei , Chengwen Luo , Jianqiang Li , Zhengzhe Liu

Understanding long-form videos, such as movies and TV episodes ranging from tens of minutes to two hours, remains a significant challenge for multi-modal models. Existing benchmarks often fail to test the full range of cognitive skills…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Kirolos Ataallah , Eslam Abdelrahman , Mahmoud Ahmed , Chenhui Gou , Khushbu Pahwa , Jian Ding , Mohamed Elhoseiny

We study the task of predicting dynamic physical properties from videos. More specifically, we consider physical properties that require temporal information to be inferred: elasticity of a bouncing object, viscosity of a flowing liquid,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Guanqi Zhan , Xianzheng Ma , Weidi Xie , Andrew Zisserman

Frontier LLMs now perform strongly across a wide range of physics evaluations, but it is hard to disentangle genuine reasoning from recall of established science. We introduce DiscoverPhysics, an interactive benchmark that asks a LLM agent…

Physics sensing plays a central role in many scientific and engineering domains, which inherently involves two coupled tasks: reconstructing dense physical fields from sparse observations and optimizing scattered sensor placements to…

Signal Processing · Electrical Eng. & Systems 2026-05-26 Yuezhou Ma , Haixu Wu , Hang Zhou , Huikun Weng , Jianmin Wang , Mingsheng Long

Modern foundational Multimodal Large Language Models (MLLMs) and video world models have advanced significantly in mathematical, common-sense, and visual reasoning, but their grasp of the underlying physics remains underexplored. Existing…

Characterizing quantum flakes is a critical step in quantum hardware engineering because the quality of these flakes directly influences qubit performance. Although computer vision methods for identifying two-dimensional quantum flakes have…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Hoang-Quan Nguyen , Xuan Bac Nguyen , Sankalp Pandey , Tim Faltermeier , Nicholas Borys , Hugh Churchill , Khoa Luu

Extracting physical dynamical system parameters from recorded observations is key in natural science. Current methods for automatic parameter estimation from video train supervised deep networks on large datasets. Such datasets require…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Alejandro Castañeda Garcia , Jan van Gemert , Daan Brinks , Nergis Tömen