English
Related papers

Related papers: Physical Property Understanding from Language-Embe…

200 papers

This work presents a framework for automatically extracting physical object properties, such as material composition, mass, volume, and stiffness, through robot manipulation and a database of object measurements. The framework involves…

It is widely accepted that reasoning about object shape is important for object recognition. However, the most powerful object recognition methods today do not explicitly make use of object shape during learning. In this work, motivated by…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Stefan Stojanov , Anh Thai , James M. Rehg

In this work we explore how fine-grained differences between the shapes of common objects are expressed in language, grounded on images and 3D models of the objects. We first build a large scale, carefully controlled dataset of human…

Computation and Language · Computer Science 2019-05-09 Panos Achlioptas , Judy Fan , Robert X. D. Hawkins , Noah D. Goodman , Leonidas J. Guibas

The world is abundant with diverse materials, each possessing unique surface appearances that play a crucial role in our daily perception and understanding of their properties. Despite advancements in technology enabling the capture and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Jiri Filip , Filip Dechterenko , Filipp Schmidt , Jiri Lukavsky , Veronika Vilimovska , Jan Kotera , Roland W. Fleming

We present a simple and effective framework, named Point2Seq, for 3D object detection from point clouds. In contrast to previous methods that normally {predict attributes of 3D objects all at once}, we expressively model the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Yujing Xue , Jiageng Mao , Minzhe Niu , Hang Xu , Michael Bi Mi , Wei Zhang , Xiaogang Wang , Xinchao Wang

To reach human performance on complex tasks, a key ability for artificial systems is to understand physical interactions between objects, and predict future outcomes of a situation. This ability, often referred to as intuitive physics, has…

Computer Vision and Pattern Recognition · Computer Science 2020-05-04 Ronan Riochet , Josef Sivic , Ivan Laptev , Emmanuel Dupoux

Given a visual scene, humans have strong intuitions about how a scene can evolve over time under given actions. The intuition, often termed visual intuitive physics, is a critical ability that allows us to make effective plans to manipulate…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Haotian Xue , Antonio Torralba , Joshua B. Tenenbaum , Daniel LK Yamins , Yunzhu Li , Hsiao-Yu Tung

Machine learning has the potential to accelerate materials discovery by accurately predicting materials properties at a low computational cost. However, the model inputs remain a key stumbling block. Current methods typically use…

Computational Physics · Physics 2021-01-07 Rhys E. A. Goodall , Alpha A. Lee

In this paper, we address an open problem of zero-shot learning. Its principle is based on learning a mapping that associates feature vectors extracted from i.e. images and attribute vectors that describe objects and/or scenes of interest.…

Computer Vision and Pattern Recognition · Computer Science 2018-06-26 Hongguang Zhang , Piotr Koniusz

Language models~(LMs) gradually become general-purpose interfaces in the interactive and embodied world, where the understanding of physical concepts is an essential prerequisite. However, it is not yet clear whether LMs can understand…

Computation and Language · Computer Science 2023-05-24 Lei Li , Jingjing Xu , Qingxiu Dong , Ce Zheng , Qi Liu , Lingpeng Kong , Xu Sun

An ability to learn about new objects from a small amount of visual data and produce convincing linguistic justification about the presence/absence of certain concepts (that collectively compose the object) in novel scenarios is an…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Shailaja Keyur Sampat , Maitreya Patel , Yezhou Yang , Chitta Baral

Inferring the physical properties of 3D scenes from visual information is a critical yet challenging task for creating interactive and realistic virtual worlds. While humans intuitively grasp material characteristics such as elasticity or…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Long Le , Ryan Lucas , Chen Wang , Chuhao Chen , Dinesh Jayaraman , Eric Eaton , Lingjie Liu

We present a computational framework that transforms single images into 3D physical objects. The visual geometry of a physical object in an image is determined by three orthogonal attributes: mechanical properties, external forces, and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Minghao Guo , Bohan Wang , Pingchuan Ma , Tianyuan Zhang , Crystal Elaine Owens , Chuang Gan , Joshua B. Tenenbaum , Kaiming He , Wojciech Matusik

To endow machines with the ability to perceive the real-world in a three dimensional representation as we do as humans is a fundamental and long-standing topic in Artificial Intelligence. Given different types of visual inputs such as…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Bo Yang

Computer vision helps machines or computer to see like humans. Computer Takes information from the images and then understands of useful information from images. Gesture recognition and movement recognition are the current area of research…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Anitta D , Annis Fathima A

We base our work on the teleosemantic modelling of concepts as abilities implementing the distinct functions of recognition and classification. Accordingly, we model two types of concepts - substance concepts suited for object recognition…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Fausto Giunchiglia , Mayukh Bagchi

We mimic the cognitive ability of Human perception, based on Bayesian hypothesis, to recognize view-based 3D objects. We consider approximate Bayesian (Empirical Bayesian) for perceptual inference for recognition. We essentially handle…

Artificial Intelligence · Computer Science 2022-11-28 Kumar Sankar Ray

Human visual perception carves a scene at its physical joints, decomposing the world into objects, which are selectively attended, tracked, and predicted as we engage our surroundings. Object representations emancipate perception from the…

Neurons and Cognition · Quantitative Biology 2021-09-09 Benjamin Peters , Nikolaus Kriegeskorte

The objective of this paper is to learn dense 3D shape correspondence for topology-varying generic objects in an unsupervised manner. Conventional implicit functions estimate the occupancy of a 3D point given a shape latent code. Instead,…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Feng Liu , Xiaoming Liu

This paper proposes a unified vision-based manipulation framework using image contours of deformable/rigid objects. Instead of using human-defined cues, the robot automatically learns the features from processed vision data. Our method…

Robotics · Computer Science 2021-05-06 Jihong Zhu , David Navarro-Alarcon , Robin Passama , Andrea Cherubini