English
Related papers

Related papers: Break and Make: Interactive Structural Understandi…

200 papers

Reasoning about objects, relations, and physics is central to human intelligence, and a key goal of artificial intelligence. Here we introduce the interaction network, a model which can reason about how objects in complex systems interact,…

Artificial Intelligence · Computer Science 2016-12-02 Peter W. Battaglia , Razvan Pascanu , Matthew Lai , Danilo Rezende , Koray Kavukcuoglu

A critical aspect of human visual perception is the ability to parse visual scenes into individual objects and further into object parts, forming part-whole hierarchies. Such composite structures could induce a rich set of semantic concepts…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Yining Hong , Li Yi , Joshua B. Tenenbaum , Antonio Torralba , Chuang Gan

Humans use semantic concepts such as spatial relations between objects to describe scenes and communicate tasks such as "Put the tea to the right of the cup" or "Move the plate between the fork and the spoon." Just as children, assistive…

Robotics · Computer Science 2023-05-17 Rainer Kartmann , Tamim Asfour

We present Team asdfo123's submission to the LLMSR@XLLM25 shared task, which evaluates large language models on producing fine-grained, controllable, and interpretable reasoning processes. Systems must extract all problem conditions,…

Computation and Language · Computer Science 2025-05-20 Xinye Li , Mingqi Wan , Dianbo Sui

Large Language Models (LLMs) demonstrate ever-increasing abilities in mathematical and algorithmic tasks, yet their geometric reasoning skills are underexplored. We investigate LLMs' abilities in constructive geometric problem-solving one…

Computation and Language · Computer Science 2024-09-23 Spyridon Mouselinos , Henryk Michalewski , Mateusz Malinowski

Decision-making in complex systems often relies on machine learning models, yet highly accurate models such as XGBoost and neural networks can obscure the reasoning behind their predictions. In operations research applications,…

Machine Learning · Computer Science 2025-02-28 Gaurav Arwade , Sigurdur Olafsson

Neural models, including large language models (LLMs), achieve superior performance on multi-hop question-answering. To elicit reasoning capabilities from LLMs, recent works propose using the chain-of-thought (CoT) mechanism to generate…

Computation and Language · Computer Science 2023-11-08 Ruosen Li , Xinya Du

Structure reasoning is a fundamental capability of large language models (LLMs), enabling them to reason about structured commonsense and answer multi-hop questions. However, existing benchmarks for structure reasoning mainly focus on…

Computation and Language · Computer Science 2025-03-04 Zhuohang Jiang , Pangjing Wu , Ziran Liang , Peter Q. Chen , Xu Yuan , Ye Jia , Jiancheng Tu , Chen Li , Peter H. F. Ng , Qing Li

Integrating robotics into everyday scenarios like tutoring or physical training requires robots capable of adaptive, socially engaging, and goal-oriented interactions. While Large Language Models show promise in human-like communication,…

Robotics · Computer Science 2025-04-03 Luca Garello , Giulia Belgiovine , Gabriele Russo , Francesco Rea , Alessandra Sciutti

Generating physically buildable brick structures from 3D shapes requires more than geometric reconstruction: the output must also satisfy discrete part constraints and structural stability. Existing brick generation methods either rely on…

Artificial Intelligence · Computer Science 2026-05-27 Zhengyang Ni , Feng Yan , Yu Guo , Fei Wang

Understanding physical phenomena is a key competence that enables humans and animals to act and interact under uncertain perception in previously unseen environments containing novel objects and their configurations. In this work, we…

Robotics · Computer Science 2019-04-23 Wenbin Li , Aleš Leonardis , Jeannette Bohg , Mario Fritz

Recent advances in Large Language Models have led to Large Reasoning Models, which produce step-by-step reasoning traces. These traces offer insight into how models think and their goals, improving explainability and helping users follow…

Human-Computer Interaction · Computer Science 2025-11-17 Ludwig Felder , Jacob Miller , Markus Wallinger , Stephen Kobourov , Chunyang Chen

Spatial cognition is essential for human intelligence, enabling problem-solving through visual simulations rather than solely relying on verbal reasoning. However, existing AI benchmarks primarily assess verbal reasoning, neglecting the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Linjie Li , Mahtab Bigverdi , Jiawei Gu , Zixian Ma , Yinuo Yang , Ziang Li , Yejin Choi , Ranjay Krishna

Multimodal Large Language Models (MLLMs) excel at structural reasoning yet suffer from a sharp logical brittleness in structural consistency. We term this phenomenon Structural Cognitive Overload (SCO), a byproduct of the contention between…

Artificial Intelligence · Computer Science 2026-05-26 Yang Luo , Xinran Liu , Tiantian Ji , Zhiyi Yin , Lingyun Peng , Shuyu Li

Robotic agents performing domestic chores by natural language directives are required to master the complex job of navigating environment and interacting with objects in the environments. The tasks given to the agents are often composite…

Robotics · Computer Science 2024-03-14 Suvaansh Bhambri , Byeonghwi Kim , Jonghyun Choi

Recent advances in augmented reality (AR) have enabled interactive systems that assist users in physical assembly tasks. In this paper, we present an AR-assisted assembly workflow that leverages object recognition and hand tracking to (1)…

Human-Computer Interaction · Computer Science 2026-01-21 Alexander Htet Kyaw , Haotian Ma , Sasa Zivkovic , Jenny Sabin

Recent advancements in large language models (LLMs) underscore the need for more comprehensive evaluation methods to accurately assess their reasoning capabilities. Existing benchmarks are often domain-specific and thus cannot fully capture…

Large Language Models (LLMs) face significant accuracy degradation due to insufficient reasoning ability when dealing with complex and abstract tasks. Thought structures such as Chain of Thought (CoT) and Tree of Thought (ToT) focus on…

Computation and Language · Computer Science 2025-09-29 Fengxiao Tang , Yufeng Li , Zongzong Wu , Ming Zhao

Evaluating large language models (LLMs) on comprehensive benchmarks is a cornerstone of their development, yet it's often computationally and financially prohibitive. While Item Response Theory (IRT) offers a promising path toward…

Artificial Intelligence · Computer Science 2025-10-07 Lele Liao , Qile Zhang , Ruofan Wu , Guanhua Fang

Large language models show great potential in unstructured data understanding, but still face significant challenges with graphs due to their structural hallucination. Existing approaches mainly either verbalize graphs into natural…

Computation and Language · Computer Science 2026-02-03 Jingyao Wu , Bin Lu , Zijun Di , Xiaoying Gan , Meng Jin , Luoyi Fu , Xinbing Wang , Chenghu Zhou