English
Related papers

Related papers: Multimodal Datasets and Benchmarks for Reasoning a…

200 papers

To be useful in everyday environments, robots must be able to observe and learn about objects. Recent datasets enable progress for classifying data into known object categories; however, it is unclear how to collect reliable object data…

Robotics · Computer Science 2019-01-18 Abhishek Venkataraman , Brent Griffin , Jason J. Corso

We argue that 3-D first-person video games are a challenging environment for real-time multi-modal reasoning. We first describe our dataset of human game-play, collected across a large variety of 3-D first-person games, which is both…

Machine Learning · Computer Science 2025-10-21 Yuguang Yue , Irakli Salia , Samuel Hunt , Christopher Green , Wenzhe Shi , Jonathan J Hunt

In this paper, we argue that simulation platforms enable a novel type of embodied spatial reasoning, one facilitated by a formal model of object and event semantics that renders the continuous quantitative search space of an open-world,…

Artificial Intelligence · Computer Science 2019-02-07 James Pustejovsky , Nikhil Krishnaswamy

Understanding uncertainty plays a critical role in achieving common ground (Clark et al.,1983). This is especially important for multimodal AI systems that collaborate with users to solve a problem or guide the user through a challenging…

Computation and Language · Computer Science 2024-10-21 Qi Cheng , Mert İnan , Rahma Mbarki , Grace Grmek , Theresa Choi , Yiming Sun , Kimele Persaud , Jenny Wang , Malihe Alikhani

We introduce BEHAVIOR, a benchmark for embodied AI with 100 activities in simulation, spanning a range of everyday household chores such as cleaning, maintenance, and food preparation. These activities are designed to be realistic, diverse,…

Recent advancements in deep learning, computer vision, and embodied AI have given rise to synthetic causal reasoning video datasets. These datasets facilitate the development of AI algorithms that can reason about physical interactions…

Artificial Intelligence · Computer Science 2021-08-16 Jiafei Duan , Samson Yu Bai Jian , Cheston Tan

Embodied Question Answering (EQA) serves as a benchmark task to evaluate the capability of robots to navigate within novel environments and identify objects in response to human queries. However, existing EQA methods often rely on simulated…

Robotics · Computer Science 2024-10-15 Koya Sakamoto , Daichi Azuma , Taiki Miyanishi , Shuhei Kurita , Motoaki Kawanabe

Existing datasets for tabular question answering typically focus exclusively on text within cells. However, real-world data is inherently multimodal, often blending images such as symbols, faces, icons, patterns, and charts with textual…

Large multimodal models exhibit remarkable intelligence, yet their embodied cognitive abilities during motion in open-ended urban 3D space remain to be explored. We introduce a benchmark to evaluate whether video-large language models…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Baining Zhao , Jianjie Fang , Zichao Dai , Ziyou Wang , Jirong Zha , Weichen Zhang , Chen Gao , Yue Wang , Jinqiang Cui , Xinlei Chen , Yong Li

Public urban spaces like streetscapes and plazas serve residents and accommodate social life in all its vibrant variations. Recent advances in Robotics and Embodied AI make public urban spaces no longer exclusive to humans. Food delivery…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Wayne Wu , Honglin He , Jack He , Yiran Wang , Chenda Duan , Zhizheng Liu , Quanyi Li , Bolei Zhou

Cutting-edge robot learning techniques including foundation models and imitation learning from humans all pose huge demands on large-scale and high-quality datasets which constitute one of the bottleneck in the general intelligent robot…

Robotics · Computer Science 2026-04-27 Shuo Jiang , Haonan Li , Ruochen Ren , Yanmin Zhou , Zhipeng Wang , Bin He

For social robots like Astro which interact with and adapt to the daily movements of users within the home, realistic simulation of human activity is needed for feature development and testing. This paper presents a framework for simulating…

Robotics · Computer Science 2023-11-28 Ifrah Idrees , Siddharth Singh , Kerui Xu , Dylan F. Glas

Embodied intelligence aims to enable robots to learn, reason, and generalize robustly across complex real-world environments. However, existing approaches often struggle with partial observability, fragmented spatial reasoning, and…

Language is an interface to the outside world. In order for embodied agents to use it, language must be grounded in other, sensorimotor modalities. While there is an extended literature studying how machines can learn grounded language, the…

Artificial Intelligence · Computer Science 2021-10-12 Tristan Karch , Laetitia Teodorescu , Katja Hofmann , Clément Moulin-Frier , Pierre-Yves Oudeyer

In embodied intelligence, datasets play a pivotal role, serving as both a knowledge repository and a conduit for information transfer. The two most critical attributes of a dataset are the amount of information it provides and how easily…

Robotics · Computer Science 2025-11-13 Jiahao Xiao , Bowen Yan , Jianbo Zhang , Jia Wang , Chunyi Li , Zhengxue Cheng , Guangtao Zhai

A smart city can be seen as a framework, comprised of Information and Communication Technologies (ICT). An intelligent network of connected devices that collect data with their sensors and transmit them using cloud technologies in order to…

Artificial Intelligence · Computer Science 2021-08-24 Farzan Shenavarmasouleh , Farid Ghareh Mohammadi , M. Hadi Amini , Hamid R. Arabnia

In Embodied Question Answering (EmbodiedQA), an agent interacts with an environment to gather necessary information for answering user questions. Existing works have laid a solid foundation towards solving this interesting problem. But the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Yu Wu , Lu Jiang , Yi Yang

The CREATE database is composed of 14 hours of multimodal recordings from a mobile robotic platform based on the iRobot Create. The various sensors cover vision, audition, motors and proprioception. The dataset has been designed in the…

Robotics · Computer Science 2018-02-01 Simon Brodeur , Simon Carrier , Jean Rouat

What is the right way to reason about human activities? What directions forward are most promising? In this work, we analyze the current state of human activity understanding in videos. The goal of this paper is to examine datasets,…

Computer Vision and Pattern Recognition · Computer Science 2017-08-10 Gunnar A. Sigurdsson , Olga Russakovsky , Abhinav Gupta

An embodied AI assistant operating on egocentric video must integrate spatial cues across time - for instance, determining where an object A, glimpsed a few moments ago lies relative to an object B encountered later. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Sahithya Ravi , Gabriel Sarch , Vibhav Vineet , Andrew D. Wilson , Balasaravanan Thoravi Kumaravel