English
Related papers

Related papers: D3-Gym: Constructing Real-World Verifiable Environ…

200 papers

Large Language Models (LLMs) possess general world knowledge but often struggle to generate precise predictions in structured, domain-specific contexts such as simulations. These limitations arise from their inability to ground their broad,…

Artificial Intelligence · Computer Science 2026-01-30 Guillaume Levy , Cedric Colas , Pierre-Yves Oudeyer , Thomas Carta , Clement Romac

The emergence of text-to-image generative models has revolutionized the field of deepfakes, enabling the creation of realistic and convincing visual content directly from textual descriptions. However, this advancement presents considerably…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Yabin Wang , Zhiwu Huang , Zhiheng Ma , Xiaopeng Hong

Recently, synthetic data generation and realistic rendering has advanced tasks like target tracking and human pose estimation. Simulations for most robotics applications are obtained in (semi)static environments, with specific sensors and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-29 Elia Bonetto , Chenghao Xu , Aamir Ahmad

DBLP is the largest open-access repository of scientific articles on computer science and provides metadata associated with publications, authors, and venues. We retrieved more than 6 million publications from DBLP and extracted pertinent…

Digital Libraries · Computer Science 2024-02-09 Jan Philip Wahle , Terry Ruas , Saif M. Mohammad , Bela Gipp

Given the remarkable performance of Large Language Models (LLMs), an important question arises: Can LLMs conduct human-like scientific research and discover new knowledge, and act as an AI scientist? Scientific discovery is an iterative…

Machine Learning · Computer Science 2025-02-24 Tingting Chen , Srinivas Anumasa , Beibei Lin , Vedant Shah , Anirudh Goyal , Dianbo Liu

We introduce VectorGym, a comprehensive benchmark suite for Scalable Vector Graphics (SVG) that spans generation from text and sketches, complex editing, and visual understanding. VectorGym addresses the lack of realistic, challenging…

Models like OpenAI-o3 pioneer visual grounded reasoning by dynamically referencing visual regions, just like human "thinking with images". However, no benchmark exists to evaluate these capabilities holistically. To bridge this gap, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Haochen Wang , Xiangtai Li , Zilong Huang , Anran Wang , Jiacong Wang , Tao Zhang , Jiani Zheng , Sule Bai , Zijian Kang , Jiashi Feng , Zhuochen Wang , Zhaoxiang Zhang

In this paper, we study the problem of mapping natural language instructions to complex spatial actions in a 3D blocks world. We first introduce a new dataset that pairs complex 3D spatial operations to rich natural language descriptions…

Computation and Language · Computer Science 2017-12-27 Yonatan Bisk , Kevin J. Shih , Yejin Choi , Daniel Marcu

Neural networks are increasingly used to support decision-making. To verify their reliability and adaptability, researchers and practitioners have proposed a variety of tools and methods for tasks such as NN code verification, refactoring,…

Machine Learning · Computer Science 2026-02-05 Nadia Daoudi , Jordi Cabot

Simulating physical systems is a core component of scientific computing, encompassing a wide range of physical domains and applications. Recently, there has been a surge in data-driven methods to complement traditional numerical simulations…

Machine Learning · Computer Science 2021-08-19 Karl Otness , Arvi Gjoka , Joan Bruna , Daniele Panozzo , Benjamin Peherstorfer , Teseo Schneider , Denis Zorin

Despite their substantial successes, AI agents continue to face fundamental challenges in terms of trustworthiness. Consider deep research agents, tasked with searching for information relevant to a given topic-while AI agents can perform…

Machine Learning · Computer Science 2026-04-21 Remy Kim , Minseung Lee , Shuo Li , Osbert Bastani

The rapid development of Artificial Intelligence Generated Content (AIGC) techniques has enabled the creation of high-quality synthetic content, but it also raises significant security concerns. Current detection methods face two major…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Changjiang Jiang , Wenhui Dong , Zhonghao Zhang , Fengchang Yu , Wei Peng , Xinbin Yuan , Yifei Bi , Ming Zhao , Zian Zhou , Chenyang Si , Caifeng Shan

Vision guided navigation requires processing complex visual information to inform task-orientated decisions. Applications include autonomous robots, self-driving cars, and assistive vision for humans. A key element is the extraction and…

Robotics · Computer Science 2022-09-20 Jaime Ruiz-Serra , Jack White , Stephen Petrie , Tatiana Kameneva , Chris McCarthy

With the advent of large multimodal language models, science is now at a threshold of an AI-based technological transformation. An emerging ecosystem of models and tools aims to support researchers throughout the scientific lifecycle,…

Reconstructing accurate 3D surfaces for street-view scenarios is crucial for applications such as digital entertainment and autonomous driving simulation. However, existing street-view datasets, including KITTI, Waymo, and nuScenes, only…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Yubin Hu , Kairui Wen , Heng Zhou , Xiaoyang Guo , Yong-Jin Liu

We aim to redefine robust ego-motion estimation and photorealistic 3D reconstruction by addressing a critical limitation: the reliance on noise-free data in existing models. While such sanitized conditions simplify evaluation, they fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Xiaohao Xu , Tianyi Zhang , Shibo Zhao , Xiang Li , Sibo Wang , Yongqi Chen , Ye Li , Bhiksha Raj , Matthew Johnson-Roberson , Sebastian Scherer , Xiaonan Huang

Training robots in simulation requires diverse 3D scenes that reflect the specific challenges of downstream tasks. However, scenes that satisfy strict task requirements, such as high-clutter environments with plausible spatial arrangement,…

Robotics · Computer Science 2025-08-27 Nicholas Pfaff , Hongkai Dai , Sergey Zakharov , Shun Iwase , Russ Tedrake

Grasp detection is a persistent and intricate challenge with various industrial applications. Recently, many methods and datasets have been proposed to tackle the grasp detection problem. However, most of them do not consider using natural…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 An Dinh Vuong , Minh Nhat Vu , Baoru Huang , Nghia Nguyen , Hieu Le , Thieu Vo , Anh Nguyen

Semantic scene understanding is crucial for robotics and computer vision applications. In autonomous driving, 3D semantic segmentation plays an important role for enabling safe navigation. Despite significant advances in the field, the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Lucas Nunes , Rodrigo Marcuzzi , Jens Behley , Cyrill Stachniss

In recent years, learning-based approaches have demonstrated significant promise in addressing intricate navigation tasks. Traditional methods for training deep neural network navigation policies rely on meticulously designed reward…

Robotics · Computer Science 2023-12-01 Wenzhe Cai , Teng Wang , Guangran Cheng , Lele Xu , Changyin Sun