English
Related papers

Related papers: 3D Arena: An Open Platform for Generative 3D Evalu…

200 papers

World Generation Models are emerging as a cornerstone of next-generation multimodal intelligence systems. Unlike traditional 2D visual generation, World Models aim to construct realistic, dynamic, and physically consistent 3D/4D worlds from…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yiting Lu , Wei Luo , Peiyan Tu , Haoran Li , Hanxin Zhu , Zihao Yu , Xingrui Wang , Xinyi Chen , Xinge Peng , Xin Li , Zhibo Chen

For safety-critical applications, it is crucial to audit 3D human pose estimators before deployment. Will the system break down if the weather or the clothing changes? Is it robust regarding gender and age? To answer these questions and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Nikita Kister , István Sárándi , Jiayi Wang , Anna Khoreva , Gerard Pons-Moll

The rise of vision-language foundation models marks an advancement in bridging the gap between human and machine capabilities in 3D scene reasoning. Existing 3D reasoning benchmarks assume real-time scene accessibility, which is impractical…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Ye Mao , Weixun Luo , Junpeng Jing , Anlan Qiu , Krystian Mikolajczyk

Anime video generation faces significant challenges due to the scarcity of anime data and unusual motion patterns, leading to issues such as motion distortion and flickering artifacts, which result in misalignment with human preferences.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Bingwen Zhu , Yudong Jiang , Baohan Xu , Siqian Yang , Mingyu Yin , Yidi Wu , Huyang Sun , Zuxuan Wu

Digital humans and, especially, 3D facial avatars have raised a lot of attention in the past years, as they are the backbone of several applications like immersive telepresence in AR or VR. Despite the progress, facial avatars reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Berna Kabadayi , Wojciech Zielonka , Bharat Lal Bhatnagar , Gerard Pons-Moll , Justus Thies

Modeling the 3D world from sensor data for simulation is a scalable way of developing testing and validation environments for robotic learning problems such as autonomous driving. However, manually creating or re-creating real-world-like…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Bokui Shen , Xinchen Yan , Charles R. Qi , Mahyar Najibi , Boyang Deng , Leonidas Guibas , Yin Zhou , Dragomir Anguelov

Three-dimensional (3D) objects have wide applications. Despite the growing interest in 3D modeling in academia and industries, designing and/or creating 3D objects from scratch remains time-consuming and challenging. With the development of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 XiuYu Zhang , Xiaolei Ye , Jui-Che Chang , Yue Fang

Generative query suggestion using large language models offers a powerful way to enhance conversational systems, but aligning outputs with nuanced user preferences remains a critical challenge. To address this, we introduce a multi-stage…

Computation and Language · Computer Science 2025-12-16 Junhao Yin , Haolin Wang , Peng Bao , Ju Xu , Yongliang Wang

The model-based estimation of 3D animal pose and shape from images enables computational modeling of animal behavior. Training models for this purpose requires large amounts of labeled image data with precise pose and shape annotations.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Tomasz Niewiadomski , Anastasios Yiannakidis , Hanz Cuevas-Velasquez , Soubhik Sanyal , Michael J. Black , Silvia Zuffi , Peter Kulits

Textured high-fidelity 3D models are crucial for games, AR/VR, and film, but human-aligned evaluation methods still fall behind despite recent advances in 3D reconstruction and generation. Existing metrics, such as Chamfer Distance, often…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Tianyu Luan , Xuelu Feng , Zixin Zhu , Phani Nuney , Sheng Liu , Xuan Gong , David Doermann , Chunming Qiao , Junsong Yuan

3D vision foundation models have shown strong generalization in reconstructing key 3D attributes from uncalibrated images through a single feed-forward pass. However, when deployed in online settings such as driving scenarios, predictions…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Fengyi Zhang , Tianjun Zhang , Kasra Khosoussi , Zheng Zhang , Zi Huang , Yadan Luo

Code large language models (codeLLMs) have made significant strides in code generation. Most previous code-related benchmarks, which consist of various programming exercises along with the corresponding test cases, are used as a common…

Computation and Language · Computer Science 2024-12-09 Jian Yang , Jiaxi Yang , Ke Jin , Yibo Miao , Lei Zhang , Liqun Yang , Zeyu Cui , Yichang Zhang , Binyuan Hui , Junyang Lin

Generative world models are reshaping embodied AI, enabling agents to synthesize realistic 4D driving environments that look convincing but often fail physically or behaviorally. Despite rapid progress, the field still lacks a unified way…

Urban 3D modeling from satellite images requires accurate semantic segmentation to delineate urban features, multiple view stereo for 3D reconstruction of surface heights, and 3D model fitting to produce compact models with accurate surface…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Shea Hagstrom , Hee Won Pak , Stephanie Ku , Sean Wang , Gregory Hager , Myron Brown

The rapid evolution of Large Language Models (LLMs) has outpaced the development of model evaluation, highlighting the need for continuous curation of new, challenging benchmarks. However, manual curation of high-quality, human-aligned…

Machine Learning · Computer Science 2024-10-16 Tianle Li , Wei-Lin Chiang , Evan Frick , Lisa Dunlap , Tianhao Wu , Banghua Zhu , Joseph E. Gonzalez , Ion Stoica

We introduce the WorldScore benchmark, the first unified benchmark for world generation. We decompose world generation into a sequence of next-scene generation tasks with explicit camera trajectory-based layout specifications, enabling…

Graphics · Computer Science 2025-12-02 Haoyi Duan , Hong-Xing Yu , Sirui Chen , Li Fei-Fei , Jiajun Wu

Manipulating facial expressions is a challenging task due to fine-grained shape changes produced by facial muscles and the lack of input-output pairs for supervised learning. Unlike previous methods using Generative Adversarial Networks…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Rumeysa Bodur , Binod Bhattarai , Tae-Kyun Kim

Answering questions about the spatial properties of the environment poses challenges for existing language and vision foundation models due to a lack of understanding of the 3D world notably in terms of relationships between objects. To…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Emilia Szymanska , Mihai Dusmanu , Jan-Willem Buurlage , Mahdi Rad , Marc Pollefeys

We introduce a benchmark to directly evaluate the alignment between human observers and vision models on a 3D shape inference task. We leverage an experimental design from the cognitive sciences which requires zero-shot visual inferences…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Tyler Bonnen , Stephanie Fu , Yutong Bai , Thomas O'Connell , Yoni Friedman , Nancy Kanwisher , Joshua B. Tenenbaum , Alexei A. Efros

Evaluating the quality of recommender systems is critical for algorithm design and optimization. Most evaluation methods are computed based on offline metrics for quick algorithm evolution, since online experiments are usually risky and…

Information Retrieval · Computer Science 2024-12-17 Zhuo Wu , Qinglin Jia , Chuhan Wu , Zhaocheng Du , Shuai Wang , Zan Wang , Zhenhua Dong