English
Related papers

Related papers: UnrealCV: Connecting Computer Vision to Unreal Eng…

200 papers

Virtual reality is expected to play a significant role in the transformation of education and psychological studies. The possibilities for its application as a visual research method can be enhanced as established frameworks and toolkits…

Human-Computer Interaction · Computer Science 2023-10-24 Corrie Green , Chloë Farr , Yang Jiang

The landscape of video generation is shifting, from a focus on generating visually appealing clips to building virtual environments that support interaction and maintain physical plausibility. These developments point toward the emergence…

Artificial Intelligence · Computer Science 2026-02-09 Jingtong Yue , Ziqi Huang , Zhaoxi Chen , Xintao Wang , Pengfei Wan , Ziwei Liu

While LLM/VLM-powered AI agents have advanced rapidly in math, coding, and computer use, their applications in complex physical and social environments remain challenging. Building agents that can survive and thrive in the real world (for…

Originally designed for applications in computer graphics, visual computing (VC) methods synthesize information about physical and virtual worlds, using prescribed algorithms optimized for spatial computing. VC is used to analyze geometry,…

Collaborative virtual environments (CVEs) are used for collaboration and interaction of possibly many participants that may be spread over large distances. Both commercial and freely available CVEs exist today. Currently, CVEs are used…

Software Engineering · Computer Science 2025-04-17 Luciano Argento , Angelo Furfaro

Video image datasets are playing an essential role in design and evaluation of traffic vision algorithms. Nevertheless, a longstanding inconvenience concerning image datasets is that manually collecting and annotating large-scale…

Computer Vision and Pattern Recognition · Computer Science 2017-12-25 Xuan Li , Kunfeng Wang , Yonglin Tian , Lan Yan , Fei-Yue Wang

Synthetic image datasets offer unmatched advantages for designing and evaluating deep neural networks: they make it possible to (i) render as many data samples as needed, (ii) precisely control each scene and yield granular ground truth…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Florian Bordes , Shashank Shekhar , Mark Ibrahim , Diane Bouchacourt , Pascal Vincent , Ari S. Morcos

4D reconstruction and rendering of human activities is critical for immersive VR/AR experience.Recent advances still fail to recover fine geometry and texture results with the level of detail present in the input images from sparse…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Xin Suo , Yuheng Jiang , Pei Lin , Yingliang Zhang , Kaiwen Guo , Minye Wu , Lan Xu

Generative artificial intelligence has shown promise in prompting virtual worlds into existence, yet little attention has been given to understanding how this process unfolds as social interaction. We present Social Conjurer, a framework…

Human-Computer Interaction · Computer Science 2024-10-03 Amina Kobenova , Cyan DeVeaux , Samyak Parajuli , Andrzej Banburski-Fahey , Judith Amores Fernandez , Jaron Lanier

Creating virtual digital replicas from real-world data unlocks significant potential across domains like gaming and robotics. In this paper, we present DRAWER, a novel framework that converts a video of a static indoor scene into a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Hongchi Xia , Entong Su , Marius Memmel , Arhan Jain , Raymond Yu , Numfor Mbiziwo-Tiapo , Ali Farhadi , Abhishek Gupta , Shenlong Wang , Wei-Chiu Ma

Recent advances in artificial intelligence have been driven by the presence of increasingly realistic and complex simulated environments. However, many of the existing environments provide either unrealistic visuals, inaccurate physics, low…

Efficient rendering of photo-realistic virtual worlds is a long standing effort of computer graphics. Modern graphics techniques have succeeded in synthesizing photo-realistic images from hand-crafted scene representations. However, the…

This study advances real-time volumetric cloud rendering in Computer Graphics (CG) by developing a specialized shader in Unreal Engine (UE), focusing on realistic cloud modeling and lighting. By leveraging ray-casting-based lighting…

Graphics · Computer Science 2025-02-13 Shruti Singh , Shantanu Kumar

In this paper VisualEnv, a new tool for creating visual environment for reinforcement learning is introduced. It is the product of an integration of an open-source modelling and rendering software, Blender, and a python module used to…

Machine Learning · Computer Science 2021-12-02 Andrea Scorsoglio , Roberto Furfaro

This paper proposed a new interaction paradigm in the virtual reality (VR) environments, which consists of a virtual mirror or window projected onto a virtual surface, representing the correct perspective geometry of a mirror or window…

Human-Computer Interaction · Computer Science 2020-11-13 Baihan Lin

Over the last decade, Computer Vision, the branch of Artificial Intelligence aimed at understanding the visual world, has evolved from simply recognizing objects in images to describing pictures, answering questions about images, aiding…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Ranjay Krishna , Mitchell Gordon , Li Fei-Fei , Michael Bernstein

Video world models have shown immense promise for interactive simulation and entertainment, but current systems still struggle with two important aspects of interactivity: user control over the environment for reproducible, editable…

Artificial Intelligence · Computer Science 2026-04-01 Ryan Po , David Junhao Zhang , Amir Hertz , Gordon Wetzstein , Neal Wadhwa , Nataniel Ruiz

The Metaverse and its promises are fast becoming reality as maturing technologies are empowering the different facets. One of the highlights of the Metaverse is that it offers the possibility for highly immersive and interactive…

Networking and Internet Architecture · Computer Science 2023-03-09 Wenhan Yu , Terence Jie Chua , Jun Zhao

In an era where numerous studies claim to achieve almost photorealism with real-time automated environment capture, there is a need for assessments and reproducibility in this domain. This paper presents a transparent and reproducible user…

Human-Computer Interaction · Computer Science 2024-07-03 Sven Kluge , Oliver Staadt

In this paper we present a framework for the rendering of dynamic 3D virtual environments which can be integrated in the development of videogames. It includes methods to manage sounds and particle effects, paged static geometries, the…

Graphics · Computer Science 2013-06-06 Salvatore Catanese , Emilio Ferrara , Giacomo Fiumara , Francesco Pagano