English
Related papers

Related papers: Scaling Face Interaction Graph Networks to Real Wo…

200 papers

This paper investigates the integration of graph neural networks (GNNs) with Qualitative Explainable Graphs (QXGs) for scene understanding in automated driving. Scene understanding is the basis for any further reactive or proactive…

Robotics · Computer Science 2025-04-18 Nassim Belmecheri , Arnaud Gotlieb , Nadjib Lazaar , Helge Spieker

We propose the method that uses only computer graphics datasets to parse the real world 3D scenes. 3D scene parsing based on semantic segmentation is required to implement the categorical interaction in the virtual world. Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2019-03-04 Daichi Ono , Hiroyuki Yabe , Tsutomu Horikawa

The significant progress on Generative Adversarial Networks (GANs) have made it possible to generate surprisingly realistic images for single object based on natural language descriptions. However, controlled generation of images for…

Computer Vision and Pattern Recognition · Computer Science 2019-11-14 Hongdong Zheng , Yalong Bai , Wei Zhang , Tao Mei

Learning effective policies for real-world problems is still an open challenge for the field of reinforcement learning (RL). The main limitation being the amount of data needed and the pace at which that data can be obtained. In this paper,…

Machine Learning · Computer Science 2022-02-04 Miguel Suau , Jinke He , Matthijs T. J. Spaan , Frans A. Oliehoek

Many current methods to learn intuitive physics are based on interaction networks and similar approaches. However, they rely on information that has proven difficult to estimate directly from image data in the past. We aim to narrow this…

Computer Vision and Pattern Recognition · Computer Science 2019-06-25 Michael Kissner , Helmut Mayer

Learning to compose visual relationships from raw images in the form of scene graphs is a highly challenging task due to contextual dependencies, but it is essential in computer vision applications that depend on scene understanding.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Neau Maëlic , Paulo E. Santos , Anne-Gwenn Bosser , Cédric Buche

3D rendering of dynamic face captures is a challenging problem, and it demands improvements on several fronts$\unicode{x2014}$photorealism, efficiency, compatibility, and configurability. We present a novel representation that enables…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Safa C. Medin , Gengyan Li , Ruofei Du , Stephan Garbin , Philip Davidson , Gregory W. Wornell , Thabo Beeler , Abhimitra Meka

Predicting future locations of agents in the scene is an important problem in self-driving. In recent years, there has been a significant progress in representing the scene and the agents in it. The interactions of agents with the scene and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-04 Görkay Aydemir , Adil Kaan Akan , Fatma Güney

Bridging the 'reality gap' that separates simulated robotics from experiments on hardware could accelerate robotic research through improved data availability. This paper explores domain randomization, a simple technique for training models…

Robotics · Computer Science 2017-03-22 Josh Tobin , Rachel Fong , Alex Ray , Jonas Schneider , Wojciech Zaremba , Pieter Abbeel

Neural rendering techniques combining machine learning with geometric reasoning have arisen as one of the most promising approaches for synthesizing novel views of a scene from a sparse set of images. Among these, stands out the Neural…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Albert Pumarola , Enric Corona , Gerard Pons-Moll , Francesc Moreno-Noguer

Data-driven approaches to tactile sensing aim to overcome the complexity of accurately modeling contact with soft materials. However, their widespread adoption is impaired by concerns about data efficiency and the capability to generalize…

Robotics · Computer Science 2020-03-06 Carmelo Sferrazza , Thomas Bi , Raffaello D'Andrea

Photo-realistic free-viewpoint rendering of real-world scenes using classical computer graphics techniques is challenging, because it requires the difficult step of capturing detailed appearance and geometry models. Recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Lingjie Liu , Jiatao Gu , Kyaw Zaw Lin , Tat-Seng Chua , Christian Theobalt

Social and information networks are gaining huge popularity recently due to their various applications. Knowledge representation through graphs in the form of nodes and edges should preserve as many characteristics of the original data as…

Machine Learning · Computer Science 2021-02-08 Rucha Bhalchandra Joshi , Subhankar Mishra

Differentiable simulators provide an avenue for closing the sim-to-real gap by enabling the use of efficient, gradient-based optimization algorithms to find the simulation parameters that best fit the observed sensor readings. Nonetheless,…

Robotics · Computer Science 2021-05-21 Eric Heiden , David Millard , Erwin Coumans , Yizhou Sheng , Gaurav S. Sukhatme

Constructing simulation scenes that are both visually and physically realistic is a problem of practical interest in domains ranging from robotics to computer vision. This problem has become even more relevant as researchers wielding large…

Autonomous driving simulation system plays a crucial role in enhancing self-driving data and simulating complex and rare traffic scenarios, ensuring navigation safety. However, traditional simulation systems, which often heavily rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Yurui Chen , Junge Zhang , Ziyang Xie , Wenye Li , Feihu Zhang , Jiachen Lu , Li Zhang

Neural rendering provides a fundamentally new way to render photorealistic images. Similar to traditional light-baking methods, neural rendering utilizes neural networks to bake representations of scenes, materials, and lights into latent…

Graphics · Computer Science 2024-05-30 Ziyang Zhang , Edgar Simo-Serra

Promising performance has been achieved for visual perception on the point cloud. However, the current methods typically rely on labour-extensive annotations on the scene scans. In this paper, we explore how synthetic models alleviate the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Runnan Chen , Xinge Zhu , Nenglun Chen , Dawei Wang , Wei Li , Yuexin Ma , Ruigang Yang , Wenping Wang

Online reconstructing and rendering of large-scale indoor scenes is a long-standing challenge. SLAM-based methods can reconstruct 3D scene geometry progressively in real time but can not render photorealistic results. While NeRF-based…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Yiming Gao , Yan-Pei Cao , Ying Shan

Recently simulation methods have been developed for optical tactile sensors to enable the Sim2Real learning, i.e., firstly training models in simulation before deploying them on the real robot. However, some artefacts in the real objects…

Robotics · Computer Science 2021-12-06 Tudor Jianu , Daniel Fernandes Gomes , Shan Luo