English
Related papers

Related papers: NeuralOS: Towards Simulating Operating Systems via…

200 papers

Simulation is a crucial component of any robotic system. In order to simulate correctly, we need to write complex rules of the environment: how dynamic agents behave, and how the actions of each of the agents affect the behavior of others.…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Seung Wook Kim , Yuhao Zhou , Jonah Philion , Antonio Torralba , Sanja Fidler

Numerical simulation is a predominant tool for studying the dynamics in complex systems, but large-scale simulations are often intractable due to computational limitations. Here, we introduce the Neural Graph Simulator (NGS) for simulating…

Machine Learning · Computer Science 2024-11-15 Hoyun Choi , Sungyeop Lee , B. Kahng , Junghyo Jo

We introduce GausSim, a novel neural network-based simulator designed to capture the dynamic behaviors of real-world elastic objects represented through Gaussian kernels. We leverage continuum mechanics and treat each kernel as a Center of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Yidi Shao , Mu Huang , Chen Change Loy , Bo Dai

The topic of provable deep neural network robustness has raised considerable interest in recent years. Most research has focused on adversarial robustness, which studies the robustness of perceptive models in the neighbourhood of particular…

Machine Learning · Computer Science 2019-11-26 Julien Girard-Satabin , Guillaume Charpiat , Zakaria Chihani , Marc Schoenauer

Simulating dynamic physical interactions is a critical challenge across multiple scientific domains, with applications ranging from robotics to material science. For mesh-based simulations, Graph Network Simulators (GNSs) pose an efficient…

Machine Learning · Computer Science 2023-11-10 Philipp Dahlinger , Niklas Freymuth , Michael Volpp , Tai Hoang , Gerhard Neumann

Augmented reality applications have rapidly spread across online platforms, allowing consumers to virtually try-on a variety of products, such as makeup, hair dying, or shoes. However, parametrizing a renderer to synthesize realistic images…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Robin Kips , Ruowei Jiang , Sileye Ba , Brendan Duke , Matthieu Perrot , Pietro Gori , Isabelle Bloch

User simulation is an emerging interdisciplinary topic with multiple critical applications in the era of Generative AI. It involves creating an intelligent agent that mimics the actions of a human user interacting with an AI system,…

Artificial Intelligence · Computer Science 2026-04-22 Krisztian Balog , ChengXiang Zhai

In this paper, we have used Recurrent Neural Networks to capture and model human motion data and generate motions by prediction of the next immediate data point at each time-step. Our RNN is armed with recently proposed Gated Recurrent…

Neural and Evolutionary Computing · Computer Science 2015-01-05 Mohammad Pezeshki

This paper presents HyperGraphOS, an innovative Operating System designed for the scientific and engineering domains. It combines model based engineering, graph modeling, data containers, and computational tools, offering users a dynamic…

Artificial Intelligence · Computer Science 2024-12-09 Antonello Ceravola , Frank Joublin , Ahmed R. Sadik , Bram Bolder , Juha-Pekka Tolvanen

Amazing progress has been made in controllable generative modeling, especially over the last few years. However, some challenges remain. One of them is precise and iterative object editing. In many of the current methods, trying to edit the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Alejandro Escontrela , Shrinu Kushagra , Sjoerd van Steenkiste , Yulia Rubanova , Aleksander Holynski , Kelsey Allen , Kevin Murphy , Thomas Kipf

This study introduces an advanced gesture recognition and user interface (UI) interaction system powered by deep learning, highlighting its transformative impact on UI design and functionality. By utilizing optimized convolutional neural…

Human-Computer Interaction · Computer Science 2024-11-26 Qi Sun , Tong Zhang , Shang Gao , Liuqingqing Yang , Fenghua Shao

Neural networks have recently become good at engaging in dialog. However, current approaches are based solely on verbal text, lacking the richness of a real face-to-face conversation. We propose a neural conversation model that aims to read…

Computer Vision and Pattern Recognition · Computer Science 2018-12-05 Hang Chu , Daiqing Li , Sanja Fidler

We present a new point-based approach for modeling the appearance of real scenes. The approach uses a raw point cloud as the geometric representation of a scene, and augments each point with a learnable neural descriptor that encodes local…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Kara-Ali Aliev , Artem Sevastopolsky , Maria Kolos , Dmitry Ulyanov , Victor Lempitsky

Human-computer interaction has long imagined technology that understands us-from our preferences and habits, to the timing and purpose of our everyday actions. Yet current user models remain fragmented, narrowly tailored to specific apps,…

Human-Computer Interaction · Computer Science 2025-09-23 Omar Shaikh , Shardul Sapkota , Shan Rizvi , Eric Horvitz , Joon Sung Park , Diyi Yang , Michael S. Bernstein

Recent advances in garment simulation have brought high-quality results closer to real-time performance. Physics-based simulators can produce accurate motion, but remain too computationally expensive for interactive applications. In…

The design of neural architectures for structured objects is typically guided by experimental insights rather than a formal process. In this work, we appeal to kernels over combinatorial structures, such as sequences and graphs, to derive…

Neural and Evolutionary Computing · Computer Science 2017-10-31 Tao Lei , Wengong Jin , Regina Barzilay , Tommi Jaakkola

User simulators (USs) are commonly used to train task-oriented dialogue systems (DSs) via reinforcement learning. The interactions often take place on semantic level for efficiency, but there is still a gap from semantic actions to natural…

Computation and Language · Computer Science 2022-08-24 Hsien-Chin Lin , Christian Geishauser , Shutong Feng , Nurul Lubis , Carel van Niekerk , Michael Heck , Milica Gašić

We propose a neural network model of multi-neuron interacting system that simulates neurons to interact each other through the surroundings of neuronal cell bodies. We physically model the neuronal cell surroundings, include the dendrites,…

Neurons and Cognition · Quantitative Biology 2021-07-05 Yu-Juan Sun , Wei-Min Zhang

To improve the experiences of face-to-face conversation with avatar, this paper presents a novel conversation system. It is composed of two sequence-to-sequence models respectively for listening and speaking and a Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2019-08-22 Zezhou Chen , Zhaoxiang Liu , Huan Hu , Jinqiang Bai , Shiguo Lian , Fuyuan Shi , Kai Wang

In the area of physical simulations, nearly all neural-network-based methods directly predict future states from the input states. However, many traditional simulation engines instead model the constraints of the system and select the state…

Machine Learning · Computer Science 2022-01-31 Yulia Rubanova , Alvaro Sanchez-Gonzalez , Tobias Pfaff , Peter Battaglia