English
Related papers

Related papers: Building Audio-Visual Digital Twins with Smartphon…

200 papers

Digital Twins represent a new and disruptive technology, where digital replicas of (cyber)-physical systems operate for long periods of time alongside their (cyber)-physical counterparts, with enabled bi-directional communication between…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-18 Henrik Ejersbo , Kenneth Lausdahl , Mirgita Frasheri , Lukas Esterle

Given only a few glimpses of an environment, how much can we infer about its entire floorplan? Existing methods can map only what is visible or immediately apparent from context, and thus require substantial movements through a space to…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Senthil Purushwalkam , Sebastian Vicenc Amengual Gari , Vamsi Krishna Ithapu , Carl Schissler , Philip Robinson , Abhinav Gupta , Kristen Grauman

The proliferation of electronic devices has greatly transformed every aspect of human life, such as communication, healthcare, transportation, and energy. Unfortunately, the global electronics supply chain is vulnerable to various attacks,…

Cryptography and Security · Computer Science 2025-09-15 Blessing Airehenbuwa , Touseef Hasan , Souvika Sarkar , Ujjwal Guin

Digital Twins (DTs) are computational models that simulate the states and temporal dynamics of real-world systems, playing a crucial role in prediction, understanding, and decision-making across diverse domains. However, existing approaches…

Machine Learning · Computer Science 2024-11-01 Samuel Holt , Tennison Liu , Mihaela van der Schaar

Soft continuum arms (SCAs) promise versatile manipulation through mechanical compliance, for assistive devices, agriculture, search applications, or surgery. However, the strong nonlinear coupling between materials, morphology, and…

This paper explores a novel research direction where a digital twin is leveraged to assist the beamforming design for an integrated sensing and communication (ISAC) system. In this setup, a base station designs joint communication and…

Signal Processing · Electrical Eng. & Systems 2024-12-11 Shuaifeng Jiang , Ahmed Alkhateeb

The concept of creating digital twins, connected digital models of physical systems, is gaining increasing attention for modeling and simulation of whole cities. The basis for building a digital twin of a city is the generation of a 3D city…

Graphics · Computer Science 2022-10-12 Vasilis Naserentin , Anders Logg

In order to improve the task execution capability of home service robot, and to cope with the problem that purely physical robot platforms cannot sense the environment and make decisions online, a method for building digital twin system for…

Robotics · Computer Science 2023-09-13 Zhengsong Jiang , Guohui Tian , Yongcheng Cui , Tiantian Liu , Yu Gu , Yifei Wang

The development of technology biometrics becomes crucial more. To define human characteristic biometric systems are used but because of inability of traditional biometric systems to recognize twins, multimodal biometric systems are…

Computer Vision and Pattern Recognition · Computer Science 2018-01-30 Cihan Akin , Umit Kacar , Murvet Kirci

Audio-video generation has often relied on complex multi-stage architectures or sequential synthesis of sound and visuals. We introduce Ovi, a unified paradigm for audio-video generation that models the two modalities as a single generative…

Multimedia · Computer Science 2025-10-03 Chetwin Low , Weimin Wang , Calder Katyal

Motivated by climate change, increasing industrialization and energy reliability concerns, the smart grid is set to revolutionize traditional power systems. Moreover, the exponential annual rise in number of grid-connected users and…

Networking and Internet Architecture · Computer Science 2023-08-03 Abdullah Othman , Georges Kaddoum , Joao V. C. Evangelista , Minh Au , Basile L. Agba

Acoustic metamaterials are artificial structures, often lattice of resonators, with unusual properties. They can be engineered to stop wave propagation in specific frequency bands. Once manufactured, their dispersive qualities remain…

Applied Physics · Physics 2024-08-20 Thomas Daunizeau , Sinan Haliyo , David Gueorguiev , Vincent Hayward

In this decade, the amount of (industrial) Internet of Things devices will increase tremendously. Today, there exist no common standards for interconnection, observation, or the monitoring of these devices. In context of the German…

Software Engineering · Computer Science 2021-03-18 Alexander Barbie , Wilhelm Hasselbring , Niklas Pech , Stefan Sommer , Sascha Flögel , Frank Wenzhöfer

Wireless digital twins require repeated synchronization between a time-evolving physical scene and its digital counterpart under limited and time-varying communication resources. For perception-centric twins, pixel-domain transmission or…

Image and Video Processing · Electrical Eng. & Systems 2026-05-27 Sige Liu , Kezhi Wang

LiDAR-based perception in intelligent transportation systems (ITS) relies on deep neural networks trained with large-scale labeled datasets. However, creating such datasets is expensive, time-consuming, and labor-intensive, limiting the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Muhammad Shahbaz , Shaurya Agarwal

Training effective artificial intelligence models for telecommunications is challenging due to the scarcity of deployment-specific data. Real data collection is expensive, and available datasets often fail to capture the unique operational…

Signal Processing · Electrical Eng. & Systems 2026-05-28 Clement Ruah , Houssem Sifaou , Osvaldo Simeone , Bashir M. Al-Hashimi

Audiovisual speech synthesis is the problem of synthesizing a talking face while maximizing the coherency of the acoustic and visual speech. In this paper, we propose and compare two audiovisual speech synthesis systems for 3D face models.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-31 Ahmed Hussen Abdelaziz , Anushree Prasanna Kumar , Chloe Seivwright , Gabriele Fanelli , Justin Binder , Yannis Stylianou , Sachin Kajarekar

Medical imaging has played a pivotal role in advancing and refining digital twin technology, allowing for the development of highly personalized virtual models that represent human anatomy and physiological functions. A key component in…

Medical Physics · Physics 2024-11-14 Feng Zhao , Yizhou Wu , Mingzhe Hu , Chih-Wei Chang , Ruirui Liu , Richard Qiu , Xiaofeng Yang

A Digital Twin (DT) is a virtual replica of a physical object or system, created to monitor, analyze, and optimize its behavior and characteristics. A Spatial Digital Twin (SDT) is a specific type of digital twin that emphasizes the…

Computers and Society · Computer Science 2023-06-13 Mohammed Eunus Ali , Muhammad Aamir Cheema , Tanzima Hashem , Anwaar Ulhaq , Muhammad Ali Babar

We introduce real-is-sim, a new approach to integrating simulation into behavior cloning pipelines. In contrast to real-only methods, which lack the ability to safely test policies before deployment, and sim-to-real methods, which require…