English
Related papers

Related papers: Multimodality in VR: A survey

200 papers

This literature review investigates the transformative potential of mixed reality (MR) technology, where we explore the intersection of contemporary technological advancements, modern deep learning recommendation systems, and social…

Human-Computer Interaction · Computer Science 2024-04-29 Sparsh Srivastava

Virtual reality (VR) is increasingly used as a platform for social interaction, including as a means for older adults to maintain engagement. However, there has been limited research to examine the features of social VR that are most…

Human-Computer Interaction · Computer Science 2022-10-10 Tong Bill Xu , Armin Mostafavi , Benjamin Kim , Angella Lee , Walter Boot , Sara Czaja , Saleh Kalantari

Deep Learning has implemented a wide range of applications and has become increasingly popular in recent years. The goal of multimodal deep learning (MMDL) is to create models that can process and link information using various modalities.…

Machine Learning · Computer Science 2022-02-21 Jabeen Summaira , Xi Li , Amin Muhammad Shoib , Jabbar Abdul

Multimodal learning, a rapidly evolving field in artificial intelligence, seeks to construct more versatile and robust systems by integrating and analyzing diverse types of data, including text, images, audio, and video. Inspired by the…

Artificial Intelligence · Computer Science 2024-12-24 Priyaranjan Pattnayak , Hitesh Laxmichand Patel , Bhargava Kumar , Amit Agarwal , Ishan Banerjee , Srikant Panda , Tejaswini Kumar

Multimodal learning has been a field of increasing interest, aiming to combine various modalities in a single joint representation. Especially in the area of visiolinguistic (VL) learning multiple models and techniques have been developed,…

Machine Learning · Computer Science 2024-03-26 Maria Lymperaiou , Giorgos Stamou

This systematic review explores the viability of virtual reality (VR) technologies for enhancing learning outcomes and operational efficiency within the construction industry. This study evaluates the current integration of VR in…

Computers and Society · Computer Science 2024-08-06 Zia Ud Din , Payam Mohammadi , Rachael Sherman

Virtual reality is expected to play a significant role in the transformation of education and psychological studies. The possibilities for its application as a visual research method can be enhanced as established frameworks and toolkits…

Human-Computer Interaction · Computer Science 2023-10-24 Corrie Green , Chloë Farr , Yang Jiang

Virtual reality (VR) is increasingly used to enhance the ecological validity of motor control and learning studies by providing immersive, interactive environments with precise motion tracking. However, designing realistic VR-based motor…

Quantitative Methods · Quantitative Biology 2025-05-01 Cristina Rossi , Rini Varghese , Amy J Bastian

Although extended reality technologies have enjoyed an explosion in popularity in recent years, few applications are effectively used outside the entertainment or academic contexts. This work consists of a literature review regarding the…

Human-Computer Interaction · Computer Science 2023-12-04 Nuno Verdelho Trindade , Alfredo Ferreira , João Madeiras Pereira

To address the shortage of a skilled workforce in the U.S. manufacturing industry, immersive Virtual Reality (VR)-based training solutions hold promising potential. To effectively utilize VR to meet workforce demands, it is important to…

The integration of Large Language Models (LLMs) into Virtual Reality (VR) games marks a paradigm shift in the design of immersive, adaptive, and intelligent digital experiences. This paper presents a comprehensive review of recent research…

Human-Computer Interaction · Computer Science 2025-11-24 Süeda Özkaya , Santiago Berrezueta-Guzman , Stefan Wagner

Transformer is a promising neural network learner, and has achieved great success in various machine learning tasks. Thanks to the recent prevalence of multimodal applications and big data, Transformer-based multimodal learning has become a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Peng Xu , Xiatian Zhu , David A. Clifton

Multimodal recommendation systems are increasingly popular for their potential to improve performance by integrating diverse data types. However, the actual benefits of this integration remain unclear, raising questions about when and how…

Information Retrieval · Computer Science 2025-08-08 Hongyu Zhou , Yinan Zhang , Aixin Sun , Zhiqi Shen

The advent of personalized reality has arrived. Rapid development in AR/MR/VR enables users to augment or diminish their perception of the physical world. Robust tooling for digital interface modification enables users to change how their…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Siddhartha Datta

Virtual reality (VR) is increasingly being used as a research platform for investigating human responses to environmental variables. While VR provides tremendous advantages in terms of variable isolation and manipulation, and ease of…

Human-Computer Interaction · Computer Science 2023-08-31 Saleh Kalantari , Bill Tong Xu , Armin Mostafavi , Anne Seoyoung Lee , Qi Yang

Measure user experience in MR (i.e., AR/VR) user studies is essential. Researchers apply a wide range of measuring methods using objective (e.g., biosignals, time logging), behavioral (e.g., gaze direction, movement amplitude), and…

Virtual reality (VR) is increasingly used as a social platform for users to interact and build connections with one another in an immersive virtual environment. Reflecting on the empirical progress in this area of study, a comprehensive…

Human-Computer Interaction · Computer Science 2024-10-17 Xiaoying Wei , Xiaofu Jin , Ge Lin Kan , Yukang Yan , Mingming Fan

The recent surge in artificial intelligence, particularly in multimodal processing technology, has advanced human-computer interaction, by altering how intelligent systems perceive, understand, and respond to contextual information (i.e.,…

Virtual reality (VR) introduces sensory perturbations that may impact perception and action. The current study was designed to investigate how immersive VR presented through a head-mounted display (HMD) affects perceived functional body…

Human-Computer Interaction · Computer Science 2025-10-02 Xiaoye Michael Wang , Ali Mazalek , Catherine M. Sabiston , Timothy N. Welsh

With the advancement of virtual reality (VR) technology, virtual displays have become integral to how museums, galleries, and other tourist destinations present their collections to the public. However, the current lack of immersion in…

Human-Computer Interaction · Computer Science 2023-04-06 Simin Yang , Ze Gao , Reza Hadi Mogavi , Pan Hui , Tristan Braud