English
Related papers

Related papers: Multimodality in VR: A survey

200 papers

This paper provided empirical knowledge of the user experience for using collaborative visualization in a distributed asymmetrical setting through controlled user studies. With the ability to access various computing devices, such as…

Human-Computer Interaction · Computer Science 2023-02-07 Wai Tong , Meng Xia , Kam Kwai Wong , Doug A. Bowman , Ting-Chuen Pong , Huamin Qu , Yalong Yang

To fill the lack of research efforts in virtual assembly of modules and training, this paper presents a virtual manipulation of building objects in an Immersive Virtual Environment (IVE). A worker wearing a Virtual Reality (VR) head-mounted…

Computers and Society · Computer Science 2019-02-15 Mojtaba Noghabaei , Khashayar Asadi , Kevin Han

Multimodal sentiment analysis has become an important research area in the field of artificial intelligence. With the latest advances in deep learning, this technology has reached new heights. It has great potential for both application and…

Computation and Language · Computer Science 2023-07-06 Songning Lai , Xifeng Hu , Haoxuan Xu , Zhaoxia Ren , Zhi Liu

Virtual reality (VR) is a multibillionaire market that keeps growing, year after year. As VR is becoming prevalent in households and small businesses, it is critical to address the effects that this technology might have on the privacy and…

Cryptography and Security · Computer Science 2024-12-24 Alberto Giaretta

Users readily embrace the rapid advancements in virtual reality (VR) technology within various everyday contexts, such as gaming, social interactions, shopping, and commerce. In order to facilitate transactions and payments, VR systems…

Cryptography and Security · Computer Science 2023-06-06 Jingjie Li , Sunpreet Singh Arora , Kassem Fawaz , Younghyun Kim , Can Liu , Sebastian Meiser , Mohsen Minaei , Maliheh Shirvanian , Kim Wagner

Evaluating the user experience of a software system is an essential final step of every research. Several concepts such as flow, affective state, presences, or immersion exist to measure user experience. Typical measurement techniques…

Human-Computer Interaction · Computer Science 2021-04-14 Tobias Drey , Michael Rietzler , Enrico Rukzio

Virtual Reality (VR) techniques, serving as the bridge between the real and virtual worlds, have boomed and are widely used in manufacturing, remote healthcare, gaming, etc. Specifically, VR systems offer users immersive experiences that…

Cryptography and Security · Computer Science 2026-05-26 Yancheng Jiang , Yan Jiang , Ruochen Zhou , Yi-Chao Chen , Xiaoyu Ji , Wenyuan Xu

Virtual Reality (VR), Augmented Reality (AR), Mixed Reality (MR), digital twin, Metaverse and other related digital technologies have attracted much attention in recent years. These new emerging technologies are changing the world…

Artificial Intelligence · Computer Science 2023-05-18 Hao Lan Zhang , Yun Xue , Yifan Lu , Sanghyuk Lee

As Mixed Reality (MR) devices become increasingly popular across industries, they raise significant privacy and ethical concerns due to their capacity to collect extensive data on users and their environments. This paper highlights the…

Human-Computer Interaction · Computer Science 2024-09-04 Marvin Strauss , Viktorija Paneva , Florian Alt , Stefan Schneegass

Virtual reality (VR) offers immersive visualization and intuitive interaction. We leverage VR to enable any biomedical professional to deploy a deep learning (DL) model for image classification. While DL models can be powerful tools for…

Machine Learning · Computer Science 2022-06-22 Kevin C. VanHorn , Meyer Zinn , Murat Can Cobanoglu

This survey provides a comprehensive overview of recent advances in multimodal alignment and fusion within the field of machine learning, driven by the increasing availability and diversity of data modalities such as text, images, audio,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Songtao Li , Hao Tang

Automatic emotion recognition has become increasingly important with the rise of AI, especially in fields like healthcare, education, and automotive systems. However, there is a lack of multimodal datasets, particularly involving body…

Artificial Intelligence · Computer Science 2025-09-09 Seyed Muhammad Hossein Mousavi , Atiye Ilanloo

Our experience of the world is multisensory, spanning a synthesis of language, sight, sound, touch, taste, and smell. Yet, artificial intelligence has primarily advanced in digital modalities like text, vision, and audio. This paper…

Machine Learning · Computer Science 2026-01-14 Paul Pu Liang

Nowadays, Mixed Reality (MR) headsets are a game-changer for knowledge work. Unlike stationary monitors, MR headsets allow users to work with large virtual displays anywhere they wear the headset, whether in a professional office, a public…

Human-Computer Interaction · Computer Science 2024-10-08 Janne Kaeder , Maurizio Vergari , Verena Biener , Tanja Kojić , Jens Grubert , Sebastian Möller , Jan-Niklas Voigt-Antons

We are living in the era of big data. The Metaverse is an emerging technology in the future, and it has a combination of big data, AI (artificial intelligence), VR (Virtual Reality), AR (Augmented Reality), MR (mixed reality), and other…

Databases · Computer Science 2022-10-31 Jiayi Sun , Wensheng Gan , Zefeng Chen , Junhui Li , Philip S. Yu

Forest bathing is a nature immersion practice that reduces stress, restores mental resources, and has a wide variety of use cases in the treatment of mental illnesses. Since many people who need the benefits of forest bathing have little…

Human-Computer Interaction · Computer Science 2023-09-06 Rachel Masters , Francisco Ortega , Victoria Interrante

Human-machine interaction has been around for several decades now, with new applications emerging every day. One of the major goals that remain to be achieved is designing an interaction similar to how a human interacts with another human.…

Human-Computer Interaction · Computer Science 2022-12-27 Tauheed Khan Mohd , Nicole Nguyen , Ahmad Y Javaid

The rise of Multimodal Large Language Models (MLLMs) has become a transformative force in the field of artificial intelligence, enabling machines to process and generate content across multiple modalities, such as text, images, audio, and…

Computation and Language · Computer Science 2025-12-09 Ming Li , Keyu Chen , Ziqian Bi , Ming Liu , Xinyuan Song , Zekun Jiang , Tianyang Wang , Benji Peng , Qian Niu , Junyu Liu , Jinlang Wang , Sen Zhang , Xuanhe Pan , Jiawei Xu , Pohsun Feng

Human perception of the empirical world involves recognizing the diverse appearances, or 'modalities', of underlying objects. Despite the longstanding consideration of this perspective in philosophy and cognitive science, the study of…

Machine Learning · Computer Science 2023-12-19 Zhou Lu

The exploration of multimodal language models integrates multiple data types, such as images, text, language, audio, and other heterogeneity. While the latest large language models excel in text-based tasks, they often struggle to…

Artificial Intelligence · Computer Science 2023-11-23 Jiayang Wu , Wensheng Gan , Zefeng Chen , Shicheng Wan , Philip S. Yu