English
Related papers

Related papers: Multimodality in VR: A survey

200 papers

Communication is the most useful tool to impart knowledge, understand ideas, clarify thoughts and expressions, organize plan and manage every single day-to-day activity. Although there are different modes of communication, physical barrier…

Computer Vision and Pattern Recognition · Computer Science 2019-09-23 Kumar Mridul , M. Ramanathan , Kunal Ahirwar , Mansi Sharma

In this poster, we present RealityDrop, a novel multimodal framework that uses Mixed Reality (MR) technology to manipulate, display, and transfer virtual content across different display systems. Employing MR as the centre of control,…

Human-Computer Interaction · Computer Science 2023-10-12 Jeremy McDade , Allison Jing , Andrew Cunningham

Multimodal interaction has been increasingly considered in designing visualization authoring tools. However, multimodal interaction has a broad meaning in visualization authoring, according to our literature review. Although some previous…

Human-Computer Interaction · Computer Science 2025-09-12 Astrid van den Brandt , Sehi L'Yi , Huyen N. Nguyen , Anna Vilanova , Nils Gehlenborg

Naturally, humans use multiple modalities to convey information. The modalities are processed both sequentially and in parallel for communication in the human brain, this changes when humans interact with computers. Empowering computers…

Human-Computer Interaction · Computer Science 2020-06-09 Muhammad Zeeshan Baig , Manolya Kavakli

As humans, we experience the world with all our senses or modalities (sound, sight, touch, smell, and taste). We use these modalities, particularly sight and touch, to convey and interpret specific meanings. Multimodal expressions are…

Machine Learning · Computer Science 2022-05-17 Anirudh Sundar , Larry Heck

Mixed Reality (MR) is an evolving technology lying in the continuum spanned by related technologies such as Virtual Reality (VR) and Augmented Reality (AR), and creates an exciting way of interacting with people and the environment. This…

Human-Computer Interaction · Computer Science 2022-07-21 Hung-Jui Guo , Balakrishnan Prabhakaran

The potential of virtual reality (VR) to contribute to drug design and development has been recognised for many years. Hardware and software developments now mean that this potential is beginning to be realised, and VR methods are being…

Biomolecules · Quantitative Biology 2022-02-09 Rebecca K. Walters , Ella M. Gale , Jonathan Barnoud , David R. Glowacki , Adrian J. Mulholland

Human cognition significantly influences expressed behavior and is intrinsically tied to authentic personality traits. Personality assessment plays a pivotal role in various fields, including psychology, education, social media, etc.…

Human-Computer Interaction · Computer Science 2024-07-30 Xintong Zhang , Di Lu , Huiqi Hu , Nan Jiang , Xianhao Yu , Jinan Xu , Yujia Peng , Qing Li , Wenjuan Han

Seamless integration of virtual and physical worlds in augmented reality benefits from the system semantically "understanding" the physical environment. AR research has long focused on the potential of context awareness, demonstrating novel…

Human-Computer Interaction · Computer Science 2024-10-08 Chengyuan Xu , Radha Kumaran , Noah Stier , Kangyou Yu , Tobias Höllerer

Deep Learning and its applications have cascaded impactful research and development with a diverse range of modalities present in the real-world data. More recently, this has enhanced research interests in the intersection of the Vision and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Shagun Uppal , Sarthak Bhagat , Devamanyu Hazarika , Navonil Majumdar , Soujanya Poria , Roger Zimmermann , Amir Zadeh

The metaverse has awakened users' expectations of an immersive interaction that fuses the virtual digital world and the physical world across space and time. However, the metaverse is still in its infancy, typically expanding multi-player…

Multimedia · Computer Science 2022-10-14 Yakun Huang , Xiuquan Qiao , Haowen Wang , Xiang Su , Schahram Dustdar , Ping Zhang

Hand tracking has become an integral feature of recent generations of immersive virtual reality head-mounted displays. With the widespread adoption of this feature, hardware engineers and software developers are faced with an exciting array…

Human-Computer Interaction · Computer Science 2021-03-30 Gavin Buckingham

The ability to regulate and cope with strong emotions is essential for maintaining our mental health and well-being. However, learning how to emotionally regulate can be a bit of a mystery since it is largely an invisible process and it can…

Human-Computer Interaction · Computer Science 2022-12-02 Alexandra Kitson

In this position paper, we aim to spark more discussions surrounding the use of empathy as the intended outcome of many studies on immersive virtual reality experiences. As a construct, empathy has many significant flaws that may lead to…

Human-Computer Interaction · Computer Science 2021-09-10 Ken Jen Lee , Edith Law

Virtual Reality (VR) has become more and more popular with dropping prices for systems and a growing number of users. However, the issue of accessibility in VR has been hardly addressed so far and no uniform approach or standard exists at…

Computers and Society · Computer Science 2021-06-02 Felix J. Thiel , Anthony Steed

With the proliferation of VR and a metaverse on the horizon, many multi-user activities are migrating to the VR world, calling for effective collaboration support. As one key feature, traditional collaborative systems provide users with…

Human-Computer Interaction · Computer Science 2024-03-19 Julian Rasch , Florian Perzl , Yannick Weiss , Florian Müller

Mixed reality (MR) environments provide great value in displaying 3D virtual content. Systems facilitating co-located multiuser MR (Co-MUMR) experiences allow multiple users to co-present in a shared immersive virtual environment with…

Human-Computer Interaction · Computer Science 2025-01-07 Zhongyuan Yu , Daniel Zeidler , Krishnan Chandran , Lars Engeln , Kelsang Mende , Matthew McGinity

Attitudes about artificial intelligence and machine learning are recent victims of endemic misunderstanding; given our increasing reliance on these technologies, the need for widespread understanding and confidence in their use is…

Graphics · Computer Science 2026-05-04 Bokang Wang , Yingxuan Liao , Leah Lee , Jack Wesson , Anlan Yang , Ruizi Wang , Yigang Wen

Deep learning methods have revolutionized speech recognition, image recognition, and natural language processing since 2010. Each of these tasks involves a single modality in their input signals. However, many applications in the artificial…

Artificial Intelligence · Computer Science 2020-07-15 Chao Zhang , Zichao Yang , Xiaodong He , Li Deng

VR has recently been promoted as a tool for knowledge workers and studies have shown that it has the potential to improve knowledge work. However, studies on its prolonged use have been scarce. A prior study compared working in VR for one…