English
Related papers

Related papers: Augmented Object Intelligence with XR-Objects

200 papers

We introduce Orion, a visual agent that integrates vision-based reasoning with tool-augmented execution to achieve powerful, precise, multi-step visual intelligence across images, video, and documents. Unlike traditional vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 N Dinesh Reddy , Dylan Snyder , Lona Kiragu , Mirajul Mohin , Shahrear Bin Amin , Sudeep Pillai

With the surge in IoT devices ranging from wearables to smart homes, prompt transmission is crucial. The Age of Information (AoI) emerges as a critical metric in this context, representing the freshness of the information transmitted across…

Computers and Society · Computer Science 2025-05-06 Aymen Hamrouni , Sofie Pollin , Hazem Sallouha

During remote communication, participants often share both digital and physical content, such as product designs, digital assets, and environments, to enhance mutual understanding. Recent advances in augmented communication have facilitated…

Human-Computer Interaction · Computer Science 2024-10-10 Erzhen Hu , Mingyi Li , Jungtaek Hong , Xun Qian , Alex Olwal , David Kim , Seongkook Heo , Ruofei Du

Vision-based Interfaces (VIs) are pivotal in advancing Human-Computer Interaction (HCI), particularly in enhancing context awareness. However, there are significant opportunities for these interfaces due to rapid advancements in multimodal…

Human-Computer Interaction · Computer Science 2024-08-15 Yongquan Hu , Wen Hu , Aaron Quigley

The integration of extended reality (XR) with artificial intelligence (AI) introduces a new paradigm for user interaction, enabling AI to perceive user intent, stimulate the senses, and influence decision-making. We explored the impact of…

Human-Computer Interaction · Computer Science 2025-07-16 Ze Dong , Binyang Han , Jingjing Zhang , Ruoyu Wen , Barrett Ens , Adrian Clark , Tham Piumsomboon

With the widespread adoption of Extended Reality (XR) headsets, spatial computing technologies are gaining increasing attention. Spatial computing enables interaction with virtual elements through natural input methods such as eye tracking,…

Human-Computer Interaction · Computer Science 2025-06-16 Zhimin Wang , Maohang Rao , Shanghua Ye , Weitao Song , Feng Lu

Future fully interconnected virtual reality (VR) systems and the Tactile Internet diminish the boundary between virtual (online) and real (offline) worlds, while extending the digital and physical capabilities of humans via edge computing…

Networking and Internet Architecture · Computer Science 2019-06-18 Martin Maier , Amin Ebrahimzadeh

In the Internet of Things (IoT) era, billions of sensors and devices collect and process data from the environment, transmit them to cloud centers, and receive feedback via the internet for connectivity and perception. However, transmitting…

Artificial Intelligence · Computer Science 2020-11-18 Jing Zhang , Dacheng Tao

An in-depth exploration of object detection and semantic segmentation is provided, combining theoretical foundations with practical applications. State-of-the-art advancements in machine learning and deep learning are reviewed, focusing on…

The Internet of Things (IoT) network integrating billions of smart physical devices embedded with sensors, software, and communication technologies is a critical and rapidly expanding component of our modern world. The IoT ecosystem…

Machine Learning · Computer Science 2024-07-16 Shentong Mo , Russ Salakhutdinov , Louis-Philippe Morency , Paul Pu Liang

Exploring new knowledge is a fundamental human ability that can be mirrored in the development of deep neural networks, especially in the field of object detection. Open world object detection (OWOD) is an emerging area of research that…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Yiming Li , Yi Wang , Wenqian Wang , Dan Lin , Bingbing Li , Kim-Hui Yap

Detecting spliced images is one of the emerging challenges in computer vision. Unlike prior methods that focus on detecting low-level artifacts generated during the manipulation process, we use an image retrieval approach to tackle this…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Bor-Chun Chen , Zuxuan Wu , Larry S. Davis , Ser-Nam Lim

Building embodied intelligent agents that can interact with 3D indoor environments has received increasing research attention in recent years. While most works focus on single-object or agent-object visual functionality and affordances, our…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Qi Li , Kaichun Mo , Yanchao Yang , Hang Zhao , Leonidas Guibas

Improving object manipulation skills through hand-object interaction exercises is crucial for rehabilitation. Despite limited healthcare resources, physical therapists propose remote exercise routines followed up by remote monitoring.…

Human-Computer Interaction · Computer Science 2023-12-13 Trudi Di Qi , LouAnne Boyd , Scott Fitzpatrick , Meghna Raswan , Farnceli Cibrian

The Human-Object Interaction (HOI) task explores the dynamic interactions between humans and objects in physical environments, providing essential biomechanical and cognitive-behavioral foundations for fields such as robotics, virtual…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Ruiyan Wang , Lin Zuo , Zonghao Lin , Qiang Wang , Zhengxue Cheng , Rong Xie , Jun Ling , Li Song

Learning 3D human-object interaction relation is pivotal to embodied AI and interaction modeling. Most existing methods approach the goal by learning to predict isolated interaction elements, e.g., human contact, object affordance, and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Yuhang Yang , Wei Zhai , Hongchen Luo , Yang Cao , Zheng-Jun Zha

As a consequence of an ever-increasing number of service robots, there is a growing demand for highly accurate real-time 3D object recognition. Considering the expansion of robot applications in more complex and dynamic environments,it is…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Nils Keunecke , S. Hamidreza Kasaei

This paper presents an interaction model adapted to mixed reality environments known as IRVO (Interacting with Real and Virtual Objects). IRVO aims at modeling the interaction between one or more users and the Mixed Reality system by…

Human-Computer Interaction · Computer Science 2007-07-11 René Chalon , Bertrand T. David

Fine-grained capturing of 3D HOI boosts human activity understanding and facilitates downstream visual tasks, including action recognition, holistic scene reconstruction, and human motion synthesis. Despite its significance, existing works…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Nan Jiang , Tengyu Liu , Zhexuan Cao , Jieming Cui , Zhiyuan zhang , Yixin Chen , He Wang , Yixin Zhu , Siyuan Huang

Content sharing across multiple Augmented Reality (AR) displays is becoming commonplace, enhancing team communication and collaboration through devices like smartphones and AR glasses. However, this practice raises significant privacy…

Human-Computer Interaction · Computer Science 2025-01-24 Yongquan Hu , Dongsheng Zheng , Kexin Nie , Junyan Zhang , Wen Hu , Aaron Quigley