English
Related papers

Related papers: Using Abstract Tangible Proxy Objects for Interact…

200 papers

We introduce the notion of an Active Proxy interface, i.e. tangible models as proxies for physical data referents, supporting interactive exploration of data through active manipulation. We realise an active proxy data visualisation system,…

Human-Computer Interaction · Computer Science 2026-01-27 Shaozhang Dai , Kadek Ananta Satriadi , Jim Smiley , Barrett Ens , Lonni Besançon , Tim Dwyer

People's identities change during life transitions, e.g., studying abroad. They bring everyday objects that embody memories and reflect their identities during such moves. To assist in these transitions, we ask how people's human identities…

Human-Computer Interaction · Computer Science 2026-01-28 Yuhui Xu , Minha Lee , Stephan Wensveen , Mahla Alizadeh , Mathias Funk

Bridging the physical and digital world through interaction remains a core challenge in augmented reality (AR). Existing systems target single objects, limiting support for planning, comparison, and assembly tasks that depend on…

Human-Computer Interaction · Computer Science 2026-04-08 Xiaoan Liu , Eric J Gonzalez , Nels Numan , Andrea Colaço , Lucy Abramyan , Chen Zhu-Tian , Ryo Suzuki , Mar Gonzalez-Franco

Robots are increasingly capable of autonomous operations, yet human interaction remains essential for issuing personalized instructions. Instead of directly controlling robots through Programming by Demonstration (PbD) or teleoperation, we…

Human-Computer Interaction · Computer Science 2025-08-18 Lauren W. Wang , Parastoo Abtahi

In 3D user interfaces, reaching out to grab and manipulate something works great until it is out of reach. Indirect techniques like gaze and pinch offer an alternative for distant interaction, but do not provide the same immediacy or…

Human-Computer Interaction · Computer Science 2026-02-26 Yang Liu , Thorbjørn Mikkelsen , Zehai Liu , Gengchen Tian , Diako Mardanbegi , Qiushi Zhou , Hans Gellersen , Ken Pfeuffer

A proxy, in general, is an object mediating access to an arbitrary target object. The proxy is then intended to be used in place of the target object. Ideally, a proxy is not distinguishable from other objects. Running a program with a…

Programming Languages · Computer Science 2013-12-20 Matthias Keil , Peter Thiemann

Humans are highly skilled in communicating their intent for when and where a handover would occur. However, even the state-of-the-art robotic implementations for handovers typically lack of such communication skills. This study investigates…

Interactions play a key role in understanding objects and scenes, for both virtual and real world agents. We introduce a new general representation for proximal interactions among physical objects that is agnostic to the type of objects or…

During VR demos we have performed over last few years, many participants (in the absence of any haptic feedback) have commented on their perceived ability to 'feel' differences between simulated molecular objects. The mechanisms for such…

Human-Computer Interaction · Computer Science 2020-05-08 Rhoslyn Roebuck Williams , Xan Varcoe , Becca R. Glowacki , Ella M. Gale , Alexander Jamieson-Binnie , David R. Glowacki

Alignment between real and virtual objects is a challenging task required for the deployment of Mixed Reality (MR) into manufacturing, medical, and construction applications. To face this challenge, a series of methods have been proposed.…

Human-Computer Interaction · Computer Science 2022-11-17 Alejandro Martin-Gomez , Alexander Winkler , Rafael de la Tijera Obert , Javad Fotouhi , Daniel Roth , Ulrich Eck , Nassir Navab

Human interaction is essential for issuing personalized instructions and assisting robots when failure is likely. However, robots remain largely black boxes, offering users little insight into their evolving capabilities and limitations. To…

Human-Computer Interaction · Computer Science 2026-01-22 Lauren W. Wang , Mohamed Kari , Parastoo Abtahi

Virtual assistants (VAs) have become ubiquitous in daily life, integrated into smartphones and smart devices, sparking interest in AI companions that enhance user experiences and foster emotional connections. However, existing companions…

Human-Computer Interaction · Computer Science 2025-09-03 Xuetong Wang , Ching Christie Pang , Pan Hui

Today there is a high variety of haptic devices capable of providing tactile feedback. Although most of existing designs are aimed at realistic simulation of the surface properties, their capabilities are limited in attempts of displaying…

Robotics · Computer Science 2021-04-20 Aleksey Fedoseev , Nikita Chernyadev , Dzmitry Tsetserukou

A switchable virtual reality (VR), augmented reality (AR), and mixed reality (MR) system is proposed using digital optical cloaking. Optical cloaking allows completely opaque VR devices to be "cloaked," switching to AR or MR while providing…

Optics · Physics 2018-02-07 Joseph S. Choi

Deformable objects often appear in unstructured configurations. Tracing deformable objects helps bringing them into extended states and facilitating the downstream manipulation tasks. Due to the requirements for object-specific modeling or…

We present Virtual Elastic Objects (VEOs): virtual objects that not only look like their real-world counterparts but also behave like them, even when subject to novel interactions. Achieving this presents multiple challenges: not only do…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Hsiao-yu Chen , Edgar Tretschk , Tuur Stuyck , Petr Kadlecek , Ladislav Kavan , Etienne Vouga , Christoph Lassner

We propose a composite optical transformation to design an illusion device which can move the image of a target from one place to another place. Enclosed by such an illusion device, an arbitrary object located at one place appears to be at…

Optics · Physics 2009-09-30 Wei Xiang Jiang , Tie Jun Cui

As augmented reality technology and hardware become more mature and affordable, researchers have been exploring more intuitive and discoverable interaction techniques for immersive environments. In this paper, we investigate multimodal…

Human-Computer Interaction · Computer Science 2022-12-02 Xiaoyan Zhou , Adam S. Williams , Francisco R. Ortega

In this work, we address the issue of a virtual representation of objects of cultural heritage for haptic interaction. Our main focus is to provide haptic access to artistic objects of any physical scale to the differently-abled people.…

Multimedia · Computer Science 2020-10-08 Sreeni K. G , Priyadarshini K , Praseedha A. K , Subhasis Chaudhuri

In order to interact with objects in our environment, humans rely on an understanding of the actions that can be performed on them, as well as their properties. When considering concrete motor actions, this knowledge has been called the…

Computation and Language · Computer Science 2021-05-12 Ka Chun Lam , Francisco Pereira , Maryam Vaziri-Pashkam , Kristin Woodard , Emalie McMahon