English
Related papers

Related papers: The Boombox: Visual Reconstruction from Acoustic V…

200 papers

Sonar-based indoor mapping systems have been widely employed in robotics for several decades. While such systems are still the mainstream in underwater and pipe inspection settings, the vulnerability to noise reduced, over time, their…

Robotics · Computer Science 2024-09-19 Usama Saqib , Letizia Marchegiani , Jesper Rindom Jensen

Telerobotics has shown promise in helping workers safely manipulate building components on construction sites; however, its primary reliance on visual feedback limits efficiency in situations with stiff contact or poor visibility. Reliable…

Human-Computer Interaction · Computer Science 2023-02-03 Yijie Gong , Haliza Mat Husin , Ecda Erol , Valerio Ortenzi , Katherine J. Kuchenbecker

In order to leverage the full power of quantum noise squeezing with unavoidable decoherence, a complete understanding of the degradation in the purity of squeezed light is demanded. By implementing machine learning architecture with a…

Humans do not acquire perceptual abilities in the way we train machines. While machine learning algorithms typically operate on large collections of randomly-chosen, explicitly-labeled examples, human acquisition relies more heavily on…

Haptic perception is highly important for immersive teleoperation of robots, especially for accomplishing manipulation tasks. We propose a low-cost haptic sensing and rendering system, which is capable of detecting and displaying surface…

We address the problem of sound representation and classification and present results of a comparative study in the context of a domestic robotic scenario. A dataset of sounds was recorded in realistic conditions (background noise, presence…

Sound · Computer Science 2014-02-18 Maxime Janvier , Xavier Alameda-Pineda , Laurent Girin , Radu Horaud

Existing open-vocabulary object detection (OVD) develops methods for testing unseen categories by aligning object region embeddings with corresponding VLM features. A recent study leverages the idea that VLMs implicitly learn compositional…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Hojun Choi , Junsuk Choe , Hyunjung Shim

Collaborative robots must effectively communicate their internal state to humans to enable a smooth interaction. Nonverbal communication is widely used to communicate information during human-robot interaction, however, such methods may…

Robotics · Computer Science 2024-05-01 Liam Roy , Dana Kulic , Elizabeth Croft

Safe human-to-robot handovers of unknown objects require accurate estimation of hand poses and object properties, such as shape, trajectory, and weight. Accurately estimating these properties requires the use of scanned 3D object models or…

Robotics · Computer Science 2021-07-06 Yik Lung Pang , Alessio Xompero , Changjae Oh , Andrea Cavallaro

The identification of device brands and models plays a pivotal role in the realm of multimedia forensic applications. This paper presents a framework capable of identifying devices using audio, visual content, or a fusion of them. The…

Machine Learning · Computer Science 2024-06-27 Ioannis Tsingalis , Christos Korgialas , Constantine Kotropoulos

A holistic understanding of object properties across diverse sensory modalities (e.g., visual, audio, and haptic) is essential for tasks ranging from object categorization to complex manipulation. Drawing inspiration from cognitive science…

Robotics · Computer Science 2024-02-26 Gyan Tatiya , Jonathan Francis , Ho-Hsiang Wu , Yonatan Bisk , Jivko Sinapov

The ability to accurately predict the surrounding environment is a foundational principle of intelligence in biological and artificial agents. In recent years, a variety of approaches have been proposed for learning to predict the physical…

Computer Vision and Pattern Recognition · Computer Science 2019-08-01 Alberto Cenzato , Alberto Testolin , Marco Zorzi

Automatic audio event recognition plays a pivotal role in making human robot interaction more closer and has a wide applicability in industrial automation, control and surveillance systems. Audio event is composed of intricate phonic…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-12 Tushar Sandhan , Sukanya Sonowal , Jin Young Choi

This paper addresses object perception applied to mobile robotics. Being able to perceive semantically meaningful objects in unstructured environments is a key capability in order to make robots suitable to perform high-level tasks in home…

Robotics · Computer Science 2015-03-18 Arnau Ramisa , David Aldavert , Shrihari Vasudevan , Ricardo Toledo , Ramon Lopez de Mantaras

The state of an object is an important piece of knowledge in robotics applications. States and objects are intertwined together, meaning that object information can help recognize the state of an image and vice versa. This paper addresses…

Computer Vision and Pattern Recognition · Computer Science 2019-05-23 Ahmad Babaeian Jelodar , Yu Sun

A toolbox for creation and rendering of dynamic virtual acoustic environments (TASCAR) that allows direct user interaction was developed for application in hearing aid research and audiology. This technical paper describes the general…

Sound · Computer Science 2025-05-01 Giso Grimm , Joanna Luberadzka , Volker Hohmann

What is the right supervisory signal to train visual representations? Current approaches in computer vision use category labels from datasets such as ImageNet to train ConvNets. However, in case of biological agents, visual representation…

Computer Vision and Pattern Recognition · Computer Science 2016-07-27 Lerrel Pinto , Dhiraj Gandhi , Yuanfeng Han , Yong-Lae Park , Abhinav Gupta

In Augmented Reality (AR), virtual objects interact with real objects. However, the lack of physicality of virtual objects leads to the absence of natural sonic interactions. When virtual and real objects collide, either no sound or a…

Human-Computer Interaction · Computer Science 2025-08-05 Laura Schütz , Sasan Matinfar , Ulrich Eck , Daniel Roth , Nassir Navab

Quantum computing can be employed in computer-aided music composition to control various attributes of the music at different structural levels. This article describes the application of quantum simulation to model compositional decision…

Quantum Physics · Physics 2025-05-28 Christopher Dobrian , Omar Costa Hamido

Despite extensive research in robust visual-inertial navigation systems~(VINS) in dynamic environments, many approaches remain vulnerable to objects that suddenly start moving, which are referred to as \textit{abruptly dynamic objects}. In…

Robotics · Computer Science 2024-10-22 Seungwon Song , Hyungtae Lim , Alex Junho Lee , Hyun Myung