English
Related papers

Related papers: Leveraging Multi-modal Sensing for Robotic Inserti…

200 papers

Achieving precise control of robotic tool paths is often challenged by inherent system misalignments, unmodeled dynamics, and actuation inaccuracies. This work introduces an Iterative Learning Control (ILC) strategy to enable precise…

Robotics · Computer Science 2025-11-04 Yasamin Foroutani , Yasamin Mousavi-Motlagh , Aya Barzelay , Tsu-Chin Tsao

For robot manipulation, a complete and accurate object shape is desirable. Here, we present a method that combines visual and haptic reconstruction in a closed-loop pipeline. From an initial viewpoint, the object shape is reconstructed…

Robotics · Computer Science 2024-09-11 Lukas Rustler , Jiri Matas , Matej Hoffmann

Robots operating in shared human environments must not only navigate, interact, and detect their surroundings, they must also interpret and respond to dynamic, and often unpredictable, human behaviours. Although recent advances have shown…

This paper demonstrates a visual servoing method which is robust towards uncertainties related to system calibration and grasping, while significantly reducing the peg-in-hole time compared to classical methods and recent attempts based on…

Robotics · Computer Science 2020-11-13 Rasmus Laurvig Haugaard , Jeppe Langaa , Christoffer Sloth , Anders Glent Buch

Robots can use Visual Imitation Learning (VIL) to learn manipulation tasks from video demonstrations. However, translating visual observations into actionable robot policies is challenging due to the high-dimensional nature of video data.…

Robotics · Computer Science 2025-01-22 Ananth Jonnavittula , Sagar Parekh , Dylan P. Losey

6D object pose estimation is widely applied in robotic tasks such as grasping and manipulation. Prior methods using RGB-only images are vulnerable to heavy occlusion and poor illumination, so it is important to complement them with depth…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Yi Cheng , Hongyuan Zhu , Ying Sun , Cihan Acar , Wei Jing , Yan Wu , Liyuan Li , Cheston Tan , Joo-Hwee Lim

Multi-modal ophthalmic image classification plays a key role in diagnosing eye diseases, as it integrates information from different sources to complement their respective performances. However, recent improvements have mainly focused on…

Image and Video Processing · Electrical Eng. & Systems 2024-05-29 Ke Zou , Tian Lin , Zongbo Han , Meng Wang , Xuedong Yuan , Haoyu Chen , Changqing Zhang , Xiaojing Shen , Huazhu Fu

Fueled by breakthrough technology developments, the biological, biomedical, and behavioral sciences are now collecting more data than ever before. There is a critical need for time- and cost-efficient strategies to analyze and interpret…

The drive for efficiency and safety in construction has boosted the role of robotics and automation. However, complex tasks like welding and pipe insertion pose challenges due to their need for precise adaptive force control, which…

Robotics · Computer Science 2025-01-28 Hengxu You , Yang Ye , Tianyu Zhou , Jing Du

Vision is well-known for its use in manipulation, especially using visual servoing. Due to the 3D nature of the world, using multiple camera views and merging them creates better representations for Q-learning and in turn, trains more…

Machine Learning · Computer Science 2025-09-01 Abdulaziz Almuzairee , Rohan Patil , Dwait Bhatt , Henrik I. Christensen

Robotic vision plays a major role in factory automation to service robot applications. However, the traditional use of frame-based camera sets a limitation on continuous visual feedback due to their low sampling rate and redundant data in…

When using reinforcement learning (RL) for contact-rich robotic manipulation, vision can provide task-relevant information that accelerates learning beyond what proprioception alone can achieve. However, vision-enabled policies tend to…

Robotics · Computer Science 2026-05-29 Victor Kowalski , Chengxi Li , Dongheui Lee

Vision-based learning methods provide promise for robots to learn complex manipulation tasks. However, how to generalize the learned manipulation skills to real-world interactions remains an open question. In this work, we study robotic…

Robotics · Computer Science 2020-03-03 Zhixin Jia , Mengxiang Lin , Zhixin Chen , Shibo Jian

This review explores the potential of foundation models to advance laboratory automation in the materials and chemical sciences. It emphasizes the dual roles of these models: cognitive functions for experimental planning and data analysis,…

Chemical multisensor devices need calibration algorithms to estimate gas concentrations. Their possible adoption as indicative air quality measurements devices poses new challenges due to the need to operate in continuous monitoring modes…

Artificial Intelligence · Computer Science 2020-02-14 S. De Vito , E. Esposito , M. Salvato , O. Popoola , F. Formisano , R. Jones , G. Di Francia

Defining reward functions for skill learning has been a long-standing challenge in robotics. Recently, vision-language models (VLMs) have shown promise in defining reward signals for teaching robots manipulation skills. However, existing…

Robotics · Computer Science 2025-02-13 Kaifeng Zhang , Zhao-Heng Yin , Weirui Ye , Yang Gao

In this paper, we discuss a framework for teaching bimanual manipulation tasks by imitation. To this end, we present a system and algorithms for learning compliant and contact-rich robot behavior from human demonstrations. The presented…

Robotics · Computer Science 2022-08-02 Simon Stepputtis , Maryam Bandari , Stefan Schaal , Heni Ben Amor

Automation can transform productivity in research activities that use liquid handling, such as organic synthesis, but it has made less impact in materials laboratories, which require sample preparation steps and a range of solid-state…

Collaborative robots are expected to be able to work alongside humans and in some cases directly replace existing human workers, thus effectively responding to rapid assembly line changes. Current methods for programming contact-rich tasks,…

While the search for new solvents in the chemical industry is of uttermost importance with respect to environmental considerations, this domain remains strongly tied to highly manual and visual inspection tasks by human experts. As the…

Robotics · Computer Science 2024-07-24 Erwann Landais , Nasser Rezzoug , Vincent Padois