English

Visual Closed-Loop Control for Pouring Liquids

Robotics 2017-02-28 v3 Computer Vision and Pattern Recognition

Abstract

Pouring a specific amount of liquid is a challenging task. In this paper we develop methods for robots to use visual feedback to perform closed-loop control for pouring liquids. We propose both a model-based and a model-free method utilizing deep learning for estimating the volume of liquid in a container. Our results show that the model-free method is better able to estimate the volume. We combine this with a simple PID controller to pour specific amounts of liquid, and show that the robot is able to achieve an average 38ml deviation from the target amount. To our knowledge, this is the first use of raw visual feedback to pour liquids in robotics.

Cite

@article{arxiv.1610.02610,
  title  = {Visual Closed-Loop Control for Pouring Liquids},
  author = {Connor Schenck and Dieter Fox},
  journal= {arXiv preprint arXiv:1610.02610},
  year   = {2017}
}

Comments

To appear at ICRA 2017

R2 v1 2026-06-22T16:15:23.066Z