Intuitive Robot Interfaces with Web Robotics
By using such an interface, non-expert users can now easily instruct a robot to manipulate the world by simply specifying how they want to world to look. The robot begins by perceiving any known objects on the table, and displays them to the user as 3D meshes. The user is then able to drag-and-drop objects around in order to specify how he or she wants the objects arranged. Users can also specify configurations of objects and save them as templates, as a form of programming by demonstration. Having such an interface available in web browsers means that non-expert users with a wide array of operating systems and browsers can perform manipulation tasks remotely, using their own computers or mobile devices.
This work was done in collaboration with Kaijen Hsiao from Willow Garage, Sarah Osentoski from Bosch, and Chad Jenkins from Brown University. For more information, see ros3djs, SharedAutonomyToolkit, and robotwebtools.org.