Publication

Grasp Recognition and Manipulation with the Tango

Kry Paul, Pai Dinesh
In Khatib O., Kumar V. et Rus D. editors, 10th International Symposium on Experimental Robotics, ISER'06. Rio de Janeiro, Brésil, juillet 2006. Springer Tracts in Advanced Robotics volume 39, pages 551–559. Springer, 2008.
We describe an interface that uses a graspable device called the Tango, which looks like a ball but measures contact pressures on its surface at 256 tactual elements (taxels) at a high rate (100 Hz). The acceleration of the device is also measured. The key idea is to use this information to recognize the shape and movement of the user's hand grasping the object, with the vision that such a system would make it much easier to program interaction with 3D objects. We describe a new rotationally invariant algorithm for recognizing hand configuration, by using examples of previous interaction collected with motion capture. The recognition method is sufficiently fast for interactive manipulation. We also describe examples of 3D interaction using our system, in which the user interacts with 3D virtual objects using a hand avatar. Using this interface, the user can grasp an object, rotate it in 3D, transport it to a different location, and place it, with the ease and simplicity approaching that of handling a simple mouse. In the future, such tangible interfaces could be used for programming robots by demonstration or for model-based telerobotics.

Images and Movies

 

BibTex References

@inproceedings{KP06a,
author = {Paul Kry and Dinesh Pai},
title = {Grasp Recognition and Manipulation with the Tango},
booktitle = {10th International Symposium on Experimental Robotics, ISER'06, July, 2006},
series = {Springer Tracts in Advanced Robotics},
editor = {Oussama Khatib and Vijay Kumar and Daniela Rus},
address = {Rio de Janeiro, Br\'esil},
publisher = {Springer},
volume = 39,
pages = {551--559},
year = 2008
}

Other Publications

 

Publication Management (Restricted Area)

 
Modify this publication
 
Add a new publication:
Article
Livre
Conférence
Chapitre de livre
Acte de congrès
Rapport de thèse (de master, de stage...)
Logiciel
Rapport technique (de recherche, de contrat...)
Séminaire
 
For any questions, contact Brigitte Bidegaray.