The Future of Robot Control - Simple Gestures, Infinite Possibilities

No more complicated buttons or complex codes. With a simple app and a mixed reality headset, controlling robots becomes more intuitive and accessible than ever.

Captură de ecran 2024-05-06 135159.png

https://github.com/Improbable-AI/VisionProTeleop

Scientists have made a significant advance in the field of robot control by developing an app that allows users to operate a robot using only head and hand gestures. The app, called "Tracking Streamer," is compatible with Apple's Vision Pro mixed reality headset and promises to revolutionize the way we interact with machines in various fields.
https://x.com/younghyo_park/status/1766274298422161830
Tracking Streamer uses a combination of advanced sensors and artificial intelligence to monitor user movements. This technology tracks 26 key points on the body, including the hands, wrists and head, and records spatial data such as height from the ground. The captured information is then transmitted via Wi-Fi to a robot on the same network, which interprets the gestures and executes the appropriate actions.

Tracking streamer must be a very crazy robot…

Tracking streamer

is an application 😊👌 or system that allows control and monitoring of a robot through various movements. This does not refer to the robot itself, but rather to the interface or tool that allows the user to communicate with the robot and direct its actions.

For example, if you have a mobile robot or robotic arm, "tracking streamer" could be an app that allows you to monitor, control and program robot movements for specific tasks. By no means the robot itself. Well, the robot itself 😁 can have various functionalities, and the "tracking streamer" is only part of the ecosystem that surrounds it. !WEED !LUV !MEME

@rafzat!

@valentin86 passed you the virtual joint!
_{If you do not want to receive these comments, please reply with !STOP}