in a new article entitled “Humanoid Policy ~ Human-Policy ” Apple researchers offer an interesting way to teach humanoid robots. And this includes wearing Apple Vision Pro.
Robot, robot do
The project is cooperation between Apple, Mit, Carnegie Mellon, University of Washtton, UC Washtton. He explores how can you use the frames of people who manipulate objects, can be used to teach general -purpose robots. SRC = ' https: //videopress.com/embed/d3drbrcu? Cover = 1 & amp; Posterurl = https%3a%2f%2f9to5Mac.com%2FWP-Content%2FUPLOADS%2FSITES%2F6%2F2025%2F05% 2FAPLE-HUMANOD-ROBOT-STYU_MP4_STD.Riginal.jpg%3FATAILY%3D82 & amp; strip = all & amp; PreloadContent = Metadata & Amp; usavergecolor = 1 & amp; HD = 0 ' Frameborder = ' 0 ' Allifullllllllllllllles Data Resize-to-Part = “True” Alling = ' BoPboard '>
The researchers have collected more than 25,000 human demonstrations and 1,500 demonstrations of robots (data set, which they called pH2D ), and them in order as a whole, which can be controlled by a physical person.
As the authors explain:
Manipulation policies with a variety of data increased their power and summarize between tasks and platforms. Nevertheless, training exclusively from robot demonstrations is laborious and requires an expensive collection of television operations, which is difficult to scale. Let people show the path.
cheaper, faster training
to collect the Apple Vision Pro, which shoots the video from the left device, and uses Apple Arkit for the Apple Arkit video Tracking 3D heads and hands. Installation, which allows them to record high-quality demonstrations in seconds, is a fairly large improvement compared to traditional methods of robot-teleposa, which are slow, more expensive and more difficult to scale. Class = “WP-Block-Heading” ID = “H-H-HUMAN-Human-TRANSFORMER-HAT”> human action transformer (HAT)
The key to the entire study is a model trained in both human demonstrations and robots in a general format. Flexible and effective. you? Let us know in the comments.
