DeepMind's robotics department has implemented Gemini 1.5 Pro into the robot to teach it how to move around the office and respond to commands.
In a series of videos, the Google AI team asks the machine to perform various tasks. In one of the experiments, the tester gave the command to take him somewhere where he could draw. The droid led the man to a blackboard with a marker.
View this post on InstagramA post from Google DeepMind (@googledeepmind)
In another test, the robot was shown a map and asked to get to the "Blue Zone". He thought for a while, then began to complete the task.
"I successfully followed the instructions on the board," the robot commented.
For the tests, the droid was trained to navigate in space using "multimodal navigation according to instructions with demonstration tours." He moves around the office and points out various landmarks with his speech. For example, the robot can move to an outlet after being asked to charge the phone.
Based on an understanding of the environment, the team taught AI to reason "in accordance with common sense." Thanks to this, he can respond to written and drawn commands, as well as gestures.
You can ask the droid if there is a favorite drink available. Gemini knows that you need to go to the refrigerator, make sure that there are or are not cans of Coca-Cola and come back with an answer.
According to Google, the AI machine showed about 90% of successful attempts to interact with employees in more than 50 tests.
Earlier, researchers from the University of Tokyo taught a robot to drive an electric car.
In July, Chinese scientists grew an artificial brain and implanted it into a droid.
Recall that Elon Musk said that Optimus humanoid robots will bring Tesla's capitalization to $ 25 trillion.