Editor choice

2024-04-01

Toyota's Innovative Robot Workers: Mastering Transparent Objects & for Enhanced Home Assistance

Toyota's dedicated R&D engineers have been working tirelessly to teach their innovative robots new skills, bringing us closer to the reality of having robotic home helpers for people with disabilities or the elderly. The latest advancements include the ability to handle transparent and mirror objects effectively, as well as shoot selfies with an action camera, choosing the optimal angle.

Toyota has been developing robots with hands for years, with the ultimate goal of creating reliable home assistance for those in need. In 2017, the company tested a prototype with a disabled war veteran, showcasing the robot's ability to grab objects, press buttons, and perform other basic household tasks. However, the journey from a basic prototype to a full-fledged commercial robot involves solving numerous small scenarios to ensure safety and convenience.

Earlier this year, engineers presented a solution for navigating around the house with objects on the floor, people, and other obstacles: they proposed fixing the robot upside down on the ceiling. Now, they have demonstrated how they trained the robot to work with transparent objects and take selfies using a selfie stick.

The engineers used two types of robots: floor and ceiling models. Functionally and structurally, they are the same, with differences only in the movable platform to which the robot is attached. The robot consists of a body assembled from several segments that can bend and unbend relative to each other. At its end are two arms and a head with two cameras.

One of the significant new abilities is the robot's improved handling of objects made from transparent materials or with mirror coatings. Previously, this was a major challenge for robots, as they determined an object's shape and border by comparing its view from different angles. However, Toyota's engineers have successfully implemented high-quality object recognition using a depth camera in their robot. By training the algorithm in a simulator with various three-dimensional objects and environments, the robot can now grab and move glasses and other transparent objects found in houses.

The second new skill is the ability to film itself. The engineers taught the robot to take a selfie stick with an action camera in its hand and position it so that the robot is in the center of the frame, capturing its actions from a new perspective. This skill, unveiled around American Selfie Day on June 21, may also have practical applications, such as providing recordings to teach algorithms using self-learning methods.

In conclusion, Toyota's innovative robot workers are making significant strides in mastering transparent objects and selfie skills, bringing us closer to the reality of efficient home assistance for those in need. Hire a robot worker today and experience the future of home care and support.

Share with friends:

Write and read comments can only authorized users