Google Play icon

One-eyed robot learns to see in weightlessness

Posted September 29, 2016
Stereo camera on ISS drone

Stereo camera on ISS drone

A small drone taught itself to judge distances using only one eye during trials aboard the International Space Station, ESA-backed researchers have reported.

Although humans can effortlessly estimate distances with a single eye, robots still lack this capability.

“It is a mathematical impossibility to extract distances to objects from one single image, if the object has not been encountered before,” explains Guido de Croon from Delft University of Technology, one of the investigators.

“But if we recognise something to be a car, then we know its physical characteristics, and we can use that information to estimate its distance from us. A similar logic is what we wanted the drone to learn during our experiment.”

One of the Spheres – Synchronized Position Hold Engage and Reorient Experimental Satellite – drones resident in the Space Station was pressed into service for testing.

Spheres drone

Spheres drone

With 12 carbon dioxide gas thrusters enabling rotation and movement in all direction, the bowling ball-sized Spheres are essentially free-floating mini-spacecraft within the Station, used for testing a wide variety of technology.

For this test, a drone began navigating inside Japan’s module while recording stereo vision information from its two camera ‘eyes’. It then began to learn about the distances to walls and nearby obstacles so that when its stereo camera was switched off, it could then begin autonomous exploration using only a single camera.

Quadcopter for ground test

Quadcopter for ground test

The self-supervised learning software had previously been tested thoroughly at the TU Delft CyberZoo – a research lab for flying and walking robots – using quadcopters.

The experiment, presented on 27 September at the International Astronautical Congress in Guadalajara, Mexico, marked an important step in an ongoing research effort based on advanced artificial intelligence concepts, in collaboration between ESA, the Massachusetts Institute of Technology and the Micro Air Vehicles Lab of the Delft University of Technology.

“It was very exciting to see a drone in space learning using cutting-edge artificial intelligence methods for the very first time,” explains Dario Izzo, coordinating the research contribution from ESA’s Advanced Concepts Team.

“At ESA, in particular in our team, we’ve been working towards the goal for the last five years. In space applications, machine learning is not considered a reliable approach to autonomy: a ‘bad’ learning approach may result in a catastrophic failure of the entire mission.

Spheres on Station

Spheres on Station

“Our approach, based on self-supervised learning, has a high degree of reliability and helps drone autonomy. A similar learning approach was successfully applied to self-driving cars, a task where reliability is also of paramount importance.”

Leopold Summerer, heading the  Advanced Concepts Team, adds: “This is a further step in our quest for truly autonomous space systems, which are increasingly in demand for deep-space exploration, complex operations, for reducing costs, and increasing capabilities and science opportunities.”

Source: ESA


Featured news from related categories:

Technology Org App
Google Play icon
84,820 science & technology articles

Most Popular Articles

  1. New Class of Painkillers Offers all the Benefits of Opioids, Minus the Side Effects and Addictiveness (2 days old)
  2. Top NASA Manager Says the 2024 Moon Landing by Astronauts might not Happen (September 19, 2019)
  3. How social media altered the good parenting ideal (September 4, 2019)
  4. What's the difference between offensive and defensive hand grenades? (September 26, 2019)
  5. Just How Feasible is a Warp Drive? (September 25, 2019)

Follow us

Facebook   Twitter   Pinterest   Tumblr   RSS   Newsletter via Email