Emergent Tech

Artificial Intelligence

On yer bike! Boffins teach AI drone to fly itself using cams on bicycles, self-driving car

At head height... don't annoy this bot

By Katyanna Quach


Vid Researchers have taught a drone to fly autonomously through the streets of Zürich, Switzerland, by using a simple neural network.

As tech companies toy with the idea of using mini-drones for delivery, monitoring buildings, or surveillance, then figuring out how to fly them without human control is vital if sales are to scale up. A paper published in the IEEE Robotics and Automation journal (here’s a free pre-print version) shows how AI can help make that process easier.

Known as DroNet, the convolutional neural network has eight layers and is much smaller and less complex than other architectures. It works by examining images from a camera, and produces two outputs: a steering angle so it can hover and skirt around obstacles, and a collision probability so it knows whether or not it's likely to bump into stuff, and take appropriate action.

The team of researchers from the University of Zurich, and the Technical University of Madrid in Spain, taught the software how to steer using more than 70,000 images from an open-source dataset created by cyber-uni Udacity, which is developing open-source self-driving car software. The pictures depict a range of scenarios taken from a front-facing camera tacked onto the vehicle.

A second dataset for collision-avoidance training was scraped together by attaching a GoPro camera to the handlebars of a bicycle to capture 32,000 images. Stills were taken from video recordings of the bicycle approaching different objects, such as pedestrians, vehicles, or trees. The images were then marked as 0 if the bike was far from an object, and 1 if it was very close to crashing into an object.

Low buzz

Antonio Loquercio, first author of the paper and a PhD student at the University of Zurich, explained to The Register that "drones operating outdoors generally fly at high altitudes, where the GPS signal is reliable enough to allow them to navigate without problems." But by using data taken from cars and bicycles, the drones can also fly at similar altitudes, he explained.

When swooping along at low heights, the bot needs to cope with large groups of people, vehicles, and other obstacles in the way. "So, how should we develop drones that can also work there? Our intuition was that cars, bicycles, or similar vehicles, already have this great ability. Therefore, we developed an algorithm to make drones that can imitate them,” said Loquercio.

The video below shows a Parrot Bebop 2.0 drone buzzing loudly as it hovers along streets, turning corners and stopping in front of cyclists and pedestrians. It travelled up to 245 metres in one of the flying experiments in an urban setting, and could be flown 50 metres in a parking garage although it wasn’t explicitly trained on parking environments.

It’s not bad for a small network with eight layers. Loquercio said reducing the complexity of the system means it an action performed by the drone requires a smaller computational cost, allowing it to react faster. That's particularly useful for responding quickly to sudden obstacles and dangerous situations. It also means it should draw less power, which is good news for battery-powered setups.

And now the downsides

There are significant downsides. Since DroNet was trained on data taken from bicycles and cars, it can also only move on a single plane at groin height and cannot fly up or down. It has to be constantly in radio contact with its controller – a laptop running the machine-learning software that makes all the decisions – and it’s also not very agile or fast either.

Loquercio told El Reg research like DroNet was “a first, but important step, toward the integration of autonomous drones into our city.”

“[Drones] will help us in our everyday activities, deliver our packages, or support search and rescue teams in their operations in case of disaster. However, there still lot of work is required in this direction. Not only from us, but from the robotics community in general. For this reason, we open-sourced all our findings, our code and our datasets,” he concluded. ®

PS: You can play around with the code here.

Sign up to our NewsletterGet IT in your inbox daily


More from The Register

British and US militaries' drone swarm hackathon definitely isn't about army tech

It's about fighting fires, not starting them, right defence bods?

London Gatwick Airport reopens but drone chaos perps still not found

Strange tale leaves 120k bods displaced during Xmas rush

Drone goal! Quadcopter menace alert freezes flights from London Heathrow Airport

Alleged sighting of annoying flying gizmo torments second UK air travel nerve-center

Bloke fined £460 after his drone screwed up police chopper search for missing woman

First UK conviction for reckless UAV flying

EasyJet boss says pre-Chrimbo Gatwick drone chaos cost it £15m

Budget airline cancelled 400 flights, stranding 82,000 customers including a Vulture*

Yikes. UK military looking into building 'fully autonomous' killer drone tech – report

MoD insists there will always be a human at the wheel

Brit drone biz Sensat notches up 29km remote-control flight

Beyond visual line-of-sight exercise paves way for Amazon-style deliveries

Intel's still-in-beta drone flight planning software gets update

Chipzilla is doing a little aviating of its own, we see

Uncle Sam gives itself the right to shoot down any drone, anywhere, any time, any how

This one's not going to get abused, not at all

Capture your late-night handbrake turns with this 'autonomous' car-chasing camera drone

Nvidia-powered quadcopter 'sees' and follows road vehicles