Feeds

BAD VIBES: High-speed video camera records your voice from trash

Next step: CCTV that eavesdrops on you

Intelligent flash storage arrays

Vid Run a camera fast enough and its images can capture sound from the way nearby objects vibrate, according to boffins from MIT, Adobe and Microsoft.

The experiments, announced by MIT, worked so well that they claimed to have recovered sound from the leaves of plants, and the vibration of a crisp packet.

The latter, as the researchers demonstrate in their video (below), was filmed through soundproof glass as proof that they weren't fudging the experiment using a hidden microphone.

YouTube video of the researchers capturing sound from images of a vibrating crisp packet.

In a paper to be presented at Siggraph, Abe Davis (MIT), Michael Rubenstein (MIT and Microsoft), Neil Wadhwa (MIT), Gautham Mysore (Adobe), Frédo Durand and William Freeman (both MIT) describe their “visual microphone”.

It's obvious that sounds will make objects around them vibrate. Turning that into a system that can recover the original sounds from the vibrations posed several challenges: the video had to be captured at a high enough frame rate; the software the researchers developed had to be able to detect the tiny pixel-scale vibrations; and background noise had to be removed.

MIT's passive visual microphone

Even through soundproof glass, audio can be recovered from vibrating objects

“To recover sound from an object, we film the object using a high-speed video camera. We then extract local motion signals across the dimensions of a complex steerable pyramid built on the recorded video. These local signals are aligned and averaged into a single, 1D motion signal that captures global movement of the object over time, which we further filter and denoise to produce the recovered sound,” the researchers write.

The video frame rate is important, since (for those that remember the Nyquist-Shannon sampling theorem) you need to sample an analogue signal like sound at twice the maximum frequency you want to capture. In the “visual microphone” experiment, the researchers worked at frame rates between 2 kHz and 20 kHz.

However, they also note that the “rolling shutter” characteristic of digital cameras means they can be used to capture sound. They used the rolling shutter “to effectively increase the sampling rate of a camera and recover sound frequencies above the camera’s frame rate”, the paper states.

The signal processing of the video wasn't in anything like real time: “Processing each video typically took 2 to 3 hours using MATLAB on a machine with two 3.46 GHz processors and 32 GB of RAM” they write. ®

Remote control for virtualized desktops

More from The Register

next story
Rosetta probot drilling DENIED: Philae has its 'LEG in the AIR'
NOT best position for scientific fulfillment
'Yes, yes... YES!' Philae lands on COMET 67P
Plucky probot aces landing on high-speed space rock - emotional scenes in Darmstadt
THERE it is! Philae comet lander FOUND in EXISTING Rosetta PICS
Crumb? Pixel? ALIEN? Better, it's a comet-catcher!
SEX BEAST SEALS may be egging each other on to ATTACK PENGUINS
Boffin: 'I think the behaviour is increasing in frequency'
HUMAN DNA 'will be FOUND ON MOON' – rocking boffin Brian Cox
Crowdfund plan to stimulate Blighty's space programme
Post-pub nosh neckfiller: The MIGHTY Scotch egg
Off to the boozer? This delicacy might help mitigate the effects
I'M SO SORRY, sobs Rosetta Brit boffin in 'sexist' sexy shirt storm
'He is just being himself' says proud mum of larger-than-life physicist
NASA launches new climate model at SC14
75 days of supercomputing later ...
prev story

Whitepapers

Why and how to choose the right cloud vendor
The benefits of cloud-based storage in your processes. Eliminate onsite, disk-based backup and archiving in favor of cloud-based data protection.
Getting started with customer-focused identity management
Learn why identity is a fundamental requirement to digital growth, and how without it there is no way to identify and engage customers in a meaningful way.
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?
Reducing the cost and complexity of web vulnerability management
How using vulnerability assessments to identify exploitable weaknesses and take corrective action can reduce the risk of hackers finding your site and attacking it.
Saudi Petroleum chooses Tegile storage solution
A storage solution that addresses company growth and performance for business-critical applications of caseware archive and search along with other key operational systems.