Sign in. It’s quick, free and it’s up to you.
An account is an optional way to support the work we do. Find out more.
RESEARCHERS AT MIT, Microsoft and Adobe have created a way to reconstruct sound from a video of an object, turning it into a makeshift microphone.
Instead of using specialist equipment such as laser microphones, which measures minute vibrations in reflective surfaces, the team developed a specialised algorithm to analyse the tiny vibrations of everyday objects using a high-speed camera.
In one experiment, the researchers were able to recover intelligible speech from the vibrations of a crisp packet photographed 15 feet away through soundproof glass.
In other experiments, they extracted audio signals from videos of aluminium foil, the surface of a glass of water, and even the leaves of a potted plant, allowing them to extract the recording of the nursery rhyme ‘Mary had a Little Lamb.’
According to the research team, the algorithm is able to pick up the sound hitting an object, which causes it to vibrate very subtly. The motion of this vibration is usually invisible to the naked eye, but by analysing high-speed video, the algorithm is able to pick out these vibrations and then convert them into audio.
The researchers go into greater detail about how the algorithm works.
Reconstructing audio from video requires that the frequency of the video samples — the number of frames of video captured per second — be higher than the frequency of the audio signal.In some of their experiments, the researchers used a high-speed camera that captured 2,000 to 6,000 frames per second. That’s much faster than the 60 frames per second possible with some smartphones, but well below the frame rates of the best commercial high-speed cameras, which can top 100,000 frames per second.
(If that explanation has gone over your head, this video will help clear things up).
In one experiment, it was able to extract sound from a video recorded using an ordinary digital camera, recorded at the standard 60 frames per second.
While the audio reconstruction wasn’t as accurate as the previous experiments, it was good enough for researchers to identify the gender of a speaker, the number of speakers in a room and even give enough information about the sound of a speaker’s voice to help identify them.
While the researchers see obvious applications for the technique in areas like law enforcement and forensics, they are more excited about developing a new kind of imaging, mainly trying to determine the material and structural properties of objects from their visible response to short bursts of sound.
The researchers will present their findings at the computer graphics conference, Siggraph, which is taking place next week.
To embed this post, copy the code below on your site
Its not going to be safe talking in front of inanimate objects anymore…. they’ll be all ears.
In future, I’ll be constantly crumpling the crisp packet I’m eating from whenever I’m having a conversation so the CIA, FBI, DEA, NSA, IRA, PSNI, GSOC etc can’t hear my conversations. It’s so annoying having to talk in riddles whenever I spot these people following me, taking pictures with their cameras, wearing sunglasses and dressed like American tourists to conceal their real identity!
Like a carbon rod
Did the sound come in crisp & clear?
The real story here. Tayto v king. Who wins, you decide (in my best Geordie BB accent)
Neither, Hunky Dory all the way.
Only sick degenerates eat tayto,even with its royal conatations King is king plus tayto’s a pykies name
How is your annual subscription to tayto park going though Paul. I hear you’re never out of the place.
I can’t go within 500 yards of it by court order
Kids discovered this years ago with tin cans and a piece of string.
Great, now I can’t even eat a packet of Tayto’s without the NSA listening in!
The journal has no shame.
http://www.theguardian.com/technology/2014/aug/05/mit-crisp-packet-eavesdrop-audio-sound
At least credit the Guardian
There’s a deadly comment on the original article on the guardian it was “so my tonfoil hats no good then”
Probably a syndicated article.
SeekingUniversalTruth – News outlets around the world have shared sources. Sorry if that’s a big shock to you. When you’re a little older we need to to tell you something about Christmas too.
No crisps in GSOC from now on.
Ooooh would love a tayto cheese and onion sambo now.
Whispering grass…
have your say