Feeds

Real-time drone videos get GPU-tastic

Swimming in sensors, drowning in data

Internet Security Threat Report 2014

HPC blog Here at the GPU Technology Conference (GTC 2012), you see a lot of things that you didn’t think were quite possible yet. Case in point: cleaning up surveillance video.

The standard scene in “24” or any spy thriller is of agents poring over some grainy, choppy, barely-lit video that’s so bad you can’t tell whether it’s four humans negotiating an arms deal or two bears having an animated conversation about football. In the Hollywood version, the techno geek says, “Let me work on this a little bit,” and suddenly things clear up to the degree that not only can you see the faces clearly, you can tell when the guys last shaved.

Cleaning up and enhancing video is a tall order, compute-wise – and doing it in real time? Hella hard. But I just saw a demo of that in a GTC12 session run by MotionDSP. Their specialty is processing video streams from mobile platforms (think drones and airplanes) on the fly. We’re talking full motion, 30 frames per second video streams that are enhanced, cleaned up, and highly analysable in real time.

The amount of processing they’re doing is incredible. Lighting is enhanced, edges are enhanced, jitter is taken out, and the on-screen metadata (time, location, speed, etc) is masked. Again – all in real time.

The effect is profound. In the demo, what was once just a vague gray ship (which seemed to be vibrating like a can in a paint-shaker) was clarified so that you could easily see what kind of ship it was and also see two suspicious figures milling around on deck. To me, it looked like there were enough pixels to enhance the video even further – to the point where we could identify the figures.

As the folks from MotionDSP explained, processing at this speed simply isn’t possible without using GPUs. Cleaning up a single stream of video to that degree takes 160 gigaflops of processing power. A single GPU card (Fermi, assumedly) can handle two simultaneous HD streams or four to six standard definition streams.

Not surprisingly, MotionDSP's biggest customers are various branches of the US government (Air Force, Naval Special Warfare Group, and lots of other secret acronym agencies). In fact, the “swimming in sensors, drowning in data” quote is from a general (I think) talking about their struggle to take advantage the masses of data provided by their sensor platforms.

Check out the demo views on the MotionDSP website; it’s interesting stuff for sure. While the early applications are typically military surveillance, how far off is the day when we’ll see this technology used to make other videos more clear?

I’m thinking about the typical YouTube video shot from a helmet cam worn by some kid on a bike at the top of a huge mountain. What’s always detracted from my viewing experience is the way the video gets so shaky and distorted after he loses his balance and starts to tumble down the mountainside. Sure, the first hit is clear, and maybe the first loop, but once he picks up speed, there’s just too much distortion. Hopefully, MotionDSP will release an edition at a price scaled to the amateur stunt man. ®

Beginner's guide to SSL certificates

More from The Register

next story
NSA SOURCE CODE LEAK: Information slurp tools to appear online
Now you can run your own intelligence agency
Azure TITSUP caused by INFINITE LOOP
Fat fingered geo-block kept Aussies in the dark
Yahoo! blames! MONSTER! email! OUTAGE! on! CUT! CABLE! bungle!
Weekend woe for BT as telco struggles to restore service
Cloud unicorns are extinct so DiData cloud mess was YOUR fault
Applications need to be built to handle TITSUP incidents
Stop the IoT revolution! We need to figure out packet sizes first
Researchers test 802.15.4 and find we know nuh-think! about large scale sensor network ops
Turnbull should spare us all airline-magazine-grade cloud hype
Box-hugger is not a dirty word, Minister. Box-huggers make the cloud WORK
SanDisk vows: We'll have a 16TB SSD WHOPPER by 2016
Flash WORM has a serious use for archived photos and videos
Astro-boffins start opening universe simulation data
Got a supercomputer? Want to simulate a universe? Here you go
Microsoft adds video offering to Office 365. Oh NOES, you'll need Adobe Flash
Lovely presentations... but not on your Flash-hating mobe
prev story

Whitepapers

Go beyond APM with real-time IT operations analytics
How IT operations teams can harness the wealth of wire data already flowing through their environment for real-time operational intelligence.
Forging a new future with identity relationship management
Learn about ForgeRock's next generation IRM platform and how it is designed to empower CEOS's and enterprises to engage with consumers.
10 threats to successful enterprise endpoint backup
10 threats to a successful backup including issues with BYOD, slow backups and ineffective security.
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?
Security and trust: The backbone of doing business over the internet
Explores the current state of website security and the contributions Symantec is making to help organizations protect critical data and build trust with customers.