Feeds

Boffins fill a dome with 480 cameras for 3D motion capture

'Panoptic studio' doesn't need no stinkin' sensors

Internet Security Threat Report 2014

Video Move over Gollum: Carnegie-Mellon boffins are working on 3D motion capture that works without tracking sensors, and can pull together images from hundreds of sensors.

Their work, documented in full here, goes way beyond the motion capture tricks that let Peter Jackson give Gollum and King Kong to the world: they put their subject inside a geodisic dome, and capture their movements with 480 cameras.

With that many input images plus the ability to identify thousands of tracking points in any given image, the system is able to work with 100,000 points at a time without markers, and track those through hundreds of frames. Since a lot of that ends up as noise, a big chunk of the smarts of the system exists to decide what to include and what to exclude from the final capture.

The university says the two-story dome – the Panoptic Studio – has been used to capture activities as diverse as volleyball games, air currents and “a cascade of confetti”.

To eliminate data that doesn't need to be included, the software estimates visibility based on cues from motion. The system tries to identify patterns it can use as tracking points, and for each point, “the system then seeks to determine which cameras see motion that is consistent with that point”.

Carnegie-Mellon's Panoptic Studio

Carnegie-Mellon's Panoptic Studio

Hence if a tracking point becomes invisible to a particular camera, the input from that camera can be ignored (incidentally reducing the processing load on the system).

The MAP – maximum a posteriori – system “increases tracking performance producing longer trajectories, at more locations, and at higher accuracies than methods that ignore visibility or use photometric consistency alone”, the researchers write in their paper.

A bat swing captured by MAP

The swing of a baseball bat, reconstructed by MAP

The Register imagines at least one possible application that will have game studios keenly interested in the technology. Outside the dome, the researchers speculate that the system could be applied to motion capture on an even larger scale. For example, hundreds of camera-phones capturing live sports could become the input images to MAP, rather than the controlled environment of the Panoptic Studio. ®

Youtube Video

Remote control for virtualized desktops

More from The Register

next story
Rosetta probot drilling DENIED: Philae has its 'LEG in the AIR'
NOT best position for scientific fulfillment
'Yes, yes... YES!' Philae lands on COMET 67P
Plucky probot aces landing on high-speed space rock - emotional scenes in Darmstadt
FORGET the CLIMATE: FATTIES are a MUCH BIGGER problem - study
Fat guy? Drink or smoke? You're worse than a TERRORIST
THERE it is! Philae comet lander FOUND in EXISTING Rosetta PICS
Crumb? Pixel? ALIEN? Better, it's a comet-catcher!
SEX BEAST SEALS may be egging each other on to ATTACK PENGUINS
Boffin: 'I think the behaviour is increasing in frequency'
HUMAN DNA 'will be FOUND ON MOON' – rocking boffin Brian Cox
Crowdfund plan to stimulate Blighty's space programme
Post-pub nosh neckfiller: The MIGHTY Scotch egg
Off to the boozer? This delicacy might help mitigate the effects
I'M SO SORRY, sobs Rosetta Brit boffin in 'sexist' sexy shirt storm
'He is just being himself' says proud mum of larger-than-life physicist
NASA launches new climate model at SC14
75 days of supercomputing later ...
prev story

Whitepapers

Why cloud backup?
Combining the latest advancements in disk-based backup with secure, integrated, cloud technologies offer organizations fast and assured recovery of their critical enterprise data.
Getting started with customer-focused identity management
Learn why identity is a fundamental requirement to digital growth, and how without it there is no way to identify and engage customers in a meaningful way.
Reg Reader Research: SaaS based Email and Office Productivity Tools
Read this Reg reader report which provides advice and guidance for SMBs towards the use of SaaS based email and Office productivity tools.
Website security in corporate America
Find out how you rank among other IT managers testing your website's vulnerabilities.
Top 5 reasons to deploy VMware with Tegile
Data demand and the rise of virtualization is challenging IT teams to deliver storage performance, scalability and capacity that can keep up, while maximizing efficiency.