Feeds

Boffins fill a dome with 480 cameras for 3D motion capture

'Panoptic studio' doesn't need no stinkin' sensors

Providing a secure and efficient Helpdesk

Video Move over Gollum: Carnegie-Mellon boffins are working on 3D motion capture that works without tracking sensors, and can pull together images from hundreds of sensors.

Their work, documented in full here, goes way beyond the motion capture tricks that let Peter Jackson give Gollum and King Kong to the world: they put their subject inside a geodisic dome, and capture their movements with 480 cameras.

With that many input images plus the ability to identify thousands of tracking points in any given image, the system is able to work with 100,000 points at a time without markers, and track those through hundreds of frames. Since a lot of that ends up as noise, a big chunk of the smarts of the system exists to decide what to include and what to exclude from the final capture.

The university says the two-story dome – the Panoptic Studio – has been used to capture activities as diverse as volleyball games, air currents and “a cascade of confetti”.

To eliminate data that doesn't need to be included, the software estimates visibility based on cues from motion. The system tries to identify patterns it can use as tracking points, and for each point, “the system then seeks to determine which cameras see motion that is consistent with that point”.

Carnegie-Mellon's Panoptic Studio

Carnegie-Mellon's Panoptic Studio

Hence if a tracking point becomes invisible to a particular camera, the input from that camera can be ignored (incidentally reducing the processing load on the system).

The MAP – maximum a posteriori – system “increases tracking performance producing longer trajectories, at more locations, and at higher accuracies than methods that ignore visibility or use photometric consistency alone”, the researchers write in their paper.

A bat swing captured by MAP

The swing of a baseball bat, reconstructed by MAP

The Register imagines at least one possible application that will have game studios keenly interested in the technology. Outside the dome, the researchers speculate that the system could be applied to motion capture on an even larger scale. For example, hundreds of camera-phones capturing live sports could become the input images to MAP, rather than the controlled environment of the Panoptic Studio. ®

Youtube Video

Internet Security Threat Report 2014

More from The Register

next story
MARS NEEDS WOMEN, claims NASA pseudo 'naut: They eat less
'Some might find this idea offensive' boffin admits
SECRET U.S. 'SPACE WARPLANE' set to return from SPY MISSION
Robot minishuttle X-37B returns after almost 2 years in orbit
LOHAN crash lands on CNN
Overflies Die Welt en route to lively US news vid
Experts brand LOHAN's squeaky-clean box
Phytosanitary treatment renders Vulture 2 crate fit for export
You can crunch it all you like, but the answer is NOT always in the data
Hear that, 'data journalists'? Our analytics prof holds forth
No sail: NASA spikes Sunjammer
'Solar sail' demonstrator project binned
America's super-secret X-37B plane returns to Earth after nearly TWO YEARS aloft
674 days in space for US Air Force's mystery orbital vehicle
Carry On Cosmonaut: Willful Child is a poor taste Star Trek parody
Cringeworthy, crude and crass jokes abound in Steven Erikson’s sci-fi debut
Origins of SEXUAL INTERCOURSE fished out of SCOTTISH LAKE
Fossil find proves it first happened 385 million years ago
prev story

Whitepapers

Forging a new future with identity relationship management
Learn about ForgeRock's next generation IRM platform and how it is designed to empower CEOS's and enterprises to engage with consumers.
Why and how to choose the right cloud vendor
The benefits of cloud-based storage in your processes. Eliminate onsite, disk-based backup and archiving in favor of cloud-based data protection.
Three 1TB solid state scorchers up for grabs
Big SSDs can be expensive but think big and think free because you could be the lucky winner of one of three 1TB Samsung SSD 840 EVO drives that we’re giving away worth over £300 apiece.
Reg Reader Research: SaaS based Email and Office Productivity Tools
Read this Reg reader report which provides advice and guidance for SMBs towards the use of SaaS based email and Office productivity tools.
Security for virtualized datacentres
Legacy security solutions are inefficient due to the architectural differences between physical and virtual environments.