Feeds

Pure boffinry: We peek inside Nokia's miracle cameraphone

How did they miniaturise a monster?

Build a business case: developing custom apps

Six lenses, one huge sensor

A model of the six lenses inside the Lumia 1020 imaging unit

The two main imaging technology projects are a miniature version of a floating image unit seen on dedicated equipment, and a huge sensor. Last year’s Lumia’s 920 introduced an optical image stabilisation OIS system, with the unit floating on gyroscopes and sensors compensating for hand movement.

The point of this was to give smoother video recording and better low light photography, since the shutter on a steadier, isolated unit can be held open for longer, absorbing more information. The 920’s OIS was much smaller than those found on dedicated cameras and this one is even smaller. So the second-generation OIS uses ball bearings rather than gyros. The device achieves another demanding requirement – it leaves the shutter open longer than the 920.

Most of the 100+ components in the Lumia 1020 camera unit perform an OIS function. The Nokia engineers said OIS was the hardest to perfect, since the lens has to move in the X-Y dimensions on the ball bearing mounts. At this scale, it also requires new and complex manufacturing techniques – which is why Nokia’s R&D will maintain a lead over rivals for some considerable time.

The huge sensor was a long-term project, begun in 2007, to improve mobile photography. The space constraints preclude physical optical lenses, so capturing accurate detail and smooth zooming must be performed by miniature hardware and offloaded onto powerful CPUs and GPUs in modern smartphones. Which is easier said than done.

Most megapixel specifications on mobile phones are a lie: the final photograph has far fewer bytes than the sensor recorded. That’s because the imaging units take one colour per pixel and then estimate the missing colours using Bayer interpolation, a technique named after the Eastman Kodak scientist who devised and patented it, Bryce Beyer. So an 8MP camera doesn’t produce an 8MP image – each pixel is a single colour and much else is used for interpolation – aka, guessing – then thrown away.

But if you make the sensor larger, then the less guessing is required, and the picture can be more true to life. A large sensor and powerful hardware can also deliver a very smooth and faithful zoom carried out in software, rather than using huge physical lenses.

The “needle in a haystack” zoom is a party trick of the 808, and plays on our experience of zooming in on a digital image only to find blur and artefacts. Zooming in an 808 image reveals only more and more accurate detail.

After five years the huge sensor appeared in last year’s PureView 808, which had a dedicated GPU for performing the intense computation required, while giving lag-free operation, as no standard part permitted the required throughput.

The advances in mobile GPUs are now sufficient for everything to be carried out in software – while the PureView 808 required a custom GPU. Although as I discovered, this required dedicated drivers and Nokia and Qualcomm engineers re-writing the off-the-shelf imaging stack for such hardware.

The result was 5MP of far greater depth, accuracy and fidelity. Compare Nokia’s Lumia 925 – the best modern smartphone camera you can buy today – with the PureView 808.

Example of detail captured by the 808 PureView

Example of detail captured by the 808 PureView, right, and the Lumia 925, left

So the phone makes a “master recording” capturing a 35MP or 38MP image, and instantly produces a 5MP version for manipulation and sharing.

The 1020 packs six lenses into the unit, posing another manufacturing challenge: both sides of the tiny lenses have to be aligned very accurately, and they have to be robust in everyday conditions. The manufacturing lines for the 1020 were different to the 808, “and we have the OIS actuators and gyros move in X-Y dimension on the ball bearings,” say Alakarhu and Salmelin.

Asked how it could shrink so much, Nokia listed the following. I presume the order reflects the importance of each change, although Nokia's engineers cautioned that, “like heartburn, there’s not one single element that makes the big difference”.

Nokia’s walkthrough of the new Pro Camera app

Firstly, a backside illuminated sensor was used - a smaller unit than the frontsize illuminated sensor. Secondly much more advanced manufacturing technology was deployed. Thirdly, the engineers decided to spread the components horizontally, rather than stack them vertically. The switch from ball bearings to springs helped, as did the new flat Xenon flash capacitors.

Nokia has done a pretty good job with its Pro Camera of providing a "one click" UI with one that brings out the powerful capabilities of a real camera, with easy access to exposure, light settings

Asked if the rigid hardware control of Windows Phone had been an additional constraint Alakarhu replied: “Windows Phone is not limiting us in any way. It’s the other way around”.

So. Was it worth it?

You can forgive Nokia crowing a little about the imaging technology here, which is the culmination of trying to produce engineering answers to completely unreasonable marketing requirements. Comparing notes after technical sessions, I would say it’s some years since journalists came away from a launch quite so impressed.

There’s a kind of insanity in trying to overcome such engineering challenges, when bending or removing the constraint would have been so much easier. Make the unit bigger. Make it less sensitive. The punter won’t mind.

Yet the result gives Nokia an imaging lead over Samsung and Apple that’s it is likely to maintain for some time. It may lag in market adoption, or fart apps, but Nokia can boast the best photos by far – something that should filter down to less costly devices.

This is the kind of thing for which you need really resourceful and exacting hardware and software engineers – graphic designers don’t cut it – and Nokia's stuff isn’t copied easily. ®

The essential guide to IT transformation

More from The Register

next story
Reg man looks through a Glass, darkly: Google's toy ploy or killer tech specs?
Tip: Put the shades on and you'll look less of a spanner
So, Apple won't sell cheap kit? Prepare the iOS garden wall WRECKING BALL
It can throw the low cost race if it looks to the cloud
Apple promises to lift Curse of the Drained iPhone 5 Battery
Have you tried turning it off and...? Never mind, here's a replacement
Now that's FIRE WIRE: HP recalls 6 MILLION burn-risk laptop cables
Right in the middle of Burning Mains Man week
One step closer to ROBOT BUTLERS: Dyson flashes vid of VACUUM SUCKER bot
Latest cleaner available for world+dog in September
Apple's iWatch? They cannae do it ... they don't have the POWER
Analyst predicts fanbois will have to wait until next year
HUGE iPAD? Maybe. HUGE ADVERTS? That's for SURE
Noo! Hand not big enough! Don't look at meee!
Samsung Gear S: Quick, LAUNCH IT – before Apple straps on iWatch
Full specs for wrist-mounted device here ... but who'll buy it?
AMD unveils 'single purpose' graphics card for PC gamers and NO ONE else
Chip maker claims the Radeon R9 285 is 'best in its class'
prev story

Whitepapers

Top 10 endpoint backup mistakes
Avoid the ten endpoint backup mistakes to ensure that your critical corporate data is protected and end user productivity is improved.
Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Backing up distributed data
Eliminating the redundant use of bandwidth and storage capacity and application consolidation in the modern data center.
The essential guide to IT transformation
ServiceNow discusses three IT transformations that can help CIOs automate IT services to transform IT and the enterprise
Next gen security for virtualised datacentres
Legacy security solutions are inefficient due to the architectural differences between physical and virtual environments.