We've detected that you're using an ad content blocking browser plug-in or feature. Ads provide a critical source of revenue to the continued operation of Silicon Investor. We ask that you disable ad blocking while on Silicon
Investor in the best interests of our community. If you are not using an ad blocker but are still receiving this message, make sure your browser's tracking protection is set to the 'standard' level.
Pure Boffinry: The Lumia 1020 Viewed from Vulture Central ...
My favorite tech writer and Brit Wit who once was their 'man in San Francisco' and today is El Regs' Editor, made the trek from London to NYC for the 'Zoom Reinvented' event. It should be noted that AO is not a Nokia or Microsoft fanboy and has been highly critical of both Nokia and the 'Beast from Redmond' who he covered closely in his Valley days from time to time.
I generally try not to dual post but this one will also wind up on the SI Camera Phone board. The 1st article is pretty darned good.
The 1st minute of the video embedded below shows the 'Zoom Reinvented' demo area and gives an impression of the effort that Nokia put into preparing for the event.
>> Pure boffinry: We peek inside Nokia's miracle cameraphone
Special Report: These days, “tech” means anything except technology. The word has become so debased that a group of marketing people talking about their ideas for websites are a “tech scene”. And hosting meetings for marketing people to talk about websites in London in 2013 actually makes you a “tech entrepreneur”. The concerns of real engineering innovators take second place to the needs of the Magic Roundabout. So it’s almost shocking in 2013 to see real engineers pushing the limits and producing something with the capacity to startle.
Last week we saw Europe’s biggest tech company, Nokia, do just that, with its Lumia 1020 phone. The device breaks several barriers for miniature cameras, and it’s the convergence of several technology projects that only a large company with an expensive, long term R&D engineering commitment could undertake. It’s the miniaturisation that’s the deal here. It’s so extreme, it’s quite hard to comprehend. It’s utterly insane.
But it comes with a base price of £20,000 and it weighs 2.3kg – the larger lenses you’ll need will cost you more and weigh more too. Similarly, if space is not a serious constraint, then every camera would use optical zoom.
Nokia’s engineers operate within very demanding cost and space constraints. Nokia is not making a standalone phone, but a tiny unit that must conform to the price and size constraints of the phone market, a market which will not buy bulky or freakish designs in significant numbers.
Here’s the camera unit itself: it contains 100 parts, is 10mm tall and is apparently larger than the phone itself when you place them side by side. What’s even more astonishing is that there are no compromises.
You could forgive Nokia for introducing a cut-down on the oversampling technology it already had, or the image stabilisation unit it had already made, just to keep the cost or size down. Many predicted this was what Nokia would actually do: a similar but lower fidelity version of what was on the market. But in fact it’s improved on both main technologies in this tiny package.
-- A schematic view of the Lumia 1020 imaging unit, which constrains over 100 parts. Ball bearings isolate the lenses giving hardware stabilisation. The Lumia 920 used a spring. --
With the help of Juha Alakarhu, lead engineer for the project, and his boss imaging chief Eero Salmelin [co-invenrors of PureView], I found out how they did that:
Four discrete technology projects converge on this product. Three have appeared before, but never together or in such a slimline package. These are the oversampling sensor, the floating OIS technology and the audio recording system. The new tech comes in the form of a new kind of Xenon flash - prior models which incorporated Xenon flashes used tubular capacitors, while this model uses flat capacitors to shave millimetres off the space required to jam in all the components.
Each technology is the culmination of many years of work and partnerships with specialist suppliers, whose engineers in turn had to do something new and unusual with their expertise. The product constraint was a unit 10mm tall. As a consequence every part of the 1020 is new, and nothing could be reused from earlier products.
Two less-highlighted technologies in the 1020 each illustrate the necessity for long-term R&D and the need for partnerships to produce bespoke hardware. Both are a case of Nokia requiring others to push the limits of what they can do. These are the flash unit and the audio recording technology.
Nokia’s Rich Recording audio system (PDF) has a wide dynamic range, capable of recording whispers alongside gunshots, and no distortion in a range of sound pressure ranging from 33 dB (Sound Pressure Level) to 140dB (SPL). The sound of a watch ticking is 30 dB SPL and the human pain threshold around 120 dB SPL.
To miniaturise this required the design and production of custom High Amplitude Audio Capture microphones. Xenon flash, which gives a burst around 100 times as bright as that of an LED, is very rarely seen on smartphones for cost and size reasons.
Nokia insisted on having it, and this in turn required miniaturising conventional tubular Xenon capacitors - inevitably replaced with flat capacitors.
Six lenses, one huge sensor
-- A model of the six lenses inside the Lumia 1020 imaging unit --
The two main imaging technology projects are a miniature version of a floating image unit seen on dedicated equipment, and a huge sensor. Last year’s Lumia’s 920 introduced an optical image stabilisation OIS system, with the unit floating on gyroscopes and sensors compensating for hand movement.
The point of this was to give smoother video recording and better low light photography, since the shutter on a steadier, isolated unit can be held open for longer, absorbing more information. The 920’s OIS was much smaller than those found on dedicated cameras and this one is even smaller. So the second-generation OIS uses ball bearings rather than gyros. The device achieves another demanding requirement – it leaves the shutter open longer than the 920.
Most of the 100+ components in the Lumia 1020 camera unit perform an OIS function. The Nokia engineers said OIS was the hardest to perfect, since the lens has to move in the X-Y dimensions on the ball bearing mounts. At this scale, it also requires new and complex manufacturing techniques – which is why Nokia’s R&D will maintain a lead over rivals for some considerable time.
The huge sensor was a long-term project, begun in 2007, to improve mobile photography. The space constraints preclude physical optical lenses, so capturing accurate detail and smooth zooming must be performed by miniature hardware and offloaded onto powerful CPUs and GPUs in modern smartphones. Which is easier said than done.
Most megapixel specifications on mobile phones are a lie: the final photograph has far fewer bytes than the sensor recorded. That’s because the imaging units take one colour per pixel and then estimate the missing colours using Bayer interpolation, a technique named after the Eastman Kodak scientist who devised and patented it, Bryce Beyer. So an 8MP camera doesn’t produce an 8MP image – each pixel is a single colour and much else is used for interpolation – aka, guessing – then thrown away.
But if you make the sensor larger, then the less guessing is required, and the picture can be more true to life. A large sensor and powerful hardware can also deliver a very smooth and faithful zoom carried out in software, rather than using huge physical lenses.
The “needle in a haystack” zoom is a party trick of the 808, and plays on our experience of zooming in on a digital image only to find blur and artefacts. Zooming in an 808 image reveals only more and more accurate detail.
After five years the huge sensor appeared in last year’s PureView 808, which had a dedicated GPU for performing the intense computation required, while giving lag-free operation, as no standard part permitted the required throughput.
The advances in mobile GPUs are now sufficient for everything to be carried out in software – while the PureView 808 required a custom GPU. Although as I discovered, this required dedicated drivers and Nokia and Qualcomm engineers re-writing the off-the-shelf imaging stack for such hardware.
The result was 5MP of far greater depth, accuracy and fidelity. Compare Nokia’s Lumia 925 – the best modern smartphone camera you can buy today – with the PureView 808.
So the phone makes a “master recording” capturing a 35MP or 38MP image, and instantly produces a 5MP version for manipulation and sharing.
The 1020 packs six lenses into the unit, posing another manufacturing challenge: both sides of the tiny lenses have to be aligned very accurately, and they have to be robust in everyday conditions. The manufacturing lines for the 1020 were different to the 808, “and we have the OIS actuators and gyros move in X-Y dimension on the ball bearings,” say Alakarhu and Salmelin.
Asked how it could shrink so much, Nokia listed the following. I presume the order reflects the importance of each change, although Nokia's engineers cautioned that, “like heartburn, there’s not one single element that makes the big difference”.
Nokia’s walkthrough of the new Pro Camera app
Firstly, a backside illuminated sensor was used - a smaller unit than the frontsize illuminated sensor. Secondly much more advanced manufacturing technology was deployed. Thirdly, the engineers decided to spread the components horizontally, rather than stack them vertically. The switch from ball bearings to springs helped, as did the new flat Xenon flash capacitors.
Nokia has done a pretty good job with its Pro Camera of providing a "one click" UI with one that brings out the powerful capabilities of a real camera, with easy access to exposure, light settings
Asked if the rigid hardware control of Windows Phone had been an additional constraint Alakarhu replied: “Windows Phone is not limiting us in any way. It’s the other way around”.
So. Was it worth it?
You can forgive Nokia crowing a little about the imaging technology here, which is the culmination of trying to produce engineering answers to completely unreasonable marketing requirements. Comparing notes after technical sessions, I would say it’s some years since journalists came away from a launch quite so impressed.
There’s a kind of insanity in trying to overcome such engineering challenges, when bending or removing the constraint would have been so much easier. Make the unit bigger. Make it less sensitive. The punter won’t mind.
Yet the result gives Nokia an imaging lead over Samsung and Apple that’s it is likely to maintain for some time. It may lag in market adoption, or fart apps, but Nokia can boast the best photos by far – something that should filter down to less costly devices.
This is the kind of thing for which you need really resourceful and exacting hardware and software engineers – graphic designers don’t cut it – and Nokia's stuff isn’t copied easily. ®
>> Nokia tears wrapper off Lumia 1020 monster imaging mobe
New York debut of EOS (though internet's been ogling her for days)
Hands On: Nokia brought its unique home-brewed imaging technology to a modern smartphone today. By a comfortable distance, the new Lumia 1020, aka "EOS", has the most impressive camera and video recording on any mobile phone today.
We also had a tool around with the prototype at the New York launch today, which confirmed that Nokia has combined its two best bulky imaging technologies into a skinny, lightweight package.
As leaks suggested, the phone has a real mechanical shutter, as a real camera should.
The Lumia 1020 (product page here) features an enormous 41MP sensor, which captures 34MP and 38MP in 16:9 or 4:3 aspect ratio, and is simultaneously saving a 5MP image, which oversamples seven pixels into one super pixel.
The phone, however, also combines the mechanical stabilisation technology found in the Lumia 920 and 925, giving excellent low-light photos, and very steady video shooting. The oversampling technology made its debut in a Symbian phone last year.
Nokia has also managed to shrink the bulging 808 mechanics into a much slimmer package.
All this requires custom silicon – as the throughput of today’s off-the-shelf mobile GPUs falls far short of the bandwidth and processing requirements of oversampling from a huge sensor.
Nokia has also created a new camera app, ProCamera, giving a clever UI real-time feedback on advanced features like ISO and filtering options.
What's most impressive is that the technology is packed into such a light package. At around 158g, it's lighter than the 41MP PureView from last year and lighter than the 185g Lumia 920.
The first 41MP phone featured a bulging, Buster Gonads sensor unit, making the phone decidedly top-heavy. Impressively, Nokia has added the Optical Image Stabilisation technology yet managed to reduce this, so the sensor hardly protrudes at all. It isn't top-heavy. The weight reduction is pretty impressive.
-- Nokia's 1020 combines the huge sensor of the 808 with the Optical Image Stabilisation of the 920 and 925, but slims them down considerably. --
Nokia is selling a $79 Camera Grip add-on that turns the phone into a familiar consumer camera - with shutter control, tripod mount and extra 1020mAh battery. I also liked the fact the phone has a lanyard port, and this can be threaded through the Camera Grip. The Grip seems to be something you'd grab for a weekend away or when anticipating some dedicated shooting.
Nokia also opened the PureView imaging system up today via an SDK. App developers can now build PureView features into their software and let the enormous custom silicon do some heavy GPU lifting. A number of major names have already signed up, including Flipbard, Path, CNN and Yelp. No Instagram as yet.
US customers can pick up the 1020 for $299 on a two-year contract from 26 July.
China and many European markets will receive the EOS “this quarter”, by the end of September.
Nokia has had a hard job convincing the market to opt for its smartphones, which use a platform that, while growing, is still marginal - with a single-digit market share. At least with the 1020, it can now boast of features no rival can approach. ®
