Feeds

New patent will give iPhone screen interactive 3D

Apple's three-dimensional UI will make cash objects sink into the abyss

Beginner's guide to SSL certificates

iPhones of the future could have virtual 3D interfaces that will detect and respond to the movements of your eyes, revealed an Apple patent granted today.

The newly patented technology would also allow for a world-behind-the-screen experience with the user's fingers appearing to reach into a space behind the glass.

Mashing up Kinect-style 3D motion sensing with facial recognition and an awareness of ambient light, the screen would react to where your eyes move and expand icons as your gaze passes over them.

Objects like icons would also cast shadows according to how the ambient light falls on the screen, creating a hyper-realistic 3rd dimension to the gadget interface.

Apple's 3D interface, credit US Patent Office

Apple's 3D interface would render using input from your eyes

Apart from reducing fanbois to a gurgling iPhone fingering trance, uses of the new 3D eye-tracking technology would include immersive gaming experiences and a new paradigm in user interfaces.

The 3D user interface would be controlled in real-time by the position and direction of the user's gaze, as measured by sensors. Tightly integrated Kinect-style sensors would use information about the iPhone's spatial position to create another space behind the screen - locations in a three dimensional user interface, called a "virtual 3D operating system environment".

Apple describe one possible user interface as a three dimensional “bento box” that would let you turn the screen around and peer inside the boxes:

It is possible to render the virtual 3D operating system environment as having a recessed "bento box" form factor inside the display. [...] As the user rotates the device, he or she could look into each "cubby hole" of the bento box independently. It would also then be possible, via the use of a front-facing camera, to have visual "spotlight" effects follow the user's gaze, i.e., by having the spotlight effect "shine" on the place in the display that the user is currently looking into.

The patent describes how users could even see "behind" the virtual objects in the operating system environment.

The object wouldn't just appear to be 3D, it would behave as if it were 3D too. The patent describes the finger-through-the-screen concept:

[T]he techniques would make it possible to simulate collision effects and other physical manifestations of reality within the virtual 3D operating system environment

Apple's behind the screen touch tech, credit US Patent Office

Apple's behind the screen touch tech

The position sensors would include a compass, an accelerometer, a GPS module, and a gyrometer, while optical sensors for the facial recognition would include an image sensor and a video camera.

The patent says that this three dimensional user interface could be applied to phones, tablets, portable music devices, televisions, gaming devices, laptops or desktops. ®

Filed in April 2010, the patent 'Three Dimensional User Interface Effects on a Display by Using Properties of Motion', No: 20120036433 was granted today by the US Patent office.

Secure remote control for conventional and virtual desktops

More from The Register

next story
Phones 4u slips into administration after EE cuts ties with Brit mobe retailer
More than 5,500 jobs could be axed if rescue mission fails
JINGS! Microsoft Bing called Scots indyref RIGHT!
Redmond sporran metrics get one in the ten ring
Driving with an Apple Watch could land you with a £100 FINE
Bad news for tech-addicted fanbois behind the wheel
Phones 4u website DIES as wounded mobe retailer struggles to stay above water
Founder blames 'ruthless network partners' for implosion
Sony says year's losses will be FOUR TIMES DEEPER than thought
Losses of more than $2 BILLION loom over troubled Japanese corp
Radio hams can encrypt, in emergencies, says Ofcom
Consultation promises new spectrum and hints at relaxed licence conditions
Why Oracle CEO Larry Ellison had to go ... Except he hasn't
Silicon Valley's veteran seadog in piratical Putin impression
Big Content Australia just blew a big hole in its credibility
AHEDA's research on average content prices did not expose methodology, so appears less than rigourous
prev story

Whitepapers

Secure remote control for conventional and virtual desktops
Balancing user privacy and privileged access, in accordance with compliance frameworks and legislation. Evaluating any potential remote control choice.
WIN a very cool portable ZX Spectrum
Win a one-off portable Spectrum built by legendary hardware hacker Ben Heck
Storage capacity and performance optimization at Mizuno USA
Mizuno USA turn to Tegile storage technology to solve both their SAN and backup issues.
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?
The next step in data security
With recent increased privacy concerns and computers becoming more powerful, the chance of hackers being able to crack smaller-sized RSA keys increases.