The Register® — Biting the hand that feeds IT

Feeds

Android app logs keystrokes using phone movements

Touchscreen side-channel hack

Regcast training : Hyper-V 3.0, VM high availability and disaster recovery

Computer scientists have developed an Android app that logs keystrokes using a smartphone's sensors to measure the locations a user taps on the touch screen.

TouchLogger, as their demo app is dubbed, allowed its creators at the University of California at Davis to demonstrate a vulnerability in smartphones and tablets that has largely gone unnoticed: While most of these devices lack physical keyboards that have long been known to leak user input, they nonetheless remain susceptible to monitoring through similar side-channel attacks.

Whereas eavesdroppers measure sound and electromagnetic emanation to capture input from traditional keyboards, they can monitor the motion of the device to achieve much the same result from a touch screen.

“Our insight is that motion sensors, such as accelerometers and gyroscopes, may be used to infer keystrokes,” the researchers wrote in a paper (PDF here) presented last week at the HotSec'11 workshop in San Francisco. “When the user types on the soft keyboard on her smartphone (especially when she holds her phone by hand rather than placing it on a fixed surface), the phone vibrates. We discover that keystroke vibration on touch screens are highly correlated to the keys being typed.”

Screen shot of Android data collecting app

User interface for data collection app

Applications like TouchLogger could be significant because they bypasses protections built into both Android and Apple's competing iOS that prevent a program from reading keystrokes unless it's active and receives focus from the screen. It was designed to work on an HTC Evo 4G smartphone. It had an accuracy rate of more than 70 percent of the input typed into the number-only soft keyboard of the device. The app worked by using the phone's accelerometer to gauge the motion of the device each time a soft key was pressed.

With minor refinements, the researchers believe they can expand the effectiveness of TouchLogger, as well as the devices it will work on.

“The tablet has a larger screen, so hopefully we can get a higher accuracy rate on a qwerty keyboard,” said Liang Cai, a graduate student in UC Davis's computer science department who collaborated with his advisor Hao Chen. “We didn't really try it on a large scale of devices.”

Besides targeting devices with larger touch screens, the researchers said TouchLogger could also be improved by tapping other sensors built into the targeted device. Prime candidates include gyroscopes to measure the rate of rotation and a camera to further detect motion. The scientists noted that the W3C recently published a specification for web applications to access accelerometer and gyroscope sensors using JavaScript. They are in the process of extending their work into a full research project.

For now, they hope to get the word out that the motion detected by a smart device's own sensors could expose highly valuable information, including passwords, social security numbers and credit card numbers.

“We hope to raise the awareness of motion as a significant side channel that may leak confidential data,” they wrote. ®

Agentless Backup is Not a Myth

Is this too obvious?

I would think the obvious solution would be to allow only the active in focus application to get feeds from the Gyroscope & camera, the same as they only allow the active and in focus application to access the keyboard buffer.

4
0

I don't THINK it'll work on my Galaxy S

I use the "Swype" input system and even it doesn't hit 70% accuracy some days...

2
0

Security threat, or feature?

As opposed to saying "oh god, this is horrible", could it be used to implement an alternative input method that lets people type on the back of the device, rather than having their fingers in the way of the screen? (I know there are devices with touchscreens on the back, but this sounds like a less accurate but possibly useful alternative.)

1
0

More from The Register

 breaking news
Number of cops abusing Police National Computer access on the rise
Only a telegram from the Queen can get you off it
 breaking news
NSA PRISM snoop-gate: Won't someone think of the children, wails Apple
10,000 things probed, mostly about missing kids, Alzheimer patients, we're told
Flash flaw potentially makes every webcam or laptop a PEEPHOLE
But it's a Google problem - Chrome only, insists Adobe
 breaking news
NSA PRISM-gate: Relax, GCHQ spooks 'keep us safe', says Cameron
Whatever they are up to, it's all above board, we're told
PRISM snitch claims NSA hacked Chinese targets since 2009
Snowden suddenly looks safer in Hong Kong after revelations
 breaking news
US chief spook: Look, we only want to spy on 6.66 BEELLLION of you
Americans assured they are not in the NSA's sights
Speech-to-text drives motorists to distraction
Will talking to you mean I crash into that car up ahead, Siri?
 breaking news
Yahoo! joins! rivals! in! PRISM! data! request! admission!
Keep calm and carry on using American tech firms, folks
DHS warns of vulns in hospital medical equipment
Has your doctor's anasthesia machine been hacked?
 breaking news
'BadNews is malware' says outfit that found it
Google says code harmless but Lookout says code base is evolving