Feeds

MS, Chinese boffins team up on Kinect-powered sign language recog

Big step forward for deaf and hard-of-hearing gamers

3 Big data security analytics techniques

Microsoft researchers are working with Chinese boffins to tap the XBox 360 Kinect motion sensor's body-tracking capabilities to provide sign language recognition capabilities for the deaf and hard-of-hearing.

Members of the Microsoft Research Asia team have produced a new paper (PDF, 2 pages, abstract) - Sign Language Recognition and Translation with Kinect - co-authored by researchers at the Institute of Computing Technology at the Chinese Academy of Sciences (CAS).

It explains that although sign language recognition has been researched for many years, it has been difficult to achieve accurately in non-control conditions, where background and lighting can vary considerably.

Special “data gloves” and web cams have also been required in previous attempts to make the technology work, but are “too expensive to popularise”, according to the paper.

Luckily for them, Kinect came along, as explained here:

Fortunately, Kinect is able to provide depth and colour data simultaneously, based on which the hand and body action can be tracked more accurate and easier. Therefore, 3D motion trajectory of each sign language vocabulary is aligned and matched between probe and gallery to get the recognised result.

First, the 3D trajectory of the signer’s hands is mapped thanks to a Kinect Windows SDK, then a resampling is done to get a normalised trajectory, taking account of differences in hand speed.

The result is then scored and matched with the closest result from a list of “gallery trajectories”.

The boffins have used their 3D trajectory matching algorithm to build a sign language recognition and translation system with two functions: translating sign language into text or speech, and translating text into sign language through a computer-generated avatar.

The Redmond PR machine has not been the best in publicising the firm’s cutting edge research and development in recent years, allowing Google and Apple to steal Microsoft’s thunder as the most innovative technology giants in Silicon Valley.

However, work like this with the potential for transforming people’s lives in a meaningful way, not just by making their smartphone apps easier to find, could help redress the balance.

For the record, the project was shown off at Microsoft’s Faculty Summit 2013 – an annual meeting bringing together 400 academics with Microsoft bods to discuss research insights.

®

SANS - Survey on application security programs

More from The Register

next story
Samsung Galaxy S5 fingerprint scanner hacked in just 4 DAYS
Sammy's newbie cooked slower than iPhone, also costs more to build
US mobile firms cave on kill switch, agree to install anti-theft code
Slow and kludgy rollout will protect corporate profits
Leaked pics show EMBIGGENED iPhone 6 screen
Fat-fingered fanbois rejoice over Chinternet snaps
Microsoft lobs pre-release Windows Phone 8.1 at devs who dare
App makers can load it before anyone else, but if they do they're stuck with it
Oh no, Joe: WinPhone users already griping over 8.1 mega-update
Hang on. Which bit of Developer Preview don't you understand?
Report: Apple seeking to raise iPhone 6 price by a HUNDRED BUCKS
'Well, that 5c experiment didn't go so well – let's try the other direction'
Rounded corners? Pah! Amazon's '3D phone has eye-tracking tech'
Now THAT'S what we call a proper new feature
Feast your PUNY eyes on highest resolution phone display EVER
Too much pixel dust for your strained eyeballs to handle
Hearthstone: Heroes of Warcraft – A jolly little war for lunchtime
Free-to-play WoW turn-based game when you have 20 minutes to kill
Zucker punched: Google gobbles Facebook-wooed Titan Aerospace
Up, up and away in my beautiful balloon flying broadband-bot
prev story

Whitepapers

Top three mobile application threats
Learn about three of the top mobile application security threats facing businesses today and recommendations on how to mitigate the risk.
Combat fraud and increase customer satisfaction
Based on their experience using HP ArcSight Enterprise Security Manager for IT security operations, Finansbank moved to HP ArcSight ESM for fraud management.
The benefits of software based PBX
Why you should break free from your proprietary PBX and how to leverage your existing server hardware.
Five 3D headsets to be won!
We were so impressed by the Durovis Dive headset we’ve asked the company to give some away to Reg readers.
SANS - Survey on application security programs
In this whitepaper learn about the state of application security programs and practices of 488 surveyed respondents, and discover how mature and effective these programs are.