Apple pen-tablet plan revives Newtonian handwriting
Microcosmic God at work
An Apple patent filing may point to pen-based handwriting recognition in Cupertino's oft-rumored tablet/netbook/media-pad/ebook/whatever.
Or it may not.
Published on Thursday, the filing carries the rather prosaic appellation: "Method and Apparatus for Acquiring and Organizing Ink Information in Pen-Aware Computer Systems"
The Reg spoke with one of the patent's authors, Larry Yaeger, who was the technical lead on the development of the Apple Newton's second-generation handwriting-recognition technology, known as Print Recognizer and remembered by Newtonians as the one that worked - as opposed to the much-ridiculed first-generation system that helped sink the pioneering Apple handheld.
According to Yaeger, today's patent filing contains a rework and resubmission of rejected portions of an earlier Apple handwriting-recognition patent, number 7,564,995, "Method and apparatus for acquiring and organizing ink information in pen-aware computer systems," which was filed in March 2000 and awarded in July 2009 - "if I am parsing the uspto.gov web site correctly," says Yaeger.
When asked if today's patent filing might mean that pen-based handwriting recognition would be included in Apple's rumored tablet, Yaeger - who has left Apple and is now Professor of Informatics at Indiana University - told The Reg: "I don't know - and believe me I wish I did."
Today's filing is fiendishly complex, but essentially it describes a recognition technology based on a system able to identify not merely a pen's strokes, but to organize those strokes into what the filing describes as "ink phrases." An "ink manager," which includes an "ink phrase termination engine", passes the ink phrase to a handwriting recognition manager, which parses the identified phrase, identifies its meaning, and passes it off to an ink-enabled application.
One advantage of phrase-based recognition, according to the filing, is that such as system can more-easily associate the content of a user's strokes with the context of a form, display area, or field, even when "one or more ink strokes (including the first ink stroke) is wholly or partially outside of the input field."
An illustration lifted and gussied-up from the original 2000 filing for use in today's version indicates how different areas on a tablet's display can be identified by the ink manager. The filing also notes that the ink phrase termination engine can determine when a stroke phrase has been completed in a designated area, thus helping increase the accuracy of the stroke-phrase recognition.

A tablet's display can help identify whether a pen-input phrase has been completed
Although such gesture-based, multi-touch interfaces as used in Apple's iPhone and iPod touch - and, for that matter, MacBook trackpads - have the unarguable convenience of finger-tip control, pen-based input can be far more precise.
And Apple hasn't abandoned pen-based input entirely. Take a look, for example, inside your Mac's System/Library/PreferencePanes folder, and you'll find an item labled Ink.prefPane. It's waiting there for you to hook up a compatible graphics tablet. Doing so will fire up Mac OS X's built-in handwriting-recognition technology, Inkwell, which not only will convert your handwriting into English, French, or German text, but which also supports editing gestures for selecting, editing, and deleting text.
And so if Mac OS X is ready for handwriting recognition, will an upcoming tablet incude it as an optional text-entry method? Doing so could not only allow for text entry in a manner more comfortable to some than an on-screen soft keyboard as used by the iPhone and iPod touch, but could also better support forms-based input that could find the tablet a home in medical, industrial, and transportation settings.
Yaeger hopes so. Understandably, he'd like to see his work find a home in a ground-breaking Apple product. "I really, really hope it's a pen-based tablet computer," he told The Reg, but again admitted "but I just don't know."
But - like any true Apple-gadget lover - Yaeger wants more; namely, a tablet that'd also allow him to carry his reading collection. "The thought of an Apple-provided pen-based tablet computer that's also the world's best ebook reader would be a dream come true," he mused. ®
Bootnote
When Larry Yaeger was a Distinguished Scientist at Apple's Advanced Technology Group - the highest position on Cupertino's technical track - his business card gave his title as Microcosmic God. Ah, Apple in the good ol' freewheeling 1990s...
COMMENTS
@Wilko1980
I think AC is talking about devices worth it. If the device is useless for most other stuff (except calling and SMS) then what good is HWR?? Handwrite your SMS? LOL
Nokia's are good for SMS and phone only, AFAIK (have had a few, never tested HWR on 'em, though), and I assume the other 4 are Nokia's!
Keyboard, because I had a giggle reading the comments ...
HWR on phones.
@ AC:
My phone has handwriting recognition, and it's pretty good (the phone sucks but the HWR is good - its a Nokia 5800 if you're wondering).
You obviously haven't been looking hard enough, I can think of at least 5 phones with HWR, most significantly better than mine.
THANK GOD!
DAMN IT'S ABOUT TIME! Every time a PDA or phone is released the *first* thing I look to see is if it has hand writing recognition and it never does darnit! I have become increasingly annoyed wondering why the heck no ones makes one. The technology has been around since the Newton! I want an electronic notepad! I want to write not peck! I have yet to buy a hand held device because of this.
Inkwell finally put to good use?
When Inkwell came out in 10.2 -- or possibly 10.3 -- I thought that Apple was imminently releasing a tablet or PDA or whatever. Since then it's been sitting there like a .... sitting thing, forgotten like something I can't remember the name of, and abandoned like a campaign promise.
(Knew I'd get one in eventually.)
@David Edwards
@David Edwards:
I wouldn't spend to much time worrying about Microsofts Courier, it's nothing more than a CGI rendering.
