DARPA working on eyes-in-the-back-of-your-head hat
'Full Sphere Awareness' to use software mini-cameras
Maverick Pentagon boffins have decided to build a miraculous gadget – perhaps as small and lightweight as a pair of sunglasses – which will endow the user with zoom vision, various forms of nightsight, and act as a heads-up display besides. Perhaps best of all, the proposed kit would also offer "full sphere awareness" – that is, eyes in the back of your head.
All this is to be achieved, according to the specifications for the new project, by the use of "computational cameras". These are a radical new approach to camera design, which will shift much of the burden of forming images – which is handled optically in today's cameras – into software.
According to the Soldier Centric Imaging via Computational Cameras (SCENICC) project documents:
The task of image formation may be more equitably shared among the optical and electronic/algorithmic elements of the camera system. The computational imaging paradigm seeks to exploit this realization in order to gain access to an entirely new region of camera design space.
The military researchers' ultimate goal is a miracle lightweight device which would provide all-around spherical vision out to 1km in high resolution and at a high framerate across the visual spectrum and well into the infrared bands used by thermal imagers and nightsights. However they might be willing to accept as a first step kit which merely improves hugely on that now on offer.
As an example, they give the current US issue M-22 binoculars, which are bulky, heavy and offer limited field-of-view and only 7x magnification. They say:
A preferred solution would operate hands-free, provide similar or better magnification on-demand, while providing FOV equal to that of the unaided eye, and incur [size, weight and power] cost comparable to that of current protective eyewear.
The miracle binocular-specs are referred to later on as Hands Free Zoom, which "aims to provide switchable stereoscopic telephoto vision in a compact form factor". It will be joined by Computer Enhanced Vision, which will allow a user to use any combination of ordinary vision, nightsight or thermal imagery and overlay this with weapon gunsights or other information. Finally, the SCENICC kit is to offer Full Sphere Awareness "providing automatic threat detection and cueing along with cross platform integration of novel visual information".
The radical new Computational Camera equipment – which will achieve all this without making a soldier's helmet too heavy to wear – will be much less optical and much more software driven. There are to be "soldier-specific software agents", "task-specific and/or adaptive processing", "optimal allocation of algorithmic functionality between focal plane and traditional computational resources", and "low power multi-core computation suitable for portable imaging applications".
As ever with this type of story, one should note that the funding agency is DARPA and thus chances of full success are small – DARPA's mission is to undertake high-risk projects. The famously extramurally-prandial* government boffins probably won't succeed in building their miracle eyes-in-the-back-of-your-head hat or headset; but one does note that DARPA was instrumental in producing the first ordinary night-vision kit. They may be similarly successful here.
The full SCENICC solicitation is here in pdf. ®
*Out to lunch
Obligitory Red Dwarf quote on Kryten becoming human....
K: My optical system doesn't appear to have a zoom function.
L: No, human eyes don't have a zoom.
K Well how do you bring a small object into sharp focus?
L: You just move your head closer to the object.
K: I see, move your head....closer to the object. Hmm. Oh right, OK. Well, what about other optical effects like split screen, slow motion, Quantel..?
L: Nah, we don't have them.
K: You don't have them? Just the zoom. No right that's fine, that's fine...
Been there, done that, seen it returned with "not interested" written on it
About a decade ago, I build a prototype very similar that provided a hemispherical (which we chose to essentially mean the ground up - this was really because the first lens/image reader combo I got my hands on to knock it together provided a hemisphere) view from any given location to a tiny tiny flip down screen that could be brought down to sit just above the wearer's eye. Turning your head would turn the view, thanks to the ickle inertial nav device I'd added; you could drive a tank with this thing without having to stick your head out, and ultimately could even have driven it remotely. The next step would have been giving the wearer multiple cameras to choose from (IR etc.) and link the whole lot back to a control station, enabling the provision of written text, photographs of targets, map overviews on request, the works.
The Uk gov rep. wasn't interested so we binned it.
Just the zoom!
What no split screen or Quantel ?
You'll be telling us the nipples don't work next.