Oblong G-Speak

The link below includes a video demonstration of gesture based computer interface technology that is similar to the fictional interface shown in “Minority Report”.

Oblong G-Speak

The SOE’s combination of gestural i/o, recombinant networking, and real-world pixels brings the first major step in computer interface since 1984; starting today, g-speak will fundamentally change the way people use machines at work, in the living room, in conference rooms, in vehicles. The g-speak platform is a complete application development and execution environment that redresses the dire constriction of human intent imposed by traditional GUIs. Its idiom of spatial immediacy and information responsive to real-world geometry enables a necessary new kind of work: data-intensive, embodied, real-time, predicated on universal human expertise.

The Spatial Operating Environment

The g-speak platform provides three core functional components:

Gestural I/O
Hi-fi input for HD output

The g-speak platform is built around free-hand, three-space gestural input. Applications are controlled by hand poses, movement and pointing. Finger and hand motion are tracked to 0.1mm at 100 hz; pointing is pixel-accurate. Two-handed and multi-user input are fully supported.

Gestural I/O removes the imbalance between high-definition graphical output available from modern computers and the narrow input channel of the mouse and keyboard. Gestural input is measurably more efficient at performing complex navigation, sorting and selection tasks. A full library of components providing UI building blocks makes it easy for application programmers to take advantage of gestural benefits.

The g-speak input framework provides for mouse and keyboard use, too. Applications built to take advantage of gestural I/O also make use of legacy input devices when appropriate.

Recombinant Networking
Structured coordination and data interchange

SOE applications process large data sets and support multi-person work-flows. The g-speak networking framework provides a collection of core library components that allow applications to scale transparently and dynamically across clusters of machines.

This transparent scalability offers three major benefits: effective use of cpu power in a LAN environment; built-in support for applications that enable collaborative work across the network; and the ability to add functionality to applications at run-time by adding new code, new machines, new screens and new people to a work context.

The recombinant networking framework also provides a set of tools for integrating legacy applications into a g-speak environment. Existing code bases automatically benefit from network transparency and limited gestural input. A low-overhead legacy extension architecture makes it possible to build support for full gestural I/O and spatial semantics with very little new code.

Real-world Pixels
Spatial semantics at the platform level

Every graphical and input object in a g-speak environment has real-world spatial identity and position. Anything on-screen can be manipulated directly. For a g-speak user, “pointing” is literal.

The g-speak implementation of spatial semantics provides application programmers with a single, ready-made solution to the interlocking problems of supporting multiple screens and multiple users. It also makes control of real-world objects (vehicles, robotic devices) trivial and allows tangible interfaces and customized physical tools to be used for input.

The g-speak platform is display agnostic. Wall-sized projection screens co-exist with desktop monitors, table-top screens and hand-held devices. Every display can be used simultaneously and data moves selectively to the displays that are most appropriate. Three-dimensional displays can be used, too, without modification to application code.

Leave a Reply

You must be logged in to post a comment.