ABSTRACT

Virtual keyboard is just another example of today’s computer trend of ‘smaller

and faster”. Computing is now not limited to desktop and laptops, it has found its

way into mobile device like palm top and even cell phones. But what has not

changed for the last 50 or so odd years is the input device, the good old

QWERTY keyboard.

The virtual keyboard technology is the latest development. The virtual keyboard

technology uses sensor technology and artificial intelligence to let users work on

any flat surface as if it were a keyboard. Virtual Keyboards lets you easily create

multilingual text content on almost any existing platform and output it directly to

PDAs or even webpages.

Virtual Keyboard, being a small, handy, well-designed and easy to use

application, turns into a perfect solution for cross platform text input.

The main features are: platform-independent multilingual support for keyboard

text input, built-in language layouts and settings, copy/paste etc.

system language settings, easy and user-friendly interface and design, and small

file size.

The report first gives an overview of the QWERTY keyboards and the

difficulties arising from using them. It then gives a description about the virtual

keyboard technology and the various types of virtual keyboards in use. Finally

drawbacks and the applications are discussed.

VIRTUALKEYBOARD

Virtual Keyboard is just another example of today’s computer trend of "smaller and

faster". Computing is now not limited to desktops and laptops, it has found its way

into mobile devices like palm tops and even cell phones. But what has not changed

for the last 50 or so odd years is the input device, the good old QWERTY

keyboard.

Alternatives came in the form of handwriting recognition, speech recognition, abcd

input (for SMS in cell phones) etc. But they all lack the accuracy and convenience

of a full blown keyboard. Speech input has an added issue of privacy. Even folded

keyboards for PDAs are yet to catch on. Thus a new generation of virtual input

devices is now being paraded, which could drastically change the way we type.

Virtual Keyboard uses sensor technology and artificial intelligence to let

users work on any surface as if it were a keyboard. Virtual Devices have

developed a flashlight-size gadget that projects an image of a keyboard on any

surface and let people input data by typing on the image

are measured and the device accurately determines the intended keystrokes and

translates them into text.

The Virtual Keyboard uses light to project a full-sized computer keyboard onto

almost any surface, and disappears when not in use. The translation process also

uses artificial intelligence. Once the keystroke has been decoded, it is sent to the

portable device either by cable or via wireless.

Yirtual keyboard

The Virtual Keyboard uses light to project a full -sized computer keyboard

onto almost any surface, and disappears when not in use. Used with Smart

Phones and PDAs, it provides a practical way to do email, word processing and

spreadsheet tasks, allowing the user to leave the laptop computer at home.
 The technology has many applications in various high -tech and industrial

Sectors. These include data entry and control panel applications in hazardous and

harsh environments and medical markets.

Projection keyboards or virtual key boards claim to provide the

convenience of compactness with the advantages of a full -blown QWERTY

keyboard. An interesting use of such keyboards would be in sterile environments

where silence or low noise is essential like operation theatres.

The advantage of such a system is that you do not need a surface for

typing; you can even type in plain air. The company's Virtual Keyboard is

designed for anyone who's become frustrated with trying to put information into a

handheld but doesn't want to carry a notebook computer around. There is also the

provision for a pause function to avoid translating extraneous hand movements \

function, so that users can stop to eat, drink etc.

It is also a superior desktop computer keyboard featuring dramatically

easier to learn touch-typing and leaving one hand free for mouse or phone.

Combination key presses ("chords") of five main and two extra control keys

allow users to type at 25-60 words per minute, with possibly greater speeds

achieved through the use of abbreviation expansion software. Most users,

however, will find memorizing the chords easy and fun, with the included typing

tutorial.
 The scanner can keep up with the fastest typist, scanning the projected area

over 50 times a second. The keyboard doesn't demand a lot of force, easing strain

on wrists and digits.

Virtual keyboards solve the problem of sore thumbs that can be caused by

typing on the tiny keyboards of various gadgets like PDAs and cell phones. They

are meant to meet the needs of mobile computer users struggling with

cumbersome, tiny, or nonexistent keyboards. It might help to prevent RSI

injuries.

The Virtual Keyboard uses an extremely durable material which is

extremely easy to clean. The Virtual Keyboard is not restricted to the QWERTY

touch-typing paradigm; adjustments can be done to the software to fit other

touch-typing paradigms as well, such as the DVORAK keyboard.

It will work with all types of Bluetooth enabled devices such as PDAs and smart

phones, as well as wearable computers. Applications include computer/PDA input,

gaming control, TV remote control, and musical applications. Thus virtual

keyboards will make typing easier, faster, and almost a pleasure.

1. The sensor module

2. IR-light source and

3. The pattern projector

Sensor module:

The Sensor Module serves as the eyes of the Keyboard Perception

technology.
 The Sensor Module operates by locating the user's fingers in 3 -D space

and tracking the intended keystrokes, or mouse movements.

Mouse tracking and keystroke information is processed and can then be

output to the host device via a USB or other interface.

ELECTRONIC PERCEPTION TECHNOLOGY:

Electronic perception technology enables ordinary electronic devices to

“see” the world around them so they can perceive and interact with it. Now

everyday electronic devices in a variety of markets can perceive users’ actions,

gaining functionality and ease of use.

The tiny electronic perception chips and embedded software work by developing a

3D “distance map” to nearby objects in real -time. This information is factored

through an on-chip processor running imaging software that translates the image

into defined events before sending it off-chip for application-specific processing.

It’s an action that is continually repeated, generating over 30 frames of 3D

information per second.

Electronic perception technology has a fundamental advantage over

classical image processing that struggles to construct three -dimensional

representations using complex mathematics and images from multiple cameras or

points of view
 This single chip “contour mapping” approach results in a high reduction of

complexity, making it possible to embed the application independent processing

software directly into the chips themselves – so they may be used in the most

modestly-priced, and even pocket-sized electronic devices.

IR-light source:

The Infrared Light Source emits a beam of infrared light. This light beam

is designed to overlap the area on which the keyboard pattern projector or

printed image resides. This is done so as to illuminate the user’s fingers by the

infra-red lightbeam.
 This helps in recognizing the hand movements and the pressing of keys.

The light beam facilitates in scanning the image. Accordingly the information is

passed on to the sensor module which decodes the information.

An invisible infra-red beam is projected above the virtual keyboard. Finger

makes keystroke on virtual keyboard. This breaks infrared beam and infrared

light is reflected back to projector. Reflected infrared beam passes through

infrared filter tocamera.

The camera photographs angle of incoming infrared light. The Sensor chip

in the sensor module determines where the infrared beam was broken. Detected

co-ordinates determine actions or characters to begenerated.

The Pattern Projector or optional printed image presents the image of the

keyboard or mouse zone of the system. This image can be projected on any flat

surface.

The projected image is that of a standard QWERTY keyboard, with all

the keys and control functions as in thekeyboard.

The Projector features a wide-angle lens so that a large pattern can be

projected from relatively low elevations. A printed image, with replaceable

templates allows system flexibility, permitting most any kind of keyboard

configuration for greater functionality.

In some types of virtual keyboards, a second infra -red beam is not

necessary. Here the projector itself takes the inputs, providing dual functionality.

A sensor or camera in the projector picks up the finger movements, and passes

the information on to the sensormodules.

Step 1: Template creation (Projection Module)

A template of the desired interface is projected onto the adjacent interface

surface. The template is produced by illuminating a speci ally designed, highly

efficient holographic optical element with a red diode laser.

Note: the template serves only as a reference for the user and is not involved in

the detection process. In a fixed environment, the templa te can just as easily be

printed ontotheinterfacesurface.
Step 2: Reference plane illumination (Micro-illumination ModuleTM)

An infra-red plane of light is generated just above, and parallel to, the interface

surface. This light is invisible to the user and hovers a few millimeters above

the surface. When the user touches a keyposition on the interface surface light
is reflected from this plane in the vicinity of the key and directed towards the

sensor module.

Step 3: Map reflection coordinates (Sensor Module)

Reflected light from user interactions with the interface surface ispassedthrough

an infra-red filter and imaged on to a CMOS image sensor in the sensor module.

Custom hardware embedded in the sensor chip (the Virtual Interface

Processing CoreTM) then makes a real-time determination of the location of the

reflected light.

The processing core can track multiple reflection events simultaneously

and can thus support both multiple keystrokes and overlapping cursor control

inputs.

DifferentTypes

There are different types of virtual keyboards, manufactured by various

companies which provide different levels of functionalities. The different type s

of virtual keyboardsare:

DeveloperVKB
 Its full-size keyboard also can be projected onto any surface and uses

laser technology to translate finger movements into letters. Working with

Siemens Procurement Logistics Services Rechargeable batteries similar to those

in cell phones power the compact unit. The keyboard is full size and the letters

are in a standard format. As a Class 1 laser, the output power is below the levelat

which eye injury can occur.

Canesta

The Canasta Keyboard, which is a laser projected keyboard with which

the same laser is also used to scan the projection field and extract 3D data.

Hence, the user sees the projected keyboard, and the device "sees" the position

of the fingers over the projected keys. They also have a chip set, Electronic

Perception Technology, which they supply for 3rd parties to develop products

using the projection/scanning technology. Canesta appears to be the most

They have a number of patents pending on theirtechnology.

The Sense board SB 04 technology is an extreme case of a hybrid

approach. The sensing transducer is neither a laser scanner nor a camera.

Rather, it is a bracelet like transducer that is worn on the hands which captures

hand and finger motion. In fact, as demonstrated, the technology does not
incorporate a projection component at all; rather, it relies on the user's ability to

touch type, and then infers the virtual row and key being typed by sensing

relative hand and finger movement. The system obviously could be augmented

to aid non-touch typists, for example, by the inclusion of a graphic

representation of the virtual keyboard under the hands/fingers. In this case,the

QWERTY keyboard, and the graphical representation could be projected or

even on a piece of paper. I include it here, as it is a relevant rela ted input

transducer that could be used with a projection system. The technology has

patents pending, and is currently in preproduction proof of Conceptform.

Sensors made of a combination of rubber and plastic are attached to the

user's palms in such a way that they do not interfere with finger motions.

Through the use of Bluetooth technology, the "typed" information is transferred

wirelessly to the computer, where a word processing program analyzes and

interprets the signals into readable text. The devi ce is currently usable via

existing ports on personal digital assistants (PDAs) from Palm and other

manufacturers. Sense board officials say it eventually will be compatible with

most brands of pocket PCs, mobile phones and laptopcomputers.

KITTY
 KITTY, a finger-mounted keyboard for data entry into PDA's, Pocket

PC's and Wearable Computers which has been developed at the University of

California inIrvine.
 KITTY, an acronym for Keyboard-Independent Touch-Typing, is a

Finger mounted keyboard that uses touch typing as a method of data entry. The

device targets the portable computing market and in particular its wearable

computing systems which are in need of a silent invisible data entry system

based on touch typing .the new device combines the idea of a finger mounted

coding device with the advantages of a system that uses touchtyping.

InFocus

InFocus is one of the leading companies in providing video and data

projectors. Their projectors are conventional, in that they do not use laser

technology. This has that advantage of delivering high quality colour images

with a mature technology. However, it has the disadvantage of larger size, lower

contrast, and higher power requirements, compared to laser projection systems.

In 2000, InFocus merged with Proxima, which had been one of its competitors.

I include InFocus/Proxima in this survey not only because they make projectors.

In their early days, Proxima developed one of the first commercially available

projection/vision systems. It was called Cyclops, and they still hold a patent on

the technology. Cyclops augmented the projector by adding a video camera that

was registered to view the projection area. The video camera had a band pass

filter over the lens, which passed only the wavelength of a lase rpointer.

The system, therefore, enabled the user to interact with the projected

image, using a provided laser pointer as the input device. The camera detected
the presence of the laser pointer on the surface, and calculated its coordinates

relative to the currently projected image. Furthermore, the laser pointer had two

intensity levels which enabled the user to not only point, but to have the

equivalent of a mouse button, by the vision system interpreting the two levels as

distinguishing button up and downevents.

It can be projected on any surface o r you can type in the plainair.

It can be useful in places like operation theatres where low noise isessential.

The typing does not require a lot of force. So easing the strain on wrists and

hands.

The Virtual Keyboard is not restricted to the QWERTY touch-typing paradigm;

adjustments can be done to the software to fit other touch -typing paradigms

aswell.

No driver software necessary, it can be used as a plug and playdevice.

High battery life. The standard coin-sized lithium battery lasts about eight

months before needing to bereplaced.

5. DRAWBACKS
Virtual keyboard is hard to get used to. Since it involves typing in thin air, it

requires a little practice. Only people who are good at typing can use a virtual

keyboardefficiently.

It is very costly ranging from 150 to 200 dollars.

The room in which the projected keyboard is used should not be very bright so

that the keyboard is properlyvisible.

6. APPLICATIONS

High-tech and industrialSectors.

Used with Smart phones, PDAs, email, word processing and spreadsheet tasks.

OperationTheatres.
As computer/PDAinput.

Gamingcontrol.

TV remotecontrol.

CONCLUSION

Virtual Keyboard uses sensor technology and artificial intelligence to let users

work on any surface as if it were a keyboard. Projection key boards or virtual key

boards claim to provide the convenience of compactness with the advantages of a

full-blown QWERTY keyboard. The company's Virtual Keyboard is designed for

anyone who's become frustrated with trying to put information into a handheld but

doesn't want to carry a notebook computer around. Canesta appears to be the most

advanced in this class of technology. Different types of virtual keyboards suit

different typing styles. Thus virtual keyboards will make typing easier, faster, and

almost apleasure.

REFERENCES
http://www.newscom.com/cgi-bin/prnh

www.canesta.com

www.procams.org4.www.billbuxton.c

om/3state.html

5.

www.smarttech.com6.www.3m.com/us/office/meeting/product_

catalog/wd.jhtml7.http://www.virtual-laser-keyboard.com/

demo.asp