gesture technology for television

8/11/2019 gesture technology for television

1/37

Gesture Sense Technology for Television

ECE 1 S.D.I.T Mangalore

Chapter 1

INTRODUCTION

Sign language is one form of communication for the hearing and speech impaired.

Similar to spoken language, there is no universal sign language. Sign language is itself a

separate language with its own grammar and rules.

Some signs are expressed as static gestures while others incorporate some

dynamic hand movements. For static gestures, the prominent sign is captured within a

specific time frame. For dynamic gestures, a sequence of finger and hand positions needs

to be identified and analyzed in order to be recognized.

The focus of the project is on static gestures with a single hand. This strive to

detect a hand signing the sign language representation of the numbers from 0 to 9.

This system achieves the objective of detecting the number of open fingers using

the concept of boundary tracing combined with fingertip detection. It handles breaks, if

any, during boundary tracing by rejoining the trace at an appropriate position.


2/37



Chapter 2

REQUIREMENTS SPECIFICATION

This software and hardware requirements specifications provide a complete

description of the basic requirements for Gesture sense technology for television.

2.1 SOFTWARE PLATFORM

2.1.1 Compatible operating system

Windows XP version matlab7.6.0 (R2008a) installed with IP toolbox.

Windows XP version Keil UVision#3 (C51) 8.0.5.

Languages: MATLAB and Embedded C.

2.2 HARDWARE PLATFORM

The minimum required configuration:

DUAL CORE or higher processor.

512 MB of RAM (1 GB Recommended).

20GB of hard disk space.

Web Cam.

IR remote

Relays drive circuit.

Microcontroller 89s52.

Serial communication system(RS232) with MAX232

Crystal oscillator (11.0592MHz)


3/37



Chapter 3

PROJECT BLOCK DIAGRAM

Figure 3.1 (a):DETAILED block diagram of project


4/37



Figure 3.1 (b):Block diagram of project

3.1 WORKING:

The gestures will be captured by the camera and submitted to the computer. The

computer loaded with the MATLAB processes the input and then recognizes the symbolic

action (Sign language) and produces the corresponding output via serial port. This BCD

input will be taken from the serial port and it will be given to the microcontroller. Based

on the sign language, computer will produces different signals for different actions. Based

on the signals that are received from the serial port, it activates the switching circuitry in

the IR remote section. This performs the particular actions in the television.

Eg: If fore finger is shown in front of the camera volume will be increased.

Camera

Mat Lab Loaded

ComputerSerial

Port

Microcontroller

Switching

Circuit

IR Remote

Controlling Circuit

with Relays.


5/37



3.11 Camera:

The gestures will be captured by camera and this captured image is processed by

the MATLB loaded computer.

3.12 MATLAB loaded computer:

MATLAB loaded computer processes the image captured by the camera and

result is given to microcontroller via serial port.

3.13 Serial port:

Serial port is used transfer the data or signal from computer to the microcontroller

which controls to the relays.

3.14 Microcontroller switching circuit:

Microcontroller is programmed such that it drives the relays according to the

signal came from the serial port.

3.15IR remote with relays:

The relays are connected to the IR remote switches. The relays perform the

switching action of the IR remote.


6/37



Chapter 4

CAMERA

The Camera is used to capture the action or sign done by hand. A Simple RGB

Camera is used. The main purpose of using the RGB Camera that provides Navigation

system for visually impaired peoples. The navigation system is expected to enable the

visually impaired peoples to extend the range of their activities compared to that of other

normal cameras. Since this design is a successor version of a previous stereo camera

based system to overcome a limitation of stereo vision based systems, algorithmic

structure of the system is maintained.

Figure 4:RGB Camera

The Camera is destined in the Matlab code. When code is running the camera

captures the image of hand signal. It captures when it finds difference between plane

background and hand signal image pixels. The Matlab code processes the image and

gives to microcontroller. Then the circuits consisting of relays are driven by the

microcontroller to switch the particular actions.


7/37



Chapter 5

MAT LAB LOADED COMPUTER

MATLAB is a software package for high-performance numerical computation and

visualization. It provides an interactive environment with hundreds of built-in functions

for technical computation, graphics and animation. It also provides easy extensibility with

its own high level programming language. The name MATLAB stands for MATrix

Laboratory.

MATLAB is an efficient program for vector and matrix data processing. It

contains ready functions for matrix manipulations and image visualization and allows a

program to have modular structure. Because of these facts MATLAB has been chosen as

prototyping software.

MATLAB provides a suitable environment for image processing. Although

MATLAB is slower than some languages (such as C), its built in functions and syntax

makes it a more versatile and faster programming environment for image processing.

Once an algorithm is finalized in MATLAB, the programmer can change it to C (or

another faster language) to make the program run faster. The Matlab loaded computer is

used to process the actions of the hand capture by the camera.


8/37



5.1 LOCATING THE HAND

5.1.1 Background Subtraction

There are many algorithms to locate the hand from the captured image. The hand

detection method that we implemented was fast and simple.

Initially, a video stream of the static background is obtained and a mean

background is computed from the different frames. This background template is saved

and is going to be used every time with every single incoming frame from the video

stream to obtain the foreground. An arbitrary threshold is then used on the resulting

foreground image to eliminate noise on the picture, and at the same time creating a binary

image of the foreground.

Figure 5.1.1:Foreground extraction by subtracting background from image

5.1.2 Finger Detection flow chart

The first phase employs an edge detected image which reduces the number of

pixels to be processed at runtime.

The next phase clips the undesirable portion of the edge detected image for further

processing. The final phase traces the boundary of the image and in the process detects

finger tips which aid in finger detection.


9/37



Figure 2.2: Finger Detection flow chart

5.1.3 Boundary Contour

Boundary contour (as we call it) is the process of determining the Euclidean

distance of any point on the edge of an image to the center of mass (COM) or Centroid.

We used this method to differentiate fingers and non-fingers as fingers have a

distinctive length which will enable us to easily determine whether certain points a finger,

thumb or neither.

Figure 2.4:Determine the distance from edges to

Centroid.


10/37



5.1.4 OBTAINING THE SKELETON IMAGE

There are two ways to obtain the skeleton image of the hand structure. We used

both the equi-distance skeleton and the thinning method for our project. To implement the

equidistance skeleton method, we used MATLABs morphing function. MATLABs

morphing function requires us to invert the colors of the binary image. Morphing the

binary image of the hand, we obtain the skeletal representation of the hand.

Figure 5.4:Morphed image to form skeleton

5.1.5 End Point Calculation

In order to determine the end point, we calculate the length of each branch, getting

rid of insignificant branches which have length shorter than a given threshold. Based on

the longest branch we calculate how many short branches and how many long branches.

Long branches would represent stretched fingers while short branches represent folded

fingers. I would encode them in terms of binary values as 1 for stretched fingers and 0 for

folded fingers.


11/37



Figure 5.1.5: An example of how the branches are being

Classified. This particular image represents the number eight

And is coded as [1101].

Based on the binary values, we would be able to classify what number does the

hand represents. There are some special cases which need to be taken care of. For an

example, a short branch could exist at the right most part of the image. This branch could

represent a thumb and thus should be coded as 1 instead of a 0.

5.3IMAGE PROCESSING BY MATLAB

1.

Figure 12.71: Original image captured by camera


12/37



2.

Figure 12.72: RGB Image converted to grayscale image

3.

Figure 12.73: grayscale image converted to Black & white Image

4.


13/37



Figure 12.74: Red dot represents the centroid

5.

Figure 12.75: Right side of the centroid is removed

6.


14/37



Figure 12.76: skeleton image


15/37



Chapter 6

SERIAL/ PARALLEL PORT

6.1 RS232 Serial Port (9 Pin)

Standard of RS232

Most widely used serial I/O interfacing standard

Input and output voltage levels are not TTL compatible

1 bit is represented by -3 to -25 V

0 bit is +3 to +25 V

-3 to +3 is undefined

To connect RS232 to a microcontroller system must use voltage converters such

as MAX232 to convert the RS232 voltage levels to the TTL logic levels, and vice

versa.

Figure 6.1:9 Pin Serial Port

We used both Male and Female D-Type plug connector in our project. The RS232

along with MAX232 is interfaced with the microcontroller.


16/37



6.1.1 PIN Description

Table (6.1.1):Pin description of 25 & 9 pin D-Type plug.

6.2 Max232 chip

MAX232converts from RS232 voltage levels to TTL voltage levels.

MAX232 has two sets of line drivers for transferring and receiving data.

Meets or Exceeds TIA/EIA-232-F and ITU

Recommendation V.28

Operates From a Single 5-V Power Supply

With 1.0-_F Charge-Pump Capacitors

Operates Up To 120 Kbit/s

Two Drivers and Two Receivers

30-V Input Levels

Low Supply Current . . . 8 mA Typical

ESD Protection Exceeds JESD 22

- 2000-V Human-Body Model (A114-A)

Upgrade With Improved ESD (15-kV HBM)

and 0.1-_F Charge-Pump Capacitors is

Available With the MAX202

Applications

- TIA/EIA-232-F, Battery-Powered Systems,

Terminals, Modems, and Computers


17/37



The MAX232 is a dual driver/receiver that includes a capacitive voltage

generator to supply TIA/EIA-232-F voltage levels from a single 5-V supply. Each

receiver converts TIA/EIA-232-F inputs to 5-V TTL/CMOS levels. These

receivers have a typical threshold of 1.3 V, a typical hysteresis of 0.5 V, and can

accept 30-V inputs. Each driver converts TTL/CMOS input levels into TIA/EIA-232-F levels.

Figure 6.2:PIN Configuration of MAX232


18/37



Chapter 7

POWER SUPPLY

The project mainly requires +5V supply which s generate using 12-0-12 @750mA transformer, rectifier section to rectify and filter the supply voltage. Here we have

used a common supply for driving different board like Microcontroller, R232 board.

7.1 TRANSFORMER:

By appropriate selection of the ratio of turns, a transformer thus allows an

alternating current (AC) voltage to be "stepped up" by making Ns greater than Np, or

"stepped down" by making Ns less than Np. Here, the 230volts power supply from the

mains if transformed by a 12-0-12V step-down centre tap transformer. This AC voltage is

needed to be converted to DC for supplying it to Microcontroller, R232 board.

A transformer is a static device that transferselectrical energy from onecircuit to

another through inductively coupled conductorsthe transformer's coils. A varying

current in the first or primary winding creates a varyingmagnetic flux in the transformer's

core and thus a varying magnetic field through the secondary winding. This varying

magnetic fieldinduces a varyingelectromotive force (EMF) or "voltage"in the secondary

winding. This effect is calledmutual induction.

If a load is connected to the secondary, an electric current will flow in the

secondary winding and electrical energy will be transferred from the primary circuit

through the transformer to the load. In an ideal transformer, the induced voltage in the

secondary winding (Vs) is in proportion to the primary voltage (Vp), and is given by the

ratio of the number of turns in the secondary (Ns) to the number of turns in the primary

(Np) as given in Eq. 1.

Eq (1)
http://en.wikipedia.org/wiki/Alternating_currenthttp://en.wikipedia.org/wiki/Electrical_energyhttp://en.wikipedia.org/wiki/Electrical_networkhttp://en.wikipedia.org/wiki/Inductive_couplinghttp://en.wikipedia.org/wiki/Electric_currenthttp://en.wikipedia.org/wiki/Magnetic_fluxhttp://en.wikipedia.org/wiki/Magnetic_fieldhttp://en.wikipedia.org/wiki/Electromagnetic_inductionhttp://en.wikipedia.org/wiki/Electromotive_forcehttp://en.wikipedia.org/wiki/Volthttp://en.wikipedia.org/wiki/Mutual_inductionhttp://en.wikipedia.org/wiki/Electrical_loadhttp://en.wikipedia.org/wiki/Electrical_loadhttp://en.wikipedia.org/wiki/Mutual_inductionhttp://en.wikipedia.org/wiki/Volthttp://en.wikipedia.org/wiki/Electromotive_forcehttp://en.wikipedia.org/wiki/Electromagnetic_inductionhttp://en.wikipedia.org/wiki/Magnetic_fieldhttp://en.wikipedia.org/wiki/Magnetic_fluxhttp://en.wikipedia.org/wiki/Electric_currenthttp://en.wikipedia.org/wiki/Inductive_couplinghttp://en.wikipedia.org/wiki/Electrical_networkhttp://en.wikipedia.org/wiki/Electrical_energyhttp://en.wikipedia.org/wiki/Alternating_current


19/37



7.2RECTIFIERS CIRCUIT:

The signals from the micro-controller are then given to the Relays through the

switching circuit. These Relays are connected to the IR Remote which performs the

switching action.

A rectifier is an electrical device that converts alternating current (AC), which

periodically reverses direction, todirect current (DC), which is in only one direction, a

process known as rectification. A full-wave bridge rectifier is used, which converts the

whole of the input waveform to one of constant polarity (positive or negative) at its

output. Full-wave rectification converts both polarities of the input waveform to DC

(direct current), and is more efficient.6A diodes are used for voltage rectification.

Therefore the AC voltage is now converted pulsating DC. While half-wave and full-wave

rectification suffice to deliver a form of DC output, neither produces constant-voltage

DC. In order to produce steady DC from a rectified AC supply, a smoothing circuit or

filter is required. This pulsation is removed by 1000micro-farad capacitor filter circuit.

Sizing of the capacitor represents a tradeoff. For a given load, a larger capacitor will

reduce ripple but will cost more and will create higher peak currents in the transformer

secondary and in the supply feeding it. In extreme cases where many rectifiers are loaded

onto a power distribution circuit, it may prove difficult for the power distribution

authority to maintain a correctly shaped sinusoidal voltage curve. The output of the filter

circuit is pure DC which is then supplied to IR remote controlling circuit consists of

relays.

Figure 7.2:Bridge rectifier circuit
http://en.wikipedia.org/wiki/Alternating_currenthttp://en.wikipedia.org/wiki/Direct_currenthttp://en.wikipedia.org/wiki/Electronic_filterhttp://en.wikipedia.org/wiki/Electronic_filterhttp://en.wikipedia.org/wiki/Direct_currenthttp://en.wikipedia.org/wiki/Alternating_current


20/37



Chapter8

MICROCONTROLLER

The main heart of the project is the microcontroller 89S52 from Philips which has

unique features to transmit, receive, control and display the data. The main processing is

done in the controller which handles all the necessary data.

8.1 Block Diagram

Figure 8.1:Block diagram of 89s52 Microcontroller


21/37



8.2 PIN Configuration

8.3 Pin Description

VCC

Supply voltage.

GND

Ground.

Port 0

Port 0 is an 8-bit open drain bidirectional I/O port. As an output port, each pin can

sink eight TTL inputs. When 1s are written to port 0 pins, the pins can be used as high

impedance inputs.

Port 0 can also be configured to be the multiplexed low order address/data bus

during accesses to external program and data memory. In this mode, P0 has internal

pull-ups. Port 0 also receives the code bytes during Flash programming and outputs the

code bytes during program verification. External pull-ups are required during program

verification.


22/37



Port 1

Port 1 is an 8-bit bidirectional I/O port with internal pull-ups .The Port 1 output

buffers can sink/source four TTL inputs. When 1s are written to Port 1 pins, they are

pulled high by the internal pull-ups and can be used as inputs. As inputs, Port 1 pins that

are externally being pulled low will source current (IIL) because of the internal pull-ups.

In addition, P1.0 and P1.1 can be configured to be the timer/counter 2 external count

input (P1.0/T2) and the timer/counter 2 trigger input (P1.1/T2EX), respectively, as shown

in the following table. Port 1 also receives the low-order address bytes during Flash

programming and verification.

Port 2

Port 2 is an 8-bit bidirectional I/O port with internal pull-ups. The Port 2 output

buffers can sink/source four TTL inputs.

When 1s are written to Port 2 pins, they are pulled high by the internal pull-ups

and can be used as inputs. As inputs, Port 2 pins that are externally being pulled low will

source current because of the internal pull-ups.

Port 2 emits the high-order address byte during fetches from external programmemory and during accesses to external data memory that uses 16-bit addresses (MOVX

@DPTR). In this application, Port 2 uses strong internal pull-ups when emitting 1s.

During accesses to external data memory that uses 8-bit addresses (MOVX @ RI), Port 2

emits the contents of the P2 Special Function Register.

Port 2 also receives the high-order address bits and some control signals during

Flash programming and verification.

Port 3


23/37



Port 3 is an 8-bit bidirectional I/O port with internal pull-ups. The Port 3 output

buffers can sink/source four TTL inputs.

When 1s are written to Port 3 pins, they are pulled high by the internal pull-ups

and can be used as inputs. As inputs, Port 3 pins that are externally being pulled low will

source current because of the pull-ups.Port 3 also serves the functions of various special features of the AT89S52, as

shown in the following table. Port 3 also receives some control signals for Flash

programming and verification.

RST

Reset input. A high on this pin for two machine cycles while the oscillator is

running resets the device. This pin drives High for 96 oscillator periods after the

Watchdog times out. The DISRTO bit in SFR AUXR (address 8EH) can be used to

disable this feature. In the default state of bit DISRTO, the RESET HIGH out feature is

enabled.

ALE/PROG

Address Latch Enable (ALE) is an output pulse for latching the low byte of the

address during accesses to external memory. This pin is also the program pulse input

(PROG) during Flash programming. In normal operation, ALE is emitted at a constant

rate of 1/6 the oscillator frequency and may be used for external timing or clocking

purposes. Note, however, that one ALE pulse is skipped during each access to external

data memory.


24/37



If desired, ALE operation can be disabled by setting bit 0 of SFR location 8EH. With the

bit set, ALE is active only during a MOVX or MOVC instruction. Otherwise, the pin is

weakly pulled high. Setting the ALE-disable bit has no effect if the microcontroller is in

external execution mode.

PSENProgram Store Enable (PSEN) is the read strobe to external program memory.

When the AT89S52 is executing code from external program memory, PSEN is activated

twice each machine cycle, except that two PSEN activations are skipped during each

access to external data memory.

EA/VPP

External Access Enable must be strapped to GND in order to enable the device to

fetch code from external program memory locations starting at 0000H up to FFFFH.

Note, however, that if lock bit 1 is programmed, EA will be internally latched on reset. A

should be strapped to VCC for internal program executions. This pin also receives the 12-

volt programming enable voltage (VPP) during Flash programming.

XTAL1

Input to the inverting oscillator amplifier and input to the internal clock operating

circuit.

XTAL2

It is the output from the inverting oscillator amplifier.

8.4 MICROCONTROLLER PROGRAMMING

sbit var1=P2^0;

sbit var2=P2^1;

sbit var3=P2^2;

sbit var4=P2^3;

void main ()

{

unsigned char RX;

P2 = 0; /* Port 2 is cleared */

TMOD = 0x20; /* Timer mode register value is loaded */

SCON = 0x50; /* Serial communication port */

TH1 = 0xFD;


25/37



TR1= 1;

TI = 0;

SBUF = 'a'; /* Serial buffer register */

while (TI==0);

TI = 0;while (1)

{

RI=0;

while (RI==0);

RX=SBUF;

RI=0;

if (RX=='a')

var1=1;

else if (RX=='b')

var2=1;

else if (RX=='c')

var3=1;

else if (RX=='d')

var4=1;

else if (RX=='s')

P2=0;

/* The port 2 is used to connect the 4 relays to the microcontroller */


26/37



Chapter 9

RELAYS

A relay is an electrically operated switch.Many relays use an electromagnet to

operate a switching mechanism mechanically, but other operating principles are also

used. Relays are used where it is necessary to control a circuit by a low-power signal

(with complete electrical isolation between control and controlled circuits), or where

several circuits must be controlled by one signal. The first relays were used in long

distance telegraph circuits, repeating the signal coming in from one circuit and re-

transmitting it to another. Relays were used extensively in telephone exchanges and early

computers to perform logical operations.

Solid-state relays control power circuits with no moving parts, instead using a

semiconductor device to perform switching. Relays with calibrated operating

characteristics and sometimes multiple operating coils are used to protect electrical

circuits from overload or faults; in modern electric power systems these functions are

performed by digital instruments still called "protective relays".

Figure 8:Basic Relays
http://en.wikipedia.org/wiki/Electrichttp://en.wikipedia.org/wiki/Switchhttp://en.wikipedia.org/wiki/Electromagnethttp://en.wikipedia.org/wiki/Solid-state_relayshttp://en.wikipedia.org/wiki/Moving_partshttp://en.wikipedia.org/wiki/Protective_relayhttp://en.wikipedia.org/wiki/Protective_relayhttp://en.wikipedia.org/wiki/Moving_partshttp://en.wikipedia.org/wiki/Solid-state_relayshttp://en.wikipedia.org/wiki/Electromagnethttp://en.wikipedia.org/wiki/Switchhttp://en.wikipedia.org/wiki/Electric


27/37



9.1 OPERATION OF RELAY

All relays contain a sensing unit, the electric coil, which is powered by AC or DC

current. When the applied current or voltage exceeds a threshold value, the coil activates

the armature, which operates either to close the open contacts or to open the closed

contacts. When a power is supplied to the coil, it generates a magnetic force that actuates

the switch mechanism. The magnetic force is, in effect, relaying the action from one

circuit to another.

There are three basic functions of a relay: On/Off Control, Limit Control and

Logic Operation.

On/Off Control: Example: Air conditioning control, used to limit and control a high

power load, such as a compressor

Limit Control: Example: Motor Speed Control, used to disconnect a motor if it runs

slower or faster than the desired speed

Logic Operation:Example: Test Equipment, used to connect the instrument to a number

of testing points on the device under test.

Figure 8.1:Operation of Relays


28/37



Chapter 10

IR REMOTE CONNECTED TO RELAYS

In this project we are connecting the four buttons in the remote to the relays,which performs the switching action.

Most audio and video systems are equipped with an infrared remote control. This

application note describes a receiver for the frequently used Philips/Sony RC5 coding

scheme.

Figure 10:RC5 Reciever

.

The RC5 code is a 14-bit word bi-phase coded signal (See Figure 10). The two

first bits are start bits, always having the value one. The next bit is a control bit or toggle

bit, which is inverted every time a button is pressed on the remote control transmitter.

Five system bits hold the system address so that only the right system responds to the

code. Usually, TV sets have the system address 0, VCRs the address 5 and so on. The

command sequence is six bits long, allowing up to 64 different commands per address.

Figure 10.1:IR Remote


29/37



Chapter 11

CIRCUIT DIAGRAM& FLOW CHARTS

11.1 Serial port with MAX232 interfaced to Microcontroller

Figure 11:Serial port with MAX232 interfaced to Microcontroller

Figure 10.1 Compenents solded on Circuit Board


30/37



11.2 FLOW CHART OF THE PROJECT

Start

Webcam o ens

Change in background?

Captures the background

Th1=20

Wait for 5 Sec

Captures the image

If

difference>th1

Find the difference of 2 snapshots

A


31/37



Processing of the image

If valid output

from c

Send result to cvia RS232

Switches the relays

No action

A

STOP


32/37



11.3 PROCESSING OF THE IMAGE

If distance from

centroid>150

Start

Converts the image to gray scale

Gray scale image is converted to black & white (B&C)

Complements the B&C image

Fills the image region and holes

Determine the centroid of image

Right half of the image from centroid is cut

Final end point

Removes the pixels less than 1000

Discard

Skeleton of the image

Determine the end point

To c via RS 232

c control the relays

Stop


33/37



Chapter 12

FEATURES, APPLICATIONS AND ADVANTAGES

12.1 FEATURES

The system is handled through microcontroller.

Matlab and microcontroller are reprogrammable.

Works on12v DC battery.

Accurate & Instant working.

Occupies very less space.

12.2 APPLICATIONS

The IR has short range communication possibility. The gestures can be captured

from the person using an image recognition device and the appropriate action can

be initiated.

Using sign language, we can produce the corresponding speech, so that the

visually impaired can benefit.

Virtual reality in 3 dimensional video gaming.

Instead of using the sensors for mechanical devices we can directly implement this

technology which reduces the cost Imposed on sensors.

The organization consisting of many numbers of computers can implement this

technology, which reduces the complexity of operating the computers.

The advances in this technology will give the virtual reality in remote surgery.


34/37



12.3 ADVANTAGES

Abstain the use of electronic remote controllers.

Instead of using external interface devices we can directly interface with the

digital devices.

One of the most important advantage of this technology is that this will be very

helpful for visually challenged people.

Programming using MATLAB will be simple and efficient.

Components used are of very less cost.

12.4 DISADVANTAGES

A plane background must be maintained in order to capture the image by the

camera and to process it.

Giving the signal from the hand must be nearer to the camera, it is not

applicable for larger distances.

This project requires high resolution camera.


35/37



Chapter 13

FUTURE DEVELOPMENT

Gesture Sense Technology is the beginning of a new era of technology where

engineering will reach new milestones. Just like in the science fiction movies where

display of computer screen appears on walls, commands are given by gestures, the smart

digital environment which talks to us to do our work and so on, these all will be possible

very soon. You imagine it and gesture sense technology will make it possible. Before few

years back it was considered to be supernatural or tantalizing imagination.

Gesture sense technology has integrated the real world objects with digital world.

The fabulous Gesture sense technology is a blend of many exquisite technologies. The

thing which makes it magnificent is the marvelous integration of all those technologies

and presents it into a single portable and economical product. It associates technologies

like hand gesture recognition, image capturing, processing, and manipulation, etc. It

superimposes the digital world on the real world. Gesture sense technology is a

perception of augmented reality concept. Like senses enable us to perceive information

about the environment in different ways it also aims at perceiving information.

But were humans and our physical body isnt meant for digital world so we cant

interact directly to the digital world. For instance we press keys to dial a number; we type

text to search it and so on. This means for an individual to communicate with the digital

world he/she must learn it. We dont communicate directly and efficiently to the digital

world as we do with the real world. The gesture sense technology is all about interacting

to the digital world in most efficient and direct way. This technology will be easily

available for equipments like pocket projector, a mirror, mobile components, color

markers and a camera. The projector projects visual images on a surface.

Although the information can be gathered by connecting devices like computers

and mobiles but they are restricted to the screen and there is no direct interaction between

the tangible physical world and intangible digital world. This gesture sense technology

provides us with the freedom of interacting with the digital world with hand gestures.

This technology has a wide application in the field of artificial intelligence.


36/37



Chapter 14

CONCLUSION

This technology has seamless applications. It can provide easy control over

machineries in industry and will have different application for different developers just

depending upon how he imagines and what he wants.

This will enable individuals to make their own application depending upon needs

and imagination. As this technology will emerge may be new devices and hence forth

new markets will evolve. Some existing devices and technologies will be discontinued

but one thing is guaranteed it will write a new chapter in history of science and

technology.


37/37


BIBILOGRAPHY

1. www.google.comfor all images used in this report.

2. www.engineersgarage.comfor all additional information about project.

3. www.alldatasheet.comfor all data sheets included in the project.

4. www.mathworks.com and www.masteringmatlab.com for all information about

the MATLAB.

5. The 8051 Microcontroller and Embedded system using assembly and c By

Mazidi, Pearson education India Sep 2007 edition.

6.Fundamentals of digital image processing, Anil .K. Jain.

7.Digital image processing using MATLAB, Rafael. c. Gonzalvez.
http://www.google.com/http://www.google.com/http://www.engineersgarage.com/http://www.engineersgarage.com/http://www.alldatasheet.com/http://www.alldatasheet.com/http://www.mathworks.com/http://www.mathworks.com/http://www.masteringmatlab.com/http://www.masteringmatlab.com/http://www.masteringmatlab.com/http://www.mathworks.com/http://www.alldatasheet.com/http://www.engineersgarage.com/http://www.google.com/

Date post:	02-Jun-2018
Category:	Documents
Upload:	arun-gopinath-g
View:	218 times
Download:	0 times

gesture technology for television

Documents