Slide 1

GESTURE VOCALIZER

INDEXAbstractTransmitter Side ModuleReceiver Side ModuleWorkingResultConclusionFuture EnhancementsReferences

ABSTRACTGesture Vocalizer is a large scale multi-microcontroller based system.

Designed to facilitate the communication among the dumb, deaf and blind communities and their communication with the normal people.

It facilitates communication by converting it into speech and text(displayed on LCD)

This system can be dynamically reconfigured to work as a smart device.TRANSMITTER MODULEFlex Sensor

Accelerometer

ATMEGA-16 ,8bit Microcontroller

RF Transreceiver (CC2500)

BLOCK DIAGRAM

Transmitter side:

FLEX SENSORS (FS):

To measure Angle Displacement Measurement. Bends and Flexes physically with motion device.

As flex sensor is bend steps range between 511 (not bent) to 145.26 (max bend).

6ACCELEROMETER

We are using 1 accelerometer (ADXL 333).

It supports 3-axis sensing.

It is placed at the center of our palm.

It can measure the static acceleration of gravity in tilt-sensing .

It can measure the dynamic acceleration resulting from motion, shock, or vibration.

MICROCONTROLLER( ATMEG16(AVR))

We are using ATMEGA 16(AVR) with 8 ADC channels, 5 v power supply.

Why we are using AVR?

RECEIVER MODULERF TRANSRECEIVER (CC2500)

ARM- LPC 2138 with inbuilt DAC For speech synthesis.

AUDIO AMPLIFER(Vega kit)

SPEAKERBLOCK DIAGRAM

RF TRANSRECEIVER(CC2500)

We are using CC2500 transreceiver for transmission of signals.

The circuit is intended for the 2400-2483.5 MHz ISM & SRD frequency band.

It has a range of 30 meters.

ARM MICROCONTROLLER(LPC2138)We are using ARM(LPC2138) microcontroller.

Why are we using ARM?

12AUDIO SECTIONVEGAKIT

We are using Vegakit 191 as mini amplifier.It is operating at 5v and providing 1W power output into a 4 loudspeaker.

SPEECH PROCESSOR

We are using IC8942A as speech processor.It is high performance Voice OTP.It has 1M bits EPROM.

WORKING

RESULTThe voltage values for flex sensor & accelerometer are displayed.

The detected gesture name is displayed

After gesture detection the value is transmitted to receiver.

Corresponding to the received values sound file is played.

The sound file is played from 1.Vegakit (mini amplifier) 2.Speech Processor IC 8942A

CONCLUSION As per our objective we are able to convert signs into speech and text.

Our system is capable of being used any time of day which is a restriction to the present systems.

ARM and AVR have inbuilt properties so it compacts the system and gives better efficiency

By using our module we were able to detect 7 signs successfully.

FUTURE ENHANCEMENTSDesigning of a whole jacket, which would be capable of vocalizing the gestures and movements of deaf and dumb.

Virtual reality application e.g., replacing the conventional input devices like joy sticks in videogames with the data glove.

The Robot control system to regulate machine activity at remote sensitive sites.REFERENCESSushmita Mitra and Tinku Acharya,Gesture Recognition: A Survey, IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS.

Juan P. Wachs, Helman Stern and Yael Edan, Cluster Labelling and Parameter Estimation for the Automated Setup of a Hand-Gesture Recognition System, IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICSSYSTEMS AND HUMANS THANK YOU