Supervisor:Dr. Elsayed Eissa Hemayed

o Marwa Ibrahim Lamey.Mayada Ibrahim Aly.

o Mona Sherif Ahmed.o Suad Mohamed Barakat.

Team Members

Agenda

oIntroduction

oTools

oTime Plan

oProject Overview

Time Plan

ToolsO

verviewIntro.

Introduction

Time Plan

ToolsO

verviewProblem definition

Intro.oHearing children can be taught many lessons and morals through stories.

What about deaf children?

Time Plan

ToolsO

verviewIntro.oFact: There exists 5 million deaf persons in

Egypt

Can’t we help them interacting with the community!??...

Background

Time Plan

ToolsO

verviewIntro.

This is not always the picture

Al Amal School- Resala Charity

Time Plan

ToolsO

verviewIntro.

Project Overview

Time Plan

ToolsO

verviewIntro.

oOur prototype is about to translate a category of children stories to the sign language in real time

oGoal: To minimize the gap between hearing parents or teachers and deaf children

Our Scope

Time Plan

ToolsO

verviewIntro.oInput: Arabic story speech signal

oOutput: Input translation to the sign language

oType: Desktop Application

Description

Time Plan

ToolsO

verviewIntro.oiCommunicator

oIBM SiSi

Market Survey

Time Plan

ToolsO

verviewIntro.oArabic speech recognition

oStart from speech and end up with sign language

SIGNlator Uniqueness

Time Plan

ToolsO

verviewIntro.oTranslation of Arabic speech to sign

language in real time.

o Translation of Arabic text to sign language.

oLearning mode.

SIGNlator Features

Time Plan

ToolsO

verviewIntro.

Block Diagram

Text to Sign languageاالشاري القاموس

للصم العربي

Recognizer Graphics module

Time Plan

ToolsO

verviewIntro.

Feature Extraction Search

Acoustic Model

Language Model

Audio Words

Dictionary

Automatic Speech Recognition-Architecture

Recognizer

Time Plan

ToolsO

verviewIntro.

ASR Categories

Word Based Phoneme Based

Isolated WordsWord Based

Isolated WordsPhoneme BasedIsolated Words

Continuous Speech

Word BasedContinuous Speech

Phoneme BasedContinuous Speech

Our Choice!!

• Very high accuracy• Maximum 150 words.

• Unlimited words can be recognized if added to the dictionary.

• Less accurate but still acceptable accuracy

Time Plan

ToolsO

verviewIntro.oTackling a new field

oPhonemes of Arabic language.

oAccents of Arabic language .

oArabic language model.

oPrepare the training set.

Challenges

Time Plan

ToolsO

verviewIntro.oAdaptability.

oExpendability.

oChange program type to be mobile application.

oIntegrate with Ayat’s Project

Future Work

Time Plan

ToolsO

verviewIntro.oRecognizer : HTK

oText to Sign languageoC# using Microsoft Visual Studio 2008oSQL Server 2005

oGraphics module: Quest3D 4.0

oGUI: Expression Studio 2 ( Blend)

Tools

Time Plan

54 days25 d

34d6d

38days

13d

18d

43days16d

14d51 days

7d6d

Brain StormingMarket Research

DesignMid-Terms

DesignFinals

Implementation

IntegrationMid-Terms

Implementation & Testing

FinalsTesting

8/7/09

26/10/0930/9/09

27/10/091/10/09

30/11/095/12/09 11/12/09

12/12/09

24/3/10

30/12/091/1/10 8/2/10

9/2/10

7/8/09

1/7/1030/6/1010/5/10

9/5/1025/4/10

10/4/1025/3/1024/4/1011/4/10

15/7/109/7/10

Doc

Working Period

Idle period

Sponsors

Thank you

Causes of deafness

• 9.6% Pregnancy-Related causes• 8.4% Post-Natal causes• 28% Genetic causes• 54% Unknown causes

Not necessary to be born for deaf parents