Date post: | 04-Jun-2018 |
Category: |
Documents |
Upload: | isolani159 |
View: | 229 times |
Download: | 0 times |
of 20
8/14/2019 Speech Classification
1/20
Speech Classification Speech Lab Spring 2009
February 17, 091
Montgomery College
Speech Classif icat ion
Uche O. AbanuloPhysics EngineeringAnd Geosciences
8/14/2019 Speech Classification
2/20
Speech Classification Speech Lab Spring 2009
February 17, 092
Montgomery College
Detai led Classif icat ion
Phonemes
Vowels Semivowels Consonants Transitionals
GlidesLiquids
FricativesNasals
Plosives
Whispers
AffricatesDiphthongs
8/14/2019 Speech Classification
3/20
Speech Classification Speech Lab Spring 2009
February 17, 093
Montgomery College
Speech Produc t ion System
8/14/2019 Speech Classification
4/20
Speech Classification Speech Lab Spring 2009
February 17, 094
Montgomery College
Vowels
Source Quasi-periodic puffs of airflow through the vocal folds vibrating at
a certain fundamental frequency, which is the pitch
System
The formation of each vowel depends on the vocal tractconfiguration, which depends on the following factors:
The tongueposition and degree of constriction
Lipsdegree of openness, roundedness
Jaws
Examples
/a/ in fathertongue is raised at the front, low degree ofconstriction of tongue against palate
/i/ in eve - tongue is raised at the front, high degree of
constriction of tongue against palate
8/14/2019 Speech Classification
5/20
Speech Classification Speech Lab Spring 2009
February 17, 095
Montgomery College
Vowels
Vowel Examplei eve
I it
e Hate
E Met
@ at
a Father
c all
o obeyU foot
u boot
A up
R bird
http://images.google.com/imgres?imgurl=http://www.translationdirectory.com/images_articles/wikipedia/Cardinal_vowel_tongue_positions.gif&imgrefurl=http://www.translationdirectory.com/articles/article1857.php&usg=__4sCZvd3VSAH5PLm0LkqV_o1x0fM=&h=298&w=300&sz=11&hl=en&start=8&sig2=Q2FseHb912mWcGURxeSA2A&um=1&tbnid=fiyu896iYwdseM:&tbnh=115&tbnw=116&ei=jgWbSdLPNtvFmQfZiaWSCg&prev=/images%3Fq%3Dvocall%2Btract%2Bprofiles%2Bfor%2Bamerican%2Bvowels%26um%3D1%26hl%3Den%26sa%3DG8/14/2019 Speech Classification
6/20
Speech Classification Speech Lab Spring 2009
February 17, 096
Montgomery College
Fricat ives
Source Noise generated buy some turbulent airflow along the oral tract
System
The formation of each fricative depends on
If the vocal tract is vibrating or not (for voice and unvoiced fricatives)
the tongue
Lips
Teeth
Theres usually a voiced/unvoiced pair
Examples
/z/ in Zebravocal folds vibrate along with noise production
/s/ in sweetNo vibration along with noise production
8/14/2019 Speech Classification
7/20
Speech Classification Speech Lab Spring 2009
February 17, 097
Montgomery College
Vowels
Voiced Fricative Example Unvoiced
Fricative
Example
v vote f forD then T thin
Z azure S she
z zoo s see
8/14/2019 Speech Classification
8/20
Speech Classification Speech Lab Spring 2009
February 17, 098
Montgomery College
Nasals
Source Quasi-periodic airflow from vibrating vocal folds
System
Air flows through the nasal cavity, sound is radiated at the
nostrils
Sound is determined by the position of the tongues constriction
Examples
/m/ in Mantongues constriction is at the lips
/n/ in Notongues constriction is at the gum ridge
/G/ in singtongues constriction is near the velum
8/14/2019 Speech Classification
9/20
Speech Classification Speech Lab Spring 2009
February 17, 099
Montgomery College
Plosives
Source/System Burst generated as a result of pressure build-up behind an oral
tract contriction
Oral tract is initially closed (with vibration of vocal cords for voicedplosives and no vibration for unvoiced plosives)
Release of air pressure and generation of turbulence over a veryshort duration
Examples
/g/ in govibration occurs along with constriction
/k/ in bakerno vibration occurs along with constriction
8/14/2019 Speech Classification
10/20
Speech Classification Speech Lab Spring 2009
February 17, 0910
Montgomery College
Whispers
Source Noise generated buy some turbulent airflow along the oral tract
System
No constriction of oral tract but no vibration either
aspiration
Examples
/h/ in he
h l f h b
8/14/2019 Speech Classification
11/20
Speech Classification Speech Lab Spring 2009
February 17, 0911
Montgomery College
Transit ionals
Diphthongs Vocal tract moves between two vowel sounds
e.g /Y/ in hide; /W/ in out; /O/ in boy; /JU/ in new
Affricates
Formed by the transition from plosive to fricative
Example
/ts/ in chewtransition from /t/ to /S/;
/J/ injusttransition from /d/ to /Z/
S h Cl f S h L b S 2009
8/14/2019 Speech Classification
12/20
Speech Classification Speech Lab Spring 2009
February 17, 0912
Montgomery College
Semi-vowels
Voice-like in nature
Glides Dynamic and transitional
Very similar to diphthongs
Usually occur between two vowels or before a vowel
More constriction of oral tract during transition than diphthongs
Greater speed of oral tract movement
e.g: /w/ in away and /y/ in you
Liquids
Similar to glides except for the tongue constriction
e.g. /l/ in liquid, /r/ in right
S h Cl ifi i S h L b S i 2009
8/14/2019 Speech Classification
13/20
Speech Classification Speech Lab Spring 2009
February 17, 0913
Montgomery College
Why Speech Class i f icat ion
Artificial speech production
Speech correction
Speech recognition
S h Cl ifi i S h L b S i 2009
8/14/2019 Speech Classification
14/20
Speech Classification Speech Lab Spring 2009
February 17, 0914
Montgomery College
Generalized speech class if icat ion
Voiced
Quasi-periodic excitation
Modulation by vocal tract
Production of vowels, voiced
fricatives & plosives
Unvoiced
No periodic vibration of vocal
chords
Noise-like nature
Production of unvoiced
fricatives and plosives
S h Cl ifi ti S h L b S i 2009
8/14/2019 Speech Classification
15/20
Speech Classification Speech Lab Spring 2009
February 17, 0915
Montgomery College
Generalized speech class if icat ion
-5000
0
5000
10000
-5000
0
5000
10000
-5000
0
5000
10000
Embedded Voiced Speech
-2000
0
2000
-2000
-1000
0
1000
2000
-2000
-1000
0
1000
2000
Embedded Unvoiced Speech
S h Cl ifi ti S h L b S i 2009
8/14/2019 Speech Classification
16/20
Speech Classification Speech Lab Spring 2009
February 17, 0916
Montgomery College
Generalized speech class if icat ion
0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1-1
-0.5
0
0.5
1
Time (seconds)
Amplitude
A Voiced Segment from a Male Speech Signal
0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1-1
-0.5
0
0.5
1
Time (seconds)
Amplitude
An Unvoiced Segment from a Male Speech Signal
S h Cl ifi ti S h L b S i 2009
8/14/2019 Speech Classification
17/20
Speech Classification Speech Lab Spring 2009
February 17, 0917
Montgomery College
Lab simple observat ion
1. Record yourself saying /S/ as in shout
2. Read and plot your file
3. Repeat 1 and 2 above with the phoneme
/a/ as in father.
Now lets compare the two figures
S h Cl ifi ti S h L b S i 2009
8/14/2019 Speech Classification
18/20
Speech Classification Speech Lab Spring 2009
February 17, 0918
Montgomery College
Lab more detai led
1. Record yourself saying shout
Now well work together to create a voiced
unvoiced detection system using onlyenergy.
Speech Classification Speech Lab Spring 2009
8/14/2019 Speech Classification
19/20
Speech Classification Speech Lab Spring 2009
February 17, 0919
Montgomery College
Group Project
1. Record yourself sayingsupercal i fragi l is t icexpial idocious
2. Manually label your recording as voiced/unvoiced
3. Automatically label your recording using the speech
classification system we just created4. Compare your manual and automatic labels
Figures will be awesome
5. Discuss all the different phonemes contained in therecorded word including
1. What kind of phoneme are they?
2. How are they produced?
3. Are they voiced or unvoiced?
4. more???
6. One-two page report due next week.
Speech Classification Speech Lab Spring 2009
8/14/2019 Speech Classification
20/20
Speech Classification Speech Lab Spring 2009
February 17, 09
Montgomery College
Research
1. Research on different ways forclassifying speech into phonemes or asvoiced/unvoiced other than energy.
2. Each group will give a 10 minutepresentation at the next meeting