+ All Categories
Home > Documents > Speech Classification

Speech Classification

Date post: 04-Jun-2018
Category:
Upload: isolani159
View: 229 times
Download: 0 times
Share this document with a friend

of 20

Transcript
  • 8/14/2019 Speech Classification

    1/20

    Speech Classification Speech Lab Spring 2009

    February 17, 091

    Montgomery College

    Speech Classif icat ion

    Uche O. AbanuloPhysics EngineeringAnd Geosciences

  • 8/14/2019 Speech Classification

    2/20

    Speech Classification Speech Lab Spring 2009

    February 17, 092

    Montgomery College

    Detai led Classif icat ion

    Phonemes

    Vowels Semivowels Consonants Transitionals

    GlidesLiquids

    FricativesNasals

    Plosives

    Whispers

    AffricatesDiphthongs

  • 8/14/2019 Speech Classification

    3/20

    Speech Classification Speech Lab Spring 2009

    February 17, 093

    Montgomery College

    Speech Produc t ion System

  • 8/14/2019 Speech Classification

    4/20

    Speech Classification Speech Lab Spring 2009

    February 17, 094

    Montgomery College

    Vowels

    Source Quasi-periodic puffs of airflow through the vocal folds vibrating at

    a certain fundamental frequency, which is the pitch

    System

    The formation of each vowel depends on the vocal tractconfiguration, which depends on the following factors:

    The tongueposition and degree of constriction

    Lipsdegree of openness, roundedness

    Jaws

    Examples

    /a/ in fathertongue is raised at the front, low degree ofconstriction of tongue against palate

    /i/ in eve - tongue is raised at the front, high degree of

    constriction of tongue against palate

  • 8/14/2019 Speech Classification

    5/20

    Speech Classification Speech Lab Spring 2009

    February 17, 095

    Montgomery College

    Vowels

    Vowel Examplei eve

    I it

    e Hate

    E Met

    @ at

    a Father

    c all

    o obeyU foot

    u boot

    A up

    R bird

    http://images.google.com/imgres?imgurl=http://www.translationdirectory.com/images_articles/wikipedia/Cardinal_vowel_tongue_positions.gif&imgrefurl=http://www.translationdirectory.com/articles/article1857.php&usg=__4sCZvd3VSAH5PLm0LkqV_o1x0fM=&h=298&w=300&sz=11&hl=en&start=8&sig2=Q2FseHb912mWcGURxeSA2A&um=1&tbnid=fiyu896iYwdseM:&tbnh=115&tbnw=116&ei=jgWbSdLPNtvFmQfZiaWSCg&prev=/images%3Fq%3Dvocall%2Btract%2Bprofiles%2Bfor%2Bamerican%2Bvowels%26um%3D1%26hl%3Den%26sa%3DG
  • 8/14/2019 Speech Classification

    6/20

    Speech Classification Speech Lab Spring 2009

    February 17, 096

    Montgomery College

    Fricat ives

    Source Noise generated buy some turbulent airflow along the oral tract

    System

    The formation of each fricative depends on

    If the vocal tract is vibrating or not (for voice and unvoiced fricatives)

    the tongue

    Lips

    Teeth

    Theres usually a voiced/unvoiced pair

    Examples

    /z/ in Zebravocal folds vibrate along with noise production

    /s/ in sweetNo vibration along with noise production

  • 8/14/2019 Speech Classification

    7/20

    Speech Classification Speech Lab Spring 2009

    February 17, 097

    Montgomery College

    Vowels

    Voiced Fricative Example Unvoiced

    Fricative

    Example

    v vote f forD then T thin

    Z azure S she

    z zoo s see

  • 8/14/2019 Speech Classification

    8/20

    Speech Classification Speech Lab Spring 2009

    February 17, 098

    Montgomery College

    Nasals

    Source Quasi-periodic airflow from vibrating vocal folds

    System

    Air flows through the nasal cavity, sound is radiated at the

    nostrils

    Sound is determined by the position of the tongues constriction

    Examples

    /m/ in Mantongues constriction is at the lips

    /n/ in Notongues constriction is at the gum ridge

    /G/ in singtongues constriction is near the velum

  • 8/14/2019 Speech Classification

    9/20

    Speech Classification Speech Lab Spring 2009

    February 17, 099

    Montgomery College

    Plosives

    Source/System Burst generated as a result of pressure build-up behind an oral

    tract contriction

    Oral tract is initially closed (with vibration of vocal cords for voicedplosives and no vibration for unvoiced plosives)

    Release of air pressure and generation of turbulence over a veryshort duration

    Examples

    /g/ in govibration occurs along with constriction

    /k/ in bakerno vibration occurs along with constriction

  • 8/14/2019 Speech Classification

    10/20

    Speech Classification Speech Lab Spring 2009

    February 17, 0910

    Montgomery College

    Whispers

    Source Noise generated buy some turbulent airflow along the oral tract

    System

    No constriction of oral tract but no vibration either

    aspiration

    Examples

    /h/ in he

    h l f h b

  • 8/14/2019 Speech Classification

    11/20

    Speech Classification Speech Lab Spring 2009

    February 17, 0911

    Montgomery College

    Transit ionals

    Diphthongs Vocal tract moves between two vowel sounds

    e.g /Y/ in hide; /W/ in out; /O/ in boy; /JU/ in new

    Affricates

    Formed by the transition from plosive to fricative

    Example

    /ts/ in chewtransition from /t/ to /S/;

    /J/ injusttransition from /d/ to /Z/

    S h Cl f S h L b S 2009

  • 8/14/2019 Speech Classification

    12/20

    Speech Classification Speech Lab Spring 2009

    February 17, 0912

    Montgomery College

    Semi-vowels

    Voice-like in nature

    Glides Dynamic and transitional

    Very similar to diphthongs

    Usually occur between two vowels or before a vowel

    More constriction of oral tract during transition than diphthongs

    Greater speed of oral tract movement

    e.g: /w/ in away and /y/ in you

    Liquids

    Similar to glides except for the tongue constriction

    e.g. /l/ in liquid, /r/ in right

    S h Cl ifi i S h L b S i 2009

  • 8/14/2019 Speech Classification

    13/20

    Speech Classification Speech Lab Spring 2009

    February 17, 0913

    Montgomery College

    Why Speech Class i f icat ion

    Artificial speech production

    Speech correction

    Speech recognition

    S h Cl ifi i S h L b S i 2009

  • 8/14/2019 Speech Classification

    14/20

    Speech Classification Speech Lab Spring 2009

    February 17, 0914

    Montgomery College

    Generalized speech class if icat ion

    Voiced

    Quasi-periodic excitation

    Modulation by vocal tract

    Production of vowels, voiced

    fricatives & plosives

    Unvoiced

    No periodic vibration of vocal

    chords

    Noise-like nature

    Production of unvoiced

    fricatives and plosives

    S h Cl ifi ti S h L b S i 2009

  • 8/14/2019 Speech Classification

    15/20

    Speech Classification Speech Lab Spring 2009

    February 17, 0915

    Montgomery College

    Generalized speech class if icat ion

    -5000

    0

    5000

    10000

    -5000

    0

    5000

    10000

    -5000

    0

    5000

    10000

    Embedded Voiced Speech

    -2000

    0

    2000

    -2000

    -1000

    0

    1000

    2000

    -2000

    -1000

    0

    1000

    2000

    Embedded Unvoiced Speech

    S h Cl ifi ti S h L b S i 2009

  • 8/14/2019 Speech Classification

    16/20

    Speech Classification Speech Lab Spring 2009

    February 17, 0916

    Montgomery College

    Generalized speech class if icat ion

    0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1-1

    -0.5

    0

    0.5

    1

    Time (seconds)

    Amplitude

    A Voiced Segment from a Male Speech Signal

    0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1-1

    -0.5

    0

    0.5

    1

    Time (seconds)

    Amplitude

    An Unvoiced Segment from a Male Speech Signal

    S h Cl ifi ti S h L b S i 2009

  • 8/14/2019 Speech Classification

    17/20

    Speech Classification Speech Lab Spring 2009

    February 17, 0917

    Montgomery College

    Lab simple observat ion

    1. Record yourself saying /S/ as in shout

    2. Read and plot your file

    3. Repeat 1 and 2 above with the phoneme

    /a/ as in father.

    Now lets compare the two figures

    S h Cl ifi ti S h L b S i 2009

  • 8/14/2019 Speech Classification

    18/20

    Speech Classification Speech Lab Spring 2009

    February 17, 0918

    Montgomery College

    Lab more detai led

    1. Record yourself saying shout

    Now well work together to create a voiced

    unvoiced detection system using onlyenergy.

    Speech Classification Speech Lab Spring 2009

  • 8/14/2019 Speech Classification

    19/20

    Speech Classification Speech Lab Spring 2009

    February 17, 0919

    Montgomery College

    Group Project

    1. Record yourself sayingsupercal i fragi l is t icexpial idocious

    2. Manually label your recording as voiced/unvoiced

    3. Automatically label your recording using the speech

    classification system we just created4. Compare your manual and automatic labels

    Figures will be awesome

    5. Discuss all the different phonemes contained in therecorded word including

    1. What kind of phoneme are they?

    2. How are they produced?

    3. Are they voiced or unvoiced?

    4. more???

    6. One-two page report due next week.

    Speech Classification Speech Lab Spring 2009

  • 8/14/2019 Speech Classification

    20/20

    Speech Classification Speech Lab Spring 2009

    February 17, 09

    Montgomery College

    Research

    1. Research on different ways forclassifying speech into phonemes or asvoiced/unvoiced other than energy.

    2. Each group will give a 10 minutepresentation at the next meeting


Recommended