40
Interarticulator programming in VCV sequences: Effects of closure duration on lip and tongue coordination Anders Löfqvist Haskins Laboratories New Haven, CT
Interarticulator programming in VCV sequences: Effects of closure duration on lip and tongue
coordination
Anders Löfqvist
Haskins Laboratories
New Haven, CT
Question
In producing a sequence of vowel-labial consonant-vowel , a speaker has to do two or three things:
1. Close and open the lips for the consonant.2. Move the tongue from the position for the first vowel to that for the second vowel.3. If the consonant is voiceless, open and close the glottis
If the duration of the labial consonant in such a sequence is changed, how is the tongue movement between the two vowels affected? What happens to the interarticulator programming of lip and tongue movements?
Length contrast in japaneseWhen a speaker of Japanese produces the words “kami” and ‘kammi”, the lips are closed for about 60 ms when the consonant is short, and for about 125 ms when the consonant is long.
Short
Long
0
50
100
150
200
YK YM KN SO TT
ms /kami, kammi/Closure duration
Subject
Background
Earlier work on American English has shown that the onset of the tongue movement from the first to the second vowel in such a VCV sequence almost always started before the oral closure for the consonant. In addition, more than 50% of the tongue movement trajectory between the vowels occurred during the oral closure. There was also a weak positive correlation between the magnitude of the tongue movement for the vowels and the interval between tongue movement onset and the onset of the lip closing movement - if you have a long way to go, start early!
Hypotheses
If the duration of the oral closure for the consonant is increased, a speaker can in principle use two strategies for the coordination of the tongue and lip movements.
Closure duration: 65 ms
“kami”
a
i
Tongue body movement from first to second vowel
Closure duration: 119 ms
“kammi”
?
1.Make the same tongue movement trajectory for a long and a short consonant. Such a strategy could have one or two versions, or a combination of them.
Hypotheses, cntd
1a. The onset of the tongue movement might be shifted later relative to the oral closure, so that the tongue movement reached its position for the second vowel at the same point in time for the long and short consonant.
i
a
Closure
“kammi”
Hypotheses, cntd
1b. Alternatively, the onset of the tongue movement could have the same temporal relationship to the consonant closure. In this case, the interval between the offset of the tongue movement and the release of the oral closure for the labial consonant would thus increase for the long consonant. Another possibility is to shift both the onset and offset of the tongue movement.
Closure
“kammi”
a
i i
a
Closure
“kammi”
Hypotheses, cntd
2.Modify the tongue movement during the long consonant, so that the relative timing between the tongue movement and the lip movements for the oral closure of the consonant would be more or less the same for the long and short consonants. This would imply making a slower tongue movement trajectory for the long than for the short consonant.
Closure
“kammi”
a
i
Procedure
SubjectsFive native speakers of Japanese, three male and two female, served as subjects. They reported no speech, language, or hearing problems. They were naive as to the purpose of the study. (The experimental protocol was approved by the IRB at the Yale University School of medicine.)
Procedure, cntd
Linguistic materialThe linguistic material consisted of Japanese words with a sequence of vowel-labial nasal-vowel. These words formed minimal pairs, where the only difference between the pairs was the duration of the labial consonant. The words were designed to require a substantial amount of tongue movement from the first to the second vowel. The following words were used: /kami, kammi/, /kamee, kammee/, /kema, kemma/, /kama, kamma/, /∫ imi, ∫ immi/. The linguistic material was organized into randomized lists and presented to the subjects in Japanese writing, with the words occurring in a short frame sentence. Fifty repetitions of each word were recorded.
Procedure, cntd
Movement recordingThe movements of the lips, the tongue, and jaw were recorded using a three-transmitter magnetometer system; when proper care is taken during the calibration, the spatial resolution of the system is in the order of .5 mm. Receivers were placed on the vermilion border of the upper and lower lip, on three positions of the tongue, referred to as tip, blade and body, and on the lower incisors at the gum line. Two additional receivers placed on the nose and the upper incisors were used for the correction of head movements. All data were subsequently corrected for head movements and rotated to bring the occlusal plane into coincidence with the x axis. This rotation was performed to obtain a uniform coordinate system for all subjects.
Procedure, cntd
The articulatory movement signals (induced voltages from the receiver coils) were sampled at 500 Hz after low-pass filtering at 200 Hz. The resolution for all signals was 12 bits
A simultaneous acoustic recording was also made with a sampling rate of 10 kHz.
Signal processingA measure of lip aperture was obtained by calculating the vertical distance between the upper and lower lip receivers. The velocity and acceleration of this signal were calculated. The onset of the closing movement of the lips for the nasal consonant, was taken as a minimum in the lip aperture acceleration signal just before oral closure.
Procedure, cntd
For each tongue receiver, its velocity and speed* were calculated. Tongue movement onsets and offsets were defined algorithmically in the tongue body speed signal as minima during, or close to, the first and second vowels.
Measurements - asymmetrical vowel contextIn this context, landmarks were defined in the acoustic and the tongue movement signals.
* Speed: ( ˙ x 2 ˙ y 2)*
Audio
Subject YK“Karewa kami to itta”
The duration of the oral closure for the consonant was measured in the acoustic signal.
200 ms
Procedure, cntd
The magnitude of the tongue movement trajectory from the first to the second vowel was obtained by summing the Euclidean distances between successive samples of the tongue body receiver from movement onset to movement offset.
The average speed of the tongue body was obtained by adding the speed of all the individual samples between movement onset and offset and then dividing by the number of samples in the interval.
0.2 cm
Tongue body horizontal position
Forward
Backward
20 cm/s
Tongue body speed
200 ms
0.2 cm
Tongue body vertical position
Oral closure for /m/
200 ms
“Karewa kami to itta”Subject YK
Onset Offset
Procedure, cntd
Three temporal intervals were measured:
The interval between tongue movement onset and oral closure; it provides information about the tongue movement relative to consonant closure.
The interval between tongue movement onset and lip closing movement onset, defined in the lip aperture acceleration signal; it examines the coordination between tongue and lip movements.
The interval between tongue movement offset and oral release; it is useful for examining the tongue movement relative to consonant release.
200 ms
5 cm/s
Lip aperture velocity
200 cm/s2
Lip aperture acceleration
0.2 cm
Lip aperture
Oral closure for /m/
“Karewa kami to itta”Subject YK
Procedure, cntd
Measurements - symmetrical vowel contextIn this context, landmarks could not be defined in the tongue movement signals. Instead, the onset and offset of the oral closure, defined in the acoustic signal, were used. The jaw movements were also analyzed, since any tongue movement could be the result of jaw movements associated with the oral closure, in partcular for the open vowel /a/.
The duration of the oral closure for the consonant was measured in the acoustic signal.
The positions of the jaw and tongue body were measured at the onset and offset of the oral closure.
The magnitude of the jaw and tongue body movement paths during closure was measured as defined above.
Results - asymmetrical contexts
Oral closureFor all speakers, there is a clear and robust difference between the long and short consonants, with the long ones about twice the duration of the short ones.
0
50
100
150
200
YK YM KN SO TT
ms /kami, kammi/
0
50
100
150
200
YK YM KN SO TT
ms /kame, kammee/Short
Long
Closure duration
Subject
LipsJawTipBladeBody
1 cm
1 cm
FrontBack
a
aa
i
ii
a
a
Subject YK /kami/
Results, ctnd
Tongue movement durationFor most subjects and words, the duration of the tongue body movement from the first to the second vowel is longer in the long than in the short consonant.
Duration of the of the tongue body movement from the first to the second vowel
0
50
100
150
200
250
YK YM KN SO TT
ms /kami,kammi/
0
50
100
150
200
250
300
YK YM KN SO TT
ms /kamee,kammee/Short
Long
Subject
0
50
100
150
200
250
300
YK YM KN SO TT
/kema,kemma/ms
Results, ctnd
Average speed of tongue movementOverall, the average speed of the tongue body movement from the first to the second vowel is slower for the long than for the short consonant.
0
20
40
60
80
100
120
YK YM KN SO TT
/kami,kammi/mm/s
0
20
40
60
80
100
YK YM KN SO TT
/kamee,kammee/mm/s
Subject
0
20
40
60
80
100
120
YK YM KN SO TT
/kema,kemma/mm/s Short
Long
Average speed of the tongue body movement from the first to the second vowel
Results, ctnd
The magnitude of the path of the tongue body movement from the first to the second vowel did not vary systematically with consonant length within or across speakers.
Any difference in movement paths was not related to a consistent change in movement onset or offset position.
0
5
10
15
20
YK YM KN SO TT
/kami,kammi/mm
0
5
10
15
20
YK YM KN SO TT
/kamee,kammee/mm
Short
Long
Subject
0
5
10
15
20
25
YK YM KN SO TT
/kema,kemma/mm
Path of the tongue body movement from the first to the second vowel.
Results, ctnd
Onset of tongue movement relative to oral closureThis interval showed no clear pattern for the long and short consonants. Of note is that with only one exception, /kammee/ for subject KN, the tongue movement onset always occurs before the closure.
-80 -60 -40 -20 0 20 40
YK
YM
KN
SO
TT
/kami,kammi/
ms
Subject
Oral closureBefore After-50 0 50
YK
YM
KN
SO
TT
ms
Subject /kamee,kammee/
OralclosureBefore After-120 -100 -80 -60 -40 -20 0 20
YK
YM
KN
SO
TT
ms
Subject /kema,kemma/
OralclosureBefore After
Short
Long
Interval between onset of tongue movement and oral closure
Results, ctnd
Relationship between tongue and lip movement onsetsThe overall results suggest that the lips lead, but there is no clear difference between the long and short consonants across words and speakers.
-20 0 20 40 60 80 100
YK
YM
KN
SO
TT
/kami,kammi/
ms
Subject
Tongueleads Lipslead0 20 40 60 80 100 120
YK
YM
KN
SO
TT
ms
Subject /kamee,kammee/
Lipslead-50 0 50 100
YK
YM
KN
SO
TT
ms
Subject /kema,kemma/
Tongueleads Lipslead
Short
Long
Interval between onsets of tongue and lip movements
Results, ctnd
Offset of tongue movement relative to oral releaseThe offset of the tongue movement tended to occur after the oral release. The pattern was, however, quite variable as shown by the standard deviations.
-50 0 50 100
YK
YM
KN
SO
TT
/kami,kammi/
ms
Subject
OralreleaseBefore After-20 0 20 40 60 80 100 120 140
YK
YM
KN
SO
TT
ms
Subject /kamee,kammee/
OralreleaseBefore After-40 -20 0 20 40 60 80 100 120
YK
YM
KN
SO
TT
ms
Subject /kema,kemma/
OralreleaseBefore After
Short
Long
Interval between offset of tongue movement and oral release
Results - symmetrical contexts
Words with symmetrical vowel contexts were only recorded in three of the subjects.
Path of jaw and tongue body movement during oral closureIn this context, the path was much shorter than in the asymmetrical context.
As expected, the path of both jaw and tongue movement was longer in the context of the open vowel /a/, where it was also longer for the long consonant. The jaw movement was related to the closure for the labial consonant.
In the context of the high vowel /i/, the longer movement trajectory of the tongue body for the short consonant was due to coarticulatory influences.
0
1
2
3
4
5
6
YK SO TT
/kama, kamma/mm
0
1
2
3
4
5
6
YK SO TT
/kama, kamma/mm
0
1
2
3
4
5
6
YK SO TT
mm/∫imi, ∫immi /
SubjectSubject
mm
0
1
2
3
4
5
6
YK SO TT
/∫imi, ∫immi /
Short
Long
Path of tongue body movement during oral closure Path of jaw movement during oral closure
Summary and conclusions
It was hypothesized that a speaker could use one of two possible strategies of interarticulator programming if the duration of the consonant was increased. In one of them, the tongue movement trajectory would be similar for the long and short consonants; thus, the timing between the lip and tongue movements would change. In the second one, the tongue movement would be modified for the long consonant, thus resulting in a similar coordination of lip and tongue movements for both the long and short consonants. The present results clearly support the second strategy.
They thus show that speakers of Japanese modify their tongue movements when they produce a sequence of a vowel-bilabial consonant-vowel with a long and a short consonant. In particular, the duration of the tongue movement is increased, while its average speed is reduced in the long consonant. However, the path of the tongue movement didn’t vary consistently with consonant duration.
Thus, the coordination of the tongue movement relative to the onset and release of the oral closure was similar for the long and short consonants. Importantly, all five speakers showed the same modification of tongue movement speed and duration for the long consonant. These finding are similar to the ones reported by Caroline Smith in her Yale 1992 dissertation. They thus suggest that the Japanese speakers tend to maintain a similar, but not identical, coordination between the tongue and lip movements across consonant length
The present results also show that speakers of Japanese have the same coordination between lip and tongue movements in VCV sequences as speakers of American English, for both the long and short consonants in Japanese. At the same time, American English and Japanese are described to have stress- and mora-timing, respectively, but the interarticulator programming of lip and tongue movements appears to be virtually identical for the two languages.
This raises the issue of whether the prosodic structure of a language will influence patterns of interarticulator timing. The results presented by Caroline Smith suggest that this may be the case, since speakers of Japanese and Italian, which also has a length contrast, may have different patterns of coordination in VCV sequences when the consonant length differs. Japanese is described as having mora timing, Italian is said to have syllable timing. The obvious next step, examining Italian speakers using the same experimental approach, is currently under way.
Acknowledgments
I am grateful to Mariko Yanagawa for help with the Japanese material and running the experiments. This work was supported by Grant No. DC-00865 from the National Institute on Deafness and Other Communication Disorders, National Institutes of Health.
