Hostname: page-component-7b7567c8c-wxvwp Total loading time: 0 Render date: 2026-11-16T20:47:42.907Z Has data issue: false hasContentIssue false

The influence of visual feedback and register changes on sign language production: A kinematic study with deaf signers

Published online by Cambridge University Press:  01 January 2009

KAREN EMMOREY*
Affiliation:
San Diego State University
NELLY GERTSBERG
Affiliation:
University of California, Irvine
FRANCO KORPICS
Affiliation:
San Diego State University
CHARLES E. WRIGHT
Affiliation:
University of California, Irvine
*
ADDRESS FOR CORRESPONDENCE Karen Emmorey, Laboratory for Language and Cognitive Neuroscience, San Diego State University, 6495 Alvarado Road, Suite 200, San Diego, CA 92120. E-mail: kemmorey@mail.sdsu.edu
Rights & Permissions [Opens in a new window]

Abstract

Speakers monitor their speech output by listening to their own voice. However, signers do not look directly at their hands and cannot see their own face. We investigated the importance of a visual perceptual loop for sign language monitoring by examining whether changes in visual input alter sign production. Deaf signers produced American Sign Language (ASL) signs within a carrier phrase under five conditions: blindfolded, wearing tunnel-vision goggles, normal (citation) signing, shouting, and informal signing. Three-dimensional movement trajectories were obtained using an Optotrak Certus system. Informally produced signs were shorter with less vertical movement. Shouted signs were displaced forward and to the right and were produced within a larger volume of signing space, with greater velocity, greater distance traveled, and a longer duration. Tunnel vision caused signers to produce less movement within the vertical dimension of signing space, but blind and citation signing did not differ significantly on any measure, except duration. Thus, signers do not “sign louder” when they cannot see themselves, but they do alter their sign production when vision is restricted. We hypothesize that visual feedback serves primarily to fine-tune the size of signing space rather than as input to a comprehension-based monitor.

Information

Type
Articles
Copyright
Copyright © Cambridge University Press 2008
Figure 0

Figure 1.Illustrations of the carrier phrase and the target ASL signs.

Figure 1

Figure 2.Illustrations of the movement trajectory for the sign GROW-UP produced in the carrier phrase THINK GROW-UP YESTERDAY in the normal, citation signing condition. The Y dimension is vertical movement and the Z dimension is movement forward from the signer. The dotted line indicates the transitional movement from the lap to the forehead for THINK and from the chin for YESTERDAY back to the lap. The solid line illustrates that excised trajectory used for analysis for the target sign GROW-UP.

Figure 2

Figure 3.An example of one dependent variable, distance traveled, in the five signing conditions, illustrating its variability across (left panel) participants and (right panel) signs. For the left panel, each combination of plotting symbol and line type connecting the plotting symbols represents a different participant. For the right panel, these same symbols and lines are used to represent different signs. Included for reference in both panels are filled circles, which represent the means across participants and signs (identical in the two panels).

Figure 3

Table 1.Means for each dependent measure

Figure 4

Figure 4.The dimensions of signing space in the five conditions (normal, blind, tunnel vision, informal, shouting) averaged across nine participants. The origin (0) is at the center of signer's face, just in front of the nose, as calibrated for each participant at the start of testing. (a, b) The values on the ordinate axis represent vertical space in the vertical Y dimension. The bottom edge of each box plot represents the average minimum height of signing, and the top is the average maximum height. (a) An illustration of the coronal plane from the signers’ perspective. The abscissa represents the horizontal X dimension. The left edge of each box plot is the average maximum leftward location, and the right edge is the average maximum rightward location. (b) An illustration of the sagittal plane with the signer facing rightward. The abscissa represents the outward Z dimension, with positive values indicating forward movement from the signer's perspective. The left edge of each box plot is the average minimum location (with little motion behind the signer), and the right edge of each box is the average maximum forward location. [A color version of this figure can be viewed online at journals.cambridge.org/aps]

Figure 5

Figure 5.Confidence interval plots for (a) X dimension size (horizontal plane), (b) Y dimension size (vertical plane), (c) Z dimension size (forward plane), and (d) duration. Each point on a graph represents the difference between that measure in normal signing and the condition stated on the x axis. Error bars show 95% confidence intervals of that difference.