Maureen Stone

Snap-dragging

We are interested in the problem of making precise line drawings using interactive computer graphics. In precise line drawings, specific relationships are expected to hold between points and lines. In published interactive drawing systems, precise relationships have been achieved by using rectangular grids or by solving simultaneous equations (constraints). The availability of fast display hardware and plentiful computational power suggest that we should take another look at the ruler and compass techniques traditionally used by draftsmen. Snap-dragging uses the ruler and compass metaphor to help the user place his next point with precision, and uses heuristics to automatically place guiding lines and circles that are likely to help the user construct each shape. Snap-dragging also provides translation, rotation, and scaling operations that take advantage of the precision placement capability. We show that snap-dragging compares favorably in power and ease of use with grid or constraint techniques.

Three‐dimensional tongue surface shapes of English consonants and vowels

This paper presents three-dimensional tongue surfaces reconstructed from multiple coronal cross-sectional slices of the tongue. Surfaces were reconstructed for sustained vocalizations of the American English sounds [symbol: see text]. Electropalatography (EPG) data were also collected for the sounds to compare tongue surface shapes with tongue-palate contact patterns. The study was interested also in whether 3-D surface shapes of the tongue were different for consonants and vowels. Previous research and speculation had found that there were differences in production, acoustics, and linguistic usage between the two groups. The present study found that four classes of tongue shape were adequate to categorize all the sounds measured. These classes were front raising, complete groove, back raising, and two-point displacement. The first and third classes have been documented before in the midsagittal plane [cf. R. Harshman, P. Ladefoged, and L. Goldstein, J. Acoust. Soc. Am. 62, 693-707 (1976)]. The first three classes contained both vowels and consonants, the last only consonants. Electropalatographic patterns of the sounds indicated three categories of tongue-palate contact: bilateral, cross-sectional, and combination of the two. Vowels used only the first pattern, consonants used all three. The EPG data provided an observable distinction in contact pattern between consonants and vowels. The ultrasound tongue surface data did not. The conclusion was that the tongue actually has a limited repertoire of shapes and positions them against the palate in different ways for consonants versus vowels to create narrow channels, divert airflow, and produce sound.

A Guide to Analysing Tongue Motion from Ultrasound Images.

This paper is meant to be an introduction to and general reference for ultrasound imaging for new and moderately experienced users of the instrument. The paper consists of eight sections. The first explains how ultrasound works, including beam properties, scan types and machine features. The second section discusses image quality, including the interpretation of anatomical features and artefacts seen in the image. The third section discusses the validity of the data collection procedures, including the effects of stabilizing the transducer and head position, and discusses some methods for stabilization. Section four discusses validation of the ultrasound and stabilization systems. The fifth section presents a sample recording set‐up, supplemental information, and normalization strategies for sessions and subjects. In section six are methods of extracting contours from ultrasound images, displaying them, and analysing them. The seventh section considers the tracking of pellets on the tongue surface and the differences between tracking tissue points and continuous surfaces. The last section presents methods, challenges and results of 3D, computerized reconstruction of tongue surfaces. An outline of the paper can be found in Appendix I.

Automatic contour tracking in ultrasound images

In this paper, a new automatic contour tracking system, EdgeTrak, for the ultrasound image sequences of human tongue is presented. The images are produced by a head and transducer support system (HATS). The noise and unrelated high‐contrast edges in ultrasound images make it very difficult to automatically detect the correct tongue surfaces. In our tracking system, a novel active contour model is developed. Unlike the classical active contour models which only use gradient of the image as the image force, the proposed model incorporates the edge gradient and intensity information in local regions around each snake element. Different from other active contour models that use homogeneity of intensity in a region as the constraint and thus are only applied to closed contours, the proposed model applies local region information to open contours and can be used to track partial tongue surfaces in ultrasound images. The contour orientation is also taken into account so that any unnecessary edges in ultrasound images will be discarded. Dynamic programming is used as the optimisation method in our implementation. The proposed active contour model has been applied to human tongue tracking and its robustness and accuracy have been verified by quantitative comparison analysis to the tracking by speech scientists.

An Ultrasound Examination of Tongue Movement during Swallowing

Six female adults were studied during the production of four single swallows each, using real-time ultrasound. A pellet was affixed to the tongue at the junction between the (calculated) anterior third and posterior two-thirds of the tongue surface. Direction, rate, and extent of pellet movement were measured and used to create stages of tongue blade movement during swallowing. Pellet movement was then compared to the three stages of hyoid movement (ascent, steady, descent). Anterior-posterior and superior-inferior components of pellet movement were examined and discussed.

A head and transducer support system for making ultrasound images of tongue/jaw movement

A head and transducer support system (HATS) was developed for use in ultrasound imaging of tongue movement. Ultrasound is an imaging technique that captures tongue motion during speech and thus has great appeal as a tool for speech research. However, because ultrasound systems are designed for clinical use, the transducer is hand-held and it is almost impossible to hold it completely steady under the chin when collecting tongue data. A system was needed to fix the head and support the transducer under the chin in a known position without disturbing speech. The HATS system was designed, constructed, and modified to provide valid, reliable tongue movement data by (1) immobilizing the head and (2) positioning the ultrasound transducer in a known relationship to the head.

Modeling the motion of the internal tongue from tagged cine-MRI images

A new technique, tagged Cine-Magnetic Resonance Imaging (tMRI), was used to develop a mechanical model that represented local, homogeneous, internal tongue deformation during speech. The goal was to infer muscle activity within the tongue from tissue deformations seen on tMRI. Measurements were made in three sagittal slices (left, middle, right) during production of the syllable /ka/. Each slice was superimposed with a grid of tag lines, and the approximately 40 tag line intersections were tracked at 7 time-phases during the syllable. A local model, similar to a finite element analysis, represented planar stretch and shear between the consonant and vowel at 110 probed locations within the tongue. Principal strains were calculated at these locations and revealed internal compression and extension patterns from which inferences could be drawn about the activities of the Verticalis, Hyoglossus, and Superior Longitudinal muscles, among others.

Soft tissue anatomy of the tongue and floor of the mouth: An ultrasound demonstration

Ultrasound technology has not been used extensively in the study of normal and abnormal oral physiology and speech. Features such as soft tissue detail, real-time motion display, and subject safety make ultrasound ideal for imaging the tongue and the floor of the mouth. This study demonstrates visualization of the muscles of the tongue and floor of the mouth for a normal subject using ultrasound imaging. By employing submandibular transducer placement of realtime sector scanners, tongue anatomy and motion were continuously visualized in sagittal or coronal planes. In addition to the entire tongue surface, much of the intrinsic anatomy was identified including: the genioglossus, geniohyoid, mylohyoid, and digastric muscles; fascial boundaries such as the median fibrous septum, floor intermuscular septum, and paramedian septums; and the hyoid bone. A tongue excised from a human cadaver was scanned using ultrasound and dissected to confirm the anatomy seen in the live tongue. Tongue surface shape and configuration of the intrinsic tissue structures were observed and compared for the phonemes /k/, /u/, and /i/. Anatomical landmarks in the resting and speaking tongue are discussed as well as applications in the fields of speech science and speech pathology.

Extraction and tracking of the tongue surface from ultrasound image sequences

This paper presents a system for automatic extraction and tracking of 2D contours of the tongue surfaces from digital ultrasound image sequences. The input to the system is provided by a Head and Transducer Support System (HATS), which is developed for use in ultrasound imaging of the tongue movement. We developed a novel active contour (snakes) model that uses several temporally adjacent images during the extraction of the tongue surface contour for an image frame. The user supplies an initial contour model for a single image frame in the whole sequence. Using optical flow and multi-resolution methods, this initial contour is then used to find the candidate contour points in the temporally immediate adjacent images. Subsequently, the new snake mechanism is applied to estimate optimal contours for each image frame using these candidate points. In turn, the extracted contours are used as models for the extraction process of new adjacent frames. Finally, the system uses a novel postprocessing technique to refine the positions of the contours. We tested the system on 11 different speech sequences, each containing about 25 images. Visual inspection of the detected contours by the speech experts shows that the results are very promising and this system can be effectively employed in speech and swallowing research.

Cross-sectional tongue shape during the production of vowels

This study used ultrasound imaging to examine the cross-sectional shape of the tongue during the production of the ten English vowels ( see text ) in two consonant contexts--/p/ and /s/--and at two scan angles--anterior and posterior. Results were compared with models of sagittal tongue shape. A newly built transducer holder and head restraint maintained the ultrasound transducer in a fixed position inferior to the mandible at a chosen location and angle. The transducer was free to move only in a superior/inferior direction, and demonstrated reliable tracking of the jaw. Since the tongue is anisotrophic along its length, anterior and posterior scan angles were examined to identify differences in tongue shape. Similarly, the coarticulatory effects of the sibilant /s/ versus the bilabial /p/ were examined, to assess variability of intrinsic tongue shape for the vowels. Results showed that the subjects midsagittal tongue grooving was almost universal for the vowels. Posterior grooves were deeper than anterior grooves. In /s/ context, posterior tongue grooves were shallower than in /p/ context. Anteriorly, /s/ context caused deeper grooves for low vowels. Cross-sectional tongue shape varied with tongue position similarly to sagittal tongue shape.