Daniel Fogerty

Perceptual contributions of the consonant-vowel boundary to sentence intelligibilitya)

Although research has focused on the perceptual contribution of consonants to spoken syllable or word intelligibility, in sentences vowels have a distinct perceptual advantage over consonants in determining intelligibility [Kewley-Port et al., J. Acoust. Soc. Am. 122, 2365-2375 (2007)]. The current study used a noise replacement paradigm to investigate how perceptual contributions of consonants and vowels are mediated by transitional information at segmental boundaries. The speech signal preserved between replacements is defined as a glimpse window. In the first experiment, glimpse windows contained proportional amounts of transitional boundary information that was either added to consonants or deleted from vowels. Results replicated a two-to-one vowel advantage for intelligibility at the traditional consonant-vowel boundary and suggest that vowel contributions remain robust against proportional deletions of the signal. The second experiment examined the combined effect of random glimpse windows not locked to segments and the distributions of durations measured from the consonant versus vowel glimpses observed in Experiment 1. Results demonstrated that, for random glimpses, the cumulative sentence duration glimpsed was an excellent predictor of performance. Comparisons across experiments confirmed that higher proportions of vowel information within glimpses yielded the highest sentence intelligibility.

Measures of hearing threshold and temporal processing across the adult lifespan

Psychophysical data on hearing sensitivity and various measures of supra-threshold auditory temporal processing are presented for large groups of young (18-35 y), middle-aged (40-55 y) and older (60-89 y) adults. Hearing thresholds were measured at 500, 1414 and 4000 Hz. Measures of temporal processing included gap-detection thresholds for bands of noise centered at 1000 and 3500 Hz, stimulus onset asynchronies for monaural and dichotic temporal-order identification for brief vowels, and stimulus onset/offset asynchronies for the monaural temporal masking of vowel identification. For all temporal-processing measures, the impact of high-frequency hearing loss in older adults was minimized by a combination of low-pass filtering the stimuli and use of high presentation levels. The performance of the older adults was worse than that of the young adults on all measures except gap-detection threshold at 1000 Hz. Middle-aged adults performed significantly worse than the young adults on measures of threshold sensitivity and three of the four measures of temporal-order identification, but not for any of the measures of temporal masking. Individual differences are also examined among a group of 124 older adults. Cognition and age were found to be significant predictors, although only 10-27% of the variance could be accounted for by these predictors.

The role of vowel and consonant fundamental frequency, envelope, and temporal fine structure cues to the intelligibility of words and sentences.

The speech signal contains many acoustic properties that may contribute differently to spoken word recognition. Previous studies have demonstrated that the importance of properties present during consonants or vowels is dependent upon the linguistic context (i.e., words versus sentences). The current study investigated three potentially informative acoustic properties that are present during consonants and vowels for monosyllabic words and sentences. Natural variations in fundamental frequency were either flattened or removed. The speech envelope and temporal fine structure were also investigated by limiting the availability of these cues via noisy signal extraction. Thus, this study investigated the contribution of these acoustic properties, present during either consonants or vowels, to overall word and sentence intelligibility. Results demonstrated that all processing conditions displayed better performance for vowel-only sentences. Greater performance with vowel-only sentences remained, despite removing dynamic cues of the fundamental frequency. Word and sentence comparisons suggest that the speech envelope may be at least partially responsible for additional vowel contributions in sentences. Results suggest that speech information transmitted by the envelope is responsible, in part, for greater vowel contributions in sentences, but is not predictive for isolated words.

The relative importance of consonant and vowel segments to the recognition of words and sentences: Effects of age and hearing loss

This study investigated the ability to use cues contained within vowel and consonant segments by older listeners with normal or impaired hearing. Spectral shaping restored audibility for the hearing-impaired group. Word and sentence materials were processed to contain primarily consonants or vowels by replacing segments with low-level speech-shaped noise. The proportion of the total duration of preserved speech was varied by manipulating the amount of transitional information contained within vowel and consonant segments. Older listeners performed more poorly than young listeners on all conditions except when listening to sentences with only the vowels preserved. Results confirmed a greater contribution to intelligibility of vowel segments in sentences, but not in words, for young normal-hearing, older normal-hearing, and older hearing-impaired listeners. Older listeners received a greater benefit than young listeners from vowels presented in a sentence context. Correlation analyses among the older listeners demonstrated an association between consonant and vowel performance in isolated words but not in sentences. In addition, the use of vowel cues in sentences was relatively independent of age and auditory sensitivity when audibility is ensured. Combined, results argue that older listeners are able to use essential cues carried by vowels for sentence intelligibility.

Perceptual contributions to monosyllabic word intelligibility: Segmental, lexical, and noise replacement factors

This study investigated the relative contributions of consonants and vowels to the perceptual intelligibility of monosyllabic consonant-vowel-consonant (CVC) words. A noise replacement paradigm presented CVCs with only consonants or only vowels preserved. Results demonstrated no difference between overall word accuracy in these conditions; however, different error patterns were observed. A significant effect of lexical difficulty was demonstrated for both types of replacement, whereas the noise level used during replacement did not influence results. The contribution of consonant and vowel transitional information present at the consonant-vowel boundary was also explored. The proportion of speech presented, regardless of the segmental condition, overwhelmingly predicted performance. Comparisons were made with previous segment replacement results using sentences [Fogerty, and Kewley-Port (2009). J. Acoust. Soc. Am. 126, 847-857]. Results demonstrated that consonants contribute to intelligibility equally in both isolated CVC words and sentences. However, vowel contributions were mediated by context, with greater contributions to intelligibility in sentence contexts. Therefore, it appears that vowels in sentences carry unique speech cues that greatly facilitate intelligibility which are not informative and/or present during isolated word contexts. Consonants appear to provide speech cues that are equally available and informative during sentence and isolated word presentations.

Perceptual weighting of individual and concurrent cues for sentence intelligibility: frequency, envelope, and fine structure.

The speech signal may be divided into frequency bands, each containing temporal properties of the envelope and fine structure. For maximal speech understanding, listeners must allocate their perceptual resources to the most informative acoustic properties. Understanding this perceptual weighting is essential for the design of assistive listening devices that need to preserve these important speech cues. This study measured the perceptual weighting of young normal-hearing listeners for the envelope and fine structure in each of three frequency bands for sentence materials. Perceptual weights were obtained under two listening contexts: (1) when each acoustic property was presented individually and (2) when multiple acoustic properties were available concurrently. The processing method was designed to vary the availability of each acoustic property independently by adding noise at different levels. Perceptual weights were determined by correlating a listeners performance with the availability of each acoustic property on a trial-by-trial basis. Results demonstrated that weights were (1) equal when acoustic properties were presented individually and (2) biased toward envelope and mid-frequency information when multiple properties were available. Results suggest a complex interaction between the available acoustic properties and the listening context in determining how best to allocate perceptual resources when listening to speech in noise.

Importance of envelope modulations during consonants and vowels in segmentally interrupted sentences.

The present study investigated the importance of overall segment amplitude and intrinsic segment amplitude modulation of consonants and vowels to sentence intelligibility. Sentences were processed according to three conditions that replaced consonant or vowel segments with noise matched to the long-term average speech spectrum. Segments were replaced with (1) low-level noise that distorted the overall sentence envelope, (2) segment-level noise that restored the overall syllabic amplitude modulation of the sentence, and (3) segment-modulated noise that further restored faster temporal envelope modulations during the vowel. Results from the first experiment demonstrated an incremental benefit with increasing resolution of the vowel temporal envelope. However, amplitude modulations of replaced consonant segments had a comparatively minimal effect on overall sentence intelligibility scores. A second experiment selectively noise-masked preserved vowel segments in order to equate overall performance of consonant-replaced sentences to that of the vowel-replaced sentences. Results demonstrated no significant effect of restoring consonant modulations during the interrupting noise when existing vowel cues were degraded. A third experiment demonstrated greater perceived sentence continuity with the preservation or addition of vowel envelope modulations. Overall, results support previous investigations demonstrating the importance of vowel envelope modulations to the intelligibility of interrupted sentences.

Perceptual weighting of the envelope and fine structure across frequency bands for sentence intelligibility: Effect of interruption at the syllabic-rate and periodic-rate of speech

Listeners often only have fragments of speech available to understand the intended message due to competing background noise. In order to maximize successful speech recognition, listeners must allocate their perceptual resources to the most informative acoustic properties. The speech signal contains temporally-varying acoustics in the envelope and fine structure that are present across the frequency spectrum. Understanding how listeners perceptually weigh these acoustic properties in different frequency regions during interrupted speech is essential for the design of assistive listening devices. This study measured the perceptual weighting of young normal-hearing listeners for the envelope and fine structure in each of three frequency bands for interrupted sentence materials. Perceptual weights were obtained during interruption at the syllabic rate (i.e., 4 Hz) and the periodic rate (i.e., 128 Hz) of speech. Potential interruption interactions with fundamental frequency information were investigated by shifting the natural pitch contour higher relative to the interruption rate. The availability of each acoustic property was varied independently by adding noise at different levels. Perceptual weights were determined by correlating a listeners performance with the availability of each acoustic property on a trial-by-trial basis. Results demonstrated similar relative weights across the interruption conditions, with emphasis on the envelope in high-frequencies.

A correlational method to concurrently measure envelope and temporal fine structure weights: Effects of age, cochlear pathology, and spectral shaping

The speech signal may be divided into spectral frequency-bands, each band containing temporal properties of the envelope and fine structure. This study measured the perceptual weights for the envelope and fine structure in each of three frequency bands for sentence materials in young normal-hearing listeners, older normal-hearing listeners, aided older hearing-impaired listeners, and spectrally matched young normal-hearing listeners. The availability of each acoustic property was independently varied through noisy signal extraction. Thus, the full speech stimulus was presented with noise used to mask six different auditory channels. Perceptual weights were determined by correlating a listeners performance with the signal-to-noise ratio of each acoustic property on a trial-by-trial basis. Results demonstrate that temporal fine structure perceptual weights remain stable across the four listener groups. However, a different weighting typography was observed across the listener groups for envelope cues. Results suggest that spectral shaping used to preserve the audibility of the speech stimulus may alter the allocation of perceptual resources. The relative perceptual weighting of envelope cues may also change with age. Concurrent testing of sentences repeated once on a previous day demonstrated that weighting strategies for all listener groups can change, suggesting an initial stabilization period or susceptibility to auditory training.

Sentence intelligibility during segmental interruption and masking by speech-modulated noise: Effects of age and hearing loss

This study investigated how single-talker modulated noise impacts consonant and vowel cues to sentence intelligibility. Younger normal-hearing, older normal-hearing, and older hearing-impaired listeners completed speech recognition tests. All listeners received spectrally shaped speech matched to their individual audiometric thresholds to ensure sufficient audibility with the exception of a second younger listener group who received spectral shaping that matched the mean audiogram of the hearing-impaired listeners. Results demonstrated minimal declines in intelligibility for older listeners with normal hearing and more evident declines for older hearing-impaired listeners, possibly related to impaired temporal processing. A correlational analysis suggests a common underlying ability to process information during vowels that is predictive of speech-in-modulated noise abilities. Whereas, the ability to use consonant cues appears specific to the particular characteristics of the noise and interruption. Performance declines for older listeners were mostly confined to consonant conditions. Spectral shaping accounted for the primary contributions of audibility. However, comparison with the young spectral controls who received identical spectral shaping suggests that this procedure may reduce wideband temporal modulation cues due to frequency-specific amplification that affected high-frequency consonants more than low-frequency vowels. These spectral changes may impact speech intelligibility in certain modulation masking conditions.