Lloyd Watts

Multi-source phoneme classification for noise-robust automatic speech recognition

A system and method are disclosed for processing an audio signal including separating the audio signal into a plurality of streams which group sounds from a same source prior to classification and analyzing each separate stream to determine phoneme-level classification. One or more words of the audio signal may then be outputted.

Reverse-engineering the human auditory pathway

The goal of reverse-engineering the human brain, starting with the auditory pathway, requires three essential ingredients: Neuroscience knowledge, a sufficiently capable computing platform, and a long-term funding source. By 2003, the neuroscience community had a good understanding of the characterization of sound which is carried out in the cochlea and auditory brainstem, and 1.4 GHz single-core computers with XGA displays were fast enough that it was possible to build computer models capable of running and visualizing these processes in isolation at near biological resolution in real-time, and it was possible to raise venture capital funding to begin the project. By 2008, these advances had permitted the development of products in the area of two-microphone noise reduction for mobile phones, leading to viable business by 2010, thus establishing a self-sustaining funding source to continue the work into the next decade 2010-2020. By 2011, advances in fMRI, multi-electrode, and behavioral studies have illuminated the cortical brain regions responsible for separating sounds in mixtures, understanding speech in quiet and in noisy environments, producing speech, recognizing speakers, and understanding and responding emotionally to music. 2GHz computers with 8 virtual cores and HD displays now permit models of these advanced auditory brain processes to be simulated and displayed simultaneously in real-time, giving a rich perspective on the concurrent and interacting representations of sound and meaning which are developed and maintained in the brain, and exposing a deeper generality to brain architecture than was evident a decade earlier. While there is much still to be discovered and implemented in the next decade, we can show demonstrable progress on the scientifically ambitious and commercially important goal of reverse-engineering the human auditory pathway.

Advanced Noise Reduction for Mobile Telephony

Mobile telephones now contain advanced noise reduction based on the operation of the human hearing system.

Real-time, high-resolution simulation of the auditory pathway, with application to cell-phone noise reduction

Recent advances in computing and auditory neuroscience have now made it possible to produce highresolution, real-time simulations of major portions of the human auditory pathway, including high resolution, real-time models of the cochlea, major cell-types of the cochlear nucleus, lateral and medial superior olivary complex, as well as polyphonic pitch perception based on combination-sensitive cells measured in inferior colliculus and auditory cortex, all running live on a notebook computer. These technologies are the foundation of Audiences Voice Processor chip, which provides advanced two-microphone noise reduction for cell-phones. The design of the simulated system required many careful decisions about what biological details to include, in order to preserve functional biological realism, while meeting the constraints of real-time implementation and commercial product realization.