SPEESH: speech-based mobile application for dysarthric speech recognition

Abstract

There are numerous automatic speech recognition applications available in market, but these applications are quite challenging to be used for individual with speech disability. Due to this demand, SPEESH, a speech recognition system is developed for individuals with dysarthria disorders. The main objective of this project is to study the requirement of proposed system and characteristics of individuals with dysarthria. Interview with speech therapists in Malaysia has been conducted on the phone to elicit the requirements for the system. Based on the interview, we acquired numerous common words that are used by dysarthric patients. These findings are crucial in designing the application to ease the user’s experience. The system consists of two phases on how it works; text dependent and text independent. First, in a text dependent phase, the system will learn to recognize specific words from the speaker and register them into database. In the next phase, speaker model will now consist characteristics of voice of the person and it can identify what one is saying. SPEESH application have been designed to be able to translate words from individuals with dysarthria or any speech disorders. All the functionalities and features are all developed in a way such that SPEESH will work as a communication platform between dysarthria individuals and their surroundings.