Childhood apraxia of speech

The objective of this work is to develop a multi-tier software architecture for automating the administration of speech therapy to children suffering from  apraxia of speech (CAS).  CAS is a neurological pediatric speech sound disorder (SSD) that debilitates oro-motor planning, and execution. CAS can delay acquisition of skills including the control of tone, breathing, intensity, and vocalization.  Our architecture follows a client-server model and facilitates task-oriented remote therapeutic training in home settings. The therapy regimen is remotely assigned to the child by a speech therapist based on a standardized protocol. We utilize tablet PCs to provide stimuli to the children and record their speech response. The speech data is then streamed to a backend server running specialized speech-processing modules to identify errors and quantify the progress of the child. These automated results allow the therapist to closely monitor the performance of each child, provide relevant feedback, and adapt the training program as needed. Our proposed architecture can accommodate a variety of interaction modalities that can serve as a complement to traditional face-to-face speech practice.


Relevant Publications


Ahmed, B; Monroe, P; Hair, A; Tan, C -T; Gutierrez-Osuna, R; Ballard, K J

Speech-driven mobile games for speech therapy: User experiences and feasibility Journal Article Forthcoming

International Journal of Speech-Language Pathology , Forthcoming.

Links | BibTeX

McKechnie, J; Ahmed, B; Gutierrez-Osuna, R; Monroe, P; McCabe, P; Ballard, K J

Automated speech analysis tools for children’s speech production: A systematic literature review Journal Article

International Journal of Speech-Language Pathology, 0 (0), pp. 1-17, 2018.

Links | BibTeX

Hair, A; Monroe, P; Ahmed, B; Ballard, K J; Gutierrez-Osuna, R

Apraxia World: A Speech Therapy Game for Children with Speech Sound Disorders Inproceedings

Proceedings of the 2018 Conference on Interaction Design and Children, ACM, 2018, ISBN: 978-1-4503-5152-2/18/06.

Abstract | Links | BibTeX


McKechnie, J; Ballard, K J; McCabe, P; Murray, E; Lan, T; Gutierrez-Osuna, R; Ahmed, B

Influence of type of feedback on effect of tablet-based delivery of intensive speech therapy in children with Childhood Apraxia of Speech Inproceedings

Proceedings of the Motor Speech Conference, 2016.



Parnandi, A; Karappa, V; Lan, T; Shahin, M; McKechnie, J; Ballard, K; Ahmed, B; Gutierrez-Osuna, R

Development of a remote therapy tool for childhood apraxia of speech Journal Article

ACM Transactions on Accessible Computing, 7 (3), pp. 10:1-10:23, 2015.

Links | BibTeX

Shahin, M; Ahmed, B; Parnandi, A; Karappa, V; McKechnie, J; Ballard, K; Gutierrez-Osuna, R

Tabby Talks: an automated tool for the assessment of childhood apraxia of speech Journal Article

Speech Communication, in press , 2015.

Links | BibTeX


Lan, T; Aryal, S; Ahmed, B; Ballard, K; Gutierrez-Osuna, R

Flappy Voice: An Interactive Game for Childhood Apraxia of Speech Therapy Inproceedings

Proc. CHI-PLAY, 2014.

Links | BibTeX

Shahin, M; Ahmed, B; McKechnie, J; Ballard, K; Gutierrez-Osuna, R

A comparison of GMM-HMM and DNN-HMM based pronunciation verification techniques for use in the assessment of childhood apraxia of speech Inproceedings

Proc. Interspeech, 2014.

Links | BibTeX


Parnandi, A; Karappa, V; Son, Y; Shahin, M; McKechnie, J; Ballard, K; Ahmed, B; Gutierrez-Osuna, R

Architecture of an automated therapy tool for childhood apraxia of speech Conference

The 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS), 2013.

Links | BibTeX