Keywords

Color segmentation, lip shape recognition, shape analysis, and speech pathology

Abstract

We have built a machine vision system to perform lip shape analysis and recognition and to generate 3.D lip models for speech pathology research. The system employs two color cameras that are synchronized to capture image video pairs simultaneously. A novel color segmentation technique that converts the RGB color components to linear color space has been developed to extract lip shape contours. Lip shape of the viseme, the smallest visibly distinguishable unit of speech, is used to identify its corresponding image frame in the recorded image sequences. It is also used to reconstruct the 3-D lip shape model as a quantitative description of the visible aspects of spoken language for speech pathology research.

Original Publication Citation

Lee, D.J., Bates, D., Dromey, C. & Xu, X. (2003). A vision system performing lip shape analysis for speech pathology research. Paper presented at the 29th Annual Conference of the IEEE Industrial Electronics Society, Roanoke, VA.

Document Type

Conference Paper

Publication Date

2003

Publisher

IEEE

Language

English

College

David O. McKay School of Education

Department

Communication Disorders

University Standing at Time of Publication

Full Professor

Share

COinS