Keywords
Color segmentation, lip shape recognition, shape analysis, and speech pathology
Abstract
We have built a machine vision system to perform lip shape analysis and recognition and to generate 3.D lip models for speech pathology research. The system employs two color cameras that are synchronized to capture image video pairs simultaneously. A novel color segmentation technique that converts the RGB color components to linear color space has been developed to extract lip shape contours. Lip shape of the viseme, the smallest visibly distinguishable unit of speech, is used to identify its corresponding image frame in the recorded image sequences. It is also used to reconstruct the 3-D lip shape model as a quantitative description of the visible aspects of spoken language for speech pathology research.
Original Publication Citation
Lee, D.J., Bates, D., Dromey, C. & Xu, X. (2003). A vision system performing lip shape analysis for speech pathology research. Paper presented at the 29th Annual Conference of the IEEE Industrial Electronics Society, Roanoke, VA.
BYU ScholarsArchive Citation
Dromey, Christopher; Lee, D J.; Bates, Daniel; and Xu, Xiaoqian, "A Vision System Performing Lip Shape Analysis for Speech Pathology Research" (2003). Faculty Publications. 7299.
https://scholarsarchive.byu.edu/facpub/7299
Document Type
Conference Paper
Publication Date
2003
Publisher
IEEE
Language
English
College
David O. McKay School of Education
Department
Communication Disorders
Copyright Status
©2003 IEEE
Copyright Use Information
https://lib.byu.edu/about/copyright/