automated testing, Oral Proficiency Interview, Elicited Imitation


Automated testing of spoken language is the subject of much current research. Elicited Imitation (EI), or sentence repetition, is well suited for automated scoring, but does not directly test a broad range of speech communication skills. An Oral Proficiency Interview (OPI) tests a broad range of skills, but is not as well suited for automated scoring. Some have suggested that EI can be used as a predictor of more general speech communication abilities. We examine EI for this purpose. A fully automated EI test is used to predict OPI scores. Experiments show strong correlation between predicted and actual OPI scores. Effectiveness of OPI score prediction depends upon at least two important design decisions. One of these decisions is to base prediction primarily on acoustic measures, rather than on transcription. The other of these decisions is the choice of sentences, or EI test items, to be repeated. It is shown that both of these design decisions can greatly impact performance. It is also shown that the effectiveness of individual test items can be predicted.

Original Publication Citation

Kevin Cook, Jeremiah McGhee, and Deryle Lonsdale (2011). Elicited imitation for automaticprediction of OPI Test Scores. Proceedings of the Sixth Workshop on Innovative Use of NLP forBuilding Educational Applications, pp. 30-37. Portland, OR.: Association for Computational Linguistics.

Document Type

Conference Paper

Publication Date



Association for Computational Linguistics







University Standing at Time of Publication

Associate Professor

Included in

Linguistics Commons