Keywords

automated testing, Oral Proficiency Interview, Elicited Imitation

Abstract

Automated testing of spoken language is the subject of much current research. Elicited Imitation (EI), or sentence repetition, is well suited for automated scoring, but does not directly test a broad range of speech communication skills. An Oral Proficiency Interview (OPI) tests a broad range of skills, but is not as well suited for automated scoring. Some have suggested that EI can be used as a predictor of more general speech communication abilities. We examine EI for this purpose. A fully automated EI test is used to predict OPI scores. Experiments show strong correlation between predicted and actual OPI scores. Effectiveness of OPI score prediction depends upon at least two important design decisions. One of these decisions is to base prediction primarily on acoustic measures, rather than on transcription. The other of these decisions is the choice of sentences, or EI test items, to be repeated. It is shown that both of these design decisions can greatly impact performance. It is also shown that the effectiveness of individual test items can be predicted.

Original Publication Citation

Kevin Cook, Jeremiah McGhee, and Deryle Lonsdale (2011). Elicited imitation for automaticprediction of OPI Test Scores. Proceedings of the Sixth Workshop on Innovative Use of NLP forBuilding Educational Applications, pp. 30-37. Portland, OR.: Association for Computational Linguistics.

Document Type

Conference Paper

Publication Date

2011

Publisher

Association for Computational Linguistics

Language

English

College

Humanities

Department

Linguistics

University Standing at Time of Publication

Associate Professor

Download

Included in

Linguistics Commons

Share

COinS