Keywords

sentence repetition test, French, speech recognition, scoring methods

Abstract

Sentence repetition (SR) tests are one way of probing a language learner’s oral proficiency. Test-takers listen to a set of carefully engineered sentences of varying complexity one-by-one, and then try to repeat them back as exactly as possible. In this paper we explore how well an SR test that we have developed for French corresponds with the test-taker’s achievement levels, represented by proficiency interview scores and by college class enrollment. We describe how we developed our SR test items using various language resources, and present pertinent facts about the test administration. The responses were scored by humans and also by a specially designed automatic speech recognition (ASR) engine; we sketch both scoring approaches. Results are evaluated in several ways: correlations between human and ASR scores, item response analysis to quantify the relative difficulty of the items, and criterion-referenced analysis setting thresholds of consistency across proficiency levels. We discuss several observations and conclusions prompted by the analyses, and suggestions for future work.

Original Publication Citation

Deryle Lonsdale and Benjamin Millard (2014). Student achievement and French sentence repetition test scores; In: N. Calzolari, K. Choukri, T. Declerck, H. Loftsson, B. Maegaard, J.Mariani, A. Moreno, J. Odijk and S Piperidis (Eds.), Proceedings of the Ninth InternationalConference on Language Resources and Evaluation (LREC'14) , pp. 2719-2725; EuropeanLanguage Resources Association (ELRA); ISBN 978-2-9517408-8-4.

Document Type

Conference Paper

Publication Date

2014

Publisher

European Language Resources Association

Language

English

College

Humanities

Department

Linguistics

University Standing at Time of Publication

Associate Professor

Included in

Linguistics Commons

Share

COinS