Language learners are known to fare best in one-on-one interactive learning situations in which they receive optimal corrective feedback. However, providing this type of tutoring by trained language instructors is time-consuming and costly, and therefore not feasible for the majority of language learners. This particularly applies to oral proficiency, where corrective feedback has to be provided immediately after the utterance has been spoken, thus making it even more difficult to provide sufficient practice in the classroom. The recent appearance of Computer Assisted Language Learning (CALL) systems that make use of Automatic Speech Recognition (ASR) and other advanced automatic techniques offers new perspectives for training oral proficiency in a second language (L2).
The present project aims to develop and test a prototype of an ASR-based CALL application for training oral proficiency for Dutch as a second language (DL2). The application optimizes learning through interaction in realistic communication situations and provides intelligent feedback on various aspects of DL2 speaking, viz. pronunciation, morphology and syntax. The communicative settings employed in Nieuwe Buren (New Neighbours, a method for DL2 training developed by Malmberg publishers) will constitute the starting point for the application.
This project addresses the STEVIN priorities, tools and data for the development of CALL applications, educational system, robustness of speech recognition, confidence measures and adaptation. It combines speech and language technology techniques to form a state-of-the-art CALL application, which can be considered innovative from an international perspective.
The results of this project are relevant for companies and institutions that conduct research and develop applications in educational speech and language technology, and also for publishers.
This project will be carried out within the framework of the Stevin Program.
Partners
CLST - Centre for Language and Speech Technology, Radboud University Nijmegen
UA - Linguapolis, Universiteit Antwerpen
RiL - Radboud in’to Languages
PDL - Polderland Language & Speech Technology
Publications (in anti-chronological order)
- J. van Doremalen, C. Cucchiarini, H. Strik (to appear)
Optimizing automatic speech recognition for low-proficient non-native speakers.
EURASIP Journal on Audio, Speech, and Music Processing. [PDF] - J. van Doremalen, C. Cucchiarini, H. Strik (2009)
Automatic Detection of Vowel Pronunciation Errors Using Multiple Information Sources.
To appear in proceedings of the biannual IEEE workshop on Automatic Speech Recognition and Understanding (ASRU) 2009. [PDF] - J. van Doremalen, H. Strik, C. Cucchiarini (2009)
Optimizing non-native speech recognition for CALL applications.
Proceedings of Interspeech-2009, Brighton, UK, pp. 592-595. [PDF] - J. van Doremalen, H. Strik, C. Cucchiarini (2009)
Utterance Verifiction in Language Learning Applications.
Proceedings of the SLaTE-2009 workshop, Warwickshire, England. [PDF] - H. Strik , F. Cornillie, J. Colpaert, J. van Doremalen, C. Cucchiarini (2009)
Developing a CALL System for Practicing Oral Proficiency: How to Design for Speech Technology, Pedagogy and Learners.
Proceedings of the SLaTE-2009 workshop, Warwickshire, England. [PDF] - F. Cornillie, J. Colpaert (2009)
Motivation revisited: empirical and theoretical validation of the Distributed Language Learning model.
EuroCALL 2009 conference handbook Ed. A. Gimeno, ISBN: 978-84-692-4598-9). Valencia, Spain. pp. 133-134. [PDF] - J. Colpaert, F. Cornillie (2009)
Designing for authenticity: a framework and guidelines for conversation simulation courseware.
Language Teaching Symposium 2009, Gent. [PDF] - C. Cucchiarini, A. Neri, H. Strik (2009)
Oral Proficiency Training in Dutch L2: the Contribution of ASR-based Corrective Feedback.
Speech Communication, Volume 51, Issue 10, October 2009, Pages 853-863. [doi] - H. Strik en C. Cucchiarini (2008)
DISCO – Nederlands leren spreken met hulp van de computer.
Special issue van DIXIT over ‘Stevin en onderwijs’, p. 18. [PDF] - C. Cucchiarini, J. van Doremalen, and H. Strik (2008)
DISCO: Development and Integration of Speech technology into Courseware for language learning.
Proceedings of Interspeech-2008, Brisbane, Australia, Sept. 26-29, 2008, pp. 2791-2794. [PDF] - H. Strik, J. van Doremalen and C. Cucchiarini (2008)
A CALL system for practicing speaking proficiency: pronunciation, morphology and syntax.
Proceedings of the XIIIth Int. CALL Conference, Antwerp, 30 August – 1 September 2008, pp. 123-125. - Helmer Strik, Ambra Neri, and Catia Cucchiarini (2008)
Speech technology for language tutoring.
Proceedings of LangTech-2008, Rome, February 28-29, 2008. [PDF]
Presentations (in anti-chronological order)
- F. Cornillie; Motivation revisited: empirical and theoretical validation of the Distributed Language Learning model.
EuroCALL 2009 conference, Gandia (Spain), 11-9-2009. [PDF pres.] [PDF hand-out] - J. van Doremalen; Optimizing non-native speech recognition for CALL applications.
Interspeech-2009, Brighton (UK), 11-9-2009. [PDF] - H. Strik; Developing a CALL System for Practicing Oral Proficiency: How to Design for Speech Technology, Pedagogy and Learners.
SLaTE-2009 workshop, Warwickshire (UK), 4-9-2009. [PDF] - J. van Doremalen; Utterance Verification in Language Learning Applications.
SLaTE-2009 workshop, Warwickshire (UK), 3-9-2009. [PDF] - J. Colpaert; Designing for authenticity: a framework and guidelines for conversation simulation courseware.
Language Teaching Symposium 2009, Gent, 29-05-2009. [PPT] - J. Colpaert; Goal-oriented Distributed Learning.
Van E-learning tot bedrijfstheater: vernieuwende leervormen in bedrijfsopleidingen, Business Faculty, Brussels, 19-03-2009. - J. Colpaert; Beyond motivation: How Self is Self? An exercise in theoretical validation of empirical findings in CALL.
CALICO 2009, Arizona State University, Phoenix, 14-03-2009. - J. Colpaert, Invited master class (L. Gómez): Beyond motivation: designing for all learners and teachers.
Universidad de Concepción, Chile, 27-11-2008. - H. Strik; DISCO: Development and Integration of Speech technology into Courseware for language learning.
Conference: Inburgering via Technologische Innovatie, Rotterdam, 20-11-2008. [PPT] [PDF] - H. Strik; DISCO: Development and Integration of Speech technology into Courseware for language learning.
Taal in Bedrijf, Brussels, 19-11-2008. - H. Strik; How to integrate ASR into CALL applications.
LESLLA 2008, Antwerp, 24-10-08. [PPT] - C. Cucchiarini; DISCO: Development and Integration of Speech technology into Courseware for language learning.
Interspeech, Brisbane, 26-09-2008. [PPT] - J. van Doremalen; A CALL system for practicing speaking proficiency: pronunciation, morphology and syntax.
CALL 2008, Antwerp, 01-09-08 - H. Strik; Speech technology for language tutoring.
The language and speech technology conference, LangTech-2008, Rome, February 28-29, 2008. [PPT] [PDF] - H. Strik; DISCO: Development and Integration of Speech technology into Courseware for language learning.
Research group meeting, Department of Language and Speech, Radboud University, Nijmegen, 23-01-2008. [PPT] [PDF]
Links