Transcript Diapositive 1 - Language assessment

One team, one test
Test de Connaissance du Français - Pôle Évaluation et Certifications - Centre International d’Études Pédagogiques
1, avenue Léon Journault - 92318 – Sèvres - France
Marianne MAVEL, Gilles BRETON, Juliette WATTEBLED, Christine TAGLIANTE, Sébastien GEORGES ([email protected])


Operation management process
Items
production
Operating
procedures
3 compulsory sections
2 optional sections
• Oral comprehension
• Language structure
• Speaking
• Reading comprehension • Writing
Pre-test
session
Pre-test
development
Verification
Internal
evaluation
committee
Optional
test
production
Items
production
Psychometrical
analysis
of results
Items
validation
committee
Stocking
Test
development
A methodological and scientific
Certificates
sent
conception
Printing
80 multiple
choice questions
30 in OC
20 in LS
30 in RC
Duration = 1½hours

Why TCF is a test.
cycle
Stocking
Compulsory
sections
TCF composition
The same administration and correction conditions
are always applied (standardised test).
Psychometrical analyses guarantee dependable and
comparable results (reliable test).
The TCF items measure only what they are supposed
to evaluate (valid test). Each item is pre-tested on a
sample population in order to define statistical
characteristics (calibrated and sensitive test).
Six levels
The Common European
Framework of Reference
for Language learning,
teaching and
assessment

Test
production
cycle
Materials
sent safely to
test centres
Testing
session
Test and
materials
returned
Marking
Items commissionned from item writers
Items evaluation by team manager
Items evaluation by internal committee
Optional
test
marking
Invigilation


Pre-test development and session
11 anchors (4 in OC, 3 in LS and 4 in RC) and 69 new items
200 to 500 examinees in accredited pre-test centres

Analysis
Classical Test Theory and Rasch Model

Classical Test
Theory
Item difficulty
Key analysis
Distractors analysis
Item discrimination

Items compilation
Conversion chart
(rough score / calibrated score)
Conversion chart consitency
Unidimensionality
Observed / Expected
Item measure / Examinee ability
Lucky choice by ignorance
Bias analysis

Printing
Materials sent
Testing session
Materials returned
Rejected

Accepted
Rejected
Anchoring

Test development
Rasch model
Accepted
Banking

Determination of items’ psychometrical qualities
Seeking of differential item functioning
Determination of item difficulty level
Analyses lead to a rejection or acceptance of pre-tested items
Scanning
Production test marking
Certificates sent
Florence Bonnaz
Gilles Breton
Maryse Da Gamma
Nathalie Duplaissy
Dorothée Dupleix
Narjès El Gharbi
Sébastien Georges
Maryvonne Gilles
Martine Gongakola
Catherine Houssa
Marianne Mavel
Bruno Mègre
Etienne Pouvreau
Christine Tagliante
Juliette Wattebled