Diapositive 1 - Language assessment
Download
Report
Transcript Diapositive 1 - Language assessment
One team, one test
Test de Connaissance du Français - Pôle Évaluation et Certifications - Centre International d’Études Pédagogiques
1, avenue Léon Journault - 92318 – Sèvres - France
Marianne MAVEL, Gilles BRETON, Juliette WATTEBLED, Christine TAGLIANTE, Sébastien GEORGES ([email protected])
Operation management process
Items
production
Operating
procedures
3 compulsory sections
2 optional sections
• Oral comprehension
• Language structure
• Speaking
• Reading comprehension • Writing
Pre-test
session
Pre-test
development
Verification
Internal
evaluation
committee
Optional
test
production
Items
production
Psychometrical
analysis
of results
Items
validation
committee
Stocking
Test
development
A methodological and scientific
Certificates
sent
conception
Printing
80 multiple
choice questions
30 in OC
20 in LS
30 in RC
Duration = 1½hours
Why TCF is a test.
cycle
Stocking
Compulsory
sections
TCF composition
The same administration and correction conditions
are always applied (standardised test).
Psychometrical analyses guarantee dependable and
comparable results (reliable test).
The TCF items measure only what they are supposed
to evaluate (valid test). Each item is pre-tested on a
sample population in order to define statistical
characteristics (calibrated and sensitive test).
Six levels
The Common European
Framework of Reference
for Language learning,
teaching and
assessment
Test
production
cycle
Materials
sent safely to
test centres
Testing
session
Test and
materials
returned
Marking
Items commissionned from item writers
Items evaluation by team manager
Items evaluation by internal committee
Optional
test
marking
Invigilation
Pre-test development and session
11 anchors (4 in OC, 3 in LS and 4 in RC) and 69 new items
200 to 500 examinees in accredited pre-test centres
Analysis
Classical Test Theory and Rasch Model
Classical Test
Theory
Item difficulty
Key analysis
Distractors analysis
Item discrimination
Items compilation
Conversion chart
(rough score / calibrated score)
Conversion chart consitency
Unidimensionality
Observed / Expected
Item measure / Examinee ability
Lucky choice by ignorance
Bias analysis
Printing
Materials sent
Testing session
Materials returned
Rejected
Accepted
Rejected
Anchoring
Test development
Rasch model
Accepted
Banking
Determination of items’ psychometrical qualities
Seeking of differential item functioning
Determination of item difficulty level
Analyses lead to a rejection or acceptance of pre-tested items
Scanning
Production test marking
Certificates sent
Florence Bonnaz
Gilles Breton
Maryse Da Gamma
Nathalie Duplaissy
Dorothée Dupleix
Narjès El Gharbi
Sébastien Georges
Maryvonne Gilles
Martine Gongakola
Catherine Houssa
Marianne Mavel
Bruno Mègre
Etienne Pouvreau
Christine Tagliante
Juliette Wattebled