Transcript TIMSS 2007 Ina V.S. Mullis and Michael O. Martin 0 47

0
TIMSS 2007
Ina V.S. Mullis and Michael O. Martin
47th IEA General Assembly
Amiens, France
9-12 October, 2006
1
TIMSS 2007
• Mathematics and Science
• Grades 4 and 8
• Trends 1995, 1999, 2003, 2007
• Baseline for New Countries
2
Mathematics Content Domains
Fourth-Grade
Percentages
Number
50%
Geometric Shapes and Measures
35%
Data Display
15%
Eighth-Grade
Number
30%
Algebra
30%
Geometry
20%
Data and Chance
20%
3
Science Content Domains
Fourth-Grade
Percentages
Life Science
45%
Physical Science
35%
Earth Science
20%
Eighth-Grade
Biology
35%
Chemistry
20%
Physics
25%
Earth Science
20%
Countries Participating
Algeria
Armenia
Australia
Austria
Bahrain
Bosnia
Botswana
Bulgaria
Canada, Alberta
Canada, B.C.
Canada, Ontario
Canada, Quebec
Chinese Taipei
Colombia
Cyprus
Czech Republic
Denmark
Djibouti
Egypt
El Salvador
England
Georgia
Ghana
Honduras
Hong Kong, SAR
Hungary
Indonesia
Iran
Israel
Italy
Japan
Jordan
Kazakhstan
Korea, Rep. of
Kuwait
Latvia
Lebanon
Lithuania
Malaysia
Malta
Moldova
Mongolia
Morocco
Netherlands
New Zealand
Norway
4
Oman
Palestinian Auth.
Qatar
Romania
Russian Federation
Saudi Arabia
Scotland
Serbia
Singapore
Slovak Republic
Slovenia
Spain, Basque Country
Sweden
Syrian Arab Republic
Thailand
Tunisia
Turkey
Ukraine
United States
United States,
Massachusetts
United States, Minnesota
Yemen, Rep. of
Major Accomplishments Since
Last General Assembly
• Conducted Field Test
– 100,000 Students
• Finalized Main Survey Instruments
• Began Data Collection in Southern
Hemisphere
5
6
TIMSS 2007 SMIRC
Mathematics Experts
Kiril Bankov, Bulgaria
Hanako Senuma, Japan
Khattab Mohammad Abu Lebdeh, Jordan
Robert Garden, New Zealand
Liv Sissel Gronmo, Norway
Mary Lindquist, United States
7
TIMSS 2007 SMIRC
Science Experts
Ahmed Mohammed Rafea, Bahrain
Chen-yung Lin, Chinese Taipei
Jophus Anamuah-Mensah, Ghana
Gabriela Noveanu, Romania
Galina Kovaleva, Russian Federation
Jackie Heaton, Scotland
Audrey Champagne, United States
8
TIMSS 2007 QIRC
Sue Thomson, Australia
Serge Baillergeon, Quebec
Solaiman El-Khodary El-Sheikh, Egypt
Martina Meelissen, The Netherlands
Boey Kok Leong, Singapore
Barbara Japelj, Slovenia
Patrick Gonzales, United States
9
TIMSS 2007 Assessment Specialists
• Mathematics Coordinator
– Graham Ruddock, NFER
• Science Coordinator
– Christine O’Sullivan, K-12 Consulting
• Special “Task Force” Consultants in
Mathematics and Science
– Intensive Week-long Working Sessions
10
TIMSS 2007 Assessment Specialists
• Staff at TIMSS & PIRLS ISC
– Content/Measurement Experience
– Production/Graphics Experience
• NRCs – National Research Coordinators
– Wealth of Knowledge and Experience
11
Overview of Year’s Activities
Finalized Field-test Instruments
• 3rd NRC Meeting for Final Review of
Instruments and Procedures
– Ljubljana, Slovenia, November 2005
• Materials for TIMSS 2007 Field Test Posted on
Web
– December 2005
12
Translation and Verification
• Translation and Verification Began
– January 2006
• Layout and Verification Began
– January 2006
• Translation Verification and Layout Verification
Completed
– April 2006
13
Scoring Training for Field Test
• Pilot Test in Six English-Speaking Countries
– January 2006
• Task Forces Met to Develop Training Materials
– February 2006
• Training Materials Posted on Website
– February 2006
• 4th NRC Meeting to Conduct Scoring Training
– March 2006
14
Conducted Field Test
March-April 2006
• 8th Grade
– 46 Countries
– 60,000 Students
– 1,200 Schools
• 4th Grade
– 33 Countries
– 40,000 Students
– 1,000 Schools
15
Analyzed and Reviewed Fieldtest Results
• Mathematics and Science Data Processed and
Analyzed for Grades 4 and 8
– July 2006
• School, Teacher, and Student Questionnaire Data
Processed and Analyzed for Grades 4 and 8
– July 2006
• 3rd SMIRC Meeting to Review Results and
Propose a Set of Items for Data Collection
– St. Petersburg, July 2006
16
Analyzed and Reviewed Fieldtest Results (cont.)
• 2nd QIRC Meeting to Review Results and
Recommend Questionnaires for Data Collection
– Hamburg, July 2006
• Posted Recommended Items, Questionnaires,
and Field-test Statistics for NRC Review
– July 2006
17
Analyzed and Reviewed Fieldtest Results (cont.)
• 5th NRC Meeting to Review and Approve Items
and Questionnaires for TIMSS 2007 Data
Collection
– Riga, Latvia, August 2006
• Final Instruments Posted on Website
– August 25, 2006
18
Data Collection – Southern
Hemisphere
• Translation and Verification
– September-October 2006
• Layout and Verification
– September-October 2006
• Arabic Translation
– August-November 2006
19
Data Collection – Southern
Hemisphere (cont.)
• Scoring Training Materials Prepared
– September-October 2006
• Training Materials Posted on Web for Southern
Hemisphere Countries
– October 2006
• Scoring Training Meeting
– Melbourne, October 2006
20
Data Collection – Southern
Hemisphere (cont.)
TIMSS 2007 Begins Data
Collection Now!!
21
Data Collection – Northern
Hemisphere
• Translation Verification
– January-March 2007
• 6th NRC Meeting for Scoring Training
– Amman, Jordan, March 2007
Data Collection March – June 2007
22
TIMSS 2007
Ina V.S. Mullis and Michael O. Martin
47th IEA General Assembly
Amiens, France
9-12 October, 2006