Transcript DODDS-EUROPE - Mediterranean District ePortal

TerraNova
2013
Training Guide
Colleen Rohowsky, Office of the Director,, DoDDS-Europe

It is DoDEA policy that all system wide
assessments administered in DoDEA
measure student performance so that
inferences can be made about student
achievement in basic skill areas as
well as provide a source of
information for decision-makers
concerning programs and services.

DoDEA Regulation: 2000.06
Colleen Rohowsky, Office of the Director, DoDDS-Europe
22
1. Norm-referenced
Student scores are compared with a
“normal” group of students at a grade level
(Ex. TerraNova, 3rd Edition, Multiple Assessments)
2. Criterion-referenced
Student scores are compared with the
achievement of specific goals or standards
(Ex. U.S. History End-of-Course Assessment)
Colleen Rohowsky, Office of the Director, DoDDS-Europe
3







Refer to the TerraNova 3rd Edition Assessment
Coordinators Manual and the publisher’s instructions
in the Test Directions for Teachers
Follow procedures:
Prior to Test Administration
During Test Administration
After Test Administration
(Reference: TN 2013 ACM pages i-iv)
When Test Scores are Received, report any
irregularities to the Amy Dilmar, District ISS
Assessment POC, and copy Colleen Rowhosky, the
DODEA-Europe ISS Assessment Coordinator on the
report as consultations with HQ and the test
company may be necessary
Colleen Rohowsky, Office of the Director, DoDDS-Europe
4

Norm-referenced

Grades 3 – 11

Five Content Areas Tested: Reading,
Language Arts, Mathematics, Science,
and Social Studies

Baseline Established -2009

Testing Window: March 11-March 29, 2013

Colleen Rohowsky, Office of the Director, DoDDS-Europe
5

Do not discuss test questions or answers with
anyone!

This means you may not go back over a test section
and review it with students or colleagues –not
anyone!

Consequences for divulging test questions will
result in the invalidation of tests and other
appropriate action
Colleen Rohowsky, Office of the Director, DoDDS-Europe
6









Certified educators must administer theTerraNova
Proctors should not be parents of students in test session
Review plans and procedures prior to testing
Emphasize the importance of test security before, during and after
testing
Proctors can fill-in student-identifying information on test books
Proctors can make sure students are working in correct place and
marking only one answer for each test question
Proctors can distribute test materials, separate punch-out rulers in the
classroom
Proctors can collect materials at end of the testing session
Test materials must be returned to the School Assessment Coordinator,
daily
(Ref. TN Test Directions for Teachers, p. 2, for more details)

Colleen Rohowsky, Office of the Director, DoDDS-Europe
7

Reference DoDEA System wide
Assessment Program Regulation 2000.06

Some highlights:

TerraNova materials may be distributed to *”certified”
staff only. Students may not have access to any new
or completed assessment materials other than their
own and then only while they are actually taking the
test
* (A certified educator: TP status and employed by the school or
DSO or Area Office )

Colleen Rohowsky, Office of the Director, DoDDS-Europe
8

CTB “TerraNova, Test Directions for Teachers” may be
reviewed by *certified educators at any time

DoD Sponsors may review the “Teacher’s
Guide to TerraNova” and the Student Practice Test-at
the school- to determine any perceived conflict with
family values or religious beliefs-they may NOT take
them home
*(Educators employed in TP status at school or DSO)

Colleen Rohowsky, Office of the Director, DoDDS-Europe
9


TerraNova Practice Tests may be taken home by students, after they
have completed it in class (it may not be administered at home)
TerraNova Student Test Booklets are NOT available for review by
anyone!

TerraNova ACM – not available for review by parents, community

Copying any portion of the TN is prohibited

All TN Student Test Booklets must be coded for student
accommodations, if applicable, and shipped (with tracking numbers)
for scoring & copies of tracking numbers must be sent to the District
CSI/Assessment/Program Evaluation ISS-they forward to Area Office

Colleen Rohowsky, Office of the Director, DoDDS-Europe
10

TN Student Test Booklets will be distributed to
TN administrators - those administering the
assessment and this means teachers or other
authorized personnel, (certified educators) on
the first day of the assessment

The Student Test Booklets will be collected,
daily by a certified educator, at the end of
each test session, and stored in a locked room
or cabinet by the School Assessment
Coordinator or an administrator
Colleen Rohowsky, Office of the Director, DoDDS-Europe
11

Tests will be distributed to teachers the
morning of testing- each day of testing

Tests will be returned to the school
Assessment Coordinator or school
administrator daily and kept in a secure,
locked location
Colleen Rohowsky, Office of the Director, DoDDS-Europe
12

The school Assessment Coordinator will inventory
and store all TerraNova materials in a secure location
(e.g. locked cabinet, drawer, or storage room)

TN Student Test Booklets will not be available to
teachers or students at any time, except during the
administration of the test - starting the first day of
testing and not before

Community members/parents do not have access to
the TN Student Test Booklets or the TN ACM
Colleen Rohowsky, Office of the Director, DoDDS-Europe
13

Administer the Practice Activities in advance of testing – not day of
testing

Students must complete the Practice Activity in the classroom

Teachers will see which students have difficulty with aspects of the
test, (such as bubbling-in the answers and can assist them prior to
test time

Students may not take their Practice Activity home for homework

Once the Practice Activity is completed and reviewed with students by
the teacher, students may take it home and it does not have to be
returned to the school
Colleen Rohowsky, Office of the Director, DoDDS-Europe
14

Follow the TN Test Directions for Teachers exactly

Test directions should be read aloud exactly as written

Per publisher’s guidelines–administer one content area a day
(Contact DSO & Area Office, in extenuating circumstances that
would prevent testing in one content area a day)
(Ref. Test Directions for Teachers, p. 2)

Permissible to change the order of the tests
(Ref. Test Directions for Teachers, p. ii & p. 3)

Schedule make-ups, if students miss all or part of a test
(Ref. Test Directions for Teachers, p. 2)

Colleen Rohowsky, Office of the Director, DoDDS-Europe
15

Do not allow electronic devices of any kind in
the testing area (includes cell phones, digital
cameras, hand-held scanners, pagers, or
games)

Do not allow use of markers, pens,
highlighters, crayons, colored pencils, paint,
correction fluid on TerraNova
(Reference: Back of front cover of TerraNova 3rd Edition Test
Directions for Teachers & pages 11 & 12)

Allow Number 2 pencils only
Colleen Rohowsky, Office of the Director, DoDDS-Europe
16




Test questions have been designed and
adequate time has been provided so that
using a calculator will not offer any
particular advantage; however the
classroom use of calculators is supported
by the National Council for Teachers of
Mathematics
(Reference HQ DoDEA Memorandum dated 12 Nov. 2008)
(Reference TN 3rd Edition, Test Directions for Teachers, p. 1)
Colleen Rohowsky, Office of the Director, DoDDS-Europe
17

Calculators should NOT be used in Part 1 of the
TerraNova 3rd Edition, Multiple Assessments, Mathematics
test

All students in grades 3-11 should have access to a
calculator during the administration of Parts 2 and 3 of
the TerraNova, 3rd Edition, Multiple Assessments
Mathematics test

Students should be familiar with the use of a calculator
prior to testing
Colleen Rohowsky, Office of the Director, DoDDS-Europe
18

Optional: Four-Function Calculators-not provided with
test materials
(Ref. TN Test Directions for Teachers, page 1, Step 1)

The type of calculator provided should be one that
students are familiar with in the classroom

If students have never used calculators in the classroom
based on standard classroom practices, it cannot be
assumed that they all know how to use a calculator-this
may be the case especially for younger students (3rd
grade, for example)
Colleen Rohowsky, Office of the Director, DoDDS-Europe
19

The classroom use of calculators in DoDEA schools
has been supported by DoDEA Headquarters in the
past through direct purchase of calculators or
FADing of money to the Area Offices for their
purchase

Calculators were already purchased and in DoDDSEurope schools

Four-function calculators may be used but are not
provided with test materials

(See HQ Memorandum dated 12 Nov. 2008)
(See TN 3rd Edition, Test Directions for Teachers, p. 1)

Colleen Rohowsky, Office of the Director, DoDDS-Europe
20






The ESL Alternate Assessment (in the TN test family) is the
CAT Survey Plus Mathematics Computation test
ESL Levels 1 and 2 students should participate in the CAT
Survey Plus- (unless the ESL Student/Teacher Team
determines the student has advanced enough-since the initial
testing earlier in the school year- and can participate in the
TerraNova
Levels 1 and 2 ESL students in Grade 3 mark their responses
in the consumable Grade 3 CAT Plus student book
Levels 1 and 2 ESL students in Grades 4-11 are to only fill-in
the Mathematics Computation section of the CAT Plus
answer sheet (page 3 of the answer sheet)
Area Office ISS ESL POC: Jizela Chirichetti (DSN: 338-7372)
Colleen Rohowsky, Office of the Director, DoDDS-Europe
21

The LAS Links Form B is also part of the ESL Alternate
Assessment and is not administered during the TN test
window

LAS Links Form B: Administered during End-of-Year ESL
Assessment, April 1 – May 17, 2013, by the ESL teachers

The CAT Survey Plus Mathematics (alternate assessment
from the TerraNova family) is administered during the
TN test window
Area Office ISS ESL POC: Jizela Chirichetti (DSN: 338-7372)

Colleen Rohowsky, Office of the Director, DoDDS-Europe
22

Inclusive education supports the premise
that ALL students are to participate in
system wide testing

The “No Child Left Behind” Act also
supports this

Accommodations enable a student to have
equal access to participation in DoDEA
assessments
Colleen Rohowsky, Office of the Director, DoDDS-Europe
23



Any student (including home- schoolers) using test
accommodations must have an Individualized
Education Program (IEP), a 504 DoDEA Education
Plan, or an ELL classification in place specifying
the testing programs the student participates in,
the content area appropriate for the student to be
tested in, and the accommodations to be used.
(Reference TerraNova 3rd Edition Assessment Coordinator’s Manual pages 10 & 11 &
DoDEA Regulation 2000.06, Enclosure 3)
Area Office ISS Student Services 504 POC: John Keating (DSN: 338-7358)
Colleen Rohowsky, Office of the Director, DoDDS-Europe

24

Alternate Assessment (SPED) all grades,
as appropriate - must be on IEP

Test window: March - May, 2013

Area Office ISS SPED POCs:
Katharine Heath (DSN: 338-7208)
Maureen Crouse {Kurzweil POC} (DSN: 338-7393)
Rhonda Roddam-Duke (DSN: 338-7798)

Colleen Rohowsky, Office of the Director, DoDDS-Europe
25


Three Categories of Accommodations
Cat. 1 Least restrictive
Cat. 2 May influence results
Cat. 3. Most Restrictive – may impact results
Accommodations for Special Education students must be
annotated in their IEP
See TerraNova, 3rd Edition, Assessment Coordinator’s Manual Spring 2013, p.9-21 for
detailed information and guidance regarding accommodations

Area Office SPED POCs: Katharine Heath (DSN 338-7208)
Maureen Crouse (DSN: 338-7393)
Rhonda Roddam-Duke (DSN: 338-7798)
Colleen Rohowsky, Office of the Director, DoDDS-Europe
26





Home-schooled students who are eligible for enrollment
on a space-required, tuition-free basis, may participate
in DODEA system wide testing
School should be contacted in advance of testing
The sponsor must verify eligibility; photo-IDs for student
& sponsor, immunization records, PCS Orders
Home-schooled students are to be tested in a classroom
with their like-age peers, at the time normally scheduled
for that classroom’s assessment
Must have a DoDEA IEP if testing with accommodations
Colleen Rohowsky, Office of the Director, DoDDS-Europe
27

Transportation costs will be the responsibility of the
child’s sponsor, not the local school

All students are expected to follow strict classroom
behavior expectations while testing

All students are expected to follow the test
administrator’s directions & must report to class on tine
as students cannot enter the classroom once testing has
started

Scores earned will not be reflected on schools Summary
Scores (Home-schooled students)

DoD sponsor will receive Individual Score Report
Colleen Rohowsky, Office of the Director, DoDDS-Europe
28




Practice Test
Teachers guide NOT teacher directions
Age appropriate/shots/photo id
DoDDs IEP
29


Scores may be used to make comparisons over time –
longitudinal analysis
Scores may be used to evaluate program effectiveness (e.g.
Continuous School Improvement)

Scores may help identify areas of concern

Scores may identify students’ skill strengths

Results of each system wide assessment identified to measure
student achievement in DoDEA shall be used as one component
of an assessment system for major decisions concerning the
student’s future leaning activities (DoDEA Regulation 2000.06)

Colleen Rohowsky, Office of the Director, DoDDS-Europe
30








Classroom observations
Classroom activities
Homework assignments
Teacher-made tests
Criterion-referenced tests
Locally SELECTED or purchased
assessments
Portfolios
Projects
Colleen Rohowsky, Office of the Director, DoDDS-Europe
31

Some highlights, per Regulation 2000.06:

Developing, teaching, and/or practicing
curriculum objectives based solely on the
content objectives of the assessment

Using assessment preparation materials
beyond the TerraNova Practice Activities or
materials that are not part of a program
materials adoption purchased by DoDEA
Colleen Rohowsky, Office of the Director, DoDDS-Europe
32

Excluding students from the TerraNova without
appropriate review and sponsor notification (against
DoDEA policy)

Teaching to specific questions or tasks

Providing assistance that will inadvertently indicate an
answer

Allowing students to use highlighters on the TN is not
permitted as the use of highlighters is considered an
accommodation and it must be on students’ IEPs - (If on
the IEP, it is permissible - as an accommodation)

Colleen Rohowsky, Office of the Director, DoDDS-Europe
33

Halting all regular instruction weeks or days prior to the test and
teaching just those concepts and content objectives on the assessment

Reviewing specific TerraNova items with students before or after the
test (unethical and generally illegal)

Using identical or virtually identical questions or items from current or
past assessments

Photocopying published assessments in whole or in part for any
purpose (copyright infringement)

Prompting students to find the correct answer to any questions except
Sample items
Colleen Rohowsky, Office of the Director, DoDDS-Europe
34
 Providing
students with a variety of test
formats throughout the school year
 Assisting
students with mechanical acts
such as finding the correct place

Reviewing general test directions and
procedures prior to the assessment
Colleen Rohowsky, Office of the Director, DoDDS-Europe
35

School Assessment Coordinator may distribute TN Test
Directions for Teachers and other supplies prior to test
time; but Not the TN Student Test Booklets as they are
distributed on the First Day of TerraNova testing

Ensuring that assessment materials are secured at the end
of each testing session - students should NOT have access
to any of the assessment materials before or after the test
administration sessions

Ensuring that teachers not discuss what was on the
TerraNova assessment with anyone, before, during or
after the test

Colleen Rohowsky, Office of the Director, DoDDS-Europe
36





Barcode labels are created by CTB by using
the student information that has been provided by
DoDEA HQ
Using the barcode roster, verify that each student’s
biographic and demographic information is
accurate. If there are any errors in the student’s
data – DO NOT use the barcode label
Affix one barcode label in the designated area on
the back cover of the student test booklet
(Reference the TN ACM Spring 2013, pages 27 & 28 for further
details)
Colleen Rohowsky, Office of the Director, DoDDS-Europe
37

DoDDS-EUROPE shipping suspense-
On or Before: April 5, 2013


Must be shipped via a traceable
method –
School Assessment Coordinators send tracking
numbers to appropriate District
CSI/Assessment/Program Evaluation ISS & once
collected, each district forwards the numbers to the
Area Office ISS counterpart
Colleen Rohowsky, Office of the Director, DoDDS-Europe
38

Bavaria: Marie McGurn (DSN: 468-7426)
Heidelberg: Mary Leonhart (DSN: 388-9373)
Isles: Jennifer Simmons (DSN: 226-7227)
Kaiserslautern: Peggy Hoffman-Schmidt (DSN: 489-6339)
Mediterranean: Amy Dilmar (DSN: 634-7738)

Area SPED ISSs: Katharine Heath (DSN: 338-7208)




Maureen Crouse {Kurzweil POC} (DSN: 338-7393)
Rhonda Roddam-Duke (DSN: 338-7798)


Area ESL ISS: Jizela Chirichetti (DSN: 338-7372)
Area Student Services (504) ISS: John Keating (DSN: 338-7358)
AREA POC: Colleen Rohowsky (DSN: 338-7204)
39

Testing window is 3 weeks
◦ Schedule Recommendation is Mid Week
◦ Copy of schedule emailed to Amy by COB February
26th
◦ Make ups/exceptions
◦ Number of tests per day
◦ Packaging/Shipping
40






Webinar
After testing
New students
Bar codes not accurate
Disposal incorrect ones
Assessment coordinator can pull together
groups of teachers to help verify bar codes
41

Leave room—invalidates
◦ Email Amy with Colleen R. on copy


Student take other subjects but not come
back to that one
Cannot do make up of that test
42

ESL 1s 2s progressing to TN?
◦ Documentation

Each test booklet/inside cover

Accommodations Form—see form.
◦ Team meetings necessary for accuracy
◦ Suspense is March 1
43

Scribe
44

Link to guide
45

October forms w/signatures
46




Pencils
Calculators
Security
Consistency
47


Tracking not just confirmation
Send tracking number to Amy and copy
principal
48

LIST
49

To Be Determined
50