Test Chairpersons* Orientation - Assessment, Research, and Data

Download Report

Transcript Test Chairpersons* Orientation - Assessment, Research, and Data

1
District 2011 through 2014 FCAT 2.0 Reading
70
60
50
2011
40
2012
2013
30
2014
20
10
0
Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 9 Grade 10
Test Chairperson’s
Orientation
80
District 2011 through 2014 FCAT 2.0 Mathematics
60
40
20
0
Grade 3
Grade 4
Grade 5
Miami-Dade County Public Schools
September 30 or October 2, 2014
Grade 6
Grade 7
Agenda
Morning Session
• 2014-15 Testing Calendar
• Accountability Update
• Test Security, Reporting Violations, and
Responding to Inquiries
• Updates to the Testing Programs
• PMRN / FAIR-FS
• FSA
• FCAT/FCAT 2.0
• EOC
• DDEOC
• SAT
• Grade 3 Opportunities for Promotion
Agenda
Morning Session
• Updates to the Testing Programs (cont.)
• PERT
• CELLA
• CELLA Online
• NAEP/TIMMS
• Interim Assessments
Afternoon Session
• Test Chair 101
• Test Chair 201
• Questions and Answers
2014-15 Testing Calendar
5
CBT Testing Platforms, 2014-2015
Assessments
On-line Comprehensive
English Language
Learning Assessment
(On-line CELLA)
Florida Assessments for
Instruction in Reading
(FAIR-FS)
CBT Platforms
AWSchoolTest.com
PMRN
Interim Assessment
Thinkgate
Next Generation
Sunshine State Standards
(NGSSS) End-of-Course
(EOC) Assessments
TestNav 6.9
TestNav 8 (Beginning
with Winter 2014
administration)
Tentative Dates
As-Needed Basis
Fall, Winter, and Spring
Fall and Winter
September 15-26
December 1-19
March 23 – April 10
April 20 – May 22
July 13-24
6
CBT Testing Platforms, 2014-2015
Assessments
CBT Platforms
TestNav 6.9
Florida Comprehensive
TestNav 8 (Beginning
Assessment (FCAT/FCAT
with Spring 2015
2.0) Retake
administration)
Postsecondary Education
College Success
Readiness Test (PERT)
Florida Standards
Test Delivery System
Assessments (FSA)
(TDS)
English Language Arts
(ELA) and Mathematics
FSA EOC
TDS
District-Designated EOCs SchoolNet (IBTP) and
(DDEOC)
Thinkgate
Tentative Dates
October 6-17
March 23-April 10
February
December 1-19 (Field
Test)
March 2-13
March 23 – April 10
April 13-May 8
April 20 – May 15
May 11 - June 5
FLDOE Framework for the
School Grading System
for 2014-15 and Beyond
Gisela Feild
Administrative Director
Assessment, Research and Data Analysis
July 2014
Revised Education Accountability
• Governor’s Education Accountability Summit and
Executive Order
▫ Provide stability and clarity with the transition to a
new assessment
▫ Pursue Florida’s course of action regarding English
Language Learners (ELL) in the ESEA waiver
▫ Ensure the accountability system is fair and
transparent and promotes improvement in student
outcomes
• Senate Bill 1642 provides the framework for the
updated school accountability system consistent
with those objectives
Senate Bill 1642–Education
Accountability Revisions
• Re-focuses the school grading formula on student
success measures
▫
▫
▫
▫
Achievement
Learning gains
Graduation
Earning College Credit and/or Industry Certifications
• Maintains a focus on students who need the most
support
• ELLs included in Achievement after 2 years
• Establishes a learning gains calculation that (1) requires
students scoring below grade level to grow toward grade
level performance, and (2) requires students already at
grade level to progress beyond grade level performance
Senate Bill 1642–Education
Accountability Revisions - continued
• Eliminates provisions that over-complicate the formula
and muddle the meaning of a school grade
▫ No bonus factors or additional weighting that may raise a
school grade
▫ No additional requirements or no automatic adjustments
that may lower a school grade
• Ensures that the level of performance associated with an
A-F school grade is transparently evident
▫ Report all school grade components as percentages, each
worth a maximum of 100 points
▫ Report A-F grades based on a percentage of points earned
(e.g., 70%, 80%), rather than a point total
Senate Bill 1642–Education
Accountability Revisions - continued
• Requires the State Board to reset the grading scale
avoiding the compression of the current scale
▫ There must be at least five percentage points separating the
percentage thresholds needed to earn each of the school
grades
• The State Board must periodically review the scale to
determine whether the expectations should be raised to
encourage increased student achievement
▫ If the Board adjusts the grading scale upward, it must
inform the public and the school districts of the reasons for
the adjustment and the anticipated impact on school grades
Elementary School Grades Model
(700 points)
• The school grade is based on the percentage of total points earned
• Provisions that may raise or lower a school’s grade beyond what the percentage of
points would indicate are eliminated (no additional requirements; no additional
weights/bonus; no automatic adjustments)
• Writing is included within the English/Language Arts components
English/ Language
Arts
Mathematics
Science
Achievement
(0% to 100%)
Achievement
(0% to 100%)
Achievement
(0% to 100%)
Learning Gains
(0% to 100%)
Learning Gains
(0% to 100%)
Learning Gains of the
Low 25%
(0% to 100%)
Learning Gains of the
Low 25%
(0% to 100%)
Middle School Grades Model
(900 points)
• The school grade is based on the percentage of total points earned
• Provisions that may raise or lower a school’s grade beyond what the percentage of
points would indicate are eliminated (no additional requirements; no additional
weights/bonus; no automatic adjustments)
• Writing is included within the English/Language Arts components
English/
Language Arts
Mathematics
Science
Social
Studies
(Civics
EOC)
Acceleration
Success
Achievement
(0% to 100%)
Achievement
(0% to 100%)
Achievement
(0% to 100%)
Achievement
(0% to 100%)
Percentage who pass
H.S. EOCs & industry
certifications
(0% to 100%)
Learning Gains
(0% to 100%)
Learning Gains
(0% to 100%)
Learning Gains of
the Low 25%
(0% to 100%)
Learning Gains of
the Low 25%
(0% to 100%)
Senior High School Grades Model
(1000 points)
• The school grade
is based on the percentage
earned
English/
Mathematics
Science of total points
Social
Studies
Graduation
Acceleration Success
•
Provisions
that
may
raise
or
lower
a
school’s
grade
beyond
what
the
percentage
of
points
would
indicate
are
Language
(US History
Rate
weights/bonus; no automatic adjustments)
Artseliminated (no additional requirements; no additionalEOC)
• Writing is included within the English/Language Arts components
• Additional graduation rates (At-Risk and 5-year), college readiness measures (based on SAT, ACT, and PERT), and a
stand-alone acceleration participation measure are eliminated from the model
Achievement
(0% to 100%)
Achievement
(0% to 100%)
Learning
Gains
(0% to 100%)
Learning
Gains
(0% to 100%)
Learning
Gains of the
Low 25%
(0% to 100%)
Learning
Gains of the
Low 25%
(0% to 100%)
Achievement
(0% to 100%)
Achievement
(0% to 100%)
Overall, 4-Year
Graduation
Rate
(0% to 100%)
Percentage of
students who can
earn college credit AP,IB,AICE,DE, IC
(0% to 100%)
Senate Bill 1642–Education
Accountability
Transition Year
• For the current school year (pending senior high, 2013-14), there are
no changes to the school grading system, except those already
directed by existing statute or State Board rule
• After Florida students take the new assessments for the first time in
2014-15, student performance level expectations (“cut scores”) will
be set in the summer immediately following the first administration
of the new assessment
• A new baseline calculation of school grades will occur in Fall 2015,
which accurately reflects student performance on the Florida
Standards and FSA
• This baseline, informational approach in the first year provides
everyone – parents, schools, districts, the general public – a clear
understanding of a student’s and a school’s starting point on the
new, more rigorous Florida Standards and FSA
Senate Bill 1642–Education
Accountability Transition Year
No Consequences from the Baseline 2014-15 School Grades
• No interruption in current support to underperforming schools
through our Differentiated Accountability teams
• A school may not be required to select and implement a
turnaround option in the 2015-16 school year based on the 201415 grade or school improvement rating
• A district or charter school system designated as highperforming may not lose the designation based on the 2014-15
grades
• For purposes of determining grade 3 retention and high school
graduation, student performance on the 2014-15 assessments
shall be linked to 2013-14 student performance expectations
▫ Same process used for FCAT to FCAT 2.0
Senate Bill 1642–Education
Accountability Implementation Schedule
• Commissioner re-establishing advisory groups to receive
input
▫ LPAC, Leadership Policy Advisory Committee
▫ AAAC, Assessment and Accountability Advisory Committee
• LPAC and AAAC will meet in the summer and fall
• Draft of school grades rule to the State Board in early 2015
• Standards setting meetings held summer 2015
• Draft of rule on school grading scale to the State Board in
Sept/Oct 2015
• 2014-15 Grades calculated in Oct/Nov 2015
18
Assessment and Accountability
Transition
Spring 2014:
FCAT 2.0
Administered
Spring 2015:
New Florida
Standards
Assessment (FSA)
administered
2013-2014
Summer 2014:
School Grades released
with current formula and
accountability measures
Summer 2015:
Standard setting
begins to establish
cut scores for the FSA
2014-2015
Spring 2016:
FSA administered
for the 2nd time
2015-2016
Fall 2015:
Baseline School Grades
released based on FSA
results and new cut scores
Summer 2016:
School Grades
released with
consequences
Test Security, Reporting
Violations, and Responding
to State Inquiries
Dr. Sally A. Shay
Security
Standards, Guidelines, and
Procedures for Test
Administration and Test
Security available at
http://oada.dadeschools.net/
TestChairInfo/InfoForTest
Chair.asp
• General guidelines adopted
by School Board
Florida Test Security Statute
and Rule
21
From Standards: Designation of
District Assessments (DDEOC)
• Validity of assessments
• Sources for selection
• Results: reporting and application
• Security concerns
▫ Development
▫ Materials
▫ Administration
FCAT/FCAT 2.0/NGSSS EOC
Caveon Data Forensics
 The FLDOE has contracted with Caveon Test
Security to provide its Caveon Data Forensics™
for all statewide assessments.
 Caveon will analyze data to identify highly
unusual test results for two primary groups:
• Students with extremely similar test responses; and
• Schools with improbable levels of similarity, gains and/or
erasures.
 Flagging only the most extreme results.
Caveon Similarity Index
Most Powerful & “Credible” Statistic
• Measures degree of similarity between two or more test
instances
• Analyze each test instance against all other test instances
in the school
Possible causes of extremely high similarity:
•
•
•
•
Answer Copying
Test Coaching
Proxy Test Taking
Collusion
A Comparison…
Index=0.25; Scores=303 & 309
2
1
0
0
5
10
15
No Match
20
25
30
Item Number
Same Correct
35
40
45
Same Incorrect
Index=15.7; Scores=303 & 309
2
1
0
0
5
10
15
20
25
30
Item Number
No Match
Same Correct
35
40
45
Caveon Erasure Analyses
Based on estimated answer changing rates
from:
• Wrong-to-Right
• Anything-to-Wrong
Find answer sheets with unusual WtR answers
Extreme statistical outliers could involve
tampering, “panic cheating”, etc.
Important! No student–level score invalidations based on
erasure analysis; erasure analysis limited to school-level
flagging for additional review.
26
FSA and FS EOC
AIR Data Forensics
• American Institutes for Research (AIR) will
conduct data forensics using their own
methodology.
• New model for similarity indices to be proposed
at Technical Advisory Committee (TAC) meeting
in November.
• Webinars for districts after the TAC meeting;
dates TBD.
Updates to the Testing Programs:
28
Progress Monitoring and Reporting
Network (PMRN v4) K-2/WAM Updates
• Mayda Cabeza, Director I
29
Progress Monitoring and Reporting
Network (PMRN v4)/
• Access to PMRN via http://www.fldoe.org/sso
▫ Login with employee credential
▫ From SSO site click on PMRN
• Principal: Required task for establishing
SSO/PMRN access for school level users
http://www.justreadflorida.com/pmrnfairfs/pdf/ssoprincipal.pdf
▫ Heat Tickets
▫ [email protected] or 855-814-2876
• Toubleshooting: Use Firefox
30
Florida Standards Assessments (FSA);
Florida Comprehensive Assessment Test
(FCAT/FCAT 2.0); and Next Generation
Sunshine State Standards (NGSSS)
End-of-Course (EOC) Assessments
• Maria C. Bruguera, Director I
• Mara Ugando, Staff Specialist
FSA/FCAT/FCAT 2.0/EOC
Florida Standards
Assessments (FSA)
Florida Comprehensive Assessment
Test (FCAT/FCAT 2.0) and End-ofCourse (EOC)
Contractor
American Institutes for
Research (AIR)
Pearson
Standards
Assessed
Florida Standards
Next Generation Sunshine State
Standards (NGSSS)
Grades 5 and 8 Science
FCAT (SSS) Mathematics Retake
Grades 3-11 ELA; (Writing
Component in Grades 4-11) FCAT 2.0 Reading Retake
Algebra 1 Retake
Grades 3-8 Mathematics
Subject Tests
Biology 1
Algebra 1
Civics
Geometry
Geometry (Fall and Winter only)
Algebra 2
US History
31
FSA/FCAT/FCAT 2.0/EOC
CBT Platform
FSA
FCAT/FCAT 2.0/EOC
Test Delivery System (TDS)
TestNav 8 (Beginning in
Winter 2014 )
Test Information
CBT Management
Distribution Engine (TIDE)
System
and TDS
Access to Score
Online Reporting System
Reports
(ORS)
CBT
Built into TDS
Accommodations
PearsonAccess
PearsonAccess
Built into TestNav 8
32
www.FSAssessments.
org
www.PearsonAccess.
com/fl
33
34
FSA/FCAT/FCAT 2.0/EOC
Computer-Based Testing
TDS
(AIR)
TestNav 8
(Pearson)
Required to Run
Secure Browser Download
Proctor Caching
Eligible Devices
•
•
•
•
•
•
•
•
•
•
Windows computers
Macintosh computers
iPads
Chromebooks
Android tablets
Windows computers
Macintosh computers
iPads
Chromebooks
Windows tablets
35
FSA/FCAT/FCAT 2.0/EOC
Computer-Based Testing
TDS
(AIR)
Create Test
Sessions
Test Administrator – TDS
CBT
Built into TDS
Accommodations
Technical
Information and www.FSAssessments.org
Resources
Help Desk
866-815-7246
[email protected]
TestNav 8
(Pearson)
School/Technology Coordinator
or PreID upload PearsonAccess
Built into TestNav 8
www.FLAssessments.com/TestNav8
877-847-3043
[email protected]
36
FSA/FCAT/FCAT 2.0/EOC
CBT Practice Tests
TDS
(AIR)
TestNav 8
(Pearson)
Name
Training Tests
ePAT
Platform
Secure Browser
Web-browser, no download
Required?
Yes, with test administrator to
mimic operational testing
Yes, with ePAT practice test
script
Available
October 2014
October 2014
37
What You Need to Know About FSA
• American Institutes for Research (AIR)
▫ CBT test delivery and support
▫ TIDE, TDS, and ORS management
• Data Recognition Corporation (DRC)
▫ Materials shipping and return
▫ Materials production
38
What You Need to Know About FSA
• The online FSA Portal is the starting place for all
FSA programs, resources, and information.
• Information previously published on the FDOE
website will now be available on the portal.
• You can register for email alerts and be notified
when new announcements or resources are posted.
• Users will access TIDE, TDS, and ORS through the
portal.
• www.FSAssessments.org
39
What You Need to Know About FSA
• The Test Delivery System (TDS) requires a secure browser
download on each computer/device that will be used for
testing.
• Response files are not saved locally. If there is a disruption in
connectivity during testing, the student will be prevented from
continuing to test until the issue is resolved.
• Handheld calculators may not be provided to students for CBT
tests (unless specified on an IEP).
• Online calculators are only provided for Sessions 2 and 3 of
grades 7 and 8 mathematics and EOCs.
• CBT Accommodations can be set for students through an
upload OR by the test administrator prior to testing.
40
What You Need to Know About FSA
• Test administrators, not school coordinators, will
create test sessions and authorize students in their
testing room to log in. Test administrators will
complete a TDS Certification Process.
• Test administrators must be familiar with all students
in their testing room.
• Test administrators must have a computer or mobile
device for test management before and during testing.
• Headphones are required for all students for Grades
5-11 ELA listening items (CBT).
41
What You Need to Know About FSA
• Training tests are available for students to become familiar with
the CBT platform and item types.
• Training tests are available by grade band, not grade level.
Answer keys and a user guide are available on the portal.
• Training tests with CBT accommodations will be available in the
fall when the secure browser is available for download.
• Grade-level/subject-specific practice tests will be available in
Fall 2015.
• Students will be able to skip items on live tests and detailed
instructions will be provided in administration scripts.
• Paper-based Sample Test Materials for grades 3 and 4,
including large print and braille (all grades), are being
developed.
42
Test Information Distribution Engine (TIDE)
• User-specific roles
• Accounts may be created individually or
through a file upload
• Users may create users at or below their level
• We will provide you with a list of user roles
and instructions
• Assigned roles will apply to all systems (TIDE,
TDS, ORS)
43
TIDE
• PreID upload
• Add/Edit/Delete Students
• Print PreID labels
• Assign Accommodations
• Invalidate CBT tests
• Check Answer Document Tracking Reports
44
Test Delivery System (TDS)
• Create Test Sessions
▫ Created by test administrator right before testing
▫ Session information is posted for students in the room so
they may log in
• Student Login/Testing
• Approve Students
▫ Once students log in, the test administrator must approve
them in TDS before they can access the test
• Pause Students
▫ Test administrators may pause student tests for a break,
etc.
45
PROPOSED FSA English Language Arts
- Writing Component ONLY
Grade/Subject
4
5
6
7
8
9
10
11
Number of ComputerProposed Time Sessions Based in 2015?
No
90 minutes
1
Yes
90 minutes
1
Yes
90 minutes
1
Yes
90 minutes
1
Yes
90 minutes
1
Yes
90 minutes
1
Yes
90 minutes
1
Yes
90 minutes
1
• The FSA ELA has a Text-Based Writing Component that is administered
separately from the rest of the FSA ELA, but it is reported as part of the
ELA score. (It is administered earlier to allow time for handscoring.)
46
PROPOSED FSA English Language Arts
(Not Including the Writing Component)
Grade/
Subject
3
4
5
6
7
8
9
10
11
Proposed
Time
160 minutes
160 minutes
160 minutes
170 minutes
170 minutes
170 minutes
180 minutes
180 minutes
180 minutes
Number
of
Sessions* Computer-Based in 2015?
No
2
No
2
Yes
2
Yes
2
Yes
2
Yes
2
Yes
2
Yes
2
Yes
2
*All sessions administered over two days.
47
PROPOSED FSA Mathematics
Number of
Grade/Subject Proposed Time Sessions*
Computer-Based in
2015?
3
160 minutes
2
No
4
160 minutes
2
No
5
160 minutes
2
Yes
6
180 minutes
3
Yes
7
180 minutes
3
Yes
8
180 minutes
3
Yes
Alg 1
180 minutes
2
Yes
Geo
180 minutes
2
Yes
Alg 2
180 minutes
2
Yes
*All sessions administered over two days. For Grades 6-8, Session 1 is on Day 1,
Sessions 2 & 3 on Day 2.
48
Additional Notes for Mathematics
Assessments
• Students in grades 7-8 and those taking Algebra
1, Algebra 2, and Geometry EOC Assessments
will be permitted to use the calculator provided
within the assessment platform for certain
items.
• Calculators will not be permitted for session 1
but will be permitted for session 2 for the above
mathematics assessments.
• Practice calculators are available on the FSA
Portal at www.FSAssessments.org.
49
Accommodations for Testing
• Beginning with Winter 2014, One-Item-Per-Page
(PBT and CBT) and Large Print (CBT) are no longer
“unique accommodations.”
• Student eligibility for ALL paper-based
accommodations must be confirmed at the district
level and submitted to FDOE.
• Remember: paper-based accommodations should
only be provided for CBT tests if students CANNOT
access assessments on the computer.
• CBT accommodations include: Text to Speech (same
as Screen Reader currently used with TestHear) and
Masking (new)
50
Readiness Activities - CBT Only
Certification Tool
Infrastructure Trials
• Both TDS and TestNav 8 will
have Infrastructure Trials for
schools to run to test their
▫ October 20–November 4, 2014
systems.
 Pearson Winter NGSSS EOC • The Infrastructure Trial for AIR
will be available prior to the
and AIR FSA Writing Field
Winter 2014 FSA ELA Writing
Test
Field Test.
• Spring 2015 CBT Certification
(Required)
• A statewide Infrastructure Trial
▫ January 20–February 3, 2015
will be conducted in January for
AIR/TDS.
 FSA ELA, Mathematics, and
• Information about completion of
EOC
the Infrastructure Trials will be
▫ February 9– 24, 2015
collected through the
 FCAT/FCAT 2.0 Retakes and
Certification Tool.
NGSSS EOC
Tentative Dates
• Winter 2014 CBT Certification
(Required)
51
52
Kathleen Sierra, Supervisor
SB 736 – Student Success Act
Requires at least 50 percent of a school
administrator
and
a
classroom
teacher’s
performance evaluation be based upon student
learning growth assessed annually by statewide
assessments or, for subjects and grade levels
not measured by statewide assessments, by
school district assessments.
SB 736 – Student Success Act (cont.)
The bill revises Florida Statute (1008.22(4)) and
requires districts to designate assessments to
measure student performance in all subjects
and grade levels, except those measured under
statewide assessment programs (i.e., FCAT2.0, FSA,
and NGSSS and FS EOC).
55
SB 736 – Student Success Act (cont.)
Assessments may include:
 Statewide assessments;
 Other standardized assessments including
nationally recognized standardized
assessments;
 Industry certification examinations;
 District-developed or district-selected EOC
assessments; and/or
 Teacher/principal-selected assessments.
56
Florida Item Bank and Test Platform (IBTP)
• Item Bank created by state with Race to the Top
Funds over 2011-2014
• All Districts will have access
• Core and non-core content areas
• IBTP items have been imported to Thinkgate
▫ Currently, Thinkgate does not support audio or
video.
 Items requiring audio/video must be delivered
through IBTP
Existing Sources of Items/Assessments
FCAT 2.0/
FSA/FAA/
SAT-10
Reading/
English/
Language Arts
End of
Course Tests
Algebra 1
Other Established
Standardized
Tests
AP
[Algebra 2]
Geometry
IBTP Core
Content
IBTP NonCore
Content
English/
Language Arts
Physical
Education/Health
Mathematics
IB
Mathematics
Visual Arts
Performing Arts
Science
Biology 1
Social Studies
US History
Science
Civics
World Languages
AICE
Industry
Certification
Spanish
Career/Technical
CFAC Grant Gap
Courses
58
Status of Courses Grades K-12
59
DDEOC: Plan for 2014-15 School Year
Courses with existing items or EOCs
• Fall 2014 – Spring 2015
▫ Finalized list of courses to be covered will be published in November
▫ Program Guide
 Address administration procedures
 Accommodations for SPED and ELL
▫ Tests will be administered through Thinkgate and the Florida IBTP
▫ Scores will be reported through the electronic gradebook system.
• For the baseline year:
▫ DDEOC scores will not be calculated into the final grade.
▫ DDEOCs administered to Annual and Semester 2 courses
60
Principal/Teacher Selected Tests:
Plan for 2014-15 School Year
Courses with no assessment
• Principals will designate use of departmentalized
or teacher-created EOCs and report to district
• Student results will be entered into Gradebook
• Will continue to work toward developing items for
courses with no items
61
Administration – 2014-15 - Baseline Year
• Test Window: May 11- June 5, 2015
• DDEOC assessments will be administered through
Thinkgate and Florida IBTP
▫ Schools will have option to print test forms and use
scanable answer sheets, with adherence to strict security
protocols
• Assessments will be multiple-choice and conducted
within a class period
• Teachers will record student’s DDEOC grade in
electronic gradebook – validity check will be conducted
62
Stanford Achievement Test-Tenth
Edition (SAT-10), Grade 3 Promotion
Opportunities, and Post Secondary
Education Readiness Test (PERT)
• Mayda Cabeza, Director I
SAT-10



What is the SAT-10?
Who is administered the SAT-10?
• Grades K - 2, districtwide
Important dates to remember
• April 13-17, 2015
63
SAT-10 Results

School Listing of Results (May-June)
• Must be picked up at ITS

Individual Student Reports (August)
•

Delivered to schools
Results
• Not available on the Parent Portal
• Posted to SPI under the tab FCAT/SAT-10 Scores NEW

Uses
• Referral of students to the district’s gifted program
• Early identification of students who would be considered at
high risk for problems associated with reading
comprehension
64
Grade 3 Opportunities for
Promotion
65
Grade 3 Opportunities for Promotion

Section 1008.25, Florida Statutes (F.S.), Eliminating
Social Promotion.
• Spring FSA English Language Arts
• Spring Grade 3 Reading Student Portfolio
• Alternative Standardized Reading Assessment
(ASRA)—ITBS, Level 9, administered the last two
weeks of school
• Alternative Assessment for Grade 3 Promotion
(AAGTP)—SAT-10, Primary 3, administered in
Summer School
• Grade 3 Mid-Year Promotion (GTMYP)—ITBS,
Level 10, administered in November
66
Grade 3 Reading Student Portfolio






Administered during the 2nd semester
Participants: All grade 3 students complete a
portfolio
Scored at the school site
Represents the 2nd opportunity for a student to be
promoted to grade 4
Student must demonstrate mastery of the
benchmarks
Training conducted via Screencast
67
Alternative Standardized Reading
Assessment (ASRA)


Administered the last two weeks of schools.
Participants:
• Students scoring Level 1 , or students who did not
participate in the Spring FSA English Language Arts,
and
• Students without a passing Reading Portfolio
Represents the 3rd and last opportunity within the
school year prior to retention.
 Students must score at or above a given cut score on
the ITBS to be considered for promotion.
 Training conducted via Screencast

68
Alternative Assessment for Grade 3
Promotion (AAGTP)
Administered at the end of the summer Reading
camp.
 Participants: Retained grade 3 students
 SAT-10, Primary 3 is scored locally through ITS
 Represents 4th opportunity for students to be
promoted to grade 4
 Students must score at or above a given cut score
on the SAT-10 to be considered for promotion
 Training conducted via Screencast

69
Grade 3 Mid-Year Promotion
(GTMYP)





Administered mid-November
Participants: Students who “just missed” passing
the AAGTP, or other students at the principal’s
discretion
ITBS, Level 10 will be scored via Thinkgate
securely. A listing of results will need to be picked
up at TDC.
Represents 5th opportunity for retained 3rd grade
students to be promoted to grade 4
Students must have a passing score on the ITBS,
representing 4th grade work. 70
PERT

High schools must evaluate the college readiness of each
student prior to grade 12. Eligible grade 11 students with the
following criteria should test.
• Student who score a Level 2 or 3 on the reading portion of the
Grade 10 FCAT 2.0
• Students who score Level 2, 3 or 4 on the Algebra I EOC in Grade
10.
Results of the assessment will be used to advise students.
 Rule 6A-1.094223, effective Nov. 3, 2013, allows a high
school student who has taken Algebra 1 but has not passed
the EOC to use a comparative score of 97 or higher on PERT
Math to meet high school graduation requirements.
 Dual Enrollment Eligibility

71
PERT College Readiness Scores
College Readiness Scores
Assessment
Reading
Writing
Mathematics
ACT
19
17
19
English
SAT
CPT
PERT
440
Verbal
N/A
440
Math
83
83
72
Sentence Skills
Elementary Algebra
103
114
106
New 2014-15: College readiness measures have been eliminated
from the high school grade component
72
PERT Score Repository
•
•
•
Houses all PERT scores across the state
Miami-Dade College (MDC) is able to access
PERT test scores for students participating
in Dual Enrollment and incoming students
interested in enrolling at MDC after
graduation.
Miami-Dade County Public Schools uploads
PERT test scores on SPI for school access.
73
Comprehensive English Language
Learning Assessment (CELLA)
Felicia Mallory, Executive Director
Denetra Collins, Staff Specialist
Overview of CELLA
CELLA is a four-skill English language assessment
measuring student proficiency in listening,
speaking, reading, and writing.
Students in grades 1 – 12 are administered the
• Listening, Reading, and Writing sections in
groups
• Speaking on a one-on-one basis
Kindergarten students are assessed in all four areas
on a one-to-one basis.
Unlike the FSA, CELLA is not a timed test.
Purposes of CELLA
The test results can provide:
• Data useful for charting student progress over time,
• Diagnostically useful information about students’
strengths and weaknesses in English,
• The language proficiency levels of individual
students can be used in making decisions regarding
placement into, or exit from English for Speakers of
Other Languages (ESOL) programs.
• Identifying the proper ESOL level,
• Determining whether the District and schools met
Annual Measureable Achievement Objectives
(AMAOs)
Important Dates for 2015 CELLA
Administration:
February 16– April 3, 2015
CELLA ONLINE
Division of Bilingual Education and World Languages
Beatriz Pereira, Executive Director
305-995-1950
[email protected]
North Region
Deland Innocent, Supervisor
305-995-2977
[email protected]
South Region
Lourdes Menendez, Supervisor
305-995-2098
[email protected]
National Assessment of
Educational Progress
(NAEP/TUDA/TIMSS)
Felicia Mallory, Executive Director
Denetra Collins, Staff Specialist
Features of NAEP
 Provides district-level data to participating urban
districts
 Provides a common yardstick to measure student
achievement in comparison to
•
•
•
•
•
Other urban districts
States
Large Central Cities
National Public Schools
Census Regions
Purpose of NAEP
 A common nationwide measure of student
performance
 Reports changes over time
 Provides results for the nation, states, and some
urban districts
 Secondary indicator for state progress and allows
national comparisons between states and large urban
districts
 Used by the President, Congress, and state leaders to
set education policy
Overview of NAEP
 A representative sample of schools and students are
selected
 Randomly selected students in grades 4, 8, and12 are
assessed in reading, mathematics, and science
 Assessments include multiple-choice and constructed
responses
 Assessments are administered by NAEP field staff
 Assessments are 90 to 120 minutes, which include
testing and answering background questions
 Accommodations are offered for ELL and SWD students
 Results are reported by scale scores, subscales,
achievement levels, subgroups, and geography
83
Trends in International
Mathematics and Science Study
(TIMSS)
 Compares the performance of U.S. students to other
countries in math and science
 Assessments administered in mathematics and science
every 4 years for students in grades 4 and 8 (since 1996)
and grade 12 (1995 and 2008)
 Students in grade 12 will participate in advanced
mathematics and physics
Important Dates for NAEP /TIMSS 2015
Event
Date
Provide School Information
September 30, 2014
Form registration
NAEP representative
Student List
Notify Parents
December 2014
Prepare for Assessment
January 2, 2015
Testing Windows:
NAEP
TIMMS
January 26– March 8, 2015
March 30 – May 29, 2015
Wrap-Up
June 2 – 5, 2015
NAEP – TUDA 2015
Release Dates
October 2015
grades 4 and 8 national and state
mathematics and reading results
December 2015 grades 4 and 8 TUDA mathematics
and reading results
March 2016
grades 4 and 8 national and state
science results
April 2016
grade 12 national mathematics,
reading and science results
Interim Assessment
Program
Formative Classroom Assessment
Felicia Mallory, Executive Director
Denetra Collins, Staff Specialist
Overview of the Interim
Assessment Program
 Interim Assessment tests administered three times per
year (BBA, fall, and winter)
 Alignment with the Florida Standards and Next
Generation Sunshine State Standards and District’s
pacing guides
 Data analysis and disaggregation, score reports, and item
analysis are available in Thinkgate
Purpose of the Interim
Assessment Program
 To monitor student progress on the Reading, Mathematics,
Science and Social Studies - Florida Standards and the Next
Generation Sunshine State Standards (Fall and Winter)
 To provide teachers with classroom assessment tools that will
provide reliable student-level benchmark information to
inform instruction
 To provide students with information on their progress on
specific benchmarks
 To provide schools with a reliable and valid assessment tool
for state progress reporting.
89
New Interim Assessment Forms
• New Fall and Winter Interim Assessments have
been developed to address the new Florida
Standards for the following:
▫ Reading, Grades 3 – 11
▫ Mathematics, Grades 3 – 8
▫ Algebra 1
▫ Algebra 2,
▫ Geometry
• US History and Civics assessments have been
revised
Interim Assessment Program
Administration Windows 2014-15
Administration Windows
BBA
August 18, 2014–
September 3, 2014
Fall
October 27, 2014–
November 14, 2014
Winter
January 26, 2015 –
February 13, 2015
Subjects and Grade Levels
- Science: Grades 5 and 8
- Reading: Grades 3-11
- Mathematics: Grades 3-8; Algebra 1,
Algebra 2, and Geometry
- Science: Grades 5, 8, and Biology 1
- United States History
- Civics
-
Reading: Grades 3-11
Mathematics: Grades 3-8; Algebra 1,
Algebra 2, and Geometry
Science: Grades 5, 8, and Biology 1
United States History
Civics
Students to be Tested
All eligible students* must take the Interim Assessment
in Reading, Mathematics, Science, and Social Studies.
Reading, Grades 3-11,*
Mathematics, Grades 3-8*
Science: Grades 5 and 8*
 All students enrolled in:
• Algebra I
• Algebra II
• Geometry
• Biology I
• U.S History
• Civics
*Students MUST take the test corresponding to the grade level in
which they are listed in ISIS (unless they are enrolled in an EOC
course in same content area).
Fall/Winter Administration
Format
ContentArea
Reading
Paper-Based
Tests
Grades 3-4
Math
Grades 3 -4
Science
Grades 5 and 8
Social
Studies
*Retake can be administered paper-based.
Computer-Based
Tests
Grades 5, 6-8, and 9-11,
and Retake Grade 10
Grades 5, 6-8, Algebra 1,
Algebra 2, and Geometry
Biology
U.S. History.
Civics
Approximate Testing Times
Before the Test
Approximately 10
minutes to pass
out testing
materials
Administration Time
Reading*:
Approximately 75 minutes
Mathematics*:
Approximately 75 minutes
After the Test
Approximately 10
minutes to collect
testing materials
Science*:
Approximately 112 minutes
Civics*:
Approximately 90 minutes
U.S. History*:
Approximately 90 minutes
* It is suggested that longer assessments be administered over a two-day time
period.
94
Performance Levels
• During the baseline administration of new Interim
Assessments, default performance levels will be used:
▫ 70% for proficiency
▫ 69% and below for non-proficiency
• Default performance levels in 2014-15 will be used for:
▫ Reading, Grades 3 – 11
▫ Mathematics, Grades 3 – 8
▫ Algebra 1
▫ Algebra 2,
▫ Geometry
▫ US History
▫ Civics
Performance Levels
The following performance levels will be used for:
Science, Grades 5 and 8; and Biology
Satisfactory Progress
Students who
are likely to
score in FCAT
levels 3 and
above
Limited Progress
Students whose
performance
was not
sufficient to
predict success
Insufficient Progress
Students who
are likely to
score below
FCAT level 3
This student demonstrated a satisfactory level of achievement on
the content focus of the Next Generation Sunshine State Standards
assessed during this instructional period. To attain high levels of
achievement in this content area, the student must receive continued
instruction on the challenging content and skills across the
benchmarks designated for this grade level.
This student demonstrated a limited level of achievement on the
content focus of the Florida Sunshine State Standards assessed
during this instructional period. To attain high levels of achievement
in this content area, the student must receive targeted interventions
and remediation in the areas of concern, and continued instruction on
the challenging content and skills across the benchmarks designated
for this grade level.
This student demonstrated an insufficient level of achievement on
the content focus of the Florida Sunshine State Standards assessed
during this instructional period. To attain high levels of achievement
in this content area, the student must receive intensive interventions
and remediation in the areas of concern, and continued instruction on
the challenging content and skills across the benchmarks designated
for this grade level.
Score Reports
Useful reports that can be retrieved via Thinkgate:
•
•
•
•
•
•
•
•
•
•
Report Card by Test
Progress Report
Item Analysis
Distractor Analysis
Score Analysis
Proficiency Report
At-Risk Students by Standard
Report Card by Standard (classes)
Test Summary
Demographic Item Performance
97
Thinkgate Consultants
Carlos Lopez
305-995-2438
Michael Slakman
305-995-2437
Lina Turnes
305-995-2440
District Resources
 Assessment, Research, and Data Analysis Website:
http://oada.dadeschools.net/
 Test Chairperson Website:
http://oada.dadeschools.net/TestChairInfo/InfoForTestChair.asp
 Testing Calendar (check for updates regularly):
http://oada.dadeschools.net/TestingCalendar/TestingCalendar.asp
 Guidelines and Tips for School Test Chairpersons:
http://oada.dadeschools.net/TestChairInfo/27GuidelinesandTipsforSchoolTestCh
airpersons.pdf
 Standards, Guidelines, and Procedures for Test Administration and Test
Security:
http://oada.dadeschools.net/TestChairInfo/StandardsGuidelinesandProcedu
resMay2013.pdf
 Test Security Screencast for Test Administrators and Proctors
http://oada.dadeschools.net/Screencasts/TestSecurity/TestSecurity.html
Contact
 Student Assessment and Educational Testing:
•
Dr. Sally A. Shay, District Director
 Florida Standards Assessment (FSA), Florida Comprehensive Assessment Test
(FCAT/FCAT 2.0) , and End-of-Course Assessments (EOC):
• Maria C. Bruguera, Director I
• Mara Ugando, Staff Specialist
 Stanford Achievement Test-Tenth Edition (SAT-10), Grade 3 Promotion
Opportunities, and Post Secondary Education Readiness Test (PERT):
• Mayda Cabeza, Director I
 Comprehensive English Language Learning Assessment (CELLA), Interim
Assessment, and National Assessment of Educational Progress (NAEP):
• Felicia Mallory, Executive Director
• Denetra Collins, Staff Specialist
 District Designated End-of-Course Assessments (DDEOC)
• Kathy Sierra, Supervisor
 Test Distribution Center
• Magaly Hernandez, Supervisor