Richard Woods, Georgia’s School Superintendent “Educating Georgia’s Future” gadoe.org System Test Coordinators’ Fall 2015 Conference General Session /Test Administration August 12 & 14, 2015 Georgia Student Assessment.
Download ReportTranscript Richard Woods, Georgia’s School Superintendent “Educating Georgia’s Future” gadoe.org System Test Coordinators’ Fall 2015 Conference General Session /Test Administration August 12 & 14, 2015 Georgia Student Assessment.
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
System Test Coordinators’ Fall 2015 Conference
General Session /Test Administration August 12 & 14, 2015 Georgia Student Assessment Program 2015 – 2016
1
2015 Fall Assessment Conference Sessions
Wednesday, August 12, 2015 Fall Assessment Conference: Test Administration/General Session Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
9:00 am -12:00 pm 9:00 am -12:00 pm Friday, August 14, 2015 Fall Assessment Conference: Test Administration/General Session (Live repeat of Aug. 12) Thursday, September 3, 2015 Fall Assessment Conference: Assessment Program Updates 2015-2016 Tuesday, September 15, 2015 Fall Assessment Conference: Assessment Program Updates 2015-2016 (Live repeat of Sep. 3) Thursday, September 17, 2015 Fall Assessment Conference: Student Assessment Handbook (SAH) Overview 1:00 pm - 4:00 pm 1:00 pm - 4:00 pm 9:00 am - 12:00 pm
Assessment Webinar memos posted at: http://www.gadoe.org/Curriculum-Instruction-and Assessment/Assessment/Pages/Memoranda--Announcements.aspx
2
Agenda
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
1. General Information and Key Reminders/Updates 2. Overview of 2015-2016 State Assessments 3. Conducting secure and successful test administrations 4. Accommodations and Special Populations 5. Post-Administration Information/Reminders 6. Ethics and Assessment 7. Online Forms on the MyGaDOE Portal 8. Program Updates 2015-2016 9. Questions & Answers 3
Assessment & Accountability Contact Information
Toll-Free (800) 634-4106 and (404) 656-2668 Melissa Fincher, Ph.D.
Deputy Superintendent, Assessment and Accountability Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
(404) 651-9405; [email protected]
Melodee Davis, Ph.D.
Director, Assessment Research and Development
(404) 657-0312; [email protected]
Anthony (Tony) Eitel Director, Assessment Administration
(404) 656-0478; [email protected]
Allison Timberlake, Ph.D.
Director, Accountability
(404) 463-6666; [email protected]
4
Assessment & Accountability Team
Deputy Superintendent
¤ Melissa Fincher
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Support Staff
¤ Connie Caldwell ¤ Joni Briscoe
Assessment Administration – Anthony (Tony) Eitel
Bobbie Bable ∞ Deborah Houston ∞ Mary Nesbit-McBride ∞ Joe Blessing ∞ Robert McLeod ∞ Missy Smith
Assessment Research & Development – Melodee (Dee) Davis
∞ Jan Reyes ∞ Kelli Harris-Wright ∞ Niveen Vosler ∞ Sheril Smith
Accountability – Allison Timberlake
∞ Michelle Christensen ∞ Paula Swartzberg ∞ August Ogletree ∞ Qi Qin 5
Assessment Administration Contact Information Georgia Milestones
Lead Contact for End of Grade (EOG) Support Contact for EOG & EOC Technology
Robert McLeod, Ed.D.
(404) 656-2589; [email protected]
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Georgia Milestones In-State Program Manager
Missy Smith (404) 657-7651; [email protected]
Lead Contact for End of Course (EOC) Lead Contact for EOG & EOC Accommodations
Mary Nesbit-McBride, Ph.D.
(404) 232-1207; [email protected]
Lead Contact for EOG & EOC Technology Georgia Online Formative Assessment Resource (GOFAR):
Joe Blessing (404) 232-1208; [email protected]
6
Assessment Administration Contact Information
ACCESS for ELLs Georgia Alternate Assessment (GAA)
Deborah Houston (404) 657-0251; [email protected]
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
National Assessment of Educational Progress (NAEP) Georgia Kindergarten Inventory of Developing Skills (GKIDS)
Bobbie Bable (404) 657-6168; [email protected]
4/24/2020 7
Assessment Research & Development Contact Information
Research and Development Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Kindergarten Entry Profile (KEP)
Sheril Smith, Ph.D.
Assessment Specialist (404) 463-0164; [email protected]
Jan Reyes, Ph.D.
Assessment Specialist (404) 463-6665; [email protected]
Formative Instructional Practices (FIP)
Niveen Vosler Assessment Specialist (404) 463-0166; [email protected]
Kelli Harris-Wright Assessment Specialist (404) 463-5047; [email protected]
8
Accountability Contact Information Accountability
Michelle Christensen Accountability Specialist 404-463-1175; [email protected]
Paula Swartzberg Accountability Specialist 404-463-1539; [email protected]
August Ogletree, Ph.D.
Accountability Research Specialist (404) 463-6675 [email protected]
Qi Qin Assessment Specialist Growth Model (404) 657-0311; [email protected]
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
9
State Board Rules
State Board Rules relating to assessment include:
• 160-3-1-.07 Testing Programs – Student Assessment • 160-4-2-.11 Promotion, Placement, and Retention • • • 160-4-2-.13 Statewide Passing Score 160-4-2-.20 List of State-Funded K-8 Subjects and 9-12 Courses
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
160-5-1-.15 Awarding of Units of Credit and Acceptance of Transfer Credit and/or Grades • • 160-4-5-.02 Language Assistance: Program for English Learners 160-4-2-.31 Hospital/Homebound (HHB) Services • • 160-4-2-.34 Dual Enrollment 160-4-8-.12 Alternative/Non-Traditional Education Programs • • • 160-5-1-.07 Student Data Collection 160-5-1-.14 Transfer of Student Records 160‐7‐1‐.01 Single Statewide Accountability System
http://www.gadoe.org/External-Affairs-and-Policy/State-Board-of Education/Pages/PEABoardRules.aspx
10
• •
General Announcements: Managerial Topics
Superintendent’s Certification Form (Online in the MyGaDOE Portal)
January – June: Submit semi-annually no later than July 31 July – December: Submit semi-annually no later than January 31 Principal’s Certification Form (Paper Form) – required after each administration. http://www.gadoe.org/Curriculum-Instruction-and Assessment/Assessment/Pages/Information-For-Educators.aspx
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Must be kept on file by System Test Coordinator for 5 years.
• Form is posted within the ‘For Educators’ link on the GaDOE site • •
Webinar schedule:
http://www.gadoe.org/Curriculum-Instruction-and Assessment/Assessment/Pages/Memoranda--Announcements.aspx
GaDOE Published Resources: GaDOE publishes and posts many resources for use by school staff with colleagues, students, and parents. These items may be downloaded and/or reproduced for such educational purposes.
• However, such publications may not be “repackaged”, cut/pasted, etc. and presented as content created by a teacher or school or recreated in a different form and then portrayed as a GaDOE approved resource. Systems may wish to address this as part of your local system’s training regarding copyright, etc.
11
General Announcements: Managerial Topics Transmission of Secure Information
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
• Do not include GTID or FTE #’s numbers in emails. • In addition, please do not email other secure information such as confidential personnel information, secure test content, confidential student documents, etc.
• If secure information such as this needs to be shared via email, you may do so via the MyGaDOE Portal. 12
General Announcements: Accurate Reporting
• Reasons for non-participation must be provided during the Accountability Non-Participation Collection. This application may be accessed via the MyGaDOE Portal. Those marked (*) are applicable only for EOC non-participation.
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
- Illness - Other - EOC Course Not Completed (*) - Medical Emergency - Unknown • • - EOC Course Not Taken for Core Credit/EOCT Administered Previously (*) Be reminded that assessment data must report to the “FTE-reporting” location (the school that reports the student for FTE purposes) and that students must be assessed per their FTE-reported grade level.
Program Codes (such as the four-digit 6000 series)
inaccuracies in your Accountability reporting.
may not be used
as the four-digit state school number. Please note that doing so will result in reporting errors for your students and may also create 13
General Announcements: Accurate Reporting
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
GaDOE Data Collections Pre-ID Cycles 2015-2016
Cycle #1: August 12-21, 2015 – GKIDS Cycle #2: September 8-23, 2015 – EOC Winter Main 2015 Cycle #3: January 12-27, 2016 – EOC & EOG Spring Main 2016
4/24/2020 14
Transition of the ELA & Math Content Standards from CCGPS to Georgia Standards of Excellence (GSE)
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
• •
Two new Georgia Milestones EOCs become available in Winter 2015:
• • • Algebra I Geometry We ask that those who will administer these two new EOCs in Winter 2015 schedule these tests for completion
no later than Friday, December 4 (paper-pencil) or Tuesday, December 8 (online)
.
•
Coordinate Algebra & Analytic Geometry remain available in 2015-2016
• These will be GSE-aligned beginning in Winter 2015.
Updates to content standards where necessary for Georgia Milestones and other Georgia programs
• Updated Content Weights and Test Blueprints for Georgia Milestones have been posted at: http://www.gadoe.org/Curriculum-Instruction-and-Assessment/Assessment/Pages/Georgia Milestones-Assessment-System.aspx
• GKIDS web application and posted materials have been updated • GAA Blueprint and materials have been updated 15
Overview of 2015-2016 State Assessments
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
16
2015 - 2016 Assessments
•
Active Programs
• ACCESS for ELLs (K-12) and Alternate ACCESS for ELLs (1-12) • Georgia Alternate Assessment (GAA) (Gr. K, 3-8 and HS) • Georgia Kindergarten Inventory of Developing Skills (GKIDS) •
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Georgia Milestones Assessment System (Georgia Milestones) (Gr. 3-8 and HS) • National Assessment of Educational Progress (NAEP) (Gr. 4, 8, and 12) •
Former Programs – Discontinued and no longer available
• Basic Skills Test (BST) • CRCT • CRCT-M • End of Course Tests (EOCT) • • • Georgia High School Graduation Tests (GHSGT) – removed three, 5-day windows from the calendar Georgia High School Writing Test (GHSWT) – removed three, 2-day windows from the calendar Grades 3, 5, and 8 Writing Assessments – removed two, 2-day windows from the calendar and the 2 week rating period for Grade 3 17
• • • •
2015 - 2016 Assessments
ACCESS for ELLs (K-12) and Alt. ACCESS for ELLs (1-12) • Important updates later in this presentation – with more to come this fall
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Georgia Alternate Assessment (GAA) (K, 3-8, 11) • Remains in its current form in 2015-2016 • Annual fall trainings scheduled for August 19, 20, 26, and 27 •
It has been determined that the provisions of House Bill 91 apply to the GAA as well. As a result, attaining the Established or Extending Stages of Progress on the GAA is no longer required for diploma eligibility. Just as with the GHSGT’s & GHSWT’s recent retirement, retest administrations no longer
required/available for both current and former students.
The GAA is still required for grade 11 first-time test takers
• Georgia Kindergarten Inventory of Developing Skills (GKIDS) (K) • The only changes will be those in the language of some ELA and Mathematics content standards per the adoption of the Georgia Standards of Excellence (GSE). Some revisions to suggested activities will be provided as well.
Georgia Milestones Assessment System (Georgia Milestones) • Year 2 of implementation • September 3 & 15 Fall Assessment Conference sessions will focus on Georgia Milestones • Lunch & Learns resume Aug. 21 . . . Sept. 4, Sept. 18, and Oct. 2 National Assessment of Educational Progress (NAEP) (4, 8, 12) • 2016 is a “national year” for which only national results will be reported 18
Assessment Contractor URLS, accounts, and Passwords
“Educating Georgia’s Future”
gadoe.org
Testing Contractor/Website When do you need or receive this information?
Who should you communicate with to have your name added/account created?
gadoe.org
MyGaDOE Portal
Georgia Department of Education https://portal.doe.k12.ga.us/login.aspx Need to obtain ASAP Local System Technology Director
ACCESS for ELLs
World Class Instructional Design and Assessment (WIDA) Fall 2015 (Date TBD) Deborah Houston [email protected]
404-657-0251
GAA GKIDS
Questar Georgia Center for Assessment (GCA) https://gkids.tsars.uga.edu/start
Georgia Milestones Test Administration System for Fall 2015 EOC Mid-Month
CTB/McGraw-Hill • CTB.com
• Test Administration System Sent in October from Questar DRC Customer Service 855-787-9615 WIDA@datarecognitioncorp .com
Deborah Houston [email protected]
404-657-0251 Need to obtain ASAP Contact GCA to update STC designation 888-392-8977 Need to obtain ASAP 866-282-2249 [email protected]
19
• • • •
Student Assessment Handbook (SAH) 2015-2016
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Posted at: http://www.gadoe.org/Curriculum-Instruction-and Assessment/Assessment/Pages/Information-For-Educators.aspx
It is possible that at least one addendum to the SAH will be published over the course the school year (Ref: Georgia Milestones and related topics).
The Handbook will be shorter than recent years due to the overall reduction in the number of assessment programs.
Highlights/Updates for 2015-2016 to include: • Annual edits (dates, updated glossary, new weblinks, etc.) • • Accommodations updates Assessment program information • Georgia Milestones • Annual updates to forms, etc. at end of Handbook 20
CONDUCTING SECURE & SUCCESSFUL TEST ADMINISTRATIONS
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
21
The state assessment program provides critical information to:
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
¤ Students ¤ Teachers ¤ Community Members ¤ Policymakers ¤ Parents ¤ Schools & Systems ¤ Administrators ¤ Various accountability measures
The integrity of the assessment process is critical to all we do as educators . . . And the public’s faith and trust in what we do!
22
• • • • •
Roles and Responsibilities
The successful implementation of the statewide student assessment program requires a concerted effort by many individuals at the local level.
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
The failure of personnel to assume the responsibilities described in the Student Assessment Handbook (SAH) may result in testing irregularities and/or invalidation of scores. Failure to perform one’s responsibilities can have many far-reaching implications for schools, systems, communities, and may affect professional certification status. Most importantly, a failure to fulfill one’s responsibilities can also have a detrimental impact upon students.
Detailed descriptions of roles and responsibilities are provided in the SAH: Superintendent System Special Educ. Coordinator Principal Examiner System Test Coordinator (STC) System Title III Coordinator School Test Coordinator Proctor 23
• •
Scheduling Considerations
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Mandated tests must be scheduled in accordance with published GaDOE testing dates. This is a provision that Superintendents document via the Superintendent’s Certification Form. • The State Testing Calendar can be found on the GaDOE Testing web page in the ‘For Educators’ link. • http://www.gadoe.org/Curriculum-Instruction-and Assessment/Assessment/Pages/Information-For-Educators.aspx
• In scheduling each assessment, schools must adhere to the testing times prescribed in the Examiner’s Manuals. Allowing too much or too little time may result in an invalidation. •
As we enter this second year of Georgia Milestones, we will continue to work closely with systems regarding the details of scheduling – particularly EOG scheduling.
When scheduling tests, consider the optimum time to administer the tests. • Consider logistics, including time and staff availability. • The increased use of online testing, on a larger scale than ever before, requires different thinking relative to logistics.
24
Scheduling Considerations
•
Georgia’s School Superintendent
Each system/school has the option of deciding whether students will be tested in their
Richard Woods,
“Educating Georgia’s Future”
gadoe.org
classrooms or in a large-group setting. It is strongly recommended that students are tested in a classroom setting (or computer lab), especially for elementary school students.
• If the large-group testing option is selected, all students must be able to hear the test instructions and have sufficient workspace for writing or marking answer documents. Instructions should be delivered by the students’ examiner who is present with them in the test setting.
• Mandated tests must be scheduled in accordance with published GaDOE testing dates . . . And where applicable, the prescribed order of content areas, etc.
• The monitoring of students during a prescribed break is required.
• Breaks are intended to allow students to “pause”; they cannot be viewed as a time where disruptive or loud behaviors are allowed or create a scenario where test security could be compromised. They are NOT intended as time for students to be left unsupervised.
• A sufficient number of proctors must be available to assist with test administration and monitor test security. A proctor is required when
30 or more
students are in a test setting. For every additional 30 students, another proctor is required.
25
• • • • • • • •
Materials Management & Security
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Plans for the effective, documented, and secure distribution and collection of test materials (test booklets, answer sheets, online authorization log-ins/passcodes, etc.) must be in place regardless of the type of setting used. Plans must be in place for students who become ill or have an urgent personal need (restroom).
Make certain that Pre-ID label files and/or student data submissions for online testing are created accurately and uploaded in a timely manner.
Correction of school/system level errors that result in reporting errors may result in fees (potentially substantial dollar amounts) to the local system.
• More importantly, they may also negatively impact students.
All testing materials must be stored – under lock and key and with strict “key control” – in a secure central location.
• Each STC must implement an accounting system for the materials that are required for each test administration. This applies at both the system and school levels. The STC should plan for the distribution of test booklets, answer documents, online log-in/password, etc., Examiner’s Manuals and Test Coordinator’s Manuals in a timely manner.
Secure materials should be distributed to schools as close to the beginning of the testing window as possible.
Once an answer document has a student pre-id label on it, student information bubbled on it, and/or student responses on it . . . It is considered secure.
26
Materials Management & Security
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
•
Upon receipt, STC should:
• Inventory all materials to ensure sufficient quantities of materials have been provided for each school.
• Locate pickup/return instructions/memo, return labels, and airbills/bills of lading.
• If there are any errors in shipping materials, contact the vendor and/or Assessment Specialist associated with the testing program immediately.
Online testing eliminates many tasks associated with the bullets above.
27
• • • •
Materials Management & Security
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Staff members who are not involved in testing should also be aware of the school’s responsibility for test security. Paraprofessionals, custodial staff, and others in the school who may be in classes during testing or may be near the area where tests are stored (even though they do not have direct access to tests) should be aware of security rules.
All personnel involved in the administration must be trained in a manner appropriate to their role; this includes all staff who are involved in the handling of secure test materials (receipt, distribution, pre/post administration activities, return shipment, computer hardware management, etc.).
Volunteers who assist in the school (non-employees) should not manage test materials or manage testing logistics but may assist in the administration in other ways (front office support, hall monitors, etc.).
• If needed, volunteers may serve as proctors – but MUST be fully trained. See SAH for details.
28
Materials Management & Security
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
• • • • Distribute materials to schools in a timely manner. However, materials should not be in schools for lengthy periods of time either prior to or after the assessment window.
Use appropriate “security checklists” to assign booklets to schools.
School Test Coordinator must count and sign for all paper materials and online “tickets” received.
Materials must be in a locked, secure location both at the system and school levels. • Restricted access must be confirmed and monitored.
• A “rule of thumb” . . . If one would not store a large sum of money in the chosen location, then it is probably not a wise choice for secure test materials either.
29
Materials Management & Security
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
• • • • • The School Test Coordinator must count/document paper materials, test tickets, etc. before disseminating to examiners. Examiners must verify count(s) upon receipt and return.
Materials that are specific to a student ( answer documents, booklets, online test tickets, etc.)
MUST be given to the correct student.
• This is a staff error that we see much too frequently – watch this carefully. Mistakes on this task can result in reporting errors that may be irreparable . . . With potentially negative impacts upon students . . . And potentially with financial costs to a district.
At the end of testing each day, the examiner must account for all materials before dismissing students. The School Test Coordinator must count and secure all materials as examiners check in the materials at the end of testing each day. 30
•
Materials Management & Security
•
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Each school should have a process that outlines how, when, where tests are to be distributed and collected each testing day.
• Schools should distribute materials to examiners immediately before testing (as close to “start time” as possible.
• Schools should collect materials immediately at the conclusion of testing each day (or after each testing “period” or “session” if applicable).
A local school’s process must ensure that staff is in possession of test materials for only the amount time that is necessary to ensure a secure and successful test administration. • For instance, if multiple sessions are conducted during the day, the morning session materials must be turned in after the morning session concludes.
• They cannot remain outside of the school’s secure storage until the end of afternoon testing.
31
• • • • •
Materials Management & Security
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Personnel are prohibited from reviewing contents of test booklets.* Neither students or parents may be involved in the counting, preparation, and dissemination of materials. This is a role reserved exclusively for the appropriate staff.
Do not copy any secure test materials.
The use, or intended use, by a student of an electronic device to photograph, post, retain, or share information/images from any portion of a secure test booklet and/or answer document will result in invalidation.
• This includes screenshots of online test forms.
Monitor students.
*Interpreters for the hearing impaired may review in advance, with supervision, to plan for administration. 32
Materials: Pre-ID Labels
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
•
Pre-ID labels (where provided) must be used to provide accurate student information for state tests.
• Refer to the Test Coordinator’s and Examiner’s manuals for current information on use of labels specific to each test. • Labels with incorrect information should not be used (and should be securely destroyed). • Labels should be applied to answer documents prior to administration. Once applied, the answer document is considered secure.
33
• • • •
Training Plan
The STC must develop and implement a district plan for training for each specific assessment program.
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Remember, online test administration requires the delivery of very detailed information that differs from the training that most are familiar with (for paper/pencil testing).
• Additionally, it may require the inclusion of staff members who were not included in trainings before – such as technology specialists, etc. Maintain detailed attendance records with the name of each participant, responsibility, date of training, and name of assessment.
Develop a specific plan for implementing accommodations including: • ensuring students receive the right accommodations • ensuring the examiner administers the accommodation appropriately and that any necessary logistics, materials, peripherals are considered 34
Importance of Training Materials
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Prior to and during test administrations, please refer to the following resources: •
Student Assessment Handbook
•
Examiner’s Manuals (paper/pencil & online)
•
Test Coordinator’s Manuals (paper/pencil & online)
•
Accommodations Manual
•
Pre-Administration Webinars
•
Online Platform Webinars, Viewing of posted “how-to” modules, User Guides, Readiness Checks, etc.
35
Planning for a Conducive Environment
•
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Ensure that seating spaces and writing surfaces are large enough. • Seating arranged to prevent cheating to the greatest degree possible. • No cell phones or other electronic devices in the test setting. • No. 2 Pencils - Each student should have two No. 2 pencils with erasers on test days. However, there should be a supply of extra pencils and erasers available. • Keep a timing device visible - you should have a clock or watch to keep track of time during test administration. • Prior to testing, make a plan for students who finish early, arrive late, appear to be (or become) ill, etc.
36
Online Testing Implications
• • • • • • •
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
For systems (and GaDOE as well) many lessons have been learned through Year 1 of Georgia Milestones (and previous years of online testing in other programs): Technology hardware, requirements, support needs, local bandwidth, proximity to wireless routers, and capacity.
Conducting more than one session per day (AM and PM, AM, PM, etc.) . . . testing on Mondays and Fridays, etc.
“Cycling” students through test settings where technology is housed Seating/space considerations Securing log-ins, passwords, etc.
Proficiency of staff and students with technology and diligent participation in trainings and follow-up activities Contingency planning for both expected and unexpected events such as power outages, monitoring weather during testing windows, Internet Service Provider (ISP) interruptions, construction in or near a school, etc.
37
Materials: Resources
• • •
RESOURCES AND AIDS
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
No dictionaries(*), textbooks, or other aids and/or resources that would provide assistance.
•
*EL Word to Word Dictionaries would be an exception to this if prescribed in an EL-TPC plan
Any instructional materials that are displayed in the room, such as posters, must be covered or removed during testing.
• We continue to have multiple irregularities on this front each year . . . Including invalidations of entire test settings.
Review calculator policies carefully.
38
Roles and Responsibilities
• • •
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Refer to the Student Assessment Handbook for detailed information.
Superintendent has ultimate responsibility for all testing activities within the local school system. The System Test Coordinator shares this responsibility as the Superintendent’s designee.
Principal has ultimate responsibility for all testing activities within the school.
• Emphasize: The Principal must complete the Principal’s Certification Form after each administration.
39
Roles and Responsibilities
System Test Coordinator
• Liaison between system and GaDOE •
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Conduct local system trainings of School Coordinators • Coordinate ALL administration activity • Know and enforce responsibilities of all other roles • Adhere to the state testing calendar and local calendars/schedules • Implement plans for ordering and receipt of materials, distribution, test security, administration, collection and return shipments, receipt and dissemination of reports and data •
Detailed list of responsibilities in SAH
40
Roles and Responsibilities
School Test Coordinator
• • Must hold a PSC-issued certificate (per Student Assessment Handbook) Count and secure all test materials
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
• Materials distribution/return, signing out and signing in materials • Attend and then redeliver training • Plan for all aspects of the school’s test administration, monitor test administration environment • Receive/verify test material counts after testing each day • Collaborate effectively with local system colleagues who have a role in the success of your system’s testing program.
•
Detailed list of responsibilities in SAH
41
Roles and Responsibilities
Examiner
•
Must Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
hold a Georgia PSC-issued certificate (teachers, counselors, administrators, paraprofessionals) . . . This is required per SBOE Rule 160-3-1-.07. GaDOE is compelled to invalidate when this does not occur (!).
• Security/verification of test materials • Control of testing environment and active monitoring • Accuracy of demographic/student information on answer documents • Correct delivery of assigned accommodations • Follows procedures for testing as given in Examiner’s Manuals, including reading all directions/script to students • Test materials are not to be used for any purpose other than test administration •
Detailed list of responsibilities in SAH
42
Roles and Responsibilities
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Proctor
• Must be trained • With examiner supervision, ensures that students are managing test materials appropriately • Active monitoring •
Detailed list of responsibilities in SAH
43
Irregularities
• • • • •
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
All personnel in the local system must follow protocol as they become aware of testing irregularities Signs of any testing irregularity must be dealt with immediately • Test Examiner > School Test Coordinator > System Test Coordinator > GaDOE All irregularities must be coded, documentation completed and submitted to the GaDOE Assessment Administration Division
Only the GaDOE may invalidate assessments
The Assessment Administration Division will review all reports of irregularities • Issue irregularity/invalidation codes • If appropriate, advise the local system as to whether a report of possible unethical conduct should be made to the Professional Standards Commission (PSC) 44
Examples of Irregularities in Security Procedures
•
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Examinee was given access to test questions or prompts prior to testing • Test Examiner or other personnel copied or reproduced and distributed secure test materials • Examinee’s test booklet, online testing ticket, answer sheets, or portfolio entries (GAA) are lost • Test Examiner or other personnel provided answers to the examinee, or altered/interfered with student responses • This would include staff member(s) critiquing student responses during test administration • For more examples, please refer to the SAH 45
Examples of Irregularities during Testing Administration
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
• • • • Test Examiner or other personnel failed to follow administration directions for the test Examinee’s test booklet, online testing “ticket”, answer sheets, or portfolio entries (GAA) are lost Test Examiner fails to provide an examinee with a documented accommodation or provides examinee with an accommodation that is not documented . . . Including a failure to transfer student responses to an answer document (such as with a Braille student) For more examples, please refer to the SAH 46
Steps for Reporting an Irregularity
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
School Test Coordinator:
• Communicate with the Principal and System Test Coordinator about a possible testing irregularity • System Test Coordinator will provide guidance regarding investigation if necessary • Statements should be provided by all parties involved in the irregularity . . . Details, Details, Details . . .
• Return all documentation to the System Test Coordinator in the manner and at the time prescribed 47
Steps for Reporting an Irregularity
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
System Test Coordinator: • Collect Testing Irregularity Forms and documentation, if needed, from School Test Coordinators • Documentation may include statements from parties with knowledge of event, list of students involved, copies of training logs, etc.
• Compile documentation and submit Portal entry for each incident • Notify the Assessment Specialist in the Assessment Administration Division to determine appropriate coding for student answer documents • Know your system’s protocol for cases that may constitute a breach of the Code of Ethics . . . Systems typically have defined investigation protocols for such instances. This may even require support from your system’s Human Resources Division and/or Board Attorney.
48
Characteristics of a Quality Investigation
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
•
Examiner must notify Principal and School Test Coordinator of incident
•
School Test Coordinator must notify System Test Coordinator
•
Request detailed written statements from all parties involved if necessary
• Follow up on details, probe all angles, etc.
•
Follow district procedures regarding alleged employee misconduct
49
Characteristics of a Quality Investigation
•
Provide a written summary of incident and investigation findings
•
Consult with GaDOE as needed.
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
•
System Test Coordinator is responsible for reporting to GaDOE
•
Note:
•
Report to GaDOE immediately, before investigation if the matter merits doing so
•
Final documentation MUST be entered into the Portal
•
The Portal is your system’s, and GaDOE’s, official record of the event and its disposition
50
• • •
Irregularities – Post Testing
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Make certain that all irregularities and invalidations are documented correctly before sending scorable documents
•
Make certain that online test irregularity forms have been finalized Communicate to school personnel the GaDOE responses to irregularity forms and consequences of irregularities, invalidations, and participation invalidations If appropriate/necessary, refer to PSC for review/action
51
• • • • • • • •
When entering irregularities into the MyGaDOE Portal . . .
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Provide comments in the “Comment” section to help elaborate on the irregularity (or in the “Reason for Invalidation” section if applicable).
• Note that simply copying and pasting text from emails sent to your by schools is, in many cases, not sufficient. If this is the approach taken, please review what’s being stated before clicking Submit.
Please include in the comments the Form # in question (if applicable).
If it has been determined that the irregularity will result in invalidation – make sure to indicate “Yes” in that drop-down box.
Names of students and their GTIDs must be provided.
Upload statements and other documents that provide necessary details on the event.
Make sure you indicate the correct “Assessment Cycle” (Date) in that field.
We have added an “Online” or “Paper-Pencil” field to the online IR form.
In an event that involves multiple students – some of whom may be IR and some who may be IV, please enter them as two separate records.
52
• • • • • •
Cell Phones and Electronic Devices
Georgia’s School Superintendent
Students are not permitted to use, or bring into the testing environment, any electronic device that could allow them to access, retain, or transmit information (e.g., cell phone, smartphone, PDA, electronic recording, camera, or playback device, etc.).
Richard Woods, gadoe.org
Announcements must be made prior to testing that such devices are not allowed in the testing environment and that possession or improper use of such devices during testing may result in disciplinary action in accordance with the system's student code of conduct and/or test invalidation. In the event students attempt to enter the testing environment with such a device, districts and schools must have a plan to collect and secure such devices so that they are not accessible during testing. Script appears in the appropriate Examiner’s Manuals regarding this topic. This script, as with all script, MUST be read to students.
If necessary, remind students that this expectation for Georgia’s state assessments is no different than most (if not all) other test settings that they will experience . . . Georgia Driver’s License Knowledge Exam, the ACT, the SAT, etc.
Many systems have local policies regarding cell phone access and/or use during the instructional day. The district should continue to apply and enforce their local discipline or other policies regarding the use of electronic devices. (Note: More and more, we are seeing cases where students have more than one device.) The GaDOE will determine if the assessment should be invalidated.
• • •
Cell Phones and Electronic Devices
Should a case occur where a student does not conform to the directions given by school staff and a device is located in the test setting . . .
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
In the event an examiner confirms during testing that a student is using a device to access, retain, or share information, the examiner must with minimal disruption: • collect the device, • stop testing that student, • • remove the student from the testing session, and notify the School Test Coordinator immediately. In the event such actions are suspected, but not yet confirmed, the examiner must with minimal disruption : • • collect the device, allow the student to complete testing, • • notify the School Test Coordinator immediately, and as soon as it is appropriate attempt to confirm whether or not the device has been used in violation of the guidelines above Simple possession of a device (including the ringing of a phone during test administration) may be addressed in keeping with the system’s code of conduct and does not require an irregularity report to the GaDOE .
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Accommodations and Special Populations
55
•
Eligible Students
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Students eligible for accommodations include:
• Students with Disabilities • students with individualized educational plans • students served under Section 504* • English Learners • Students qualifying for language assistance services • EL students who are also SWD • Students who have exited language assistance services in the last two years (EL-Monitored)** * Only in the rarest of circumstances would a 504 student qualify for a conditional accommodation.
** EL-M students are not eligible for conditional accommodations.
Accommodations
•
Accommodations allow access…
• they are practices and procedures in the areas of
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
presentation, response, setting, and scheduling that provide equitable instructional and assessment access for students with disabilities and English learners. •
Accommodations reduce or eliminate the effects of a student’s disability or limited English proficiency
•
Accommodations do not provide an unfair advantage
•
Accommodations do not reduce or change learning expectations
Accommodations
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
In Georgia accommodations MAY NOT
• alter, explain, simplify, paraphrase, or eliminate any test item, reading passage, writing prompt, or choice option • provide verbal or other clues or suggestions that hint at or give away the correct response to the student Only state-approved accommodations may be used on state-mandated assessments, following the guidance issued.
• • • •
Test Administration Accommodations
Accommodations provide access for demonstration of achievement • Allow participation • • Do not guarantee proficiency
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
They may not be selected solely as mean to help ensure proficiency Must be required by the student in order to participate in the assessment Must be provided during, and be informed by, routine instruction and assessment in the classroom (both before and after the state tests are administered) • For instance, the amount of extended time a student is given for a state assessment should be informed by the amount given during routine, daily instruction and classroom/local assessment experiences.
Neither accommodations or assessment designations (such as a student’s assignment to the GAA) should be influenced by accountability concerns or influences.
Key Considerations
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
•
For students with disabilities IEP teams should consider –
•
the characteristics of the disability or the combination of disabilities for the individual student
•
how the disability affects/impacts the learning of specific content
•
how the disability affects/impacts the demonstration of learning
60
• •
Key Considerations
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
For English learners EL-TPC teams should consider –
• the student’s level of English proficiency • the student’s level of literacy in English • the student’s level of native language proficiency • the student’s level of literacy in native language
Where a student is both SWD & EL, the appropriate educators need to converse regarding how to appropriately accommodate the student in light of the fact that both plans would apply.
61
Plan for Accommodations
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
• • • • • • • • Know who your SWD, EL, and 504 students are who require accommodations . . . And plan well in advance for their needs.
Plan for small groups and the need for the same form number/letter.
Know who your visually impaired students are and ensure you have adequate materials.
Make provisions for Extended Time students.
Plan in advance for any Word to Word (EL) Dictionary needs.
Ensure that examiners are familiar with the proper way to deliver the necessary accommodations.
Collaborate with others as needed to ensure that “paperwork” (IEP’s, EL-TPC’s, 504 Plans, etc.) is in order.
The transposition of student responses to a student answer document (in cases such as Large Print and Braille administrations) should be completed with a witness present . . . The witness should hold a PSC-issued certificate.
It is critical that staff confirm that this process is completed where required. A form to document this process is provided in the Student Assessment Handbook under Required Forms.
62
Plan for Accommodations
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
• Any accommodation(s) given to a student during the administration must be specified in the student’s IEP, 504/IAP, EL/TPC.
• All accommodation(s) during state mandated testing should reflect instructional practices.
• Again, students should not experience an accommodation for the first time on a state assessment.
• School Test Coordinators must ensure that students are given their appropriate accommodations, before a student begins to test.
63
Requests for Accommodations Not on State-Approved List
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
In rare instances, the GaDOE will consider a request for use of an accommodation that is not included in the
Student Assessment Handbook
, on a student by student basis.
• In order to consider the request, the Assessment Division will need detailed information for
the/each
student.
• See the Student Assessment Handbook for the required information that must be submitted.
• To grant the request, there must be a clear relationship between the student’s disability and the need for the accommodation to access the test. Accommodations that serve to grant the student a differential boost in correct answers cannot be approved if that is the sole reason for the request. • Given that accommodations are to be prescribed based upon the needs of individual students, requests that are identical for multiple students are not appropriate and will not be reviewed.
64
Requests for Accommodations Not on State-Approved List
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
• •
The System Test Coordinator must review all requests submitted by their local schools PRIOR to submission to GaDOE and indicate their approval of the school’s request.
appropriate and/or are incomplete.
Requests must be reviewed with consideration given to the purpose of the assessment and the constructs measured. Requests must not be forwarded to GaDOE if they are not
Requests must be submitted by systems in a “batched” fashion
time (e. g.: all CRCT requests submitted in one batch).
so that all being submitted for each state assessment are provided to GaDOE at one •
This will likely require local systems to establish internal timelines
for such requests to be tendered to the System Test Coordinator.
• This information should be submitted to the Assessment Division by submitting the form by fax at (404) 656-5976, or preferably by emailing the information to Melissa Fincher, Deputy Superintendent, at [email protected]
. Requests MUST be received six weeks prior to the opening of each applicable state testing window for consideration. 65
Post Administration Info/Reminders
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
66
Collecting Paper-Pencil Materials
• In a supervised setting, at the conclusion of testing: •
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
The School Test Coordinator . . . Conducts, coordinates, and supervises inspection of all completed answer documents for the following purposes only . . .
• to ensure that student demographic and identification information is accurate • • that necessary coding/labeling is complete that documents are in good condition for scanning/scoring. (If there is concern
about some form of damage, stain, tear, etc., please contact GaDOE Assessment to discuss if needed.)
• Count the answer documents and test booklets to account for the appropriate number • Check to make certain there are no answer documents left in the test booklets • Unnecessary handling of answer documents must be avoided 67
Returning Paper-Pencil Scorables and Nonscorable Materials
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
•
Arrange for pickup of test materials. Refer to Test Coordinator Manual regarding pickup protocols
•
Prior to shipping, make certain that there are no documents left in the schools or district offices and that an accounting of all documents is completed
•
All materials should be in the proper order as explained in the Test Coordinator Manuals
68
Transferring Student Test Scores
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
•
It is the responsibility of local school systems to ensure that test scores become a part of students' records as soon as possible after testing, and that such records follow students to their new schools
•
This responsibility to provide scores to students/parents continues even after a student withdraws/exits school. GaDOE does not issue individual student scores to students, parents, or receiving schools.
69
Dissemination of Test Scores
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
• • • Data files, and for some programs PDFs of reports, are released on the department’s secure portal, MyGaDOE, and/or (for some programs) via a contractor’s delivery system • To have access to these downloadable roster reports and data files, it is imperative that System Test Coordinators acquire a login and password for both the MyGaDOE Portal and any necessary contractor sites • Requests for data from other personnel in the system (e.g. principals, teachers, parents, etc.) will be redirected to the System Test Coordinator Individual student reports, rosters, school level summary reports, and system level reports are made available to districts via printed copy Most importantly, parents must receive their student’s report(s) on a timely basis – this includes both test scores and growth scores (SGPs) 70
Test Administration/Errors in Reporting
Please note that mistakes in test administration that occur in a school or system may result in the local school system being invoiced for the costs incurred to correct any resulting errors in test data/reports.
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Errors that may result in costs being borne by the local school system include, but are not
• • • • • • • • •
limited to:
late return of scorable materials failure to report irregularities in a timely manner use of old/incorrect answer documents not correctly coding student information or incorrectly using one student's label for another student (this would include providing incorrect online testing authorization tickets to the wrong student) incorrect coding of header sheets, incorrect use of school names, inaccurate grouping of answer documents failure to transpose student responses (i.e., for Braille students or other accommodated students) from the test booklet to an answer document leaving scorable answer documents in test booklets or shipping scorables with non-scorables administering the wrong test(s) to the wrong student(s) return shipments sent to the wrong location/wrong contractor
These errors may necessitate custom and/or hand scoring, creation of new student, school, system, or state reports and/or data files and some may be irreparable. It is important to be aware that costs for such instances could be quite substantial.
71
Ethics and Assessment
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
72
CODE OF ETHICS FOR GEORGIA EDUCATORS
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
The Professional Standards Commission’s (PSC) Code of Ethics for Georgia Educators contains a standard specific to testing.
PSC Ethics Division: http://www.gapsc.com/Ethics/Home.aspx
Standard 11: Testing - An educator shall administer state-mandated assessments fairly and ethically. Unethical conduct includes but is not limited to: 1. committing any act that breaches Test Security; and 2. compromising the integrity of the assessment.
73
Test Security Reminders
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
• • • • • •
Be thoroughly familiar with the Student Assessment Handbook and test administration manuals
Thoroughly train everyone involved in testing Carefully consider who has access to secure materials . . . And that includes who has access to online testing platforms and what “role” they have in the online system Make everyone in the school/system aware of the importance of test security and the consequences of violating test security Report problems in a timely manner Principal’s Certification Form is required after each administration and must be maintained by the System Test Coordinator for 5 years 74
Test Security Reminders
• • • • • Advanced planning is necessary Solid logistical procedures must be in place Secure storage before, during, and after must be present
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Clear and concise communication about roles and responsibilities • • Leave no doubt about what’s expected and required by both GaDOE and your local system . . . And what’s unacceptable and unethical • Remind staff that security breaches can be either “acts of commission” (“doing something wrong”) or “acts of omission” (“not fulfilling one’s role or responsibilities”) Document training carefully, including participants Loss of test booklets, answer documents, and/or any other secure materials constitute a breach of test security that can result in a referral to PSC 75
ONLINE FORMS IN THE MyGaDOE PORTAL
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
76
Assessment Online Forms
https://portal.doe.k12.ga.us/login.aspx
•
Assessment Rescore Request
• STC > GaDOE •
PENDING: Special Accommodations
• STC > GaDOE •
Superintendent’s Test Certification
• STC > Superintendent > GaDOE •
Testing Irregularity
• STC > GaDOE
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
77
Assessment Online Forms
https://portal.doe.k12.ga.us/login.aspx
•
Assessment Rescore Request Form
•
IMPORTANT: Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Email/call appropriate Assessment Specialist to discuss applicable fees and notify GaDOE of request •
PENDING: Special Accommodations Request Form
• Guidance appears in Student Assessment Handbook • Form will replace the need to submit requests via email •
Superintendent’s Certification Form
• January – June: Submit no later than July 31 • July – December: Submit no later than January 31 •
Testing Irregularity Form
• Has been updated with a “Mode of Administration” drop-down and retired assessments have been removed 78
Entering IRs into the MyGaDOE Portal
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
In the MyGaDOE Portal, find the “Surveys” section and click on “More” https://portal.doe.k12.ga.us/login.aspx
Click on “View Summary” next to Testing Irregularity Form Click on “Add New Record” Click on “Start”
Entering IRs into the MyGaDOE Portal
https://portal.doe.k12.ga.us/login.aspx
See the Online Forms QuickStart Guide at
http://www.gadoe.org/Curriculum-Instruction-and Assessment/Assessment/Pages/Information-For-Educators.aspx
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
80
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Program Updates 2015-2016
81
•
ACCESS for ELLs & Alternate ACCESS for ELLs
In 2015-2016, the WIDA Consortium will begin administration of a • newly developed ACCESS for ELLs summative assessment.
The program will move online and will replace the previous paper-
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
based version of ACCESS for ELLs for Grades 1-12.
• A paper-based assessment will continue to be available for students who have a disability that requires paper-based testing. Paper will also be available for systems/schools that are unable to move fully online in 2015-2016.
Online testing will be conducted using Data Recognition Corporation’s (DRC) INSIGHT testing platform.
• WIDA requirements are posted at: https://www.wida.us/assessment/access20 tech.aspx
• Note that schools that use Thin Client/Virtualization solutions need to plan to administer ACCESS for ELLs via paper (or on non-Thin Client hardware if available) as audio (the Listening test) delivery support is not ensured for Thin Clients. DRC Customer Service (relative to ACCESS) can be reached at (855) 787-9615; [email protected]
. 82
• • • • • •
ACCESS for ELLs & Alternate ACCESS for ELLs
ACCESS for ELLs will continue to assess each of the four language domains
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
separately: Listening, Speaking, Reading, and Writing.
WIDA recommends that students first take the Listening test and then the Reading test. Speaking and Writing may be taken in either order.
Target administration times range from 30 minutes up to 60 minutes.
ACCESS for ELLs will assess (via the online platform) Grades 1-12 using the following new clusters: Grade 1, Grades 2-3, Grades 4-5, Grades 6-8, and Grades 9-12.
•
Note that the Writing domain for the online ACCESS for ELLs Grade 1, Grades 2-3, and Grades 4-5 forms will continue to be administered on paper in 2015-2016.
Kindergarten will continue to be paper-based in 2015-2016.
The online test is a staged adaptive test, meaning students will progress through the test based on their performance.
•
Due to this adaptability, the online test will not require test administrators/examiners to determine tier placement of students in order to administer the test.
• In cases where the paper test continues to be administered, schools must identify the appropriate tier for proficiency. The protocol for tier placement for paper tests will remain the same as previous years.
• Each student testing online will require a computer and headset with microphone for the Speaking test – and headphones for the other domains.
4/24/2020 83
• • •
ACCESS for ELLs & Alternate ACCESS for ELLs
Students’ performance on the online Listening and Reading tests will determine their placement for Speaking and Writing.
• WIDA recommends that students first take the Listening test and then the Reading test. Speaking and Writing may be taken in either order.
The domains may be administered across multiple days in the manner that best works for scheduling purposes and the use of technology.
• • However, a single domain may not be broken into separate administrations.
The online platform will not have a limit on the number of students who can test at one time. • For Speaking, it is recommended that groups of 5-7 students (or fewer) test simultaneously so that headset microphones do not capture other voices. Students of different grades may test in the same room at the same time – though it would be wise to consider the needs of the involved students before taking this approach.
For 2015-2016, the paper test will include the following grade clusters: Grade 1, Grade 2, Grade 3, Grades 4-5, Grades 6-8, and Grades 9-12.
• In 2016-2017, the paper test will be updated to have the same grade clusters as the online test.
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
4/24/2020 84
ACCESS for ELLs & Alternate ACCESS for ELLs
•
Georgia’s School Superintendent
“Educating Georgia’s Future”
As in previous years, examiners must complete online training and become
Richard Woods, gadoe.org
• • • “certified” to administer ACCESS for ELLs.
• • The online course modules become available in October 2015.
The courses necessary will vary based upon what the examiner is administering: • Kindergarten (Paper-based only in 2015-2016) or, • Grades 1-12 (via Online) or, • Grades 1-12 (via Paper).
Closely monitor the number of English Learners (ELs) in your systems to ensure an accurate order of any paper materials your system may require. Systems will be invoiced for excessive orders.
The ordering process will occur from October 12 – November 30, 2015
• •
Review technology requirements soon (next few weeks)!
View WIDA training modules and attend webinars!
Alternate ACCESS is unchanged for 2015-2016.
The state testing window for ACCESS is seven-weeks in length –systems may utilize the entire window as needed. The windows for ACCESS for ELLs and the Alternate ACCESS for ELLs are the same.
4/24/2020 85
ACCESS for ELLs & Alternate ACCESS for ELLs
Training Webinars/Modules
August 2015: Brief Overview via Fall Assessment Conference
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Fall 2015: Availability of Online Training Courses for Grades K, 1-12 (Paper), 1-12 (Online) September 2015: Availability of Online Modules (Account Set-Up, Materials Ordering, Pre ID Uploads, System Downloads, Test Session Creation, Student Management, ) September 23, 2015: System/School Test Coordinator’s Overview September 30, 2015: Test Administrator’s (Examiner’s) Overview October 7, 2015: Technology Coordinator’s Overview November 10, 2015: Alternate ACCESS Pre-Administration November 12, 2015: ACCESS for ELLs Pre-Administration January 7, 2016: Pre-Administration Question & Answer Webinar Memo posted at: http://www.gadoe.org/Curriculum-Instruction-and Assessment/Assessment/Pages/Memoranda--Announcements.aspx
4/24/2020 86
ACCESS for ELLs & Alternate ACCESS for ELLs
Important Dates ACCESS for ELLs Administration Dates (2015-2016) Description Test Materials Ordering Pre-ID Files from local systems to Data Recognition Corporation (DRC) Online Test Setup Available Test Materials Arrive Georgia ACCESS for ELLs State Testing Window Additional Test Material Window Districts Ship Completed Test Material to DRC All Test Material Received at DRC Pre-Reporting Data Validation Window for local systems Districts Receive Reports - Printed and Online (On or Before) Post-Reporting Data Validation Window Final Data Available
4/24/2020
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Start Date End Date 10/12/2015 10/12/2015 12/18/2015 1/5/2016 1/19/2016 1/6/2016 4/4/2016 5/2/2016 5/2/2016 5/26/2016 11/30/2015 11/30/2015 3/4/2016 1/5/2016 3/4/2016 2/26/2016 No Later Than 3/11/2016 No Later Than 3/18/2016 4/15/2016 5/2/2016 5/13/2016 5/26/2016
87
• • • • • •
Georgia Alternate Assessment (GAA)
The GAA continues in its current form in 2015-2016
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Our annual fall trainings are scheduled for August 19, 20, 26, and 27.
• Memo posted at: http://www.gadoe.org/Curriculum-Instruction-and-Assessment/Assessment/Pages/Memoranda -Announcements.aspx
The GaDOE Policy Division has determined that HB 91 DOES apply to high school GAA students who are seeking a regular diploma. As a result, the assessment requirement for diploma eligibility no longer applies. Retest administrations are no longer
necessary or available for either current or former students.
The GAA is still required for grade 11 first-time test takers
Student work becomes secure test material once it has been placed in the assessment binder as a piece of evidence. The required Validation Form must be completed (this includes affirming each item on the “checklist” that appears) and signed by both the person submitting the portfolio and the building administrator. Binders and other materials will arrive beginning in late August. Return shipping labels and instructions for returning portfolios will be included with a second shipment of materials in February.
• You may notice a change in binder colors (a different shade of blue) this year.
88
Georgia Kindergarten Inventory of Developing Skills (GKIDS)
• GKIDS continues in its current form in 2015-2016. The GKIDS website opened on August 3.
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
• Teachers should contact the school coordinator first and then the system test coordinator for assistance with GKIDS.
• Teachers should enter student information into the website in a timely manner. • Students who transfer from a school/classroom should be released through the GKIDS website so they can be acquired by the new teacher.
• GTID issues should be addressed with the school student database contact and/or the GaDOE Technology Services Division.
• There is not a state-mandated baseline or end of year summary of required elements.
• Teachers are responsible for students’ end of year reports prior to the end of the administration window in May.
• A mid-year data file will again be available in January 2016.
89
GKIDS: Pre-Population Option
Again, during 2015-2016, there are two ways for teachers to add students to their class lists. Systems may require that all of their schools select the same
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
option or they may allow schools to choose which option to use – however, all teachers in a single school should use the same option.
Please plan to attend our GKIDS Pre-Administration Webinars on August 27 and September 1.
• Enter students manually. This can be done at any time during the school year, beginning on August 3, 2015 and will be no different than previous years.
• Select students from a Pre-Populated School List. After Pre-ID Cycle 1, GCA will upload student demographic information in September. The GKIDS site will be down from September 14-22 while the student information is uploaded.
On September 22, the website will be back online, and teachers may select their students from a school list if they have not already added their students manually. If teachers in schools/systems that will use pre-population wish to start assessing students at the beginning of the school year, before September 22, they may use the recording sheet posted on the GaDOE website if desired: http://www.gadoe.org/Curriculum-Instruction-and Assessment/Assessment/Documents/GKIDS%20Recording%20Sheet.pdf
GKIDS: Pre-Population Option
August 3, 2015 August 12-21, 2015 August 28, 2015 Sept. 14, 2015 Sept. 22, 2015 January, 2016 May 6, 2016 June 10, 2016 GKIDS Website goes online; teachers may add students manually to the GKIDS database.
GaDOE Pre-ID Cycle I (GKIDS) Richard Woods,
“Educating Georgia’s Future”
gadoe.org
Deadline for System Test Coordinators to notify GCA of any new schools and/or school closures for 2015-2016 GKIDS Website goes offline to upload student demographic information from Pre-ID Cycle 1.
GKIDS Website goes back online; pre-population feature is available for selecting students from a class list.
Mid-Year GKIDS student data file posted to systems in the MyGaDOE Portal Deadline for entry of student assessment data by teachers.
GKIDS Website closes for the 2015-16 school year.
• • • •
Georgia Milestones
Our September 3 & 15 Fall Assessment Conference sessions will be focused upon Georgia Milestones. Lunch & Learns resume August 21.
CTB purchased by Data Recognition Corporation (DRC) on July 1, 2015.
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Technology requirements for Georgia Milestones and DRC INSIGHT posted at: GA Milestones/DRC INSIGHT Tech Requirements • Information about trainings relative to DRC’s online testing and administrative platforms will be forthcoming. The transition to INSIGHT will begin with the Winter 2015 EOC Administration.
• Note that DRC INSIGHT does support Thin Client solutions, including nComputing, Citrix, Wyse, and VMWare for non-audio test delivery. Consult Technology Requirements document!
• Schools that use Thin Client/Desktop Virtualization solutions will likely need to plan to administer Oral Reading accommodations via paper/human reader (or use non-Thin Client hardware) as audio delivery support is not ensured for Thin Clients. DRC Customer Service, relative to GA Milestones, can be reached at (866) 282-2249; [email protected]
.
• INSIGHT provides for caching through its Testing Site Manager (TSM) As a result of both the transition from CCGPS >>> GSE and work with educators this summer, the posting of new/updated resource documents is underway and will continue over the next few weeks.
• These include revised Content Weights, revised Blueprints, new Student/Resource Guides, revised Assessment Guides, formula sheets, etc.
EOC enrollment counts for Winter 2015 will be collected August 17-28, 2015 (using the CTB enrollment site previously used in 2014-2015).
4/24/2020 92
Georgia Milestones
• • • • The EOG main testing window remains at 9 consecutive school days.
o
However, we will again work with systems that are seeking to maximize online testing for windows of up to 12 days (and as many of you already know, Robert McLeod is an excellent resource for these discussions).
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
The testing window for EOG Summer 2016 Retest Administration has been established, May 16 – July 22, 2016.
• State main administration window closes Friday, May 6, 2016.
• Systems who wish to retest prior to the end of the school year would be wise to consider: (1) testing grades 3, 5, and 8 online and (2) testing those grades early in your local window. • Turn-around time for scores to post (electronically) for the EOG is anticipated at two weeks from the receipt of students tests in the scoring center(s). Online tests will reach the scoring center(s) much quicker than paper tests.
A single (1) allowable hand-held calculator will be permitted in online testing environments again this year. (Local systems may chose to not allow the devices.) Calculator Policy is posted at: Assessment-System.aspx
. http://www.gadoe.org/Curriculum Instruction-and-Assessment/Assessment/Pages/Georgia-Milestones For Braille students, Georgia’s classrooms will be transitioning to Unified English Braille (UEB) code in 2015-2016. We anticipate that Georgia Milestones will mirror this transition beginning with the Winter 2015 EOC.
4/24/2020 93
Georgia Milestones Achievement Levels
The names of the four Achievement Levels have been determined:
• Distinguished Learner (*) • Proficient Learner • Developing Learner • Beginning Learner (**)
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
(*) This will be the required Achievement Level for a successful EOC “test-out” attempt.
(**) This level will require retest in the area of mathematics for grades 5 & 8.
A reading score will be provided for the purpose of determining promotion status in grades 3, 5, and 8.
4/24/2020 94
Georgia Milestones
REVISED: SCRATCH PAPER ALLOWANCES
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Effective beginning with the Winter 2015 EOC Main Administration Applies to paper-pencil & online settings As in past years, paper-pencil students may still write in their test booklet (but no highlighters)
Scratch paper is considered SECURE once used!!!
• ELA (Allowed in all Sections 1, 2, and 3, both EOG and EOC) – One sheet • MATH (Allowed in both Sections, both EOG and EOC) – Two sheets • SCIENCE (Allowed in both Sections, both EOG and EOC Physical Science and Biology) – One sheet • SOCIAL STUDIES (Allowed in both Sections, both EOG and EOC US History and Economics) – One sheet 4/24/2020 95
Georgia Milestones
REVISED: ADMINISTRATION TIMES BY CONTENT AREA
Effective with the Winter 2015 EOC Main Administration
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
• • • • •
ELA, Sections 1 and 2
• Minimum = 60 • Maximum = 75 (Up from 70 minutes)
ELA, Section 3
• Minimum = 70 • Maximum = 90
Math, Sections 1 & 2
• Minimum = 60 • Maximum = 85 (Up from 80 minutes)
Science, Sections 1 & 2
• Minimum = 45 (Down from 50 minutes) • Maximum = 70
Social Studies, Sections 1 & 2
• Minimum = 45 (Down from 50 minutes) • Maximum = 70 4/24/2020 96
Revised
Administration
Georgia Milestones Administration Times
Effective beginning with the Winter 2015 EOC Main Content Area/Course
English Language Arts English Language Arts
Test Section(s)
1 and 2 3
Minimum Time Per Section(s)
60 70
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Maximum Time Per Section(s)
75 90 Mathematics Science Social Studies 1 and 2 1 and 2 1 and 2 60 45 45 85 70 70
Note:
These maximum time limits do not apply to those students who have the accommodation of extended time.
GEORGIA MILESTONES EOC COURSES 2015-2016
Changes from 2014-2015 appear in purple font
Course ID 23.06100
23.05100
23.05300
23.06120
23.06800
23.07300
26.01200
26.01400
26.01800
40.01100
45.08100
45.08200
45.08700
45.06100
45.06200
45.06300
45.06500
27.09710
27.09750
27.09720
27.09760
27.09900
27.09910
27.09940
27.09950
Course Name Ninth Grade Literature and Composition American Literature and Composition AP English Language and Composition IB English B, Year One IB English A Literature, Year One IB English A Language & Literature, Year One Biology I AP Biology IB Biology, Year One Physical Science United States History AP United States History IB History of the Americas, Year One Economics Business Free Enterprise AP Macroeconomics AP Microeconomics IB Economics, Year One Coordinate Algebra Accelerated Coordinate Algebra/Analytic Geometry A Analytic Geometry Accelerated Analytic Geometry B/Advanced Algebra
Algebra I Geometry Accelerated Algebra I/Geometry A Accelerated Geometry B/Algebra II
9 th
Georgia’s School Superintendent
Corresponding EOC Grade Literature
Richard Woods, gadoe.org
American Literature American Literature American Literature American Literature American Literature Biology Biology Biology Physical Science US History US History US History Economics Economics Economics Economics Coordinate Algebra Coordinate Algebra Analytic Geometry Analytic Geometry
Algebra I Geometry Algebra I Geometry
EOC Mid-Months: August – November 2015
Windows will be open as follows:
August 3 – 21, 2015 *
September 14 – 25, 2015 *
October 12 – 23, 2015
November 9 – 20, 2015 * Eligible students may attempt to “test-out” during these windows Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
• • •
Group 1: Students completing an EOC for a 2014-2015 Fall 2015 EOC Mid-Month course enrollment through the The provisions of the State Board’s 2014-2015 waiver of Rule 160-4-2-.13 (Statewide Passing
Score) continue to apply through November 2015 for this group of students. The EOC does NOT apply to the final course grade of students in this category. Local systems may determine the final course grade for these students by applying the same policies and procedures used during the 2014-2015 school year.
For example, a student who did not take a required EOC in Spring 2015, and who makes-up this EOC through the Fall 2015 Mid-Month, will not have the resulting EOC score apply as 20% of their final course grade.
The same holds true for a student who enrolled in a summer semester course (i.e., June or July 2015), but who still must complete their required EOC for that course via the Fall 2015 EOC Mid Month due to an absence during summer testing or because summer testing was not offered by their school district.
99
• • •
EOC Mid-Months: August – November 2015
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Group 2: Students completing an EOC for a 2015-2016 course enrollment through the Fall 2015 EOC Mid-Month Once Fall 2015 EOC Mid-Month test results begin to report, which we anticipate will be in late October 2015, the students described below are required to have the EOC applied to their final course grade/transcript.
Students who enroll, during the 2015-2016 school year, in a course that has an associated EOC.
• This includes students enrolling in compacted/short-term courses for Fall 2015 (such as 9-week courses that conclude in October 2015) and course recovery experiences that begin with the start of the 2015 2016 school year.
Students enrolling during the 2015-2016 school year from non-accredited private schools, home study programs, or other non-traditional educational centers and who are seeking to have credit from these experiences posted to their public school transcript.
• Once reporting begins for the Fall 2015 Mid-Month, school systems shall use the EOC results to make determinations relative to the awarding of course credit.
• Local systems will need to determine how to enact course placements for these students pending the receipt of Fall Mid-Month results. 100
EOC Mid-Months: August – November 2015
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Group 3: Eligible students seeking to demonstrate subject area competency (“test-out”) through the Fall 2015 EOC Mid-Month (August & September windows only)
• A student who attains the Achievement Level of Distinguished Learner will have successfully demonstrated subject area competency and shall be awarded credit for the course.
• Local systems will need to determine how to enact course placements pending the receipt of Fall Mid-Month results.
• Given that a variety of approaches to high school scheduling exist across the state, this is by necessity a local decision. • After September 2015, the next opportunity for “testing-out” will be during the March 2016 EOC Mid-Month administration.
• The Summer 2016 Main Administration can be used for this purpose as well.
101
EOC Mid-Months: August – November 2015
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Group 4: Students enrolled in courses requiring a mathematics EOC (i.e., Coordinate Algebra, Analytic Geometry, Algebra I, and Geometry) during the Fall Semester of 2015-2016, and who require an EOC at the end of their fall semester course, must adhere to the following:
• These students must test during the Winter 2015 EOC Administration; they should not test during the Fall 2015 Mid-Month.
• The Fall Mid-Month forms for Coordinate Algebra and Analytic Geometry are not appropriate for students enrolled in these courses in 2015-2016 due to changes resulting from the adoption of the Georgia Standards of Excellence (GSE). • For the new courses, Algebra I and Geometry, there will be newly developed EOCs that are available for the first time in Winter 2015.
• The Winter 2015 Administration will consist of GSE-aligned test forms for each of the four courses listed above; scores will be issued at that time.
102
EOC Mid-Months & Retests: January – March 2016
Windows will be open as follows:
January 19 – 29, 2016
February 15 – 26, 2016
March 7 – 18, 2016 * Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
• • •
* Eligible students may attempt to “test-out” during this window
•
Retest administrations resume with the Spring 2016 EOC Mid-Month Administration.
• As in previous years, retest administrations will occur within the confines of the Mid-Month Administration windows.
Retests will also be permitted during the Summer (2016) Main Administration.
Policy guidelines for EOC retest administrations appear in the 2015-2016 Student Assessment Handbook.
It is critical, and required, that retest administrations be coded as such in the “Purpose” field.
4/24/2020 103
•
EOC Mid-Months & Retests: January – March 2016
The administration of retests should adhere to the following parameters:
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
Original EOC administration that resulted in a non-proficient score: Retest opportunity completed no later than the: Fall Mid-Month Administration subsequent February Mid-Month Administration Winter Main Administration Spring Mid-Month Administration subsequent March Mid-Month Administration subsequent Summer Main or August Mid-Month Administration Spring Main Administration Summer Main Administration subsequent September Mid-Month Administration subsequent October Mid-Month Administration
• • Students are NOT be permitted to take the same EOC more than once during a given EOC Mid-Month or the Summer testing window.
•
For example, students cannot take the Biology EOC as their 20% final exam during a mid month, “fail” the Biology EOC, and then take the Biology EOC as a retest during the same mid-month administration. If this occurs, the second of the two administrations (the retest) must be invalidated. The same holds true for retests conducted in the Summer administration.
The March 2016 Mid-Month window may be used for “test-out” purposes. Code in “Purpose” field.
4/24/2020 104
•
Georgia Online Formative Assessment Resource (GOFAR)
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
GOFAR is Georgia’s new online platform for our various online formative assessment tools. It replaces the OAS which is no longer available.
• • • • • • GOFAR launched in November/December 2014 (running parallel to the OAS).
Access to GOFAR is provided by your local system . . . through the SLDS and your local System Information System (SIS).
Items in GOFAR include the previous OAS item bank and the formative/benchmark assessment items developed as part of Georgia’s Race to the Top work in recent years. The final sets of items are scheduled to load in August and/or September 2015.
GOFAR is “integrated” with the SLDS (meaning reports will populate in SLDS and there will no longer be a student upload process required).
Tests will NOT be purged each summer as was the case with OAS. Tests will remain in the system as long as they are used at least once every 18 months.
User documentation is available at: http://www.gadoe.org/Curriculum-Instruction-and Assessment/Assessment/Pages/Georgia-Online-Formative-Assessment-Resource.aspx
105
National Assessment of Educational Progress (NAEP)
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
• • • • • • • • Georgia systems/schools selected for this year’s (2016) NAEP sample have been notified.
The National Assessment of Educational Progress (NAEP) collects data about what students know and can do in a variety of subjects.
Participation in NAEP is required by federal and state law.
Schools and students are sampled by NCES to represent national and state demographics.
Assessment is administered by contracted team.
Scores are calculated and reported for states and selected districts only.
2015-2016 is a “national year” for NAEP.
Public release of 2015 NAEP (national & state level only) results is anticipated later this fall (October).
106
Thank you for joining us!
Richard Woods, Georgia’s School Superintendent
“Educating Georgia’s Future”
gadoe.org
107