Transcript COPPER PATINA

OAKS Online
Test Delivery System
2011-2012
Test Delivery System
Objectives
• Familiarize users with new
enhancements to the OAKS
Online Test Delivery System and
processes related to online
testing.
• Identify resources to help users
familiarize themselves with use of
the Test Delivery System
Test Delivery System
OAKS Portal
• www.oaks.k12.or.us
• Dedicated to OAKS Online, ELPA , and the
Writing Assessment
• Provides ODE, ESD, district, and school staff
with access to the following applications:
– Test Information Distribution Engine (TIDE)
– OAKS Online Reporting System
– Test Delivery System (TDS) - TA Interface (Test
Administration)
– Test Delivery System (TDS) - Student Interface
– TA Training Site
– Student Practice Test
– News and important updates relating to OAKS Online,
the ELPA, and the Writing Assessment
– Download of Secure Browsers 5.0 (installation
instructions and FAQs)
Test Delivery System
Common Login System (CLS)
• Centralized login to access multiple OAKS systems
– Via OAKS portal
– User has access to all systems (depending on
security)
TA Interface
TIDE
Online Reporting System
TA Training Site
– Easily navigate between OAKS systems
– Administer OAKS Online, ELPA, and Online
Writing tests
Test Delivery System
Overview of Test Delivery System
• TA Interface
– Used to administer online tests , track progress,
and manage students testing in their session
– Ability to adjust test settings (including
accommodations/modifications) for individual
students before they are approved to start the test
– TAs use this interface to approve and submit print
requests from students
• Student Interface
– Secure online test that must be accessed via a
secure browser. The OAKS Portal
(www.oaks.k12.or.us) contains details on installing
the necessary software.
Note: Some images in this presentation are preliminary; actual cosmetic look is not final.
Test Delivery System
New Features for 2011-2012
• TA Interface Enhancements
– Mobile device support for TA Interface
– Session Handoff feature allows TAs to switch machines
while administering tests without interruption to their
test session
– Now displays the duration that a student’s test has been
paused (in a test session)
• Student Interface
– Only one opportunity available between 11/8/2011 and
1/10/2012
– New Braille Interface for students who use Braille for
Reading, Math, Science, and Social Sciences
– New computer-based read-aloud feature for Math,
Science, and Social Sciences
– Additional levels of enlarged print
– More calculator features for Math, Science, and Social
Sciences tests
Note: Some images in this presentation are preliminary; actual cosmetic look is not final.
Test Delivery System
TA Interface at A Glance
• Simplified workflow reduces the need to navigate multiple pages to
create/edit sessions and approve students.
• All information is visible on one screen
• Tests in session
• Students needing approval to start testing
• Students with tests in progress
• Print requests
Test Delivery System
TA Interface (cont’d)
• Create / Edit Sessions
– The list of available tests
automatically displays upon logging
in and can remain on screen while
monitoring students
– Simply select the tests for the session
and click [Start Session]
What does this mean for test administration?
– Test sessions automatically expire upon TA logout
• Create one test session for students testing during a specific time
• Sessions cannot be resumed (A new Session ID is generated for
each session)
• Students may resume a paused test in any new test session that
includes the applicable test subject and grade.
• Example: TA creates a test session for students on Tuesday. To resume
testing on Wednesday, the TA will create another test session for
students to resume testing.
TA Interface (cont’d)
Oaks Online
• Student Test Settings and
Approvals
– Approvals Preview (right) allows
TAs to see students that need to be
approved while monitoring test
progress
– The complete list of students awaiting
approval will display on a pop-up
screen
Oaks Online
TA Interface (cont’d)
• Student Test Settings and Approvals
– Adjust test settings for an individual student
Test Delivery System
Student Test Settings
 Language
• A student’s test language is configurable by test
subject via TIDE (but can also be adjusted in
TA Interface for that specific test opportunity)
• Mathematics, Science, Social Sciences, and
Writing (all grades) can be administered in
English-Spanish side-by-side
• For Grade 3, Reading can be administered in
Spanish only as a native-language assessment
(this is not an English-Spanish side-by-side test)
• New for 2011-12: a new Braille interface is
accessible for students who use Braille by
selecting “Braille” from the language menu
• Print Size – now available in 4 levels of zoom
Test Delivery System
Student Test Settings (Cont’d)
 Color Choice
• The Student Interface can be set to
present the test background with
different options
• Text and background color
combinations are pre-defined for a
colored overlay over test content
Test Delivery System
Student Test Settings (Cont’d)
 Print on Request
• Printed reading passages remains an
allowable resource for all students.
For reading, “stimuli” is the default
setting for all students
• Printed items in all subjects and stimuli
in Science and Social Sciences are
available as a restricted resource for
individual students only
• Only DTSA or DSA-level users can
pre-set this restricted resource (via
TIDE)
• All print requests (for items or reading
passages) must still be approved by the
TA in the TA Interface
Test Delivery System
Student Test Settings (Cont’d)
 Text-to-Speech
• Computer-based read-aloud accommodation available
for OAKS Math, Science, and Social Sciences
• Recommended for use with Windows 7 or Mac 10.6 for
optimal results
• Spanish read-aloud supported for Spanish-English sideby-side tests—to use, districts must purchase and install
Spanish voice pack (for optimal results, ODE and AIR
recommend the Marta voice pack from Cepstral for
Windows users and the Rosa voice pack from Infovox
for Mac users)
• Headsets
• USB headsets
• Ensure sound works with headsets on each
computer prior to testing. The student login screen
contains a diagnostic tool to verify that audio is
working within the secure browser. The student
will also be prompted with a sound-check as part of
the approval process.
Test Delivery System
Student Test Settings (Cont’d)
 Braille
If “Braille” is selected for a
student’s test (via Language
drop-down), settings for Emboss
Request Type and Braille Type are
automatically displayed.
Test Delivery System
Student Interface at A Glance
Test Delivery System
Dos and Don’ts
Dos
• Do use the TA Training Site and Practice
Tests to become familiar with both the
TA and Student Interfaces before testing
begins
• Do review the 2011-12 OAKS Online TA
User Guide for descriptions of all
features of the TA and Student Interfaces
• Do carefully review student settings for
students before approving them to test
Test Delivery System
Dos and Don’ts (cont’d)
Don’ts
• OAKS Online users must not share their
login information and passwords, even with
other authorized users.
• Do not use last year’s OAKS Secure Browser.
Old secure browsers should be uninstalled
before installing the new secure browsers.
• Do not approve students to test until you
are sure the students are taking the correct
test at the right time.
• Do not approve a student to take the ELPA
unless his or her LEP flag is set to “yes.”
• Do not let tests linger, they will expire after
45 calendar days.
Test Information
Distribution Engine
(TIDE)
TIDE
Overview
Definition: Test Information
Distribution Engine
• Available through the OAKS Portal
(http:www.oaks.k12.or.us)
Purpose:
• To provide ODE, ESD, district, and
school staff with access to:
– User Information
•
Add new users or modify existing accounts
– Student Information
•
•
View student information in read-only mode
Search for students
– Student Settings
•
View/Edit student test settings for a student
– Student Restrictions
•
•
View/Edit or Add restrictions for a student
Upload restrictions for a batch of students
TIDE
What’s the Same?
• User Roles and Access – OAKS users (DSA
and lower) are associated with a district
and/or institution(s). Current roles are (in
order of hierarchy): State, DSA, DTSA, STC,
TA, and TT.
• System Requirements around Browsers
and Operating Systems
• Add/Modify Users – TIDE allows the
following: view/edit users, upload users,
add users.
TIDE
New for 2011-12
• Accommodation Codes are now separated
by Subject
• More efficient search tool (for Users and
Students)
• Student Details now have a “Braille” option
for students taking OAKS Online using the
Braille Interface
• Suppress Score Feature: Allows user to
change a student’s settings so they do not
see their score when they finish an OAKS
Online test
TIDE
TIDE: Student Information
– Student search is combined with the Student
Information tab
– Users can now choose to search for a group of students
(such as by grade and/or school) or for an individual
student (such as by first name, last name, or SSID).
Once the search is complete a student table is
generated.
TIDE
TIDE: Student Settings
• Users can view but not edit the
student’s personal information.
• Users can update all test settings
and select other accommodations
on this page.
TIDE
TIDE: Student Restrictions
• Here users can view and edit test restrictions for
students within a district and/or institution. Test
restrictions prevent students from testing in a specified
subject.
• Please note that if a student transfers schools or district,
his or her test restriction settings will not change or be
reset.
TIDE
TIDE: View/Edit Restrictions
• Select the district and/or institution from the list(s) and
click [Search]. To narrow the search, one can select an
enrolled grade, or enter a student's SSID, first or last name.
• Each row displays information for students, including test
settings and accommodations. Each row also contains an
[Edit] button.
TIDE
TIDE: Upload Restrictions
• TIDE accepts uploads of student test restriction
information in CSV (ASCII) format. CSV files can be
opened/edited using spreadsheet applications such as
Microsoft Excel or a notepad application.
TIDE
Do’s and Don’ts
Do’s
• Use student restrictions function to manage
student access to specific assessments in
OAKS Online.
• Use student test settings to assign system
features and restricted resources to students
by test subject (e.g., language, zoom, printon-request).
TIDE
Promising Practices
•The district uses the Student Restriction function to
restrict students who are designated to take OAKS
Extended from accessing the Online test.
•The district applies student test settings for students by
test subject to ensure that students have appropriate
access to OAKS Online. For students with IEPs or 504
Plans, the district consults the student’s plan before
applying test settings to ensure compliance with the
student’s plan.
Online Reporting
System
Overview
Definition: Performance Reports
• Available through the OAKS Portal
(http://www.oaks.k12.or.us)
Purpose:
• To allow districts and school staff and teachers to
identify strengths and weaknesses and improve
teaching and learning by providing:
–
–
–
–
–
–
–
–
Aggregate performance data for their district or school
Aggregate performance data for teachers or classes
Scores for individual students in their district or school
The ability to print student reports to distribute to
families
The ability to view performance trends
The ability to create and view reports for custom
rosters
Aggregate and student level performance data on
strands
Aggregate level performance data on content
standards
New Features for 2011-2012
•
Test Management Center (Replaces the old
Participation Reports): view summary statistics,
manage student participation and identify school
testing windows
•
Download Roster/Data Dump: extract student
information from any page in the reporting system
•
Student Listing Report: Now includes a “Breakdown by”
feature that allows users to view a list of individual
students by subgroup (e.g. males).
•
Student Search:
• Search for students by SSID, Name, and other
information
• Directly access students’ score reports
New Features for 2011-2012
(con’t)
•
High School tests: New aggregation rule
• Now calculates aggregated data like average and
percent proficient by using all of the scores that 11th
graders have earned over the past three years. This
means that the reports will show more accurate
proficiency rates, even if the 11th grade students
demonstrated proficiency in their 9th or 10th grade
year.
• The student listing page for the high school reports
will also include a Test Date column so that users
can sort out scores from different administrations.
Other Changes to Reports
•
Student transfers: New rule for access to student data
after student transfers to new district. Beginning this
year, data access will transfer with a student.
•
New Science Content Standards and Reporting
Categories
•
New Science Achievement Standards (pending Board
adoption in October 2011)
•
New Reading Achievement Standards
•
New ELPA Reporting Categories
•
“Breakdown By” filter now separates “Asian” and
“Pacific Islander” students
Performance Reports:
Subject Performance
District users can see performance data for the district and its
schools; school users see data for a school and each teacher;
etc.
The distribution of students across performance levels is
displayed graphically to allow easier comparison between
groups
Users can view the data for subgroups by choosing an option
from the “Breakdown By” dropdown
Performance Reports: Navigation
Users can explore the data in various ways to answer questions they
have of the performance reports and identify strengths and
weaknesses
The
icon indicates that data can be further explored
When users click the
icon, they see a control panel that will let
them select whether they want to see more or less group detail, more
or less content detail, or if they want to see a trend for a particular
piece of data
Performance Reports: Navigation
(cont’d)
By choosing more or less group detail, users can see data for
schools, individual personnel, classes, or individual students.
The buttons on the control panel will update to identify the data
the user is accessing.
This will help users answer “who” questions. For example: Who is
struggling in algebra?
Performance Reports: Navigation
(cont’d)
By choosing “Trend” or “Current” users can choose whether they
want information on the current year performance of a student,
group of students, school, or district or if they want a historical
trend of that performance.
This will help users answer “When” questions. For example, Has
this group of students struggled in mathematics in the past?
Performance Reports:
Data and Tools
Users can access these data and tools:
• Longitudinal Reports
• Rosters of students with scores
• Ability to create custom rosters
• Ability to view all aggregated data for custom
rosters
• Printable family-friendly student reports
• Ability to print and export pages
• Ability to print and export student responses
to Writing Performance Assessment (for
individual students or groups of students)
Performance Reports:
Student Report
The Performance Reports provides the familyfriendly student report and other data and
tools.
Test Management Center Features
• Replacing old Participation Reports
• Participation Reports are now in the “Plan and
Manage Testing” section of the Test Management
Center, and is very similar to the filters used in the old
Participation Reports
Test Management Center Features
• Summary Statistics
• View statistics on how many students have tested at each
opportunity
• 00
Test Management Center Features
(cont’d)
• Set a Schedule of Testing Windows (via Summary
Statistics)
• Set a schedule of testing
windows to organize when
students will test
• Available to TT, TA, STC,
and DTSA Users through the
Summary Statistics page
Retrieving Student Results /
Download Roster
• New feature allows users to download student results for a
selected group (by School, District, Teacher, or Roster)
• The system creates a data file of all students’ scores from the
reported administration (based on your request)
• This file appears in your Online Reporting “Inbox”
• Data file is designed to be read in spreadsheet programs
(Excel) and statistical software packages
Student Listing Report
• Two new features that allow users to view
subcategories for individual students and choose
which columns you would like to view.
• “Breakdown By” filter: Breakdown student listing into
chosen category (gender, ethnicity, special education, etc…)
• Show/Hide columns: Select what columns you would like to
show and hide (available on every table in Online
Reporting)
Student Search
• Allows users to look up information for any
student that exists in the Online Reporting System
(based on your user role access)
• Enter either the student’s SSID OR the first or last name
of a student
• The student results will show a list of students that
matched your search (for name based searches)
High School Banked Scores
• Reporting OAKS High School Scores
• High school students can have scores from grades 9, 10,
or 11
• Aggregated scores for High School students now based on
all of the grade 11 students’ scores from the past three
years.
• Ex: If a grade 11 student demonstrated proficiency
while in 9th grade, that is reflected in the current
aggregated reports
• Aggregated data corresponds to that administration’s grade
11 students only
• Grade 9 and 10 students who take the High School
tests will appear in individual student rosters.
However, comparison scores for data purposes
incorporate only grade 11 students.
New Rules for Transfer Students
Data for students no longer enrolled in your school:
• Scores travel with students transferring between Oregon schools
• If a student transfers to a school, his or her scores are now associated
with the new school in the Online Reporting System
• If a student leaves a school, his or her scores are no longer associated
with the originating/previous school in the Online Reporting System
• Scores do not travel with students who transfer or move to a
non-Oregon school
• If a student transfers from an Oregon public or charter school to a
private or parochial school that does not conduct OAKS testing, the
student’s scores remain with your school.
• If the student moves to another state, his or her scores remain with your
school.
• Scores do not travel with students who drop out or otherwise
leave Oregon public/charter schools entirely
• This does not change how AYP is calculated for schools
Do’s and Don’ts
Do’s
• Use the enhanced help features to learn
about the new online reporting system and
how to make best use of it
• Use data from the Performance Reports
along with other information on student
ability to identify areas of need and
provided targeted instruction
• Create custom rosters to track the progress
of particular groups of students
– Students in an intervention program
• Use the data after checking your
assumptions
Do’s and Don’ts (cont’d)
Don’ts
• Online Reporting users must not share
their log-in information and
passwords, even with other
authorized Performance users –
Student Score Data is Confidential
Promising Practices
• Creating
custom rosters to track
the progress of a group of
students in a particular program
• Using trend reports to examine
student data over time