Transcript Slide 1
UNDERSTANDING NRS DATA AND ACCOUNTABILITY Mark Baird, Ph.D. Director, Research and Evaluation Division of Career and Adult Education WHY IS THE NRS IMPORTANT? Statutory Requirement •Adult Education and Family Literacy Act •Workforce Investment Act Impacts future funding/incentive dollars •Basis for Florida receiving incentive dollars Can and should be used for program improvement OVERVIEW OF NRS REPORT Annual federal report used to evaluate statelevel adult education program effectiveness Uniform reporting system with common definitions and terminology across the nation • Established Educational Functioning Levels (EFLs) • Educational Gain became effectiveness measure • Tied performance to continued federal funding WHO COLLECTS THE DATA? All entities receiving federal funding for: •Adult Basic Education (ABE) •Adult High School (AHS) •Applied Academics for Adult Education (AAAE) •GED Prep •English for Speakers of Other Languages (ESOL, ESL) DATA COLLECTION It starts at the Local Level… •Intake staff and teachers should collect and record NRS measures such as •Age, Ethnicity, Race, Gender •Student’s core outcome goals •Teachers should collect and report Attendance or instructional hours Student progress (Pre and Post Testing) Updates in student goals Fill in missing information EDUCATIONAL FUNCTIONING LEVELS • Adult Basic Education (4 EFLs) • Beginning ABE Literacy • Beginning Basic Education • Low Intermediate Basic Education • High Intermediate Basic Education Grade Levels 0.0 – 1.9 2.0 – 3.9 4.0 – 5.9 6.0 – 8.9 • Adult Secondary Education (2 EFLs) • Low Adult Secondary Education 9.0 – 10.9 • High Adult Secondary Education 11.0 – 12.0 EDUCATIONAL FUNCTIONING LEVELS (CONTINUED) • English as a Second Language (6 EFLs) • Beginning ESL Literacy CASAS Scale 0 – 180 • Low Beginning ESL 181 – 190 • High Beginning ESL • Low Intermediate ESL 191 – 200 201 – 210 • High Intermediate ESL 211 - 220 • Advanced ESL 221 – 235 UNIQUE REPORTING REQUIREMENTS Students must be enrolled a minimum of 12 contact hours in the ‘program year’ to be NRS reportable Pre testing is required during first 12 hours. Educational gain is calculated from the lowest Educational Functioning Level (EFL) only Distance education courses must use on-site proctored assessments to be NRS reportable NRS CORE OUTCOME MEASURES Educational Gains (advance to next EFL in the program year) Entered Employment* Retained Employment* Placement in postsecondary education or training Receipt of a secondary school diploma or GED NRS DESCRIPTIVE MEASURES Demographics •Status and Goals • Labor force status •Race/Ethnicity • Public Assistance •Gender status •Age • Rural residence • Disability Status HOW IS DATA USED TO SET PERFORMANCE MEASURES NRS Table 4 data are used to establish state targets and identify previous performance levels. State Targets are negotiated yearly with the US DOE based on performance indicated by Table 4. Florida’s student outcomes are compared with national averages to evaluate effectiveness. The negotiated Targets become Florida Performance standards for the next grant cycle. Grant recipients use these benchmarks to set their goals in their application to be used to improve student outcomes. FOUR DATA SYSTEMS OF ADULT ED. Workforce Data Information System (WDIS) Community College Student Database (CCSDB) Community Based Organization (CBO) web based system Florida Education & Training Placement Information Program (FETPIP) HOW ARE NRS TABLES BUILT? FLDOE compiles state data from all delivery systems annually and sends it to USDOE by Dec 31st in the following tables • Table 1 – Participants by Entering EFL, Ethnicity, Sex • Table 2 – Participants by Age, Ethnicity, and Sex • Table 3 – Participants by Program Type and Age • Table 4 – Educational Gains/Attendance by EFL Table 4b – Ed. Gains/Attend for Pre- and Post-tested Table 4c – Ed. Gains/Attend for Distance Education* • Table 5 – Core Follow-up Outcome Achievement • Table 5a – Core Follow-up Outcomes for Distance Education • Table 6 – Participant Status and Program Enrollment • Table 7 – Personnel by Function and Job Status POST TESTING Use same instrument for pretest and post-test – Record data even if student did not pass Post testing rates show up in Table 4B NRS GAIN METRICS Grade Levels, Functioning Levels Program Area 6-8.9 ABE inter. high 9-10.9 EFL from high school courses EFL from GED Subtest EFL from GED Diploma EFL from H.S. Diploma NO YES YES YES ASE low/ GED prep YES (12 credit min.) YES YES YES 11-12 ASE high/ GED prep NO NO YES YES 6-8.9 Pre-GED prep (LOW) 9900120 NO YES YES YES 9-10 Gen Ed YES (12 credit min.) NO YES YES 11-12 Gen Ed NO NO YES YES promotion Low (AHS) 9900010 promotion High (AHS) 9900010 CONTACT AND WEB INFORMATION Program NRS Contact • Craig Winger, (850)245-0720 • [email protected] Florida NRS Web Site: http://www.fldoe.org/arm/cctcmis/pubs/nrs/nrs.asp USDOE NRS Web Site: http://www.nrsweb.org