Transcript Common Measures for the Workforce Investment Act (WIA) An equal opportunity employer/program.

Common Measures for the
Workforce Investment Act (WIA)
An equal opportunity employer/program. Auxiliary aids and services are available upon request to
individuals with disabilities. All voice telephone numbers on this document may be reached by
persons using TTY/TDD equipment via the Florida Relay Service at 711.
• An equal opportunity employer/program.
Auxiliary aids and services are available
upon request to individuals with
disabilities. All voice telephone numbers
on this document may be reached by
persons using TTY/TDD equipment via the
Florida Relay Service at 711.
Workforce Summit 2005
2
Common Measures
3
Establishing Common Measures
• President’s Management Agenda
• Affects six agencies (29 programs)
–
–
–
–
–
–
Department of Labor
Department of Education
Department of Health and Human Svcs.
Department of Veterans Affairs
Department of the Interior
Department of Housing and Urban Development
• TEGL 17-05 issued on February 17, 2006
– Rescinds TEGLs 28-04 and 15-03
– Policy applies to DOL funded programs only
– July 1, 2005, implementation for W-P, VETS and
WIA; October 1, 2005, implementation
for TAA
4
Benefits of Common Measures
• Focus on the core purposes of the workforce
system; employment for adults and skill gain for
youth
• Break down barriers to integration resulting
from different definitions, data and reports for
each workforce program
• Resolve questions raised by GAO and other
oversight agencies regarding the consistency
and reliability of data
• Reduce confusion among our customers and
stakeholders who want to know about results
5
The Common Measures
• Adult measures: (Adults and DWs)
–
–
–
–
Entered employment
Employment retention
Earnings increase (PY 05)
Average Earnings (PY 06)
• Youth and lifelong learning measures: (Ages 14-21)
– Placement in employment or education
– Attainment of a degree or certificate
– Literacy or numeracy gains
6
The Common Measures and Revised
Reporting Requirements for
WIA Programs
7
Roll-Out of Common Measures
• Common measure outcomes will be collected
through revised reports
• Common measure definitions replace existing
program-specific performance measure
definitions where possible
• Efficiency measures to be computed at Federal
level only
8
WIA Adult Program Measures
Roll-Out of Common Measures
WIA Adult Core
Performance Measures
Entered employment
rate
Employment
retention rate at six
months
Earnings gain
Adult Common
Performance Measures
Adult entered
employment rate
Adult employment
retention rate
Adult earnings increase (PY 05)
Adult average earnings (PY 06)
Employment and
credential rate
Note: Regions have negotiated performance
goals for entered employment, retention,
earnings gain & credential for PY05 and PY06.
9
WIA Dislocated Worker Program Measures
Roll-Out of Common Measures
WIA Dislocated Worker
Performance Measures
Entered employment
rate
Employment
retention rate at six
months
Earnings replacement
Employment and
credential rate
Adult Common
Performance Measures
Adult entered
employment rate
Adult employment
retention rate
Adult earnings increase (PY 05)
Adult average earnings (PY 06)
Note: Regions have negotiated performance
goals for entered employment, retention,
earnings gain and credential measures for
PY05 and PY06.
10
WIA Youth Program Measures
Roll-Out of Common Measures
Youth Common Performance Measures
States have negotiated performance goals for WIA programs
according to Federal measures for PY 2005 and PY 2006
Older Youth
Entered employment
Employment retention
Earnings change
Employment and credential rate
Younger Youth
Skill attainment rate
Diploma attainment rate
Retention rate
11
WIA Youth Program Measures
Roll-Out of Common Measures
Youth Common Performance Measures
• Placement in employment or education/ advanced
training (PY05)
• Attainment of a degree or certificate (PY05)
• Literacy and Numeracy gains (PY06)
As of 06/15/2006 there has been no negotiated performance goals for
the youth common measures.
12
Key Concepts
13
Program Participation
• A participant is a person who is
determined eligible to participate in a
program and receives a service
funded by the program in a physical
location
• The date of participation is the date of the first
service after eligibility determination
• Individuals who receive services that are
accessed by virtual means outside of the
program’s facility need not, but may, be treated
as participants
14
Program Participation
• Generally, all participants will be taken into
account when computing performance outcomes
under the common measures
• Two types of participants may be excluded from
the performance calculations:
• Participants who do not voluntarily disclose valid
Social Security numbers
• Participants who are excluded from the
calculations by law (death, health/medical,
institutionalized, etc.)
15
Minimum Data Needed from SelfService Participants
• At a minimum, data needed from self-service
participants:
 social security number (SSN)
 employment status at the point of
participation.
• Upon request of a customer’s SSN, the
customer must also be offered the opportunity to
provide Equal Employment/demographic
information.
16
Program Exit
 Exit (for reporting purposes) occurs when . . .
• Participant does not receive a service or partner
service for 90 consecutive calendar days;
• Participant has no planned gap in service; and
• Participant is not scheduled for future services
 Date of exit is applied retroactively to the last day
of service funded by the program or partner
program
 The State has the capability to track partner
services in order to extend the date of exit
17
Program Exit
• Days included in any planned gap in
services do not count when
determining the exit date
– Delay before the beginning of training
– Health condition or providing care for
a family member with a health condition
– Temporary move from the area
– All gaps in service must be documented
18
Exclusions from Performance
• Exclusions from all common measures:
– Persons institutionalized (exceptions
are detained Responsible Reintegration of
Youthful Offenders and disabled
individuals residing in institutions)
– Persons unable to continue due to
health/medical or family care reasons
– Deceased
– Reservists called to active duty
– Relocated to a mandated residential program (youth
only)
• To be excluded from performance calculations, the event
must be expected to last 90 days or more
19
Calculating Outcomes
Adult Measures
20
Adult Entered Employment
Of those not employed at participation:
Number employed in quarter after exit
Number of exiters
Computing
• Employment at participation is based on
Outcomes
information from the individual -- not wage
records
• Exclude adults employed at the time
of participation
• Include adults employed at the time of
participation who are on layoff notice
• Supplemental data will not be used in Florida
• Wage records only will be used to determine
employment in the quarter after exit
21
Adult Entered Employment
Employed at participation?
YES
Excluded
NO
Employed in quarter after exit?
NO
YES
Numerator
Denominator
22
Adult Employment Retention
Of those employed in the quarter after exit:
Number employed in both the 2nd and
3rd quarters after exit
Number of exiters
Computing
Outcomes
• Based on those employed in quarter after exit
• Employment in the 1st, 2nd and 3rd quarters after exit does
not have to be with the same employer
• Must be employed in both the 2nd and 3rd quarters after
exit to count as retained
• Only UI Wage records will be used
• Supplemental data will not be used in Florida
23
Adult Employment Retention
Employed in quarter after exit?
NO
Excluded
YES
Employed in 2nd and 3rd qtr.
after exit?
NO
YES
Numerator
Denominator
24
Adult Earnings Increase
Of those employed in the quarter after exit:
Earnings in 2nd
and 3rd quarter
after exit
-
Earnings in 2nd and
3rd quarter prior to
participation
Number exiters
Computing
Outcomes
• For program year 05-06 only
• Only wage records may be used for determining
pre-program and post-program earnings
• Includes same population as the adult retention measure
• Likely to be negative for dislocated workers
25
Adult Earnings Increase
Employed in qtr. after exit?
YES
NO
Excluded
Included
26
Adult Average Earnings
Of those employed in the first, second, and
third quarters after exit:
Total earnings in the 2nd quarter plus total
earnings in the 3rd quarter after exit
Number exiters
Computing
Outcomes
• Effective July 1, 2006
• Only wage records may be used for determining
average earnings
• Includes same population as the adult retention measure
27
Adult Average Earnings
Employed in qtr. after exit?
NO
Excluded
YES
Employed in 2nd qtr. after exit?
NO
YES
Employed in 3rd qtr. after exit?
NO
YES
Included
28
Calculating Outcomes
Youth Measures
29
Youth Measures Requirements
• Reporting for Program Year ending June 2006:
– 7 current WIA youth measures (4 OY and 3 YY) –
negotiate on these for accountability
– First 2 youth common measures (placement and
certificate)
– Lit/Num common measure required for new youth
enrolled beginning July 1, 2006
– No negotiation on Lit/Num measure in PY 05
30
Youth Common Measures
• Placement in Employment, Education, or Training
• Attainment of a Degree/Certificate
• Literacy/Numeracy Gains
Note: Youth Common Measures include all youth,
no longer a distinction between younger/older
youth
31
Placement In Employment or
Education
Of those who are not in post-secondary
education, employment, or the military at
participation:
Number of youth in employment, military
service, enrolled in post-secondary
education, advanced training, or
occupational skills training in the quarter
after exit
Computing
Outcomes
Number of exiters
32
Youth and Lifelong Learning
Placement In Employment or
Education
• Excludes youth in employment, military service,
or post-secondary education at participation
• Includes youth in secondary education at exit
• Employment, military and education status at
participation are based on information from the
youth
33
Youth and Lifelong Learning
Placement in Employment or
Education
• Employment and military service in the 1st
quarter after exit is based on UI wage data
• Includes first quarter after exit only
• Currently no common measures for
retention or earnings change
34
Youth and Lifelong Learning
Placement in Employment or
Education
In post-secondary education,
employment, or the military at
participation?
YES
Excluded
NO
Did the qualifying outcome
occur in the 1st quarter
after exit?
YES
Numerator
Denominator
35
Attainment of Degree or Certificate
Of those enrolled in education at
participation or any time during the
program:
Number attaining a diploma, GED or
certificate by the end of the 3rd
quarter after exit
Number of exiters
Computing
Outcomes
36
Youth and Lifelong Learning
Attainment of Degree or Certificate
• Education refers to secondary school,
post-secondary school, adult education,
or any organized program of study approved by
the Florida Department of Education
• Includes youth in secondary school at exit
• Outcome can be attained during participation
• Diploma is any credential the Florida Department
of Education accepts as equivalent to a high
school diploma
37
Youth and Lifelong Learning
Attainment of Degree or Certificate
• Defining “certificate”…
– awarded in recognition of an attainment of
measurable technical or occupational skills
necessary to gain employment or advance within
an occupation.
– Technical or occupational skills are based on
standards developed or endorsed by employers.
– Recognition of generic pre-employment and/or
work readiness skills are not considered
certificates.
• Definition applies only to youth attainment of
degree or certificate common measure
Computing
Outcomes
38
Definition of Certificate (cont.)
• Awarding Institutions include:
A State educational agency
– Institution of higher education
– Professional, industry or employer organization or a
product manufacturer
– Registered apprenticeship program
– Public regulatory agency
– A program approved by the Dept of Veterans Affairs
– Office of Job Corps
– Indian Tribe Higher Education Institution
–
39
Youth And Lifelong Learning
Attainment of Degree or Certificate
Enrolled in education at
participation or any time
during the program?
NO
Excluded
YES
Numerator
YES
Attained diploma, GED or
certificate by the end
of the 3rd quarter after exit?
Denominator
40
Youth and Lifelong Learning
Literacy or Numeracy Gains
Of those out-of-school youth who are basic skills deficient:
Number who increase one or more
educational functioning levels
Number who
completed a year
of participation
+
Number who exit
before completing a
year of participation
Computing
Outcomes
41
Youth and Lifelong Learning
Literacy or Numeracy Gains
• Excludes youth who are not basic skills
deficient
• Excludes youth who are in-school
• Includes individuals with learning disabilities
• To be in the numerator, an individual must
advance one or more Adult Basic Education
(ABE) or English as a Second Language
(ESL) functioning levels
42
Youth and Lifelong Learning
Literacy or Numeracy Gains
Tests cross-walked with ABE and ESL
levels include:
– Comprehensive Adult Student Assessment
Instrument (CASAS)
– Test of Adult Basic Education (TABE)
– Adult Basic Learning Examination (ABLE)
– Student Performance Levels for ESL
– Basic English Skills Test (BEST) for ESL
– WorkKeys (for the top 3 ABE levels)
43
Youth and Lifelong Learning
Literacy or Numeracy Gains
• Individuals should be pre-tested within 60 days of the
participation date or obtain a pre-test completed by a
partner agency within 6 months of the participation date
may be used
• Requires the use of the same standardized test for both
pre and post assessments
• Individuals with disabilities should be accommodated
according to guidelines associated with the assessment
tool and state law or policies
• Individuals should be post-tested by the end of one year of
participation and compared to pre-test results obtained
during the initial assessment
44
Youth and Lifelong Learning
Literacy or Numeracy Gains
• If a youth continues to be basic
skills deficient after the first 12 months
of participation, then s/he should
continue to receive training in literacy
and/or numeracy skills until they become
basic skills sufficient
• Participants should be post-tested and
included in the measure at the
completion of the 2nd year
• Only included in measure a second time if
they complete a full 2nd year in program
Computing
Outcomes
45
If you have questions:
Antonio L. Carter
Senior Management Analyst Supervisor
One-Stop & Program Support
Department of Economic Opportunity
(850)245-7406
[email protected]
46
The End
47