Transcript Using the VFA & its Data

Using the VFA and its Data
VFA Overview
Need
The Voluntary Framework of Accountability
is the first national system of accountability
SPECIFICALLY
for community colleges
by community colleges.
Action
Reporting VFA
Six Year Cohort
Two Year Cohort
Main
Developmental
Education Progress
Measures
Cohorts
Two-Year Progress
Measures
Credential Seeking
First Time
In College
Six-Year Outcomes
Measures
Measures
CTE Cohort
Career & Technical
Education Measures
ABE Cohort
Adult Basic Education
Measures
Objectives for the VFA
• Value-added metrics for accountability (using data to
measure performance and make better decisions)
• National benchmarking for good practices
Meaningful
• Opportunity to streamline reporting / relieve IR
capacity
• Ability to tell a better, more robust story
• Better data to inform public policy and advocacy
Utility
Use Cases for VFA Data
• Internal assessment
• conversations with staff and faculty
• Identify areas for improvement
• Strategic planning
Meaningful
• Benchmarking
• Identify areas of relative weakness
• Identify areas of relative strength
• institutional assessment and planning
• Demonstration of using the tool to explore data
• State system
• Value of state-wide participation
• At the college level
• At the state level
Utility
VFA Dashboard: SPO, Developmental Education Progress Measures
% REFERRED & ATTEMPTED DEV:
• Math: 79.1%
• Reading: 11.0%
• Writing: 73.0%
% REFERRED & COMPLETED HIGHEST DEV:
• Math: 35.2%
• Reading: 4.0%
• Writing: 44.1%
% REFERRED & COMPLETED COLLEGE:
• Math: 22.8%
• Reading: 47.2%
• Writing: 40.1%
In Oxnard’s Words
• Accountability will continue to increase at District/College, State,
Federal and Accreditation levels
Meaningful
• Need to train administrators, faculty and staff on use of data and
information-based decision-making (CQI)
• Proper documentation is absolutely necessary
(transparency/communication)
• Understanding “Leading Indicators” as precursors to “Completion”
• Invest in research capacity
• Move towards analysis of data to get to equity determination –
academic achievement gaps between ethnic and gender groups
Utility
VFA Dashboard: Six-Year Outcomes
Use-case Examples
•
OCCC
•
Incorporating VFA into all
responses for accountability
•
Benchmarking parameters
•
Setting developmental
education goals
VFA at OCCC
• OCCC began participating with the pilot in 2011.
• OCCC completed first year of data collection last
June. OCCC used a collection of linked
spreadsheets to calculate all the required fields.
• OCCC participated in the raw data input pilot for
second year. Raw data input greatly reduced
workload and increased confidence in output.
• Year two data under review; examples used here
are year one.
2
Value of VFA to OCCC
• Very detailed and comprehensive data definitions.
• Because data is comparable, it can be used for
benchmarking. OCCC can construct comparison
cohort based on size, urbanicity, diversity, and
other factors known to influence completion.
• Definition of cohorts and metrics calculated are
more useful and relevant for community colleges
than the one-size-fits-all of IPEDS.
3
Six Year Outcomes*
0.5
Progressing and/or awarded
a certificate or degree.
0.45
45.1%
Not Progressing.
45.1%
0.4
0.35
0.3
26.4%
0.25
0.2
15.5%
14.3%
0.15
10.4%
0.1
0.05
9.7%
7.9%
5.1%
4.2%
3.8%
5.2%
5.9%
0.3%
0
Associates
without
Transfer
14
Certificate
without
Transfer
Still Enrolled
OCCC
Associates
with Transfer
No Award
Transfer
Comparison Group
Left <30
credits
Left 30>
credits
Uses of VFA data under
consideration…
15
1.
Finalize update of second year data which includes two-year
developmental.
2.
Consider using 6 year outcomes in an appendix of the
Student Success Monitoring Report.
3.
After two year data is added, review developmental success
and time to complete sequence again (if existing pattern
holds we may have an opportunity for improvement).
2.
Consider setting targets either this Spring or next Spring in
the Annual Plan for selected measures (Fall to Spring
Persistence is a prime candidate).
Using the tool
How are we
doing?
In order to improve we need data,
but data should lead to more
questions than answers
Where do we
need to
improve?
Engagement
Alignment
The Voluntary Framework of Accountability
is an institutional framework;
HOWEVER…
The power is in sector-wide
and national implementation
Burden
Reduction
VFA Dashboard: Six-Year Outcomes
Use-case Examples
•
Community Colleges in Michigan and the MCCA
•
On-campus uses and benefits
•
State-wide uses and benefits
Meaningful
Utility
IPEDS Student Right to Know Graduation/transfer rates
compared to VFA rates
80.0%
70.0%
60.0%
50.0%
40.0%
30.0%
20.0%
10.0%
0.0%
State 1
College A
College B
College C
VFA Main - Completed/transferred
VFA Credential Seeking - Completed/transferred
VFA FTIC - Completed/transferred
SRK FTFT Completed/transferred
Tough Conversations
Career Technical
Education
The Voluntary Framework of Accountability
is about better measures;
HOWEVER…
Tough conversations about how and what to
measure are happening
Adult Basic
Education
Voluntary Framework of Accountability
 We welcome Questions & Feedback
 Contact VFA at [email protected]
Website:
http://VFA.AACC.NCHE.EDU
Y2 , Y3, Y4…
principle
accountability
system