Transcript Building a Bigger Picture

Materials linked from the April 24, 2013 Baccalaureate Core Committee Minutes.
Building the Bigger Picture
Synthesis Bacc Core Review Results
By Stefani Dawn, PhD
Assistant Director for Assessment
Course vs. Program Level Data
• Bacc Core category review has historically
been about individual course review
– Meeting category criteria and what delivering in
the class
• With student learning data (new) and other
data streams it can inform the Bacc Core as a
Program and improve learning for students
Course Level Data
Synthesis Review
• 26 courses were not offered (19%)
• 22 submission incomplete (missing syllabus,
review form or both) (16%)
• 10 submissions were exemplary (7%)
– 2 of those were selected to receive $500 awards
• 61 courses were recertified (44%)
• 21 courses require additional follow-up (15%)
Bacc Core
is an Academic Program
• A series of courses that make up a curriculum.
• Courses work together to develop students’
knowledge, skills, and values identified by the
faculty as being important.
• The Bacc Core forms the foundation to
complete this sentence with confidence:
An OSU baccalaureate graduate
is able to ___________
How do we know?
• That students A, B and C at graduation have
attained the same minimum competencies?
• A shared minimum experience and education.
Student Attainment of Standards
Minimum Standard
The Numbers
• As part of assessment
– Submit one Category Review webform per course
• 124 webforms were submitted by the units
• 4 courses requested to be discontinued
eSET
• 42% of Synthesis courses in Spring 2012
participated in pilot
• 80% of the responding students were taking
the course to satisfy a Bacc Core requirement
(n=497)
• Asked to rate ability to…(outcome): Median 4
out of 6 (good)
• eSET NOT used in individual course reviews.
The Numbers
•
•
•
•
•
Asst/Assoc/Prof: 27%
Instructor/Senior Instructor: 45%
GTA/No Rank: 24%
~4,000 students per term in Synthesis courses
83%-91% max capacity
Conclusions Analysis
• 48/125 provided a conclusion related to the
SLOs
• Sorted into
– Students met all outcomes
– Specific outcome met
– Students fell short on a specific outcome
– Sorted into specific, identified challenges (e.g.
writing, etc.)
Conclusions Analysis
• 61% stated that the students met all of the
outcomes
• 37% expressed some weakness, concern or
variability
– Writing
– Students had difficulty synthesizing complex,
global-level or multidisciplinary information
Do We Believe It?
• We do know more than we did before
• What need for confidence in conclusions
– Consistent matching of assessments with
outcomes
– Consistent collection of evidence across sections
and terms over time (appropriate sampling)
– Reporting specific results of student learning for
EACH outcome.
Bacc Core:
More than the Sum of it Parts
• We can use the data we have as an indicator.
• Goal: Use the information provided by those
teaching the Bacc Core to inform the program
(the curriculum, resources, etc.)
• It goes way beyond individual courses
• We depend on you to tell us what is
happening with our students