Transcript Slide 1

Putting Assessment at the Heart
of Learning at the University of
Glamorgan
Haydn Blackey and Alice Lau
3 March 2011
Context – The University of Glamorgan
The institution’s vision is to be committed to the delivery of a
first class learning environment incorporating the highest
standards of blended learning, tutor support and the use of
cutting edge learning facilities
First strategic priority is to improve the nature and quality of
the student experience, with assessment being one of its key
themes.
The Assessment situation at
Glamorgan
• Review of assessment across the Institution 06/07
– assessment methods being used are still largely traditional
– Use of essays, closed book exams and lab reports are the most common!
– Little and slow uptake to innovative forms of assessment despite strong support from
the University
• Review of assessment loadings for 15 first year
awards
– Significant variations on the loading of assessment across the same year ( from 6 pieces
to 29 pieces of assignment)
• The poor student experience on assessment and
feedback identified by the NSS and our internal
student survey
• Senior management commitment to change in
learning, teaching and assessment – Assessment for
Learning
Assessment for Learning and Blended
Learning at Glamorgan
Assessment for learning - seeks to
develop a learning environment which
promotes dialogues between staff and
students; amongst staff and amongst
students that would lead to increased
learner autonomy to evaluate and
improve thereby contributes to
improving student achievement.
Linking A4L with BL
E-assessment must not simply invent
new technologies which recycle our
current ineffective practices (Ripley, 2004)
Assessment
of Learning
Assessment
for Learning
(Ripley, 2004)
It is not about promoting new
technology to the Glamorgan
academic staff but tools to
empower them to make more
efficient, redesign and
transform assessment-related
activities
To nurture the growth…
Senior
Management
Faculties
Seminars, workshops, case studies
and good practice, ELTA awards,
and innovation grants
Initial challenges…
 These policies and procedures can be
seen as top-down ‘control’; therefore
some resistance to changing their
current practices
“I worry
about
the ‘centralisation’
of decision
 Staff
debate
about
the understanding
making
areas such
as this
of theinconcept
and
the[assessment].
surroundingThere are
different
expectations
and academic
traditions that
principles
of assessment
for learning.
associated
withperceive
particularassessment
groups of staff and
 are
Some
lecturers
scope
for localas
modification
therefore needed”
for learning
just ‘idealisthinking’
that
would not work in practice
 Some lecturers perceive that such
policies are ‘dumbing down’
assessment and giving weak students
‘the advantage’
How can we embed Change?
• We need to give faculties
more ownership.
• Create a bottom-up
approach to complement the
top-down approach.
• Provide time and resources
for faculties to experiment.
The answer?
Work directly with staff and
STUDENTS
What our students said –
Good Practice
Some lecturers set aside lecture
time/tutorial to discuss what is
required from a specific
assessment
Providing students with past
assignment examples
Formative feedback
(support) on
summative work
Feedback sessions – students
especially value the opportunity to gain
feedback from both tutors and their
peers
“…In one module, our lecturers actually organised a
Giving students choices in 1)set time in tutorial to go over our work in
The use of Bb, email to
progress
and highlight areas of improvement
assessment questions/themes
2)
communicate/remind students about
agreeing a deadline with students viaalong with the marking criteria.
assessment information and
in-class discussions at the start of
deadlines.
term
What our students said –
Assessment and Learning?
• Generally positive about the role
assessment has on their learning.
– 81% of the respondents felt that all or most of their
assessments have challenged their current
understanding and knowledge of the subject.
– 74%of respondents stated that all or most of
assessments given to them helped them to
consolidate knowledge from the course.
– 76% of the respondents felt that their assessments
were relevant to their course of study.
What did our students said –
Assessment and Learning?
• 64% of the respondents noted that all or most of
“I think we need more information in the
their assessments
provided
with
very
module handbook
about
what them
weprocess:
need
to put
in clear
E.g.
Submission
the essay...
wordthey
“evaluation”
can be to do.
instructions
onThe
what
are expected
anything...”
•
“…there are many options to hand it
67% of respondents[assignment]
noted thatinall
most
… itor
can
be of
“A lot of the time you don’t
know
confusing,
it’d be helpful
if they
their
assessments
criteria
helped
them
“I
have
difficulties
drawing
that
line
in
the
sand,
where your lecture notes
fit
[lecturers]
just give one option so
what
do
they
expect
for
me
to
getdo
a first?”
into the coursework,
you
understand
what they
need
to
a
youcan’t
know where
itto
willachieve
be.”
quite see where the questions
positive
outcome.
come from and you’ve got to
teach yourself…”
What our student said in terms of
assessment design?
• 56% of respondents stated that their
assignments deadlines are spread out
“All
ourterm.
deadlines
are in one, it would be
appropriately
the
“…knowing
where tothrough
hand in and
when
to
•
hand in is difficult, this year wenice
hadto spread it out, you have a week
to
something,
think
about it,
Do
we
our
students
choice?
“…if
there
are
different
of assessing,
rather
than
hardly
anygive
warning
right
up toways
theperfect
when
all the
work
is due
in at
just all
and
exams
at the
end,
I think
it the same
assignments,
allcoursework
my three modules
are
I don’tYou
know
I have done, or
help
our
learning time,
a bit
dowhat
get quite
asking forwill
your
first
assignments
in more.
the
what
enthusiastic
about
your
firstI have
one orlearnt.
two
second term,
I have five
modules
when
starting inassessments,
January and but
these
are itallget to the fourth one and
are still
doing
part of myyou
degree.
It is
veryan essay, it does become so
mundane
and dull.
You just feel that you are simply
unfair…why
not spread
it out?
churning them out…perhaps more interactive
assessment would be good.”
What our students said - feedback?
How feedback is currently provided to our students
30%
25%
20%
15%
10%
5%
0%
What students said? - feedback
58% of respondents stated that they were told when
“Because
we returned
have lots oftoassessments
their marked assessment
will be
them.
[deadlines]
thaton
are
“…To date, I have not received
feedback
myclose together. You need
feedback
first two assessments,the
and
[I] don’t soon,
know if it’s too late you have no
time to use
it, andbeyou can’t work on it and by
when [I will receive feedback].
It would
52%
of respondents state
that
they
are given a date
thetotime
youifreceive
appreciated if in addition
a deadline
for your feedback, most of
for
feedbacksome
to beindication
returned
tocoursework
them,
your
out ofwas
the way!”
submission,
of the
date oftheis date
always
adhered to.can be provided.”
feedback/grades
48% of respondents said they received continuous
feedback to all or most of their assessment.
What students said? - Feedback
56% of respondents said that all or most of their
“…Sometimes
you
just
get
comments
such as – ‘
“When
you get it [the
assignment]
back
and
got
awith
2:1 say,
assessments
are
handed back
to
them
you write
I want
to know,
how do
alldetailed
the feedback
is positive,
but well’.
if it’s that
good,
why didn’t
I I write
feedback
well!struggle,
Tell me ifI’ve
I write
get 100%. I find that a real
had well
that why
with don’t
a fewI write
excellently,
do I need
to to
doknow
to improve
[assignments]. Some are
good, butwhat
it would
be nice
Only
21%toofdothe
respondents
thought
there was a
even more?”
what
I need
to get
a 1st.”
need for them to go ask for more feedback
“…The comments I got did not validate the mark.
of respondents
saidthat
that
they
are able to
I 62%
had 45%,
and to get a mark
low,
nearly
with their
tutors
tofeedback
discussthan
their
ameet
fail, I expected
much
more
a marks and
feedback
onatall
most
ofessay!
their ”assessment
few lines
theor
end
of my
Outcomes
• Captured and enabled
us
to
share
with
For example: We thought providing
For
example:
would like:
students
with Students
multiple
methods
of
colleagues, students’
views
on
what
they
•communicating
choice in how they
can
present
and submitting their
considered as goodwork.
practice
and
assessment
would
give students more
•Diverse
assessment
methods
flexibilityStudents
but students
actually
For example:
are not
overlyfound
challenged our beliefs
in
what
we
think
•Collaboration
with other students
that confusing.
concerned
with the ‘20 days rules’, as
outside their course (especially for CCI
long
as
they are given a date when they
students want.
students)
can expect feedback and as long as it is
before their next piece of work.
– Assessment process
– Learning experience
– Feedback
Activity – Responding to the student
voice (15 minutes)
• In your pack, there are some student
comments emerged from institutional
research at the University of Glamorgan.
• What approach would you use to address the
issue(s) or idea(s) raised by the student?
In practice – some examples
Example 1: Providing students with clear, specific and
consistent communications from tutors on assessment
information.
• Creating a single e-submission point for our students across
the University
Example 2: Avoid assessment overload and bunching
•The assessment diary
•is a list of module codes and titles, dates
for when assessments are submitted and
dates by which they are to be returned.
•Developed the diary in consultation
with colleagues teaching on the
same course in order to avoid
bunching of assessment deadlines.
•The diary was posted on the VLE for
students
In practice – some examples
Example 3: Innovative assessment
– Raise awareness of the choice of technologies for
lecturers and students to Use in the Assessment
Process
– Provide training, fundings and uses students as
change agents.
• The use of wiki and blogs
– Introduced group work via a creation of wiki and
blogs
– Link to example
In practice – some examples
• Example 4: Provide timely, appropriate, stimulating feedback
and feedforward in order to engage students in learning
• The use of Turnitin and Grademark
• The use of audio feedback e.g. Audacity, example
• The use of video feedback in a first year Calculus module Link
to examples
• Group feedback session
• Explain to student what feedback is and what they can expect
e.g. Feedback leaflet
• Ask students to explain how they will use the feedback
before they get a mark
Lessons learnt
Assessment is a process! – more than
changing the assessment method.
Reviewing the entire process identified that even
simple steps such as the assessment diary can
make a huge difference to both staff and student
Important to engage students, administrative
teams in each faculty as well as academic staff
Bottom up approach, time and resources!