Transcript Re-Imagining Multiple Choice Tests

Keith Nickson M.S.W.
Professor, George Brown College, Toronto
8th Annual ACESS Conference, Thunder Bay, On.
Some Thoughts on Teaching:
c/o Chris Napper, Queen’s University
 Vs. Deep Learning
 “Incorporating new ideas
Surface or Rote Learning
“Memorizing main points,
has some value…but
students are primarily
motivated by a fear of
failure.”
with existing knowledge,
and new experiences,
changing the model I’m
working with.”
 Heavy workload =
surface learning
{Mr. Bloom’s Taxonomy}
 Remember
 Understand
 Analyze
 Apply
 Evaluate
 Create
MC tests mostly focus on…
 Remembering:
The lowest ‘order’ of learning
How can we make the tests
move up to ‘application’?
Teaching S. Work =
Integration of theory and
practice = application,
higher order of learning
than mere remembering
“Every learning activity, every
evaluation should be
designed to help our
students practice the skills
they will use in their jobs.
Evaluations should match
course outcomes.”
Anne Vandevelde, M.Ed
Curriculum Specialist
George Brown
Knapper’s Ideas
Research on College Teaching and Learning: ‘What We Know’ (2004)
Active Learning
Assessing Student Work
“The greatest responsibility of
the teacher is not the
communication of subject
matter content, but the selection
and design of appropriate
learning tasks.”
“Assessment is most effective
when it is done fairly frequently,
when feedback is provided
quickly, and is constructive…
“Mastery and transfer are most
effective when the tasks set
closely replicate what the
learner will encounter in life
and work situations beyond the
classroom.”
“To use assessments as a way of
motivating students, the
assignments need to be
challenging enough to demand
effort and creativity, while not so
hard that students will give up
prematurely.”
Do MC Tests Meet These Criteria?
Do they reach into Bloom’s upper
levels?
 A Manual for Authors of M. Choice Testbanks
 By David DiBattista, Brock U, 2008/3M Teaching Fellow
 (posted at www.gbcnickson1.pbworks.com)
 Claim:
 ‘Not just memory being tested but also higher order
cognitive processes’
M Choice Tests: Context
 Why are they popular?
 Quick, reliable, more
 Most widely used objective
assessment tool used in
N. America
questions can be answered,
more material covered,
marking not affected by
handwriting, favoritism…&
publishers supply them.
 Many students like them
Study by DiBattista
•How we view MC tests
•Is memory enough?
 90% of faculty believed MC
tests measured the ability to
remember information
 Less than 50% think it
measures higher order
cognitive processes
 “If assessment tasks are to tap
into higher order cognitive
processes, students must not
be able to rely on memory
alone.”
A Couple of Questions…
 Can MC tests tap into ‘higher order’ learning
processes?
 How can we make MC tests a learning experience as
well as an evaluation of what’s been learned…..
 …In the way that essays, group assignments,
presentations combine learning and demonstration of
skills/knowledge?
Maryellen Weimer: Editor,
The Teaching Professor
 “With evaluation, we
need to move from
testing memory to a
combination of testing
and learning.”
 “Essays and group
projects engage a range
of learning processes, so
doing MC tests in the
same way makes them a
richer experience.”
 “But always give students
a rationale for doing MC
tests differently.”
Maryellen’s Options
 30 mins, do test alone
 Put students into pairs or
groups of 3
 30 mins, do same test in
pairs/groups
 Marking:
 Higher mark counts or:
 Combine divide by 2
 Crib/cheat sheets
OK for part of test
What Keith does…
 Students told to pair up
ahead of time or choose
to write test alone
 Students encouraged to
work as a small study
group to prep for test
 Cheat sheet sometimes
 1st 30 mins alone
 2nd 30 mins in pairs or
alone
 Each student submits
one scantron: they can
disagree on a question
Other Options…
 Students use cheat
 Review Week Before:
sheets, work alone
 In groups, students write
 Open book for 2nd half
of test period
one MC question each
based on one section of
course/text and post
 Then go round room in
their group, trying to
answer each question
using their text
The Benefits…
 Less cheating; students know
they can chat in 2nd part
 Incentive to work in small
study groups, deepens
learning and improves
memory
 Choice: can work alone
 Allows for more ‘higher order’
questions, more case study,
application questions & less
straight memory work
 Focus less on stats/numbers,
more on challenging concepts
 Questions can be more
challenging
 In pairs: students teach each
other, debate the answers
 Shift from memorizing to
‘deeper’ learning
What the Best College Teachers Do
Ken Bain (2004)
 “The outstanding
teachers used
assessment to help
students learn, not just
rate and rank their
efforts.”
 “Not all teachers
followed the same
practices, but they often
broke with
convention…every act
centers around and
ultimately springs from a
concern for student
learning.”
Your ‘lower order’ MC Questions
 A. True
 #1. In DiBattista’s study,
more than 50% of those
surveyed said that MC
tests have the potential
to measure higher order
cognitive processes.
 B. False
#2.
 “The responsibility of the
teacher is not to
communicate
information but to
design learning tasks.”
 Who said this?
 A. Maryellen Weimer
 B. Chris Napper
 C. David DiBattista
 All of the above