Transcript Online Assessment and Evaluation Techniques at the K-12 Level Dr. Curtis J.

Online Assessment and Evaluation
Techniques at the K-12 Level
Dr. Curtis J. Bonk
Indiana University and CourseShare.com
http://php.indiana.edu/~cjbonk
[email protected]
Online Student Assessment
How the Internet Will Help
Large-Scale Assessment Reinvent Itself
(2001, Feb). Education Policy Analysis Archives, Volume 9 Number 5, By
Randy Elliot Bennett, Educational Testing Service, U.S.A.

In the same way that the Internet
is already helping to revolutionize
commerce, education, and even
social interaction, this
technological advance will help
revolutionize the business and
substance of large-scale
assessment.
Assessments Possible






Online Portfolios of Work
Discussion/Forum Participation and
Feedback
Online Mentoring
Weekly Reflections or Logs
Tasks Attempted or Completed, Usage…
Quizzes, Tests, Problems, Cases, Group
Work???
Students as Infotectives
(Jamie McKenzie, Grazing the Internet: Rasing a generation of freeranging students. Sept. 1998, pp. 26-31, Phi Delta Kappan)

Inquiry and Detective Skills








changing course, asking for help,
framing essential questions and subsidiary questions,
planning voyage,
screening garbage, analyzing data.
Suggesting and testing hypotheses
Envisioning what’s possible, invent,
rearrange
Seeing what’s missing
Suspending judgment
Students as Authors of Knowledge
(Lehrer, 1993)




Ability to use electronic databases
Locate and select information
Segment information into useful
categories
Interpret and summarize
information from multiple sources
Issues to Consider…
1.
2.
3.
4.
5.
6.
Bonus pts for participation?
Peer evaluation of work?
Assess improvement?
Is it timed? Give unlimited time
to complete? Allow retakes?
How measure competency? How
demo learning?
Cheating. Is it that student?
Reducing Cheating Online
($7-$30/page, http://www.syllabus.com/ January, 2002,
Phillip Long, Plagiarism: IT-Enabled Tools for Deceit?)


http://www.plagiarism.org/ (resource)
http://www.turnitin.com/ (software,
$100, free 30 day demo/trial)
What is Available?
I.
II.
III.
IV.
V.
Online Rubric
Examples/Builders
Online Gradebooks
Online Test Tools & Exam
Reviews
Survey and Polling Tools
E-Portfolios (Student and
Teacher)
I. Online Rubrics
II. Electronic Gradebooks
(Vockell & Fiore, 1993)






Calculate scores, store info
Weight scores
Flag students with certain
characteristics
Print reports by individual or group
Provide prompt feedback
But inflexible, impersonal, & can be
incorrect
III. Online Testing Tools
Courseware Test Tools
eduTest from Lightspan






Tailored Assessments for
You
Customize and design
assessments to meet your
district and state
objectives.
Control assessment
content and delivery.
Access a powerful search
engine with over 60,000
test items.
Create and add tailored
test items.
Develop your own test
items in additional
languages and in other
Test Selection Criteria
(Hezel, 1999; Perry & Colon, 2001)




Easy to Configure Items and Test
Handle Symbols, Timed Tests
Scheduling of Feedback (immediate?)
Flexible Scoring and Reporting




(first, last, ave, by individual or group)
Easy to Pick Items for Randomizing
Randomize Answers Within a Question
Weighting of Answer Options
Web Resource: http://www.indiana.edu/~best/
Fun and Games Testing
IV. Online Survey Tools for
Assessment
Web-Based Survey Advantages






Faster collection of data
Standardized collection format
Computer graphics may reduce
fatigue
Computer controlled branching and
skip sections
Easy to answer clicking
Wider distribution of respondents
Sample Survey Tools



Zoomerang (http://www.zoomerang.com)
IOTA Solutions
(http://www.iotasolutions.com)
QuestionMark

(http://www.questionmark.com/home.html)
SurveyShare (http://SurveyShare.com; from
Courseshare.com)
Survey Solutions from Perseus

Infopoll (http://www.infopoll.com)

(http://www.perseusdevelopment.com/fromsurv.htm)
Survey Student Opinions
(e.g., InfoPoll, SurveySolutions, Zoomerang,
SurveyShare.com)
V. Digital Portfolios


“A purposeful collection of work,
captured by electronic means, that
serves as an exhibit of individual
efforts, progress, and achievements in
one or more areas.” (i.e., demo how
they know what came to know; how
knowledge increased and evolved)
Terry Wiedmar, 1998
Learning Logs
(Paul Hickman, Northeastern University)

Combines journal writing and portfolios.





Interactive (student-student, student-tchr)
Collaborative (share thoughts, consensus)
Electronic (word processed & exchanged)
Essentially portfolios of student work.
Generate q’s, summarize articles, reflect
on what learned, test models, propose
explanations for results
E-Portfolios: What might
they include?








Multimedia presentations (video,
animation, voice-over testimonials)
Examples of work
Personal statement
Self-reflections on that work
Connections between experiences
Standard biographical info
i.e., progress, achievements, efforts…
Large, complex, time to grade
E-Portfolios: Skills Learned
(Sanders, 2000)





Planning, design, and reflection on
work
Revision and evaluation of work
Communication of work
Consideration of audience
Track personal improvements and
accomplishments
Sample Portfolio Scoring Dimensions
(10 pts each)
(see: http://php.indiana.edu/~cjbonk/p250syla.htm)
1.
2.
3.
4.
5.
6.
7.
8.
Richness
Coherence
Elaboration
Relevancy
Timeliness
Completeness
Persuasiveness
Originality
1.
2.
3.
4.
5.
6.
7.
8.
9.
Insightful
Clear/Logical
Original
Learning
Fdback/Responsive
Format
Thorough
Reflective
Overall Holistic
What about Teacher EPortfolios






Digital pictures of
student activities
Handouts from
coursework
Philosophy
statements
Videotapes of
teaching
Audio recordings
Lesson plans







Letters to parents
Letters of rec
Sample writing
Newspaper clippings
of their activities
Work from students
Student evaluations
Self-evaluations
TICKIT: Teacher Institute for Curriculum
Knowledge about the Integration of Technology
(http://www.indiana.edu/~tickit)
TICKIT Training and Projects:







Web: Web quests, Web search, Web
editing/publishing.
Write: Electronic newsletters.
Tools: Photoshop, Inspiration, PPt.
Telecom: e-mail with Key pals.
Computer conferencing: Nicenet.
Web Course: HighWired.com, MyClass.net,
Lightspan.com, eBoard.com
Digitizing: using camera, scanning,
digitizing.
Technology Integration Ideas







Collab with students in other countries
Make Web resources accessible
Experts via computer conferencing (or
interview using e-mail)
Reflect & Discuss on ideas on the Web.
Put lesson plans on Web.
Peer mentoring.
Other: role play, scav hunts.
Self-Assessment
Quest Atlantis Project


Quest Atlantis is a Web-based communitydriven, meta-game built using 3D technologies
and that combines elements of play, role
playing, adventure, and learning, …
… allowing 9-14 year old children from diverse
socio-economic backgrounds to virtually travel
to 3-D, worlds where they select engaging
quests, talk with other Questers and mentors,
and build virtual persona.
Legend of Atlantis






Atlantis is facing impending disaster
Disaster is a result of lost values and
corrupt leadership
A Council of Elders opened a portal to find
help
Children of the Earth can use this portal to
save Atlantis
Centers have been created to access the
portal
Children must save Atlantis and avoid our
common fate
Future Testing Trends???






Computerized Writing Assessments
Project Essay Grade (PEG)
Computer Adaptive Testing (CAT)
E-Portfolios Standard
Language Translation
Digitized Expert Performances
(standards)
Tips on Online Authentification
Today:



Check e-mail access against list
Use password access
Provide keycode, PIN, or ID #
Future:

Palm Print, fingerprint, voice
recognition, iris scanning, facial
scanning, handwriting recognition,
picture ID)
So, Where is Korea Headed???