Transcript International Diabetes Federation (IDF) East Mediterranean and Middle East Region (EMME) Workshop on Professional Educational Methodology in Diabetes 11-12 August 2008 Bibliotheca Alexandrina, Egypt.

International Diabetes Federation
(IDF)
East Mediterranean and Middle East
Region (EMME)
Workshop
on
Professional Educational
Methodology
in Diabetes
11-12 August 2008
Bibliotheca Alexandrina, Egypt
Professional Technology
Standards in Educational
Development
by
Prof. Morsi Arab
2
Evaluation
Evaluation by judgment :
A- Expert judgment by trained observers:
* the methods of unstructured observation is powerful in
that the observer may discover in the course of
observation new and important aspects of the
phenomenon under study.
*the expert observer determines “ how well” , without
having to define further the concept of “well”. The
concept “well” may gradually come to be defined
afterwards.
Evaluation by judgment : ( cont.)
B- The use of tests and scales for judgment:
- Here the investigator must know in advance what he is
trying to measure , observe or assess.
- The concept “well” has to be defined before.
- This method of judgment is costly in time and effort
(disadvantage ) but it may save a lot of time needed for
long observations .
- Standardization and objectivity will ensure comparability
of information and consequently a better judgment .
Definitions in Evaluation :
- A test: a set of questions to which there is an accepted set
of correct answers (scoring marks). Tests should be
standardized and objective .
- Scale : an instrument for which questions of true/false may
not apply ( when related to attitudes, interests and
behaviours).
- Standarization : control of the situation in which information
is collected ( standard condition) to ensure objectivity.
- Objectivity : the extent to which a particular student’s
( response/answer) yields a unique interpretation ( used
to overcome different interpretations by different human
judgements).
The needs for evaluation , why?
1- to check ( ensure) competence to perform
a job at a reasonable standard (certification)
2- It stimulates students to learn.
3- a guide to reconsider the skills and attitudes
required for a specific job ( to FB the
objectives & curriculum content ).
The needs for evaluation , why?(cont.)
4- a guide to the teachers to improve teaching methods
(FB to strategy ) .
5- FB for guiding the student (learner): while the final
(graduation) exam is useful for certification to take
a job, it is not useful to FB the students to what they
should learn ( too late ..!!).
Decide the required intentions of the evaluation process
before selecting which method of evaluation to use.
Evaluation
General Considerations :
- There is no one ideal method for evaluation .
Each one has advantages and disadvantages.
- The choice of one or other method depends on :
1- is it reliable?
2- is it valid?
3- how much time is consumed?
4- availability of its tools and procedures.
5- dose it give a FB (feed-back) to the learning
process
N.B. It is essential to include not only testing knowledge but
also skills and attitude.
How to ensure reliability of the test
By using objective methods, e.g. MCQs,
check lists, rating scales and similar
methods to help the examiners to unify
their judgment
What makes evaluation practical and
satisfactory ?
1- if it utilizes the available facilities.
2- being cost-effective (economics and time).
3- tests also skills and attitudes, not only cognition.
4- reliability (fair scoring).
Be sure that evaluation is testing for the
exact requirements of the job:
1- Discard Qs on sophisticated Kn which is beyond
the learner’s needs for the required tasks in
the job.
2- Concentrate on the skills and attitudes needed
as was defined by task analysis and job
description.