Transcript Slide 1
NEED FOR e- ASSESSMENT IN THE FIELD OF EDUCATION Sudha Bhogle Professor of Psychology Head, Student Solutions EDUQUITY CAREER TECHNOLOGIES P LTD Bangalore Mumbai Chennai Kolkata Noida Hyderabad Chandigarh Dubai © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. Assessment is the process of documenting, usually in measurable terms, knowledge, skills, attitudes and beliefs It is to estimate or judge the value, character, etc., of; to evaluate ( Wikipedia). In its broadest sense, e-assessment is the use of information technology for any assessment -related activity © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. Some different types of assessment: • Summative assessment / Formative assessment Summative and formative assessment are referred to in a learning context as "assessment of learning" and "assessment for learning" respectively. •Norm referenced / criterion referenced / Ipsative assessment © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. SUMMATIVE ASSESSMENTS © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. Summative assessments •The large numbers to be assessed •The regularity of exams •Geographical distances which are increasing with the advent of distance education /learning •The range of technologies that are appropriate All these make online examinations extremely interesting. For teachers - they remove the drudgery out of examinations and give the teacher more time to spend on teaching © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. From the learner’s viewpoint To quote… “A notable result was the ease with which students interacted with computers. The affective response from students was very strong – they really enjoy working on these tasks. This might be related to the sustained challenge the tasks present, which is similar to the reported reasons why they like computer based games” (Kirriemuir and McFarlane 2004). © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. Why??? •lower long-term costs •instant feedback to students •greater flexibility with respect to location •more importance given to the learner (timing) •improved reliability (machine marking is much more reliable than human marking) •enhanced question styles which incorporate interactivity and multimedia •can take into consideration different learning styles •can be adapted for testing the physically /sensorially challenged © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. COMPARISION PAPER-BASED MODEL ONLINE MODEL Huge administrative load Virtually no administrative load Error-prone and Security issues Virtually error-free and security is controlled Data analysis cumbersome and takes inordinate amount of time Data analysis is almost automatic and pre-determined. Single Question paper. No randomization possible. Multiple Question-forms. Randomized. Results delayed. Results immediate Teacher oriented Learner oriented Duration of testing not limited to computers available. Duration dependent on availability of computers. © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. COMPUTER-BASED TESTING The International Testing Commission, an independent body, has identified four critical areas in Computer-Based Testing [CBT]: TECHNOLOGY QUALITY CONTROL SECURITY Here is how Eduquity ensures right practices in CBT……………… © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. CBT - TECHNOLOGY Ensuring technical aspects of hardware and software requirements. • Eduquity has developed its proprietary software for error-free online testing for intranet and internet based testing. • The software has been proven in the field with over 6,00,000 assessments conducted online in various parts of the world. • No other Indian company has this proven experience and scale in online testing. • Zero failure rate. Not a single candidate has had to forfeit his/her testing on the scheduled date so far. © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. CBT - QUALITY Ensuring quality of testing and test materials and good practices. Question-Bank development by Subject-Matter-Experts [SMEs] Question-bank moderation and validation by another independent group of SMEs. Eduquity Specialists manage the Q-bank. (SMEs will have no knowledge for whom the bank has been developed and what it contains) Eduquity arranges for and manages Secure Data entry Correctness and Q-bank arrangement and metrics as required (in consultation with client) Encryption of all questions and answer options Randomization of questions and answers © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. CBT - CONTROL Controlling the delivery of tests and test-taker authentication and credentialization Computer- generated Admit cards and a photo/college ID card. Eduquity authenticates this. Barcode on Admit card scanned Web-cam registration Computer allocated to the test taker (random generation) Center manager downloads question set from central server (if required) and updates local server. Web cam placed on the PC programmed to take random pictures of the candidate. On completion of the test, the candidate can sign the marks sheet and hand it over to the proctor Center Manager compiles reports and uploads/reports to Central server © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. CBT - SECURITY Eduquity realizes the importance of security and confidentiality of question papers and answer scripts. Eduquity has proven methods for addressing: 1. 2. 3. 4. 5. 6. Question bank development and protection Monitoring and proctoring at all test centers Authentication of test takers to avoid faking Randomization of Q-bank to eliminate cheating Securing uploading of data to central servers (Firewalls etc) Password protection at all critical stages. © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. NORM REFERENCED e-ASSESSMENTS © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. The student’s performance is compared to a larger group. Usually the larger group or 'norm group' is a sample representing a wide and diverse cross-section of students. Based on the results, informed decisions are then made © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. One example of norm referenced e-assessments, used for informed decision making can be seen in the field of career counselling Eduquity’s PathFinder is an example of this © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. What does PathFinder do? •e-assesses a student’s interests, abilities and personality based on psychometrically developed tools •Combines these to develop a career report which suggests career choices and academic streams •Helps the student make informed career decisions © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. Advantages •24/7 access to the site where ever and whenever required. •Multi media content possible •User friendly •Timing and scoring, exact and error free •Immediate scoring and generation of career report •Can email or chat online directly with the counselor •Get awareness about various careers other than conventional careers. © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. IPSATIVE e ASSESSMENTS © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. •In this mode of assessment, a person's performance is compared with their own earlier performance, with a view to determining whether any improvement has been made, or any 'added value' brought about. •Such assessment might involve setting a learner the same test prior to and after undertaking a course or unit thereof •In all cases, however, the benchmark against which any change in performance is measured is the person's own performance -not the performance of other people. © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. One example of ipsative e-assessments can be seen in elearning and training modules Eduquity’s SMART Student is an example of this © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. •SMART Student program uses behavioral tools and computer based training. •Using the Life Skills approach and computer based training, the entire training programme is divided into two clusters namely, Academic skills and Life Skills •There are web based interactions for those who require it. •The training program for each skill consists of a Pre-training Strength Identification Assessment, Training and a Post training assessment © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. FEATURES OF THE TRAINING •Computer based and interactive sessions •Web based learning •Self-directed course •Each student works individually and in groups •Cannot proceed to the next module till they have completed the previous one •Every session includes a quiz to assess learning retention and at the end of every module, a post-training assessment to assess efficacy of the training © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. Advantages The Tomlinson Report (2004) identifies major problems with current educational provision at ages 14-19 years. Young people are not being equipped with the generic skills, knowledge and personal attributes they will need in the future We need to ensure the development of metacognitive skills, creativity, communication skills, and the ability to work productively in groups © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. As we move towards a knowledge-based society, the development of metacognitive skills increases in importance, and they become educational goals in themselves. The SMART student address these issues © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. In conclusion, The issue of e-assessment in the field of education is not if it will happen, but rather, what, when and how it will happen. E-assessment is a stimulus for rethinking the whole curriculum, as well as all our current assessment systems. © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved. Thank You © Eduquity Career Technologies P Ltd, Bangalore. All Rights Reserved.