Transcript How to write a report on assessment

How to write a Report
On Assessment
Source: AUN Secretariat
Report Preparation
Objectives of Feedback
• Level of performance based on AUN-QA
guidelines and criteria
• Key strengths of university/faculty/programme
• Areas for improvement
2
Quality Assessment Process (Check)
Guide 53-66
Report Preparation
Review
Assessment
Findings
• Verify evidence
Identify Strengths
• Areas which meet criteria
• Areas which are best practices
Establish Areas
for Improvement
• Areas which need improvement
• Areas which are major weaknesses
Establish Rating
Clarify
Prepare Final
Report
• Establish and agree on level of performance or rating
• Reconciliation of ratings between teams for common criteria
• Confirm areas in doubt
• Agree on improvement areas
• Presentation of findings at closing meeting
• Using AUN-QA Assessment Results Template
• Final report
3
Quality Assessment Process (Check)
Guide 53-66
Desktop Assessment
AUN-QA Assessment Planning Template (Programme Level)
4
Quality Assessment Process (Do)
Guide 53-66
Desktop
Assessment
Example of Assessment Planning
using the Programme Level Template
5
Quality Assessment Process (Do)
Guide 53-66
Report Preparation
7-Point Rating Scale
Score
Value Interpretation
Quality & Improvement
Interpretation
1
Nothing (no documents, no plans, no
evidence) present
Absolutely inadequate; immediate
improvements must be made
2
This subject is in the planning stage
Inadequate, improvements necessary
3
Documents available, but no clear
evidence that they are used
Inadequate, but minor improvements will
make it adequate
4
Documents available and evidence
that they are used
Adequate as expected (meeting the
AUN-QA guidelines and criteria)
5
Clear evidence on the efficiency of
the aspect
Better than adequate (exceeding the
AUN-QA guidelines and criteria)
6
Example of best practices
Example of best practices
7
Excellent (world-class or leading
practices)
Excellent (world-class or leading
practices)
After completing the score for each criterion/statement, compute the score
for the overall opinion and overall verdict
6
Quality Assessment Process (Check)
Guide 53-66
Report Preparation
Guidelines for Feedback
• Feedback must be:
– Objective
– Based on evidence
– Encouraging
– Part of a “learning” process
• Feedback must NOT:
– Ridicule
– Mandate solutions
– Be insensitive to the overall effort
– Ignore the achievement made
7
Quality Assessment Process (Check)
Guide 53-66
Report Preparation
Writing Feedback
• Use clear, simple, grammatically correct and
complete sentences
• Avoid jargons or acronyms
• Be constructive
– Use positive tone
– Be specific
– Fall within the criteria
• Be non-prescriptive – state observations and
evaluations
8
Quality Assessment Process (Check)
Guide 53-66
Report Preparation
Samples of Feedback
Poor Comment
“Staff training needs are revised and frequently met”
Good Comment
“Staff training needs are revised and updated annually.
Training was provided to assist staff to operate and
maintain equipment and to take proactive approach to
address students’ needs”
9
Quality Assessment Process (Check)
Guide 53-66
Report Preparation
Samples of Feedback
Poor Comment
“The university sets aside a high 3% of their funds for
research”
Good Comment
“Some 3% of the funds are allocated for research
activities. The fund is used for the research of new
technologies and the commercialisation of new
inventions. Staff are allowed to tap into this fund to
finance their projects upon approval from the research
evaluation committee”
10
Quality Assessment Process (Check)
Guide 53-66
Report Preparation
Samples of Feedback
Poor Comment
“The university does not conduct survey to receive
feedback from its stakeholders”
Good Comment
“Based on the interview, there is little evidence of the
university gathering feedback from students, alumni and
employers about the curriculum. This prevents the
university from determining and incorporating labour
market needs for curriculum development and
improvement”
11
Quality Assessment Process (Check)
Guide 53-66
Report Preparation
AUN-QA Assessment Results Template
(Programme Level)
12
Quality Assessment Process (Check)
Guide 53-66
Report Preparation
Example of AUN-QA Assessment Results Report
(Programme Level)
13
Quality Assessment Process (Check)
Guide 53-66
Presentation of Assessment Findings
The purpose of the closing meeting is to:
– present the key results of the assessment to key
management staff
– highlight the key strengths and areas for improvement
rather than the ratings
– ensure that the results of the assessment are clearly
understood
– provide an opportunity for clarification
– confirm of assessment findings
– conclude the assessment
14
Quality Assessment Process (Check)
Guide 53-66
Assessment Report & Recommendations
Final Report
• Executive summary
– Introduction
– Summary of the Results of Assessment
• Criteria and their scores
• Overall verdict
• General comments
– Conclusion
• Results of Assessment
Quality Assessment Process (Act)
15
Guide 53-66
Report on the Quality Assessment at Programme Level for Bachelor
of ____________________________ at the Faculty of
______________, University of _______________________
Introduction
This report documents the findings on the quality assessment at
programme level for the Bachelor of __________________________
at the Faculty of ______________, University of ____________ on
_____________. The quality assessment was carried out by
_________________ from ____________ and __________ .
The report is based on the information provided in the selfassessment report, on- site verification of the documentation and
interviews with selected stakeholders including faculty staff, students,
alumni and employers.
Results of Assessment
The assessment framework is based on the AUN
Actual Quality Assessment at Programmed Level.
The assessment covers 15 criteria and each
criterion was assessed based on a 7-point scale.
A summary of the assessment results is as
follows
15 criteria with corresponding scores
The Department of _______________________
has put in place quality assurance approaches to
address the criteria spelt out in the AUN-QA
guidelines. Of the 15 criteria, 9 criteria were rated
“better than adequate” especially in programme
outcomes, specification and structure & content;
student assessment; staff and student quality;
facilities & infrastructure; quality assurance of
teaching & learning and output. 5 criteria were
rated “adequate as expected” and 1 criterion on
stakeholders feedback was rated as “inadequate
but minor improvements will make it adequate”.
A summary of the key strengths and areas for
improvement is tabulated below
A detailed report of the quality assessment at programme
level for the Bachelor of _________________________ is
attached.
Conclusion
Based on the self-assessment report, evidences and
interviews, the Bachelor of
__________________________________ fulfilled all except
one criterion. Overall the quality assurance implemented for
the programme is between adequate as expected and better
than adequate.
Report prepared by:
Date
Enc. Assessment Results
Desktop
Assessment
Example of Assessment Planning
using the Programme Level Template
22
Quality Assessment Process (Do)
Guide 53-66