


Theme
Assessment: Written and Feedback
INSTITUTION
Ondokuz Mayis Uni. Medical School

Designing good test such as progress test takes amount of tme and effort. Questions are chosen depending on the complete learning objectives of medical school and this can give opportunity to evaluate the complete domain of knowledge base. Monitoring students improvement is quite easy but evaluating all program is more complex.
We aimed to examine the use of progress tests in a matrix table as part of a feedback process to curriculum designer and evaluate the strengths and weaknesses of curriculum.PT was introduced to our students since 2009. We used 200 MCQ single best answer format questions from 40 departments in 11 organ different systems. In total we gathered 713790 answers from students’ paper based tests. All question tagged by 10 different subdomains.
- Learning Objective number
- Department
- Assigned teaher to given learning objective
- Related system
- Difficulty Level
- Bloom's Taxonomy Level
- Related Module/block
- Related year
- Type of educational activity
- Positive/Negative constuction of stem
These kind of tagging provided a rich source of data and detailed feedback to departments, students, teacher and curriculum designer is given. As a medical school, we tried to be better at utilising the available collected data for improving feedback about performance of all parites. The Matrix Analyse Table constructed by Department of Medical Education with data source. Which followed by evaluation of departments depending on students’ response with predetermined difficulty indexed questions.
Answers embedded to the matrix table to take a snapshot of curriculum. In table we summarized organ systems in columns and departments in rows. Endocrine & Metabolism system questions were best correct answers rate while Urogenital System lowest. Infectious Disease Department is rated worst by students’ answers as feedback. But by using matrix table we found infectious disease question, which related respiratory system having good correct rate while cardiovascular infectious disease worst. Such results enable us opportunity to criticize specific point.
Our results show that progress testing is a valid and reliable instrument to evaluate effectiveness of departments and divisions in undergraduate medical education.
The Matrix Analyse Table gives perfect clues to students and curriculum designers about their strength and weakness.