ePoster
Evaluation of Curriculum by Progress Test

Authors

  1. H. Omer Tontus
  2. Ozlem Midik

Theme

Assessment: Written and Feedback

INSTITUTION

Ondokuz Mayis Uni. Medical School

Background

Designing good test such as progress test takes amount of tme and effort. Questions are chosen depending on the complete learning objectives of medical school and this can give opportunity to evaluate the complete domain of knowledge base. Monitoring students improvement is quite easy but evaluating all program is more complex. 

Summary of Work

We aimed to examine the use of progress tests in a matrix table as part of a feedback process to curriculum designer and evaluate the strengths and weaknesses of curriculum.PT was introduced to our students since 2009. We used 200 MCQ single best answer format questions from 40 departments in 11 organ different systems. In total we gathered 713790 answers from students’ paper based tests. All question tagged by 10 different subdomains.

  1. Learning Objective number
  2. Department
  3. Assigned teaher to given learning objective
  4. Related system
  5. Difficulty Level
  6. Bloom's Taxonomy Level
  7. Related Module/block
  8. Related year
  9. Type of educational activity
  10. Positive/Negative constuction of stem

These kind of tagging provided a rich source of data and detailed feedback to departments, students, teacher and curriculum designer is given. As a medical school, we tried to be better at utilising the available collected data for improving feedback about performance of all parites. The Matrix Analyse Table constructed by Department of Medical Education with data source. Which followed by evaluation of departments depending on students’ response with predetermined difficulty indexed questions.

Summary of Results

Answers embedded to the matrix table to take a snapshot of curriculum. In table we summarized organ systems in columns and departments in rows. Endocrine & Metabolism system questions were best correct answers rate while Urogenital System lowest. Infectious Disease Department is rated worst by students’ answers as feedback. But by using matrix table we found infectious disease question, which related respiratory system having good correct rate while cardiovascular infectious disease worst. Such results enable us opportunity to criticize specific point.

References
Conclusion

Our results show that progress testing is a valid and reliable instrument to evaluate effectiveness of departments and divisions in undergraduate medical education.

Take-home Messages

The Matrix Analyse Table gives perfect clues to students and curriculum designers about their strength and weakness.

Acknowledgement
Background
Summary of Work
Summary of Results
References
Conclusion
Take-home Messages
Acknowledgement
Send ePoster Link