Q: How can the impact assessment of a self-assessment tool be carried out?

Hello. Thanks for your query. This will need inputs from our methodology experts. We shall reach out to them and get back to your soon. In the meantime, feel free to explore the site to read up on other matters of interest. :-)

Hello. Here’s the response from our experts.

Let’s say you’re working on such a tool for nurse midwife trainees. One way of carrying out such an impact assessment is to ask a ‘test group’ to carry out an exercise (e.g., attempt an examination) and to self-assess their performance. This should be followed by asking a ‘control group’ to assess the test group’s performance on the same exercise. The results of the two assessments may then be compared to evaluate the impact of the self-assessment.

The results would be more robust if several such exercises were conducted for the same test group and the same control group, and the scores compared and analyzed over time. The two groups may also be interviewed to record their perceptions of the performance on the exercise and their self-assessment (in the case of the ‘test group’).

Further, any correlation between the two sets of assessments may be investigated statistically (e.g., calculate the p-value).

Hope that helps. You may also find it useful to know more about our Experimental Design service here.

All the best for your assessment/study!