Evaluate
Story of Formative Evaluation

The course
The teacher has built some online help for students studying rehabilitation science in order to assist them to write the special type of report they need for the profession, a Client Evaluation Report. The site has taken the form of an online guidebook composed of a number of 'challenges' in areas such as 'content', 'structure' and 'common errors' of report writing. These 'challenges' are in the form of interactive MCQs for students to do. Upon completion of the 'challenges', students are shown some learning tips about various aspects of report writing.

After a few 'challenges' had been built, a formative evaluation was implemented so that we could identify ways to further improve the 'challenges' and implement these improvements to the remaining 'challenges' to be built.

 

Evaluation questions
The formative evaluation questions were:

  1. How can we make the web materials even more helpful to the students' learning?
  2. What other content could incorporated into the 'challenges'?
  3. What improvement can be made to the design and navigation of the 'challenges'

 

Evaluation plan
In order to answer the evaluation questions, we have made an evaluation plan for collecting data and feedback from two groups of previewers.

We first met with a group of student previewers. The students had been asked to complete the few sample 'challenges' at home before attending the meeting. They commented on the content, design and navigation of the materials. They also commented on the overall helpfulness of the 'challenges' and suggested ways of improvement.

A group of experienced e-learning material builders and designers was invited to attend the second meeting, together with the teacher who had planned the site and written the 'challenges'. They were asked to try out the 'challenges' before the meeting. They then commented on the content, design and navigation aspects of the materials. They also looked at how the materials were to be integrated into the actual course and commented on the learning value added to the course with the help of the site.

Click to view some preliminary results of the evaluation.