Evaluate
Pre-development Formative Evaluation Report

Student previewers

A. Procedure

Two students who were studying the same course were invited to be previewers in early April 2003.

They were given the URLs of two of the interactive exercises developed for the course. They were asked to preview the exercises in detail for at least half an hour in their leisure time at home and then fill in the feedback form. The feedback form asked questions concerning the usefulness, navigation and design matters relating to the previewed materials.

 

B. Executive summary

On the whole, the students commented that they found this type of exercise very useful. They liked being allowed to attempt the questions as many times as possible; this was a good practice as they felt they were more motivated to learn in this way.

Some improvements were suggested. They include:

  1. a lighter background colour
  2. pictures with higher resolution
  3. more help in the feedback
  4. showing the location in the answers graphically
  5. more MCQs of this kind
  6. a lower difficulty of level in future MCQs
These suggestions were taken into account, where appropriate, in the next stage of the development.

 

C. Feedback form

Usefulness

  1. Do you think this kind of online exercises is useful in helping you to learn? Please explain.
  2. Can you think of some areas or topics in this subject in which you would most like to see this kind of online exercises being developed?

Question-answer-feedback navigation

Right now, you can attempt an exercise as many times as possible until you reach the correct answer. Also, feedback will be given immediately after each attempt.

  1. Do you like this possibility of submitting unlimited attempts? Please explain.
  2. Do you like the arrangement that feedback is shown every time you make an attempt? Please explain.

Quality of feedback

  1. Do you think the feedback right now is good enough to help you understand the issues at hand? Please explain.

Design

  1. How much do you like the page layout of the MCQ? You may comment on aspects like the colour tone, positions of the buttons and text, size of text fonts, and/or the amount of animation available, etc.
  2. Is there any additional feature on the page layout that you would like to see? If yes, please elaborate.

-end-