Learning Objects for Introductory Programming

Evaluation

These learning objects have been used by over 1,000 students at London Metropolitan University and Bolton Institute on 4 modular courses beginning in September 2002. Structured evaluation has been carried out during this time, to measure the success of the approach taken, and of the use and value of the learning objects. Evaluation has centred on gaining student feedback, using a range of methods to collect both quantitative and qualitative data:

• 3 student questionnaires at the beginning, middle and end of the modules
• structured interviews with a sample of students
• capturing the tracking data from the learning object server and WebCT which is used to deliver the objects to students.

Some of the evaluation results are presented below.

Increase in pass rates

Evidence of learning object use

Server tracking data for Semester A 2002-3 shows that:

• 79,325 learning object pages were requested
• the majority of pages were accessed during the day between the hours of 9am and 6pm (74%), but 26% were requested after 6pm and before 9am (i.e. in the evening and early hours of the morning)
• most pages, 92%, were accessed on weekdays (Monday to Friday), but 8% were requested at weekends.

The tracking data shows substantial use, and that access peaks during students' lab sessions. However, students also access the materials outside of the scheduled sessions, at times of their choosing.

Students view of the usefulness of the learning objects

We used two types of learning objects, text-based (html) and Flash-based multimedia animations. In the mid semester questionnaire students were asked how useful each type of learning object (learning aid) was in helping them to learn Java. The results can be seen in the following bar chart. Whilst both types are viewed to be very useful/useful by large numbers of students, they rate the visual and interactive animations more highly.

Source: Mid semester questionnaire at LondonMet, 2002-3, 223 responses

These learning objects have been produced by London Metropolitan University and Bolton Institute, with support from the HEA-ICS