VLE reviews (Caviar or Red Herring ?)

The JISC 2012 paper on Extending the learning environment provides information which assists in informing the review process of VLEs.

Earlier in 2012, Northampton went through a VLE review process and the notes and links below may be of interest to institutions which are going through a similar process. I have sub-titled this post ‘Caviar or Red Herring’ as the process may be seen as either a quality opportunity to ensure that you have the best product (the Caviar) or an opportunity to spend significant time comparing products with very similar functionality (the Red Herring) – you may not be sure which you have until you get to the end of the process…..and could end up with a mix of the two !

** Please note that the review below was conducted early in 2012 – all products mentioned were reviewed at that time and have changed significantly since in terms of functionality and version. **

We started the review process with a number of key principles:

• The institution is committed to reviewing its virtual learning environment to ensure suitability for purpose and cost effectiveness.
• Any change must enhance the student experience. Staff and students should evaluate the options and be involved in the change decision. Dedicated and nominated staff within the Schools should be allowed time to review the options with the support of their Dean.
• The change process can be disruptive for staff and students due to the migration needed. This can be mitigated though recruitment of dedicated staff to support the process.
• Whether we maintain the current platform under the current VLE or move to an alternative platform, the review is an opportunity for staff to fully engage with all students and University stakeholders.
• Material and structure should be reviewed and improved where possible. Templates and support will be provided and staff will engage with these. Additional long term support will need to be considered.
• All platforms under the VLE should be externally hosted at present to provide maximum uptime.

[The decision to go hosted with the current VLE (Blackboard] was made in 2007 based on the need for high level system availability which could not be guaranteed with internal hosting. This decision was based on Northampton’s internal culture and infrastructure. It was decided at the time of the VLE review that the system should be maintained as a hosted operation]

As part of the process we were aware that several other institutions had conducted VLE reviews in the past year and contacted these to obtain a copy of their findings – some were more open than others (for obvious reasons).

This brief report is a summary of the six VLE reviews which we were able to obtain.

Reviews were instigated by either / and:

• Issues caused with current internal hosting
• An impending significant upgrade to the current system
• A perception that a move will save money

Four of the six will continue to use Blackboard; one is moving to Moodle on cost grounds; ** are considering moving to Moodle.

Uptime is considered a key issue for all reviews and most are considering, or have already moved to hosted option regardless of the product chosen.

Functionality reviews have tried to compare the latest features of each system and there is an inevitable cross over between them. Analysis of the reviews seems to indicate that Blackboard currently has a more intuitive structure ‘out of the box’. Flexible designs may be achieved in Moodle.

All reviews have noted that there is a ‘transition cost’ which pushes up the Total Cost of Ownership (TCO). Moodle options necessitate the need for a developer (or team) in house to make best use of the system and customise the interface.

The majority of academic staff within the reviews noted no pedagogical advantage in moving from Blackboard to Moodle and felt that any such a change would present a significant risk to the current status of the University’s core business and its likely future development. Retraining would be needed in any transition.

** noted that staff development and training needs were often overlooked, or severely underestimated in transitions. They had migrated to Moodle as a perceived cost saving.

Recommendations:

• The TCO of any migration is fully costed
• Staff and students need to be fully consulted in current and future needs
• Regardless of the option chosen – staff need to be fully supported and encouraged to make best use of it. Some current poor student reviews within the current VLE were prompted by poor academic engagement with the system rather than any lack of functionality.
• The review process must review the latest available version of each VLE.
• Considering the current IT infrastructure, we need to maintain a hosted solution regardless of the option selected.

The final report which was presented to the University Executive Group summarised the 4 month review process. Please note that some confidential details have been removed for obvious reasons.

The decision to remain with Blackboard for a further three years was based on a wide range of factors and not just the basic cost. The TCO which included price, cultural issues and migration meant that the decision was the best for Northampton at that time. I’m fully aware that other institutions will conduct reviews which will be conducted within a completely culture and with different needs which will lead them down a different path. We will be looking for a formal review again in 2014/15 – let’s hope that this is a ‘Caviar’ experience.

For further details on the review process please contact Rob Howe