CAIeRO workshops are a time-intensive activity, requiring two full days from every member of the team to be most effective. With this in mind, it’s really worth taking the time in advance to agree what the team wants to achieve in that time. The person running the CAIeRO will be a trained facilitator or Learning Designer, and they will always request a pre-CAIeRO meeting, with at least the programme and module leaders but ideally with the whole team.
In the pre-CAIeRO meeting we will cover a range of topics including:
- Background to the programme. We’ll need an idea of what the course is about, who the tutors are, who the learners are, mode of delivery etc.
- Why do you need a CAIeRO? We’ll discuss any goals or challenges identified by the programme team that need to be addressed, and also any upcoming QA processes (validation, PSR) that need to be considered.
- What do you know about CAIeRO? We’ll give you an overview of what you can expect, what’s expected of you, and the deliverables.
- What skills and resources do we have available? We’ll review what experience the team has of course design, of teaching on the course, of delivering in the chosen mode, of using NILE etc.
- Who (else) needs to be there? We need at least all the staff on the teaching team. This means those who lead and teach on the modules under review, and ideally also those who teach the other modules in that year or programme. This helps promote a consistent experience from the student perspective, and also allows the shared vision and skills developed to be disseminated to other modules where appropriate. We will also need at least one ‘reality checker’ from outside the team (more on that later). But in order to get the design right, we might also want input from other stakeholders… Students? Academic Librarian? Learning Technologist? Embedded Quality Officer? CfAP? Critical friend? External Examiner? Employer?
- Logistics. When* and where? You’ll need a room with a screen, and with tables for laying out flip chart paper. And although fun, CAIeRO can also be hard work, so don’t forget the coffee and biscuits!
Once we have all the details worked out, your Learning Designer will create a CAIeRO planner document and send out the link to it. This is a working document that we will be using throughout the process. Before the CAIeRO itself, the team can use this document to record their aims for the module, reflections on student feedback, and any ideas or resources they want to include on the day.
*Note: the two days that make up a CAIeRO do not need to be consecutive. There are benefits to keeping the two days together to maintain momentum, but it can also be helpful to leave time in between for reflection, depending on how the team works best. It is important though to put both days in the diary at the beginning. Leaving the second day to be arranged later risks leaving the work half done, despite the best of intentions…
This is one in a series of posts about the CAIeRO process. To see the full list, go the original post: De-mystifying the CAIeRO.
Need a CAIeRO? Email the Learning Design team at LD@northampton.ac.uk.
“I keep hearing about this CAIeRO thing, but I don’t really know what it is…”
CAIeRO stands for “Creating Aligned Interactive educational Resource Opportunities”. If you’re wondering, yes, there is a theme here. The acronym was chosen (although not by me) to align with the Northampton Integrated Learning Environment (NILE).
So what does it actually mean? Think of it as a Course Design Retreat – a full module CAIeRO is two days away from the phone and the email, to build or re-design taught modules, with support from a range of specialist staff. Every CAIeRO will be different, but broadly speaking the workshop has two aims – to develop the modules themselves, and to help the teaching team to develop their course design skills.
This is the first in a series of blog posts examining the different elements of the CAIeRO course design process. The series will cover all of the key interactions, from the pre-CAIeRO meeting through to follow up activities. It will discuss the tools and techniques used in CAIeRO, and their role in course design.
I hope these posts will provide an insight into the process for those that are new to CAIeRO, as well as a reminder for those who have participated in or facilitated sessions. CAIeRO is a work in progress, and we’d love to hear about your experiences, so please feel free to add your own comments, insights and suggestions.
Links to the posts will be added below as they are published. You can also click on the image to see a visual overview of the CAIeRO process.
De-mystifying the CAIeRO:
- The pre-CAIeRO meeting
- Programme level CAIeRO
- CAIeRO Stage 1: The blueprint
- CAIeRO Stage 2: The storyboard
- CAIeRO Stages 3-5, let’s get building!
- CAIeRO Stages 6 and 7, planning and reflecting
Need a CAIeRO? Email the Learning Design team at LD@northampton.ac.uk.
For more information about the development of the CAIeRO methodology, research into the use of CAIeRO, and guidance on how to become a facilitator, see the Introduction to CAIeRO page on our ILT website.
A typical module CAIeRO will often start with programme level exercises, such as agreeing or reviewing the mission, ‘look and feel’, and learning outcomes for the programme as a whole. It’s in the interests of the teaching team – and the students – to (re-)use these elements of the programme’s blueprint when designing at module level – it helps to promote coherence and consistency, and to minimise unintentional duplication. But focusing on the module level, while necessary for planning and supporting good learning, can sometimes lead to a fragmented approach over time. Sometimes you need to take a step back to see the bigger picture.
The Learning Design team are often asked to support teams who need to review and make changes at the programme level. As with module CAIeROs, the reasons for this can be many and varied: maybe it’s a new programme or pathway; maybe there have been significant changes in staffing or in the subject area; maybe the team want to respond to specific institutional agendas or to challenges identified in student feedback or grades; maybe it’s just been a long time since the programme was reviewed as a whole and the team want to ensure that iterative changes at the module level haven’t affected the coherence of the award map. Programme level CAIeROs can be as diverse and bespoke as module level ones, but there are some common goals, and as a team we are always refining our toolkit to support them. You may find you use some of the steps below more or less depending on your needs, but this post, along with the Programme Planner developed by our very own Rob Farmer, will give you an idea of some of the approaches available to you.
Before you start: (Re)establishing consensus
The programme ‘blueprint’
As always we suggest you start by defining the intended outcomes, if you don’t have these already. Although programme outcomes are slightly different to module outcomes, because they are not directly assessed, many of the same principles still apply. They need to be aligned with national quality standards (e.g. the FHEQ and Subject Benchmark Statements), and with any relevant Professional, Statutory and Regulatory Body (PSRB) requirements if the programme is accredited – and of course they have to make sense to non-experts, including students and employers. Once you have your programme outcomes, you can start thinking about breaking them down into chunks of learning that will form your taught modules – or, for existing programmes, reviewing how well they map to the modules you already have in place. Do you need to add, remove, combine or split anything?
Sequencing learning
Taking a programme level perspective allows you to plan the development of understanding and skills across a larger timeframe, to make sure that the scaffold is sound and your students aren’t missing a foundation piece when they reach the higher levels. To get the sequence right, you can storyboard your programme using a range of tools, from paper and post-its to Powerpoint or Popplet. Move the pieces around until the order seems logical, and think about whether each piece needs to be ‘short and fat’ (intensive) or ‘long and thin’. At this stage you might want to consider the placement of elements that are more complicated to schedule, like placements and trips, as well as those over which you have no control, like holidays and closed days.
Mapping assessment and feedback
It can be really useful to overlay your assessments on to your programme storyboard, to give you an idea of the mix of assessment activity and also to identify any deadline and marking ‘bottlenecks’. Programme leaders will usually collate details of the summative assessments across a programme, because this information is required for processes like validation, but we would encourage you to do this for your formative assessment opportunities too. This will allow you to easily see the turnaround time and where students will receive their feedback – and to identify whether it is timely enough to be useful for the next summative task! If you don’t know yet how your modules will be assessed, make a note to come back to this step, or keep a ‘work in progress’ version that you can update with more detail as you go on.
Key skills and ChANGE skills
Programme design can be a complex business – and this is before you even get in to the details of the individual modules! We recommend that teams who have a lot to do at the programme level leave at least a full day for this type of work, before moving on to the module level CAIeROs.
This is one in a series of posts about the CAIeRO process. To see the full list, go the original post: De-mystifying the CAIeRO.
Need a CAIeRO? Email the Learning Design team at LD@northampton.ac.uk.
In 2010, Roshni Khatri presented on students perceptions of online audio and online text based feedback. Her experiences on feedback were also further disseminated in the Submission and Grading Electronically (SaGE) working group on 17th December, 2014 as they were felt to be still relevant to current cohorts.
Roshni indicated that the majority of students preferred the audio feedback when compared to the online feedback.
Students commented that:
- ‘The online written feedback was visual and suits my learning style.’
- ‘I heard my name and I paid attention!’
- ‘really helpful for me as I am able to go over the proposal and know which bits you are explaining about. I find this more helpful than having written feedback.’
The presentation noted benefits and problems with the process and made suggestions for further work.
Although we suggest using the Media Gallery on NILE for students to submit work to, there are a couple of drawbacks. You would need to add feedback and marks through a Grade Centre column and students cannot see their submitted work in the media gallery, which has led to a few anxious calls to the LearnTech helpdesk.
The alternative is to use a standard Blackboard Assignment (not Turnitin) and allow students to use the Kaltura Mashup tool – which is part of the text box editor. This creates a Grade Centre column and students will have more confidence that they have submitted their work.
It does require clear guidance though so we have created a basic explanation (with screenshots that will work in any module), that you can paste into the description text box (use the HTML editor) to get you started.
You may be having trouble getting Kaltura screen recorder to work. It turns out that with the latest version of Java as a security feature, applets get blocked if their HTML source and jar file are on different servers. To overcome this, you need to add an exception for both https://nile.northampton.ac.uk/ and https://cdnsecakmi.kaltura.com – this does do the trick! The link below explains it in detail: http://www.java.com/en/download/help/java_blocked.xml (Thank you to Dr.Hendrix, for tracking down this solution).
How does it work on a mac? It appears to VERY picky about browser, OS and java versions. We got it to work in Safari on OSX v10.9.3 with Java 7 – running the NILE site in “Unsafe mode” by going to Safari Preferences > Security > Manage Website Settings > Select Java from the left and selecting ‘Run in unsafe mode’ for nile.northampton.ac.uk. Not ideal, but until Kaltura and the latest version of Java are in synch, it is at least possible to get it to work.
Please contact IT Services (rather than LearnTech) on ext. 3333, if you need to get this working on a uni machine.
Images and interactivity encourage students to explore content more willingly that a list of links and anything that can facilitate students to generate and share content themselves outside of the rather clunky discussion boards and blogs within NILE is always welcome.
thinglink is a free picture annotation tool website that allows content to be linked to external resources and then be embedded in your NILE site or blog. There are also editors available as IOS or Android apps.
Possible uses are as a ‘visual portal’ for students to access further information and resources or – if the thinglink is set to public – as a shared activity where students can add links and annotations to a picture as a class or as part of a group.
You can find more details and try using example thinglinks in this NILEX review.
Thanks to Belinda Green for spotting the usefulness of this app in Education and sharing.
We’re well into assignment season and support calls are beginning to increase in relation to missing assignment submission points, incorrect settings preventing students from uploading one or more versions, apparently missing assignment submission in Grade Centre, grades being released too early (or never) and scores instead of letter grades being given to students.
While it might be tempting to blame the computer*, it’s usually just being a little rusty that’s at the root of the problem. Please take a few minutes to remind yourself of the simple things to do before and after marking to avoid problems by looking at the SaGE survival guide.
NILE isn’t without its problems, but we must be honest with students if we are to be able to interpret their feedback on this critical part of their student experience.
* and posting this in an announcement!
Great learning design and quality assurance are two sides of the same coin. When you make changes to a module or programme, there are a range of QA procedures that might apply, and it helps to understand how these processes interlink – particularly when planning ahead.
New programmes or modules
When writing a new module or programme, a CAIeRO workshop can help you with everything from writing the learning outcomes, to choosing the assessment and creating the learning activities. The first day of the workshop will help you set the foundations, and the second day helps ensure these are workable in practice.
New programmes and modules are subject to validation, and as part of this process you will be required to write a rationale for the new offering. The planning work you do in the CAIeRO can help you complete this, as it includes consideration of strategic goals, the student experience, and resource and training requirements. The CAIeRO process can also help you firm up your curriculum documentation (also required for validation), and make decisions about the allocation of teaching and learning hours, assessment strategy and more. In addition to documentation, the CAIeRO can help you get started creating sample teaching materials, which are required for validation of distance learning programmes.
At the University, many validations can be completed online, but some (particularly those involving PSRBs) require a validation event. For these programmes, validations usually take place in the Spring term. For a new programme starting in September, you should aim for validation early in the term to allow the maximum possible time for development of the course materials (if you want the course to start the following January, you might aim for validation later, in March or April). This means you should be scheduling your CAIeRO in the previous Autumn term.
For more on the validation process, see the validation page of the website, which has information and links to the handbook..
Periodic subject reviews
PSRs are a chance to reflect on what has worked well in your teaching over the previous five years. It is also a great opportunity to use those reflections to define the future direction of the programmes involved. The CAIeRO process can be used to support this process in a number of ways: as a ‘health check’ or review of a programme; to target specific issues you may have identified; and/or to plan how to implement changes you’d like to make.
For PSR you will be required to submit a Self-Evaluation Document (SED). This document will ask you to reflect on things like alignment with frameworks and standards, the currency of the curriculum and student achievement and feedback. All of these elements can be considered within the CAIeRO process, to help you complete the SED form and prepare for any questions during the PSR event.
At the University, PSRs usually take place in the Autumn term, and the documentation is submitted in advance. CAIeROs for PSR can be scheduled at any point in the year (although you may want to note the Change of Approval guidance below when considering timing).
For more on the PSR process, see the PSR page on the website, which has information and links to the handbooks.
Ongoing review of delivery
Of course, adjusting and adapting your teaching and assessment practice happens all year round, and is not dependent on big events like those listed above. You might have taken over a module or programme, or be considering a more blended approach, or just want to try a new idea you’ve heard about. You can book a CAIeRO for issues like this at any time in the year, but you should be conscious of timing the implementation of these changes, and the possible impact on the student experience.
Wherever possible, you should avoid making big changes that will affect current delivery of a module or programme part way through. In addition to this, for level 5 and 6 modules, be aware that students need to know what to expect when they make their module choices. Any changes made after students have chosen the module should be made in consultation with those students.
Changes to existing modules and programmes are achieved through the Change of Approval process, which recognises three levels of change (based on degree of impact). Type B and C changes (more substantial than Type A) must be submitted well in advance of the proposed delivery, and for levels 5 and 6, in advance of the publication of module information to students. For 2015/16 delivery, the deadline for change of approvals for these modules is 13 January (for levels 4 and 7, the deadline is May).
For more on this process, see the Change of Approval page on the website, which has information and links to the handbooks.
Learntech have been examining the world of free online polling tools this week in response to a number of requests. While there are several alternatives with different strengths an weaknesses, Polldaddy stands out as a flexible tool to use in a variety of situations – as a brief informal piece of formative assessment, a survey/poll or just feedback on a piece of content or activity. These items embed very well within NILE. There is a fuller description of Polldaddy on the NILE External Tools blog.
It requires an email registration on the WordPress.com site, with which it is also tightly integrated.
Recent Posts
- LearnTech Symposium 2025
- Blackboard Upgrade – August 2025
- H5P (HTML5 package) content types meets the needs of Jim Atkinson, Staff Development Trainer
- Blackboard Upgrade – July 2025
- StudySmart 2 – Student Posters
- NILE Ultra Course Award Winners 2025
- Blackboard Upgrade – June 2025
- Learning Technology / NILE Community Group
- Blackboard Upgrade – May 2025
- Blackboard Upgrade – April 2025
Tags
ABL Practitioner Stories Academic Skills Accessibility Active Blended Learning (ABL) ADE AI Artificial Intelligence Assessment Design Assessment Tools Blackboard Blackboard Learn Blackboard Upgrade Blended Learning Blogs CAIeRO Collaborate Collaboration Distance Learning Feedback FHES Flipped Learning iNorthampton iPad Kaltura Learner Experience MALT Mobile Newsletter NILE NILE Ultra Outside the box Panopto Presentations Quality Reflection SHED Submitting and Grading Electronically (SaGE) Turnitin Ultra Ultra Upgrade Update Updates Video Waterside XerteArchives
Site Admin