I recently presented at a conference in relation to AI and assessment. I think this was reasonably good timing given JCQ had just released further guidance in relation to student coursework and AI plus AQA had announced they were going to use online testing as part of their exam suite in the Italian and Polish GCSEs starting from 2016. I think this is a positive step forward in both cases however I think it is important that we see this journey as more than simply replacing pencil and paper exams with a hall full of students completing the same exams but as an online/digital exam. There is significant potential here to ask ourselves what are we seeking to assess, why are we seeking to assess it and how are we best to assess?
The SAMR model
The SAMR model is useful when looking at technology change programmes. The first element of SAMR is that of simple substitution, similar to the example I gave above in the introduction. The concern for me is that this might be the goal being aimed at where technology and AI present such significant potential beyond mere substitution, and where the world has moved at a fast technologically drive pace, yet our education system has changed little, and our key assessment methodologies, of terminal coursework and exams have barely changed at all.
In looking to progress beyond substitution it might be useful to unpick some of the limitations of the current system. For this purpose I am going to focus purely on terminal exams given they are such a significant part of the current formal education system in the UK. So what are the limitations of the currently accepted system?
Logistics
One of the key drawbacks in the current system, as I see it, is the massive logistical challenge it presents. Students have to be filed into exams halls across the country and the world all at the same time, to complete exam papers which have been securely delivered to exam centres. Its quite an undertaking and even more so when you consider trying to keep the papers and questions secure. In a world of technology where content can quickly and easily be shared it doesn’t take much before questions are out in the open ahead of the exam, advantaging those who have seen the information when compared with those who have missed it. Then you have the issue of gathering all the completed papers up, sharing them with assessors to mark, quality assurance of marking and then eventual release of results to students some months later. This is a world where technology supports the sharing of information, written, audio, video and more instantly. Why cant the exams process be quicker and more streamlined, making use of technology to achieve this?
Diversity
Another key drawback has to be that of diversity. We, more than ever, identify the individual differences which exist in us all. Discussion of neurodiversity is common at the moment but despite this we still file all students into a hall to complete the same exam paper. Now there are exam concessions which can be provided to students but this barely scratches the surface in my opinion. Where is the valuing of diversity in all of this?
Methodology
We also need to acknowledge that the current exams system very much values those students who are able to memorise facts, processes, etc. Memorisation is so key to exams success however out in the real world we have access to ChatGPT and Google to find the information we need when we need it, with the key then being how we then interpret, validate and apply this information to the challenges or work in front of us. Shouldn’t the assessment methodology align with the requirements of the world we live in? Now I will acknowledge the important of key foundational knowledge so I not suggesting we stop teaching any basic knowledge, but knowledge and memorisation should be less of a focus than it is now.
Conclusion
I believe technology could address a lot of the drawbacks listed above. Now I note the use of technology will present its own challenges but how often do we find the “perfect” solution? Wouldn’t a solution which is easier for schools to administer, is quicker and more efficient, is more student centred and more in line with the world we now live in be a good thing?
Technology and Learning