As generative AI technologies have become increasingly powerful and available, online assessments need to be reviewed and re-evaluated to maintain their educational value. Open-book online quizzes have long been an effective tool for engaging students and reinforcing fundamental knowledge and skills. However, the ease of using AI to complete these quizzes may undermine their intended purpose. Students are likely to have access to many generative AI tools, including an institutional version of MS Copilot Chat which is included within Office 365. It has become more powerful in 2025 and is now powered by GPT-4o, with file upload, code interpreter and data protection. Agentic tools are emerging for automating the completion of online quizzes.

This presentation will explore the findings of a short 2025 study using MS Copilot Chat, to answer a series of online quizzes used for continuous assessment in a first-year quantitative techniques module. The results will be compared to previously published results for ChatGPT for the same quizzes (Raftery 2025), and consider the accuracy of answers, the ease of use and the usefulness of explanations for students. The implications will be discussed, along with considerations for whether and how to integrate generative AI into the learning and assessment process.

Raftery, D. (2023). Will ChatGPT pass the online quizzes? Adapting an assessment strategy in the age of generative AI. Irish Journal of Technology Enhanced Learning 7(1) https://doi.org/10.22554/ijtel.v7i1.114