This presentation reports on the development of an innovative, data-driven assessment toolkit designed to support scalable, competency-based learning in STEM education. Developed with grant funding under QQI's anniversary funding call, the REAL assessment toolkit empowers educators to deliver precise, standards-aligned evaluations while providing students with personalised, error-specific feedback that builds confidence, fosters mastery, and supports progression across NFQ levels.

The project comprised four parts - mapping and consultation, toolkit development, evaluation, and dissemination. The toolkit created develops a range of quiz questions within the Moodle platform which expand the normal capabilities of online questions and investigate their suitability for a range of scenarios at NFQ levels 6-8. We also demonstrate how highly effective feedback can be embedded into question design. In addition, a wizard and repository were developed which allows for the development of new questions with a significantly reduced learning curve for new users.

The evaluation of the questions developed allowed for the creation of unique insights into the behaviour of students. Examples include student practice in laboratory classes, how students deal with their laboratory data and examining how students’ online engagement can affect success in passing a module.