Wattle Events

GenAI vs Higher Education Assessment

More than a year has passed since reports of ChatGPT-3.5’s capability to pass exams sent shockwaves through education circles. These initial concerns led to a multi-institutional and multi-disciplinary study to assess the performance of Generative Artificial Intelligence (GenAI) against assessment tasks used across 10 engineering subjects, showcasing the capability of GenAI.

Assessment types included online quiz, numerical, oral, visual, programming and writing (experimentation, project, reflection and critical thinking, and research). This work was award-winning and broke readership records. Twelve months later, the study was repeated using new and updated tools ChatGPT-4, Copilot, Gemini, SciSpace and Wolfram. The updated study investigated the performance and capability differences, identifying the best tool for each assessment type. This presentation by Dr Sasha Nikolic provides insights into performance differences across the various tools.

The GenAI Assessment Security and Integration Opportunity Matrix is presented as a framework to support teaching staff moving forward. Full insights available at https://doi.org/10.1080/22054952.2024.2372154.

Date: 4 September 2024
Time: 1:30pm - 2:30pm
Location: Online
Presenters: Sasha Nikolic

Brief Biographical for Presenter

Sasha Nikolic is a Senior Lecturer in Engineering Education at the University of Wollongong. Dr Nikolic has received awards for his contribution to engineering education through the IEEE, AAEE, ASCILITE, UOW, AAUT and other institutions. He became a Senior IEEE Member in 2015 and is a Senior Fellow of the Wollongong Academy of Tertiary Teaching and Learning Excellence. Sasha has served in the development of engineering education internationally, including General Co-Chair for IEEE TALE2018, Chair for the IEEE New South Wales Section 2018-2019, Secretary of the IEEE Australia Council 2021-2022 and has served on many IEEE committees. He is an Executive Committee member of the Australasian Association of Engineering Education and has been a committee member of the annual conference since 2021.

Sasha is the founding president of the Australasian Artificial Intelligence in Engineering Education Centre, a collaboration of 14 universities. The centre's work strives to identify the risks and opportunities of working alongside GenAI and provides many implementation exemplars.