A Threat Assessment Framework for Screening the Integrity of University Assessments in the Era of Large Language Models

[favorite_button]

Creator(s)

Alan Hickey, Cathal Ó Faoláin, Emer Doheny, John Healy, Kevin Nolan, Paul Cuffe

Organisation(s)

University College Dublin

Discipline(s)

Education, Engineering, Generic programmes and qualifications, Manufacturing and Construction, Teaching & Learning

Topic(s)

Assessment and Feedback, Curriculum Design, Learning Analytics, Open Education

License

CC BY-SA

Media Format

PDF, PDF document

Date Submitted

Submitted by

Export Resource Data

Description

A. Hickey, C. O’Faolain, J. Healy, K. Nolan, E. Doheny and P. Cuffe, “A Threat Assessment Framework for Screening the Integrity of University Assessments in the Era of Large Language Models”, presented at 8th IEEE International Forum on Research and Technologies for Society and Industry Innovation, Lecco, Italy, September 2024

Benefit of this resource and how to make the best use of it

Since late 2022, the sudden growth in the availability and capabilities of generative artificial intelligence tools, such as Large Language Models, has raised concerns about the threat they pose to the integrity of assessment in educational institutions. Such models are constantly evolving and improving, making the task of understanding exactly what they can do more difficult. Recognising this challenge, this paper establishes a Large Language Model exposure framework to qualitatively and quantitatively examine the assessment strategies of university modules to provide a high-level estimated indication of the exposure of these modules to potential dishonest use of such models in the completion of their assessments and coursework. This framework may be used and adapted when planning and reviewing teaching and learning practices and policies.

Creative Commons Attribution-ShareAlike (CC BY-SA)

This work is licensed under a CC BY-SA license, allowing adaptation and sharing with proper attribution, provided derivative works use the same license.

https://creativecommons.org/licenses/by-sa/4.0/
? This citation is automatically generated and may require adjustment. Always verify it against your style guide.
Hickey, A., Faoláin, C. Ó., Doheny, E., Healy, J., Nolan, K., & Cuffe, P. (2025). A threat assessment framework for screening the integrity of university assessments in the era of large language models. National Resource Hub (Ireland). Retrieved from: https://hub.teachingandlearning.ie/resource/a-threat-assessment-framework-for-screening-the-integrity-of-university-assessments-in-the-era-of-large-language-models/ License: Creative Commons Attribution-ShareAlike (CC BY-SA).

Adapting this resource? Share your version!

If you have modified or adopted this resource, share your version here. Tracking adaptations helps us measure impact and connects others with useful updates.

Related OER

This poster offers educators an overview of designing a syllabus on the Canvas learning management system that supports personalised learning pathways. It highlights (1) a gamified pedagogy grounded in gaming principles and (2) adaptive learning strategies using MasteryPaths.

This toolkit draws on our experiences facilitating a SATLE-funded community-engaged learning project that brought students of the School of Languages, Literatures, and Cultures (UCC) together with people in Cork seeking international protection for a series of three wellbeing and creativity workshops.

The HEA Education for Sustainable Development Spotlight Series 2025: Case Studies Compendium brings together 115 case studies from higher education institutions across Ireland. It showcases how universities and colleges are integrating sustainability and the UN Sustainable Development Goals into teaching, research, curriculum design, assessment practices and community engagement. It offers a comprehensive picture of national ESD activity and provides an accessible resource for educators and policymakers seeking examples of practice-based innovation.