National Resource Hub

A Threat Assessment Framework for Screening the Integrity of University Assessments in the Era of Large Language Models

Go to Resource

Creator(s)

Alan Hickey, Cathal Ó Faoláin, Emer Doheny, John Healy, Kevin Nolan, Paul Cuffe

Organisation(s)

University College Dublin

Discipline(s)

Education, Engineering, Generic programmes and qualifications, Manufacturing and Construction, Teaching & Learning

Topic(s)

Assessment and Feedback, Curriculum Design, Learning Analytics, Open Education

License

CC BY-SA

Media Format

PDF, PDF document

Date Submitted

Submitted by

Ana Rocha

Export Resource Data

Report an Issue

Description

A. Hickey, C. O’Faolain, J. Healy, K. Nolan, E. Doheny and P. Cuffe, “A Threat Assessment Framework for Screening the Integrity of University Assessments in the Era of Large Language Models”, presented at 8th IEEE International Forum on Research and Technologies for Society and Industry Innovation, Lecco, Italy, September 2024

Benefit of this resource and how to make the best use of it

Since late 2022, the sudden growth in the availability and capabilities of generative artificial intelligence tools, such as Large Language Models, has raised concerns about the threat they pose to the integrity of assessment in educational institutions. Such models are constantly evolving and improving, making the task of understanding exactly what they can do more difficult. Recognising this challenge, this paper establishes a Large Language Model exposure framework to qualitatively and quantitatively examine the assessment strategies of university modules to provide a high-level estimated indication of the exposure of these modules to potential dishonest use of such models in the completion of their assessments and coursework. This framework may be used and adapted when planning and reviewing teaching and learning practices and policies.

Creative Commons Attribution-ShareAlike (CC BY-SA)

This work is licensed under a CC BY-SA license, allowing adaptation and sharing with proper attribution, provided derivative works use the same license.

https://creativecommons.org/licenses/by-sa/4.0/
? This citation is automatically generated and may require adjustment. Always verify it against your style guide.
Hickey, A., Faoláin, C. Ó., Doheny, E., Healy, J., Nolan, K., & Cuffe, P. (2025). A threat assessment framework for screening the integrity of university assessments in the era of large language models. National Resource Hub (Ireland). Retrieved from: https://hub.teachingandlearning.ie/resource/a-threat-assessment-framework-for-screening-the-integrity-of-university-assessments-in-the-era-of-large-language-models/ License: Creative Commons Attribution-ShareAlike (CC BY-SA).

Adapting this resource? Share your version!

If you have modified or adopted this resource, share your version here. Tracking adaptations helps us measure impact and connects others with useful updates.

Share Your Version

Related OER

This survey was adapted from a North American Faculty OER Survey Toolkit for use in the Irish Higher Education context. It was used across the DOERs project partner sites to audit staff Open Educational Resources and Open Educational Practices awareness and practices. We encourage other institutions to adapt this tool to meet their needs.

The DOERs Project Open Educational Resources (OER) Institutional Survey

CC BY

Two modules are available on this page one for educators and one for mentors to learn how to engage in mentoring sessions with students. The page also has access to the Community Mentoring Handbook (for mentors), Mentee Toolkit (for second-level students taking part in sessions) and the Adult Ed Handbook(for adult learners taking part in sessions).

Community Mentoring Resources

CC 0

This document provides a summary of the book “MÉTODO DE LOS RELOJES. GRAMÁTICA DESCRIPTIVA DEL ESPAÑOL” authored by Manuel Perez Saiz, which serves as the foundation for the UCC Spanish grammar course.

Las Horas Summary Notes

CC BY-NC-SA

This Toolkit was created by students at University College Dublin, for students, to break down sustainability in a way that’s simple and easy to understand. Climate change is something that affects all of us—no matter what you’re studying, where you’re from, or what you do. It’s here, and it’s impacting our world—but many of us aren’t sure what we can do about it.

The purpose of this toolkit is a starting point for what students need to learn about living more sustainably on and off campus. We hope it’ll inspire students to take small steps that make a big impact, and they can do it all at their own pace. You can access the Moodle page to view the Toolkit. There are also Zip files of the SCORM packages used to create the Toolkit (Part 1 and Part 2) that can be downloaded and imported into a Virtual Learning Environment.

• Part 1: Climate Change → Watch short Youtube videos followed by a little quiz to brush up on your sustainability knowledge.
• Part 2: What Can You Do? → Find tips and tricks to incorporate sustainability into your day-to-day life, this is a resource tool to help you get started!

Sustainability Toolkit – SATLE 2022 project

CC BY-SA
Report an Issue

Name
This field is for validation purposes and should be left unchanged.