A short guide to evaluating analytics-led interventions, covering definitions of success, evaluation planning, possible indicators and the challenges of attributing changes to an intervention.
Ancillary, supplementary or associated files…
A short guide to evaluating analytics-led interventions, covering definitions of success, evaluation planning, possible indicators and the challenges of attributing changes to an intervention.
This two-page National Forum guidance note explores how higher education institutions can evaluate the effectiveness of analytics-led interventions. It encourages institutions to define what success means in relation to their own aims and to plan evaluation during the design and implementation of an analytics strategy.
The note distinguishes the ability to answer questions about students’ learning or engagement from the impact of actions taken in response. It highlights the difficulty of attributing changes to an intervention when other factors may also be involved. Possible indicators include engagement with learning resources, changes in individual students’ grades over time, use of support services, development of graduate attributes and changes in estimated withdrawal risk. It cautions against relying on grades alone or treating an observed improvement as proof of causation.
Creative Commons Attribution (CC BY)
This work is licensed under a CC BY license, allowing sharing and adaptation with proper attribution.
https://creativecommons.org/licenses/by/4.0/If you have modified or adopted this resource, share your version here. Tracking adaptations helps us measure impact and connects others with useful updates.