In the denouement of the COVID-19 pandemic, talk of a return to “normalcy” in higher education belies the great challenges and ongoing disruptions that yet lie ahead for many institutions. Public perceptions of the value of postsecondary education continue their downward slide, placing institutions in the position of having to demonstrate their worth and find solutions to declining enrollments. Data and analytics capabilities continue to evolve, introducing new opportunities and new risks to the institution. Chief among these capabilities, generative AI promises to change teaching and learning in ways many of us have yet to fully understand or prepare for.
For this year’s teaching and learning Horizon Report, expert panelists’ discussions highlighted and wrestled with these present and looming challenges for higher education. This report summarizes the results of those discussions and serves as one vantage point on where our future may be headed.
Infographic promoting Moodle’s analytics graphs, which come packaged in a single block and offer a host of statistics and figures on various aspects of students’ Moodle usage
Infographic promoting Moodle’s activity completion feature, which allows the lecturer to assign completion criteria to specific activities and resources within Moodle
Infographic providing information on Moodle’s attendance feature, which allows lecturers to take attendance in Moodle and for individual students to see their own attendance record
Recording of National Forum Seminar December 2021 with Lee O Farrell, UCD; Mary Loftus, IT Sligo; and, Prof James Pickering & Dr Bronwen Swinnerton, University of Leeds (UK), chaired by Damien Raftery, IT Carlow
A teacher-focused summary of the European Commission’s 2013 teaching-quality report, with reflective questions on professional development, student partnership, course design and assessment.
A National Forum summary for institutional leaders of the European High Level Group’s June 2013 report, highlighting teaching quality, staff development, recognition of teaching and student partnership.
A two-page student-facing summary of the European High Level Group’s June 2013 report, exploring active learning, student voice, assessment, skills development and institutional support.
A student-facing introduction to learning analytics, explaining digital footprints, potential benefits for feedback and support, and questions students can ask about how their learning data is used.
A Forum Insight for higher education leaders introducing institutional uses of learning analytics and six considerations for planning an effective, sustainable implementation strategy.
A December 2016 introduction to learning analytics and educational data mining, outlining the National Forum project’s aims, three development phases and planned support for institutional analytics strategies.
An October 2017 National Forum Insight introducing ORLA, its purpose and its resources for institutional strategy, teaching practice and learning analytics case studies.
A September 2017 introduction to DESSI, outlining its approach to institution-specific strategies for data-enabled student success, including aims, governance, data, action, engagement and culture.
A four-page introduction to learning analytics for teaching staff, explaining how student data can inform feedback, engagement monitoring, resource use and timely support, alongside common questions and concerns.
A short introduction to how learning analytics can help teaching staff understand engagement, identify learning difficulties, review resource use and plan more targeted feedback and support.
Recording of a 6 November 2019 webinar exploring how quiz data, supportive communication and Moodle assessment information can inform teaching and student support, with examples from Irish and European higher education.
Recording of the 21 May 2019 National Forum webinar comparing Essex learner analytics, GMIT personalised feedback and UCD attendance-based student support, with discussion of implementation, data quality and effective interventions.
An ORLA guide to developing institutional learning analytics policies, drawing on international examples and offering questions and suggested actions across 25 policy themes.
An ORLA guide proposing six principles for ethical learning analytics, with explanations and practical actions to help institutions develop an approach centred on learning, trust and partnership.
A stakeholder guide to consultation in learning analytics implementation, explaining how students and staff across teaching, support, technical and governance roles can contribute to a shared institutional approach.
Seven historical Irish institutional case studies covering data integration, reporting platforms, engagement dashboards, IT support and analytics-led feedback, with practical examples of connecting information to action.
This guide details some of the key reporting features in Blackboard that can be of benefit to staff who teach that wish to employ a data-informed approach to their practice.
This guide details some of the key reporting features in Moodle that can be of benefit to staff who teach that wish to employ a data-informed approach to their practice.
This guide details some of the key reporting features in Sakai that can be of benefit to staff who teach that wish to employ a data-informed approach to their practice.
A detailed September 2017 introduction to DESSI, explaining its proposed institutional support process, commitments, policy context and possible steps for developing a data-enabled student success strategy.
A historical, pre-GDPR checklist adapting Data Protection Commissioner guidance to learning analytics, with questions on transparency, purpose, security, data quality, retention and access.
Guidance on supportive automated learning analytics communications using an Alert–Engage–Inform approach, with attention to sensitive wording, practical signposting and person-to-person support.
Data quality is a major challenge for most institutions as they begin to develop a data-enabled approach, but it is a critical early step. Any answers generated by your data will only be as accurate as the data itself. This resources highlights some of the key steps to ensuring the quality of the data you have access to.
The value of data lies in answering questions so knowing what question(s) you want to answer is an essential first step. This guide details some of the areas that data can be used to investigate.
An ORLA case study by Geraldine Gray showing how standard Moodle reports can flag gaps in online participation and prompt personal contact to offer support and strengthen belonging.
An ORLA case study by Patrick McGarry on using question-level examination analysis to identify learning difficulties, plan teaching changes and support annual module improvement.
An ORLA case study by Patrick McGarry on using a shared spreadsheet to coordinate assessment deadlines across modules and reduce peaks in student workload.
A short guide to evaluating analytics-led interventions, covering definitions of success, evaluation planning, possible indicators and the challenges of attributing changes to an intervention.
An ORLA case study by Mary Kelly on analysing Moodle activity and using personal emails to encourage participation in a blended teacher-education programme.
An ORLA case study by Dara Cassidy on using Moodle activity logs and student surveys to improve Hibernia College’s online orientation module and support students’ transition to online and blended learning.
An ORLA case study by Paula Carroll on combining attendance, Blackboard activity and assessment data to understand resource use in a large business statistics module.
An ORLA case study by Teresa Curtin and Gráinne Walsh on combining engagement and assessment data to connect first-year chemistry students with learning support.
An ORLA case study by James Brown on combining pre- and post-module multiple-choice results with student feedback to identify teaching changes and additional learning resources.
An ORLA teacher-education case study exploring how quantitative activity data and qualitative student feedback can be combined to guide module redesign.
An ORLA case study exploring a limited approach to VLE activity data, student communication and anonymous feedback, with attention to transparency and purpose.
An introductory report by Dr Paul Lambert examining data-protection and ethical questions institutions should consider before implementing learning analytics in Ireland.
A guide mapping potential institutional data sources to learning analytics questions, with considerations for data quality, operational suitability, privacy, transparency and institutional values.
A guide to framing learning analytics questions for institutions, lecturers and students, with illustrative data recipes and considerations for evidence, privacy, interpretation and practical action.
An ORLA case study by Irene O’Dowd analysing Moodle quiz completion and repeat attempts to explore participation across two years of a blended teacher-education programme.