A comparative analysis of human-generated and AI-generated educational content and their different impact on student's experience and learning
Lead institution: University of Derby
Country: United Kingdom
Project primary contact: Dr Gary F. Fisher (g.fisher@derby.ac.uk), Senior Learning Designer
Additional contact: Associate Professor Dean Fido (d.fido@derby.ac.uk) and Associate Professor Paula Shaw (p.shaw@derby.ac.uk)
Project Title: A comparative analysis of human-generated and AI-generated educational content and their different impact on student's experience and learning
The project is: Has finished
Project Summary:
Our project evaluates the extent to which generative AI can serve as a co-designer in the production of teaching and learning materials. Through a rigorous process of prompt engineering, we have worked with ChatGPT to design an AI-enhanced version of a set of existing human-written teaching and learning materials being delivered to our students. Employing a mixed-methods evaluation involving a psycholinguistic analysis and a quantitative survey of a large sample of students (n=361) who were exposed to both the AI-generated and human-generated educational content, we have robustly evaluated the comparative impact that each of these samples had on student experience and outcomes.
This has enabled us to assess the extent to which generative AI can act as a tool to assist in the production of educational material and augment the capacity of academic practitioners in the face of continually growing workloads. We demonstrate how, with appropriate prompts delivered by an academic professional with advanced subject expertise, generative AI tools can efficiently support the production of highly effective educational materials. Moreover, through this evaluation, we have proposed and piloted a robust research protocol to support further investigation into the field.
Impact: Our project demonstrates and evaluates the potential of generative AI to significantly enhance the effectiveness of academic teaching materials and the efficiency with which they are produced.
Audience: The project impacts educators who seek innovative strategies to enhance the quality of teaching materials while simultaneously augmenting their own productivity, in addition to benefiting students who gain access to high-quality educational materials and academic educators with increased capacity.
This output is part of a member project - AI Garage: Creating the Future Now which collects and curates cutting-edge practice examples of AI. You can explore other submissions here.