목차
Title page 1
Contents 2
Executive Summary 7
Education hackathons 7
Hackathon Outcomes 8
PoC Development 8
User Research 9
Introduction 11
Project Aims 11
Project structure and phases 11
Summary of PoC build 14
Outline of the 3 strands of user research 17
Hackathon Findings 19
Summary 19
Summary of key use cases 23
User Research Findings 30
Introduction 30
Methods 31
Results 32
Conclusions 45
User research conclusions 45
Suggested areas of future focus 46
Further work in progress 49
Recommendations for delivery of future hackathons 50
Annex 1: Summary of pre-Hackathon consultation findings 53
Overview 53
Aims 53
Methods 54
Findings 56
Enablers and barriers to AI use 64
Next steps 65
Annex 2: Full Hackathon findings report (November 2023) 66
Introduction 66
Potential barriers to Generative AI adoption 67
Use cases for Teachers 69
Use cases for School Leaders and Administrators 78
Use case for Students 81
Annex 3: AI mini-hackathons project summary 84
Background to the project 84
The aims of the hackathon 84
What did we do? 85
What did we learn? 85
Annex 4: Membership of steering committee 89
Annex 5: Methods for user research 90
Methods 90
Sample and sampling strategy 90
Materials and Procedure 91
Annex 6/Annex 5: Prompts used in the Hackathons 93
Generating age-appropriate lesson plans 93
Generating effective questioning materials 95
Marking a KS2 essay based on a modified mark scheme and providing personalised feedback 97
Providing feedback on students' work in a way meaningful to students 98
Prompt used to generate newsletter articles, using standardised data fields (parent-carer communications) 100
Prompt used to simplify text for students (lesson materials) 101
Hallucination in creating end-of-year reports, with the hallucination highlighted in bold italics 103
Writing end-of-year reports for other teachers based on key information 104
Prompting the LLM to create a vocabulary list with simple prompting (language learning assistant) 106
Prompting the LLM to correct a student's work by providing steps to follow and one-shot prompting 106
Adjusting data literacy policies in line with school values 107
Providing detailed context for adapting school policy 110
Creating policy-based scenarios for testing with staff 111
Generating newsletters based on short user inputs 113
Mandarin language assistant 115
Annex 7/Annex 6: Key Terms 118
Annex 8/Annex 7: References 119
Tables 6
Table 1. 8 use cases selected as having potential to develop to PoC 13
Table 2. Participants in each strand of user research 18
Table 3. Use cases explored during the hackathons 20
Table 4. Summary of user feedback for generating age-appropriate lesson plans 23
Table 5. Summary of user feedback for generating effective questioning ideas 24
Table 6. Summary of user feedback for generating lesson materials 24
Table 7. Summary of user feedback for assigning marks to work submitted by students 25
Table 8. Summary of user feedback for generating personalised formative feedback and addressing student misconceptions 27
Table 9. Summary of user feedback for generating drafts of statutory policies 28
Table 10. Summary of user feedback for generating pupil or class data analysis and synthesis 28
Table 11. Summary of top five time saving use cases across teachers, leaders and administrators 62
Table 12. Summary of top five professional development use cases across teachers, leaders and administrators 63
Table 13/Table 14. Teacher sample and school contexts 90
Figures 5
Figure 1. Screenshot of the essay upload user interface 15
Figure 2. Screenshot of the teacher feedback user view 15
Figure 3. Screenshot of the student feedback user view 16
Figure 4. Screenshot of the student task user view 17
Figure 5. Opportunities and risks associated with using GenAI tools for assessment and feedback 33
Figure 6. Needs identified by teachers based on their perceived barriers and facilitators to GenAI adoption in schools 40
Figure 7. Breakdown of survey stakeholders by role 54
Figure 8. Venn diagram to show the overlap in teachers' use case choices for time saving and strengthening practice 57
