South Australia Department for Education
EdChat school chatbot with content safety controls
South Australia trials EdChat in eight secondary schools with about 1,500 students and 150 teachers
Problem
Generative AI could help students and teachers, but the department had to keep students away from harmful or inappropriate content before using it in classrooms.
Approach
The department built EdChat with Microsoft and used Azure AI Content Safety to detect and block harmful content. It controls how the system is trained to moderate content, and school principals decided how widely it was used. An eight-week trial ran in eight secondary schools.
Results
Takeaway
The department judged EdChat safe for school use after the trial and planned to tune controls for different student groups as it expanded. About 20% of trial students used it actively.
Categories
- Size
- Large enterprise
- Industry
- Education
- Business function
- Internal work and knowledge management
- Innovation type
- Product and service innovation
- AI technology
- Generative AIConversational and voice AI
- Adoption
- Co-developed with a partner
- Goal
- Quality and risk
- Evidence
- Vendor's case study
Sources
Source summaries
Microsoft describes the department's EdChat trial and its use of content filtering to protect students. It gives the trial size and the share of students who used the chatbot.
Full details are in the original sources.