Australian Government (Digital Transformation Agency)
Whole-of-government Microsoft 365 Copilot trial
Australia's six-month Copilot trial across federal agencies found moderate use, with only a third of staff using it daily
Problem
Federal agencies wanted to know whether a generative AI assistant built into everyday office software would save public servants time, and what risks it would bring for records, privacy and skills.
Approach
The Digital Transformation Agency coordinated a trial of Microsoft 365 Copilot from January to June 2024 with 5,765 licences spread across dozens of agencies, which nominated the participating staff. The evaluation, published in October 2024, relied on surveys and interviews in which staff assessed their own use and time savings. It made no specific recommendation to embed Copilot in daily operations.
Results
Takeaway
Staff reported saving time on summaries and first drafts, and training was linked to greater use. Savings were self-reported by agency-selected staff, with no direct measurement.
Categories
- Size
- Large enterprise
- Industry
- Public sector
- Business function
- Internal work and knowledge management
- Innovation type
- Process innovationOrganization and ways of working
- AI technology
- Generative AI
- Adoption
- Off-the-shelf tool or platform
- Evidence
- Company's own claim
Sources
Source summaries
iTnews reports the DTA's evaluation of 5,765 Copilot licences used in the first half of 2024. About two thirds of participants used the tool a few times a week or less, and belief it would cut email time fell 32% and meeting time 54%. The evaluation relied entirely on self-assessment, and executives were over-represented.
The Decoder reports the evaluation across 56 agencies. Participants estimated time savings of 1.1 hours a day for summarising and one hour for document drafting, and 77% were positive about the tool. They raised concerns about data security, bias, loss of skills and effects on entry-level administrative roles.
GovTech Review reports that the trial ran in the first six months of 2024 and that usage was rated moderate, with a third of participants using Copilot daily. It says 46% found value a few times a week and that the largest efficiency gains were among junior and middle APS grades and ICT roles. It reports over 7,600 participants in more than 60 agencies.
Full details are in the original sources.