← Cases
AustraliaPublic sector2018 – ongoing

IP Australia

Patent Auto Classifier for routing applications

An audit found IP Australia's patent classifier averaged 64.7% correct classifications

In progressRegulator, audit or court

Problem

Patent applications needed classification by technical subject before reaching the appropriate examination team. Incorrect routing required examiners to redirect applications.

Approach

IP Australia implemented the Patent Auto Classifier in 2018. It processed application text with natural language processing and scored relevant patent-classification symbols. Applications went to the examination queue associated with the highest relevance, with staff correcting routing errors.

Results

64.7%average correct classifications in ANAO's analysis through November 2025Regulator, audit or court[1]
27.5%classifications missing in the same analysisRegulator, audit or court[1]
7.8%classifications incorrect in the same analysisRegulator, audit or court[1]

Takeaway

Annual retraining coexisted with persistent classification gaps. The auditor identified an opportunity to analyse existing performance data for emerging problems.

Categories

Business function
Production and quality
Innovation type
Process innovation
Evidence
Regulator, audit or court

Sources

  1. Artificial Intelligence Use in IP Australia
    Australian National Audit Office29 Jun 2026Regulator, audit or court document

Source summaries

[1]Australian National Audit Office29 Jun 2026

ANAO examined deployed patent-processing AI and tested the classifier in detail. It reported correct, missing and incorrect classification shares and identified opportunities for better performance monitoring, without finding that the classifier had been withdrawn.

Full details are in the original sources.

Added 1 Nov 2026 · Updated 1 Nov 2026
Open case page ↗