Pacers Sports & Entertainment
Live arena captioning with a custom speech model
Indiana Pacers' live captions reach a 1.14% error rate with a fine-tuned Azure speech model
Problem
The team wanted live captions for deaf, hard-of-hearing and non-English-speaking fans. Standard speech tools struggled with fast announcers, game terms, player names and arena noise.
Approach
The team fine-tuned a custom model in Azure AI Speech using hundreds of hours of Pacers and Fever broadcasts. Captions reach arena screens and the mobile app through Azure Functions and SignalR. English launched first, Spanish followed, and 12 more languages are planned.
Results
Takeaway
Caption error rate was 1.14%, against an original goal of 10%. Audio preparation dropped from up to five days to about two minutes.
Categories
- Industry
- Media and entertainment
- Business function
- Production and quality
- Innovation type
- Product and service innovation
- AI technology
- Generative AIConversational and voice AI
- Adoption
- Vendor solution
- Evidence
- Vendor's case study
Sources
Source summaries
Microsoft describes how the Pacers' parent company trained a speech model on its own broadcasts for live captions. It reports a 1.14% error rate and far shorter training prep.
Full details are in the original sources.