Close

Presentation

PI-Whisper: Designing an Adaptive and Incremental Automatic Speech Recognition System for Edge Devices
DescriptionThree important challenges must be addressed for resource-constrained ASR models on the edge, i.e., adaptivity, incrementality, and inclusivity. We propose a novel ASR system, PI-Whisper, in this work and show how it can improve an ASR's recognition capabilities adaptively by identifying different speakers' characteristics, how such an adaption can be performed incrementally without repetitive retraining, and how it can improve the equity and fairness for diverse speaker groups. The proposed system attains all of these nice properties while achieving state-of-the-art accuracy with up to 13.7% reduction of the word error rate (WER) with linear scalability with respect to computing resources.