Principled Coarse-Grained Acceptance for Speculative Decoding in Speech
machinelearning.apple.com/research/coarse-grainedPrincipled Coarse-Graining (PCG) accelerates speech token generation by verifying proposals at the level of Acoustic Similarity Groups (ASGs) derived from the target model’s embedding space. This approach increases acceptance and throughput while maintaining intelligibility and speaker similarity.