Reducing the Output-Mode Gap in Speech Language Models via Joint-Output On-Policy Distillation

Autoregressive generation of interleaved text and acoustic tokens is a common approach to spoken-response generation in speech large language models. Although this design enables streaming generation with explicit textual guidance, generated acoustic tokens become part of the context for subsequent