Transduced language models can compute target prefix probabilities by composing a pretrained source language model with a functional finite-state transducer

Transduced language models (TLMs) compose a pretrained \emph{source} language model with a functional finite-state transducer to induce a language model over \emph{target} strings.

http://arxiv.org/abs/2608.27428v1