Resampling source prefixes without replacement and reweighting by inverse inclusion probability gives an unbiased estimator of target prefix probability in TLMs

Instead, we resample source prefixes without replacement and reweight each selected prefix by the inverse of its inclusion probability. We show that applying this correction recursively gives an unbiased estimator of the target prefix probability and lets us estimate the mass lost by threshold pruning.

http://arxiv.org/abs/2608.27428v1