A centered-softplus reformulation of DPO is argmin-equivalent for β>0 while making the inverse preference-noise-scale and learning-rate effects explicit and independently tunable

a centered-softplus reformulation that is argmin-equivalent to DPO for $β>0$, while making the inverse preference-noise-scale and learning-rate effects explicit and independently tunable

http://arxiv.org/abs/2608.27032v1