The task-performance gains of ES are only contributed to a sparse subset of larger-magnitude updates despite substantial whole-model parameter drift

we find that despite substantial whole-model parameter drift, the task-performance gains of ES are only contributed to a sparse subset of larger-magnitude updates.

http://arxiv.org/abs/2608.27351v1