Parameter count is only meaningful alongside data quantity, compute allocation, and deployment conditions

Parameter count is only meaningful alongside three others — how much data you have, where you intend to spend your compute, and who will run the model, under what conditions.

https://www.latent.space/p/ainews-death-of-params-zai-ceo-jie