Nearly all Chinese frontier models now use linear attention and sparse attention/indexer-compression designs

nearly all Chinese frontier models now use linear attentionnearly all use sparse attention / indexer-compression designs

https://www.latent.space/p/ainews-nvidia-buys-huggingface-for