Topik trending
#
Bonk Eco continues to show strength amid $USELESS rally
#
Pump.fun to raise $1B token sale, traders speculating on airdrop
#
Boop.Fun leading the way with a new launchpad on Solana.
Selalu menyenangkan melihat lebih banyak pekerjaan memperluas Diloco dan mengurangi kebutuhan bandwidth untuk prapelatihan!

22 Agu 2025
Introducing SparseLoCo: a communication-efficient method for LLM pre-training.
TL;DR: We leverage Top-k sparsification + error feedback with DiLoCo’s infrequent outer steps—communicating only 1–3% gradients with 2-bit quantization—outperforming DiLoCo and DeMo. 1/N,
ArXiv:
Github:

4,96K
Teratas
Peringkat
Favorit