Does your data spark joy? Performance gains from domain upsampling at the end of training Paper • 2406.03476 • Published Jun 5, 2024 • 4
agentica-org/DeepScaleR-1.5B-Preview Text Generation • 2B • Updated Apr 9, 2025 • 21.3k • 577
ByteDance-Seed/Seed-OSS-36B-Instruct Text Generation • 36B • Updated Aug 26, 2025 • 9.14k • 469
Running 131 TxT360: Trillion Extracted Text 📖 131 Explore and analyze the TxT360 dataset for LLM pre-training
MAGA: MAssive Genre-Audience Reformulation to Pretraining Corpus Expansion Paper • 2502.04235 • Published Feb 6, 2025 • 23
Running 3.62k The Ultra-Scale Playbook 🌌 3.62k The ultimate guide to training LLM on large GPU Clusters