devngho PRO

devngho's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted a paper 5 days ago

Bolmo: Byteifying the Next Generation of Language Models

Paper • 2512.15586 • Published 10 days ago • 11

upvoted a collection 7 days ago

Kanana-2

Collection

Open Source Kanana-2 • 23 items • Updated 9 days ago • 17

upvoted a paper about 1 month ago

DoPE: Denoising Rotary Position Embedding

Paper • 2511.09146 • Published Nov 12 • 93

upvoted a collection about 1 month ago

📄 FinePDFs

Collection

81 items • Updated Nov 11 • 25

upvoted an article about 1 month ago

view article

Article

The 1 Billion Token Challenge: Finding the Perfect Pre-training Mix

• 

Nov 3

•

52

upvoted a paper about 1 year ago

Were RNNs All We Needed?

Paper • 2410.01201 • Published Oct 2, 2024 • 53

upvoted a collection over 1 year ago

Qwen2.5

Collection

Qwen2.5 language models, including pretrained and instruction-tuned models of 7 sizes, including 0.5B, 1.5B, 3B, 7B, 14B, 32B, and 72B. • 46 items • Updated Jul 21 • 671

upvoted a paper over 1 year ago

CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 Languages

Paper • 2309.09400 • Published Sep 17, 2023 • 85

upvoted an article over 1 year ago

view article

Article

Mergoo: Efficiently Build Your Own MoE LLM

• 

Jun 3, 2024

•

48

upvoted 4 papers over 1 year ago

Instruction Pre-Training: Language Models are Supervised Multitask Learners

Paper • 2406.14491 • Published Jun 20, 2024 • 95

Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling

Paper • 2304.01373 • Published Apr 3, 2023 • 9

Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies

Paper • 2407.13623 • Published Jul 18, 2024 • 56

Trans-Tokenization and Cross-lingual Vocabulary Transfers: Language Adaptation of LLMs for Low-Resource NLP

Paper • 2408.04303 • Published Aug 8, 2024 • 22

upvoted 2 articles over 1 year ago

view article

Article

Expanding Model Context and Creating Chat Models with a Single Click

• 

Apr 28, 2024

•

38

view article

Article

Can We Train Chat Models with Raw Data?

• 

Apr 25, 2024

•

19