devngho
/

phi4-jamo-tokenizer

Model card Files Files and versions

phi4-jamo-tokenizer / tokenizer.json

devngho's picture

Fix bos token

ecbdfb8 verified 10 months ago

history blame contribute delete

11.3 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )

SHA256:: b535a26b9b09cb661b5642a9ddffbb577d45cb1bf872e3039b975d6b67a16ed6
Pointer size:: 133 Bytes
Size of remote file:: 11.3 MB
Xet hash:: 0c967d82c6ea7805f32030480c8cb770db9fd384649961dbd05ca579650ab079

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.