YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

phi-2 quantized using imatrix data from kalomaze's groups_merged.txt

Perplexities: Q8_0: 5.3886 Q4_0: 5.5526 IQ3_XXS: 6.0745 IQ2_XS: 7.2570 IQ2_XXS: 9.3666 IQ1_S: 18.7885

Downloads last month
14
GGUF
Model size
3B params
Architecture
phi2
Hardware compatibility
Log In to view the estimation

1-bit

2-bit

3-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support