Must run at Quant 4 or higher, 15tps or higher. Full Precision vs Quant not benchmarked.
Ben Kelly PRO
YellowjacketGames
AI & ML interests
None yet
Recent Activity
updated
a collection
about 3 hours ago
Small Models ( 8B max ) GTX 1660 Super
updated
a collection
about 3 hours ago
Small Models ( 8B max ) GTX 1660 Super
updated
a collection
about 3 hours ago
Small Models ( 8B max ) GTX 1660 Super
Organizations
None yet
