how much Quantization decrease model's capability?
as the title, this is just for my reference, maybe i need a good reading material about how much Quantization influence model quality. i know the rule of thumb that lower Q = lower Quality.
as the title, this is just for my reference, maybe i need a good reading material about how much Quantization influence model quality. i know the rule of thumb that lower Q = lower Quality.