I took the Krea2 BF16 Safetensors from and made GGUF's Q80 and Q40, I also have the FP8Mixed version.
Modellquelle
Quellenbeschreibung
Converted from the full FP16 Krea2 model directly from Krea2 Hugginface repository.
FP8-Mixed models are specialized models that keep FP16 for the important weights, but quantize the "useless" ones. Making the model smaller, but still almost "full strenght"
You need to make the model compute_dtype FP16 to use otherwise it'll kick back errors. I use KJNode's "Checkpoint Loader" which allows you to set the set the compute_dtype to FP16. (It really does need to be FP16, or FP32, it will not work with BF16) The downside - it's very "polished" look, almost always digital illustration.
Quellen
1 QuelleModellartefakte
1 Artefaktkrea2TubroQ8FromBF16_krea2TurboFp8mixed.safetensors
safetensors · FP8_MIXED · 11,9 GB · SHA-256 e9aa38705d40…cfb7 · Civitai
HerunterladenQuellenauszüge
1 AuszugSource context: 233 downloads · Type Checkpoint · Base model Krea 2