Have a ComfyUI workflow? Get a readable Workflow Doc in your browser.Make a workflow readable.Try it now ↗
This are the quantizations of the model LightOnOCR-2-1B-ocr-soup
Model source
Source description
This are the quantizations of the model LightOnOCR-2-1B-ocr-soup
Try to use the best quality you can run.
Quality order: BF16 > F16 > Q8_0 > Q6_K > Q5_K_M > IQ4_NL > IQ4_XS > Q4_K_M
For the mmproj, try to use the F32 version as it will produce the best results.
Quality order: F32 > BF16 > F16
Sources
1 sourceVerified Sep 10
Model artifacts
12 artifactsSource excerpts
2 excerpts--- pipeline_tag: image-to-text base_model: lightonai/LightOnOCR-2-1B-ocr-soup --- This are the quantizations of the model [LightOnOCR-2-1B-ocr-soup](https://huggingface.co/lightonai/LightOnOCR-2-1B-ocr-soup) Try to use the best quality you can run. Quality order: BF16 > F16 > Q8_0 > Q6_K > Q5_K_M > IQ4_NL > IQ4_XS > Q4_K_M For the mmproj, try to use the F32 version as it will produce the best results. Quality order: F32 > BF16 > F16
LightOnOCR-2-1B-ocr-soup-F16.gguf
gguf · 1.12 GB · SHA-256 11a26bcc98d4…b604 · Hugging Face
LightOnOCR-2-1B-ocr-soup-IQ4_NL.gguf
gguf · 364 MB · SHA-256 b9998f1a251b…fad3 · Hugging Face
DownloadLightOnOCR-2-1B-ocr-soup-IQ4_XS.gguf
gguf · 351 MB · SHA-256 373b69aa3b47…0040 · Hugging Face
DownloadLightOnOCR-2-1B-ocr-soup-Q4_K_M.gguf
gguf · 378 MB · SHA-256 6bdf9fdc6ef7…bc3b · Hugging Face
DownloadLightOnOCR-2-1B-ocr-soup-Q5_K_M.gguf
gguf · 424 MB · SHA-256 2055ba681239…0b2f · Hugging Face
DownloadSource context: 4115 downloads · 10 likes · Pipeline image-to-text · Repo noctrex/LightOnOCR-2-1B-ocr-soup-GGUF
