Loading
Have a ComfyUI workflow? Get a readable Workflow Doc in your browser.Make a workflow readable.Try it now ↗
For a convenient overview and download list, visit our model page for this model.
Model source
Source description
weighted/imatrix quants of https://huggingface.co/prithivMLmods/Megalodon-OCR-Sync-0713
For a convenient overview and download list, visit our model page for this model.
static quants are available at
Sources
1 sourceVerified Sep 17
Model artifacts
24 artifactsSource excerpts
2 excerptsThis is a vision model - mmproj files (if any) will be in the static repository.
If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|---|---|---|---|
| GGUF | i1-IQ1_S | 0.9 | for the desperate |
| GGUF | i1-IQ1_M | 1.0 | mostly desperate |
| GGUF | i1-IQ2_XXS | 1.0 | |
| GGUF | i1-IQ2_XS | 1.1 | |
Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):
image.png
And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
See https://huggingface.co/mradermacher/model_requests for some answers to questions you might have and/or if you want some other model quantized.
I thank my company, nethype GmbH, for letting me use its servers and providing upgrades to my workstation to enable this work in my free time. Additional thanks to @nicoboss for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
Megalodon-OCR-Sync-0713.i1-IQ2_M.gguf
gguf · 1.06 GB · SHA-256 40fe4c415acc…d8a2 · Hugging Face
DownloadMegalodon-OCR-Sync-0713.i1-IQ2_S.gguf
gguf · 1,013 MB · SHA-256 e1e619d9baed…28d4 · Hugging Face
DownloadMegalodon-OCR-Sync-0713.i1-IQ2_XS.gguf
gguf · 984 MB · SHA-256 31779400117d…2e10 · Hugging Face
DownloadMegalodon-OCR-Sync-0713.i1-IQ2_XXS.gguf
gguf · 904 MB · SHA-256 d90a9ba8b808…0eb6 · Hugging Face
DownloadMegalodon-OCR-Sync-0713.i1-IQ3_M.gguf
gguf · 1.39 GB · SHA-256 dbf177e7de9b…ee39 · Hugging Face
DownloadMegalodon-OCR-Sync-0713.i1-IQ3_S.gguf
gguf · 1.36 GB · SHA-256 e039955bd7ab…c149 · Hugging Face
DownloadMegalodon-OCR-Sync-0713.i1-IQ3_XS.gguf
gguf · 1.30 GB · SHA-256 ee47817cba29…40c8 · Hugging Face
DownloadMegalodon-OCR-Sync-0713.i1-IQ3_XXS.gguf
gguf · 1.19 GB · SHA-256 ef343d9cee80…e954 · Hugging Face
DownloadMegalodon-OCR-Sync-0713.i1-IQ4_NL.gguf
gguf · 1.70 GB · SHA-256 1629ae98ebd6…b839 · Hugging Face
DownloadMegalodon-OCR-Sync-0713.i1-IQ4_XS.gguf
gguf · 1.62 GB · SHA-256 fe2bb9ac9862…b12e · Hugging Face
DownloadMegalodon-OCR-Sync-0713.i1-Q2_K_S.gguf
gguf · 1.12 GB · SHA-256 89764089275c…da56 · Hugging Face
DownloadMegalodon-OCR-Sync-0713.i1-Q2_K.gguf
gguf · 1.19 GB · SHA-256 b76afdf729fe…44ce · Hugging Face
DownloadMegalodon-OCR-Sync-0713.i1-Q3_K_L.gguf
gguf · 1.59 GB · SHA-256 9eb8ad67644e…cb1e · Hugging Face
DownloadMegalodon-OCR-Sync-0713.i1-Q3_K_M.gguf
gguf · 1.48 GB · SHA-256 ff09260122d9…43e6 · Hugging Face
DownloadMegalodon-OCR-Sync-0713.i1-Q3_K_S.gguf
gguf · 1.35 GB · SHA-256 daa76acbe6a0…480a · Hugging Face
DownloadMegalodon-OCR-Sync-0713.i1-Q4_0.gguf
gguf · 1.70 GB · SHA-256 f319844b6c41…fbbb · Hugging Face
DownloadMegalodon-OCR-Sync-0713.i1-Q4_1.gguf
gguf · 1.86 GB · SHA-256 b9b415c01cec…0c1e · Hugging Face
DownloadMegalodon-OCR-Sync-0713.i1-Q4_K_M.gguf
gguf · 1.80 GB · SHA-256 10bf9df1b99f…cf86 · Hugging Face
DownloadMegalodon-OCR-Sync-0713.i1-Q4_K_S.gguf
gguf · 1.71 GB · SHA-256 ebf19e419f77…a9a3 · Hugging Face
DownloadMegalodon-OCR-Sync-0713.i1-Q5_K_M.gguf
gguf · 2.07 GB · SHA-256 9690718282bc…b01f · Hugging Face
DownloadMegalodon-OCR-Sync-0713.i1-Q5_K_S.gguf
gguf · 2.02 GB · SHA-256 03d1154a03ed…ac57 · Hugging Face
DownloadMegalodon-OCR-Sync-0713.i1-Q6_K.gguf
gguf · 2.36 GB · SHA-256 42efbc2e7ffa…7758 · Hugging Face
Download--- base_model: prithivMLmods/Megalodon-OCR-Sync-0713 language: - en - zh library_name: transformers mradermacher: readme_rev: 1 quantized_by: mradermacher tags: - text-generation-inference - image-captioning - optical-character-recognition - intelligent-character-recognition - caption - ocr - visual-understanding - art - image-to-text - vlm - table --- ## About <!-- ### quantize_version: 2 --> <!-- ### output_tensor_quantised: 1 --> <!-- ### convert_type: hf --> <!-- ### vocab_type: --> <!-- ### tags: nicoboss --> weighted/imatrix quants of https://huggingface.co/prithivMLmods/Megalodon-OCR-Sync-0713 <!-- provided-files --> ***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Megalodon-OCR-Sync-0713-i1-GGUF).*** static quants are available at https://huggingface.co/mradermacher/Megalodon-OCR-Sync-0713-GGUF **This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/Megalodon-OCR-Sync-0713-GGUF).** ## Usage If you are unsure how to use GGUF files, refer to one of [TheBloke's READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for more details, including on how to concatenate multi-part files. ## Provided Quants (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) | Link | Type | Size/GB | Notes | |:-----|:-----|--------:|:------| | [GGUF](https://huggingface.co/mradermacher/Megalodon-OCR-Sync-0713-i1-GGUF/resolve/main/Megalodon-OCR-Sync-0713.i1-IQ1_S.gguf) | i1-IQ1_S | 0.9 | for the desperate | | [GGUF](https://huggingface.co/mradermacher/Megalodon-OCR-Sync-0713-i1-GGUF/resolve/main/Megalodon-OCR-Sync-0713.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate | | [GGUF](https://huggingface.co/mradermacher/Megalodon-OCR-Sync-0713-i1-GGUF/resolve/main/Megalodon-OCR-Sync-0713.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.0 | | | [GGUF](https://huggingface.co/mradermacher/Megalodon-OCR-Sync-0713-i1-GGUF/resolve/main/Megalodon-OCR-Sync-0713.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.1 | | | [GGUF](https://huggingface.co/mradermacher/Megalodon-OCR-Sync-0713-i1-GGUF/resolve/main/Megalodon-OCR-Sync-0713.i1-IQ2_S.gguf) | i1-IQ2_S | 1.2 | | | [GGUF](https://huggingface.co/mradermacher/Megalodon-OCR-Sync-0713-i1-GGUF/resolve/main/Megalodon-OCR-Sync-0713.i1-IQ2_M.gguf) | i1-IQ2_M | 1.2 | | | [GGU...
Source context: 593 downloads · 1 likes · Pipeline image-to-text · Library transformers · Repo mradermacher/Megalodon-OCR-Sync-0713-i1-GGUF
| i1-IQ2_S |
| 1.2 |
| GGUF | i1-IQ2_M | 1.2 |
| GGUF | i1-Q2_K_S | 1.3 | very low quality |
| GGUF | i1-Q2_K | 1.4 | IQ3_XXS probably better |
| GGUF | i1-IQ3_XXS | 1.4 | lower quality |
| GGUF | i1-IQ3_XS | 1.5 |
| GGUF | i1-Q3_K_S | 1.6 | IQ3_XS probably better |
| GGUF | i1-IQ3_S | 1.6 | beats Q3_K* |
| GGUF | i1-IQ3_M | 1.6 |
| GGUF | i1-Q3_K_M | 1.7 | IQ3_S probably better |
| GGUF | i1-Q3_K_L | 1.8 | IQ3_M probably better |
| GGUF | i1-IQ4_XS | 1.8 |
| GGUF | i1-IQ4_NL | 1.9 | prefer IQ4_XS |
| GGUF | i1-Q4_0 | 1.9 | fast, low quality |
| GGUF | i1-Q4_K_S | 1.9 | optimal size/speed/quality |
| GGUF | i1-Q4_K_M | 2.0 | fast, recommended |
| GGUF | i1-Q4_1 | 2.1 |
| GGUF | i1-Q5_K_S | 2.3 |
| GGUF | i1-Q5_K_M | 2.3 |
| GGUF | i1-Q6_K | 2.6 | practically like static Q6_K |
