Aller au contenu

ModelPrésentéExterne

Inkling UD Q2 K XL Layers

Distributed GGUF inference package for Mesh LLM

Sourcehuggingface.co/meshllm/inkling-UD-Q2_K_XL-layers/tree/9b4b91a7ddd978dd7a01679bc977f6e53777f2c7

TypeOtherModèle de baseunsloth/inkling-GGUFVersionRevision 9b4b91aBClasse

Source du modèle

Type: Other
Taille du fichier: 421 MB–5,18 GB
Modèle de base: unsloth/inkling-GGUF
Version: vRevision 9b4b91a
Mis à jour: 15 sept. 2026
Téléchargements: 3,2 k
Source: Hugging Face

Extrait de la source

Distributed GGUF inference package for Mesh LLM

Sources

1 source

Hugging FacePrincipalVersion 9b4b91a7ddd978dd7a01679bc977f6e53777f2c7

huggingface.co/meshllm/inkling-UD-Q2_K_XL-layers/tree/9b4b91a7ddd978dd7a01679bc977f6e53777f2c7

Vérifié 20 août

Artefacts du modèle

64 artefacts

layers/layer-000.gguf

gguf · 421 MB · SHA-256 8651944f8656…d20b · Hugging Face

layers/layer-001.gguf

gguf · 421 MB · SHA-256 fc009caf18af…fa66 · Hugging Face

layers/layer-002.gguf

gguf · 4,51 GB · SHA-256 143fe7028b60…177a · Hugging Face

layers/layer-003.gguf

gguf · 4,51 GB · SHA-256 73cab90bb1fe…a746 · Hugging Face

layers/layer-004.gguf

gguf · 4,51 GB · SHA-256 85d3e7e1eeed…ed82 · Hugging Face

layers/layer-005.gguf

gguf · 4,50 GB · SHA-256 922bce46894c…3978 · Hugging Face

layers/layer-006.gguf

gguf · 4,51 GB · SHA-256 a13195d50b80…b392 · Hugging Face

layers/layer-007.gguf

gguf · 4,51 GB · SHA-256 d943ca0cc8b8…3739 · Hugging Face

layers/layer-008.gguf

gguf · 4,51 GB · SHA-256 e37c5d6b719b…495c · Hugging Face

layers/layer-009.gguf

gguf · 4,51 GB · SHA-256 771660a8479f…f7df · Hugging Face

layers/layer-010.gguf

gguf · 4,51 GB · SHA-256 09d7f5f64706…577f · Hugging Face

layers/layer-011.gguf

gguf · 4,50 GB · SHA-256 228159f4039f…4123 · Hugging Face

layers/layer-012.gguf

gguf · 4,51 GB · SHA-256 bc2078614fda…00f1 · Hugging Face

layers/layer-013.gguf

gguf · 4,51 GB · SHA-256 5f2c416d3264…63d2 · Hugging Face

layers/layer-014.gguf

gguf · 4,51 GB · SHA-256 661018528f6b…9d2b · Hugging Face

layers/layer-015.gguf

gguf · 4,51 GB · SHA-256 7f2765c2ea3a…b81c · Hugging Face

layers/layer-016.gguf

gguf · 4,51 GB · SHA-256 2baab6c9f535…e6f7 · Hugging Face

layers/layer-017.gguf

gguf · 4,50 GB · SHA-256 565ecf6a8dcd…04c5 · Hugging Face

layers/layer-018.gguf

gguf · 4,51 GB · SHA-256 bf4d3672a114…67a4 · Hugging Face

layers/layer-019.gguf

gguf · 4,51 GB · SHA-256 ae1c70604252…72e6 · Hugging Face

layers/layer-020.gguf

gguf · 4,51 GB · SHA-256 60c25db537c3…d365 · Hugging Face

layers/layer-021.gguf

gguf · 4,51 GB · SHA-256 e0ca26a196dc…e3a5 · Hugging Face

layers/layer-022.gguf

gguf · 4,51 GB · SHA-256 200a0d345477…1566 · Hugging Face

layers/layer-023.gguf

gguf · 4,50 GB · SHA-256 70416918a9e2…8638 · Hugging Face

layers/layer-024.gguf

gguf · 4,51 GB · SHA-256 15e43e635316…5439 · Hugging Face

layers/layer-025.gguf

gguf · 4,51 GB · SHA-256 371221cb15cd…a3ed · Hugging Face

layers/layer-026.gguf

gguf · 4,51 GB · SHA-256 a1cb733531ff…1cf2 · Hugging Face

layers/layer-027.gguf

gguf · 4,51 GB · SHA-256 a36c41a47fff…da4f · Hugging Face

layers/layer-028.gguf

gguf · 4,51 GB · SHA-256 be08d6a5ef16…ea29 · Hugging Face

layers/layer-029.gguf

gguf · 4,50 GB · SHA-256 2e077fae794d…c629 · Hugging Face

layers/layer-030.gguf

gguf · 4,51 GB · SHA-256 06c3fcb8bf50…7745 · Hugging Face

layers/layer-031.gguf

gguf · 4,51 GB · SHA-256 2d7808f6d446…3379 · Hugging Face

layers/layer-032.gguf

gguf · 4,51 GB · SHA-256 8d3692a994f7…2605 · Hugging Face

layers/layer-033.gguf

gguf · 4,51 GB · SHA-256 48f66cb8a959…6217 · Hugging Face

layers/layer-034.gguf

gguf · 4,51 GB · SHA-256 e84f9bf768de…2d7f · Hugging Face

layers/layer-035.gguf

gguf · 4,50 GB · SHA-256 3bc4f06ca160…1c25 · Hugging Face

layers/layer-036.gguf

gguf · 4,51 GB · SHA-256 312ac075b2af…5be2 · Hugging Face

layers/layer-037.gguf

gguf · 4,51 GB · SHA-256 33130440e296…c390 · Hugging Face

layers/layer-038.gguf

gguf · 4,51 GB · SHA-256 edf0464d29ea…6605 · Hugging Face

layers/layer-039.gguf

gguf · 4,51 GB · SHA-256 b438c1ed89ff…820b · Hugging Face

layers/layer-040.gguf

gguf · 5,18 GB · SHA-256 111a5aea0d7c…52f7 · Hugging Face

layers/layer-041.gguf

gguf · 4,50 GB · SHA-256 3939d1a386f9…cbe1 · Hugging Face

layers/layer-042.gguf

gguf · 4,51 GB · SHA-256 3abfa4c16e88…4770 · Hugging Face

layers/layer-043.gguf

gguf · 4,51 GB · SHA-256 0a6b4e686604…421e · Hugging Face

layers/layer-044.gguf

gguf · 4,51 GB · SHA-256 210385b00193…0eed · Hugging Face

layers/layer-045.gguf

gguf · 4,51 GB · SHA-256 8727dbcb33fc…4473 · Hugging Face

layers/layer-046.gguf

gguf · 4,51 GB · SHA-256 0d3880357ab5…7567 · Hugging Face

layers/layer-047.gguf

gguf · 4,50 GB · SHA-256 4e76c95ffd9e…8732 · Hugging Face

layers/layer-048.gguf

gguf · 4,51 GB · SHA-256 a2097293eec1…178b · Hugging Face

layers/layer-049.gguf

gguf · 4,51 GB · SHA-256 92e112ae5004…9e61 · Hugging Face

layers/layer-050.gguf

gguf · 4,51 GB · SHA-256 85f1ca85422a…38c5 · Hugging Face

layers/layer-051.gguf

gguf · 4,51 GB · SHA-256 3e89e49bb645…85bc · Hugging Face

layers/layer-052.gguf

gguf · 4,51 GB · SHA-256 c403a2d8f4a6…58c5 · Hugging Face

layers/layer-053.gguf

gguf · 4,50 GB · SHA-256 2163a788478a…3bca · Hugging Face

layers/layer-054.gguf

gguf · 4,51 GB · SHA-256 29e35878760e…acee · Hugging Face

layers/layer-055.gguf

gguf · 4,51 GB · SHA-256 1221d7c0c5f8…d12e · Hugging Face

layers/layer-056.gguf

gguf · 4,51 GB · SHA-256 4aaaef7ffe54…fb2e · Hugging Face

layers/layer-057.gguf

gguf · 4,51 GB · SHA-256 9cf7b697858f…96b1 · Hugging Face

layers/layer-058.gguf

gguf · 4,51 GB · SHA-256 5cbb2189ddf8…4706 · Hugging Face

layers/layer-059.gguf

gguf · 5,17 GB · SHA-256 4e18edae0164…926f · Hugging Face

layers/layer-060.gguf

gguf · 5,18 GB · SHA-256 51d5984630c2…9a68 · Hugging Face

layers/layer-061.gguf

gguf · 4,51 GB · SHA-256 cc75d78739a6…3c39 · Hugging Face

layers/layer-062.gguf

gguf · 5,18 GB · SHA-256 ee7fa7a3de58…998e · Hugging Face

layers/layer-063.gguf

gguf · 5,18 GB · SHA-256 8cf159145898…1238 · Hugging Face

Extraits de sources

2 extraits

Readme20 aoûthuggingface.co/meshllm/inkling-UD-Q2_K_XL-layers

--- library_name: mesh-llm base_model: - "unsloth/inkling-GGUF" pipeline_tag: "image-text-to-text" tags: - gguf - mesh-llm - layer-package - skippy - distributed-inference - local-inference - openai-compatible - experimental --- <div align="center"> <a href="https://www.meshllm.cloud"> <img src="https://meshllm.cloud/assets/images/jelly-logo-wordmark.png" alt="Mesh LLM" width="220"> </a> <h1>inkling-UD-Q2_K_XL</h1> <p> <strong>Distributed GGUF inference package for Mesh LLM</strong> </p> <p> <a href="https://www.meshllm.cloud"><img alt="Website" src="https://img.shields.io/badge/Website-meshllm.cloud-111111?style=for-the-badge"></a> <a href="https://github.com/Mesh-LLM/mesh-llm"><img alt="GitHub" src="https://img.shields.io/badge/GitHub-Mesh--LLM-24292f?style=for-the-badge&logo=github"></a> <a href="https://discord.gg/rs6fmc63eN"><img alt="Discord" src="https://img.shields.io/badge/Discord-Join-5865F2?style=for-the-badge&logo=discord&logoColor=white"></a> </p> </div> > [!WARNING] > **Experimental package:** artifact integrity may be validated, but runtime, split-correctness, and multimodal certification are still pending. This package is not discoverable through `meshllm/catalog@main` until its Hugging Face catalog PR is reviewed and merged. GGUF layer package for running **inkling-UD-Q2_K_XL** across a local Mesh LLM cluster. This package is derived from [unsloth/inkling-GGUF](https://huggingface.co/unsloth/inkling-GGUF) and keeps the original GGUF distribution split into per-layer artifacts for distributed inference. ## Highlights | Run locally | Pool multiple machines | OpenAI-compatible | Package variant | |---|---|---|---| | Private inference on your hardware | Split layers across peers | Serve `/v1/chat/completions` locally | `UD-Q2_K_XL` layer package | ## Model Overview | Property | Value | |---|---| | **Source model** | [unsloth/inkling-GGUF](https://huggingface.co/unsloth/inkling-GGUF) | | **Model id** | `unsloth/inkling-GGUF:UD-Q2_K_XL` | | **Family** | inkling | | **Parameter scale** | not recorded | | **Quantization** | `UD-Q2_K_XL` | | **Layer count** | 66 | | **Activation width** | 6144 | | **Package size** | 296.5 GB | | **Source file** | `UD-Q2_K_XL/inkling-UD-Q2_K_XL-00001-of-00008.gguf` | | **Package repo** | [meshllm/inkling-UD-Q2_K_XL-layers](https://huggingface.co/meshllm/inkling-UD-Q2_K_XL-layers) | ## Recomm...

Note20 aoûthuggingface.co/meshllm/inkling-UD-Q2_K_XL-layers

Source context: 3181 downloads · 1 likes · Pipeline image-text-to-text · Library mesh-llm · Repo meshllm/inkling-UD-Q2_K_XL-layers