ModelAufgelistetExtern

Bonsai 8b 1bit HNPU

Prebuilt Hexagon NPU artifacts for prism-ml/Bonsai-8B.

Quellehuggingface.co/runanywhere/bonsai_8b_1bit_HNPU/tree/33825a2939723ea8b5ed236ce1e05977dcfd93f0

ArtOtherBasismodellprism-ml/Bonsai-8BVersionRevision 33825a2CBewertung

Modellquelle

Art: Other
Dateigröße: 1,10–1,16 GB
Basismodell: prism-ml/Bonsai-8B
Version: vRevision 33825a2
Aktualisiert: 7. Okt. 2026
Downloads: 0
Quelle: Hugging Face

Quellenbeschreibung

Bonsai-8B — Hexagon NPU artifacts

Prebuilt Hexagon NPU artifacts for prism-ml/Bonsai-8B.

See the upstream model card for model behavior, license, intended use, and limitations.

Artifacts are arch-pinned; this repo currently contains a v81/ directory.

Quellen

1 Quelle

Hugging FacePrimärVersion 33825a2939723ea8b5ed236ce1e05977dcfd93f0

huggingface.co/runanywhere/bonsai_8b_1bit_HNPU/tree/33825a2939723ea8b5ed236ce1e05977dcfd93f0

Verifiziert 30. Aug.

Download files

Modellartefakte

2 Artefakte

v81/bonsai8b_embed_f16.bin

bin · 1,16 GB · SHA-256 e547f36abd93…aa85 · Hugging Face

Download file

v81/bonsai8b_kernel.bin

bin · 1,10 GB · SHA-256 f681c3866483…005a · Hugging Face

Download file

Quellenauszüge

3 Auszüge

Readme30. Aug.huggingface.co/runanywhere/bonsai_8b_1bit_HNPU

--- license: other tags: - hnpu - hexagon - npu - llm - v81 base_model: prism-ml/Bonsai-8B pipeline_tag: text-generation --- # Bonsai-8B — Hexagon NPU artifacts Prebuilt Hexagon NPU artifacts for [`prism-ml/Bonsai-8B`](https://huggingface.co/prism-ml/Bonsai-8B). See the upstream model card for model behavior, license, intended use, and limitations. Artifacts are arch-pinned; this repo currently contains a `v81/` directory.

Readme17. Julihuggingface.co/runanywhere/bonsai_8b_1bit_HNPU

--- license: other tags: - hnpu - hexagon - npu - v75 - v81 - text-generation - 1-bit base_model: prism-ml/Bonsai-8B --- # Bonsai-8B — 1-bit for the Qualcomm Hexagon NPU (HNPU) A QHexRT-runnable bundle of [prism-ml/Bonsai-8B](https://huggingface.co/prism-ml/Bonsai-8B) at **true 1-bit (Q1_0, ~1.125 bit/weight)** for the Hexagon NPU. Runs the full model on-device via a custom HVX op-package. **Supported arches:** v75 (SM8650), v81 (SM8850). Artifacts are arch-pinned; this repo contains `v75/` and `v81/` directories.

Note17. Julihuggingface.co/runanywhere/bonsai_8b_1bit_HNPU

Source context: 0 downloads · 0 likes · Pipeline text-generation · Repo runanywhere/bonsai_8b_1bit_HNPU