These are quantizations of the model UI-Venus-1.5-8B, using a imatrix created from text\en\medium
Modellquelle
Quellenbeschreibung
These are quantizations of the model UI-Venus-1.5-8B, using a imatrix created from text_en_medium
Usage Notes:
Quellen
1 QuelleVerifiziert 11. Sept.
Modellartefakte
11 ArtefakteQuellenauszüge
2 Auszüge--- pipeline_tag: image-to-text base_model: - inclusionAI/UI-Venus-1.5-8B --- These are quantizations of the model [UI-Venus-1.5-8B](https://huggingface.co/inclusionAI/UI-Venus-1.5-8B), using a imatrix created from [text\_en\_medium](https://huggingface.co/datasets/eaddario/imatrix-calibration/blob/main/text_en_medium.parquet) **Usage Notes:** - Download the latest [llama.cpp](https://github.com/ggml-org/llama.cpp) to use these quantizations. - Try to use the best quality you can run. - For the `mmproj` file, the F32 version is recommended for best results (F32 > BF16 > F16).
mmproj file, the F32 version is recommended for best results (F32 > BF16 > F16).mmproj-F16.gguf
gguf · 1,08 GB · SHA-256 1a79397d75c8…8a7e · Hugging Face
Source context: 329 downloads · 0 likes · Pipeline image-to-text · Repo noctrex/UI-Venus-1.5-8B-GGUF