Saltar al contenido
ModelVerificadoExterno
Descargar

LFM 2.5 1.2b Instruct Roleplay Tuned v2 I1 GGUF

lfm1.0

Fuentehuggingface.co/mradermacher/LFM-2.5-1.2b-Instruct-roleplay-tuned-v2-i1-GGUF/tree/2b8f3bb7c2464a59be8bdee0b35ba7bd692caa86
TipoOtherModelo baseIndexnusrefather/LFM-2.5-1.2b-Instruct-roleplay-tuned-v2VersiónRevision 2b8f3bbPublicador@mradermacherCcalidad

Fuente del modelo

Tipo
Other
Tamaño del archivo
1,11–918 MB
Modelo base
Indexnusrefather/LFM-2.5-1.2b-Instruct-roleplay-tuned-v2
Versión
vRevision 2b8f3bb
Actualizado
6 oct 2026
Publicador
@mradermacher
Descargas
198
Parámetros
2B
Fuente
Hugging Face

Descripción de la fuente

About

weighted/imatrix quants of https://huggingface.co/Indexnusrefather/LFM-2.5-1.2b-Instruct-roleplay-tuned-v2

For a convenient overview and download list, visit our model page for this model.

static quants are available at https://huggingface.co/mradermacher/LFM-2.5-1.2b-Instruct-roleplay-tuned-v2-GGUF

Usage

If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.

Provided Quants

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

LinkTypeSize/GBNotes
GGUFimatrix0.1imatrix file (for creating your own quants)
GGUFi1-IQ1_S0.4for the desperate
GGUFi1-IQ1_M0.4mostly desperate
GGUFi1-IQ2_XXS0.5
GGUFi1-IQ2_XS0.5
GGUFi1-IQ2_S0.5
GGUFi1-IQ2_M0.5
GGUFi1-Q2_K_S0.6very low quality
GGUFi1-Q2_K0.6IQ3_XXS probably better
GGUFi1-IQ3_XXS0.6lower quality
GGUFi1-IQ3_XS0.6
GGUFi1-IQ3_S0.7beats Q3_K*
GGUFi1-Q3_K_S0.7IQ3_XS probably better
GGUFi1-IQ3_M0.7
GGUFi1-Q3_K_M0.7IQ3_S probably better
GGUFi1-Q3_K_L0.7IQ3_M probably better
GGUFi1-IQ4_XS0.8
GGUFi1-IQ4_NL0.8prefer IQ4_XS
GGUFi1-Q4_00.8fast, low quality
GGUFi1-Q4_K_S0.8optimal size/speed/quality
GGUFi1-Q4_K_M0.8fast, recommended
GGUFi1-Q4_10.9
GGUFi1-Q5_K_S0.9
GGUFi1-Q5_K_M0.9
GGUFi1-Q6_K1.1practically like static Q6_K

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):

image.png

And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9

FAQ / Model Request

See https://huggingface.co/mradermacher/model_requests for some answers to questions you might have and/or if you want some other model quantized.

Thanks

I thank my company, nethype GmbH, for letting me use its servers and providing upgrades to my workstation to enable this work in my free time. Additional thanks to @nicoboss for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.

Fuentes

1 fuente
Hugging FacePrincipalVersión 2b8f3bb7c2464a59be8bdee0b35ba7bd692caa86
huggingface.co/mradermacher/LFM-2.5-1.2b-Instruct-roleplay-tuned-v2-i1-GGUF/tree/2b8f3bb7c2464a59be8bdee0b35ba7bd692caa86

Verificado 1 sept

Artefactos del modelo

25 artefactos

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-IQ1_M.gguf

gguf · 312 MB · SHA-256 926c7fffdc9a…be24 · Hugging Face

Descargar

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-IQ1_S.gguf

gguf · 290 MB · SHA-256 44b6aef20464…5191 · Hugging Face

Descargar

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-IQ2_M.gguf

gguf · 414 MB · SHA-256 e90ce1ab8df5…b308 · Hugging Face

Descargar

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-IQ2_S.gguf

gguf · 385 MB · SHA-256 ec2bb2272a4a…bda3 · Hugging Face

Descargar

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-IQ2_XS.gguf

gguf · 378 MB · SHA-256 b35adb64e7fc…a775 · Hugging Face

Descargar

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-IQ2_XXS.gguf

gguf · 348 MB · SHA-256 d27dabe21378…6d09 · Hugging Face

Descargar

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-IQ3_M.gguf

gguf · 541 MB · SHA-256 8d73df759ef6…f711 · Hugging Face

Descargar

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-IQ3_S.gguf

gguf · 532 MB · SHA-256 0ac4811b537d…c40f · Hugging Face

Descargar

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-IQ3_XS.gguf

gguf · 513 MB · SHA-256 61a4adfb055a…aa1c · Hugging Face

Descargar

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-IQ3_XXS.gguf

gguf · 468 MB · SHA-256 dc531316531c…d794 · Hugging Face

Descargar

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-IQ4_NL.gguf

gguf · 664 MB · SHA-256 8bcf40fc57ba…7973 · Hugging Face

Descargar

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-IQ4_XS.gguf

gguf · 633 MB · SHA-256 f6f36e0627ca…2fa2 · Hugging Face

Descargar

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-Q2_K_S.gguf

gguf · 439 MB · SHA-256 9972ef36a11c…27ef · Hugging Face

Descargar

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-Q2_K.gguf

gguf · 461 MB · SHA-256 ee6bee1922cf…f767 · Hugging Face

Descargar

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-Q3_K_L.gguf

gguf · 606 MB · SHA-256 707ad59e3976…694c · Hugging Face

Descargar

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-Q3_K_M.gguf

gguf · 573 MB · SHA-256 d71fc4550e6a…2b5a · Hugging Face

Descargar

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-Q3_K_S.gguf

gguf · 532 MB · SHA-256 4cac5bbe38ad…a7d3 · Hugging Face

Descargar

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-Q4_0.gguf

gguf · 666 MB · SHA-256 f68be73ffabb…30ce · Hugging Face

Descargar

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-Q4_1.gguf

gguf · 725 MB · SHA-256 f55e08894e8a…8159 · Hugging Face

Descargar

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-Q4_K_M.gguf

gguf · 697 MB · SHA-256 81952df46c83…85b4 · Hugging Face

Descargar

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-Q4_K_S.gguf

gguf · 668 MB · SHA-256 cb36c0f9a64e…7aa9 · Hugging Face

Descargar

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-Q5_K_M.gguf

gguf · 804 MB · SHA-256 b4ef8e673080…d0e6 · Hugging Face

Descargar

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-Q5_K_S.gguf

gguf · 787 MB · SHA-256 e7e7f44c1e73…384b · Hugging Face

Descargar

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-Q6_K.gguf

gguf · 918 MB · SHA-256 58f832ababed…88a3 · Hugging Face

Descargar

LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.imatrix.gguf

gguf · 1,11 MB · SHA-256 0cdf83f98273…93a0 · Hugging Face

Descargar

Extractos de fuentes

3 extractos
Readme11 julhuggingface.co/mradermacher/LFM-2.5-1.2b-Instruct-roleplay-tuned-v2-i1-GGUF

--- base_model: Indexnusrefather/LFM-2.5-1.2b-Instruct-roleplay-tuned-v2 language: - en library_name: transformers license: other license_link: LICENSE license_name: lfm1.0 mradermacher: readme_rev: 1 quantized_by: mradermacher tags: - rp - roleplay - creative - experimental - finetune - lora - lfm2.5 - writer --- ## About <!-- ### quantize_version: 2 --> <!-- ### output_tensor_quantised: 1 --> <!-- ### convert_type: hf --> <!-- ### vocab_type: --> <!-- ### tags: nicoboss --> <!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S --> <!-- ### quants_skip: --> <!-- ### skip_mmproj: --> weighted/imatrix quants of https://huggingface.co/Indexnusrefather/LFM-2.5-1.2b-Instruct-roleplay-tuned-v2 <!-- provided-files --> ***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#LFM-2.5-1.2b-Instruct-roleplay-tuned-v2-i1-GGUF).*** static quants are available at https://huggingface.co/mradermacher/LFM-2.5-1.2b-Instruct-roleplay-tuned-v2-GGUF ## Usage If you are unsure how to use GGUF files, refer to one of [TheBloke's READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for more details, including on how to concatenate multi-part files. ## Provided Quants (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) | Link | Type | Size/GB | Notes | |:-----|:-----|--------:|:------| | [GGUF](https://huggingface.co/mradermacher/LFM-2.5-1.2b-Instruct-roleplay-tuned-v2-i1-GGUF/resolve/main/LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | | [GGUF](https://huggingface.co/mradermacher/LFM-2.5-1.2b-Instruct-roleplay-tuned-v2-i1-GGUF/resolve/main/LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-IQ1_S.gguf) | i1-IQ1_S | 0.4 | for the desperate | | [GGUF](https://huggingface.co/mradermacher/LFM-2.5-1.2b-Instruct-roleplay-tuned-v2-i1-GGUF/resolve/main/LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-IQ1_M.gguf) | i1-IQ1_M | 0.4 | mostly desperate | | [GGUF](https://huggingface.co/mradermacher/LFM-2.5-1.2b-Instruct-roleplay-tuned-v2-i1-GGUF/resolve/main/LFM-2.5-1.2b-Instruct-roleplay-tuned-v2.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.5 | | | [GGUF](https://huggingface.co/mradermacher/L...

Note1 septhuggingface.co/mradermacher/LFM-2.5-1.2b-Instruct-roleplay-tuned-v2-i1-GGUF

Source context: 198 downloads · 0 likes · Library transformers · Repo mradermacher/LFM-2.5-1.2b-Instruct-roleplay-tuned-v2-i1-GGUF

Note18 julhuggingface.co/mradermacher/LFM-2.5-1.2b-Instruct-roleplay-tuned-v2-i1-GGUF

Source context: 1147 downloads · 0 likes · Library transformers · Repo mradermacher/LFM-2.5-1.2b-Instruct-roleplay-tuned-v2-i1-GGUF