ModelVerificadoExterno

Glm5.1 Tiny

> 由 model-scaler v0.1.0 生成于 2026-04-21 07:04:45 UTC

Fuentehuggingface.co/sqjian/glm5.1-tiny/tree/b4b1c5c50e7d4b299e5ae1e98930b3aaf29753f8

TipoText modelVersiónmodelPublicador@sqjianCcalidad

Fuente del modelo

Tipo: Text model
Tamaño del archivo: 1,96 GB
Versión: vmodel
Actualizado: 1 oct 2026
Publicador: @sqjian
Descargas: 17
Tareas: Generación de texto
Fuente: Hugging Face

Descripción de la fuente

缩放模型

由 model-scaler v0.1.0 生成于 2026-04-21 07:04:45 UTC

来源信息

源模型: /models/ckpts/ZhipuAI/GLM-5.1

架构参数对比

参数	原始值	缩放值
num_hidden_layers	78	4
hidden_size	6144	2048
num_attention_heads	64	32
intermediate_size	12288	4096
n_routed_experts	256	16
n_shared_experts	1	1
num_experts_per_tok	8	2
moe_intermediate_size	2048	1024
first_k_dense_replace	3	1
index_head_dim	128	128
index_n_heads	32	4
index_topk	2048	128
q_lora_rank	2048	512
kv_lora_rank	512	512
qk_head_dim	256	192
qk_nope_head_dim	192	128
qk_rope_head_dim	64	64
v_head_dim	256	128

使用方法

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained(
    "./path/to/scaled-model",
    trust_remote_code=True,
)
tokenizer = AutoTokenizer.from_pretrained(
    "./path/to/scaled-model",
    trust_remote_code=True,
)

Fuentes

1 fuente

Hugging FacePrincipalVersión b4b1c5c50e7d4b299e5ae1e98930b3aaf29753f8

huggingface.co/sqjian/glm5.1-tiny/tree/b4b1c5c50e7d4b299e5ae1e98930b3aaf29753f8

Verificado 1 oct

Artefactos del modelo

1 artefacto

model.safetensors

safetensors · 1,96 GB · SHA-256 2fe1a9276f46…e708 · Hugging Face

Descargar

Extractos de fuentes

3 extractos

Readme11 julhuggingface.co/sqjian/glm5.1-tiny

--- pipeline_tag: text-generation --- # 缩放模型 > 由 model-scaler v0.1.0 生成于 2026-04-21 07:04:45 UTC ## 来源信息 - **源模型**: /models/ckpts/ZhipuAI/GLM-5.1 ## 架构参数对比 | 参数 | 原始值 | 缩放值 | |------|--------|--------| | num_hidden_layers | 78 | 4 | | hidden_size | 6144 | 2048 | | num_attention_heads | 64 | 32 | | intermediate_size | 12288 | 4096 | | n_routed_experts | 256 | 16 | | n_shared_experts | 1 | 1 | | num_experts_per_tok | 8 | 2 | | moe_intermediate_size | 2048 | 1024 | | first_k_dense_replace | 3 | 1 | | index_head_dim | 128 | 128 | | index_n_heads | 32 | 4 | | index_topk | 2048 | 128 | | q_lora_rank | 2048 | 512 | | kv_lora_rank | 512 | 512 | | qk_head_dim | 256 | 192 | | qk_nope_head_dim | 192 | 128 | | qk_rope_head_dim | 64 | 64 | | v_head_dim | 256 | 128 | ## 使用方法 ```python from transformers import AutoModelForCausalLM, AutoTokenizer model = AutoModelForCausalLM.from_pretrained( "./path/to/scaled-model", trust_remote_code=True, ) tokenizer = AutoTokenizer.from_pretrained( "./path/to/scaled-model", trust_remote_code=True, ) ```

Note1 octhuggingface.co/sqjian/glm5.1-tiny

Source context: 17 downloads · 0 likes · Pipeline text-generation · Repo sqjian/glm5.1-tiny

Note16 julhuggingface.co/sqjian/glm5.1-tiny

Source context: 29 downloads · 0 likes · Pipeline text-generation · Repo sqjian/glm5.1-tiny