ModelAufgelistetExtern

Jacobian Lens Glm4 9b

A fitted Jacobian lens for zai-org/GLM-4-9B-0414, from Anthropic's [Verbalizable Representations Form a Global Workspace in Language Models]( fitted with the reference implementation anthropics/jacobian-lens.

Quellehuggingface.co/andyx10/jacobian-lens-glm4-9b/tree/ba29a914a94539470ab7034d7520934270e3527a

ArtOtherBasismodellzai-org/GLM-4-9B-0414VersionRevision ba29a91CBewertung

Modellquelle

Art: Other
Dateigröße: 1,22 GB
Basismodell: zai-org/GLM-4-9B-0414
Version: vRevision ba29a91
Aktualisiert: 5. Okt. 2026
Downloads: 0
Quelle: Hugging Face

Quellenbeschreibung

Screenshot 2026-07-12 at 5.02.25 PM

Screenshot 2026-07-12 at 4.22.40 PM

Jacobian Lens for GLM-4-9B-0414

A fitted Jacobian lens for zai-org/GLM-4-9B-0414, from Anthropic's Verbalizable Representations Form a Global Workspace in Language Models, fitted with the reference implementation anthropics/jacobian-lens.

field	value
base model	`zai-org/GLM-4-9B-0414` (40 layers, `d_model=4096`)
source layers	0–38 (all 39 layers below the final)
target layer	39 (final)
Jacobian shape	`[4096, 4096]` per layer, fp16 on disk
file size	~1.22 GiB
fitting corpus	100 WikiText-103 prompts × 128 tokens (first 16 positions skipped as attention sinks)
estimator	`dim_batch=8`, mean over valid source positions
fit hardware	1× NVIDIA H100 80GB, ~85 min, peak 24.5 GiB VRAM

License

Apache-2.0, matching the reference implementation. The base model zai-org/GLM-4-9B-0414 is MIT-licensed.

Quellen

1 Quelle

Hugging FacePrimärVersion ba29a914a94539470ab7034d7520934270e3527a

huggingface.co/andyx10/jacobian-lens-glm4-9b/tree/ba29a914a94539470ab7034d7520934270e3527a

Verifiziert 31. Aug.

Modellartefakte

1 Artefakt

glm4_9b_lens.pt

pt · 1,22 GB · SHA-256 473d216911d0…722d · Hugging Face

Download file

Quellenauszüge

3 Auszüge

Readme13. Julihuggingface.co/dormantx/jacobian-lens-glm4-9b

--- license: apache-2.0 base_model: zai-org/GLM-4-9B-0414 tags: - interpretability - jacobian-lens - logit-lens - glm4 library_name: jlens --- ![Screenshot 2026-07-12 at 5.02.25 PM](https://cdn-uploads.huggingface.co/production/uploads/6997e2c73023436326a52378/IyfaucQ4kPRnh4gkNdTTl.png) ![Screenshot 2026-07-12 at 4.22.40 PM](https://cdn-uploads.huggingface.co/production/uploads/6997e2c73023436326a52378/FvtLgmE7JpF-JylgJMScC.png) # Jacobian Lens for GLM-4-9B-0414 A fitted Jacobian lens for [`zai-org/GLM-4-9B-0414`](https://huggingface.co/zai-org/GLM-4-9B-0414), from Anthropic's [*Verbalizable Representations Form a Global Workspace in Language Models*](https://transformer-circuits.pub/2026/workspace/index.html), fitted with the reference implementation [`anthropics/jacobian-lens`](https://github.com/anthropics/jacobian-lens). ## Contents | field | value | |---|---| | base model | `zai-org/GLM-4-9B-0414` (40 layers, `d_model=4096`) | | source layers | 0–38 (all 39 layers below the final) | | target layer | 39 (final) | | Jacobian shape | `[4096, 4096]` per layer, fp16 on disk | | file size | ~1.22 GiB | | fitting corpus | 100 WikiText-103 prompts × 128 tokens (first 16 positions skipped as attention sinks) | | estimator | `dim_batch=8`, mean over valid source positions | | fit hardware | 1× NVIDIA H100 80GB, ~85 min, peak 24.5 GiB VRAM | ## License Apache-2.0, matching the reference implementation. The base model `zai-org/GLM-4-9B-0414` is MIT-licensed.

Note31. Aug.huggingface.co/andyx10/jacobian-lens-glm4-9b

Source context: 0 downloads · 0 likes · Library jlens · Repo andyx10/jacobian-lens-glm4-9b

Note13. Julihuggingface.co/dormantx/jacobian-lens-glm4-9b

Source context: 0 downloads · 0 likes · Library jlens · Repo dormantx/jacobian-lens-glm4-9b