Tess 4 27B MLX Mixed 4 6

Tess-4-27B MLX mixed_4_6 This is an MLX conversion of , a Qwen3.6-27B based Qwen3.5-family multimodal reasoning model. ## Conversion - Source model: - Source revision: - Format: MLX safetensors - Quantization: - Reported size: about 16 GB - Reported average precision: 5.092 bits per weight - Vision tower: kept unquantized by the mlx-vlm conversion predicate The mixed quantization keeps embeddings, , selected , and selected layers at 6-bit while using 4-bit for most eligible language linear layers. ## Requirements Use a recent that includes the Qwen3.5 norm sanitization fix from PR . Older builds can double-shift Qwen3.5 norm weights when loading converted MLX checkpoints, causing broken logits. ## Quickstart For a concise answer without visible reasoning: ## Prompt Format Tess-4 uses the Qwen3.5-family chat template with explicit thinking blocks: Prefer instead of writing the template by hand. ## Verification The converted model was smoke-tested locally with greedy generation: Smoke-test stats on the conversion machine: - Prompt tokens: 22 - Generated tokens: 2 - Peak memory: about 19.0 GB ## Notes This is a lossy quantized conversion intended for local Apple Silicon inference with MLX. For maximum fidelity, use the original BF16 checkpoint. For llama.cpp, LM Studio, or Ollama-style runtimes, see the upstream GGUF repo linked from the original model card. ## Attribution Tess-4-27B was created by and is built on . This conversion keeps the original Apache 2.0 license. Original model card: