Qwen3.6 35B A3B 6bit

--- library_name: mlx base_model: Qwen/Qwen3.6-35B-A3B license: apache-2.0 pipeline_tag: text-generation tags: - mlx - mlx-lm - quantized - 6-bit - base_model:Qwen/Qwen3.6-35B-A3B --- [](https://mlxhub.app/open-model?repo=DreamFoundries/Qwen3.6-35B-A3B-6bit) # Qwen3.6-35B-A3B MLX 6-bit This repository contains an MLX-LM conversion of [Qwen/Qwen3.6-35B-A3B](https://huggingface.co/Qwen/Qwen3.6-35B-A3B). ## Conversion Details - Original model: `Qwen/Qwen3.6-35B-A3B` - Model family: Qwen3.6 - Source model type: `qwen3_5_moe` - Model size: 35,951,822,704 parameters - Quantization: MLX-LM affine quantization - Bits: 6-bit - Group size: 64 - Local MLX folder size at upload time: 26.25 GiB - Local safetensors weight size at upload time: 26.23 GiB ## Usage ```bash mlx_lm.generate --model DreamFoundries/Qwen3.6-35B-A3B-6bit --prompt "Hello" --max-tokens 64 ``` ## Benchmarks No comparative benchmarks have been run yet. The repository does not currently provide quality, speed, memory, or benchmark comparisons against the original weights or other quantizations. ## License This is a converted/quantized derivative of the original model. Please refer to the original model repository for the upstream license and usage terms: https://huggingface.co/Qwen/Qwen3.6-35B-A3B --- [](https://apps.apple.com/app/apple-store/id6766485144?pt=121945436&ct=HuggingFace&mt=8)

--- library_name: mlx base_model: Qwen/Qwen3.6-35B-A3B license: apache-2.0 pipeline_tag: text-generation tags: - mlx - mlx-lm - quantized - 6-bit - base_model:Qwen/Qwen3.6-35B-A3B --- # Qwen3.6-35B-A3B MLX 6-bit This repository contains an MLX-LM conversion of [Qwen/Qwen3.6-35B-A3B](https://huggingface.co/Qwen/Qwen3.6-35B-A3B). ## Conversion Details - Original model: `Qwen/Qwen3.6-35B-A3B` - Model family: Qwen3.6 - Source model type: `qwen3_5_moe` - Model size: 35,951,822,704 parameters - Quantization: MLX-LM affine quantization - Bits: 6-bit - Group size: 64 - Local MLX folder size at upload time: 26.25 GiB - Local safetensors weight size at upload time: 26.23 GiB ## Usage ```bash mlx_lm.generate --model DreamFoundries/Qwen3.6-35B-A3B-6bit --prompt "Hello" --max-tokens 64 ``` ## Benchmarks No comparative benchmarks have been run yet. The repository does not currently provide quality, speed, memory, or benchmark comparisons against the original weights or other quantizations. ## License This is a converted/quantized derivative of the original model. Please refer to the original model repository for the upstream license and usage terms: https://huggingface.co/Qwen/Qwen3.6-35B-A3B

Source context: 151 downloads · 0 likes · Pipeline text-generation · Library mlx · Repo DreamFoundries/Qwen3.6-35B-A3B-6bit