Loading
¿Tienes un flujo de trabajo de ComfyUI? Obtén un Workflow Doc legible en tu navegador.Haz legible un flujo de trabajo.Pruébalo ahora ↗
This is a Multimodal World Model architecture based on the Joint-Embedding Predictive Architecture (JEPA). It fuses the reasoning power of Qwen3-VL-4B-Thinking with the visual latent space of Stable Diffusion VAE.
Fuente del modelo
Descripción de la fuente
This is a Multimodal World Model architecture based on the Joint-Embedding Predictive Architecture (JEPA). It fuses the reasoning power of Qwen3-VL-4B-Thinking with the visual latent space of Stable Diffusion VAE.
Fuentes
1 fuenteVerificado 10 sept
Artefactos del modelo
1 artefactoExtractos de fuentes
2 extractos--- language: en license: apache-2.0 library_name: transformers tags: - multimodal - jepa - world-model - qwen3 - vision base_model: Qwen/Qwen3-VL-4B-Thinking pipeline_tag: image-to-text --- # Qwen3-VL JEPA World Model This is a **Multimodal World Model** architecture based on the **Joint-Embedding Predictive Architecture (JEPA)**. It fuses the reasoning power of **Qwen3-VL-4B-Thinking** with the visual latent space of **Stable Diffusion VAE**. ## 🧠 Architecture - **Thinking Engine:** `Qwen/Qwen3-VL-4B-Thinking` - **Visual Perception:** `runwayml/stable-diffusion-v1-5` (VAE) - **World Modeling:** Designed to predict the next latent state of a scene. ## 🛠 Status This repository contains the **structural fuse**. The predictors are currently randomly initialized and require training on sequential image data to function as a world model.
Qwen/Qwen3-VL-4B-Thinkingrunwayml/stable-diffusion-v1-5 (VAE)This repository contains the structural fuse. The predictors are currently randomly initialized and require training on sequential image data to function as a world model.
Source context: 3 downloads · 1 likes · Pipeline image-to-text · Library transformers · Repo burnboom/Qwen3_world_model_test