Loading
Have a ComfyUI workflow? Get a readable Workflow Doc in your browser.Make a workflow readable.Try it now ↗
This is a Multimodal World Model architecture based on the Joint-Embedding Predictive Architecture (JEPA). It fuses the reasoning power of Qwen3-VL-4B-Thinking with the visual latent space of Stable Diffusion VAE.
Model source
Source description
This is a Multimodal World Model architecture based on the Joint-Embedding Predictive Architecture (JEPA). It fuses the reasoning power of Qwen3-VL-4B-Thinking with the visual latent space of Stable Diffusion VAE.
Sources
1 sourceVerified Sep 10
Model artifacts
1 artifactSource excerpts
2 excerpts--- language: en license: apache-2.0 library_name: transformers tags: - multimodal - jepa - world-model - qwen3 - vision base_model: Qwen/Qwen3-VL-4B-Thinking pipeline_tag: image-to-text --- # Qwen3-VL JEPA World Model This is a **Multimodal World Model** architecture based on the **Joint-Embedding Predictive Architecture (JEPA)**. It fuses the reasoning power of **Qwen3-VL-4B-Thinking** with the visual latent space of **Stable Diffusion VAE**. ## 🧠 Architecture - **Thinking Engine:** `Qwen/Qwen3-VL-4B-Thinking` - **Visual Perception:** `runwayml/stable-diffusion-v1-5` (VAE) - **World Modeling:** Designed to predict the next latent state of a scene. ## 🛠 Status This repository contains the **structural fuse**. The predictors are currently randomly initialized and require training on sequential image data to function as a world model.
Qwen/Qwen3-VL-4B-Thinkingrunwayml/stable-diffusion-v1-5 (VAE)This repository contains the structural fuse. The predictors are currently randomly initialized and require training on sequential image data to function as a world model.
Source context: 3 downloads · 1 likes · Pipeline image-to-text · Library transformers · Repo burnboom/Qwen3_world_model_test