Companion Engine — v1.0 — v2.0

Companion Engine is a ComfyUI workflow for spoken avatar video replies: give it an avatar image, a setting, a voice sample, a question, and prompts, and it can create a video answer that carries its last frame into the next run.

Ollama sends the question and avatar image to a vision model; its JSON reply supplies a scene description and duration, which MiniMax H3 uses to render the speaking avatar with audio from the voice sample.

With continuity enabled, the last frame of the video is isolated and fed into the model for the next run.

Canvas controls include the avatar image, voice sample, Ollama server URL and model, question, resolution, and loaders for the diffusion model, text encoder, video VAE, and audio VAE.

The outputs are the video, the LLM's raw JSON, and the exact prompt sent to MiniMax.

Version v2.0 is listed for MiniMax H3, and the default Ollama server address is 127.0.0.1:11434.

The listed node packs are comfyui-easy-use, comfyui-impact-pack, and comfyui-ollama.

Listed model files are minimax_h3_audio_vae_fp32.safetensors, minimax_h3_ref2v_lightx2v_turbo_4step_v0.1_resized_avg_rank_20_bf16.safetensors, minimax_h3_ref2va_pruned_int8_convrot.safetensors, minimax_h3_video_vae_fp16.safetensors, and qwen3vl_32b_minimax_h3_nvfp4_awq.safetensor

For the first round, set Continuity off and Reset Memory on; for later rounds, turn Continuity on and Reset Memory off, then edit the conversation prompt.

Use the conversation prompt to describe the avatar's identity, personality, and goals or ask questions; a separate hidden prompt can guide content the companion may not know unless it sees it in a later frame.

This is described as a concept prototype, not a finished product.

No download location is listed for minimax_h3_ref2v_lightx2v_turbo_4step_v0.1_resized_avg_rank_20_bf16.safetensors, so check that you can obtain it before setup.

Sugestão · não verificado