Image to video with generated audio

Animate a starting image into a video with generated sound using prompted motion, a base pass, a fixed 2× latent upscale, and refinement. Upload a starting image and enter a prompt describing the scene, action, camera motion, and desired sounds or dialogue. The model, distilled LoRA, and upscaler are fixed. For a first run, retain the 720-pixel output long edge, 97 video frames, 97 audio frames, and 20 fps for conditioning, audio timing, and export. Keep MP4 file type and H.264 codec. The video plays for approximately 4.85 seconds. Output proportions follow the uploaded image; latent sizing can round dimensions. The long edge means the larger dimension, not a guaranteed height. Uploaded transparency is not retained through the RGB image path. When changing duration, set video and audio frame counts together. Video length uses an 8n+1 pattern, such as 97 or 121 frames. Keep conditioning, audio, and export frame rates equal, using a positive whole-number rate within all three fields' ranges. These independent controls do not update one another. Changing only export fps changes video playback duration without changing generated audio timing. Keep both batch sizes at 1 for the first run; if adjusting them, keep them equal. Advanced image guidance offers independent base and refinement strengths and switches to skip either image injection. A strength has no effect when that pass's injection is skipped. Skipping refinement image conditioning retains the upscaled base result and still runs refinement. With both injections skipped, generation is prompt-driven, but the upload remains required for aspect ratio and sizing. Reference resize and compression affect conditioning preparation rather than saved-video dimensions or encoding. Advanced sampling offers a shared seed and sampler, separate CFG values and noise schedules for each pass, and independent model and text-encoder strengths for the fixed LoRA. Retain source defaults initially. Seed -1 randomizes each run; a fixed nonnegative seed reuses noise initialization. The negative prompt feeds both passes, but standard CFG at the default value of 1 gives it no negative-guidance contribution. The base schedule contains eight intervals and the refinement schedule three; changing their comma-separated values changes sampling steps and noise levels. File type and codec are separate export controls. Select a compatible combination that supports audio to retain generated sound; GIF cannot carry sound. Export also exposes CRF, bitrate in Mbps, pixel format, bit depth, and color-space settings. Retain their defaults for the first run and keep codec, pixel format, and bit depth compatible when changing them. Selecting HDR does not establish HDR information in generated frames. Advanced decoding controls spatial tile size and overlap in pixels and temporal chunk size and overlap in frames; keep overlaps smaller than their corresponding sizes.

Animate a starting image into a video with generated sound using prompted motion, a base pass, a fixed 2× latent upscale, and refinement. Upload a starting image and enter a prompt describing the scene, action, camera motion, and desired sounds or dialogue. The model, distilled LoRA, and upscaler are fixed. For a first run, retain the 720-pixel output long edge, 97 video frames, 97 audio frames, and 20 fps for conditioning, audio timing, and export. Keep MP4 file type and H.264 codec. The video plays for approximately 4.85 seconds. Output proportions follow the uploaded image; latent sizing can round dimensions. The long edge means the larger dimension, not a guaranteed height. Uploaded transparency is not retained through the RGB image path. When changing duration, set video and audio frame counts together. Video length uses an 8n+1 pattern, such as 97 or 121 frames. Keep conditioning, audio, and export frame rates equal, using a positive whole-number rate within all three fields' ranges. These independent controls do not update one another. Changing only export fps changes video playback duration without changing generated audio timing. Keep both batch sizes at 1 for the first run; if adjusting them, keep them equal. Advanced image guidance offers independent base and refinement strengths and switches to skip either image injection. A strength has no effect when that pass's injection is skipped. Skipping refinement image conditioning retains the upscaled base result and still runs refinement. With both injections skipped, generation is prompt-driven, but the upload remains required for aspect ratio and sizing. Reference resize and compression affect conditioning preparation rather than saved-video dimensions or encoding. Advanced sampling offers a shared seed and sampler, separate CFG values and noise schedules for each pass, and independent model and text-encoder strengths for the fixed LoRA. Retain source defaults initially. Seed -1 randomizes each run; a fixed nonnegative seed reuses noise initialization. The negative prompt feeds both passes, but standard CFG at the default value of 1 gives it no negative-guidance contribution. The base schedule contains eight intervals and the refinement schedule three; changing their comma-separated values changes sampling steps and noise levels. File type and codec are separate export controls. Select a compatible combination that supports audio to retain generated sound; GIF cannot carry sound. Export also exposes CRF, bitrate in Mbps, pixel format, bit depth, and color-space settings. Retain their defaults for the first run and keep codec, pixel format, and bit depth compatible when changing them. Selecting HDR does not establish HDR information in generated frames. Advanced decoding controls spatial tile size and overlap in pixels and temporal chunk size and overlap in frames; keep overlaps smaller than their corresponding sizes.