This is old stuff. AnimateDiff was one of the first Video AI solutions for offline needs. And this is the most basic workflow for it. The base for other AnimateDiff workflows.
Perfil de ejecución
Descripción de la fuente
Howto
Adjust prompt. Generate.
Description
This is old stuff. AnimateDiff was one of the first Video AI solutions for offline needs. And this is the most basic workflow for it. The base for other AnimateDiff workflows.
This workflow here is about prompt traveling with AnimateDiff. You choose different prompts for different keyframes. And in the video the prompts morphs into each other.
There are two workflows available. One for AnimateDiff 2 and 3. And one for the AnimateLCM, which is based at AnimateDiff 2.
AnimateDiff and Stable Diffusion 1.5, which are used in conjunction, are trained at 512 pixels in size. So you better won't go this much higher in creation size. The result will become inconsistent. What you can try is to upscale afterwards.
Comentario generado por IA
Explicación generada por IA basada en los detalles de la fuente y la configuración. Las sugerencias están claramente identificadas.
Use this workflow to make an AnimateDiff video from different prompts assigned to keyframes; the prompts morph into one another over time.
Set different prompts for keyframes, then generate the video.
Choose between a version for AnimateDiff 2 and 3, or one for AnimateLCM, which is based on AnimateDiff 2.
Both versions are described as including upscaling; the example output is a six-second, 1280 × 720 video made with simple AI upscaling.
This version is listed for the SD 1.5 base model and is v1.0 by Arunderan.
Listed model files include analogMadness_v70.safetensors, AnimateLCM_sd15_t2v.ckpt, AnimateLCM_sd15_t2v_lora.safetensors, RealESRGAN_x2.pth, realismBYSTABLEYOGI_v6LCM .safetensors, rife47.pth, v2_lora_ZoomIn.ckpt, v3_sd15_adapter.ckpt, v3_sd15_mm.ckpt, and vae-ft-mse-840000-ema-<
Named node packs include ComfyUI-AnimateDiff-Evolved (ADE_AnimateDiffLoaderWithContext, ADE_AnimateDiffLoRALoader, ADE_AnimateDiffUniformContextOptions, ADE_ApplyAnimateDiffModelSimple, ADE_LoadAnimateDiffModel, ADE_LoopedUniformContextOptions, ADE_MultivalDynamic, ADE_UseEvolved
Other named nodes include CheckpointLoaderSimple, CLIPSetLastLayer, CLIPTextEncode, EmptyLatentImage, Fast Groups Bypasser (rgthree), Fast Groups Muter (rgthree), FreeU, ImageScale, ImageScaleBy, ImageUpscaleWithModel, KSampler, LoraLoaderModelOnly, RIFE VFI, VAEDecode, VAEEncode
The creator says AnimateDiff and SD 1.5 were trained at 512 pixels and advises against going much higher during generation because results may become inconsistent.
Sugerencia · sin verificar
For upscaling, the creator recommends using a separate workflow with a second KSampler.
Sugerencia · sin verificar
The creator says the workflows were made with 8 GB of VRAM, reports frequent out-of-memory errors, and recommends at least 12 GB for proper upscaling.
Sugerencia · sin verificar
No license information is listed for this workflow.
¿Es necesario editarlo?
Inicia sesión para solicitar una edición.
Fuentes
1 fuenteExtractos de fuentes
2 extractosSource context: 369 downloads · Type Workflows · Base model SD 1.5
Both workflows comes with upscaling. But i recommend to upscale in an extra workflow. By a second Ksampler. See this article here:
Time
The example with a length of six seconds and a resolution of 1280 x 720 (simple upscaling with AI) finished in two and a half minutes at an 4060 TI with 16gb Vram. It does not use the best upscaling method though.
Requirements
These workflows were generated with 8 gb vram back in the days. However, i ran too often into an OOM. And when you want to do a proper upscaling then i highly suggest a card with at least 12 gb vram.
Requisito de VRAM estimado
Estimación no disponible
457 MB en 3 de 7 archivos de modelos. Total de archivos de modelos + 25 % de sobrecarga de carga + 2 GB de margen de ejecución, redondeado hacia arriba.
Requisitos
34 requisitosAnimateLCM_sd15_t2v_lora.safetensors
No resueltoLoRA · Unknown
AnimateLCM_sd15_t2v.ckpt
No resueltoCheckpoint · Unknown
Upscaler · 64.0 MB · Hugging Face · ai-forever/Real-ESRGAN
realismBYSTABLEYOGI_v6LCM .safetensors
No resueltoCheckpoint · Unknown
Checkpoint · Hugging Face
LoRA · 73.9 MB · Hugging Face · guoyww/animatediff
vae-ft-mse-840000-ema-pruned.safetensors
EncontradoVAE · 319 MB · Hugging Face · stabilityai/sd-vae-ft-mse-original
Paquete de nodos · Unknown
ADE_ApplyAnimateDiffModelSimple
EncontradoPaquete de nodos · Unknown
Source context: 353 downloads · Type Workflows · Base model SD 1.5
Paquete de nodos · Unknown
ADE_LoopedUniformContextOptions
EncontradoPaquete de nodos · Unknown
Paquete de nodos · Unknown
Paquete de nodos · Unknown
Paquete de nodos · Unknown
CheckpointLoaderSimple
PosiblePaquete de nodos · Unknown
CLIPSetLastLayer
PosiblePaquete de nodos · Unknown
CLIPTextEncode
PosiblePaquete de nodos · Unknown
EmptyLatentImage
PosiblePaquete de nodos · Unknown
Fast Groups Muter (rgthree)
No resueltoPaquete de nodos · Unknown
FreeU
PosiblePaquete de nodos · Unknown
ImageScale
PosiblePaquete de nodos · Unknown
ImageScaleBy
PosiblePaquete de nodos · Unknown
ImageUpscaleWithModel
PosiblePaquete de nodos · Unknown
KSampler
PosiblePaquete de nodos · Unknown
LoraLoaderModelOnly
PosiblePaquete de nodos · Unknown
RIFE VFI
PosiblePaquete de nodos · Unknown
Paquete de nodos · Unknown
UpscaleModelLoader
PosiblePaquete de nodos · Unknown
VAEDecode
PosiblePaquete de nodos · Unknown
VAEEncode
PosiblePaquete de nodos · Unknown
VAELoader
PosiblePaquete de nodos · Unknown
VHS_GetLatentCount
PosiblePaquete de nodos · Unknown
VHS_VideoCombine
PosiblePaquete de nodos · Unknown
Paquete de nodos · Unknown