This is old stuff. AnimateDiff was one of the first Video AI solutions for offline needs. And this is the most basic workflow for it. The base for other AnimateDiff workflows.
Perfil de execução
Descrição da fonte
Howto
Adjust prompt. Generate.
Description
This is old stuff. AnimateDiff was one of the first Video AI solutions for offline needs. And this is the most basic workflow for it. The base for other AnimateDiff workflows.
This workflow here is about prompt traveling with AnimateDiff. You choose different prompts for different keyframes. And in the video the prompts morphs into each other.
There are two workflows available. One for AnimateDiff 2 and 3. And one for the AnimateLCM, which is based at AnimateDiff 2.
AnimateDiff and Stable Diffusion 1.5, which are used in conjunction, are trained at 512 pixels in size. So you better won't go this much higher in creation size. The result will become inconsistent. What you can try is to upscale afterwards.
Comentário gerado por IA
Explicação gerada por IA com base nos detalhes da fonte e da configuração. As sugestões são claramente identificadas.
Use this workflow to make an AnimateDiff video from different prompts assigned to keyframes; the prompts morph into one another over time.
Set different prompts for keyframes, then generate the video.
Choose between a version for AnimateDiff 2 and 3, or one for AnimateLCM, which is based on AnimateDiff 2.
Both versions are described as including upscaling; the example output is a six-second, 1280 × 720 video made with simple AI upscaling.
This version is listed for the SD 1.5 base model and is v1.0 by Arunderan.
Listed model files include analogMadness_v70.safetensors, AnimateLCM_sd15_t2v.ckpt, AnimateLCM_sd15_t2v_lora.safetensors, RealESRGAN_x2.pth, realismBYSTABLEYOGI_v6LCM .safetensors, rife47.pth, v2_lora_ZoomIn.ckpt, v3_sd15_adapter.ckpt, v3_sd15_mm.ckpt, and vae-ft-mse-840000-ema-<
Named node packs include ComfyUI-AnimateDiff-Evolved (ADE_AnimateDiffLoaderWithContext, ADE_AnimateDiffLoRALoader, ADE_AnimateDiffUniformContextOptions, ADE_ApplyAnimateDiffModelSimple, ADE_LoadAnimateDiffModel, ADE_LoopedUniformContextOptions, ADE_MultivalDynamic, ADE_UseEvolved
Other named nodes include CheckpointLoaderSimple, CLIPSetLastLayer, CLIPTextEncode, EmptyLatentImage, Fast Groups Bypasser (rgthree), Fast Groups Muter (rgthree), FreeU, ImageScale, ImageScaleBy, ImageUpscaleWithModel, KSampler, LoraLoaderModelOnly, RIFE VFI, VAEDecode, VAEEncode
The creator says AnimateDiff and SD 1.5 were trained at 512 pixels and advises against going much higher during generation because results may become inconsistent.
Sugestão · não verificado
For upscaling, the creator recommends using a separate workflow with a second KSampler.
Sugestão · não verificado
The creator says the workflows were made with 8 GB of VRAM, reports frequent out-of-memory errors, and recommends at least 12 GB for proper upscaling.
Sugestão · não verificado
No license information is listed for this workflow.
Isso precisa ser editado?
Faça login para enviar uma solicitação de edição.
Fontes
1 fonteTrechos de fonte
2 trechosSource context: 369 downloads · Type Workflows · Base model SD 1.5
Both workflows comes with upscaling. But i recommend to upscale in an extra workflow. By a second Ksampler. See this article here:
Time
The example with a length of six seconds and a resolution of 1280 x 720 (simple upscaling with AI) finished in two and a half minutes at an 4060 TI with 16gb Vram. It does not use the best upscaling method though.
Requirements
These workflows were generated with 8 gb vram back in the days. However, i ran too often into an OOM. And when you want to do a proper upscaling then i highly suggest a card with at least 12 gb vram.
Estimativa de requisito VRAM
Estimativa indisponível
457 MB distribuídos em 3 de 7 arquivos de modelo. Total de arquivos do modelo + 25% de overhead de carregamento + 2 GB de buffer de execução, arredondado para cima.
Requisitos
Requisitos 34AnimateLCM_sd15_t2v_lora.safetensors
Não resolvidoLoRA · Unknown
AnimateLCM_sd15_t2v.ckpt
Não resolvidoCheckpoint · Unknown
Upscaler · 64.0 MB · Hugging Face · ai-forever/Real-ESRGAN
realismBYSTABLEYOGI_v6LCM .safetensors
Não resolvidoCheckpoint · Unknown
Checkpoint · Hugging Face
LoRA · 73.9 MB · Hugging Face · guoyww/animatediff
vae-ft-mse-840000-ema-pruned.safetensors
EncontradoVAE · 319 MB · Hugging Face · stabilityai/sd-vae-ft-mse-original
Pacote de nós · Unknown
ADE_ApplyAnimateDiffModelSimple
EncontradoPacote de nós · Unknown
Source context: 353 downloads · Type Workflows · Base model SD 1.5
Pacote de nós · Unknown
ADE_LoopedUniformContextOptions
EncontradoPacote de nós · Unknown
Pacote de nós · Unknown
Pacote de nós · Unknown
Pacote de nós · Unknown
CheckpointLoaderSimple
PossívelPacote de nós · Unknown
CLIPSetLastLayer
PossívelPacote de nós · Unknown
CLIPTextEncode
PossívelPacote de nós · Unknown
EmptyLatentImage
PossívelPacote de nós · Unknown
Fast Groups Muter (rgthree)
Não resolvidoPacote de nós · Unknown
FreeU
PossívelPacote de nós · Unknown
ImageScale
PossívelPacote de nós · Unknown
ImageScaleBy
PossívelPacote de nós · Unknown
ImageUpscaleWithModel
PossívelPacote de nós · Unknown
KSampler
PossívelPacote de nós · Unknown
LoraLoaderModelOnly
PossívelPacote de nós · Unknown
RIFE VFI
PossívelPacote de nós · Unknown
Pacote de nós · Unknown
UpscaleModelLoader
PossívelPacote de nós · Unknown
VAEDecode
PossívelPacote de nós · Unknown
VAEEncode
PossívelPacote de nós · Unknown
VAELoader
PossívelPacote de nós · Unknown
VHS_GetLatentCount
PossívelPacote de nós · Unknown
VHS_VideoCombine
PossívelPacote de nós · Unknown
Pacote de nós · Unknown