This repository contains various nodes for supporting Deforum-style animation generation with ComfyUI. I created these
for my own use (producing videos for my "Alt Key Project" music -
youtube channel), but I think they should be generic enough
and useful to many ComfyUI users.
I have demonstrated the use of these custom nodes in this youtube video.
This custom node pack is currently not being updated. Stable Diffusion video generation is moving towards a different
workflow with AnimateDiff and Stable Video Diffusion. I decided to not try to update this node pack, but I am instead
creating a separate custom node pack here:
After startup, a configuration file 'config.json' should have been created in the 'comfyui-dream-project' directory.
Specifically check that the path of ffmpeg works in your system (add full path to the command if needed).
Upgrade
When upgrading, it is good to re-run the pip install command as specified in the install section. This will install any
new dependencies.
Configuration
debug
Setting this to true will enable some trace-level logging.
ffmpeg.file_extension
Sets the output file extension and with that the envelope used.
ffmpeg.path
Path to the ffmpeg executable or just the command if ffmpeg is in PATH.
ffmpeg.arguments
The arguments sent to FFMPEG. A few of the values are provided by the node:
%FPS% the target framerate
%FRAMES% a frame ionput file
%OUTPUT% output video file path
encoding.jpeg__quality
Sets the encoding quality of jpeg images.
ui.top_category
Sets the name of the top level category on the menu. Set to empty string "" to remove the top level. If the top level
is removed you may also want to disable the category icons to get nodes into existing category folders.
Flags to add an icon before and/or after the node name.
ui.category_icons
Each key defines a unicode symbol as an icon used for the specified category.
mpeg_coder.bitrate_factor
This factor allows changing the bitrate to better fit the required quality and codec. A value of 1 is typically
suitable for H.265.
mpeg_coder.codec_name
Codec names as specified by ffmpeg. Some common options include "libx264", "libx264" and "mpeg2video".
mpeg_coder.encoding_threads
Increasing the number of encoding threads in mpegCoder will generally reduce the overall encoding time, but it will also
increase the load on the computer.
mpeg_coder.file_extension
Sets the output file extension and with that the envelope used.
mpeg_coder.max_b_frame
Sets the max-b-frames parameter for as specified in ffmpeg.
Concepts used
These are some concepts used in nodes:
Frame Counter
The frame counter is an abstraction that keeps track of where we are in the animation - what frame is rendered
and how does the current frame fit into the current animation.
Curves
A curve is simply a node that produces a value based
Knoten in diesem Paket
58 Knoten (Plural)
Analyze Palette [Dream]
Analyze Palette [Dream]
Output brightness, red, green and blue averages of a palette. Useful to control other processing.
Beat Curve [Dream]
Beat Curve [Dream]
Beat pattern curve with impulses at specified beats of a measure.
Big Float Switch [Dream]
Big Float Switch [Dream]
Kompakte Beschreibung für diesen Knoten nicht verfügbar.
Big Image Switch [Dream]
Big Image Switch [Dream]
Kompakte Beschreibung für diesen Knoten nicht verfügbar.
Big Int Switch [Dream]
Big Int Switch [Dream]
Kompakte Beschreibung für diesen Knoten nicht verfügbar.
Big Latent Switch [Dream]
Big Latent Switch [Dream]
Kompakte Beschreibung für diesen Knoten nicht verfügbar.
Big Palette Switch [Dream]
Big Palette Switch [Dream]
Kompakte Beschreibung für diesen Knoten nicht verfügbar.
Big Text Switch [Dream]
Big Text Switch [Dream]
Kompakte Beschreibung für diesen Knoten nicht verfügbar.
Boolean To Float [Dream]
Boolean To Float [Dream]
Kompakte Beschreibung für diesen Knoten nicht verfügbar.
Boolean To Int [Dream]
Boolean To Int [Dream]
Kompakte Beschreibung für diesen Knoten nicht verfügbar.
Build Prompt [Dream]
Build Prompt [Dream]
Kompakte Beschreibung für diesen Knoten nicht verfügbar.
Calculation [Dream]
Calculation [Dream]
Mathematical calculation node. Exposes most of the mathematical functions in the python float, max and min.
Common Frame Dimensions [Dream]
Common Frame Dimensions [Dream]
Utility for calculating good width/height based on common video dimensions.
Compare Palettes [Dream]
Compare Palettes [Dream]
Analyses two palettes and produces the quotient for each individual channel (b/a) and brightness.
CSV Curve [Dream]
CSV Curve [Dream]
CSV input curve where first column is frame or second and second column is value.
CSV Generator [Dream]
CSV Generator [Dream]
CSV output, mainly for debugging purposes. First column is frame number and second is value. Recreates file at frame 0 (removing and existing content in the file).
FFMPEG Video Encoder [Dream]
FFMPEG Video Encoder [Dream]
Kompakte Beschreibung für diesen Knoten nicht verfügbar.
File Count [Dream]
File Count [Dream]
Finds the number of files in a directory matching specified patterns.
Finalize Prompt [Dream]
Finalize Prompt [Dream]
Kompakte Beschreibung für diesen Knoten nicht verfügbar.
Float Input [Dream]
Float Input [Dream]
Kompakte Beschreibung für diesen Knoten nicht verfügbar.
Float to Log Entry [Dream]
Float to Log Entry [Dream]
Kompakte Beschreibung für diesen Knoten nicht verfügbar.
Frame Count Calculator [Dream]
Frame Count Calculator [Dream]
Simple utility to calculate number of frames based on time and framerate.
Frame Counter (Directory) [Dream]
Frame Counter (Directory) [Dream]
Directory backed frame counter, for output directories.
Frame Counter (Simple) [Dream]
Frame Counter (Simple) [Dream]
Integer value used as frame counter. Useful for testing or if an auto-incrementing primitive is used as a frame counter.
Frame Counter Info [Dream]
Frame Counter Info [Dream]
Extracts information from the frame counter.
Frame Counter Offset [Dream]
Frame Counter Offset [Dream]
Adds an offset (in frames) to a frame counter.
Frame Counter Time Offset [Dream]
Frame Counter Time Offset [Dream]
Adds an offset in seconds to a frame counter.
Image Brightness Adjustment [Dream]
Image Brightness Adjustment [Dream]
Adjusts the brightness of an image by a factor.
Image Color Shift [Dream]
Image Color Shift [Dream]
Allows changing the colors of an image with a multiplier for each channel (RGB).
Image Contrast Adjustment [Dream]
Image Contrast Adjustment [Dream]
Adjusts the contrast of an image by a factor.
Image Motion [Dream]
Image Motion [Dream]
Node supporting zooming in/out and translating an image.
Image Sequence Blend [Dream]
Image Sequence Blend [Dream]
Post processing for animation sequences blending frame for a smoother blurred effect.
Image Sequence Loader [Dream]
Image Sequence Loader [Dream]
Loads a frame from a directory of images.
Image Sequence Saver [Dream]
Image Sequence Saver [Dream]
Saves a frame to a directory.
Image Sequence Tweening [Dream]
Image Sequence Tweening [Dream]
Post processing for animation sequences generating blended in-between frames.
Int Input [Dream]
Int Input [Dream]
Kompakte Beschreibung für diesen Knoten nicht verfügbar.
Int to Log Entry [Dream]
Int to Log Entry [Dream]
Kompakte Beschreibung für diesen Knoten nicht verfügbar.
Laboratory [Dream]
Laboratory [Dream]
Super-charged number generator for experimenting with ComfyUI.
Linear Curve [Dream]
Linear Curve [Dream]
Linear interpolation between two values over the full animation.
Log Entry Joiner [Dream]
Log Entry Joiner [Dream]
Merges multiple log entries (reduces noodling).
Log File [Dream]
Log File [Dream]
The text logging facility for the Dream Project Animation nodes.
Noise from Area Palettes [Dream]
Noise from Area Palettes [Dream]
Generates noise based on the colors of up to nine different palettes, each connected to position/area of the image. Although the palettes are optional, at least one palette should be provided.
Noise from Palette [Dream]
Noise from Palette [Dream]
Generates noise based on the colors in a palette.
Palette Color Align [Dream]
Palette Color Align [Dream]
Shifts the colors of one palette towards another target palette. If the alignment factor is 0.5 the result is nearly an average of the two palettes. At 0 no alignment is done and at 1 we get a close alignment to the target. Above one we will overshoot the alignment.
Palette Color Shift [Dream]
Palette Color Shift [Dream]
Multiplies the color values in a palette to shift the color balance or brightness.
Random Prompt Words [Dream]
Random Prompt Words [Dream]
Randomly picks words/tokens/phrases from an input text.
Sample Image Area as Palette [Dream]
Sample Image Area as Palette [Dream]
Randomly samples a palette from an image based on pre-defined areas. The image is separated into nine rectangular areas of equal size and each node may sample one of these.
Sample Image as Palette [Dream]
Sample Image as Palette [Dream]
Randomly samples pixels from a source image to build a palette from it.
Saw Curve [Dream]
Saw Curve [Dream]
Kompakte Beschreibung für diesen Knoten nicht verfügbar.
Sine Curve [Dream]
Sine Curve [Dream]
Kompakte Beschreibung für diesen Knoten nicht verfügbar.
Smooth Event Curve [Dream]
Smooth Event Curve [Dream]
Single event/peak curve with a slight bell-shape.
String Input [Dream]
String Input [Dream]
Kompakte Beschreibung für diesen Knoten nicht verfügbar.
String to Log Entry [Dream]
String to Log Entry [Dream]
Kompakte Beschreibung für diesen Knoten nicht verfügbar.
String Tokenizer [Dream]
String Tokenizer [Dream]
Splits a text into tokens by a separator and returns one of the tokens based on a given index.
Text Input [Dream]
Text Input [Dream]
Kompakte Beschreibung für diesen Knoten nicht verfügbar.
Triangle Curve [Dream]
Triangle Curve [Dream]
Kompakte Beschreibung für diesen Knoten nicht verfügbar.
