This workflow will primarily use Ace-Step 1.5 Models to generate Music and an Cover Art image using Flux2.Klein 9B or Krea2 in one run.
Profil d'exécution
Description de la source
This workflow will primarily use Ace-Step 1.5 Models to generate Music and an Cover Art image using Flux2.Klein 9B or Krea2 in one run.
This workflow tries to be a comfortable one click generation WF with organized and well named output.
Meta Lyrics Version:
This one is a comprehensive all in one workflow which has the following features:
• Switch between ACE-Step models (Checkpoint / diffusion / unet)
• Switch between t2i models (Flux.2 klein 9B / Krea2)
• Save mp3 including metadata (cover-art inside the mp3 output)
Sources
1 sourceExtraits de sources
1 extraitSource context: 321 downloads · Type Workflows · Base model ACE Audio
• Save mp4 Lyrics video (warning: large file size and 2 minutes generation time)
warning - dependencies required and a particular custom node mandatory for this one:
GitHub - mattjohnpowell/comfyui-audio-expo · GitHub
FLUX.2 9B and Krea2 Version:
As a result the following will be saved by default:
Root Output folder → Folder named after your Music Title →
Filename will be: Artist - Title - Seed - Output type
Example:
Adaptalabor - Homing Flames - 619329538607327 - Audio_00001.mp3
Adaptalabor - Homing Flames - 619329538607327 - Cover_Art_0001.webp
Adaptalabor - Homing Flames - 619329538607327 - Static_Video_00001_.mp4
The Title will be shown in the Cover and influences the cover art design.
You can add an additional prompt to enhance the cover-art outcome.
Required Reccources:
Any CustomNodes that are used in this workflow.
Just make sure you have the Custom Nodes manager installed and
use the missing nodes download function.
Have Fun and have a nice day.
The Process:
It might be helpful that I posted a table (created with Copilot) that shows typical key-range/bpm/ and scales for each genre.
Furthermore I use a local llm on a seperate text-generation client to create the lyrics. My favorite Model right now is: MS3.2-The-Omega-Directive-24B-Unslop-v2.0 (16GB VRAM-Card)
A promt can looks like this:
"create long lyrics for a lo-fi style music song from a female's perspective. make it rhyme. make it erotic and poetic. Here are some outlines:
Verse1
[Description of the topic / theme / story]
Chorus:
[Description of the topic / theme / story]
Verse2
[Description of the topic / theme / story]
Chorus:
[Description of the topic / theme / story]
Verse3
[Description of the topic / theme / story]
Chorus:
[Description of the topic / theme / story]"
This usually works well."
I could not keep the whole thing to myself and hope it is as helpful to you as it was for me.
Enjoy!
Remaining hardware or download-size estimates are not available yet.
Exigences
VAE · 322 MB · SAFETENSORS · bf16 · Unknown
Checkpoint · 9.29 GB · Civitai · 2549270
acestep-5Hz-lm-4B-Q6_K.gguf
Non résoluText encoder · Unknown
acestep-v15-turbo-Q8_0.gguf
Non résoluCheckpoint · Unknown
aceStep15Music_sft17BAIO.safetensors
Non résoluCheckpoint · Unknown
Checkpoint · 8.79 GB · SAFETENSORS · Unknown
flux2-vae.safetensors
Fichier non vérifiéVAE · Unknown
Text encoder · Hugging Face · Comfy-Org/ace_step_1.5_ComfyUI_files
Text encoder · Hugging Face · Comfy-Org/ace_step_1.5_ComfyUI_files
Text encoder · 8.07 GB · SAFETENSORS · fp16 · Unknown
Pack de nœud · Registry
ComfyLiterals
TrouvéPack de nœud · Registry
comfyui-custom-scripts
TrouvéPack de nœud · Registry
ComfyUI-GGUF
PossiblePack de nœud · Registry
comfyui-mxtoolkit
TrouvéPack de nœud · Registry
comfyui-various
TrouvéPack de nœud · Registry
Pack de nœud · Registry
rgthree-comfy
TrouvéPack de nœud · Registry
was-node-suite-comfyui
PossiblePack de nœud · Registry
was-ns
Non résoluPack de nœud · Registry