Florence 2 Base PromptGen v2.0

--- license: mit --- # Florence-2-base-PromptGen v2.0 This upgrade is based on PromptGen 1.5 with some new features to the model: ## Features: * Improved caption quality for \<GENERATE_TAGS\>, \<DETAILED_CAPTION\> and \<MORE_DETAILED_CAPTION\>. <img style="width:100%; hight:100%" src="https://msdn.miaoshouai.com/miaoshou/bo/2024-11-05_03-15-15.png" /> <img style="width:100%; hight:100%" src="https://msdn.miaoshouai.com/miaoshou/bo/2024-11-05_03-40-29.png" /> * A new \<ANALYZE\> instruction, which helps the model to better understands the image composition of the input image. <img style="width:100%; hight:100%" src="https://msdn.miaoshouai.com/miaoshou/bo/2024-11-05_03-42-58.png" /> <img style="width:100%; hight:100%" src="https://msdn.miaoshouai.com/miaoshou/bo/2024-11-05_07-42-36.png" /> * Memory efficient compare to other models! This is a really light weight caption model that allows you to use a little more than 1G of VRAM and produce lightening fast and high quality image captions. <img style="width:100%; hight:100%" src="https://msdn.miaoshouai.com/miaoshou/bo/2024-09-05_12-56-39.png" /> * Designed to handle image captions for Flux model for both T5XXL CLIP and CLIP_L, the Miaoshou Tagger new node called "Flux CLIP Text Encode" which eliminates the need to run two separate tagger tools for caption creation. You can easily populate both CLIPs in a single generation, significantly boosting speed when working with Flux models. <img style="width:100%; hight:100%" src="https://msdn.miaoshouai.com/miaoshou/bo/2024-09-05_14-11-02.png" /> ## Instruction prompt: \<GENERATE_TAGS\> generate prompt as danbooru style tags<br> \<CAPTION\> a one line caption for the image<br> \<DETAILED_CAPTION\> a structured caption format which detects the position of the subjects in the image<br> \<MORE_DETAILED_CAPTION\> a very detailed description for the image<br> \<ANALYZE\> image composition analysis mode<br> \<MIXED_CAPTION\> a mixed caption style of more detailed caption and tags, this is extremely useful for FLUX model when using T5XXL and CLIP_L together. A new node in MiaoshouTagger ComfyUI is added to support this instruction.<br> \<MIXED_CAPTION_PLUS\> Combine the power of mixed caption with analyze.<br> ## Version History: For version 2.0, you will notice the following 1. \<ANALYZE\> along with a beta node in ComfyUI for partial image analysis 2. A new ins...

Source context: 5970 downloads · 73 likes · Repo MiaoshouAI/Florence-2-base-PromptGen-v2.0

Source context: 12828 downloads · 71 likes · Repo MiaoshouAI/Florence-2-base-PromptGen-v2.0