Saltar al contenido
ModelPublicadoExterno
Descargar

Text2video Zero ControlNet Canny Anime

Text2Video-Zero is a zero-shot text to video generator. It can perform zero-shot text-to-video generation, Video Instruct Pix2Pix (instruction-guided video editing), text and pose conditional video generation, text...

Fuentehuggingface.co/PAIR/text2video-zero-controlnet-canny-anime/tree/a899ef66873284213cc9f5f2eac3602166490b2e
TipoOtherVersiónpytorch_modelBcalidad

Fuente del modelo

Tipo
Other
Tamaño del archivo
1,13 GB
Versión
vpytorch_model
Actualizado
6 oct 2026
Descargas
18
Fuente
Hugging Face

Descripción de la fuente

Text2Video-Zero Model Card - ControlNet Canny Anime Style

Text2Video-Zero is a zero-shot text to video generator. It can perform zero-shot text-to-video generation, Video Instruct Pix2Pix (instruction-guided video editing), text and pose conditional video generation, text and canny-edge conditional video generation, and text, canny-edge and dreambooth conditional video generation. For more information about this work, please have a look at our paper and our demo: Hugging Face Spaces Our code works with any StableDiffusion base model.

This model provides DreamBooth weights for the Anime style to be used with edge guidance (using ControlNet) in text2video zero.

Weights for Text2Video-Zero

We converted the original weights into diffusers and made them usable for ControlNet with edge guidance using: https://github.com/lllyasviel/ControlNet/discussions/12.

Model Details

  • Developed by: Levon Khachatryan, Andranik Movsisyan, Vahram Tadevosyan, Roberto Henschel, Zhangyang Wang, Shant Navasardyan and Humphrey Shi

  • Model type: Dreambooth text-to-image and text-to-video generation model with edge control for text2video zero

  • Language(s): English

  • License: The CreativeML OpenRAIL M license.

  • Model Description: This is a model for text2video zero with edge guidance and anime style. It can be used also with ControlNet in a text-to-image setup with edge guidance.

  • DreamBoth Keyword: anime style

  • Resources for more information: GitHub, Paper, CIVITAI.

  • Cite as:

    @article{text2video-zero,
  title={Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators},
  author={Khachatryan, Levon and Movsisyan, Andranik and Tadevosyan, Vahram and Henschel, Roberto and Wang, Zhangyang and Navasardyan, Shant and Shi, Humphrey},
  journal={arXiv preprint arXiv:2303.13439},
  year={2023}
}

Original Weights

The Dreambooth weights for the Anime style were taken from CIVITAI.

Model Details

  • Developed by: Quiet_Joker (Username listed on CIVITAI)
  • Model type: Dreambooth text-to-image generation model
  • Language(s): English
  • License: The CreativeML OpenRAIL M license.
  • Model Description: This is a model that was created using DreamBooth to generate images with Anime style, based on text prompts.
  • DreamBoth Keyword: anime style
  • Resources for more information: CIVITAI.

Biases content acknowledgement:

Beware that Text2Video-Zero may output content that reinforces or exacerbates societal biases, as well as realistic faces, pornography, and violence. Text2Video-Zero in this demo is meant only for research purposes.

Citation

  @article{text2video-zero,
    title={Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators},
    author={Khachatryan, Levon and Movsisyan, Andranik and Tadevosyan, Vahram and Henschel, Roberto and Wang, Zhangyang and Navasardyan, Shant and Shi, Humphrey},
    journal={arXiv preprint arXiv:2303.13439},
    year={2023}
  }

Fuentes

1 fuente
Hugging FacePrincipalVersión a899ef66873284213cc9f5f2eac3602166490b2e
huggingface.co/PAIR/text2video-zero-controlnet-canny-anime/tree/a899ef66873284213cc9f5f2eac3602166490b2e

Verificado 6 oct

Artefactos del modelo

1 artefacto

safety_checker/pytorch_model.bin

bin · 1,13 GB · SHA-256 16d28f2b3710…a394 · Hugging Face

Descargar

Extractos de fuentes

3 extractos
Readme29 julhuggingface.co/PAIR/text2video-zero-controlnet-canny-anime

--- license: creativeml-openrail-m library_name: diffusers inference: true pipeline_tag: text-to-video tags: - text-to-video - text-to-image --- # Text2Video-Zero Model Card - ControlNet Canny Anime Style [Text2Video-Zero](https://arxiv.org/abs/2303.13439) is a zero-shot text to video generator. It can perform `zero-shot text-to-video generation`, `Video Instruct Pix2Pix` (instruction-guided video editing), `text and pose conditional video generation`, `text and canny-edge conditional video generation`, and `text, canny-edge and dreambooth conditional video generation`. For more information about this work, please have a look at our [paper](https://arxiv.org/abs/2303.13439) and our demo: [![Hugging Face Spaces](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Spaces-blue)](https://huggingface.co/spaces/PAIR/Text2Video-Zero) Our [code](https://github.com/Picsart-AI-Research/Text2Video-Zero) works with any StableDiffusion base model. This model provides [DreamBooth](https://arxiv.org/abs/2208.12242) weights for the `Anime style` to be used with edge guidance (using [ControlNet](https://arxiv.org/abs/2302.05543)) in text2video zero. ## Weights for Text2Video-Zero We converted the original weights into diffusers and made them usable for [ControlNet](https://arxiv.org/abs/2302.05543) with edge guidance using: https://github.com/lllyasviel/ControlNet/discussions/12. ### Model Details - **Developed by:** Levon Khachatryan, Andranik Movsisyan, Vahram Tadevosyan, Roberto Henschel, Zhangyang Wang, Shant Navasardyan and Humphrey Shi - **Model type:** Dreambooth text-to-image and text-to-video generation model with edge control for text2video zero - **Language(s):** English - **License:** [The CreativeML OpenRAIL M license](https://huggingface.co/spaces/CompVis/stable-diffusion-license). - **Model Description:** This is a model for [text2video zero](https://github.com/Picsart-AI-Research/Text2Video-Zero) with edge guidance and anime style. It can be used also with ControlNet in a text-to-image setup with edge guidance. - **DreamBoth Keyword:** anime style - **Resources for more information:** [GitHub](https://github.com/Picsart-AI-Research/Text2Video-Zero), [Paper](https://arxiv.org/abs/2303.13439), [CIVITAI](https://civitai.com/models/8740/superanime-viper). - **Cite as:** @article{text2video-zero, title={Text2Video-Zero: Text-to-Image Diffusion Mod...

Note6 octhuggingface.co/PAIR/text2video-zero-controlnet-canny-anime

Source context: 18 downloads · 20 likes · Pipeline text-to-video · Library diffusers · Repo PAIR/text2video-zero-controlnet-canny-anime

Note29 julhuggingface.co/PAIR/text2video-zero-controlnet-canny-anime

Source context: 42 downloads · 20 likes · Pipeline text-to-video · Library diffusers · Repo PAIR/text2video-zero-controlnet-canny-anime