Aller au contenu
ModelPrésentéExterne
Browse files

LatentSync

This repo not only stores the pretrained U-Net and SyncNet checkpoints of LatentSync, but also stores the whisper checkpoints, auxiliary checkpoints for detecting face, calculating syncnet confidence score and so on....

TypeOtherVersionI3d torchscriptCClasse

Source du modèle

Type
Other
Taille du fichier
48,9 MB–3,17 GB
Version
vI3d torchscript
Mis à jour
20 oct. 2026
Source
Hugging Face

Description de la source

The checkpoints of LatentSync

This repo not only stores the pretrained U-Net and SyncNet checkpoints of LatentSync, but also stores the whisper checkpoints, auxiliary checkpoints for detecting face, calculating syncnet confidence score and so on. They have covered all you need for both inference and training of LatentSync

Paper: https://arxiv.org/abs/2412.09262

Code: https://github.com/bytedance/LatentSync

Sources

1 source
Hugging FacePrincipalVersion 883e784233984f0e22f85688aba1bb87328ab355
huggingface.co/Kirfol/LatentSync/tree/883e784233984f0e22f85688aba1bb87328ab355

Vérifié 20 oct.

Download files

Artefacts du modèle

8 artefacts

auxiliary/i3d_torchscript.pt

pt · 48,9 MB · SHA-256 bec6519f66ea…a5e2 · Hugging Face

Download file

auxiliary/s3fd-619a316812.pth

pth · 85,7 MB · SHA-256 619a31681264…3543 · Hugging Face

Download file

auxiliary/sfd_face.pth

pth · 85,7 MB · SHA-256 d54a87c2b754…c491 · Hugging Face

Download file

auxiliary/vgg16-397923af.pth

pth · 528 MB · SHA-256 397923af8e79…5bf0 · Hugging Face

Download file

auxiliary/vit_g_hybrid_pt_1200e_ssv2_ft.pth

pth · 1,88 GB · SHA-256 5a210a92f035…7e70 · Hugging Face

Download file

latentsync_syncnet.pt

pt · 1,39 GB · SHA-256 38fa63bad3ed…4da5 · Hugging Face

Download file

latentsync_unet.pt

pt · 3,17 GB · SHA-256 63197c73d21a…f3c7 · Hugging Face

Download file

whisper/tiny.pt

pt · 72,1 MB · SHA-256 65147644a518…22b9 · Hugging Face

Download file

Extraits de sources

2 extraits

--- license: openrail++ library_name: diffusers tags: - video-to-video --- # The checkpoints of LatentSync This repo not only stores the pretrained U-Net and SyncNet checkpoints of LatentSync, but also stores the whisper checkpoints, auxiliary checkpoints for detecting face, calculating syncnet confidence score and so on. They have covered all you need for both inference and training of LatentSync Paper: https://arxiv.org/abs/2412.09262 Code: https://github.com/bytedance/LatentSync

Source context: 0 downloads · 1 likes · Pipeline video-to-video · Library diffusers · Repo Kirfol/LatentSync