Aller au contenu
ModelPrésentéExterne
Browse files

LatentSync

Please note that this repo is a copy of as at 1912hrs, 27/01/2025. This repo not only stores the pretrained U-Net and SyncNet checkpoints of LatentSync, but also stores the whisper checkpoints, auxiliary checkpoints...

TypeOtherVersionI3d torchscriptCClasse

Source du modèle

Type
Other
Taille du fichier
48,9 MB–3,17 GB
Version
vI3d torchscript
Mis à jour
27 oct. 2026
Source
Hugging Face

Description de la source

The checkpoints of LatentSync

Please note that this repo is a copy of https://huggingface.co/ByteDance/LatentSync as at 1912hrs, 27/01/2025. This repo not only stores the pretrained U-Net and SyncNet checkpoints of LatentSync, but also stores the whisper checkpoints, auxiliary checkpoints for detecting face, calculating syncnet confidence score and so on. They have covered all you need for both inference and training of LatentSync

Paper: https://arxiv.org/abs/2412.09262

Code: https://github.com/bytedance/LatentSync

Sources

1 source
Hugging FacePrincipalVersion 42c5c9ca3a70d441aca766e958554e4a25dad6c5
huggingface.co/Isi99999/LatentSync/tree/42c5c9ca3a70d441aca766e958554e4a25dad6c5

Vérifié 27 oct.

Download files

Artefacts du modèle

8 artefacts

auxiliary/i3d_torchscript.pt

pt · 48,9 MB · SHA-256 bec6519f66ea…a5e2 · Hugging Face

Download file

auxiliary/s3fd-619a316812.pth

pth · 85,7 MB · SHA-256 619a31681264…3543 · Hugging Face

Download file

auxiliary/sfd_face.pth

pth · 85,7 MB · SHA-256 d54a87c2b754…c491 · Hugging Face

Download file

auxiliary/vgg16-397923af.pth

pth · 528 MB · SHA-256 397923af8e79…5bf0 · Hugging Face

Download file

auxiliary/vit_g_hybrid_pt_1200e_ssv2_ft.pth

pth · 1,88 GB · SHA-256 5a210a92f035…7e70 · Hugging Face

Download file

latentsync_syncnet.pt

pt · 1,39 GB · SHA-256 38fa63bad3ed…4da5 · Hugging Face

Download file

latentsync_unet.pt

pt · 3,17 GB · SHA-256 63197c73d21a…f3c7 · Hugging Face

Download file

whisper/tiny.pt

pt · 72,1 MB · SHA-256 65147644a518…22b9 · Hugging Face

Download file

Extraits de sources

2 extraits

--- license: openrail library_name: diffusers tags: - video-to-video pipeline_tag: video-to-video --- # The checkpoints of LatentSync Please note that this repo is a copy of https://huggingface.co/ByteDance/LatentSync as at 1912hrs, 27/01/2025. This repo not only stores the pretrained U-Net and SyncNet checkpoints of LatentSync, but also stores the whisper checkpoints, auxiliary checkpoints for detecting face, calculating syncnet confidence score and so on. They have covered all you need for both inference and training of LatentSync Paper: https://arxiv.org/abs/2412.09262 Code: https://github.com/bytedance/LatentSync

Source context: 0 downloads · 0 likes · Pipeline video-to-video · Library diffusers · Repo Isi99999/LatentSync