Saltar al contenido
ModelPublicadoExterno
Browse files

Deepfake Multimodal Weights

Trained weights for Multi-ModelDeepfakeDetection, a CLI that scores a video for manipulation by fusing three independent modalities (visual frames, audio track, spoken transcript).

TipoOtherModelo baseprithivMLmods/deepfake-detector-model-v1VersiónClf ep6 torchscriptBcalidad

Fuente del modelo

Tipo
Other
Tamaño del archivo
774 KB–354 MB
Modelo base
prithivMLmods/deepfake-detector-model-v1
Versión
vClf ep6 torchscript
Actualizado
19 oct 2026
Fuente
Hugging Face

Descripción de la fuente

Multi-Modal Deepfake Detection — trained weights

Trained weights for Multi-Model_Deepfake_Detection, a CLI that scores a video for manipulation by fusing three independent modalities (visual frames, audio track, spoken transcript).

Do not download these files by hand — clone the GitHub repo and run python download_weights.py, which places every file where config.yaml expects it.

Contents

FileRoleVal metric
video_model_colab_ft/SigLIP ViT, full fine-tune on FaceForensics++ (c23) face cropsAUC 0.861 / frame, 0.939 / video
clf_ep6_torchscript.ptMLP over WavLM-base-plus embeddings (WaveFake + JSUT)AUC 0.999
text_model/head_best.ptLinear head over DistilBERT for transcript claim scoring (FibVID)AUC 0.909
fusion_model.pklHistGradientBoosting meta-classifier over the three probabilitiesAUC 0.998 (simulated joint data)

Validation methodology and known limitations (audio language confound, simulated fusion training data) are documented in the project README.

Licensing

Code and these trained heads: MIT. The video model is a fine-tune of prithivMLmods/deepfake-detector-model-v1 and retains its upstream terms. Training datasets are not redistributed here: FaceForensics++ requires a signed EULA; WaveFake is CC BY-SA; JSUT is for research use.

Fuentes

1 fuente
Hugging FacePrincipalVersión 41bbedbf52849e4aaffa6bddd716f4ca678a9311
huggingface.co/AUA27/deepfake-multimodal-weights/tree/41bbedbf52849e4aaffa6bddd716f4ca678a9311

Verificado 19 oct

Download files

Artefactos del modelo

3 artefactos

clf_ep6_torchscript.pt

pt · 1,77 MB · SHA-256 b8a70485cbb9…f0dd · Hugging Face

Download file

text_model/head_best.pt

pt · 774 KB · SHA-256 a0f54a57ec48…95a0 · Hugging Face

Download file

video_model_colab_ft/model.safetensors

safetensors · 354 MB · SHA-256 9c93e5cb93c9…9c25 · Hugging Face

Download file

Extractos de fuentes

2 extractos

--- license: mit base_model: prithivMLmods/deepfake-detector-model-v1 tags: - deepfake-detection - multimodal - video-classification - audio-classification --- # Multi-Modal Deepfake Detection — trained weights Trained weights for [Multi-Model_Deepfake_Detection](https://github.com/aua27/Multi-Model_Deepfake_Detection), a CLI that scores a video for manipulation by fusing three independent modalities (visual frames, audio track, spoken transcript). **Do not download these files by hand** — clone the GitHub repo and run `python download_weights.py`, which places every file where `config.yaml` expects it. ## Contents | File | Role | Val metric | |---|---|---| | `video_model_colab_ft/` | SigLIP ViT, full fine-tune on FaceForensics++ (c23) face crops | AUC 0.861 / frame, 0.939 / video | | `clf_ep6_torchscript.pt` | MLP over WavLM-base-plus embeddings (WaveFake + JSUT) | AUC 0.999 | | `text_model/head_best.pt` | Linear head over DistilBERT for transcript claim scoring (FibVID) | AUC 0.909 | | `fusion_model.pkl` | HistGradientBoosting meta-classifier over the three probabilities | AUC 0.998 (simulated joint data) | Validation methodology and known limitations (audio language confound, simulated fusion training data) are documented in the [project README](https://github.com/aua27/Multi-Model_Deepfake_Detection#known-limitations). ## Licensing Code and these trained heads: MIT. The video model is a fine-tune of [prithivMLmods/deepfake-detector-model-v1](https://huggingface.co/prithivMLmods/deepfake-detector-model-v1) and retains its upstream terms. Training datasets are **not** redistributed here: FaceForensics++ requires a signed EULA; WaveFake is CC BY-SA; JSUT is for research use.

Source context: 0 downloads · 0 likes · Pipeline audio-classification · Repo AUA27/deepfake-multimodal-weights