Have a ComfyUI workflow? Get a readable Workflow Doc in your browser.Make a workflow readable.Try it now ↗
Ungated again. Friendly reminder to all to please respect the MIT license. Attribution should be made to the original project (see bottom) as well as this repository. Other than that, you're free to use the model as...
Model source
Source description
Model presented in Community Forensics: Using Thousands of Generators to Train Fake Image Detectors.
- An upcoming open-source framework for adaptive deepfake detection.
Sources
1 sourceVerified Aug 1
Model artifacts
3 artifactsSource excerpts
2 excerptsProject OpenSight HF Spaces coming soon with an eval playground and eventually a leaderboard. Preview:
image/png
Vision Transformer (ViT) model trained on the largest dataset to-date for detecting AI-generated images in forensic applications.
HF Space will be open sourced shortly showcasing various ways to run ultra-fast inference. Make sure to follow us for updates, as we will be releasing a slew of projects in the coming weeks.
| Metric | Value |
|---|---|
| Accuracy | 97.2% |
| F1 Score | 0.968 |
| AUC-ROC | 0.992 |
| FP Rate | 2.1% |
image/png
BibTeX:
@misc{park2024communityforensics,
title={Community Forensics: Using Thousands of Generators to Train Fake Image Detectors},
author={Jeongsoo Park and Andrew Owens},
year={2024},
eprint={2411.04125},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2411.04125},
}
pretrained_weights/model_v11_ViT_384_base_ckpt.pt
pt · 250 MB · SHA-256 d134f6f2c618…dcde · Hugging Face
--- base_model: - timm/vit_small_patch16_384.augreg_in21k_ft_in1k library_name: transformers license: mit pipeline_tag: image-classification tags: - image-classification - timm - transformers - detection - deepfake - forensics - deepfake_detection - community - opensight --- # NOTICE: 7/22/2026 - Ungated again. Friendly reminder to all to please respect the MIT license. Attribution should be made to the original project (see bottom) as well as this repository. Other than that, you're free to use the model as you wish. ## Trained on 2.7M samples across 4,803 generators (see Training Data) Model presented in [Community Forensics: Using Thousands of Generators to Train Fake Image Detectors](https://huggingface.co/papers/2411.04125). **Uploaded for community validation as part of OpenSight** - An upcoming open-source framework for adaptive deepfake detection. **Project OpenSight HF Spaces coming soon with an eval playground and eventually a leaderboard. Preview:**  ## Model Details ### Model Description Vision Transformer (ViT) model trained on the largest dataset to-date for detecting AI-generated images in forensic applications. - **Developed by:** Jeongsoo Park and Andrew Owens, University of Michigan - **Model type:** Vision Transformer (ViT-Small) - **License:** MIT (compatible with CreativeML OpenRAIL-M referenced in [2411.04125v1.pdf]) - **Finetuned from:** timm/vit_small_patch16_384.augreg_in21k_ft_in1k - **Adapted for HF** inference compatibility by Borderless. **HF Space will be open sourced shortly showcasing various ways to run ultra-fast inference. Make sure to follow us for updates, as we will be releasing a slew of projects in the coming weeks.** ### Links - **Repository:** [JeongsooP/Community-Forensics](https://github.com/JeongsooP/Community-Forensics) - **Paper:** [arXiv:2411.04125](https://arxiv.org/pdf/2411.04125) - **Project Page:** https://jespark.net/projects/2024/community_forensics ## Training Details ### Training Data - 2.7mil images from 15+ generators, 4600+ models - Over 1.15TB worth of images ### Training Hyperparameters - **Framework:** PyTorch 2.0 - **Precision:** bf16 mixed - **Optimizer:** AdamW (lr=5e-5) - **Epochs:** 10 - **Batch Size:** 32 ## Evaluation ### Unverified Testing Results - Only un...
Source context: 282844 downloads · 15 likes · Pipeline image-classification · Library transformers · Repo buildborderless/CommunityForensics-DeepfakeDet-ViT