Multi Learned Deepfake Det

--- title: "Deepfake Reasoning with MobileVLM" emoji: 🧠 colorFrom: indigo colorTo: blue sdk: gradio sdk_version: "4.0.0" app_file: app.py pinned: false license: mit tags: - deepfake-detection - computer-vision - multimodal - vision-language - mobilevlm - clip - explainable-ai models: - openai/clip-vit-base-patch32 - mobilevlm datasets: - coco - celeba - diffusion-generated --- # 🧠 Deepfake Reasoning with MobileVLM > Multimodal deepfake analysis using MobileVLM for human-readable forensics. --- ## 🚀 Overview This system implements a **multimodal reasoning pipeline** for deepfake detection. Unlike traditional "black-box" classifiers, this system generates **natural language explanations** by bridging visual features with generative language modeling — making forensic results interpretable and actionable. --- ## 🏗️ Architecture & Pipeline ### Multimodal Reasoning Flow ``` Input Image → CLIP Vision Encoder → Adapter Network → Multimodal Projector → MobileVLM → Final Explanation ``` ### System Components | Component | Role | Specification | |----------------|------------------|-----------------------------------| | **CLIP Encoder** | Visual Backbone | Frozen ViT weights | | **Adapter** | Refinement | Trainable MLP (1024→512→1024) | | **Projector** | Alignment | Linear mapping to LLM space | | **MobileVLM** | Reasoning | Generates textual forensics | --- ## 💡 Example Output ``` "This image is classified as Fake. Forensic analysis reveals inconsistent lighting gradients on the subject's face and blurred texture artifacts along the jawline, typical of GAN-based generation." ``` --- ## 📊 Final Performance Metrics Our "Deepfake-Aware" calibration of the vision-to-language projector has achieved industry-leading results for mobile-first models: | Target Set | Accuracy / Achievement | | :--- | :--- | | **Celeb-DF-v2 (Videos)** | **96.76% FAKE Detection** | | **Unified Image Test Set** | **94.20% Accuracy** | | **Inference Latency** | **< 2s per frame (on Mobile NPU)** | | **Memory Efficiency** | **~2.6GB Footprint (Q4_K_M)** | --- ## 📦 Installation & Usage ### 1. Clone the Repository ```bash git clone https://github.com/your-repo/mobilevlm-deepfake cd mobilevlm-deepfake ``` ### 2. Install Dependencies ```bash pip install -r requirements.txt ``` ### 3. Run Inference ```python # Extract features and refine feats = vision_tower(image)...

Source context: 55 downloads · 1 likes · Repo uchihamadara1816/Multi-Learned-Deepfake-Det

Source context: 145 downloads · 1 likes · Repo uchihamadara1816/Multi-Learned-Deepfake-Det