Captcha Conv Transformer Finetuned

--- tags: - ocr - pytorch license: mit datasets: - hammer888/captcha-data metrics: - accuracy - cer pipeline_tag: image-to-text library_name: transformers --- <div align="center"> # ✨ DeepCaptcha-Conv-Transformer: Sequential Vision for OCR ### Convolutional Transformer Fine-Tuned [](https://opensource.org/licenses/MIT) [](https://www.python.org/downloads/release/python-3130/) [](https://huggingface.co/Graf-J/captcha-crnn-finetuned) 🚀 **Live Demo:** 👉 [Try the Model in Your Browser](https://huggingface.co/spaces/Graf-J/Captcha-Demo) --- <img src="images/CAPTCHA.png" alt="Captcha Example" width="500"> *Advanced sequence recognition using a Convolutional Transformer Encoder with Connectionist Temporal Classification (CTC) loss.* </div> --- ## 📋 Model Details - **Task:** Alphanumeric Captcha Recognition - **Input:** Images - **Output:** String sequences (Length 1–8 characters) - **Vocabulary:** Alphanumeric (`a-z`, `A-Z`, `0-9`) - **Architecture:** Convolutional Transformer Encoder (CNN + Transformer Encoder) --- ## 📊 Performance Metrics This project features four models exploring the trade-offs between recurrent (LSTM) and attention-based (Transformer) architectures, as well as the effects of fine-tuning on capchas generated by the [Python Captcha Library](https://captcha.lepture.com/). | Metric | **CRNN (Base)** | **CRNN (Finetuned)** | **Conv-Transformer (Base)** | **Conv-Transformer (Finetuned)** | |--------|-----------------|----------------------|-----------------------------|----------------------------------| | Architecture | CRNN | CRNN | Convolutional Transformer | Convolutional Transformer | | Training Data | [hammer888/captcha-data](https://huggingface.co/datasets/hammer888/captcha-data) | [hammer888/captcha-data](https://huggingface.co/datasets/hammer888/captcha-data) <br> [Python Captcha Library](https://captcha.lepture.com/) | [hammer888/captcha-data](https://huggingface.co/datasets/hammer888/captcha-data) | [hammer888/captcha-data](https://huggingface.co/datasets/hammer888/captcha-data) <br> [Python Captcha Library](https://captcha.lepture.com/) | | # Parameters | **3,570,943** | **3,570,943** | 12...