Distilbert Goodreads Genre Classifier

--- library_name: transformers license: apache-2.0 base_model: distilbert-base-cased tags: - generated_from_trainer metrics: - accuracy - f1 model-index: - name: distilbert-goodreads-genre-classifier results: [] --- # distilbert-goodreads-genre-classifier This model is a fine-tuned version of [distilbert-base-cased](https://huggingface.co/distilbert-base-cased) on an unknown dataset. It achieves the following results on the evaluation set: - Loss: 2.3467 - Accuracy: 0.6075 - F1: 0.6062 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 5e-05 - train_batch_size: 32 - eval_batch_size: 64 - seed: 42 - optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments - lr_scheduler_type: linear - lr_scheduler_warmup_steps: 100 - num_epochs: 3 - mixed_precision_training: Native AMP ### Training results | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:| | 4.1343 | 0.25 | 50 | 3.9771 | 0.2819 | 0.2411 | | 3.4253 | 0.5 | 100 | 2.8775 | 0.5162 | 0.4823 | | 2.7610 | 0.75 | 150 | 2.5655 | 0.5544 | 0.5419 | | 2.5195 | 1.0 | 200 | 2.4380 | 0.5681 | 0.5602 | | 2.0694 | 1.25 | 250 | 2.4156 | 0.5731 | 0.5683 | | 2.0905 | 1.5 | 300 | 2.3633 | 0.5844 | 0.5854 | | 2.0416 | 1.75 | 350 | 2.3150 | 0.5938 | 0.5924 | | 2.0064 | 2.0 | 400 | 2.2510 | 0.6 | 0.5996 | | 1.4565 | 2.25 | 450 | 2.3549 | 0.6 | 0.5908 | | 1.4512 | 2.5 | 500 | 2.3747 | 0.6038 | 0.6018 | | 1.3495 | 2.75 | 550 | 2.3693 | 0.6006 | 0.5931 | | 1.3544 | 3.0 | 600 | 2.3467 | 0.6075 | 0.6062 | ### Framework versions - Transformers 5.0.0 - Pytorch 2.10.0+cu128 - Datasets 4.8.3 - Tokenizers 0.22.2