Opus Mt En Ro Finetuned En To Ro

--- library_name: transformers license: apache-2.0 base_model: Helsinki-NLP/opus-mt-en-ro tags: - generated_from_trainer metrics: - bleu model-index: - name: opus-mt-en-ro-finetuned-en-to-ro results: [] --- # opus-mt-en-ro-finetuned-en-to-ro This model is a fine-tuned version of [Helsinki-NLP/opus-mt-en-ro](https://huggingface.co/Helsinki-NLP/opus-mt-en-ro) on an unknown dataset. It achieves the following results on the evaluation set: - Loss: 0.9153 - Bleu: 26.6936 - Gen Len: 61.2596 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 2e-05 - train_batch_size: 32 - eval_batch_size: 32 - seed: 42 - optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments - lr_scheduler_type: linear - num_epochs: 8 - mixed_precision_training: Native AMP ### Training results | Training Loss | Epoch | Step | Validation Loss | Bleu | Gen Len | |:-------------:|:-----:|:------:|:---------------:|:-------:|:-------:| | 0.4824 | 1.0 | 19073 | 1.0155 | 25.3616 | 61.2766 | | 0.4256 | 2.0 | 38146 | 0.9622 | 25.8777 | 61.3977 | | 0.3983 | 3.0 | 57219 | 0.9407 | 26.1333 | 61.1661 | | 0.3775 | 4.0 | 76292 | 0.9260 | 26.5216 | 61.1406 | | 0.3629 | 5.0 | 95365 | 0.9212 | 26.4602 | 61.2366 | | 0.3505 | 6.0 | 114438 | 0.9178 | 26.6475 | 61.2191 | | 0.3453 | 7.0 | 133511 | 0.9157 | 26.3941 | 61.1641 | | 0.3413 | 8.0 | 152584 | 0.9153 | 26.6936 | 61.2596 | ### Framework versions - Transformers 5.0.0 - Pytorch 2.10.0+cu128 - Datasets 4.0.0 - Tokenizers 0.22.2