Saltar al contenido
ModelPublicadoExterno
Descargar

Algea VE

Algea-ve is trained on the LAION-CC-SBU dataset using algea-550M-base as the base model and fine-tuned on llavav15mix665k. It uses CLIP ViT-L/14-336 as the visual encoder. The model is very small, requiring only 32GB...

TipoText modelVersiónmodelBcalidad

Fuente del modelo

Tipo
Text model
Tamaño del archivo
1,60 GB
Versión
vmodel
Actualizado
22 sept 2026
Descargas
16
Fuente
Hugging Face

Descripción de la fuente

Algea-VE: A Tiny Multimodal Language Model with Only 0.8B Parameters

Algea-ve is trained on the LAION-CC-SBU dataset using algea-550M-base as the base model and fine-tuned on llava_v1_5_mix665k. It uses CLIP ViT-L/14-336 as the visual encoder. The model is very small, requiring only 32GB of VRAM for fine-tuning and 3GB for inference.

Due to insufficient training of the base model, the current model has some issues with hallucinations and repetition. To address this, I am training a new model that will maintain the same size but offer better performance.

This model is built based on the llavaphi project. To use the model, please click here.

Fuentes

1 fuente
Hugging FacePrincipalVersión ac4fe074ba485928daf344a8ff7c812d4029016a
huggingface.co/PhelixZhen/Algea-VE/tree/ac4fe074ba485928daf344a8ff7c812d4029016a

Verificado 28 ago

Artefactos del modelo

1 artefacto

model.safetensors

safetensors · 1,60 GB · SHA-256 9e7305603226…faf9 · Hugging Face

Download file

Extractos de fuentes

2 extractos

--- license: apache-2.0 language: - en pipeline_tag: visual-question-answering --- # Algea-VE: A Tiny Multimodal Language Model with Only 0.8B Parameters Algea-ve is trained on the LAION-CC-SBU dataset using [algea-550M-base](https://huggingface.co/PhelixZhen/Algae-550M-base) as the base model and fine-tuned on llava_v1_5_mix665k. It uses CLIP ViT-L/14-336 as the visual encoder. The model is very small, requiring only 32GB of VRAM for fine-tuning and 3GB for inference. Due to insufficient training of the base model, the current model has some issues with hallucinations and repetition. To address this, I am training a new model that will maintain the same size but offer better performance. This model is built based on the llavaphi project. To use the model, please click [here](https://github.com/phelixzhen/Algea-VE).

Source context: 16 downloads · 0 likes · Pipeline visual-question-answering · Library transformers · Repo PhelixZhen/Algea-VE