Calcyon 1b | Sweet Tea StudioCalcyon 1b
Modele de langage francophone technique (1.152B parametres). Architecture LLaMA-style decoder, 22 couches, GQA 16/8 heads, SwiGLU Tokenizer SentencePiece BPE 32k optimise francais Contexte 8192 tokens, RoPE theta=500000 Domaines Aeronautique, electricite/electrotechnique, hydraulique/hydroelectrique, developpement Python/C++, hardware, FPV, LiDAR Prompt format (ChatML)
Verified source
Kindtext-generationVersionv74eea8ffe1f79041aa025a299c2d6569f703b62dLicenseapache-2.0Publisher@MinelaxieFRCgrade Model source
- Kind
- text-generation
- Version
- v74eea8ffe1f79041aa025a299c2d6569f703b62d
- License
- apache-2.0
- Parameters
- 1B
- Tasks
- text-generation
- Source
- Hugging Face
--- language: - fr license: apache-2.0 tags: - llama - french - calcyon - technical pipeline_tag: text-generation --- # cALCYON-1B Modele de langage francophone technique (1.152B parametres). ## Architecture - LLaMA-style decoder, 22 couches, GQA 16/8 heads, SwiGLU - Tokenizer SentencePiece BPE 32k optimise francais - Contexte 8192 tokens, RoPE theta=500000 ## Domaines Aeronautique, electricite/electrotechnique, hydraulique/hydroelectrique, developpement Python/C++, hardware, FPV, LiDAR ## Prompt format (ChatML) ``` Tu es cALCYON. Question ``` ## Entrainement SFT LoRA r=32 sur Wikipedia-FR + OpenHermes-FR + donnees techniques. GPU : NVIDIA RTX 5080 16GB. ## Usage LM Studio / Ollama Telecharger `calcyon-1b-q4_k_m.gguf` (709 MB) et charger dans LM Studio ou Ollama.
Sources & provenance
1 active source
Source evidence
3 excerpts
Modele de langage francophone technique (1.152B parametres). Architecture LLaMA-style decoder, 22 couches, GQA 16/8 heads, SwiGLU Tokenizer SentencePiece BPE 32k optimise francais Contexte 8192 tokens, RoPE theta=500000 Domaines Aeronautique,…
Jul 11
Modele de langage francophone technique (1.152B parametres).
