Saltar al contenido
ModelVerificadoExterno
Descargar

LunarLander v2

This is a trained model of a PPO agent playing LunarLander-v2.

TipoOtherVersiónRevision 5f12879Publicador@ZuzELCcalidad

Fuente del modelo

Tipo
Other
Tamaño del archivo
41,9 KB
Versión
vRevision 5f12879
Actualizado
2 oct 2026
Publicador
@ZuzEL
Descargas
0
Fuente
Hugging Face

Descripción de la fuente

PPO Agent Playing LunarLander-v2

This is a trained model of a PPO agent playing LunarLander-v2.

The agent was trained with Gymnasium on LunarLander-v3. The model card uses LunarLander-v2 because the Hugging Face Deep RL Course Unit 8 checker still looks for that environment tag.

Evaluation

  • Mean reward: 240.74
  • Standard deviation: 16.21
  • Course score: 224.53

Hyperparameters

{
  "anneal_lr": true,
  "batch_size": 16384,
  "capture_video": false,
  "clip_coef": 0.2,
  "clip_vloss": true,
  "course_env_id": "LunarLander-v2",
  "cuda": true,
  "ent_coef": 0.01,
  "env_id": "LunarLander-v3",
  "eval_deterministic": true,
  "eval_episodes": 10,
  "eval_video_dir": null,
  "evaluate": false,
  "exp_name": "ppo_lunarlander",
  "gae": true,
  "gae_lambda": 0.98,
  "gamma": 0.999,
  "headless": false,
  "learning_rate": 0.0003,
  "load_model_path": "checkpoints/ppo_lunarlander.pt",
  "logs_dir": "runs/LunarLander-v3__ppo_lunarlander__3__1779423167",
  "max_grad_norm": 0.5,
  "minibatch_size": 64,
  "norm_adv": true,
  "num_envs": 16,
  "num_minibatches": 256,
  "num_steps": 1024,
  "package_dir": "hub_package",
  "repo_id": "ZuzEL/LunarLander-v2",
  "save_model_path": "checkpoints/ppo_lunarlander.pt",
  "seed": 3,
  "target_kl": null,
  "torch_deterministic": true,
  "total_timesteps": 1000000,
  "track": false,
  "update_epochs": 4,
  "upload_to_hub": true,
  "vf_coef": 0.5,
  "video_fps": 30,
  "wandb_entity": null,
  "wandb_project_name": "cleanRL"
}

Fuentes

1 fuente
Hugging FacePrincipalVersión 5f12879b09af21a2908e2112bbc3136b8a9db347
huggingface.co/ZuzEL/LunarLander-v2/tree/5f12879b09af21a2908e2112bbc3136b8a9db347

Verificado 2 oct

Artefactos del modelo

1 artefacto

model.pt

pt · 41,9 KB · SHA-256 6dca2dc6d4ef…9269 · Hugging Face

Descargar

Extractos de fuentes

3 extractos

--- tags: - LunarLander-v2 - ppo - deep-reinforcement-learning - reinforcement-learning - custom-implementation - deep-rl-course model-index: - name: PPO results: - task: type: reinforcement-learning name: reinforcement-learning dataset: name: LunarLander-v2 type: LunarLander-v2 metrics: - type: mean_reward value: 240.74 +/- 16.21 name: mean_reward verified: false --- # PPO Agent Playing LunarLander-v2 This is a trained model of a PPO agent playing LunarLander-v2. The agent was trained with Gymnasium on `LunarLander-v3`. The model card uses `LunarLander-v2` because the Hugging Face Deep RL Course Unit 8 checker still looks for that environment tag. # Evaluation - Mean reward: 240.74 - Standard deviation: 16.21 - Course score: 224.53 # Hyperparameters ```json { "anneal_lr": true, "batch_size": 16384, "capture_video": false, "clip_coef": 0.2, "clip_vloss": true, "course_env_id": "LunarLander-v2", "cuda": true, "ent_coef": 0.01, "env_id": "LunarLander-v3", "eval_deterministic": true, "eval_episodes": 10, "eval_video_dir": null, "evaluate": false, "exp_name": "ppo_lunarlander", "gae": true, "gae_lambda": 0.98, "gamma": 0.999, "headless": false, "learning_rate": 0.0003, "load_model_path": "checkpoints/ppo_lunarlander.pt", "logs_dir": "runs/LunarLander-v3__ppo_lunarlander__3__1779423167", "max_grad_norm": 0.5, "minibatch_size": 64, "norm_adv": true, "num_envs": 16, "num_minibatches": 256, "num_steps": 1024, "package_dir": "hub_package", "repo_id": "ZuzEL/LunarLander-v2", "save_model_path": "checkpoints/ppo_lunarlander.pt", "seed": 3, "target_kl": null, "torch_deterministic": true, "total_timesteps": 1000000, "track": false, "update_epochs": 4, "upload_to_hub": true, "vf_coef": 0.5, "video_fps": 30, "wandb_entity": null, "wandb_project_name": "cleanRL" } ```

Source context: 0 downloads · 0 likes · Pipeline reinforcement-learning · Repo ZuzEL/LunarLander-v2

Source context: 0 downloads · 0 likes · Pipeline reinforcement-learning · Repo ZuzEL/LunarLander-v2