csle_agents.agents.ppo package

Submodules

csle_agents.agents.ppo.ppo_agent module

class csle_agents.agents.ppo.ppo_agent.PPOAgent(simulation_env_config: SimulationEnvConfig, emulation_env_config: Union[None, EmulationEnvConfig], experiment_config: ExperimentConfig, training_job: Optional[TrainingJobConfig] = None, save_to_metastore: bool = True)

Bases: BaseAgent

A PPO agent using the implementation from OpenAI baselines

hparam_names() → List[str]

Returns

a list with the hyperparameter names

train() → ExperimentExecution

Runs the training process

Returns

the results

class csle_agents.agents.ppo.ppo_agent.PPOTrainingCallback(exp_result: ExperimentResult, seed: int, random_seeds: List[int], training_job: TrainingJobConfig, exp_execution: ExperimentExecution, max_steps: int, simulation_name: str, start: float, states: List[State], actions: List[Action], player_type: PlayerType, env: BaseEnv, experiment_config: ExperimentConfig, verbose=0, eval_every: int = 100, eval_batch_size: int = 10, save_every: int = 10, save_dir: str = '', L: int = 3, gym_env_name: str = '', save_to_metastore: bool = False)

Bases: BaseCallback

Callback for monitoring PPO training

Module contents