2020-03-23 22:17:38 INFO [trainer_controller.py:167] Hyperparameters for the PPOTrainer of brain BotBrainIsland:
        trainer:        ppo
        batch_size:     1024
        beta:   0.005
        buffer_size:    10240
        epsilon:        0.2
        hidden_units:   128
        lambd:  0.95
        learning_rate:  0.0003
        learning_rate_schedule: linear
        max_steps:      5.0e5
        memory_size:    128
        normalize:      False
        num_epoch:      3
        num_layers:     2
        time_horizon:   64
        sequence_length:        64
        summary_freq:   10000
        use_recurrent:  False
        vis_encode_type:        simple
        reward_signals:
          extrinsic:
            strength:   1.0
            gamma:      0.99
        summary_path:   Island4_BotBrainIsland
        model_path:     ./models/Island4/BotBrainIsland
        keep_checkpoints:       5
2020-03-23 22:17:38.420364: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2
2020-03-23 22:19:13 INFO [trainer.py:213] Island4: BotBrainIsland: Step: 10000. Time Elapsed: 94.679 s Mean Reward: -0.851. Std of Reward: 0.406. Training.
2020-03-23 22:20:44 INFO [trainer.py:213] Island4: BotBrainIsland: Step: 20000. Time Elapsed: 186.286 s Mean Reward: 0.067. Std of Reward: 1.210. Training.
2020-03-23 22:22:17 INFO [trainer.py:213] Island4: BotBrainIsland: Step: 30000. Time Elapsed: 279.228 s Mean Reward: 0.607. Std of Reward: 1.492. Training.
2020-03-23 22:23:49 INFO [trainer.py:213] Island4: BotBrainIsland: Step: 40000. Time Elapsed: 371.210 s Mean Reward: 2.131. Std of Reward: 2.412. Training.
2020-03-23 22:25:19 INFO [trainer_controller.py:100] Saved Model
2020-03-23 22:25:21 INFO [trainer.py:220]  Island4: BotBrainIsland: Step: 50000. No episode was completed since last summary. Training.
2020-03-23 22:26:52 INFO [trainer.py:220]  Island4: BotBrainIsland: Step: 60000. No episode was completed since last summary. Training.
2020-03-23 22:28:24 INFO [trainer.py:220]  Island4: BotBrainIsland: Step: 70000. No episode was completed since last summary. Training.