2020-08-20 13:35:11,549	INFO resource_spec.py:212 -- Starting Ray with 1.37 GiB memory available for workers and up to 0.93 GiB for objects. You can adjust these settings with ray.init(memory=<bytes>, object_store_memory=<bytes>).
2020-08-20 13:35:11,962	INFO services.py:1170 -- View the Ray dashboard at localhost:8265
2020-08-20 13:35:19,990	ERROR trial_runner.py:519 -- Trial PPO_procgen_env_wrapper_00000: Error processing event.
Traceback (most recent call last):
  File "/Users/manu/anaconda3/envs/procgen/lib/python3.7/site-packages/ray/tune/trial_runner.py", line 467, in _process_trial
    result = self.trial_executor.fetch_result(trial)
  File "/Users/manu/anaconda3/envs/procgen/lib/python3.7/site-packages/ray/tune/ray_trial_executor.py", line 431, in fetch_result
    result = ray.get(trial_future[0], DEFAULT_GET_TIMEOUT)
  File "/Users/manu/anaconda3/envs/procgen/lib/python3.7/site-packages/ray/worker.py", line 1515, in get
    raise value.as_instanceof_cause()
ray.exceptions.RayTaskError(ValueError): ray::PPO.train() (pid=17491, ip=192.168.0.20)
  File "python/ray/_raylet.pyx", line 424, in ray._raylet.execute_task
  File "python/ray/_raylet.pyx", line 459, in ray._raylet.execute_task
  File "python/ray/_raylet.pyx", line 462, in ray._raylet.execute_task
  File "python/ray/_raylet.pyx", line 463, in ray._raylet.execute_task
  File "python/ray/_raylet.pyx", line 417, in ray._raylet.execute_task.function_executor
  File "/Users/manu/anaconda3/envs/procgen/lib/python3.7/site-packages/ray/rllib/agents/trainer_template.py", line 90, in __init__
    Trainer.__init__(self, config, env, logger_creator)
  File "/Users/manu/anaconda3/envs/procgen/lib/python3.7/site-packages/ray/rllib/agents/trainer.py", line 448, in __init__
    super().__init__(config, logger_creator)
  File "/Users/manu/anaconda3/envs/procgen/lib/python3.7/site-packages/ray/tune/trainable.py", line 174, in __init__
    self._setup(copy.deepcopy(self.config))
  File "/Users/manu/anaconda3/envs/procgen/lib/python3.7/site-packages/ray/rllib/agents/trainer.py", line 591, in _setup
    self._init(self.config, self.env_creator)
  File "/Users/manu/anaconda3/envs/procgen/lib/python3.7/site-packages/ray/rllib/agents/trainer_template.py", line 117, in _init
    self.config["num_workers"])
  File "/Users/manu/anaconda3/envs/procgen/lib/python3.7/site-packages/ray/rllib/agents/trainer.py", line 662, in _make_workers
    logdir=self.logdir)
  File "/Users/manu/anaconda3/envs/procgen/lib/python3.7/site-packages/ray/rllib/evaluation/worker_set.py", line 61, in __init__
    RolloutWorker, env_creator, policy, 0, self._local_config)
  File "/Users/manu/anaconda3/envs/procgen/lib/python3.7/site-packages/ray/rllib/evaluation/worker_set.py", line 279, in _make_worker
    extra_python_environs=extra_python_environs)
  File "/Users/manu/anaconda3/envs/procgen/lib/python3.7/site-packages/ray/rllib/evaluation/rollout_worker.py", line 376, in __init__
    self._build_policy_map(policy_dict, policy_config)
  File "/Users/manu/anaconda3/envs/procgen/lib/python3.7/site-packages/ray/rllib/evaluation/rollout_worker.py", line 859, in _build_policy_map
    policy_map[name] = cls(obs_space, act_space, merged_conf)
  File "/Users/manu/anaconda3/envs/procgen/lib/python3.7/site-packages/ray/rllib/policy/tf_policy_template.py", line 143, in __init__
    obs_include_prev_action_reward=obs_include_prev_action_reward)
  File "/Users/manu/anaconda3/envs/procgen/lib/python3.7/site-packages/ray/rllib/policy/dynamic_tf_policy.py", line 163, in __init__
    framework="tf")
  File "/Users/manu/anaconda3/envs/procgen/lib/python3.7/site-packages/ray/rllib/models/catalog.py", line 317, in get_model_v2
    registered))
ValueError: It looks like variables {<tf.Variable 'default_policy/conv4_block4_1_conv/kernel:0' shape=(1, 1, 1024, 256) dtype=float32>, <tf.Variable 'default_policy/conv4_block6_preact_bn/moving_mean:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv4_block1_2_bn/moving_mean:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block1_2_conv/kernel:0' shape=(3, 3, 256, 256) dtype=float32>, <tf.Variable 'default_policy/conv3_block4_preact_bn/moving_mean:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv4_block1_1_bn/beta:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block1_1_bn/moving_variance:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block5_2_bn/moving_mean:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv5_block1_2_bn/gamma:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv4_block5_2_bn/gamma:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv5_block2_3_conv/bias:0' shape=(2048,) dtype=float32>, <tf.Variable 'default_policy/conv4_block6_1_conv/kernel:0' shape=(1, 1, 1024, 256) dtype=float32>, <tf.Variable 'default_policy/conv4_block3_2_bn/gamma:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv5_block1_1_conv/kernel:0' shape=(1, 1, 1024, 512) dtype=float32>, <tf.Variable 'default_policy/conv4_block3_2_bn/moving_mean:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv5_block1_1_bn/gamma:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv4_block3_preact_bn/beta:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv4_block3_preact_bn/moving_variance:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv4_block2_1_conv/kernel:0' shape=(1, 1, 1024, 256) dtype=float32>, <tf.Variable 'default_policy/conv4_block2_3_conv/kernel:0' shape=(1, 1, 256, 1024) dtype=float32>, <tf.Variable 'default_policy/conv4_block5_1_bn/moving_mean:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/post_bn/gamma:0' shape=(2048,) dtype=float32>, <tf.Variable 'default_policy/post_bn/moving_mean:0' shape=(2048,) dtype=float32>, <tf.Variable 'default_policy/conv4_block6_1_bn/gamma:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block6_preact_bn/gamma:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv3_block3_2_conv/kernel:0' shape=(3, 3, 128, 128) dtype=float32>, <tf.Variable 'default_policy/conv3_block3_preact_bn/moving_variance:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv4_block1_preact_bn/gamma:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv4_block2_1_bn/moving_variance:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block5_1_conv/kernel:0' shape=(1, 1, 1024, 256) dtype=float32>, <tf.Variable 'default_policy/conv4_block5_1_bn/gamma:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block1_preact_bn/moving_mean:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv3_block3_3_conv/bias:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv5_block1_preact_bn/gamma:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv3_block4_2_bn/moving_mean:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv4_block2_1_bn/beta:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block4_preact_bn/gamma:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv4_block1_3_conv/bias:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv4_block4_1_bn/gamma:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block6_3_conv/bias:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv5_block1_preact_bn/moving_mean:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv5_block3_1_bn/beta:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv4_block1_0_conv/kernel:0' shape=(1, 1, 512, 1024) dtype=float32>, <tf.Variable 'default_policy/conv3_block3_1_bn/gamma:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv4_block4_1_bn/moving_mean:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block1_1_conv/kernel:0' shape=(1, 1, 512, 256) dtype=float32>, <tf.Variable 'default_policy/conv4_block1_1_bn/gamma:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv3_block2_3_conv/bias:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv4_block3_2_conv/kernel:0' shape=(3, 3, 256, 256) dtype=float32>, <tf.Variable 'default_policy/conv4_block5_preact_bn/gamma:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv5_block1_1_bn/moving_mean:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv4_block4_preact_bn/moving_mean:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv5_block1_0_conv/kernel:0' shape=(1, 1, 1024, 2048) dtype=float32>, <tf.Variable 'default_policy/conv4_block1_1_bn/moving_mean:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block5_preact_bn/moving_mean:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv4_block2_preact_bn/gamma:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv5_block2_1_bn/gamma:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv3_block3_1_conv/kernel:0' shape=(1, 1, 512, 128) dtype=float32>, <tf.Variable 'default_policy/conv3_block4_2_bn/gamma:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv4_block2_preact_bn/moving_mean:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv4_block1_3_conv/kernel:0' shape=(1, 1, 256, 1024) dtype=float32>, <tf.Variable 'default_policy/conv4_block3_1_bn/beta:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv5_block2_1_bn/moving_mean:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv5_block3_2_bn/beta:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv3_block2_3_conv/kernel:0' shape=(1, 1, 128, 512) dtype=float32>, <tf.Variable 'default_policy/conv5_block1_2_bn/beta:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv5_block1_2_bn/moving_variance:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv3_block3_3_conv/kernel:0' shape=(1, 1, 128, 512) dtype=float32>, <tf.Variable 'default_policy/conv4_block3_3_conv/kernel:0' shape=(1, 1, 256, 1024) dtype=float32>, <tf.Variable 'default_policy/conv5_block2_2_bn/moving_mean:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv4_block2_2_conv/kernel:0' shape=(3, 3, 256, 256) dtype=float32>, <tf.Variable 'default_policy/conv3_block4_preact_bn/beta:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv3_block4_preact_bn/moving_variance:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv4_block2_2_bn/gamma:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block2_2_bn/moving_mean:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block1_0_conv/bias:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv4_block3_preact_bn/moving_mean:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv4_block3_1_bn/moving_variance:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block5_2_bn/beta:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv5_block3_preact_bn/beta:0' shape=(2048,) dtype=float32>, <tf.Variable 'default_policy/conv5_block1_preact_bn/moving_variance:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv5_block1_2_bn/moving_mean:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv5_block3_preact_bn/moving_variance:0' shape=(2048,) dtype=float32>, <tf.Variable 'default_policy/conv4_block6_2_bn/gamma:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block5_2_bn/moving_variance:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv5_block1_3_conv/bias:0' shape=(2048,) dtype=float32>, <tf.Variable 'default_policy/conv4_block6_2_bn/moving_mean:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv5_block2_1_bn/beta:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv4_block3_preact_bn/gamma:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv5_block1_preact_bn/beta:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv5_block3_2_bn/moving_mean:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv3_block4_1_bn/moving_mean:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv4_block5_2_conv/kernel:0' shape=(3, 3, 256, 256) dtype=float32>, <tf.Variable 'default_policy/conv5_block2_preact_bn/beta:0' shape=(2048,) dtype=float32>, <tf.Variable 'default_policy/conv5_block2_2_conv/kernel:0' shape=(3, 3, 512, 512) dtype=float32>, <tf.Variable 'default_policy/conv5_block2_preact_bn/moving_variance:0' shape=(2048,) dtype=float32>, <tf.Variable 'default_policy/conv4_block2_preact_bn/moving_variance:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv3_block4_2_bn/beta:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv5_block2_1_bn/moving_variance:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv4_block2_preact_bn/beta:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv3_block3_2_bn/beta:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv5_block3_2_conv/kernel:0' shape=(3, 3, 512, 512) dtype=float32>, <tf.Variable 'default_policy/conv3_block4_2_bn/moving_variance:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv5_block2_3_conv/kernel:0' shape=(1, 1, 512, 2048) dtype=float32>, <tf.Variable 'default_policy/post_bn/beta:0' shape=(2048,) dtype=float32>, <tf.Variable 'default_policy/conv3_block3_preact_bn/gamma:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv4_block3_1_conv/kernel:0' shape=(1, 1, 1024, 256) dtype=float32>, <tf.Variable 'default_policy/conv3_block3_2_bn/moving_variance:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv5_block3_3_conv/bias:0' shape=(2048,) dtype=float32>, <tf.Variable 'default_policy/conv4_block4_2_conv/kernel:0' shape=(3, 3, 256, 256) dtype=float32>, <tf.Variable 'default_policy/conv4_block2_1_bn/gamma:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block2_2_bn/beta:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv5_block1_2_conv/kernel:0' shape=(3, 3, 512, 512) dtype=float32>, <tf.Variable 'default_policy/conv3_block4_1_conv/kernel:0' shape=(1, 1, 512, 128) dtype=float32>, <tf.Variable 'default_policy/conv4_block5_3_conv/kernel:0' shape=(1, 1, 256, 1024) dtype=float32>, <tf.Variable 'default_policy/conv3_block3_preact_bn/moving_mean:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv4_block6_1_bn/beta:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block6_3_conv/kernel:0' shape=(1, 1, 256, 1024) dtype=float32>, <tf.Variable 'default_policy/post_bn/moving_variance:0' shape=(2048,) dtype=float32>, <tf.Variable 'default_policy/conv4_block6_preact_bn/beta:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv4_block2_1_bn/moving_mean:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv5_block1_3_conv/kernel:0' shape=(1, 1, 512, 2048) dtype=float32>, <tf.Variable 'default_policy/conv4_block2_2_bn/moving_variance:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block3_3_conv/bias:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv4_block4_2_bn/beta:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block6_1_bn/moving_variance:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block6_preact_bn/moving_variance:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv4_block1_preact_bn/beta:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv3_block4_preact_bn/gamma:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv4_block4_2_bn/gamma:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block4_2_bn/moving_mean:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block3_1_bn/gamma:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block3_1_bn/moving_mean:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv5_block3_preact_bn/gamma:0' shape=(2048,) dtype=float32>, <tf.Variable 'default_policy/conv5_block3_preact_bn/moving_mean:0' shape=(2048,) dtype=float32>, <tf.Variable 'default_policy/conv3_block3_1_bn/moving_variance:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv3_block4_2_conv/kernel:0' shape=(3, 3, 128, 128) dtype=float32>, <tf.Variable 'default_policy/conv4_block6_1_bn/moving_mean:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv3_block3_preact_bn/beta:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv3_block4_1_bn/beta:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv4_block4_2_bn/moving_variance:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block1_preact_bn/moving_variance:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv5_block3_1_conv/kernel:0' shape=(1, 1, 2048, 512) dtype=float32>, <tf.Variable 'default_policy/conv5_block3_3_conv/kernel:0' shape=(1, 1, 512, 2048) dtype=float32>, <tf.Variable 'default_policy/conv3_block4_1_bn/moving_variance:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv3_block3_1_bn/moving_mean:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv3_block4_3_conv/kernel:0' shape=(1, 1, 128, 512) dtype=float32>, <tf.Variable 'default_policy/conv5_block2_2_bn/beta:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv5_block2_preact_bn/gamma:0' shape=(2048,) dtype=float32>, <tf.Variable 'default_policy/conv4_block4_3_conv/kernel:0' shape=(1, 1, 256, 1024) dtype=float32>, <tf.Variable 'default_policy/conv4_block2_3_conv/bias:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv4_block3_2_bn/beta:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv5_block2_2_bn/moving_variance:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv5_block2_preact_bn/moving_mean:0' shape=(2048,) dtype=float32>, <tf.Variable 'default_policy/conv3_block4_1_bn/gamma:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv4_block3_2_bn/moving_variance:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv5_block2_1_conv/kernel:0' shape=(1, 1, 2048, 512) dtype=float32>, <tf.Variable 'default_policy/conv4_block4_1_bn/beta:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block6_2_conv/kernel:0' shape=(3, 3, 256, 256) dtype=float32>, <tf.Variable 'default_policy/conv4_block6_2_bn/beta:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv3_block4_3_conv/bias:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv5_block3_1_bn/moving_mean:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv4_block6_2_bn/moving_variance:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv3_block3_2_bn/gamma:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv3_block3_2_bn/moving_mean:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv4_block5_3_conv/bias:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv5_block3_1_bn/gamma:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv4_block1_2_bn/gamma:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv5_block3_2_bn/moving_variance:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv4_block1_2_bn/beta:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block5_1_bn/beta:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv5_block1_1_bn/beta:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv4_block4_preact_bn/beta:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv5_block3_1_bn/moving_variance:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv3_block3_1_bn/beta:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv4_block4_1_bn/moving_variance:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block4_3_conv/bias:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv4_block1_2_bn/moving_variance:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv4_block5_preact_bn/beta:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv4_block5_1_bn/moving_variance:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv5_block1_1_bn/moving_variance:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv4_block4_preact_bn/moving_variance:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv5_block1_0_conv/bias:0' shape=(2048,) dtype=float32>, <tf.Variable 'default_policy/conv5_block2_2_bn/gamma:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv4_block5_preact_bn/moving_variance:0' shape=(1024,) dtype=float32>, <tf.Variable 'default_policy/conv5_block3_2_bn/gamma:0' shape=(512,) dtype=float32>} were created as part of <impala_cnn_tf.ImpalaCNN object at 0x190c9ad50> but does not appear in model.variables() ({<tf.Variable 'default_policy/conv2_block1_1_bn/gamma:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv3_block1_2_bn/beta:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv3_block1_2_bn/moving_variance:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv2_block3_3_conv/kernel:0' shape=(1, 1, 64, 256) dtype=float32>, <tf.Variable 'default_policy/conv3_block2_2_bn/gamma:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/vf/kernel:0' shape=(256, 1) dtype=float32>, <tf.Variable 'default_policy/conv2_block2_preact_bn/moving_mean:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv2_block2_1_conv/kernel:0' shape=(1, 1, 256, 64) dtype=float32>, <tf.Variable 'default_policy/conv2_block1_2_conv/kernel:0' shape=(3, 3, 64, 64) dtype=float32>, <tf.Variable 'default_policy/conv2_block2_2_bn/gamma:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv2_block2_1_bn/beta:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv2_block2_2_bn/moving_mean:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv3_block1_preact_bn/moving_mean:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv2_block2_1_bn/moving_variance:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv2_block2_3_conv/bias:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv3_block2_2_conv/kernel:0' shape=(3, 3, 128, 128) dtype=float32>, <tf.Variable 'default_policy/hidden/bias:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv3_block2_preact_bn/moving_variance:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv2_block1_2_bn/moving_variance:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv2_block1_preact_bn/moving_mean:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv2_block1_preact_bn/gamma:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv2_block1_2_bn/beta:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv2_block3_2_bn/gamma:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv3_block1_preact_bn/gamma:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv3_block1_1_bn/beta:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv3_block2_1_bn/beta:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv3_block1_1_bn/moving_variance:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv3_block2_1_bn/moving_variance:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv2_block2_2_conv/kernel:0' shape=(3, 3, 64, 64) dtype=float32>, <tf.Variable 'default_policy/conv2_block1_1_bn/moving_variance:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv1_conv/bias:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv2_block1_1_conv/kernel:0' shape=(1, 1, 64, 64) dtype=float32>, <tf.Variable 'default_policy/conv2_block1_1_bn/beta:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv2_block1_3_conv/bias:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv2_block3_preact_bn/gamma:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv3_block1_0_conv/bias:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv2_block3_2_conv/kernel:0' shape=(3, 3, 64, 64) dtype=float32>, <tf.Variable 'default_policy/conv3_block2_2_bn/beta:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv2_block3_preact_bn/moving_mean:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv2_block3_1_bn/moving_mean:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv2_block3_2_bn/moving_variance:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv3_block2_preact_bn/beta:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv3_block2_2_bn/moving_variance:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/pi/bias:0' shape=(15,) dtype=float32>, <tf.Variable 'default_policy/conv2_block1_0_conv/kernel:0' shape=(1, 1, 64, 256) dtype=float32>, <tf.Variable 'default_policy/conv2_block1_0_conv/bias:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv3_block1_0_conv/kernel:0' shape=(1, 1, 256, 512) dtype=float32>, <tf.Variable 'default_policy/conv2_block3_1_conv/kernel:0' shape=(1, 1, 256, 64) dtype=float32>, <tf.Variable 'default_policy/conv3_block1_2_bn/moving_mean:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv3_block1_3_conv/kernel:0' shape=(1, 1, 128, 512) dtype=float32>, <tf.Variable 'default_policy/vf/bias:0' shape=(1,) dtype=float32>, <tf.Variable 'default_policy/conv2_block2_preact_bn/beta:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv2_block2_preact_bn/moving_variance:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv2_block1_3_conv/kernel:0' shape=(1, 1, 64, 256) dtype=float32>, <tf.Variable 'default_policy/conv2_block2_1_bn/gamma:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv2_block2_2_bn/beta:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv3_block1_preact_bn/beta:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv2_block2_1_bn/moving_mean:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv2_block2_2_bn/moving_variance:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv3_block1_preact_bn/moving_variance:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv3_block1_2_bn/gamma:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/hidden/kernel:0' shape=(8192, 256) dtype=float32>, <tf.Variable 'default_policy/conv3_block1_2_conv/kernel:0' shape=(3, 3, 128, 128) dtype=float32>, <tf.Variable 'default_policy/conv1_conv/kernel:0' shape=(7, 7, 3, 64) dtype=float32>, <tf.Variable 'default_policy/conv2_block1_preact_bn/beta:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv2_block1_preact_bn/moving_variance:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv3_block1_3_conv/bias:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv2_block1_2_bn/moving_mean:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv3_block1_1_bn/moving_mean:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv2_block3_preact_bn/beta:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv2_block3_1_bn/gamma:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv2_block3_2_bn/beta:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv3_block2_1_bn/moving_mean:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv2_block3_3_conv/bias:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv3_block2_preact_bn/gamma:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/conv3_block2_1_conv/kernel:0' shape=(1, 1, 512, 128) dtype=float32>, <tf.Variable 'default_policy/conv3_block1_1_conv/kernel:0' shape=(1, 1, 256, 128) dtype=float32>, <tf.Variable 'default_policy/conv2_block1_2_bn/gamma:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv2_block1_1_bn/moving_mean:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv2_block2_preact_bn/gamma:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv3_block1_1_bn/gamma:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv3_block2_1_bn/gamma:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv3_block2_2_bn/moving_mean:0' shape=(128,) dtype=float32>, <tf.Variable 'default_policy/conv2_block3_1_bn/beta:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv2_block3_2_bn/moving_mean:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv2_block3_preact_bn/moving_variance:0' shape=(256,) dtype=float32>, <tf.Variable 'default_policy/conv2_block3_1_bn/moving_variance:0' shape=(64,) dtype=float32>, <tf.Variable 'default_policy/conv2_block2_3_conv/kernel:0' shape=(1, 1, 64, 256) dtype=float32>, <tf.Variable 'default_policy/conv3_block2_preact_bn/moving_mean:0' shape=(512,) dtype=float32>, <tf.Variable 'default_policy/pi/kernel:0' shape=(256, 15) dtype=float32>}). Did you forget to call model.register_variables() on the variables in question?
Traceback (most recent call last):
  File "train.py", line 238, in <module>
    run(args, parser)
  File "train.py", line 232, in run
    concurrent=True)
  File "/Users/manu/anaconda3/envs/procgen/lib/python3.7/site-packages/ray/tune/tune.py", line 411, in run_experiments
    return_trials=True)
  File "/Users/manu/anaconda3/envs/procgen/lib/python3.7/site-packages/ray/tune/tune.py", line 347, in run
    raise TuneError("Trials did not complete", incomplete_trials)
ray.tune.error.TuneError: ('Trials did not complete', [PPO_procgen_env_wrapper_00000])