Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- Traceback (most recent call last):
- File "/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/client/session.py", line 1365, in _do_call
- return fn(*args)
- File "/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/client/session.py", line 1350, in _run_fn
- target_list, run_metadata)
- File "/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/client/session.py", line 1443, in _call_tf_sessionrun
- run_metadata)
- tensorflow.python.framework.errors_impl.ResourceExhaustedError: 2 root error(s) found.
- (0) Resource exhausted: OOM when allocating tensor with shape[1,48,2,25,582,64] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc
- [[{{node sample_sequence/while/concat}}]]
- Hint: If you want to see a list of allocated tensors when OOM happens, add report_tensor_allocations_upon_oom to RunOptions for current allocation info.
- [[sample_sequence/while/Exit_3/_1387]]
- Hint: If you want to see a list of allocated tensors when OOM happens, add report_tensor_allocations_upon_oom to RunOptions for current allocation info.
- (1) Resource exhausted: OOM when allocating tensor with shape[1,48,2,25,582,64] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc
- [[{{node sample_sequence/while/concat}}]]
- Hint: If you want to see a list of allocated tensors when OOM happens, add report_tensor_allocations_upon_oom to RunOptions for current allocation info.
- 0 successful operations.
- 0 derived errors ignored.
- During handling of the above exception, another exception occurred:
- Traceback (most recent call last):
- File "play.py", line 271, in <module>
- play_aidungeon_2()
- File "play.py", line 234, in play_aidungeon_2
- result = "\n" + story_manager.act(action)
- File "/content/AIDungeon/AIDungeon/AIDungeon/story/story_manager.py", line 207, in act
- result = self.generate_result(action_choice)
- File "/content/AIDungeon/AIDungeon/AIDungeon/story/story_manager.py", line 212, in generate_result
- block = self.generator.generate(self.story_context() + action)
- File "/content/AIDungeon/AIDungeon/AIDungeon/generator/gpt2/gpt2_generator.py", line 119, in generate
- text = self.generate_raw(prompt)
- File "/content/AIDungeon/AIDungeon/AIDungeon/generator/gpt2/gpt2_generator.py", line 102, in generate_raw
- self.context: [context_tokens for _ in range(self.batch_size)]
- File "/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/client/session.py", line 956, in run
- run_metadata_ptr)
- File "/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/client/session.py", line 1180, in _run
- feed_dict_tensor, options, run_metadata)
- File "/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/client/session.py", line 1359, in _do_run
- run_metadata)
- File "/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/client/session.py", line 1384, in _do_call
- raise type(e)(node_def, op, message)
- tensorflow.python.framework.errors_impl.ResourceExhaustedError: 2 root error(s) found.
- (0) Resource exhausted: OOM when allocating tensor with shape[1,48,2,25,582,64] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc
- [[node sample_sequence/while/concat (defined at /usr/local/lib/python3.6/dist-packages/tensorflow_core/python/framework/ops.py:1748) ]]
- Hint: If you want to see a list of allocated tensors when OOM happens, add report_tensor_allocations_upon_oom to RunOptions for current allocation info.
- [[sample_sequence/while/Exit_3/_1387]]
- Hint: If you want to see a list of allocated tensors when OOM happens, add report_tensor_allocations_upon_oom to RunOptions for current allocation info.
- (1) Resource exhausted: OOM when allocating tensor with shape[1,48,2,25,582,64] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc
- [[node sample_sequence/while/concat (defined at /usr/local/lib/python3.6/dist-packages/tensorflow_core/python/framework/ops.py:1748) ]]
- Hint: If you want to see a list of allocated tensors when OOM happens, add report_tensor_allocations_upon_oom to RunOptions for current allocation info.
- 0 successful operations.
- 0 derived errors ignored.
- Original stack trace for 'sample_sequence/while/concat':
- File "play.py", line 271, in <module>
- play_aidungeon_2()
- File "play.py", line 106, in play_aidungeon_2
- generator = GPT2Generator()
- File "/content/AIDungeon/AIDungeon/AIDungeon/generator/gpt2/gpt2_generator.py", line 51, in __init__
- top_p=top_p,
- File "/content/AIDungeon/AIDungeon/AIDungeon/generator/gpt2/src/sample.py", line 120, in sample_sequence
- back_prop=False,
- File "/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/ops/control_flow_ops.py", line 2753, in while_loop
- return_same_structure)
- File "/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/ops/control_flow_ops.py", line 2245, in BuildLoop
- pred, body, original_loop_vars, loop_vars, shape_invariants)
- File "/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/ops/control_flow_ops.py", line 2170, in _BuildLoop
- body_result = body(*packed_vars_for_body)
- File "/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/ops/control_flow_ops.py", line 2705, in <lambda>
- body = lambda i, lv: (i + 1, orig_body(*lv))
- File "/content/AIDungeon/AIDungeon/AIDungeon/generator/gpt2/src/sample.py", line 98, in body
- else tf.concat([past, next_outputs["presents"]], axis=-2),
- File "/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/util/dispatch.py", line 180, in wrapper
- return target(*args, **kwargs)
- File "/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/ops/array_ops.py", line 1420, in concat
- return gen_array_ops.concat_v2(values=values, axis=axis, name=name)
- File "/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/ops/gen_array_ops.py", line 1257, in concat_v2
- "ConcatV2", values=values, axis=axis, name=name)
- File "/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/framework/op_def_library.py", line 794, in _apply_op_helper
- op_def=op_def)
- File "/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/util/deprecation.py", line 507, in new_func
- return func(*args, **kwargs)
- File "/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/framework/ops.py", line 3357, in create_op
- attrs, op_def, compute_device)
- File "/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/framework/ops.py", line 3426, in _create_op_internal
- op_def=op_def)
- File "/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/framework/ops.py", line 1748, in __init__
- self._traceback = tf_stack.extract_stack()
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement