Advertisement
Guest User

Model Loading Error

a guest
Jul 16th, 2019
102
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 4.89 KB | None | 0 0
  1. Traceback (most recent call last):
  2. File "/u/nlp/anaconda/main/anaconda3/envs/fresh/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1334, in _do_call
  3. return fn(*args)
  4. File "/u/nlp/anaconda/main/anaconda3/envs/fresh/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1319, in _run_fn
  5. options, feed_dict, fetch_list, target_list, run_metadata)
  6. File "/u/nlp/anaconda/main/anaconda3/envs/fresh/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1407, in _call_tf_sessionrun
  7. run_metadata)
  8. tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value eval_metrics/mean/count
  9. [[{{node eval_metrics/mean/AssignAdd_1}} = AssignAdd[T=DT_FLOAT, use_locking=false, _device="/job:localhost/replica:0/task:0/device:GPU:0"](eval_metrics/mean/count, eval_metrics/mean/ToFloat, ^add_8)]]
  10.  
  11. During handling of the above exception, another exception occurred:
  12.  
  13. Traceback (most recent call last):
  14. File "evaluate_save.py", line 42, in <module>
  15. model.evaluate(test_batch_generator, evaluator) # inference on test data
  16. File "/juicier/scr126/scr/hnf035/fresh/SMRCToolkit/sogou_mrc/model/bert_coqa.py", line 356, in evaluate
  17. Trainer._evaluate(self, batch_generator, evaluator)
  18. File "/juicier/scr126/scr/hnf035/fresh/SMRCToolkit/sogou_mrc/train/trainer.py", line 153, in _evaluate
  19. output = Trainer._eval_sess(model, batch_generator, eval_num_steps, None)
  20. File "/juicier/scr126/scr/hnf035/fresh/SMRCToolkit/sogou_mrc/train/trainer.py", line 48, in _eval_sess
  21. _, output = model.session.run([model.eval_update_metrics, model.output_variable_dict], feed_dict=feed_dict)
  22. File "/u/nlp/anaconda/main/anaconda3/envs/fresh/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 929, in run
  23. run_metadata_ptr)
  24. File "/u/nlp/anaconda/main/anaconda3/envs/fresh/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1152, in _run
  25. feed_dict_tensor, options, run_metadata)
  26. File "/u/nlp/anaconda/main/anaconda3/envs/fresh/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1328, in _do_run
  27. run_metadata)
  28. File "/u/nlp/anaconda/main/anaconda3/envs/fresh/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1348, in _do_call
  29. raise type(e)(node_def, op, message)
  30. tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value eval_metrics/mean/count
  31. [[node eval_metrics/mean/AssignAdd_1 (defined at /juicier/scr126/scr/hnf035/fresh/SMRCToolkit/sogou_mrc/model/bert_coqa.py:199) = AssignAdd[T=DT_FLOAT, use_locking=false, _device="/job:localhost/replica:0/task:0/device:GPU:0"](eval_metrics/mean/count, eval_metrics/mean/ToFloat, ^add_8)]]
  32.  
  33. Caused by op 'eval_metrics/mean/AssignAdd_1', defined at:
  34. File "evaluate_save.py", line 38, in <module>
  35. model = BertCoQA(bert_dir=bert_dir,answer_verification=True)
  36. File "/juicier/scr126/scr/hnf035/fresh/SMRCToolkit/sogou_mrc/model/bert_coqa.py", line 25, in __init__
  37. self._build_graph()
  38. File "/juicier/scr126/scr/hnf035/fresh/SMRCToolkit/sogou_mrc/model/bert_coqa.py", line 199, in _build_graph
  39. 'loss': tf.metrics.mean(self.loss)
  40. File "/u/nlp/anaconda/main/anaconda3/envs/fresh/lib/python3.6/site-packages/tensorflow/python/ops/metrics_impl.py", line 403, in mean
  41. update_count_op = state_ops.assign_add(count, num_values)
  42. File "/u/nlp/anaconda/main/anaconda3/envs/fresh/lib/python3.6/site-packages/tensorflow/python/ops/state_ops.py", line 188, in assign_add
  43. ref, value, use_locking=use_locking, name=name)
  44. File "/u/nlp/anaconda/main/anaconda3/envs/fresh/lib/python3.6/site-packages/tensorflow/python/ops/gen_state_ops.py", line 103, in assign_add
  45. "AssignAdd", ref=ref, value=value, use_locking=use_locking, name=name)
  46. File "/u/nlp/anaconda/main/anaconda3/envs/fresh/lib/python3.6/site-packages/tensorflow/python/framework/op_def_library.py", line 787, in _apply_op_helper
  47. op_def=op_def)
  48. File "/u/nlp/anaconda/main/anaconda3/envs/fresh/lib/python3.6/site-packages/tensorflow/python/util/deprecation.py", line 488, in new_func
  49. return func(*args, **kwargs)
  50. File "/u/nlp/anaconda/main/anaconda3/envs/fresh/lib/python3.6/site-packages/tensorflow/python/framework/ops.py", line 3274, in create_op
  51. op_def=op_def)
  52. File "/u/nlp/anaconda/main/anaconda3/envs/fresh/lib/python3.6/site-packages/tensorflow/python/framework/ops.py", line 1770, in __init__
  53. self._traceback = tf_stack.extract_stack()
  54.  
  55. FailedPreconditionError (see above for traceback): Attempting to use uninitialized value eval_metrics/mean/count
  56. [[node eval_metrics/mean/AssignAdd_1 (defined at /juicier/scr126/scr/hnf035/fresh/SMRCToolkit/sogou_mrc/model/bert_coqa.py:199) = AssignAdd[T=DT_FLOAT, use_locking=false, _device="/job:localhost/replica:0/task:0/device:GPU:0"](eval_metrics/mean/count, eval_metrics/mean/ToFloat, ^add_8)]]
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement