Advertisement
lamiastella

cudnn 7.6.4 for cuda 10.1 doesn't work for cuda 10.2

Jun 11th, 2021
58
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 5.62 KB | None | 0 0
  1. 2021-06-11 02:13:58.205671: E tensorflow/stream_executor/cuda/cuda_dnn.cc:319] Loaded runtime CuDNN library: 7.4.2 but source was compiled with: 7.6.4. CuDNN library major and minor version needs to match or have higher minor version in case of CuDNN 7.0 or later version. If using a binary install, upgrade your CuDNN library. If building from sources, make sure the library loaded at runtime is compatible with the version specified during compile configuration.
  2. Traceback (most recent call last):
  3. File "/scratch3/venv/djrn/lib/python3.8/site-packages/tensorflow/python/client/session.py", line 1365, in _do_call
  4. return fn(*args)
  5. File "/scratch3/venv/djrn/lib/python3.8/site-packages/tensorflow/python/client/session.py", line 1349, in _run_fn
  6. return self._call_tf_sessionrun(options, feed_dict, fetch_list,
  7. File "/scratch3/venv/djrn/lib/python3.8/site-packages/tensorflow/python/client/session.py", line 1441, in _call_tf_sessionrun
  8. return tf_session.TF_SessionRun_wrapper(self._session, options, feed_dict,
  9. tensorflow.python.framework.errors_impl.UnknownError: 2 root error(s) found.
  10. (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
  11. [[{{node transform_net1/tconv1/Conv2D}}]]
  12. [[conv7/Relu/_225]]
  13. (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
  14. [[{{node transform_net1/tconv1/Conv2D}}]]
  15. 0 successful operations.
  16. 0 derived errors ignored.
  17.  
  18. During handling of the above exception, another exception occurred:
  19.  
  20. Traceback (most recent call last):
  21. File "Feature_extraction.py", line 98, in <module>
  22. evaluate()
  23. File "Feature_extraction.py", line 76, in evaluate
  24. eval_one_epoch(sess, ops)
  25. File "Feature_extraction.py", line 92, in eval_one_epoch
  26. feat = sess.run([ops['feat']], feed_dict=feed_dict)
  27. File "/scratch3/venv/djrn/lib/python3.8/site-packages/tensorflow/python/client/session.py", line 957, in run
  28. result = self._run(None, fetches, feed_dict, options_ptr,
  29. File "/scratch3/venv/djrn/lib/python3.8/site-packages/tensorflow/python/client/session.py", line 1180, in _run
  30. results = self._do_run(handle, final_targets, final_fetches,
  31. File "/scratch3/venv/djrn/lib/python3.8/site-packages/tensorflow/python/client/session.py", line 1358, in _do_run
  32. return self._do_call(_run_fn, feeds, fetches, targets, options,
  33. File "/scratch3/venv/djrn/lib/python3.8/site-packages/tensorflow/python/client/session.py", line 1384, in _do_call
  34. raise type(e)(node_def, op, message)
  35. tensorflow.python.framework.errors_impl.UnknownError: 2 root error(s) found.
  36. (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
  37. [[node transform_net1/tconv1/Conv2D (defined at /scratch3/research/code/DJ-RN-dawnlight/pointnet/utils/tf_util.py:158) ]]
  38. [[conv7/Relu/_225]]
  39. (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
  40. [[node transform_net1/tconv1/Conv2D (defined at /scratch3/research/code/DJ-RN-dawnlight/pointnet/utils/tf_util.py:158) ]]
  41. 0 successful operations.
  42. 0 derived errors ignored.
  43.  
  44. Errors may have originated from an input operation.
  45. Input Source operations connected to node transform_net1/tconv1/Conv2D:
  46. transform_net1/ExpandDims (defined at /scratch3/research/code/DJ-RN-dawnlight/pointnet/models/transform_nets.py:18)
  47. transform_net1/tconv1/weights/read (defined at /scratch3/research/code/DJ-RN-dawnlight/pointnet/utils/tf_util.py:22)
  48.  
  49. Input Source operations connected to node transform_net1/tconv1/Conv2D:
  50. transform_net1/ExpandDims (defined at /scratch3/research/code/DJ-RN-dawnlight/pointnet/models/transform_nets.py:18)
  51. transform_net1/tconv1/weights/read (defined at /scratch3/research/code/DJ-RN-dawnlight/pointnet/utils/tf_util.py:22)
  52.  
  53. Original stack trace for 'transform_net1/tconv1/Conv2D':
  54. File "Feature_extraction.py", line 98, in <module>
  55. evaluate()
  56. File "Feature_extraction.py", line 57, in evaluate
  57. feat = MODEL.get_model(pointclouds_pl, is_training_pl)
  58. File "/scratch3/research/code/DJ-RN-dawnlight/pointnet/models/pointnet_hico.py", line 27, in get_model
  59. transform = input_transform_net(point_cloud, is_training, bn_decay, K=3)
  60. File "/scratch3/research/code/DJ-RN-dawnlight/pointnet/models/transform_nets.py", line 19, in input_transform_net
  61. net = tf_util.conv2d(input_image, 64, [1,3],
  62. File "/scratch3/research/code/DJ-RN-dawnlight/pointnet/utils/tf_util.py", line 158, in conv2d
  63. outputs = tf.nn.conv2d(inputs, kernel,
  64. File "/scratch3/venv/djrn/lib/python3.8/site-packages/tensorflow/python/ops/nn_ops.py", line 2006, in conv2d
  65. return gen_nn_ops.conv2d(input, # pylint: disable=redefined-builtin
  66. File "/scratch3/venv/djrn/lib/python3.8/site-packages/tensorflow/python/ops/gen_nn_ops.py", line 965, in conv2d
  67. _, _, _op, _outputs = _op_def_library._apply_op_helper(
  68. File "/scratch3/venv/djrn/lib/python3.8/site-packages/tensorflow/python/framework/op_def_library.py", line 742, in _apply_op_helper
  69. op = g._create_op_internal(op_type_name, inputs, dtypes=None,
  70. File "/scratch3/venv/djrn/lib/python3.8/site-packages/tensorflow/python/framework/ops.py", line 3319, in _create_op_internal
  71. ret = Operation(
  72. File "/scratch3/venv/djrn/lib/python3.8/site-packages/tensorflow/python/framework/ops.py", line 1791, in __init__
  73. self._traceback = tf_stack.extract_stack()
  74.  
  75.  
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement