Azathoth42

tensorflow tfrecord log

Jun 23rd, 2018
215
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 12.53 KB | None | 0 0
  1. racinmat@goedel:/mnt/datagrid/personal/racinmat/anime-style-transfer/code/mod-cycle-gan$ python3 train.py
  2. fetching data from tfrecords_file: /datagrid/personal/racinmat/anime-style-transfer/datasets/anime/no-game-no-life.tfrecord
  3. fetching data from tfrecords_file: /datagrid/personal/racinmat/anime-style-transfer/datasets/real/cityscapes.tfrecord
  4. INFO:root:Cycle GAN instantiated.
  5. real_shape=(512, 512, 3) anime_shape=(512, 512, 3)
  6. cycle_lambda=2.000000
  7. learning_rate=0.000200 beta1=0.500000 steps=200000 decay_from=100000
  8. WARNING:tensorflow:From /home.others/eb/easybuild/software/TensorFlow/1.7.0-goolfc-2018a-Python-3.6.4/lib/python3.6/site-packages/tensorflow/contrib/learn/python/learn/datasets/base.py:198: retry (from tensorflow.contrib.learn.python.learn.datasets.base) is deprecated and will be removed in a future version.
  9. Instructions for updating:
  10. Use the retry module or similar alternatives.
  11. WARNING:tensorflow:From /home.others/eb/easybuild/software/TensorFlow/1.7.0-goolfc-2018a-Python-3.6.4/lib/python3.6/site-packages/tensorflow/contrib/learn/python/learn/datasets/base.py:198: retry (from tensorflow.contrib.learn.python.learn.datasets.base) is deprecated and will be removed in a future version.
  12. Instructions for updating:
  13. Use the retry module or similar alternatives.
  14. INFO:root:Created CycleGAN model
  15. 2018-06-23 11:28:43.742977: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1344] Found device 0 with properties:
  16. name: TITAN Xp major: 6 minor: 1 memoryClockRate(GHz): 1.582
  17. pciBusID: 0000:02:00.0
  18. totalMemory: 11.91GiB freeMemory: 11.74GiB
  19. 2018-06-23 11:28:44.153952: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1344] Found device 1 with properties:
  20. name: GeForce GTX TITAN X major: 5 minor: 2 memoryClockRate(GHz): 1.076
  21. pciBusID: 0000:03:00.0
  22. totalMemory: 11.93GiB freeMemory: 11.81GiB
  23. 2018-06-23 11:28:44.480427: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1344] Found device 2 with properties:
  24. name: GeForce GTX TITAN Black major: 3 minor: 5 memoryClockRate(GHz): 0.98
  25. pciBusID: 0000:83:00.0
  26. totalMemory: 5.94GiB freeMemory: 5.86GiB
  27. 2018-06-23 11:28:44.909111: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1344] Found device 3 with properties:
  28. name: GeForce GTX 1080 Ti major: 6 minor: 1 memoryClockRate(GHz): 1.582
  29. pciBusID: 0000:84:00.0
  30. totalMemory: 10.92GiB freeMemory: 2.45GiB
  31. 2018-06-23 11:28:44.909300: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1394] Ignoring visible gpu device (device: 1, name: GeForce GTX TITAN X, pci bus id: 0000:03:00.0, compute capability: 5.2) with Cuda compute capability 5.2. The minimum required Cuda capability is 6.1.
  32. 2018-06-23 11:28:44.909321: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1394] Ignoring visible gpu device (device: 2, name: GeForce GTX TITAN Black, pci bus id: 0000:83:00.0, compute capability: 3.5) with Cuda compute capability 3.5. The minimum required Cuda capability is 6.1.
  33. 2018-06-23 11:28:44.909335: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1423] Adding visible gpu devices: 0, 3
  34. 2018-06-23 11:28:46.489760: I tensorflow/core/common_runtime/gpu/gpu_device.cc:911] Device interconnect StreamExecutor with strength 1 edge matrix:
  35. 2018-06-23 11:28:46.489797: I tensorflow/core/common_runtime/gpu/gpu_device.cc:917] 0 1 2 3
  36. 2018-06-23 11:28:46.489806: I tensorflow/core/common_runtime/gpu/gpu_device.cc:930] 0: N N N N
  37. 2018-06-23 11:28:46.489816: I tensorflow/core/common_runtime/gpu/gpu_device.cc:930] 1: N N N N
  38. 2018-06-23 11:28:46.489821: I tensorflow/core/common_runtime/gpu/gpu_device.cc:930] 2: N N N N
  39. 2018-06-23 11:28:46.489826: I tensorflow/core/common_runtime/gpu/gpu_device.cc:930] 3: N N N N
  40. 2018-06-23 11:28:46.490360: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1041] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11370 MB memory) -> physical GPU (device: 0, name: TITAN Xp, pci bus id: 0000:02:00.0, compute capability: 6.1)
  41. 2018-06-23 11:28:46.490993: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1041] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:1 with 2159 MB memory) -> physical GPU (device: 3, name: GeForce GTX 1080 Ti, pci bus id: 0000:84:00.0, compute capability: 6.1)
  42. INFO:root: real->anime gen - num params: 872064
  43. INFO:root: anime->real gen - num params: 872064
  44. INFO:root: real dis - num params: 1036096
  45. INFO:root: anime dis - num params: 1036096
  46. 2018-06-23 11:28:47.807796: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: real_data (data type: float) is required but could not be found.
  47. 2018-06-23 11:28:47.807868: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: anime_data (data type: float) is required but could not be found.
  48. 2018-06-23 11:28:47.813240: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: real_data (data type: float) is required but could not be found.
  49. 2018-06-23 11:28:47.813380: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: anime_data (data type: float) is required but could not be found.
  50. 2018-06-23 11:28:47.818492: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: real_data (data type: float) is required but could not be found.
  51. 2018-06-23 11:28:47.818554: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: anime_data (data type: float) is required but could not be found.
  52. 2018-06-23 11:28:47.821526: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: anime_data (data type: float) is required but could not be found.
  53. 2018-06-23 11:28:47.821569: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: real_data (data type: float) is required but could not be found.
  54. 2018-06-23 11:28:47.824569: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: anime_data (data type: float) is required but could not be found.
  55. 2018-06-23 11:28:47.824633: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: real_data (data type: float) is required but could not be found.
  56. 2018-06-23 11:28:47.827246: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: anime_data (data type: float) is required but could not be found.
  57. 2018-06-23 11:28:47.827510: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: real_data (data type: float) is required but could not be found.
  58. 2018-06-23 11:28:47.829913: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: anime_data (data type: float) is required but could not be found.
  59. 2018-06-23 11:28:47.830373: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: real_data (data type: float) is required but could not be found.
  60. 2018-06-23 11:28:47.832576: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: anime_data (data type: float) is required but could not be found.
  61. 2018-06-23 11:28:47.833252: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: real_data (data type: float) is required but could not be found.
  62. 2018-06-23 11:28:47.835246: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: anime_data (data type: float) is required but could not be found.
  63. 2018-06-23 11:28:47.836119: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: real_data (data type: float) is required but could not be found.
  64. 2018-06-23 11:28:47.837908: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: anime_data (data type: float) is required but could not be found.
  65. 2018-06-23 11:28:47.838936: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: real_data (data type: float) is required but could not be found.
  66. 2018-06-23 11:28:47.840391: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: anime_data (data type: float) is required but could not be found.
  67. 2018-06-23 11:28:47.841668: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: real_data (data type: float) is required but could not be found.
  68. 2018-06-23 11:28:47.843005: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: anime_data (data type: float) is required but could not be found.
  69. 2018-06-23 11:28:47.844445: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: real_data (data type: float) is required but could not be found.
  70. 2018-06-23 11:28:47.845527: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: anime_data (data type: float) is required but could not be found.
  71. 2018-06-23 11:28:47.847173: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: real_data (data type: float) is required but could not be found.
  72. 2018-06-23 11:28:47.848099: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: anime_data (data type: float) is required but could not be found.
  73. 2018-06-23 11:28:47.849846: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: real_data (data type: float) is required but could not be found.
  74. 2018-06-23 11:28:47.850488: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at iterator_ops.cc:891 : Invalid argument: Feature: anime_data (data type: float) is required but could not be found.
  75. [[Node: ParseSingleExample/ParseSingleExample = ParseSingleExample[Tdense=[DT_FLOAT], dense_keys=["anime_data"], dense_shapes=[[512,512,3]], num_sparse=0, sparse_keys=[], sparse_types=[]](arg0, ParseSingleExample/Const)]]
  76. 2018-06-23 11:28:47.850550: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: anime_data (data type: float) is required but could not be found.
  77. 2018-06-23 11:28:47.852376: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at iterator_ops.cc:891 : Invalid argument: Feature: real_data (data type: float) is required but could not be found.
  78. [[Node: ParseSingleExample/ParseSingleExample = ParseSingleExample[Tdense=[DT_FLOAT], dense_keys=["real_data"], dense_shapes=[[512,512,3]], num_sparse=0, sparse_keys=[], sparse_types=[]](arg0, ParseSingleExample/Const)]]
  79. 2018-06-23 11:28:47.852438: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Feature: real_data (data type: float) is required but could not be found.
  80. INFO:root:Interrupted
  81. INFO:root:Feature: anime_data (data type: float) is required but could not be found.
  82. [[Node: ParseSingleExample/ParseSingleExample = ParseSingleExample[Tdense=[DT_FLOAT], dense_keys=["anime_data"], dense_shapes=[[512,512,3]], num_sparse=0, sparse_keys=[], sparse_types=[]](arg0, ParseSingleExample/Const)]]
  83. [[Node: IteratorGetNext_1 = IteratorGetNext[output_shapes=[[?,512,512,3]], output_types=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/device:CPU:0"](anime/OneShotIterator)]]
  84. INFO:root:Model saved in file: /datagrid/personal/racinmat/anime-style-transfer/checkpoint/20180623-1128-0/model.ckpt-0
  85. INFO:tensorflow:Froze 39 variables.
  86. INFO:tensorflow:Froze 39 variables.
  87. Converted 39 variables to const ops.
  88. INFO:tensorflow:Froze 39 variables.
  89. INFO:tensorflow:Froze 39 variables.
  90. Converted 39 variables to const ops.
Advertisement
Add Comment
Please, Sign In to add comment