Advertisement
Guest User

Untitled

a guest
Mar 23rd, 2018
110
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 5.81 KB | None | 0 0
  1. [ec2-user@ip-10-47-238-23 sequoia]$ echo balance-stnz-test | python sequoia/report/heatmaps/run.py
  2. No configs found; falling back on auto-configuration
  3. INFO:mrjob.conf:No configs found; falling back on auto-configuration
  4. Creating temp directory /tmp/run.ec2-user.20180323.045057.034259
  5. INFO:mrjob.runner:Creating temp directory /tmp/run.ec2-user.20180323.045057.034259
  6. Running step 1 of 2...
  7. INFO:mrjob.sim:Running step 1 of 2...
  8. reading from STDIN
  9. INFO:mrjob.runner:reading from STDIN
  10. INFO:root:sequoia.report.heatmaps.yield_grid_stands: job: balance-stnz-test
  11. INFO:root:Cache Hit! balance-stnz-test/_cache/sequoia.report.heatmaps/yield_grid_stands/balance-stnz-test.txt
  12. INFO:root:sequoia.report.heatmaps.rasterize_grid: grid: -1716_180
  13. INFO:root:Executing command: cd /opt/sequoia && python -m sequoia.report.heatmaps.scripts.rasterize_grid --key_file /mnt/vol/sequoia.report.heatmaps.scripts.rasterize_grid.key.29b263fa-a3a3-40a5-afb8-bcd3f5b0b9a0.txt --value_file /mnt/vol/sequoia.report.heatmaps.scripts.rasterize_grid.value.4820d071-3415-41cb-b33b-0d3efe10eab9.txt --out_file /mnt/vol/sequoia.report.heatmaps.scripts.rasterize_grid.output.c17dad6f-8116-42f2-b8ca-7d6d81c937bc.txt
  14. Traceback (most recent call last):
  15. File "sequoia/report/heatmaps/run.py", line 46, in <module>
  16. ReportHeatmaps.run()
  17. File "/usr/lib/python2.7/dist-packages/mrjob/job.py", line 439, in run
  18. mr_job.execute()
  19. File "/usr/lib/python2.7/dist-packages/mrjob/job.py", line 460, in execute
  20. super(MRJob, self).execute()
  21. File "/usr/lib/python2.7/dist-packages/mrjob/launch.py", line 161, in execute
  22. self.run_job()
  23. File "/usr/lib/python2.7/dist-packages/mrjob/launch.py", line 231, in run_job
  24. runner.run()
  25. File "/usr/lib/python2.7/dist-packages/mrjob/runner.py", line 476, in run
  26. self._run()
  27. File "/usr/lib/python2.7/dist-packages/mrjob/sim.py", line 198, in _run
  28. self._invoke_step(step_num, 'reducer')
  29. File "/usr/lib/python2.7/dist-packages/mrjob/sim.py", line 272, in _invoke_step
  30. working_dir, env)
  31. File "/usr/lib/python2.7/dist-packages/mrjob/inline.py", line 154, in _run_step
  32. child_instance.execute()
  33. File "/usr/lib/python2.7/dist-packages/mrjob/job.py", line 454, in execute
  34. self.run_reducer(self.options.step_num)
  35. File "/usr/lib/python2.7/dist-packages/mrjob/job.py", line 569, in run_reducer
  36. for out_key, out_value in reducer(key, values) or ():
  37. File "/usr/lib/python2.7/dist-packages/drjob/master.py", line 303, in function
  38. self.run_docker_cmd()
  39. File "/usr/lib/python2.7/dist-packages/drjob/master.py", line 239, in run_docker_cmd
  40. return docker.run_cmd(self.make_docker_cmd(), timeout=self.timeout)
  41. File "/usr/lib/python2.7/dist-packages/drjob/utils/docker.py", line 54, in run_cmd
  42. raise Exception(str(errs))
  43. Exception: INFO:drjob.utils.s3:Downloading u's3://silviaterra-sequoia/balance-stnz-test/output/trees/-1708.50_184.50/S407Mario01.json' to '/tmp/tmpfOpp5S/tmpApQPHW/S407Mario01.json'
  44. INFO:drjob.utils.s3:Downloading u's3://silviaterra-sequoia/balance-stnz-test/output/trees/-1708.50_184.50/S409Mario01.json' to '/tmp/tmpfOpp5S/tmpBroiOT/S409Mario01.json'
  45. INFO:drjob.utils.s3:Downloading u's3://silviaterra-sequoia/balance-stnz-test/output/trees/-1708.50_184.50/STANDS269.json' to '/tmp/tmpfOpp5S/tmpkPLfyu/STANDS269.json'
  46. INFO:drjob.utils.s3:Downloading u's3://silviaterra-sequoia/balance-stnz-test/output/trees/-1708.50_184.50/STANDS289.json' to '/tmp/tmpfOpp5S/tmptsJ2XV/STANDS289.json'
  47. INFO:drjob.utils.s3:Downloading u's3://silviaterra-sequoia/balance-stnz-test/output/trees/-1708.50_184.50/STANDS293.json' to '/tmp/tmpfOpp5S/tmpAiSfwI/STANDS293.json'
  48. INFO:drjob.utils.s3:Downloading u's3://silviaterra-sequoia/balance-stnz-test/output/trees/-1708.50_184.50/STANDS303.json' to '/tmp/tmpfOpp5S/tmpH0dPna/STANDS303.json'
  49. INFO:drjob.utils.s3:Downloading u's3://silviaterra-sequoia/balance-stnz-test/output/trees/-1708.50_184.50/STANDS305.json' to '/tmp/tmpfOpp5S/tmpHcP7CT/STANDS305.json'
  50. INFO:drjob.utils.s3:Downloading u's3://silviaterra-sequoia/balance-stnz-test/output/trees/-1708.50_184.50/STANDS359.json' to '/tmp/tmpfOpp5S/tmpstRDh2/STANDS359.json'
  51. INFO:drjob.utils.s3:Downloading u's3://silviaterra-sequoia/balance-stnz-test/output/trees/-1708.50_184.50/STANDS459.json' to '/tmp/tmpfOpp5S/tmpyeXrlg/STANDS459.json'
  52. /usr/local/lib/python2.7/dist-packages/rasterio/__init__.py:99: FutureWarning: GDAL-style transforms are deprecated and will not be supported in Rasterio 1.0.
  53. transform = guard_transform(transform)
  54. Traceback (most recent call last):
  55. File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
  56. "__main__", fname, loader, pkg_name)
  57. File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
  58. exec code in run_globals
  59. File "/opt/sequoia/sequoia/report/heatmaps/scripts/rasterize_grid.py", line 165, in <module>
  60. RasterizeGrid().run()
  61. File "/usr/local/lib/python2.7/dist-packages/drjob/slave.py", line 72, in run
  62. io.write_lines(self.out_file, self.process())
  63. File "/usr/local/lib/python2.7/dist-packages/drjob/utils/io.py", line 29, in write_lines
  64. for v in get_iterable(values):
  65. File "/opt/sequoia/sequoia/report/heatmaps/scripts/rasterize_grid.py", line 144, in run
  66. for fn in minigrid_heatmap_fns:
  67. File "/opt/sequoia/sequoia/report/heatmaps/scripts/rasterize_grid.py", line 108, in make_minigrid_heatmaps
  68. os.path.join(out_dir, '{}.tif'.format(img_type))
  69. File "/opt/sequoia/sequoia/report/heatmaps/scripts/rasterize_grid.py", line 37, in offset_vals_to_rast
  70. with rasterio.open(output_fn, 'w', **template.profile) as dst:
  71. File "/usr/local/lib/python2.7/dist-packages/rasterio/__init__.py", line 123, in open
  72. s.start()
  73. File "rasterio/_io.pyx", line 1346, in rasterio._io.RasterUpdater.start (rasterio/_io.c:19049)
  74. ValueError: Given nodata value, -3.40282346639e+38, is beyond the valid range of its data type, float32.
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement