API tools faq
paste
Advertisement
Guest User

stack trace

a guest
Jul 21st, 2017
235
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 11.69 KB | None | 0 0
raw download clone embed print report
  1. Cluster configuration: Standalone cluster with JobManager at /10.0.20.148:6123
  2. Using address 10.0.20.148:6123 to connect to JobManager.
  3. JobManager web interface address http://10.0.20.148:8081
  4. Starting execution of program
  5. Submitting job with JobID: a68369119ce030c8ca4a0b98aeb39387. Waiting for job completion.
  6. Connected to JobManager at Actor[akka.tcp://flink@10.0.20.148:6123/user/jobmanager#-158757060] with leader session id 00000000-0000-0000-0000-000000000000.
  7. 07/21/2017 12:40:31 Job execution switched to status RUNNING.
  8. 07/21/2017 12:40:31 CHAIN DataSource (TextSource) -> Map (TextSourcePostStep)(1/3) switched to SCHEDULED
  9. 07/21/2017 12:40:31 CHAIN DataSource (TextSource) -> Map (TextSourcePostStep)(1/3) switched to DEPLOYING
  10. 07/21/2017 12:40:31 CHAIN DataSource (TextSource) -> Map (TextSourcePostStep)(2/3) switched to SCHEDULED
  11. 07/21/2017 12:40:31 CHAIN DataSource (TextSource) -> Map (TextSourcePostStep)(2/3) switched to DEPLOYING
  12. 07/21/2017 12:40:31 CHAIN DataSource (TextSource) -> Map (TextSourcePostStep)(3/3) switched to SCHEDULED
  13. 07/21/2017 12:40:31 CHAIN DataSource (TextSource) -> Map (TextSourcePostStep)(3/3) switched to DEPLOYING
  14. 07/21/2017 12:40:31 CHAIN DataSource (TextSource) -> Map (TextSourcePostStep)(2/3) switched to RUNNING
  15. 07/21/2017 12:40:31 CHAIN DataSource (TextSource) -> Map (TextSourcePostStep)(3/3) switched to RUNNING
  16. 07/21/2017 12:40:31 CHAIN DataSource (TextSource) -> Map (TextSourcePostStep)(1/3) switched to RUNNING
  17. 07/21/2017 12:40:32 MapPartition (PythonFlatMap -> PythonMap)(1/3) switched to SCHEDULED
  18. 07/21/2017 12:40:32 MapPartition (PythonFlatMap -> PythonMap)(1/3) switched to DEPLOYING
  19. 07/21/2017 12:40:32 CHAIN DataSource (TextSource) -> Map (TextSourcePostStep)(1/3) switched to FINISHED
  20. 07/21/2017 12:40:32 MapPartition (PythonFlatMap -> PythonMap)(2/3) switched to SCHEDULED
  21. 07/21/2017 12:40:32 MapPartition (PythonFlatMap -> PythonMap)(2/3) switched to DEPLOYING
  22. 07/21/2017 12:40:32 CHAIN DataSource (TextSource) -> Map (TextSourcePostStep)(2/3) switched to FINISHED
  23. 07/21/2017 12:40:32 MapPartition (PythonFlatMap -> PythonMap)(1/3) switched to RUNNING
  24. 07/21/2017 12:40:32 MapPartition (PythonFlatMap -> PythonMap)(3/3) switched to SCHEDULED
  25. 07/21/2017 12:40:32 MapPartition (PythonFlatMap -> PythonMap)(3/3) switched to DEPLOYING
  26. 07/21/2017 12:40:32 MapPartition (PythonFlatMap -> PythonMap)(2/3) switched to RUNNING
  27. 07/21/2017 12:40:32 CHAIN DataSource (TextSource) -> Map (TextSourcePostStep)(3/3) switched to FINISHED
  28. 07/21/2017 12:40:32 MapPartition (PythonFlatMap -> PythonMap)(3/3) switched to RUNNING
  29. 07/21/2017 12:40:32 MapPartition (PythonFlatMap -> PythonMap)(1/3) switched to FAILED
  30. java.lang.Exception: The user defined 'open()' method caused an exception: Plan file caused an error. Check log-files for details.python: can't open file '/data/tmp/flink/flink-dist-cache-9fc4a122-1f21-4930-a998-db31129b4596/a68369119ce030c8ca4a0b98aeb39387/flink_dc/plan.py': [Errno 2] No such file or directory
  31.  
  32. at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:485)
  33. at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:355)
  34. at org.apache.flink.runtime.taskmanager.Task.run(Task.java:702)
  35. at java.lang.Thread.run(Thread.java:748)
  36. Caused by: java.lang.RuntimeException: Plan file caused an error. Check log-files for details.python: can't open file '/data/tmp/flink/flink-dist-cache-9fc4a122-1f21-4930-a998-db31129b4596/a68369119ce030c8ca4a0b98aeb39387/flink_dc/plan.py': [Errno 2] No such file or directory
  37.  
  38. at org.apache.flink.python.api.streaming.data.PythonStreamer.checkPythonProcessHealth(PythonStreamer.java:177)
  39. at org.apache.flink.python.api.streaming.data.PythonStreamer.startPython(PythonStreamer.java:154)
  40. at org.apache.flink.python.api.streaming.data.PythonStreamer.open(PythonStreamer.java:98)
  41. at org.apache.flink.python.api.functions.PythonMapPartition.open(PythonMapPartition.java:51)
  42. at org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:36)
  43. at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:481)
  44. ... 3 more
  45.  
  46. 07/21/2017 12:40:32 Job execution switched to status FAILING.
  47. java.lang.Exception: The user defined 'open()' method caused an exception: Plan file caused an error. Check log-files for details.python: can't open file '/data/tmp/flink/flink-dist-cache-9fc4a122-1f21-4930-a998-db31129b4596/a68369119ce030c8ca4a0b98aeb39387/flink_dc/plan.py': [Errno 2] No such file or directory
  48.  
  49. at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:485)
  50. at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:355)
  51. at org.apache.flink.runtime.taskmanager.Task.run(Task.java:702)
  52. at java.lang.Thread.run(Thread.java:748)
  53. Caused by: java.lang.RuntimeException: Plan file caused an error. Check log-files for details.python: can't open file '/data/tmp/flink/flink-dist-cache-9fc4a122-1f21-4930-a998-db31129b4596/a68369119ce030c8ca4a0b98aeb39387/flink_dc/plan.py': [Errno 2] No such file or directory
  54.  
  55. at org.apache.flink.python.api.streaming.data.PythonStreamer.checkPythonProcessHealth(PythonStreamer.java:177)
  56. at org.apache.flink.python.api.streaming.data.PythonStreamer.startPython(PythonStreamer.java:154)
  57. at org.apache.flink.python.api.streaming.data.PythonStreamer.open(PythonStreamer.java:98)
  58. at org.apache.flink.python.api.functions.PythonMapPartition.open(PythonMapPartition.java:51)
  59. at org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:36)
  60. at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:481)
  61. ... 3 more
  62. 07/21/2017 12:40:32 MapPartition (PythonFlatMap -> PythonMap)(2/3) switched to CANCELING
  63. 07/21/2017 12:40:32 MapPartition (PythonFlatMap -> PythonMap)(3/3) switched to CANCELING
  64. 07/21/2017 12:40:32 GroupReduce (PythonGroupReducePreStep)(1/3) switched to CANCELED
  65. 07/21/2017 12:40:32 GroupReduce (PythonGroupReducePreStep)(2/3) switched to CANCELED
  66. 07/21/2017 12:40:32 GroupReduce (PythonGroupReducePreStep)(3/3) switched to CANCELED
  67. 07/21/2017 12:40:32 CHAIN MapPartition (PythonGroupReduce -> PythonMap -> PythonMap) -> Map (Map at createTextSink(PythonPlanBinder.java:403))(1/3) switched to CANCELED
  68. 07/21/2017 12:40:32 CHAIN MapPartition (PythonGroupReduce -> PythonMap -> PythonMap) -> Map (Map at createTextSink(PythonPlanBinder.java:403))(2/3) switched to CANCELED
  69. 07/21/2017 12:40:32 CHAIN MapPartition (PythonGroupReduce -> PythonMap -> PythonMap) -> Map (Map at createTextSink(PythonPlanBinder.java:403))(3/3) switched to CANCELED
  70. 07/21/2017 12:40:32 DataSink (TextSink)(1/3) switched to CANCELED
  71. 07/21/2017 12:40:32 DataSink (TextSink)(2/3) switched to CANCELED
  72. 07/21/2017 12:40:32 DataSink (TextSink)(3/3) switched to CANCELED
  73. 07/21/2017 12:40:32 MapPartition (PythonFlatMap -> PythonMap)(2/3) switched to CANCELED
  74. 07/21/2017 12:40:32 MapPartition (PythonFlatMap -> PythonMap)(3/3) switched to CANCELED
  75. 07/21/2017 12:40:32 Job execution switched to status FAILED.
  76.  
  77. ------------------------------------------------------------
  78. The program finished with the following exception:
  79.  
  80. org.apache.flink.client.program.ProgramInvocationException: The program execution failed: Job execution failed.
  81. at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:478)
  82. at org.apache.flink.client.program.StandaloneClusterClient.submitJob(StandaloneClusterClient.java:105)
  83. at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:442)
  84. at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:429)
  85. at org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:62)
  86. at org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:926)
  87. at org.apache.flink.python.api.PythonPlanBinder.runPlan(PythonPlanBinder.java:173)
  88. at org.apache.flink.python.api.PythonPlanBinder.main(PythonPlanBinder.java:99)
  89. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  90. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  91. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  92. at java.lang.reflect.Method.invoke(Method.java:498)
  93. at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:528)
  94. at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:419)
  95. at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:381)
  96. at org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:838)
  97. at org.apache.flink.client.CliFrontend.run(CliFrontend.java:259)
  98. at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1086)
  99. at org.apache.flink.client.CliFrontend$2.call(CliFrontend.java:1133)
  100. at org.apache.flink.client.CliFrontend$2.call(CliFrontend.java:1130)
  101. at org.apache.flink.runtime.security.HadoopSecurityContext$1.run(HadoopSecurityContext.java:43)
  102. at java.security.AccessController.doPrivileged(Native Method)
  103. at javax.security.auth.Subject.doAs(Subject.java:422)
  104. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
  105. at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:40)
  106. at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1130)
  107. Caused by: org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
  108. at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$6.apply$mcV$sp(JobManager.scala:933)
  109. at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$6.apply(JobManager.scala:876)
  110. at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$6.apply(JobManager.scala:876)
  111. at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
  112. at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
  113. at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:40)
  114. at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
  115. at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
  116. at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
  117. at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
  118. at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
  119. Caused by: java.lang.Exception: The user defined 'open()' method caused an exception: Plan file caused an error. Check log-files for details.python: can't open file '/data/tmp/flink/flink-dist-cache-9fc4a122-1f21-4930-a998-db31129b4596/a68369119ce030c8ca4a0b98aeb39387/flink_dc/plan.py': [Errno 2] No such file or directory
  120.  
  121. at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:485)
  122. at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:355)
  123. at org.apache.flink.runtime.taskmanager.Task.run(Task.java:702)
  124. at java.lang.Thread.run(Thread.java:748)
  125. Caused by: java.lang.RuntimeException: Plan file caused an error. Check log-files for details.python: can't open file '/data/tmp/flink/flink-dist-cache-9fc4a122-1f21-4930-a998-db31129b4596/a68369119ce030c8ca4a0b98aeb39387/flink_dc/plan.py': [Errno 2] No such file or directory
  126.  
  127. at org.apache.flink.python.api.streaming.data.PythonStreamer.checkPythonProcessHealth(PythonStreamer.java:177)
  128. at org.apache.flink.python.api.streaming.data.PythonStreamer.startPython(PythonStreamer.java:154)
  129. at org.apache.flink.python.api.streaming.data.PythonStreamer.open(PythonStreamer.java:98)
  130. at org.apache.flink.python.api.functions.PythonMapPartition.open(PythonMapPartition.java:51)
  131. at org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:36)
  132. at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:481)
  133. ... 3 more
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!