API tools faq
paste
GEOFBOT

Flink taskmanager log

GEOFBOT
Jul 13th, 2016
88
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 18.28 KB | None | 0 0
raw download clone embed print report
  1. 2016-07-13 13:06:49,715 INFO org.apache.flink.client.CliFrontend - --------------------------------------------------------------------------------
  2. 2016-07-13 13:06:49,717 INFO org.apache.flink.client.CliFrontend - Starting Command Line Client (Version: 1.1-SNAPSHOT, Rev:a160257, Date:05.07.2016 @ 21:01:31 EDT)
  3. 2016-07-13 13:06:49,717 INFO org.apache.flink.client.CliFrontend - Current user: bluedata
  4. 2016-07-13 13:06:49,717 INFO org.apache.flink.client.CliFrontend - JVM: Java HotSpot(TM) 64-Bit Server VM - Oracle Corporation - 1.8/25.92-b14
  5. 2016-07-13 13:06:49,717 INFO org.apache.flink.client.CliFrontend - Maximum heap size: 27305 MiBytes
  6. 2016-07-13 13:06:49,718 INFO org.apache.flink.client.CliFrontend - JAVA_HOME: (not set)
  7. 2016-07-13 13:06:49,720 INFO org.apache.flink.client.CliFrontend - Hadoop version: 2.3.0
  8. 2016-07-13 13:06:49,720 INFO org.apache.flink.client.CliFrontend - JVM Options:
  9. 2016-07-13 13:06:49,720 INFO org.apache.flink.client.CliFrontend - -Dlog.file=/home/bluedata/flink/log/flink-bluedata-client-bluedata-256.log
  10. 2016-07-13 13:06:49,721 INFO org.apache.flink.client.CliFrontend - -Dlog4j.configuration=file:/home/bluedata/flink/conf/log4j-cli.properties
  11. 2016-07-13 13:06:49,721 INFO org.apache.flink.client.CliFrontend - -Dlogback.configurationFile=file:/home/bluedata/flink/conf/logback.xml
  12. 2016-07-13 13:06:49,721 INFO org.apache.flink.client.CliFrontend - Program Arguments:
  13. 2016-07-13 13:06:49,721 INFO org.apache.flink.client.CliFrontend - run
  14. 2016-07-13 13:06:49,721 INFO org.apache.flink.client.CliFrontend - -v
  15. 2016-07-13 13:06:49,721 INFO org.apache.flink.client.CliFrontend - /home/bluedata/flink/lib/flink-python_2.10-1.1-SNAPSHOT.jar
  16. 2016-07-13 13:06:49,721 INFO org.apache.flink.client.CliFrontend - 3
  17. 2016-07-13 13:06:49,721 INFO org.apache.flink.client.CliFrontend - it_test.py
  18. 2016-07-13 13:06:49,722 INFO org.apache.flink.client.CliFrontend - Classpath: /home/bluedata/flink/lib/flink-dist_2.10-1.1-SNAPSHOT.jar:/home/bluedata/flink/lib/flink-python_2.10-1.1-SNAPSHOT.jar:/home/bluedata/flink/lib/log4j-1.2.17.jar:/home/bluedata/flink/lib/slf4j-log4j12-1.7.7.jar:::
  19. 2016-07-13 13:06:49,722 INFO org.apache.flink.client.CliFrontend - --------------------------------------------------------------------------------
  20. 2016-07-13 13:06:49,722 INFO org.apache.flink.client.CliFrontend - Using configuration directory /home/bluedata/flink/conf
  21. 2016-07-13 13:06:49,722 INFO org.apache.flink.client.CliFrontend - Trying to load configuration file
  22. 2016-07-13 13:06:49,931 INFO org.apache.flink.client.CliFrontend - Running 'run' command.
  23. 2016-07-13 13:06:49,936 INFO org.apache.flink.client.CliFrontend - Building program from JAR file
  24. 2016-07-13 13:06:49,953 INFO org.apache.flink.client.program.StandaloneClusterClient - Starting client actor system.
  25. 2016-07-13 13:06:50,318 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started
  26. 2016-07-13 13:06:50,368 INFO Remoting - Starting remoting
  27. 2016-07-13 13:06:50,517 INFO Remoting - Remoting started; listening on addresses :[akka.tcp://[email protected]:47976]
  28. 2016-07-13 13:06:50,523 INFO org.apache.flink.client.CliFrontend - Cluster retrieved
  29. 2016-07-13 13:06:50,523 INFO org.apache.flink.client.program.StandaloneClusterClient - Looking up JobManager
  30. 2016-07-13 13:06:50,765 INFO org.apache.flink.client.CliFrontend - Using address /172.17.77.10:6123 to connect to JobManager.
  31. 2016-07-13 13:06:50,765 INFO org.apache.flink.client.program.StandaloneClusterClient - Looking up JobManager
  32. 2016-07-13 13:06:50,772 INFO org.apache.flink.client.CliFrontend - JobManager web interface address http://bluedata-256.bdlocal:8081
  33. 2016-07-13 13:06:50,772 INFO org.apache.flink.client.CliFrontend - Starting execution of program
  34. 2016-07-13 13:06:50,772 INFO org.apache.flink.client.program.StandaloneClusterClient - Starting program in interactive mode
  35. 2016-07-13 13:06:52,994 INFO org.apache.flink.api.java.ExecutionEnvironment - The job has 0 registered types and 0 default Kryo serializers
  36. 2016-07-13 13:06:53,123 INFO org.apache.flink.runtime.client.JobClientActor - Disconnect from JobManager null.
  37. 2016-07-13 13:06:53,124 INFO org.apache.flink.runtime.client.JobClientActor - Received job Flink Java Job at Wed Jul 13 13:06:52 EDT 2016 (8d45eba11db5ec1e939830a1cd6b3ab6).
  38. 2016-07-13 13:06:53,125 INFO org.apache.flink.runtime.client.JobClientActor - Could not submit job Flink Java Job at Wed Jul 13 13:06:52 EDT 2016 (8d45eba11db5ec1e939830a1cd6b3ab6), because there is no connection to a JobManager.
  39. 2016-07-13 13:06:53,129 INFO org.apache.flink.runtime.client.JobClientActor - Connect to JobManager Actor[akka.tcp://[email protected]:6123/user/jobmanager#1978161580].
  40. 2016-07-13 13:06:53,130 INFO org.apache.flink.runtime.client.JobClientActor - Connected to new JobManager akka.tcp://[email protected]:6123/user/jobmanager.
  41. 2016-07-13 13:06:53,132 INFO org.apache.flink.runtime.client.JobClientActor - Sending message to JobManager akka.tcp://[email protected]:6123/user/jobmanager to submit job Flink Java Job at Wed Jul 13 13:06:52 EDT 2016 (8d45eba11db5ec1e939830a1cd6b3ab6) and wait for progress
  42. 2016-07-13 13:06:53,134 INFO org.apache.flink.runtime.client.JobClientActor - Upload jar files to job manager akka.tcp://[email protected]:6123/user/jobmanager.
  43. 2016-07-13 13:06:53,155 INFO org.apache.flink.runtime.client.JobClientActor - Submit job to the job manager akka.tcp://[email protected]:6123/user/jobmanager.
  44. 2016-07-13 13:06:53,195 INFO org.apache.flink.runtime.client.JobClientActor - Job was successfully submitted to the JobManager akka.tcp://[email protected]:6123/user/jobmanager.
  45. 2016-07-13 13:06:53,234 INFO org.apache.flink.runtime.client.JobClientActor - 07/13/2016 13:06:53 Job execution switched to status RUNNING.
  46. 2016-07-13 13:06:53,238 INFO org.apache.flink.runtime.client.JobClientActor - 07/13/2016 13:06:53 CHAIN DataSource (ValueSource) -> Map (ValueSourcePostStep)(1/1) switched to SCHEDULED
  47. 2016-07-13 13:06:53,241 INFO org.apache.flink.runtime.client.JobClientActor - 07/13/2016 13:06:53 CHAIN DataSource (ValueSource) -> Map (ValueSourcePostStep)(1/1) switched to DEPLOYING
  48. 2016-07-13 13:06:53,335 INFO org.apache.flink.runtime.client.JobClientActor - 07/13/2016 13:06:53 CHAIN DataSource (ValueSource) -> Map (ValueSourcePostStep)(1/1) switched to RUNNING
  49. 2016-07-13 13:06:53,383 INFO org.apache.flink.runtime.client.JobClientActor - 07/13/2016 13:06:53 PartialSolution (Bulk Iteration)(1/1) switched to SCHEDULED
  50. 2016-07-13 13:06:53,386 INFO org.apache.flink.runtime.client.JobClientActor - 07/13/2016 13:06:53 PartialSolution (Bulk Iteration)(1/1) switched to DEPLOYING
  51. 2016-07-13 13:06:53,389 INFO org.apache.flink.runtime.client.JobClientActor - 07/13/2016 13:06:53 CHAIN DataSource (ValueSource) -> Map (ValueSourcePostStep)(1/1) switched to FINISHED
  52. 2016-07-13 13:06:53,424 INFO org.apache.flink.runtime.client.JobClientActor - 07/13/2016 13:06:53 PartialSolution (Bulk Iteration)(1/1) switched to RUNNING
  53. 2016-07-13 13:06:55,945 INFO org.apache.flink.runtime.client.JobClientActor - 07/13/2016 13:06:55 MapPartition (PythonMap)(1/1) switched to SCHEDULED
  54. 2016-07-13 13:06:55,948 INFO org.apache.flink.runtime.client.JobClientActor - 07/13/2016 13:06:55 MapPartition (PythonMap)(1/1) switched to DEPLOYING
  55. 2016-07-13 13:06:55,979 INFO org.apache.flink.runtime.client.JobClientActor - 07/13/2016 13:06:55 MapPartition (PythonMap)(1/1) switched to RUNNING
  56. 2016-07-13 13:06:58,060 INFO org.apache.flink.runtime.client.JobClientActor - 07/13/2016 13:06:58 MapPartition (PythonMap)(1/1) switched to FAILED
  57. java.lang.Exception: The user defined 'open()' method caused an exception: External process for task MapPartition (PythonMap) terminated prematurely.
  58. python3: can't open file '/home/bluedata/flink/tmp/flink-dist-cache-5f146e89-236c-4163-ba22-9ecfbdf53874/8d45eba11db5ec1e939830a1cd6b3ab6/flink/plan.py': [Errno 2] No such file or directory
  59. at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:481)
  60. at org.apache.flink.runtime.iterative.task.AbstractIterativeTask.run(AbstractIterativeTask.java:146)
  61. at org.apache.flink.runtime.iterative.task.IterationTailTask.run(IterationTailTask.java:107)
  62. at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:351)
  63. at org.apache.flink.runtime.taskmanager.Task.run(Task.java:588)
  64. at java.lang.Thread.run(Thread.java:745)
  65. Caused by: java.lang.RuntimeException: External process for task MapPartition (PythonMap) terminated prematurely.
  66. python3: can't open file '/home/bluedata/flink/tmp/flink-dist-cache-5f146e89-236c-4163-ba22-9ecfbdf53874/8d45eba11db5ec1e939830a1cd6b3ab6/flink/plan.py': [Errno 2] No such file or directory
  67. at org.apache.flink.python.api.streaming.data.PythonStreamer.startPython(PythonStreamer.java:144)
  68. at org.apache.flink.python.api.streaming.data.PythonStreamer.open(PythonStreamer.java:92)
  69. at org.apache.flink.python.api.functions.PythonMapPartition.open(PythonMapPartition.java:48)
  70. at org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:38)
  71. at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:477)
  72. ... 5 more
  73.  
  74. 2016-07-13 13:06:58,082 INFO org.apache.flink.runtime.client.JobClientActor - 07/13/2016 13:06:58 Job execution switched to status FAILING.
  75. java.lang.Exception: The user defined 'open()' method caused an exception: External process for task MapPartition (PythonMap) terminated prematurely.
  76. python3: can't open file '/home/bluedata/flink/tmp/flink-dist-cache-5f146e89-236c-4163-ba22-9ecfbdf53874/8d45eba11db5ec1e939830a1cd6b3ab6/flink/plan.py': [Errno 2] No such file or directory
  77. at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:481)
  78. at org.apache.flink.runtime.iterative.task.AbstractIterativeTask.run(AbstractIterativeTask.java:146)
  79. at org.apache.flink.runtime.iterative.task.IterationTailTask.run(IterationTailTask.java:107)
  80. at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:351)
  81. at org.apache.flink.runtime.taskmanager.Task.run(Task.java:588)
  82. at java.lang.Thread.run(Thread.java:745)
  83. Caused by: java.lang.RuntimeException: External process for task MapPartition (PythonMap) terminated prematurely.
  84. python3: can't open file '/home/bluedata/flink/tmp/flink-dist-cache-5f146e89-236c-4163-ba22-9ecfbdf53874/8d45eba11db5ec1e939830a1cd6b3ab6/flink/plan.py': [Errno 2] No such file or directory
  85. at org.apache.flink.python.api.streaming.data.PythonStreamer.startPython(PythonStreamer.java:144)
  86. at org.apache.flink.python.api.streaming.data.PythonStreamer.open(PythonStreamer.java:92)
  87. at org.apache.flink.python.api.functions.PythonMapPartition.open(PythonMapPartition.java:48)
  88. at org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:38)
  89. at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:477)
  90. ... 5 more
  91. 2016-07-13 13:06:58,086 INFO org.apache.flink.runtime.client.JobClientActor - 07/13/2016 13:06:58 PartialSolution (Bulk Iteration)(1/1) switched to CANCELING
  92. 2016-07-13 13:06:58,087 INFO org.apache.flink.runtime.client.JobClientActor - 07/13/2016 13:06:58 CHAIN MapPartition (PythonMap) -> Map (PrintSinkPreStep)(1/1) switched to CANCELED
  93. 2016-07-13 13:06:58,088 INFO org.apache.flink.runtime.client.JobClientActor - 07/13/2016 13:06:58 DataSink (Print to System.out)(1/1) switched to CANCELED
  94. 2016-07-13 13:06:58,089 INFO org.apache.flink.runtime.client.JobClientActor - 07/13/2016 13:06:58 Sync(Bulk Iteration)(1/1) switched to CANCELED
  95. 2016-07-13 13:06:58,090 INFO org.apache.flink.runtime.client.JobClientActor - 07/13/2016 13:06:58 PartialSolution (Bulk Iteration)(1/1) switched to CANCELED
  96. 2016-07-13 13:06:58,093 INFO org.apache.flink.runtime.client.JobClientActor - 07/13/2016 13:06:58 Job execution switched to status FAILED.
  97. 2016-07-13 13:06:58,097 INFO org.apache.flink.runtime.client.JobClientActor - Terminate JobClientActor.
  98. 2016-07-13 13:06:58,097 INFO org.apache.flink.runtime.client.JobClient - Job execution failed
  99. 2016-07-13 13:06:58,097 INFO org.apache.flink.runtime.client.JobClientActor - Disconnect from JobManager Actor[akka.tcp://[email protected]:6123/user/jobmanager#1978161580].
  100. 2016-07-13 13:06:58,106 ERROR org.apache.flink.client.CliFrontend - Error while running the command.
  101. org.apache.flink.client.program.ProgramInvocationException: The program execution failed: Job execution failed.
  102. at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:378)
  103. at org.apache.flink.client.program.StandaloneClusterClient.submitJob(StandaloneClusterClient.java:91)
  104. at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:355)
  105. at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:342)
  106. at org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:61)
  107. at org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:896)
  108. at org.apache.flink.python.api.PythonPlanBinder.runPlan(PythonPlanBinder.java:149)
  109. at org.apache.flink.python.api.PythonPlanBinder.main(PythonPlanBinder.java:115)
  110. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  111. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  112. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  113. at java.lang.reflect.Method.invoke(Method.java:498)
  114. at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:509)
  115. at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:403)
  116. at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:297)
  117. at org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:740)
  118. at org.apache.flink.client.CliFrontend.run(CliFrontend.java:253)
  119. at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:965)
  120. at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1008)
  121. Caused by: org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
  122. at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply$mcV$sp(JobManager.scala:806)
  123. at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply(JobManager.scala:752)
  124. at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply(JobManager.scala:752)
  125. at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
  126. at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
  127. at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41)
  128. at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401)
  129. at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
  130. at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
  131. at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
  132. at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
  133. at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
  134. Caused by: java.lang.Exception: The user defined 'open()' method caused an exception: External process for task MapPartition (PythonMap) terminated prematurely.
  135. python3: can't open file '/home/bluedata/flink/tmp/flink-dist-cache-5f146e89-236c-4163-ba22-9ecfbdf53874/8d45eba11db5ec1e939830a1cd6b3ab6/flink/plan.py': [Errno 2] No such file or directory
  136. at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:481)
  137. at org.apache.flink.runtime.iterative.task.AbstractIterativeTask.run(AbstractIterativeTask.java:146)
  138. at org.apache.flink.runtime.iterative.task.IterationTailTask.run(IterationTailTask.java:107)
  139. at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:351)
  140. at org.apache.flink.runtime.taskmanager.Task.run(Task.java:588)
  141. at java.lang.Thread.run(Thread.java:745)
  142. Caused by: java.lang.RuntimeException: External process for task MapPartition (PythonMap) terminated prematurely.
  143. python3: can't open file '/home/bluedata/flink/tmp/flink-dist-cache-5f146e89-236c-4163-ba22-9ecfbdf53874/8d45eba11db5ec1e939830a1cd6b3ab6/flink/plan.py': [Errno 2] No such file or directory
  144. at org.apache.flink.python.api.streaming.data.PythonStreamer.startPython(PythonStreamer.java:144)
  145. at org.apache.flink.python.api.streaming.data.PythonStreamer.open(PythonStreamer.java:92)
  146. at org.apache.flink.python.api.functions.PythonMapPartition.open(PythonMapPartition.java:48)
  147. at org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:38)
  148. at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:477)
  149. ... 5 more
  150. 2016-07-13 13:06:58,115 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
  151. 2016-07-13 13:06:58,116 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
  152. 2016-07-13 13:06:58,153 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!