API tools faq
paste
Advertisement
Guest User

second-run

a guest
Mar 25th, 2021
130
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 63.13 KB | None | 0 0
raw download clone embed print report
  1. sed: couldn't open temporary file /opt/flink/conf/sedsyuEUg: Read-only file system
  2. sed: couldn't open temporary file /opt/flink/conf/sedNN6Qdf: Read-only file system
  3. /docker-entrypoint.sh: line 75: /opt/flink/conf/flink-conf.yaml: Read-only file system
  4. sed: couldn't open temporary file /opt/flink/conf/sedm9GtFj: Read-only file system
  5. /docker-entrypoint.sh: line 90: /opt/flink/conf/flink-conf.yaml.tmp: Read-only file system
  6. Start command: $JAVA_HOME/bin/java -classpath $FLINK_CLASSPATH -Xmx1073741824 -Xms1073741824 -XX:MaxMetaspaceSize=268435456 -Dlog.file=/opt/flink/log/jobmanager.log -Dlogback.configurationFile=file:/opt/flink/conf/logback-console.xml -Dlog4j.configuration=file:/opt/flink/conf/log4j-console.properties -Dlog4j.configurationFile=file:/opt/flink/conf/log4j-console.properties org.apache.flink.kubernetes.entrypoint.KubernetesApplicationClusterEntrypoint -D jobmanager.memory.off-heap.size=134217728b -D jobmanager.memory.jvm-overhead.min=201326592b -D jobmanager.memory.jvm-metaspace.size=268435456b -D jobmanager.memory.heap.size=1073741824b -D jobmanager.memory.jvm-overhead.max=201326592b
  7. 2021-03-25 09:25:06,864 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --------------------------------------------------------------------------------
  8. 2021-03-25 09:25:06,868 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting KubernetesApplicationClusterEntrypoint (Version: 1.12.2, Scala: 2.12, Rev:4dedee0, Date:2021-02-26T17:14:28+01:00)
  9. 2021-03-25 09:25:06,868 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - OS current user: flink
  10. 2021-03-25 09:25:06,869 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Current Hadoop/Kerberos user: <no hadoop dependency found>
  11. 2021-03-25 09:25:06,869 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM: OpenJDK 64-Bit Server VM - Oracle Corporation - 1.8/25.282-b08
  12. 2021-03-25 09:25:06,869 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Maximum heap size: 989 MiBytes
  13. 2021-03-25 09:25:06,869 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JAVA_HOME: /usr/local/openjdk-8
  14. 2021-03-25 09:25:06,870 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - No Hadoop Dependency available
  15. 2021-03-25 09:25:06,870 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM Options:
  16. 2021-03-25 09:25:06,870 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xmx1073741824
  17. 2021-03-25 09:25:06,870 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xms1073741824
  18. 2021-03-25 09:25:06,870 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -XX:MaxMetaspaceSize=268435456
  19. 2021-03-25 09:25:06,870 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog.file=/opt/flink/log/jobmanager.log
  20. 2021-03-25 09:25:06,870 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlogback.configurationFile=file:/opt/flink/conf/logback-console.xml
  21. 2021-03-25 09:25:06,870 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog4j.configuration=file:/opt/flink/conf/log4j-console.properties
  22. 2021-03-25 09:25:06,871 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog4j.configurationFile=file:/opt/flink/conf/log4j-console.properties
  23. 2021-03-25 09:25:06,871 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Program Arguments:
  24. 2021-03-25 09:25:06,872 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
  25. 2021-03-25 09:25:06,872 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.off-heap.size=134217728b
  26. 2021-03-25 09:25:06,873 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
  27. 2021-03-25 09:25:06,873 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-overhead.min=201326592b
  28. 2021-03-25 09:25:06,873 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
  29. 2021-03-25 09:25:06,873 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-metaspace.size=268435456b
  30. 2021-03-25 09:25:06,873 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
  31. 2021-03-25 09:25:06,873 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.heap.size=1073741824b
  32. 2021-03-25 09:25:06,874 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
  33. 2021-03-25 09:25:06,874 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-overhead.max=201326592b
  34. 2021-03-25 09:25:06,874 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Classpath: /opt/flink/lib/flink-csv-1.12.2.jar:/opt/flink/lib/flink-json-1.12.2.jar:/opt/flink/lib/flink-shaded-zookeeper-3.4.14.jar:/opt/flink/lib/flink-table-blink_2.12-1.12.2.jar:/opt/flink/lib/flink-table_2.12-1.12.2.jar:/opt/flink/lib/log4j-1.2-api-2.12.1.jar:/opt/flink/lib/log4j-api-2.12.1.jar:/opt/flink/lib/log4j-core-2.12.1.jar:/opt/flink/lib/log4j-slf4j-impl-2.12.1.jar:/opt/flink/lib/flink-dist_2.12-1.12.2.jar:::
  35. 2021-03-25 09:25:06,874 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --------------------------------------------------------------------------------
  36. 2021-03-25 09:25:06,876 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Registered UNIX signal handlers for [TERM, HUP, INT]
  37. 2021-03-25 09:25:06,893 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: blob.server.port, 6124
  38. 2021-03-25 09:25:06,894 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.execution.failover-strategy, region
  39. 2021-03-25 09:25:06,894 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.cluster-id, batch-job-cluster
  40. 2021-03-25 09:25:06,894 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.address, localhost
  41. 2021-03-25 09:25:06,894 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.service-account, flink-service-account
  42. 2021-03-25 09:25:06,894 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.cluster-id, batch-job-cluster
  43. 2021-03-25 09:25:06,895 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.secret-key, ******
  44. 2021-03-25 09:25:06,895 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.storageDir, s3://flink/flink-ha
  45. 2021-03-25 09:25:06,895 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.endpoint, http://minio-1616518256:9000
  46. 2021-03-25 09:25:06,895 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.savepoint.ignore-unclaimed-state, false
  47. 2021-03-25 09:25:06,895 WARN org.apache.flink.configuration.GlobalConfiguration [] - Error while trying to split key and value in configuration file /opt/flink/conf/flink-conf.yaml:11: "$internal.application.program-args: "
  48. 2021-03-25 09:25:06,896 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.container.image, localhost:5000/user-profile/batch-flink-app-v3:latest
  49. 2021-03-25 09:25:06,896 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: parallelism.default, 1
  50. 2021-03-25 09:25:06,896 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.ssl.enabled, false
  51. 2021-03-25 09:25:06,896 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1
  52. 2021-03-25 09:25:06,896 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.rest-service.exposed.type, NodePort
  53. 2021-03-25 09:25:06,897 WARN org.apache.flink.configuration.GlobalConfiguration [] - Error while trying to split key and value in configuration file /opt/flink/conf/flink-conf.yaml:17: "pipeline.classpaths: "
  54. 2021-03-25 09:25:06,897 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.jobmanager.port, 6123
  55. 2021-03-25 09:25:06,897 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.path-style-access, true
  56. 2021-03-25 09:25:06,897 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.process.size, 1728m
  57. 2021-03-25 09:25:06,897 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.archive.fs.dir, s3://flink/completed-jobs
  58. 2021-03-25 09:25:06,897 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.internal.jobmanager.entrypoint.class, org.apache.flink.kubernetes.entrypoint.KubernetesApplicationClusterEntrypoint
  59. 2021-03-25 09:25:06,897 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.target, kubernetes-application
  60. 2021-03-25 09:25:06,898 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.memory.process.size, 1600m
  61. 2021-03-25 09:25:06,898 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123
  62. 2021-03-25 09:25:06,898 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.rpc.port, 6122
  63. 2021-03-25 09:25:06,898 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.access-key, myaccesskey
  64. 2021-03-25 09:25:06,898 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.attached, true
  65. 2021-03-25 09:25:06,898 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.cluster.execution-mode, NORMAL
  66. 2021-03-25 09:25:06,898 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability, org.apache.flink.kubernetes.highavailability.KubernetesHaServicesFactory
  67. 2021-03-25 09:25:06,898 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.shutdown-on-attached-exit, false
  68. 2021-03-25 09:25:06,899 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: pipeline.jars, local:///opt/flink/usrlib/wordcount.jar
  69. 2021-03-25 09:25:07,110 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting KubernetesApplicationClusterEntrypoint.
  70. 2021-03-25 09:25:07,123 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install default filesystem.
  71. 2021-03-25 09:25:07,128 INFO org.apache.flink.core.fs.FileSystem [] - Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available.
  72. 2021-03-25 09:25:07,225 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install security context.
  73. 2021-03-25 09:25:07,266 INFO org.apache.flink.runtime.security.modules.HadoopModuleFactory [] - Cannot create Hadoop Security Module because Hadoop cannot be found in the Classpath.
  74. 2021-03-25 09:25:07,272 INFO org.apache.flink.runtime.security.modules.JaasModule [] - Jaas file will be created as /tmp/jaas-1731694976812922705.conf.
  75. 2021-03-25 09:25:07,280 INFO org.apache.flink.runtime.security.contexts.HadoopSecurityContextFactory [] - Cannot install HadoopSecurityContext because Hadoop cannot be found in the Classpath.
  76. 2021-03-25 09:25:07,282 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Initializing cluster services.
  77. 2021-03-25 09:25:07,307 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to start actor system, external address 172.17.0.8:6123, bind address 0.0.0.0:6123.
  78. 2021-03-25 09:25:08,585 INFO akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started
  79. 2021-03-25 09:25:08,659 INFO akka.remote.Remoting [] - Starting remoting
  80. 2021-03-25 09:25:08,970 INFO akka.remote.Remoting [] - Remoting started; listening on addresses :[akka.tcp://flink@172.17.0.8:6123]
  81. 2021-03-25 09:25:09,112 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system started at akka.tcp://flink@172.17.0.8:6123
  82. 2021-03-25 09:25:11,187 INFO org.apache.flink.runtime.blob.FileSystemBlobStore [] - Creating highly available BLOB storage directory at s3://flink/flink-ha/batch-job-cluster/blob
  83. 2021-03-25 09:25:11,195 INFO org.apache.flink.runtime.blob.BlobServer [] - Created BLOB server storage directory /tmp/blobStore-dc9e5304-5ee4-4805-bcb8-eecc448ac415
  84. 2021-03-25 09:25:11,198 INFO org.apache.flink.runtime.blob.BlobServer [] - Started BLOB server at 0.0.0.0:6124 - max concurrent requests: 50 - max backlog: 1000
  85. 2021-03-25 09:25:11,266 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl [] - No metrics reporter configured, no metrics will be exposed/reported.
  86. 2021-03-25 09:25:11,271 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to start actor system, external address 172.17.0.8:0, bind address 0.0.0.0:0.
  87. 2021-03-25 09:25:11,291 INFO akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started
  88. 2021-03-25 09:25:11,296 INFO akka.remote.Remoting [] - Starting remoting
  89. 2021-03-25 09:25:11,368 INFO akka.remote.Remoting [] - Remoting started; listening on addresses :[akka.tcp://flink-metrics@172.17.0.8:34437]
  90. 2021-03-25 09:25:11,376 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system started at akka.tcp://flink-metrics@172.17.0.8:34437
  91. 2021-03-25 09:25:11,394 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/rpc/MetricQueryService .
  92. 2021-03-25 09:25:11,565 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Upload directory /tmp/flink-web-fb57ef5e-14e2-4f31-9a69-ba2aaebd0668/flink-web-upload does not exist.
  93. 2021-03-25 09:25:11,566 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Created directory /tmp/flink-web-fb57ef5e-14e2-4f31-9a69-ba2aaebd0668/flink-web-upload for file uploads.
  94. 2021-03-25 09:25:11,592 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Starting rest endpoint.
  95. 2021-03-25 09:25:11,902 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined location of main cluster component log file: /opt/flink/log/jobmanager.log
  96. 2021-03-25 09:25:11,903 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined location of main cluster component stdout file: /opt/flink/log/jobmanager.out
  97. 2021-03-25 09:25:12,137 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Rest endpoint listening at 172.17.0.8:8081
  98. 2021-03-25 09:25:12,484 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesLeaderElector [] - Create KubernetesLeaderElector batch-job-cluster-restserver-leader with lock identity 10077f6e-bbc6-4291-9438-d88e927a2e2f.
  99. 2021-03-25 09:25:13,271 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesLeaderElector [] - New leader elected 10077f6e-bbc6-4291-9438-d88e927a2e2f for batch-job-cluster-restserver-leader.
  100. 2021-03-25 09:25:13,286 INFO org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] - Starting DefaultLeaderElectionService with KubernetesLeaderElectionDriver{configMapName='batch-job-cluster-restserver-leader'}.
  101. 2021-03-25 09:25:13,288 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Web frontend listening at http://172.17.0.8:8081.
  102. 2021-03-25 09:25:13,288 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - http://172.17.0.8:8081 was granted leadership with leaderSessionID=9adb2305-84b5-4384-a03c-9e64f7deda96
  103. 2021-03-25 09:25:13,313 INFO org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils [] - The derived from fraction jvm overhead memory (172.800mb (181193935 bytes)) is less than its min value 192.000mb (201326592 bytes), min value will be used instead
  104. 2021-03-25 09:25:13,386 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: blob.server.port, 6124
  105. 2021-03-25 09:25:13,386 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.execution.failover-strategy, region
  106. 2021-03-25 09:25:13,386 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.cluster-id, batch-job-cluster
  107. 2021-03-25 09:25:13,386 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.address, localhost
  108. 2021-03-25 09:25:13,387 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.service-account, flink-service-account
  109. 2021-03-25 09:25:13,387 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.cluster-id, batch-job-cluster
  110. 2021-03-25 09:25:13,387 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.secret-key, ******
  111. 2021-03-25 09:25:13,387 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.storageDir, s3://flink/flink-ha
  112. 2021-03-25 09:25:13,387 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.endpoint, http://minio-1616518256:9000
  113. 2021-03-25 09:25:13,387 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.savepoint.ignore-unclaimed-state, false
  114. 2021-03-25 09:25:13,387 WARN org.apache.flink.configuration.GlobalConfiguration [] - Error while trying to split key and value in configuration file /opt/flink/conf/flink-conf.yaml:11: "$internal.application.program-args: "
  115. 2021-03-25 09:25:13,387 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.container.image, localhost:5000/user-profile/batch-flink-app-v3:latest
  116. 2021-03-25 09:25:13,387 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: parallelism.default, 1
  117. 2021-03-25 09:25:13,388 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.ssl.enabled, false
  118. 2021-03-25 09:25:13,388 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1
  119. 2021-03-25 09:25:13,388 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.rest-service.exposed.type, NodePort
  120. 2021-03-25 09:25:13,388 WARN org.apache.flink.configuration.GlobalConfiguration [] - Error while trying to split key and value in configuration file /opt/flink/conf/flink-conf.yaml:17: "pipeline.classpaths: "
  121. 2021-03-25 09:25:13,388 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.jobmanager.port, 6123
  122. 2021-03-25 09:25:13,388 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.path-style-access, true
  123. 2021-03-25 09:25:13,388 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.process.size, 1728m
  124. 2021-03-25 09:25:13,388 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.archive.fs.dir, s3://flink/completed-jobs
  125. 2021-03-25 09:25:13,389 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.internal.jobmanager.entrypoint.class, org.apache.flink.kubernetes.entrypoint.KubernetesApplicationClusterEntrypoint
  126. 2021-03-25 09:25:13,389 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.target, kubernetes-application
  127. 2021-03-25 09:25:13,389 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.memory.process.size, 1600m
  128. 2021-03-25 09:25:13,389 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123
  129. 2021-03-25 09:25:13,389 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.rpc.port, 6122
  130. 2021-03-25 09:25:13,389 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.access-key, myaccesskey
  131. 2021-03-25 09:25:13,389 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.attached, true
  132. 2021-03-25 09:25:13,389 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.cluster.execution-mode, NORMAL
  133. 2021-03-25 09:25:13,390 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability, org.apache.flink.kubernetes.highavailability.KubernetesHaServicesFactory
  134. 2021-03-25 09:25:13,390 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.shutdown-on-attached-exit, false
  135. 2021-03-25 09:25:13,390 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: pipeline.jars, local:///opt/flink/usrlib/wordcount.jar
  136. 2021-03-25 09:25:13,399 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager at akka://flink/user/rpc/resourcemanager_0 .
  137. 2021-03-25 09:25:13,478 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesLeaderElector [] - Create KubernetesLeaderElector batch-job-cluster-dispatcher-leader with lock identity 10077f6e-bbc6-4291-9438-d88e927a2e2f.
  138. 2021-03-25 09:25:13,569 INFO org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] - Starting DefaultLeaderElectionService with KubernetesLeaderElectionDriver{configMapName='batch-job-cluster-dispatcher-leader'}.
  139. 2021-03-25 09:25:13,578 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesLeaderElector [] - New leader elected 10077f6e-bbc6-4291-9438-d88e927a2e2f for batch-job-cluster-dispatcher-leader.
  140. 2021-03-25 09:25:13,582 INFO org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] - Starting DefaultLeaderRetrievalService with KubernetesLeaderRetrievalDriver{configMapName='batch-job-cluster-resourcemanager-leader'}.
  141. 2021-03-25 09:25:13,659 INFO org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] - Starting DefaultLeaderRetrievalService with KubernetesLeaderRetrievalDriver{configMapName='batch-job-cluster-dispatcher-leader'}.
  142. 2021-03-25 09:25:13,669 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Start SessionDispatcherLeaderProcess.
  143. 2021-03-25 09:25:13,671 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Recover all persisted job graphs.
  144. 2021-03-25 09:25:13,767 INFO org.apache.flink.runtime.jobmanager.DefaultJobGraphStore [] - Retrieved job ids [] from KubernetesStateHandleStore{configMapName='batch-job-cluster-dispatcher-leader'}
  145. 2021-03-25 09:25:13,772 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Successfully recovered 0 persisted job graphs.
  146. 2021-03-25 09:25:13,921 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at akka://flink/user/rpc/dispatcher_1 .
  147. 2021-03-25 09:25:13,985 INFO org.apache.flink.client.ClientUtils [] - Starting program (detached: false)
  148. Executing WordCount example with default input data set.
  149. Use --input to specify file input.
  150. Printing result to stdout. Use --output to specify output path.
  151. 2021-03-25 09:25:14,487 INFO org.apache.flink.api.java.utils.PlanGenerator [] - The job has 0 registered types and 0 default Kryo serializers
  152. 2021-03-25 09:25:14,564 INFO org.apache.flink.kubernetes.KubernetesResourceManagerDriver [] - Recovered 0 pods from previous attempts, current attempt id is 1.
  153. 2021-03-25 09:25:14,564 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Recovered 0 workers from previous attempt.
  154. 2021-03-25 09:25:14,565 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesLeaderElector [] - Create KubernetesLeaderElector batch-job-cluster-resourcemanager-leader with lock identity 10077f6e-bbc6-4291-9438-d88e927a2e2f.
  155. 2021-03-25 09:25:14,590 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesLeaderElector [] - New leader elected 10077f6e-bbc6-4291-9438-d88e927a2e2f for batch-job-cluster-resourcemanager-leader.
  156. 2021-03-25 09:25:14,589 INFO org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] - Starting DefaultLeaderElectionService with KubernetesLeaderElectionDriver{configMapName='batch-job-cluster-resourcemanager-leader'}.
  157. 2021-03-25 09:25:14,599 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - ResourceManager akka.tcp://flink@172.17.0.8:6123/user/rpc/resourcemanager_0 was granted leadership with fencing token aafb3240cb81457d01247e82b19242dd
  158. 2021-03-25 09:25:14,661 INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl [] - Starting the SlotManager.
  159. 2021-03-25 09:25:14,779 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: blob.server.port, 6124
  160. 2021-03-25 09:25:14,780 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.execution.failover-strategy, region
  161. 2021-03-25 09:25:14,780 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.cluster-id, batch-job-cluster
  162. 2021-03-25 09:25:14,780 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.address, localhost
  163. 2021-03-25 09:25:14,781 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.service-account, flink-service-account
  164. 2021-03-25 09:25:14,781 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.cluster-id, batch-job-cluster
  165. 2021-03-25 09:25:14,781 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.secret-key, ******
  166. 2021-03-25 09:25:14,782 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.storageDir, s3://flink/flink-ha
  167. 2021-03-25 09:25:14,782 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.endpoint, http://minio-1616518256:9000
  168. 2021-03-25 09:25:14,782 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.savepoint.ignore-unclaimed-state, false
  169. 2021-03-25 09:25:14,782 WARN org.apache.flink.configuration.GlobalConfiguration [] - Error while trying to split key and value in configuration file /opt/flink/conf/flink-conf.yaml:11: "$internal.application.program-args: "
  170. 2021-03-25 09:25:14,783 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.container.image, localhost:5000/user-profile/batch-flink-app-v3:latest
  171. 2021-03-25 09:25:14,783 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: parallelism.default, 1
  172. 2021-03-25 09:25:14,783 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.ssl.enabled, false
  173. 2021-03-25 09:25:14,784 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1
  174. 2021-03-25 09:25:14,784 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.rest-service.exposed.type, NodePort
  175. 2021-03-25 09:25:14,784 WARN org.apache.flink.configuration.GlobalConfiguration [] - Error while trying to split key and value in configuration file /opt/flink/conf/flink-conf.yaml:17: "pipeline.classpaths: "
  176. 2021-03-25 09:25:14,784 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.jobmanager.port, 6123
  177. 2021-03-25 09:25:14,785 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.path-style-access, true
  178. 2021-03-25 09:25:14,785 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.process.size, 1728m
  179. 2021-03-25 09:25:14,785 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.archive.fs.dir, s3://flink/completed-jobs
  180. 2021-03-25 09:25:14,786 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.internal.jobmanager.entrypoint.class, org.apache.flink.kubernetes.entrypoint.KubernetesApplicationClusterEntrypoint
  181. 2021-03-25 09:25:14,786 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.target, kubernetes-application
  182. 2021-03-25 09:25:14,786 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.memory.process.size, 1600m
  183. 2021-03-25 09:25:14,787 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123
  184. 2021-03-25 09:25:14,787 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.rpc.port, 6122
  185. 2021-03-25 09:25:14,787 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.access-key, myaccesskey
  186. 2021-03-25 09:25:14,787 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.attached, true
  187. 2021-03-25 09:25:14,788 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.cluster.execution-mode, NORMAL
  188. 2021-03-25 09:25:14,788 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability, org.apache.flink.kubernetes.highavailability.KubernetesHaServicesFactory
  189. 2021-03-25 09:25:14,788 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.shutdown-on-attached-exit, false
  190. 2021-03-25 09:25:14,789 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: pipeline.jars, local:///opt/flink/usrlib/wordcount.jar
  191. 2021-03-25 09:25:14,972 INFO org.apache.flink.client.deployment.application.executors.EmbeddedExecutor [] - Job 00000000000000000000000000000000 is submitted.
  192. 2021-03-25 09:25:14,973 INFO org.apache.flink.client.deployment.application.executors.EmbeddedExecutor [] - Submitting Job with JobId=00000000000000000000000000000000.
  193. 2021-03-25 09:25:15,080 WARN com.amazonaws.services.s3.internal.Mimetypes [] - Unable to find 'mime.types' file in classpath
  194. 2021-03-25 09:25:15,338 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Received JobGraph submission 00000000000000000000000000000000 (Flink Java Job at Thu Mar 25 09:25:14 UTC 2021).
  195. 2021-03-25 09:25:15,344 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Submitting job 00000000000000000000000000000000 (Flink Java Job at Thu Mar 25 09:25:14 UTC 2021).
  196. 2021-03-25 09:25:15,566 INFO org.apache.flink.runtime.jobmanager.DefaultJobGraphStore [] - Added JobGraph(jobId: 00000000000000000000000000000000) to KubernetesStateHandleStore{configMapName='batch-job-cluster-dispatcher-leader'}.
  197. 2021-03-25 09:25:15,588 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesLeaderElector [] - Create KubernetesLeaderElector batch-job-cluster-00000000000000000000000000000000-jobmanager-leader with lock identity 10077f6e-bbc6-4291-9438-d88e927a2e2f.
  198. 2021-03-25 09:25:15,609 INFO org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] - Starting DefaultLeaderElectionService with KubernetesLeaderElectionDriver{configMapName='batch-job-cluster-00000000000000000000000000000000-jobmanager-leader'}.
  199. 2021-03-25 09:25:15,657 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesLeaderElector [] - New leader elected 10077f6e-bbc6-4291-9438-d88e927a2e2f for batch-job-cluster-00000000000000000000000000000000-jobmanager-leader.
  200. 2021-03-25 09:25:15,670 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at akka://flink/user/rpc/jobmanager_2 .
  201. 2021-03-25 09:25:15,682 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Initializing job Flink Java Job at Thu Mar 25 09:25:14 UTC 2021 (00000000000000000000000000000000).
  202. 2021-03-25 09:25:15,772 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using restart back off time strategy NoRestartBackoffTimeStrategy for Flink Java Job at Thu Mar 25 09:25:14 UTC 2021 (00000000000000000000000000000000).
  203. 2021-03-25 09:25:15,820 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Running initialization on master for job Flink Java Job at Thu Mar 25 09:25:14 UTC 2021 (00000000000000000000000000000000).
  204. 2021-03-25 09:25:15,857 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Successfully ran initialization on master in 36 ms.
  205. 2021-03-25 09:25:15,885 INFO org.apache.flink.runtime.scheduler.adapter.DefaultExecutionTopology [] - Built 1 pipelined regions in 3 ms
  206. 2021-03-25 09:25:15,892 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using failover strategy org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy@541d31c4 for Flink Java Job at Thu Mar 25 09:25:14 UTC 2021 (00000000000000000000000000000000).
  207. 2021-03-25 09:25:15,913 INFO org.apache.flink.runtime.jobmaster.JobManagerRunnerImpl [] - JobManager runner for job Flink Java Job at Thu Mar 25 09:25:14 UTC 2021 (00000000000000000000000000000000) was granted leadership with session id ea2d33e7-2d20-4e8f-8fb6-25163df3c6ae at akka.tcp://flink@172.17.0.8:6123/user/rpc/jobmanager_2.
  208. 2021-03-25 09:25:15,961 INFO org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] - Starting DefaultLeaderRetrievalService with KubernetesLeaderRetrievalDriver{configMapName='batch-job-cluster-resourcemanager-leader'}.
  209. 2021-03-25 09:25:15,962 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Starting execution of job Flink Java Job at Thu Mar 25 09:25:14 UTC 2021 (00000000000000000000000000000000) under job master id 8fb625163df3c6aeea2d33e72d204e8f.
  210. 2021-03-25 09:25:15,964 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
  211. 2021-03-25 09:25:15,965 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job Flink Java Job at Thu Mar 25 09:25:14 UTC 2021 (00000000000000000000000000000000) switched from state CREATED to RUNNING.
  212. 2021-03-25 09:25:15,972 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - CHAIN DataSource (at getDefaultTextLineDataSet(WordCountData.java:70) (org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at main(WordCount.java:84)) -> Combine (SUM(1), at main(WordCount.java:87) (1/1) (48f3036eafece90885803331e600aa95) switched from CREATED to SCHEDULED.
  213. 2021-03-25 09:25:15,972 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Reduce (SUM(1), at main(WordCount.java:87) (1/1) (16505a673599183a1bf23c28bddcfa76) switched from CREATED to SCHEDULED.
  214. 2021-03-25 09:25:15,973 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - DataSink (collect()) (1/1) (c16406c2dfbae8e7b4626323b7a2335d) switched from CREATED to SCHEDULED.
  215. 2021-03-25 09:25:15,988 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{809c20b25a311fe992a5f88a3135105c}]
  216. 2021-03-25 09:25:19,613 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Connecting to ResourceManager akka.tcp://flink@172.17.0.8:6123/user/rpc/resourcemanager_0(aafb3240cb81457d01247e82b19242dd)
  217. 2021-03-25 09:25:19,618 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Resolved ResourceManager address, beginning registration
  218. 2021-03-25 09:25:19,623 INFO org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] - Starting DefaultLeaderRetrievalService with KubernetesLeaderRetrievalDriver{configMapName='batch-job-cluster-00000000000000000000000000000000-jobmanager-leader'}.
  219. 2021-03-25 09:25:19,623 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Registering job manager 8fb625163df3c6aeea2d33e72d204e8f@akka.tcp://flink@172.17.0.8:6123/user/rpc/jobmanager_2 for job 00000000000000000000000000000000.
  220. 2021-03-25 09:25:19,732 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Registering job manager 8fb625163df3c6aeea2d33e72d204e8f@akka.tcp://flink@172.17.0.8:6123/user/rpc/jobmanager_2 for job 00000000000000000000000000000000.
  221. 2021-03-25 09:25:19,952 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Registering job manager 8fb625163df3c6aeea2d33e72d204e8f@akka.tcp://flink@172.17.0.8:6123/user/rpc/jobmanager_2 for job 00000000000000000000000000000000.
  222. 2021-03-25 09:25:20,373 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Registering job manager 8fb625163df3c6aeea2d33e72d204e8f@akka.tcp://flink@172.17.0.8:6123/user/rpc/jobmanager_2 for job 00000000000000000000000000000000.
  223. 2021-03-25 09:25:20,728 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Registered job manager 8fb625163df3c6aeea2d33e72d204e8f@akka.tcp://flink@172.17.0.8:6123/user/rpc/jobmanager_2 for job 00000000000000000000000000000000.
  224. 2021-03-25 09:25:20,733 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - JobManager successfully registered at ResourceManager, leader id: aafb3240cb81457d01247e82b19242dd.
  225. 2021-03-25 09:25:20,736 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{809c20b25a311fe992a5f88a3135105c}] and profile ResourceProfile{UNKNOWN} with allocation id 59932061f16bee1510c155a8debb95a0 from resource manager.
  226. 2021-03-25 09:25:20,731 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Registered job manager 8fb625163df3c6aeea2d33e72d204e8f@akka.tcp://flink@172.17.0.8:6123/user/rpc/jobmanager_2 for job 00000000000000000000000000000000.
  227. 2021-03-25 09:25:20,738 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Registered job manager 8fb625163df3c6aeea2d33e72d204e8f@akka.tcp://flink@172.17.0.8:6123/user/rpc/jobmanager_2 for job 00000000000000000000000000000000.
  228. 2021-03-25 09:25:20,738 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Registered job manager 8fb625163df3c6aeea2d33e72d204e8f@akka.tcp://flink@172.17.0.8:6123/user/rpc/jobmanager_2 for job 00000000000000000000000000000000.
  229. 2021-03-25 09:25:20,738 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 00000000000000000000000000000000 with allocation id 59932061f16bee1510c155a8debb95a0.
  230. 2021-03-25 09:25:20,751 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Requesting new worker with resource spec WorkerResourceSpec {cpuCores=1.0, taskHeapSize=384.000mb (402653174 bytes), taskOffHeapSize=0 bytes, networkMemSize=128.000mb (134217730 bytes), managedMemSize=512.000mb (536870920 bytes)}, current pending count: 1.
  231. 2021-03-25 09:25:20,759 INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: []
  232. 2021-03-25 09:25:20,843 INFO org.apache.flink.kubernetes.KubernetesResourceManagerDriver [] - Creating new TaskManager pod with name batch-job-cluster-taskmanager-1-1 and resource <1728,1.0>.
  233. 2021-03-25 09:25:20,960 INFO org.apache.flink.kubernetes.KubernetesResourceManagerDriver [] - Pod batch-job-cluster-taskmanager-1-1 is created.
  234. 2021-03-25 09:25:20,963 INFO org.apache.flink.kubernetes.KubernetesResourceManagerDriver [] - Received new TaskManager pod: batch-job-cluster-taskmanager-1-1
  235. 2021-03-25 09:25:20,966 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Requested worker batch-job-cluster-taskmanager-1-1 with resource spec WorkerResourceSpec {cpuCores=1.0, taskHeapSize=384.000mb (402653174 bytes), taskOffHeapSize=0 bytes, networkMemSize=128.000mb (134217730 bytes), managedMemSize=512.000mb (536870920 bytes)}.
  236. 2021-03-25 09:25:34,910 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Registering TaskManager with ResourceID batch-job-cluster-taskmanager-1-1 (akka.tcp://flink@172.17.0.7:6122/user/rpc/taskmanager_0) at ResourceManager
  237. 2021-03-25 09:25:34,939 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Worker batch-job-cluster-taskmanager-1-1 is registered.
  238. 2021-03-25 09:25:34,940 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Worker batch-job-cluster-taskmanager-1-1 with resource spec WorkerResourceSpec {cpuCores=1.0, taskHeapSize=384.000mb (402653174 bytes), taskOffHeapSize=0 bytes, networkMemSize=128.000mb (134217730 bytes), managedMemSize=512.000mb (536870920 bytes)} was requested in current attempt. Current pending count after registering: 0.
  239. 2021-03-25 09:25:35,710 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - CHAIN DataSource (at getDefaultTextLineDataSet(WordCountData.java:70) (org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at main(WordCount.java:84)) -> Combine (SUM(1), at main(WordCount.java:87) (1/1) (48f3036eafece90885803331e600aa95) switched from SCHEDULED to DEPLOYING.
  240. 2021-03-25 09:25:35,717 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying CHAIN DataSource (at getDefaultTextLineDataSet(WordCountData.java:70) (org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at main(WordCount.java:84)) -> Combine (SUM(1), at main(WordCount.java:87) (1/1) (attempt #0) with attempt id 48f3036eafece90885803331e600aa95 to batch-job-cluster-taskmanager-1-1 @ 172.17.0.7 (dataPort=37183) with allocation id 59932061f16bee1510c155a8debb95a0
  241. 2021-03-25 09:25:35,725 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Reduce (SUM(1), at main(WordCount.java:87) (1/1) (16505a673599183a1bf23c28bddcfa76) switched from SCHEDULED to DEPLOYING.
  242. 2021-03-25 09:25:35,725 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying Reduce (SUM(1), at main(WordCount.java:87) (1/1) (attempt #0) with attempt id 16505a673599183a1bf23c28bddcfa76 to batch-job-cluster-taskmanager-1-1 @ 172.17.0.7 (dataPort=37183) with allocation id 59932061f16bee1510c155a8debb95a0
  243. 2021-03-25 09:25:35,727 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - DataSink (collect()) (1/1) (c16406c2dfbae8e7b4626323b7a2335d) switched from SCHEDULED to DEPLOYING.
  244. 2021-03-25 09:25:35,727 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying DataSink (collect()) (1/1) (attempt #0) with attempt id c16406c2dfbae8e7b4626323b7a2335d to batch-job-cluster-taskmanager-1-1 @ 172.17.0.7 (dataPort=37183) with allocation id 59932061f16bee1510c155a8debb95a0
  245. 2021-03-25 09:25:36,330 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - CHAIN DataSource (at getDefaultTextLineDataSet(WordCountData.java:70) (org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at main(WordCount.java:84)) -> Combine (SUM(1), at main(WordCount.java:87) (1/1) (48f3036eafece90885803331e600aa95) switched from DEPLOYING to RUNNING.
  246. 2021-03-25 09:25:36,332 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - DataSink (collect()) (1/1) (c16406c2dfbae8e7b4626323b7a2335d) switched from DEPLOYING to RUNNING.
  247. 2021-03-25 09:25:36,343 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Reduce (SUM(1), at main(WordCount.java:87) (1/1) (16505a673599183a1bf23c28bddcfa76) switched from DEPLOYING to RUNNING.
  248. 2021-03-25 09:25:36,658 WARN org.apache.flink.runtime.taskmanager.TaskManagerLocation [] - No hostname could be resolved for the IP address 172.17.0.7, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
  249. 2021-03-25 09:25:36,855 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - CHAIN DataSource (at getDefaultTextLineDataSet(WordCountData.java:70) (org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at main(WordCount.java:84)) -> Combine (SUM(1), at main(WordCount.java:87) (1/1) (48f3036eafece90885803331e600aa95) switched from RUNNING to FINISHED.
  250. 2021-03-25 09:25:36,933 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - DataSink (collect()) (1/1) (c16406c2dfbae8e7b4626323b7a2335d) switched from RUNNING to FINISHED.
  251. 2021-03-25 09:25:36,939 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Reduce (SUM(1), at main(WordCount.java:87) (1/1) (16505a673599183a1bf23c28bddcfa76) switched from RUNNING to FINISHED.
  252. 2021-03-25 09:25:36,948 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job Flink Java Job at Thu Mar 25 09:25:14 UTC 2021 (00000000000000000000000000000000) switched from state RUNNING to FINISHED.
  253. 2021-03-25 09:25:36,975 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Job 00000000000000000000000000000000 reached globally terminal state FINISHED.
  254. 2021-03-25 09:25:37,033 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Stopping the JobMaster for job Flink Java Job at Thu Mar 25 09:25:14 UTC 2021(00000000000000000000000000000000).
  255. 2021-03-25 09:25:37,034 INFO org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] - Stopping DefaultLeaderRetrievalService.
  256. 2021-03-25 09:25:37,035 INFO org.apache.flink.kubernetes.highavailability.KubernetesLeaderRetrievalDriver [] - Stopping KubernetesLeaderRetrievalDriver{configMapName='batch-job-cluster-resourcemanager-leader'}.
  257. 2021-03-25 09:25:37,036 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesConfigMapWatcher [] - The watcher is closing.
  258. Program execution finished
  259. Job with JobID 00000000000000000000000000000000 has finished.
  260. Job Runtime: 21382 ms
  261. Accumulator Results:
  262. - ba8d06890711e87e109f7c1bb23f9916 (java.util.ArrayList) [170 elements]
  263.  
  264.  
  265. (a,5)
  266. (action,1)
  267. (after,1)
  268. (against,1)
  269. (all,2)
  270. (and,12)
  271. (arms,1)
  272. (arrows,1)
  273. (awry,1)
  274. (ay,1)
  275. (bare,1)
  276. (be,4)
  277. (bear,3)
  278. (bodkin,1)
  279. (bourn,1)
  280. (but,1)
  281. (by,2)
  282. (calamity,1)
  283. (cast,1)
  284. (coil,1)
  285. (come,1)
  286. (conscience,1)
  287. (consummation,1)
  288. (contumely,1)
  289. (country,1)
  290. (cowards,1)
  291. (currents,1)
  292. (d,4)
  293. (death,2)
  294. (delay,1)
  295. (despis,1)
  296. (devoutly,1)
  297. (die,2)
  298. (does,1)
  299. (dread,1)
  300. (dream,1)
  301. (dreams,1)
  302. (end,2)
  303. (enterprises,1)
  304. (er,1)
  305. (fair,1)
  306. (fardels,1)
  307. (flesh,1)
  308. (fly,1)
  309. (for,2)
  310. (fortune,1)
  311. (from,1)
  312. (give,1)
  313. (great,1)
  314. (grunt,1)
  315. (have,2)
  316. (he,1)
  317. (heartache,1)
  318. (heir,1)
  319. (himself,1)
  320. (his,1)
  321. (hue,1)
  322. (ills,1)
  323. (in,3)
  324. (insolence,1)
  325. (is,3)
  326. (know,1)
  327. (law,1)
  328. (life,2)
  329. (long,1)
  330. (lose,1)
  331. (love,1)
  332. (make,2)
  333. (makes,2)
  334. (man,1)
  335. (may,1)
  336. (merit,1)
  337. (might,1)
  338. (mind,1)
  339. (moment,1)
  340. (more,1)
  341. (mortal,1)
  342. (must,1)
  343. (my,1)
  344. (name,1)
  345. (native,1)
  346. (natural,1)
  347. (no,2)
  348. (nobler,1)
  349. (not,2)
  350. (now,1)
  351. (nymph,1)
  352. (o,1)
  353. (of,15)
  354. (off,1)
  355. (office,1)
  356. (ophelia,1)
  357. (opposing,1)
  358. (oppressor,1)
  359. (or,2)
  360. (orisons,1)
  361. (others,1)
  362. (outrageous,1)
  363. (pale,1)
  364. (pangs,1)
  365. (patient,1)
  366. (pause,1)
  367. (perchance,1)
  368. (pith,1)
  369. (proud,1)
  370. (puzzles,1)
  371. (question,1)
  372. (quietus,1)
  373. (rather,1)
  374. (regard,1)
  375. (remember,1)
  376. (resolution,1)
  377. (respect,1)
  378. (returns,1)
  379. (rub,1)
  380. (s,5)
  381. (say,1)
  382. (scorns,1)
  383. (sea,1)
  384. (shocks,1)
  385. (shuffled,1)
  386. (sicklied,1)
  387. (sins,1)
  388. (sleep,5)
  389. (slings,1)
  390. (so,1)
  391. (soft,1)
  392. (something,1)
  393. (spurns,1)
  394. (suffer,1)
  395. (sweat,1)
  396. (take,1)
  397. (takes,1)
  398. (than,1)
  399. (that,7)
  400. (the,22)
  401. (their,1)
  402. (them,1)
  403. (there,2)
  404. (these,1)
  405. (this,2)
  406. (those,1)
  407. (thought,1)
  408. (thousand,1)
  409. (thus,2)
  410. (thy,1)
  411. (time,1)
  412. (tis,2)
  413. (to,15)
  414. (traveller,1)
  415. (troubles,1)
  416. (turn,1)
  417. (under,1)
  418. (undiscover,1)
  419. (unworthy,1)
  420. (us,3)
  421. (we,4)
  422. (weary,1)
  423. (what,1)
  424. (when,2)
  425. (whether,1)
  426. (whips,1)
  427. (who,2)
  428. (whose,1)
  429. (will,1)
  430. (wish,1)
  431. (with,3)
  432. (would,2)
  433. (wrong,1)
  434. (you,1)
  435. 2021-03-25 09:25:37,071 INFO org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap [] - Application completed SUCCESSFULLY
  436. 2021-03-25 09:25:37,072 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Shutting KubernetesApplicationClusterEntrypoint down with application status SUCCEEDED. Diagnostics null.
  437. 2021-03-25 09:25:37,072 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Shutting down rest endpoint.
  438. 2021-03-25 09:25:37,148 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Suspending SlotPool.
  439. 2021-03-25 09:25:37,159 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Close ResourceManager connection 97555ce81f886d2ecf9e4f4a1946595f: Stopping JobMaster for job Flink Java Job at Thu Mar 25 09:25:14 UTC 2021(00000000000000000000000000000000)..
  440. 2021-03-25 09:25:37,163 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Stopping SlotPool.
  441. 2021-03-25 09:25:37,169 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Disconnect job manager 8fb625163df3c6aeea2d33e72d204e8f@akka.tcp://flink@172.17.0.8:6123/user/rpc/jobmanager_2 for job 00000000000000000000000000000000 from the resource manager.
  442. 2021-03-25 09:25:37,235 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Removing cache directory /tmp/flink-web-fb57ef5e-14e2-4f31-9a69-ba2aaebd0668/flink-web-ui
  443. 2021-03-25 09:25:37,238 INFO org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] - Stopping DefaultLeaderElectionService.
  444. 2021-03-25 09:25:37,239 INFO org.apache.flink.kubernetes.highavailability.KubernetesLeaderElectionDriver [] - Closing KubernetesLeaderElectionDriver{configMapName='batch-job-cluster-restserver-leader'}.
  445. 2021-03-25 09:25:37,249 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesConfigMapWatcher [] - The watcher is closing.
  446. 2021-03-25 09:25:37,249 INFO org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] - Stopping DefaultLeaderElectionService.
  447. 2021-03-25 09:25:37,249 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Shut down complete.
  448. 2021-03-25 09:25:37,253 INFO org.apache.flink.kubernetes.highavailability.KubernetesLeaderElectionDriver [] - Closing KubernetesLeaderElectionDriver{configMapName='batch-job-cluster-00000000000000000000000000000000-jobmanager-leader'}.
  449. 2021-03-25 09:25:37,261 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesConfigMapWatcher [] - The watcher is closing.
  450. 2021-03-25 09:25:37,324 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Shut down cluster because application is in SUCCEEDED, diagnostics null.
  451. 2021-03-25 09:25:37,328 INFO org.apache.flink.kubernetes.KubernetesResourceManagerDriver [] - Deregistering Flink Kubernetes cluster, clusterId: batch-job-cluster, diagnostics:
  452. 2021-03-25 09:25:37,354 INFO org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent [] - Closing components.
  453. 2021-03-25 09:25:37,354 INFO org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] - Stopping DefaultLeaderRetrievalService.
  454. 2021-03-25 09:25:37,355 INFO org.apache.flink.kubernetes.highavailability.KubernetesLeaderRetrievalDriver [] - Stopping KubernetesLeaderRetrievalDriver{configMapName='batch-job-cluster-dispatcher-leader'}.
  455. 2021-03-25 09:25:37,355 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesConfigMapWatcher [] - The watcher is closing.
  456. 2021-03-25 09:25:37,359 INFO org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] - Stopping DefaultLeaderRetrievalService.
  457. 2021-03-25 09:25:37,359 INFO org.apache.flink.kubernetes.highavailability.KubernetesLeaderRetrievalDriver [] - Stopping KubernetesLeaderRetrievalDriver{configMapName='batch-job-cluster-resourcemanager-leader'}.
  458. 2021-03-25 09:25:37,360 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesConfigMapWatcher [] - The watcher is closing.
  459. 2021-03-25 09:25:37,361 INFO org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] - Stopping DefaultLeaderElectionService.
  460. 2021-03-25 09:25:37,362 INFO org.apache.flink.kubernetes.highavailability.KubernetesLeaderElectionDriver [] - Closing KubernetesLeaderElectionDriver{configMapName='batch-job-cluster-dispatcher-leader'}.
  461. 2021-03-25 09:25:37,362 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesConfigMapWatcher [] - The watcher is closing.
  462. 2021-03-25 09:25:37,365 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Stopping SessionDispatcherLeaderProcess.
  463. 2021-03-25 09:25:37,369 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Stopping dispatcher akka.tcp://flink@172.17.0.8:6123/user/rpc/dispatcher_1.
  464. 2021-03-25 09:25:37,370 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Stopping all currently running jobs of dispatcher akka.tcp://flink@172.17.0.8:6123/user/rpc/dispatcher_1.
  465. 2021-03-25 09:25:37,426 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - The watcher is closing.
  466. 2021-03-25 09:25:37,428 INFO org.apache.flink.runtime.jobmanager.DefaultJobGraphStore [] - Removed job graph 00000000000000000000000000000000 from KubernetesStateHandleStore{configMapName='batch-job-cluster-dispatcher-leader'}.
  467. 2021-03-25 09:25:37,443 INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl [] - Closing the SlotManager.
  468. 2021-03-25 09:25:37,443 INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl [] - Suspending the SlotManager.
  469. 2021-03-25 09:25:37,447 INFO org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] - Stopping DefaultLeaderElectionService.
  470. 2021-03-25 09:25:37,447 INFO org.apache.flink.kubernetes.highavailability.KubernetesLeaderElectionDriver [] - Closing KubernetesLeaderElectionDriver{configMapName='batch-job-cluster-resourcemanager-leader'}.
  471. 2021-03-25 09:25:37,448 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesConfigMapWatcher [] - The watcher is closing.
  472. 2021-03-25 09:25:37,449 INFO org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] - Stopping DefaultLeaderRetrievalService.
  473. 2021-03-25 09:25:37,450 INFO org.apache.flink.kubernetes.highavailability.KubernetesLeaderRetrievalDriver [] - Stopping KubernetesLeaderRetrievalDriver{configMapName='batch-job-cluster-00000000000000000000000000000000-jobmanager-leader'}.
  474. 2021-03-25 09:25:37,450 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesConfigMapWatcher [] - The watcher is closing.
  475. 2021-03-25 09:25:37,634 INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.BackPressureRequestCoordinator [] - Shutting down back pressure request coordinator.
  476. 2021-03-25 09:25:37,638 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Stopped dispatcher akka.tcp://flink@172.17.0.8:6123/user/rpc/dispatcher_1.
  477. 2021-03-25 09:25:37,642 INFO org.apache.flink.runtime.jobmanager.DefaultJobGraphStore [] - Stopping DefaultJobGraphStore.
  478. 2021-03-25 09:25:37,647 INFO org.apache.flink.runtime.blob.BlobServer [] - Stopped BLOB server at 0.0.0.0:6124
  479. 2021-03-25 09:25:37,647 INFO org.apache.flink.kubernetes.highavailability.KubernetesHaServices [] - Close and clean up all data for KubernetesHaServices.
  480. 2021-03-25 09:25:37,746 ERROR org.apache.flink.runtime.history.FsJobArchivist [] - Failed to archive job.
  481. java.io.IOException: File already exists:s3://flink/completed-jobs/00000000000000000000000000000000
  482. at com.facebook.presto.hive.s3.PrestoS3FileSystem.create(PrestoS3FileSystem.java:357) ~[?:?]
  483. at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1169) ~[?:?]
  484. at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1149) ~[?:?]
  485. at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1038) ~[?:?]
  486. at org.apache.flink.fs.s3presto.common.HadoopFileSystem.create(HadoopFileSystem.java:154) ~[?:?]
  487. at org.apache.flink.fs.s3presto.common.HadoopFileSystem.create(HadoopFileSystem.java:37) ~[?:?]
  488. at org.apache.flink.core.fs.PluginFileSystemFactory$ClassLoaderFixingFileSystem.create(PluginFileSystemFactory.java:168) ~[flink-dist_2.12-1.12.2.jar:1.12.2]
  489. at org.apache.flink.runtime.history.FsJobArchivist.archiveJob(FsJobArchivist.java:73) ~[flink-dist_2.12-1.12.2.jar:1.12.2]
  490. at org.apache.flink.runtime.dispatcher.JsonResponseHistoryServerArchivist.lambda$archiveExecutionGraph$0(JsonResponseHistoryServerArchivist.java:57) ~[flink-dist_2.12-1.12.2.jar:1.12.2]
  491. at org.apache.flink.util.function.ThrowingRunnable.lambda$unchecked$0(ThrowingRunnable.java:49) ~[flink-dist_2.12-1.12.2.jar:1.12.2]
  492. at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1640) [?:1.8.0_282]
  493. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_282]
  494. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_282]
  495. at java.lang.Thread.run(Thread.java:748) [?:1.8.0_282]
  496. 2021-03-25 09:25:37,764 INFO org.apache.flink.kubernetes.highavailability.KubernetesHaServices [] - Finished cleaning up the high availability data.
  497. 2021-03-25 09:25:37,766 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Stopping Akka RPC service.
  498. 2021-03-25 09:25:37,754 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Could not archive completed job Flink Java Job at Thu Mar 25 09:25:14 UTC 2021(00000000000000000000000000000000) to the history server.
  499. java.util.concurrent.CompletionException: java.lang.RuntimeException: java.io.IOException: File already exists:s3://flink/completed-jobs/00000000000000000000000000000000
  500. at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273) ~[?:1.8.0_282]
  501. at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280) [?:1.8.0_282]
  502. at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1643) [?:1.8.0_282]
  503. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_282]
  504. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_282]
  505. at java.lang.Thread.run(Thread.java:748) [?:1.8.0_282]
  506. Caused by: java.lang.RuntimeException: java.io.IOException: File already exists:s3://flink/completed-jobs/00000000000000000000000000000000
  507. at org.apache.flink.util.ExceptionUtils.rethrow(ExceptionUtils.java:316) ~[flink-dist_2.12-1.12.2.jar:1.12.2]
  508. at org.apache.flink.util.function.ThrowingRunnable.lambda$unchecked$0(ThrowingRunnable.java:51) ~[flink-dist_2.12-1.12.2.jar:1.12.2]
  509. at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1640) ~[?:1.8.0_282]
  510. ... 3 more
  511. Caused by: java.io.IOException: File already exists:s3://flink/completed-jobs/00000000000000000000000000000000
  512. at com.facebook.presto.hive.s3.PrestoS3FileSystem.create(PrestoS3FileSystem.java:357) ~[?:?]
  513. at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1169) ~[?:?]
  514. at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1149) ~[?:?]
  515. at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1038) ~[?:?]
  516. at org.apache.flink.fs.s3presto.common.HadoopFileSystem.create(HadoopFileSystem.java:154) ~[?:?]
  517. at org.apache.flink.fs.s3presto.common.HadoopFileSystem.create(HadoopFileSystem.java:37) ~[?:?]
  518. at org.apache.flink.core.fs.PluginFileSystemFactory$ClassLoaderFixingFileSystem.create(PluginFileSystemFactory.java:168) ~[flink-dist_2.12-1.12.2.jar:1.12.2]
  519. at org.apache.flink.runtime.history.FsJobArchivist.archiveJob(FsJobArchivist.java:73) ~[flink-dist_2.12-1.12.2.jar:1.12.2]
  520. at org.apache.flink.runtime.dispatcher.JsonResponseHistoryServerArchivist.lambda$archiveExecutionGraph$0(JsonResponseHistoryServerArchivist.java:57) ~[flink-dist_2.12-1.12.2.jar:1.12.2]
  521. at org.apache.flink.util.function.ThrowingRunnable.lambda$unchecked$0(ThrowingRunnable.java:49) ~[flink-dist_2.12-1.12.2.jar:1.12.2]
  522. at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1640) ~[?:1.8.0_282]
  523. ... 3 more
  524. 2021-03-25 09:25:37,845 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Stopping Akka RPC service.
  525. 2021-03-25 09:25:37,875 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Shutting down remote daemon.
  526. 2021-03-25 09:25:37,875 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Shutting down remote daemon.
  527. 2021-03-25 09:25:37,924 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remote daemon shut down; proceeding with flushing remote transports.
  528. 2021-03-25 09:25:37,928 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remote daemon shut down; proceeding with flushing remote transports.
  529. 2021-03-25 09:25:38,050 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remoting shut down.
  530. 2021-03-25 09:25:38,051 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remoting shut down.
  531. 2021-03-25 09:25:38,068 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - RECEIVED SIGNAL 15: SIGTERM. Shutting down as requested.
  532. 2021-03-25 09:25:38,074 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Stopped Akka RPC service.
  533.  
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!