API tools faq
paste
Advertisement
Guest User

first-run

a guest
Mar 25th, 2021
448
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 59.10 KB | None | 0 0
raw download clone embed print report
  1. sed: couldn't open temporary file /opt/flink/conf/sedthJuKu: Read-only file system
  2. sed: couldn't open temporary file /opt/flink/conf/sed2tv6bu: Read-only file system
  3. /docker-entrypoint.sh: line 75: /opt/flink/conf/flink-conf.yaml: Read-only file system
  4. sed: couldn't open temporary file /opt/flink/conf/sed3xsWSt: Read-only file system
  5. /docker-entrypoint.sh: line 90: /opt/flink/conf/flink-conf.yaml.tmp: Read-only file system
  6. Start command: $JAVA_HOME/bin/java -classpath $FLINK_CLASSPATH -Xmx1073741824 -Xms1073741824 -XX:MaxMetaspaceSize=268435456 -Dlog.file=/opt/flink/log/jobmanager.log -Dlogback.configurationFile=file:/opt/flink/conf/logback-console.xml -Dlog4j.configuration=file:/opt/flink/conf/log4j-console.properties -Dlog4j.configurationFile=file:/opt/flink/conf/log4j-console.properties org.apache.flink.kubernetes.entrypoint.KubernetesApplicationClusterEntrypoint -D jobmanager.memory.off-heap.size=134217728b -D jobmanager.memory.jvm-overhead.min=201326592b -D jobmanager.memory.jvm-metaspace.size=268435456b -D jobmanager.memory.heap.size=1073741824b -D jobmanager.memory.jvm-overhead.max=201326592b
  7. 2021-03-25 09:24:06,568 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --------------------------------------------------------------------------------
  8. 2021-03-25 09:24:06,572 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting KubernetesApplicationClusterEntrypoint (Version: 1.12.2, Scala: 2.12, Rev:4dedee0, Date:2021-02-26T17:14:28+01:00)
  9. 2021-03-25 09:24:06,572 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - OS current user: flink
  10. 2021-03-25 09:24:06,573 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Current Hadoop/Kerberos user: <no hadoop dependency found>
  11. 2021-03-25 09:24:06,573 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM: OpenJDK 64-Bit Server VM - Oracle Corporation - 1.8/25.282-b08
  12. 2021-03-25 09:24:06,573 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Maximum heap size: 989 MiBytes
  13. 2021-03-25 09:24:06,574 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JAVA_HOME: /usr/local/openjdk-8
  14. 2021-03-25 09:24:06,574 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - No Hadoop Dependency available
  15. 2021-03-25 09:24:06,574 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM Options:
  16. 2021-03-25 09:24:06,574 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xmx1073741824
  17. 2021-03-25 09:24:06,574 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xms1073741824
  18. 2021-03-25 09:24:06,575 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -XX:MaxMetaspaceSize=268435456
  19. 2021-03-25 09:24:06,575 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog.file=/opt/flink/log/jobmanager.log
  20. 2021-03-25 09:24:06,575 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlogback.configurationFile=file:/opt/flink/conf/logback-console.xml
  21. 2021-03-25 09:24:06,575 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog4j.configuration=file:/opt/flink/conf/log4j-console.properties
  22. 2021-03-25 09:24:06,575 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog4j.configurationFile=file:/opt/flink/conf/log4j-console.properties
  23. 2021-03-25 09:24:06,575 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Program Arguments:
  24. 2021-03-25 09:24:06,577 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
  25. 2021-03-25 09:24:06,577 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.off-heap.size=134217728b
  26. 2021-03-25 09:24:06,577 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
  27. 2021-03-25 09:24:06,577 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-overhead.min=201326592b
  28. 2021-03-25 09:24:06,578 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
  29. 2021-03-25 09:24:06,578 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-metaspace.size=268435456b
  30. 2021-03-25 09:24:06,578 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
  31. 2021-03-25 09:24:06,578 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.heap.size=1073741824b
  32. 2021-03-25 09:24:06,578 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
  33. 2021-03-25 09:24:06,579 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-overhead.max=201326592b
  34. 2021-03-25 09:24:06,579 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Classpath: /opt/flink/lib/flink-csv-1.12.2.jar:/opt/flink/lib/flink-json-1.12.2.jar:/opt/flink/lib/flink-shaded-zookeeper-3.4.14.jar:/opt/flink/lib/flink-table-blink_2.12-1.12.2.jar:/opt/flink/lib/flink-table_2.12-1.12.2.jar:/opt/flink/lib/log4j-1.2-api-2.12.1.jar:/opt/flink/lib/log4j-api-2.12.1.jar:/opt/flink/lib/log4j-core-2.12.1.jar:/opt/flink/lib/log4j-slf4j-impl-2.12.1.jar:/opt/flink/lib/flink-dist_2.12-1.12.2.jar:::
  35. 2021-03-25 09:24:06,579 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --------------------------------------------------------------------------------
  36. 2021-03-25 09:24:06,581 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Registered UNIX signal handlers for [TERM, HUP, INT]
  37. 2021-03-25 09:24:06,641 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: blob.server.port, 6124
  38. 2021-03-25 09:24:06,641 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.execution.failover-strategy, region
  39. 2021-03-25 09:24:06,642 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.cluster-id, batch-job-cluster
  40. 2021-03-25 09:24:06,642 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.address, localhost
  41. 2021-03-25 09:24:06,642 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.service-account, flink-service-account
  42. 2021-03-25 09:24:06,642 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.cluster-id, batch-job-cluster
  43. 2021-03-25 09:24:06,642 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.secret-key, ******
  44. 2021-03-25 09:24:06,643 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.storageDir, s3://flink/flink-ha
  45. 2021-03-25 09:24:06,643 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.endpoint, http://minio-1616518256:9000
  46. 2021-03-25 09:24:06,643 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.savepoint.ignore-unclaimed-state, false
  47. 2021-03-25 09:24:06,643 WARN org.apache.flink.configuration.GlobalConfiguration [] - Error while trying to split key and value in configuration file /opt/flink/conf/flink-conf.yaml:11: "$internal.application.program-args: "
  48. 2021-03-25 09:24:06,643 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.container.image, localhost:5000/user-profile/batch-flink-app-v3:latest
  49. 2021-03-25 09:24:06,643 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: parallelism.default, 1
  50. 2021-03-25 09:24:06,644 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.ssl.enabled, false
  51. 2021-03-25 09:24:06,644 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1
  52. 2021-03-25 09:24:06,644 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.rest-service.exposed.type, NodePort
  53. 2021-03-25 09:24:06,644 WARN org.apache.flink.configuration.GlobalConfiguration [] - Error while trying to split key and value in configuration file /opt/flink/conf/flink-conf.yaml:17: "pipeline.classpaths: "
  54. 2021-03-25 09:24:06,644 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.jobmanager.port, 6123
  55. 2021-03-25 09:24:06,645 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.path-style-access, true
  56. 2021-03-25 09:24:06,645 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.process.size, 1728m
  57. 2021-03-25 09:24:06,645 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.archive.fs.dir, s3://flink/completed-jobs
  58. 2021-03-25 09:24:06,645 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.internal.jobmanager.entrypoint.class, org.apache.flink.kubernetes.entrypoint.KubernetesApplicationClusterEntrypoint
  59. 2021-03-25 09:24:06,645 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.target, kubernetes-application
  60. 2021-03-25 09:24:06,645 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.memory.process.size, 1600m
  61. 2021-03-25 09:24:06,646 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123
  62. 2021-03-25 09:24:06,646 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.rpc.port, 6122
  63. 2021-03-25 09:24:06,646 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.access-key, myaccesskey
  64. 2021-03-25 09:24:06,646 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.attached, true
  65. 2021-03-25 09:24:06,647 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.cluster.execution-mode, NORMAL
  66. 2021-03-25 09:24:06,647 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability, org.apache.flink.kubernetes.highavailability.KubernetesHaServicesFactory
  67. 2021-03-25 09:24:06,647 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.shutdown-on-attached-exit, false
  68. 2021-03-25 09:24:06,647 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: pipeline.jars, local:///opt/flink/usrlib/wordcount.jar
  69. 2021-03-25 09:24:06,799 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting KubernetesApplicationClusterEntrypoint.
  70. 2021-03-25 09:24:06,834 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install default filesystem.
  71. 2021-03-25 09:24:06,838 INFO org.apache.flink.core.fs.FileSystem [] - Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available.
  72. 2021-03-25 09:24:06,941 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install security context.
  73. 2021-03-25 09:24:06,953 INFO org.apache.flink.runtime.security.modules.HadoopModuleFactory [] - Cannot create Hadoop Security Module because Hadoop cannot be found in the Classpath.
  74. 2021-03-25 09:24:06,959 INFO org.apache.flink.runtime.security.modules.JaasModule [] - Jaas file will be created as /tmp/jaas-2440697269095246749.conf.
  75. 2021-03-25 09:24:06,967 INFO org.apache.flink.runtime.security.contexts.HadoopSecurityContextFactory [] - Cannot install HadoopSecurityContext because Hadoop cannot be found in the Classpath.
  76. 2021-03-25 09:24:06,969 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Initializing cluster services.
  77. 2021-03-25 09:24:06,995 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to start actor system, external address 172.17.0.8:6123, bind address 0.0.0.0:6123.
  78. 2021-03-25 09:24:08,250 INFO akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started
  79. 2021-03-25 09:24:08,335 INFO akka.remote.Remoting [] - Starting remoting
  80. 2021-03-25 09:24:08,642 INFO akka.remote.Remoting [] - Remoting started; listening on addresses :[akka.tcp://flink@172.17.0.8:6123]
  81. 2021-03-25 09:24:08,831 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system started at akka.tcp://flink@172.17.0.8:6123
  82. 2021-03-25 09:24:10,966 INFO org.apache.flink.runtime.blob.FileSystemBlobStore [] - Creating highly available BLOB storage directory at s3://flink/flink-ha/batch-job-cluster/blob
  83. 2021-03-25 09:24:11,032 INFO org.apache.flink.runtime.blob.BlobServer [] - Created BLOB server storage directory /tmp/blobStore-96114486-7d64-458a-85a7-291631d37b93
  84. 2021-03-25 09:24:11,037 INFO org.apache.flink.runtime.blob.BlobServer [] - Started BLOB server at 0.0.0.0:6124 - max concurrent requests: 50 - max backlog: 1000
  85. 2021-03-25 09:24:11,051 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl [] - No metrics reporter configured, no metrics will be exposed/reported.
  86. 2021-03-25 09:24:11,056 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to start actor system, external address 172.17.0.8:0, bind address 0.0.0.0:0.
  87. 2021-03-25 09:24:11,125 INFO akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started
  88. 2021-03-25 09:24:11,130 INFO akka.remote.Remoting [] - Starting remoting
  89. 2021-03-25 09:24:11,143 INFO akka.remote.Remoting [] - Remoting started; listening on addresses :[akka.tcp://flink-metrics@172.17.0.8:46733]
  90. 2021-03-25 09:24:11,151 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system started at akka.tcp://flink-metrics@172.17.0.8:46733
  91. 2021-03-25 09:24:11,227 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/rpc/MetricQueryService .
  92. 2021-03-25 09:24:11,345 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Upload directory /tmp/flink-web-9ff1cf8c-3776-43c9-bb78-9942358ac81c/flink-web-upload does not exist.
  93. 2021-03-25 09:24:11,346 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Created directory /tmp/flink-web-9ff1cf8c-3776-43c9-bb78-9942358ac81c/flink-web-upload for file uploads.
  94. 2021-03-25 09:24:11,371 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Starting rest endpoint.
  95. 2021-03-25 09:24:11,689 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined location of main cluster component log file: /opt/flink/log/jobmanager.log
  96. 2021-03-25 09:24:11,689 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined location of main cluster component stdout file: /opt/flink/log/jobmanager.out
  97. 2021-03-25 09:24:11,934 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Rest endpoint listening at 172.17.0.8:8081
  98. 2021-03-25 09:24:12,285 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesLeaderElector [] - Create KubernetesLeaderElector batch-job-cluster-restserver-leader with lock identity 358df63e-186e-4ee0-9e3e-e0afe283dd29.
  99. 2021-03-25 09:24:13,041 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesLeaderElector [] - New leader elected 358df63e-186e-4ee0-9e3e-e0afe283dd29 for batch-job-cluster-restserver-leader.
  100. 2021-03-25 09:24:13,059 INFO org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] - Starting DefaultLeaderElectionService with KubernetesLeaderElectionDriver{configMapName='batch-job-cluster-restserver-leader'}.
  101. 2021-03-25 09:24:13,063 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Web frontend listening at http://172.17.0.8:8081.
  102. 2021-03-25 09:24:13,064 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - http://172.17.0.8:8081 was granted leadership with leaderSessionID=b2a3e825-b8de-4970-9305-a8c8031ea08a
  103. 2021-03-25 09:24:13,137 INFO org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils [] - The derived from fraction jvm overhead memory (172.800mb (181193935 bytes)) is less than its min value 192.000mb (201326592 bytes), min value will be used instead
  104. 2021-03-25 09:24:13,164 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: blob.server.port, 6124
  105. 2021-03-25 09:24:13,165 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.execution.failover-strategy, region
  106. 2021-03-25 09:24:13,166 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.cluster-id, batch-job-cluster
  107. 2021-03-25 09:24:13,166 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.address, localhost
  108. 2021-03-25 09:24:13,168 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.service-account, flink-service-account
  109. 2021-03-25 09:24:13,171 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.cluster-id, batch-job-cluster
  110. 2021-03-25 09:24:13,171 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.secret-key, ******
  111. 2021-03-25 09:24:13,172 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.storageDir, s3://flink/flink-ha
  112. 2021-03-25 09:24:13,172 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.endpoint, http://minio-1616518256:9000
  113. 2021-03-25 09:24:13,172 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.savepoint.ignore-unclaimed-state, false
  114. 2021-03-25 09:24:13,173 WARN org.apache.flink.configuration.GlobalConfiguration [] - Error while trying to split key and value in configuration file /opt/flink/conf/flink-conf.yaml:11: "$internal.application.program-args: "
  115. 2021-03-25 09:24:13,173 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.container.image, localhost:5000/user-profile/batch-flink-app-v3:latest
  116. 2021-03-25 09:24:13,173 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: parallelism.default, 1
  117. 2021-03-25 09:24:13,173 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.ssl.enabled, false
  118. 2021-03-25 09:24:13,224 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1
  119. 2021-03-25 09:24:13,225 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.rest-service.exposed.type, NodePort
  120. 2021-03-25 09:24:13,225 WARN org.apache.flink.configuration.GlobalConfiguration [] - Error while trying to split key and value in configuration file /opt/flink/conf/flink-conf.yaml:17: "pipeline.classpaths: "
  121. 2021-03-25 09:24:13,225 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.jobmanager.port, 6123
  122. 2021-03-25 09:24:13,226 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.path-style-access, true
  123. 2021-03-25 09:24:13,226 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.process.size, 1728m
  124. 2021-03-25 09:24:13,227 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.archive.fs.dir, s3://flink/completed-jobs
  125. 2021-03-25 09:24:13,227 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.internal.jobmanager.entrypoint.class, org.apache.flink.kubernetes.entrypoint.KubernetesApplicationClusterEntrypoint
  126. 2021-03-25 09:24:13,227 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.target, kubernetes-application
  127. 2021-03-25 09:24:13,228 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.memory.process.size, 1600m
  128. 2021-03-25 09:24:13,228 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123
  129. 2021-03-25 09:24:13,231 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.rpc.port, 6122
  130. 2021-03-25 09:24:13,231 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.access-key, myaccesskey
  131. 2021-03-25 09:24:13,232 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.attached, true
  132. 2021-03-25 09:24:13,233 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.cluster.execution-mode, NORMAL
  133. 2021-03-25 09:24:13,233 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability, org.apache.flink.kubernetes.highavailability.KubernetesHaServicesFactory
  134. 2021-03-25 09:24:13,233 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.shutdown-on-attached-exit, false
  135. 2021-03-25 09:24:13,234 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: pipeline.jars, local:///opt/flink/usrlib/wordcount.jar
  136. 2021-03-25 09:24:13,254 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager at akka://flink/user/rpc/resourcemanager_0 .
  137. 2021-03-25 09:24:13,280 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesLeaderElector [] - Create KubernetesLeaderElector batch-job-cluster-dispatcher-leader with lock identity 358df63e-186e-4ee0-9e3e-e0afe283dd29.
  138. 2021-03-25 09:24:13,338 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesLeaderElector [] - New leader elected 358df63e-186e-4ee0-9e3e-e0afe283dd29 for batch-job-cluster-dispatcher-leader.
  139. 2021-03-25 09:24:13,389 INFO org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] - Starting DefaultLeaderElectionService with KubernetesLeaderElectionDriver{configMapName='batch-job-cluster-dispatcher-leader'}.
  140. 2021-03-25 09:24:13,430 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Start SessionDispatcherLeaderProcess.
  141. 2021-03-25 09:24:13,436 INFO org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] - Starting DefaultLeaderRetrievalService with KubernetesLeaderRetrievalDriver{configMapName='batch-job-cluster-resourcemanager-leader'}.
  142. 2021-03-25 09:24:13,441 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Recover all persisted job graphs.
  143. 2021-03-25 09:24:13,525 INFO org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] - Starting DefaultLeaderRetrievalService with KubernetesLeaderRetrievalDriver{configMapName='batch-job-cluster-dispatcher-leader'}.
  144. 2021-03-25 09:24:13,539 INFO org.apache.flink.runtime.jobmanager.DefaultJobGraphStore [] - Retrieved job ids [] from KubernetesStateHandleStore{configMapName='batch-job-cluster-dispatcher-leader'}
  145. 2021-03-25 09:24:13,539 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Successfully recovered 0 persisted job graphs.
  146. 2021-03-25 09:24:13,570 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at akka://flink/user/rpc/dispatcher_1 .
  147. 2021-03-25 09:24:13,753 INFO org.apache.flink.client.ClientUtils [] - Starting program (detached: false)
  148. Executing WordCount example with default input data set.
  149. Use --input to specify file input.
  150. Printing result to stdout. Use --output to specify output path.
  151. 2021-03-25 09:24:14,243 INFO org.apache.flink.api.java.utils.PlanGenerator [] - The job has 0 registered types and 0 default Kryo serializers
  152. 2021-03-25 09:24:14,351 INFO org.apache.flink.kubernetes.KubernetesResourceManagerDriver [] - Recovered 0 pods from previous attempts, current attempt id is 1.
  153. 2021-03-25 09:24:14,351 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Recovered 0 workers from previous attempt.
  154. 2021-03-25 09:24:14,353 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesLeaderElector [] - Create KubernetesLeaderElector batch-job-cluster-resourcemanager-leader with lock identity 358df63e-186e-4ee0-9e3e-e0afe283dd29.
  155. 2021-03-25 09:24:14,440 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesLeaderElector [] - New leader elected 358df63e-186e-4ee0-9e3e-e0afe283dd29 for batch-job-cluster-resourcemanager-leader.
  156. 2021-03-25 09:24:14,444 INFO org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] - Starting DefaultLeaderElectionService with KubernetesLeaderElectionDriver{configMapName='batch-job-cluster-resourcemanager-leader'}.
  157. 2021-03-25 09:24:14,527 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - ResourceManager akka.tcp://flink@172.17.0.8:6123/user/rpc/resourcemanager_0 was granted leadership with fencing token 86e4ef60432360bdc00c1c32094d4583
  158. 2021-03-25 09:24:14,543 INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl [] - Starting the SlotManager.
  159. 2021-03-25 09:24:14,569 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: blob.server.port, 6124
  160. 2021-03-25 09:24:14,569 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.execution.failover-strategy, region
  161. 2021-03-25 09:24:14,569 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.cluster-id, batch-job-cluster
  162. 2021-03-25 09:24:14,569 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.address, localhost
  163. 2021-03-25 09:24:14,570 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.service-account, flink-service-account
  164. 2021-03-25 09:24:14,570 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.cluster-id, batch-job-cluster
  165. 2021-03-25 09:24:14,570 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.secret-key, ******
  166. 2021-03-25 09:24:14,570 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.storageDir, s3://flink/flink-ha
  167. 2021-03-25 09:24:14,570 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.endpoint, http://minio-1616518256:9000
  168. 2021-03-25 09:24:14,571 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.savepoint.ignore-unclaimed-state, false
  169. 2021-03-25 09:24:14,571 WARN org.apache.flink.configuration.GlobalConfiguration [] - Error while trying to split key and value in configuration file /opt/flink/conf/flink-conf.yaml:11: "$internal.application.program-args: "
  170. 2021-03-25 09:24:14,571 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.container.image, localhost:5000/user-profile/batch-flink-app-v3:latest
  171. 2021-03-25 09:24:14,571 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: parallelism.default, 1
  172. 2021-03-25 09:24:14,571 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.ssl.enabled, false
  173. 2021-03-25 09:24:14,572 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1
  174. 2021-03-25 09:24:14,572 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.rest-service.exposed.type, NodePort
  175. 2021-03-25 09:24:14,572 WARN org.apache.flink.configuration.GlobalConfiguration [] - Error while trying to split key and value in configuration file /opt/flink/conf/flink-conf.yaml:17: "pipeline.classpaths: "
  176. 2021-03-25 09:24:14,572 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.jobmanager.port, 6123
  177. 2021-03-25 09:24:14,573 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.path-style-access, true
  178. 2021-03-25 09:24:14,573 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.process.size, 1728m
  179. 2021-03-25 09:24:14,573 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.archive.fs.dir, s3://flink/completed-jobs
  180. 2021-03-25 09:24:14,573 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.internal.jobmanager.entrypoint.class, org.apache.flink.kubernetes.entrypoint.KubernetesApplicationClusterEntrypoint
  181. 2021-03-25 09:24:14,573 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.target, kubernetes-application
  182. 2021-03-25 09:24:14,574 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.memory.process.size, 1600m
  183. 2021-03-25 09:24:14,574 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123
  184. 2021-03-25 09:24:14,574 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.rpc.port, 6122
  185. 2021-03-25 09:24:14,574 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.access-key, myaccesskey
  186. 2021-03-25 09:24:14,575 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.attached, true
  187. 2021-03-25 09:24:14,575 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.cluster.execution-mode, NORMAL
  188. 2021-03-25 09:24:14,576 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability, org.apache.flink.kubernetes.highavailability.KubernetesHaServicesFactory
  189. 2021-03-25 09:24:14,577 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.shutdown-on-attached-exit, false
  190. 2021-03-25 09:24:14,577 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: pipeline.jars, local:///opt/flink/usrlib/wordcount.jar
  191. 2021-03-25 09:24:14,693 INFO org.apache.flink.client.deployment.application.executors.EmbeddedExecutor [] - Job 00000000000000000000000000000000 is submitted.
  192. 2021-03-25 09:24:14,693 INFO org.apache.flink.client.deployment.application.executors.EmbeddedExecutor [] - Submitting Job with JobId=00000000000000000000000000000000.
  193. 2021-03-25 09:24:14,771 WARN com.amazonaws.services.s3.internal.Mimetypes [] - Unable to find 'mime.types' file in classpath
  194. 2021-03-25 09:24:15,028 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Received JobGraph submission 00000000000000000000000000000000 (Flink Java Job at Thu Mar 25 09:24:14 UTC 2021).
  195. 2021-03-25 09:24:15,038 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Submitting job 00000000000000000000000000000000 (Flink Java Job at Thu Mar 25 09:24:14 UTC 2021).
  196. 2021-03-25 09:24:15,251 INFO org.apache.flink.runtime.jobmanager.DefaultJobGraphStore [] - Added JobGraph(jobId: 00000000000000000000000000000000) to KubernetesStateHandleStore{configMapName='batch-job-cluster-dispatcher-leader'}.
  197. 2021-03-25 09:24:15,325 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesLeaderElector [] - Create KubernetesLeaderElector batch-job-cluster-00000000000000000000000000000000-jobmanager-leader with lock identity 358df63e-186e-4ee0-9e3e-e0afe283dd29.
  198. 2021-03-25 09:24:15,341 INFO org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] - Starting DefaultLeaderElectionService with KubernetesLeaderElectionDriver{configMapName='batch-job-cluster-00000000000000000000000000000000-jobmanager-leader'}.
  199. 2021-03-25 09:24:15,345 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesLeaderElector [] - New leader elected 358df63e-186e-4ee0-9e3e-e0afe283dd29 for batch-job-cluster-00000000000000000000000000000000-jobmanager-leader.
  200. 2021-03-25 09:24:15,359 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at akka://flink/user/rpc/jobmanager_2 .
  201. 2021-03-25 09:24:15,431 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Initializing job Flink Java Job at Thu Mar 25 09:24:14 UTC 2021 (00000000000000000000000000000000).
  202. 2021-03-25 09:24:15,463 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using restart back off time strategy NoRestartBackoffTimeStrategy for Flink Java Job at Thu Mar 25 09:24:14 UTC 2021 (00000000000000000000000000000000).
  203. 2021-03-25 09:24:15,557 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Running initialization on master for job Flink Java Job at Thu Mar 25 09:24:14 UTC 2021 (00000000000000000000000000000000).
  204. 2021-03-25 09:24:15,565 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Successfully ran initialization on master in 7 ms.
  205. 2021-03-25 09:24:15,590 INFO org.apache.flink.runtime.scheduler.adapter.DefaultExecutionTopology [] - Built 1 pipelined regions in 3 ms
  206. 2021-03-25 09:24:15,598 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using failover strategy org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy@5bdc3b50 for Flink Java Job at Thu Mar 25 09:24:14 UTC 2021 (00000000000000000000000000000000).
  207. 2021-03-25 09:24:15,634 INFO org.apache.flink.runtime.jobmaster.JobManagerRunnerImpl [] - JobManager runner for job Flink Java Job at Thu Mar 25 09:24:14 UTC 2021 (00000000000000000000000000000000) was granted leadership with session id 96e79205-a6eb-4b93-a594-fce3d134fc17 at akka.tcp://flink@172.17.0.8:6123/user/rpc/jobmanager_2.
  208. 2021-03-25 09:24:15,654 INFO org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] - Starting DefaultLeaderRetrievalService with KubernetesLeaderRetrievalDriver{configMapName='batch-job-cluster-resourcemanager-leader'}.
  209. 2021-03-25 09:24:15,654 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Starting execution of job Flink Java Job at Thu Mar 25 09:24:14 UTC 2021 (00000000000000000000000000000000) under job master id a594fce3d134fc1796e79205a6eb4b93.
  210. 2021-03-25 09:24:15,662 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
  211. 2021-03-25 09:24:15,663 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job Flink Java Job at Thu Mar 25 09:24:14 UTC 2021 (00000000000000000000000000000000) switched from state CREATED to RUNNING.
  212. 2021-03-25 09:24:15,675 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - CHAIN DataSource (at getDefaultTextLineDataSet(WordCountData.java:70) (org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at main(WordCount.java:84)) -> Combine (SUM(1), at main(WordCount.java:87) (1/1) (9242b0cd15ae05fdb12c7934e798bfdc) switched from CREATED to SCHEDULED.
  213. 2021-03-25 09:24:15,675 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Reduce (SUM(1), at main(WordCount.java:87) (1/1) (0bcce5990337b0ef18f99fd288d6b188) switched from CREATED to SCHEDULED.
  214. 2021-03-25 09:24:15,675 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - DataSink (collect()) (1/1) (e7751b79347225bbecbd3d4e65bad1d7) switched from CREATED to SCHEDULED.
  215. 2021-03-25 09:24:15,739 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{7984b2630db0b61cadeac3dc19d86e24}]
  216. 2021-03-25 09:24:19,468 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Connecting to ResourceManager akka.tcp://flink@172.17.0.8:6123/user/rpc/resourcemanager_0(86e4ef60432360bdc00c1c32094d4583)
  217. 2021-03-25 09:24:19,477 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Resolved ResourceManager address, beginning registration
  218. 2021-03-25 09:24:19,484 INFO org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] - Starting DefaultLeaderRetrievalService with KubernetesLeaderRetrievalDriver{configMapName='batch-job-cluster-00000000000000000000000000000000-jobmanager-leader'}.
  219. 2021-03-25 09:24:19,484 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Registering job manager a594fce3d134fc1796e79205a6eb4b93@akka.tcp://flink@172.17.0.8:6123/user/rpc/jobmanager_2 for job 00000000000000000000000000000000.
  220. 2021-03-25 09:24:19,597 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Registering job manager a594fce3d134fc1796e79205a6eb4b93@akka.tcp://flink@172.17.0.8:6123/user/rpc/jobmanager_2 for job 00000000000000000000000000000000.
  221. 2021-03-25 09:24:19,817 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Registering job manager a594fce3d134fc1796e79205a6eb4b93@akka.tcp://flink@172.17.0.8:6123/user/rpc/jobmanager_2 for job 00000000000000000000000000000000.
  222. 2021-03-25 09:24:20,235 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Registering job manager a594fce3d134fc1796e79205a6eb4b93@akka.tcp://flink@172.17.0.8:6123/user/rpc/jobmanager_2 for job 00000000000000000000000000000000.
  223. 2021-03-25 09:24:20,410 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Registered job manager a594fce3d134fc1796e79205a6eb4b93@akka.tcp://flink@172.17.0.8:6123/user/rpc/jobmanager_2 for job 00000000000000000000000000000000.
  224. 2021-03-25 09:24:20,414 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Registered job manager a594fce3d134fc1796e79205a6eb4b93@akka.tcp://flink@172.17.0.8:6123/user/rpc/jobmanager_2 for job 00000000000000000000000000000000.
  225. 2021-03-25 09:24:20,415 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Registered job manager a594fce3d134fc1796e79205a6eb4b93@akka.tcp://flink@172.17.0.8:6123/user/rpc/jobmanager_2 for job 00000000000000000000000000000000.
  226. 2021-03-25 09:24:20,415 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Registered job manager a594fce3d134fc1796e79205a6eb4b93@akka.tcp://flink@172.17.0.8:6123/user/rpc/jobmanager_2 for job 00000000000000000000000000000000.
  227. 2021-03-25 09:24:20,417 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - JobManager successfully registered at ResourceManager, leader id: 86e4ef60432360bdc00c1c32094d4583.
  228. 2021-03-25 09:24:20,423 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{7984b2630db0b61cadeac3dc19d86e24}] and profile ResourceProfile{UNKNOWN} with allocation id f288acf24cb2ce09d7693e8e56bb3f08 from resource manager.
  229. 2021-03-25 09:24:20,425 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 00000000000000000000000000000000 with allocation id f288acf24cb2ce09d7693e8e56bb3f08.
  230. 2021-03-25 09:24:20,434 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Requesting new worker with resource spec WorkerResourceSpec {cpuCores=1.0, taskHeapSize=384.000mb (402653174 bytes), taskOffHeapSize=0 bytes, networkMemSize=128.000mb (134217730 bytes), managedMemSize=512.000mb (536870920 bytes)}, current pending count: 1.
  231. 2021-03-25 09:24:20,441 INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: []
  232. 2021-03-25 09:24:20,542 INFO org.apache.flink.kubernetes.KubernetesResourceManagerDriver [] - Creating new TaskManager pod with name batch-job-cluster-taskmanager-1-1 and resource <1728,1.0>.
  233. 2021-03-25 09:24:20,662 INFO org.apache.flink.kubernetes.KubernetesResourceManagerDriver [] - Pod batch-job-cluster-taskmanager-1-1 is created.
  234. 2021-03-25 09:24:20,665 INFO org.apache.flink.kubernetes.KubernetesResourceManagerDriver [] - Received new TaskManager pod: batch-job-cluster-taskmanager-1-1
  235. 2021-03-25 09:24:20,666 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Requested worker batch-job-cluster-taskmanager-1-1 with resource spec WorkerResourceSpec {cpuCores=1.0, taskHeapSize=384.000mb (402653174 bytes), taskOffHeapSize=0 bytes, networkMemSize=128.000mb (134217730 bytes), managedMemSize=512.000mb (536870920 bytes)}.
  236. 2021-03-25 09:24:34,791 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Registering TaskManager with ResourceID batch-job-cluster-taskmanager-1-1 (akka.tcp://flink@172.17.0.7:6122/user/rpc/taskmanager_0) at ResourceManager
  237. 2021-03-25 09:24:34,819 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Worker batch-job-cluster-taskmanager-1-1 is registered.
  238. 2021-03-25 09:24:34,822 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Worker batch-job-cluster-taskmanager-1-1 with resource spec WorkerResourceSpec {cpuCores=1.0, taskHeapSize=384.000mb (402653174 bytes), taskOffHeapSize=0 bytes, networkMemSize=128.000mb (134217730 bytes), managedMemSize=512.000mb (536870920 bytes)} was requested in current attempt. Current pending count after registering: 0.
  239. 2021-03-25 09:24:35,396 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - CHAIN DataSource (at getDefaultTextLineDataSet(WordCountData.java:70) (org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at main(WordCount.java:84)) -> Combine (SUM(1), at main(WordCount.java:87) (1/1) (9242b0cd15ae05fdb12c7934e798bfdc) switched from SCHEDULED to DEPLOYING.
  240. 2021-03-25 09:24:35,401 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying CHAIN DataSource (at getDefaultTextLineDataSet(WordCountData.java:70) (org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at main(WordCount.java:84)) -> Combine (SUM(1), at main(WordCount.java:87) (1/1) (attempt #0) with attempt id 9242b0cd15ae05fdb12c7934e798bfdc to batch-job-cluster-taskmanager-1-1 @ 172.17.0.7 (dataPort=39439) with allocation id f288acf24cb2ce09d7693e8e56bb3f08
  241. 2021-03-25 09:24:35,409 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Reduce (SUM(1), at main(WordCount.java:87) (1/1) (0bcce5990337b0ef18f99fd288d6b188) switched from SCHEDULED to DEPLOYING.
  242. 2021-03-25 09:24:35,409 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying Reduce (SUM(1), at main(WordCount.java:87) (1/1) (attempt #0) with attempt id 0bcce5990337b0ef18f99fd288d6b188 to batch-job-cluster-taskmanager-1-1 @ 172.17.0.7 (dataPort=39439) with allocation id f288acf24cb2ce09d7693e8e56bb3f08
  243. 2021-03-25 09:24:35,410 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - DataSink (collect()) (1/1) (e7751b79347225bbecbd3d4e65bad1d7) switched from SCHEDULED to DEPLOYING.
  244. 2021-03-25 09:24:35,410 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying DataSink (collect()) (1/1) (attempt #0) with attempt id e7751b79347225bbecbd3d4e65bad1d7 to batch-job-cluster-taskmanager-1-1 @ 172.17.0.7 (dataPort=39439) with allocation id f288acf24cb2ce09d7693e8e56bb3f08
  245. 2021-03-25 09:24:35,942 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - DataSink (collect()) (1/1) (e7751b79347225bbecbd3d4e65bad1d7) switched from DEPLOYING to RUNNING.
  246. 2021-03-25 09:24:35,944 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - CHAIN DataSource (at getDefaultTextLineDataSet(WordCountData.java:70) (org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at main(WordCount.java:84)) -> Combine (SUM(1), at main(WordCount.java:87) (1/1) (9242b0cd15ae05fdb12c7934e798bfdc) switched from DEPLOYING to RUNNING.
  247. 2021-03-25 09:24:35,992 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Reduce (SUM(1), at main(WordCount.java:87) (1/1) (0bcce5990337b0ef18f99fd288d6b188) switched from DEPLOYING to RUNNING.
  248. 2021-03-25 09:24:36,293 WARN org.apache.flink.runtime.taskmanager.TaskManagerLocation [] - No hostname could be resolved for the IP address 172.17.0.7, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
  249. 2021-03-25 09:24:36,419 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - CHAIN DataSource (at getDefaultTextLineDataSet(WordCountData.java:70) (org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at main(WordCount.java:84)) -> Combine (SUM(1), at main(WordCount.java:87) (1/1) (9242b0cd15ae05fdb12c7934e798bfdc) switched from RUNNING to FINISHED.
  250. 2021-03-25 09:24:36,439 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Reduce (SUM(1), at main(WordCount.java:87) (1/1) (0bcce5990337b0ef18f99fd288d6b188) switched from RUNNING to FINISHED.
  251. 2021-03-25 09:24:36,495 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - DataSink (collect()) (1/1) (e7751b79347225bbecbd3d4e65bad1d7) switched from RUNNING to FINISHED.
  252. 2021-03-25 09:24:36,505 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job Flink Java Job at Thu Mar 25 09:24:14 UTC 2021 (00000000000000000000000000000000) switched from state RUNNING to FINISHED.
  253. 2021-03-25 09:24:36,531 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Job 00000000000000000000000000000000 reached globally terminal state FINISHED.
  254. 2021-03-25 09:24:36,534 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Stopping the JobMaster for job Flink Java Job at Thu Mar 25 09:24:14 UTC 2021(00000000000000000000000000000000).
  255. 2021-03-25 09:24:36,535 INFO org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] - Stopping DefaultLeaderRetrievalService.
  256. 2021-03-25 09:24:36,535 INFO org.apache.flink.kubernetes.highavailability.KubernetesLeaderRetrievalDriver [] - Stopping KubernetesLeaderRetrievalDriver{configMapName='batch-job-cluster-resourcemanager-leader'}.
  257. 2021-03-25 09:24:36,535 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesConfigMapWatcher [] - The watcher is closing.
  258. 2021-03-25 09:24:36,602 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Suspending SlotPool.
  259. 2021-03-25 09:24:36,603 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Close ResourceManager connection 2781e02e4b2a29071ae304ac0e2d9e62: Stopping JobMaster for job Flink Java Job at Thu Mar 25 09:24:14 UTC 2021(00000000000000000000000000000000)..
  260. Program execution finished
  261. Job with JobID 00000000000000000000000000000000 has finished.
  262. Job Runtime: 21254 ms
  263. Accumulator Results:
  264. - 9dbb8f7814768bce4b3501439848d5e6 (java.util.ArrayList) [170 elements]
  265.  
  266.  
  267. (a,5)
  268. (action,1)
  269. (after,1)
  270. (against,1)
  271. (all,2)
  272. (and,12)
  273. (arms,1)
  274. (arrows,1)
  275. (awry,1)
  276. (ay,1)
  277. (bare,1)
  278. (be,4)
  279. (bear,3)
  280. (bodkin,1)
  281. (bourn,1)
  282. (but,1)
  283. (by,2)
  284. (calamity,1)
  285. (cast,1)
  286. (coil,1)
  287. (come,1)
  288. (conscience,1)
  289. (consummation,1)
  290. (contumely,1)
  291. (country,1)
  292. (cowards,1)
  293. (currents,1)
  294. (d,4)
  295. (death,2)
  296. (delay,1)
  297. (despis,1)
  298. (devoutly,1)
  299. (die,2)
  300. (does,1)
  301. (dread,1)
  302. (dream,1)
  303. (dreams,1)
  304. (end,2)
  305. (enterprises,1)
  306. (er,1)
  307. (fair,1)
  308. (fardels,1)
  309. (flesh,1)
  310. (fly,1)
  311. (for,2)
  312. (fortune,1)
  313. (from,1)
  314. (give,1)
  315. (great,1)
  316. (grunt,1)
  317. (have,2)
  318. (he,1)
  319. (heartache,1)
  320. (heir,1)
  321. (himself,1)
  322. (his,1)
  323. (hue,1)
  324. (ills,1)
  325. (in,3)
  326. (insolence,1)
  327. (is,3)
  328. (know,1)
  329. (law,1)
  330. (life,2)
  331. (long,1)
  332. (lose,1)
  333. (love,1)
  334. (make,2)
  335. (makes,2)
  336. (man,1)
  337. (may,1)
  338. (merit,1)
  339. (might,1)
  340. (mind,1)
  341. (moment,1)
  342. (more,1)
  343. (mortal,1)
  344. (must,1)
  345. (my,1)
  346. (name,1)
  347. (native,1)
  348. (natural,1)
  349. (no,2)
  350. (nobler,1)
  351. (not,2)
  352. (now,1)
  353. (nymph,1)
  354. (o,1)
  355. (of,15)
  356. (off,1)
  357. (office,1)
  358. (ophelia,1)
  359. (opposing,1)
  360. (oppressor,1)
  361. (or,2)
  362. (orisons,1)
  363. (others,1)
  364. (outrageous,1)
  365. (pale,1)
  366. (pangs,1)
  367. (patient,1)
  368. (pause,1)
  369. (perchance,1)
  370. (pith,1)
  371. (proud,1)
  372. (puzzles,1)
  373. (question,1)
  374. (quietus,1)
  375. (rather,1)
  376. (regard,1)
  377. (remember,1)
  378. (resolution,1)
  379. (respect,1)
  380. (returns,1)
  381. (rub,1)
  382. (s,5)
  383. (say,1)
  384. (scorns,1)
  385. (sea,1)
  386. (shocks,1)
  387. (shuffled,1)
  388. (sicklied,1)
  389. (sins,1)
  390. (sleep,5)
  391. (slings,1)
  392. (so,1)
  393. (soft,1)
  394. (something,1)
  395. (spurns,1)
  396. (suffer,1)
  397. (sweat,1)
  398. (take,1)
  399. (takes,1)
  400. (than,1)
  401. (that,7)
  402. (the,22)
  403. (their,1)
  404. (them,1)
  405. (there,2)
  406. (these,1)
  407. (this,2)
  408. (those,1)
  409. (thought,1)
  410. (thousand,1)
  411. (thus,2)
  412. (thy,1)
  413. (time,1)
  414. (tis,2)
  415. (to,15)
  416. (traveller,1)
  417. (troubles,1)
  418. (turn,1)
  419. (under,1)
  420. (undiscover,1)
  421. (unworthy,1)
  422. (us,3)
  423. (we,4)
  424. (weary,1)
  425. (what,1)
  426. (when,2)
  427. (whether,1)
  428. (whips,1)
  429. (who,2)
  430. (whose,1)
  431. (will,1)
  432. (wish,1)
  433. (with,3)
  434. (would,2)
  435. (wrong,1)
  436. (you,1)
  437. 2021-03-25 09:24:36,613 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Stopping SlotPool.
  438. 2021-03-25 09:24:36,613 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Disconnect job manager a594fce3d134fc1796e79205a6eb4b93@akka.tcp://flink@172.17.0.8:6123/user/rpc/jobmanager_2 for job 00000000000000000000000000000000 from the resource manager.
  439. 2021-03-25 09:24:36,614 INFO org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap [] - Application completed SUCCESSFULLY
  440. 2021-03-25 09:24:36,614 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Shutting KubernetesApplicationClusterEntrypoint down with application status SUCCEEDED. Diagnostics null.
  441. 2021-03-25 09:24:36,614 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Shutting down rest endpoint.
  442. 2021-03-25 09:24:36,627 INFO org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] - Stopping DefaultLeaderElectionService.
  443. 2021-03-25 09:24:36,630 INFO org.apache.flink.kubernetes.highavailability.KubernetesLeaderElectionDriver [] - Closing KubernetesLeaderElectionDriver{configMapName='batch-job-cluster-00000000000000000000000000000000-jobmanager-leader'}.
  444. 2021-03-25 09:24:36,631 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesConfigMapWatcher [] - The watcher is closing.
  445. 2021-03-25 09:24:36,791 INFO org.apache.flink.runtime.jobmanager.DefaultJobGraphStore [] - Removed job graph 00000000000000000000000000000000 from KubernetesStateHandleStore{configMapName='batch-job-cluster-dispatcher-leader'}.
  446. 2021-03-25 09:24:36,830 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Removing cache directory /tmp/flink-web-9ff1cf8c-3776-43c9-bb78-9942358ac81c/flink-web-ui
  447. 2021-03-25 09:24:36,832 INFO org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] - Stopping DefaultLeaderElectionService.
  448. 2021-03-25 09:24:36,833 INFO org.apache.flink.kubernetes.highavailability.KubernetesLeaderElectionDriver [] - Closing KubernetesLeaderElectionDriver{configMapName='batch-job-cluster-restserver-leader'}.
  449. 2021-03-25 09:24:36,837 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesConfigMapWatcher [] - The watcher is closing.
  450. 2021-03-25 09:24:36,844 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Shut down complete.
  451. 2021-03-25 09:24:36,892 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Shut down cluster because application is in SUCCEEDED, diagnostics null.
  452. 2021-03-25 09:24:36,892 INFO org.apache.flink.kubernetes.KubernetesResourceManagerDriver [] - Deregistering Flink Kubernetes cluster, clusterId: batch-job-cluster, diagnostics:
  453. 2021-03-25 09:24:36,924 INFO org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent [] - Closing components.
  454. 2021-03-25 09:24:36,924 INFO org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] - Stopping DefaultLeaderRetrievalService.
  455. 2021-03-25 09:24:36,924 INFO org.apache.flink.kubernetes.highavailability.KubernetesLeaderRetrievalDriver [] - Stopping KubernetesLeaderRetrievalDriver{configMapName='batch-job-cluster-dispatcher-leader'}.
  456. 2021-03-25 09:24:36,924 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesConfigMapWatcher [] - The watcher is closing.
  457. 2021-03-25 09:24:36,924 INFO org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] - Stopping DefaultLeaderRetrievalService.
  458. 2021-03-25 09:24:36,924 INFO org.apache.flink.kubernetes.highavailability.KubernetesLeaderRetrievalDriver [] - Stopping KubernetesLeaderRetrievalDriver{configMapName='batch-job-cluster-resourcemanager-leader'}.
  459. 2021-03-25 09:24:36,925 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesConfigMapWatcher [] - The watcher is closing.
  460. 2021-03-25 09:24:36,925 INFO org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] - Stopping DefaultLeaderElectionService.
  461. 2021-03-25 09:24:36,930 INFO org.apache.flink.kubernetes.highavailability.KubernetesLeaderElectionDriver [] - Closing KubernetesLeaderElectionDriver{configMapName='batch-job-cluster-dispatcher-leader'}.
  462. 2021-03-25 09:24:36,939 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesConfigMapWatcher [] - The watcher is closing.
  463. 2021-03-25 09:24:36,949 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Stopping SessionDispatcherLeaderProcess.
  464. 2021-03-25 09:24:36,992 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Stopping dispatcher akka.tcp://flink@172.17.0.8:6123/user/rpc/dispatcher_1.
  465. 2021-03-25 09:24:36,992 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Stopping all currently running jobs of dispatcher akka.tcp://flink@172.17.0.8:6123/user/rpc/dispatcher_1.
  466. 2021-03-25 09:24:36,993 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - The watcher is closing.
  467. 2021-03-25 09:24:37,000 INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl [] - Closing the SlotManager.
  468. 2021-03-25 09:24:37,001 INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl [] - Suspending the SlotManager.
  469. 2021-03-25 09:24:37,003 INFO org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] - Stopping DefaultLeaderElectionService.
  470. 2021-03-25 09:24:37,003 INFO org.apache.flink.kubernetes.highavailability.KubernetesLeaderElectionDriver [] - Closing KubernetesLeaderElectionDriver{configMapName='batch-job-cluster-resourcemanager-leader'}.
  471. 2021-03-25 09:24:37,003 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesConfigMapWatcher [] - The watcher is closing.
  472. 2021-03-25 09:24:37,008 INFO org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] - Stopping DefaultLeaderRetrievalService.
  473. 2021-03-25 09:24:37,010 INFO org.apache.flink.kubernetes.highavailability.KubernetesLeaderRetrievalDriver [] - Stopping KubernetesLeaderRetrievalDriver{configMapName='batch-job-cluster-00000000000000000000000000000000-jobmanager-leader'}.
  474. 2021-03-25 09:24:37,011 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesConfigMapWatcher [] - The watcher is closing.
  475. 2021-03-25 09:24:37,098 INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.BackPressureRequestCoordinator [] - Shutting down back pressure request coordinator.
  476. 2021-03-25 09:24:37,099 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Stopped dispatcher akka.tcp://flink@172.17.0.8:6123/user/rpc/dispatcher_1.
  477. 2021-03-25 09:24:37,105 INFO org.apache.flink.runtime.jobmanager.DefaultJobGraphStore [] - Stopping DefaultJobGraphStore.
  478. 2021-03-25 09:24:37,106 INFO org.apache.flink.runtime.blob.BlobServer [] - Stopped BLOB server at 0.0.0.0:6124
  479. 2021-03-25 09:24:37,108 INFO org.apache.flink.kubernetes.highavailability.KubernetesHaServices [] - Close and clean up all data for KubernetesHaServices.
  480. 2021-03-25 09:24:37,222 INFO org.apache.flink.kubernetes.highavailability.KubernetesHaServices [] - Finished cleaning up the high availability data.
  481. 2021-03-25 09:24:37,224 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Stopping Akka RPC service.
  482. 2021-03-25 09:24:37,237 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Stopping Akka RPC service.
  483. 2021-03-25 09:24:37,307 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Shutting down remote daemon.
  484. 2021-03-25 09:24:37,310 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Shutting down remote daemon.
  485. 2021-03-25 09:24:37,311 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remote daemon shut down; proceeding with flushing remote transports.
  486. 2021-03-25 09:24:37,319 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remote daemon shut down; proceeding with flushing remote transports.
  487. 2021-03-25 09:24:37,329 INFO org.apache.flink.runtime.history.FsJobArchivist [] - Job 00000000000000000000000000000000 has been archived at s3://flink/completed-jobs/00000000000000000000000000000000.
  488. 2021-03-25 09:24:37,446 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remoting shut down.
  489. 2021-03-25 09:24:37,492 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remoting shut down.
  490. 2021-03-25 09:24:37,526 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Stopped Akka RPC service.
  491. 2021-03-25 09:24:37,592 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Stopped Akka RPC service.
  492. 2021-03-25 09:24:37,595 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Terminating cluster entrypoint process KubernetesApplicationClusterEntrypoint with exit code 0.
  493.  
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!