API tools faq
paste
Advertisement
faneron

Worker DataNode LOG

faneron
Sep 13th, 2022 (edited)
1,797
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Apache Log 30.00 KB | Source Code | 0 0
raw download clone embed print report
  1. 'stevel' on 2022-07-29T12:32Z
  2. STARTUP_MSG:   java = 1.8.0_342
  3. ************************************************************/
  4. 2022-09-13 11:16:15,300 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: registered UNIX signal handlers for [TERM, HUP, INT]
  5. 2022-09-13 11:16:15,556 INFO org.apache.hadoop.hdfs.server.datanode.checker.ThrottledAsyncChecker: Scheduling a check for [DISK]file:/home/ml/dfs/datanode
  6. 2022-09-13 11:16:15,633 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: Loaded properties from hadoop-metrics2.properties
  7. 2022-09-13 11:16:15,697 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s).
  8. 2022-09-13 11:16:15,697 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system started
  9. 2022-09-13 11:16:15,850 INFO org.apache.hadoop.hdfs.server.common.Util: dfs.datanode.fileio.profiling.sampling.percentage set to 0. Disabling file IO profiling
  10. 2022-09-13 11:16:15,862 INFO org.apache.hadoop.hdfs.server.datanode.BlockScanner: Initialized block scanner with targetBytesPerSec 1048576
  11. 2022-09-13 11:16:15,867 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Configured hostname is NAS
  12. 2022-09-13 11:16:15,867 INFO org.apache.hadoop.hdfs.server.common.Util: dfs.datanode.fileio.profiling.sampling.percentage set to 0. Disabling file IO profiling
  13. 2022-09-13 11:16:15,871 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Starting DataNode with maxLockedMemory = 0
  14. 2022-09-13 11:16:15,886 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Opened streaming server at /0.0.0.0:9866
  15. 2022-09-13 11:16:15,887 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Balancing bandwidth is 104857600 bytes/s
  16. 2022-09-13 11:16:15,887 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Number threads for balancing is 100
  17. 2022-09-13 11:16:15,919 INFO org.eclipse.jetty.util.log: Logging initialized @1053ms to org.eclipse.jetty.util.log.Slf4jLog
  18. 2022-09-13 11:16:16,000 WARN org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. Reason: Could not read signature secret file: /home/ml/hadoop-http-auth-signature-secret
  19. 2022-09-13 11:16:16,006 INFO org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.datanode is not defined
  20. 2022-09-13 11:16:16,012 INFO org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
  21. 2022-09-13 11:16:16,014 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
  22. 2022-09-13 11:16:16,014 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
  23. 2022-09-13 11:16:16,014 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
  24. 2022-09-13 11:16:16,067 INFO org.apache.hadoop.http.HttpServer2: Jetty bound to port 45959
  25. 2022-09-13 11:16:16,068 INFO org.eclipse.jetty.server.Server: jetty-9.4.43.v20210629; built: 2021-06-30T11:07:22.254Z; git: 526006ecfa3af7f1a27ef3a288e2bef7ea9dd7e8; jvm 1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
  26. 2022-09-13 11:16:16,086 INFO org.eclipse.jetty.server.session: DefaultSessionIdManager workerName=node0
  27. 2022-09-13 11:16:16,086 INFO org.eclipse.jetty.server.session: No SessionScavenger set, using defaults2022-09-13 11:16:16,087 INFO org.eclipse.jetty.server.session: node0 Scavenging every 600000ms
  28. 2022-09-13 11:16:16,098 INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.s.ServletContextHandler@2049a9c1{logs,/logs,file:///home/ml/hadoop/logs/,AVAILABLE}
  29. 2022-09-13 11:16:16,098 INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.s.ServletContextHandler@7c51f34b{static,/static,file:///home/ml/hadoop/share/hadoop/hdfs/webapps/static/,AVAILABLE}
  30. 2022-09-13 11:16:16,153 INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.w.WebAppContext@53f6fd09{datanode,/,file:///home/ml/hadoop/share/hadoop/hdfs/webapps/datanode/,AVAILABLE}{file:/home/ml/hadoop/share/hadoop/hdfs/webapps/datanode}
  31. 2022-09-13 11:16:16,161 INFO org.eclipse.jetty.server.AbstractConnector: Started ServerConnector@3e74829{HTTP/1.1, (http/1.1)}{localhost:45959}
  32. 2022-09-13 11:16:16,161 INFO org.eclipse.jetty.server.Server: Started @1296ms
  33. 2022-09-13 11:16:16,222 WARN org.apache.hadoop.hdfs.server.datanode.web.DatanodeHttpServer: Got null for restCsrfPreventionFilter - will not do any filtering.
  34. 2022-09-13 11:16:16,284 INFO org.apache.hadoop.hdfs.server.datanode.web.DatanodeHttpServer: Listening HTTP traffic on /0.0.0.0:9864
  35. 2022-09-13 11:16:16,288 INFO org.apache.hadoop.util.JvmPauseMonitor: Starting JVM pause monitor
  36. 2022-09-13 11:16:16,289 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: dnUserName = ml
  37. 2022-09-13 11:16:16,289 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: supergroup = supergroup
  38. 2022-09-13 11:16:16,335 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 1000, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false.
  39. 2022-09-13 11:16:16,350 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 9867
  40. 2022-09-13 11:16:16,497 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Opened IPC server at /0.0.0.0:9867
  41. 2022-09-13 11:16:16,523 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Refresh request received for nameservices: null
  42. 2022-09-13 11:16:16,529 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Starting BPOfferServices for nameservices: <default>
  43. 2022-09-13 11:16:16,537 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Block pool <registering> (Datanode Uuid unassigned) service to DataScience/192.168.1.65:9000 starting to offer service
  44. 2022-09-13 11:16:16,542 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
  45. 2022-09-13 11:16:16,542 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 9867: starting
  46. 2022-09-13 11:16:18,616 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: DataScience/192.168.1.65:9000
  47. 2022-09-13 11:16:25,660 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: DataScience/192.168.1.65:9000
  48. 2022-09-13 11:16:32,722 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: DataScience/192.168.1.65:9000
  49. 2022-09-13 11:16:39,777 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: DataScience/192.168.1.65:9000
  50. 2022-09-13 11:16:46,824 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: DataScience/192.168.1.65:9000
  51. 2022-09-13 11:16:53,866 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: DataScience/192.168.1.65:9000
  52. 2022-09-13 11:17:00,913 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: DataScience/192.168.1.65:9000
  53. 2022-09-13 11:17:07,959 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: DataScience/192.168.1.65:9000
  54. 2022-09-13 11:17:14,995 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: DataScience/192.168.1.65:9000
  55. 2022-09-13 11:17:22,038 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: DataScience/192.168.1.65:9000
  56. 2022-09-13 11:17:29,095 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: DataScience/192.168.1.65:9000
  57. 2022-09-13 11:17:36,146 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: DataScience/192.168.1.65:9000
  58. 2022-09-13 11:17:43,207 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: DataScience/192.168.1.65:9000
  59. 2022-09-13 11:17:50,391 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: DataScience/192.168.1.65:9000
  60. 2022-09-13 11:17:57,444 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: DataScience/192.168.1.65:9000
  61. 2022-09-13 11:18:04,471 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: DataScience/192.168.1.65:9000
  62. 2022-09-13 11:18:11,506 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: DataScience/192.168.1.65:9000
  63. 2022-09-13 11:18:18,553 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: DataScience/192.168.1.65:9000
  64. 2022-09-13 11:18:25,597 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: DataScience/192.168.1.65:9000
  65. 2022-09-13 11:18:32,657 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: DataScience/192.168.1.65:9000
  66. 2022-09-13 11:18:39,713 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: DataScience/192.168.1.65:9000
  67. 2022-09-13 11:18:46,793 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: DataScience/192.168.1.65:9000
  68. 2022-09-13 11:18:53,873 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: DataScience/192.168.1.65:9000
  69. 2022-09-13 11:19:00,904 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: DataScience/192.168.1.65:9000
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!