Advertisement
Guest User

Untitled

a guest
Aug 8th, 2016
596
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 32.88 KB | None | 0 0
  1. 2016-06-30 10:45:43,814 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Triggering log roll on remote NameNode inf-v2.archive.com/10.10.10.83:8022
  2. 2016-06-30 10:45:43,943 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Reading org.apache.hadoop.hdfs.server.namenode.RedundantEditLogInputStream@628093a2 expecting start txid #142683015
  3. 2016-06-30 10:45:43,943 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Start loading edits file http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54, http://adm-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54
  4. 2016-06-30 10:45:43,943 INFO org.apache.hadoop.hdfs.server.namenode.EditLogInputStream: Fast-forwarding stream 'http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54, http://adm-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54' to transaction ID 142683015
  5. 2016-06-30 10:45:43,943 INFO org.apache.hadoop.hdfs.server.namenode.EditLogInputStream: Fast-forwarding stream 'http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54' to transaction ID 142683015
  6. 2016-06-30 10:45:43,953 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 10.10.10.83:50010 is added to blk_1074594200_1099546525800{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-6cb61d85-d3d4-4e98-ae2d-0313ab8941c4:NORMAL:10.10.10.83:50010|FINALIZED]]} size 0
  7. 2016-06-30 10:45:43,953 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 10.10.10.84:50010 is added to blk_1074594200_1099546525800{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-6cb61d85-d3d4-4e98-ae2d-0313ab8941c4:NORMAL:10.10.10.83:50010|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4b57fed3-06c0-444e-b217-e67f36edff97:NORMAL:10.10.10.84:50010|FINALIZED]]} size 0
  8. 2016-06-30 10:45:43,953 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 10.10.10.80:50010 is added to blk_1074594200_1099546525800{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-6cb61d85-d3d4-4e98-ae2d-0313ab8941c4:NORMAL:10.10.10.83:50010|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4b57fed3-06c0-444e-b217-e67f36edff97:NORMAL:10.10.10.84:50010|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d7077514-495d-42b2-a2ec-9f76fcc43db4:NORMAL:10.10.10.80:50010|FINALIZED]]} size 0
  9. 2016-06-30 10:45:44,103 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 10.10.10.83:50010 is added to blk_1074594201_1099546525801{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-6cb61d85-d3d4-4e98-ae2d-0313ab8941c4:NORMAL:10.10.10.83:50010|FINALIZED]]} size 0
  10. 2016-06-30 10:45:44,103 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 10.10.10.84:50010 is added to blk_1074594201_1099546525801{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-6cb61d85-d3d4-4e98-ae2d-0313ab8941c4:NORMAL:10.10.10.83:50010|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4b57fed3-06c0-444e-b217-e67f36edff97:NORMAL:10.10.10.84:50010|FINALIZED]]} size 0
  11. 2016-06-30 10:45:44,103 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 10.10.10.80:50010 is added to blk_1074594201_1099546525801{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-6cb61d85-d3d4-4e98-ae2d-0313ab8941c4:NORMAL:10.10.10.83:50010|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4b57fed3-06c0-444e-b217-e67f36edff97:NORMAL:10.10.10.84:50010|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d7077514-495d-42b2-a2ec-9f76fcc43db4:NORMAL:10.10.10.80:50010|FINALIZED]]} size 0
  12. 2016-06-30 10:45:44,104 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Edits file http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54, http://adm-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54 of size 2208108 edits # 11839 loaded in 0 seconds
  13. 2016-06-30 10:45:44,112 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Loaded 11839 edits starting from txid 142683014
  14. 2016-06-30 10:46:07,021 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Get corrupt file blocks returned error: Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error
  15. 2016-06-30 10:46:15,323 WARN org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:hdfs (auth:SIMPLE) cause:org.apache.hadoop.ipc.StandbyException: Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error
  16. 2016-06-30 10:46:15,323 INFO org.apache.hadoop.ipc.Server: IPC Server handler 25 on 9000, call org.apache.hadoop.hdfs.protocol.ClientProtocol.listCacheDirectives from 10.10.10.80:41553 Call#165869 Retry#0: org.apache.hadoop.ipc.StandbyException: Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error
  17. 2016-06-30 10:46:40,365 WARN org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:hdfs (auth:SIMPLE) cause:org.apache.hadoop.ipc.StandbyException: Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error
  18. 2016-06-30 10:46:40,365 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1 on 9000, call org.apache.hadoop.hdfs.protocol.ClientProtocol.getFileInfo from 10.10.10.80:41634 Call#165871 Retry#0: org.apache.hadoop.ipc.StandbyException: Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error
  19. 2016-06-30 10:46:40,380 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Get corrupt file blocks returned error: Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error
  20. 2016-06-30 10:47:06,987 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Get corrupt file blocks returned error: Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error
  21. 2016-06-30 10:47:25,116 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Get corrupt file blocks returned error: Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error
  22. 2016-06-30 10:47:25,134 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: RECEIVED SIGNAL 15: SIGTERM
  23. 2016-06-30 10:47:25,137 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
  24. 2016-06-30 10:48:29,790 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: STARTUP_MSG:
  25. 2016-06-30 10:48:29,877 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: registered UNIX signal handlers for [TERM, HUP, INT]
  26. 2016-06-30 10:48:29,889 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: createNameNode []
  27. 2016-06-30 10:48:30,678 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
  28. 2016-06-30 10:48:30,844 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
  29. 2016-06-30 10:48:30,844 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system started
  30. 2016-06-30 10:48:30,899 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: fs.defaultFS is hdfs://nameservice1
  31. 2016-06-30 10:48:30,900 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Clients are to use nameservice1 to access this namenode/service.
  32. 2016-06-30 10:48:32,275 INFO org.apache.hadoop.util.JvmPauseMonitor: Starting JVM pause monitor
  33. 2016-06-30 10:48:32,365 INFO org.apache.hadoop.hdfs.DFSUtil: Starting Web-server for hdfs at: http://inf-v1.archive.com:50070
  34. 2016-06-30 10:48:32,590 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
  35. 2016-06-30 10:48:32,625 INFO org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets.
  36. 2016-06-30 10:48:32,648 INFO org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.namenode is not defined
  37. 2016-06-30 10:48:32,687 INFO org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
  38. 2016-06-30 10:48:32,699 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs
  39. 2016-06-30 10:48:32,699 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
  40. 2016-06-30 10:48:32,699 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
  41. 2016-06-30 10:48:32,810 INFO org.apache.hadoop.http.HttpServer2: Added filter 'org.apache.hadoop.hdfs.web.AuthFilter' (class=org.apache.hadoop.hdfs.web.AuthFilter)
  42. 2016-06-30 10:48:32,812 INFO org.apache.hadoop.http.HttpServer2: addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
  43. 2016-06-30 10:48:32,857 INFO org.apache.hadoop.http.HttpServer2: Jetty bound to port 50070
  44. 2016-06-30 10:48:32,871 INFO org.mortbay.log: jetty-6.1.26.cloudera.4
  45. 2016-06-30 10:48:33,832 INFO org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@inf-v1.archive.com:50070
  46. 2016-06-30 10:48:34,066 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: No KeyProvider found.
  47. 2016-06-30 10:48:34,077 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: fsLock is fair:true
  48. 2016-06-30 10:48:34,135 INFO org.apache.hadoop.util.HostsFileReader: Adding 10.10.10.80 to the list of included hosts from /var/run/cloudera-scm-agent/process/1244-hdfs-NAMENODE/dfs_hosts_allow.txt
  49. 2016-06-30 10:48:34,135 INFO org.apache.hadoop.util.HostsFileReader: Adding 10.10.10.84 to the list of included hosts from /var/run/cloudera-scm-agent/process/1244-hdfs-NAMENODE/dfs_hosts_allow.txt
  50. 2016-06-30 10:48:34,135 INFO org.apache.hadoop.util.HostsFileReader: Adding 10.10.10.85 to the list of included hosts from /var/run/cloudera-scm-agent/process/1244-hdfs-NAMENODE/dfs_hosts_allow.txt
  51. 2016-06-30 10:48:34,136 INFO org.apache.hadoop.util.HostsFileReader: Adding 10.10.10.82 to the list of included hosts from /var/run/cloudera-scm-agent/process/1244-hdfs-NAMENODE/dfs_hosts_allow.txt
  52. 2016-06-30 10:48:34,136 INFO org.apache.hadoop.util.HostsFileReader: Adding 10.10.10.83 to the list of included hosts from /var/run/cloudera-scm-agent/process/1244-hdfs-NAMENODE/dfs_hosts_allow.txt
  53. 2016-06-30 10:48:34,190 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager: dfs.block.invalidate.limit=1000
  54. 2016-06-30 10:48:34,190 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager: dfs.namenode.datanode.registration.ip-hostname-check=true
  55. 2016-06-30 10:48:34,192 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
  56. 2016-06-30 10:48:34,193 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: The block deletion will start around 2016 Jun 30 10:48:34
  57. 2016-06-30 10:48:34,196 INFO org.apache.hadoop.util.GSet: Computing capacity for map BlocksMap
  58. 2016-06-30 10:48:34,196 INFO org.apache.hadoop.util.GSet: VM type = 64-bit
  59. 2016-06-30 10:48:34,198 INFO org.apache.hadoop.util.GSet: 2.0% max memory 4.0 GB = 81.3 MB
  60. 2016-06-30 10:48:34,198 INFO org.apache.hadoop.util.GSet: capacity = 2^23 = 8388608 entries
  61. 2016-06-30 10:48:34,223 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: dfs.block.access.token.enable=false
  62. 2016-06-30 10:48:34,226 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: defaultReplication = 3
  63. 2016-06-30 10:48:34,226 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: maxReplication = 512
  64. 2016-06-30 10:48:34,226 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: minReplication = 1
  65. 2016-06-30 10:48:34,226 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: maxReplicationStreams = 20
  66. 2016-06-30 10:48:34,226 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: replicationRecheckInterval = 3000
  67. 2016-06-30 10:48:34,226 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: encryptDataTransfer = false
  68. 2016-06-30 10:48:34,227 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: maxNumBlocksToLog = 1000
  69. 2016-06-30 10:48:34,234 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: fsOwner = hdfs (auth:SIMPLE)
  70. 2016-06-30 10:48:34,235 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: supergroup = supergroup
  71. 2016-06-30 10:48:34,235 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: isPermissionEnabled = false
  72. 2016-06-30 10:48:34,235 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Determined nameservice ID: nameservice1
  73. 2016-06-30 10:48:34,236 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: HA Enabled: true
  74. 2016-06-30 10:48:34,238 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Append Enabled: true
  75. 2016-06-30 10:48:34,563 INFO org.apache.hadoop.util.GSet: Computing capacity for map INodeMap
  76. 2016-06-30 10:48:34,564 INFO org.apache.hadoop.util.GSet: VM type = 64-bit
  77. 2016-06-30 10:48:34,564 INFO org.apache.hadoop.util.GSet: 1.0% max memory 4.0 GB = 40.6 MB
  78. 2016-06-30 10:48:34,564 INFO org.apache.hadoop.util.GSet: capacity = 2^22 = 4194304 entries
  79. 2016-06-30 10:48:34,733 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Caching file names occuring more than 10 times
  80. 2016-06-30 10:48:34,763 INFO org.apache.hadoop.util.GSet: Computing capacity for map cachedBlocks
  81. 2016-06-30 10:48:34,763 INFO org.apache.hadoop.util.GSet: VM type = 64-bit
  82. 2016-06-30 10:48:34,763 INFO org.apache.hadoop.util.GSet: 0.25% max memory 4.0 GB = 10.2 MB
  83. 2016-06-30 10:48:34,764 INFO org.apache.hadoop.util.GSet: capacity = 2^20 = 1048576 entries
  84. 2016-06-30 10:48:34,767 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: dfs.namenode.safemode.threshold-pct = 0.9990000128746033
  85. 2016-06-30 10:48:34,767 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: dfs.namenode.safemode.min.datanodes = 0
  86. 2016-06-30 10:48:34,767 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: dfs.namenode.safemode.extension = 30000
  87. 2016-06-30 10:48:34,772 INFO org.apache.hadoop.hdfs.server.namenode.top.metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.num.buckets = 10
  88. 2016-06-30 10:48:34,772 INFO org.apache.hadoop.hdfs.server.namenode.top.metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.users = 10
  89. 2016-06-30 10:48:34,772 INFO org.apache.hadoop.hdfs.server.namenode.top.metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.minutes = 1,5,25
  90. 2016-06-30 10:48:34,774 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Retry cache on namenode is enabled
  91. 2016-06-30 10:48:34,775 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
  92. 2016-06-30 10:48:34,778 INFO org.apache.hadoop.util.GSet: Computing capacity for map NameNodeRetryCache
  93. 2016-06-30 10:48:34,778 INFO org.apache.hadoop.util.GSet: VM type = 64-bit
  94. 2016-06-30 10:48:34,779 INFO org.apache.hadoop.util.GSet: 0.029999999329447746% max memory 4.0 GB = 1.2 MB
  95. 2016-06-30 10:48:34,779 INFO org.apache.hadoop.util.GSet: capacity = 2^17 = 131072 entries
  96. 2016-06-30 10:48:34,786 INFO org.apache.hadoop.hdfs.server.namenode.NNConf: ACLs enabled? false
  97. 2016-06-30 10:48:34,786 INFO org.apache.hadoop.hdfs.server.namenode.NNConf: XAttrs enabled? true
  98. 2016-06-30 10:48:34,786 INFO org.apache.hadoop.hdfs.server.namenode.NNConf: Maximum size of an xattr: 16384
  99. 2016-06-30 10:48:34,808 INFO org.apache.hadoop.hdfs.server.common.Storage: Lock on /usr/local/hadoop/name/in_use.lock acquired by nodename 13323@inf-v1.archive.com
  100. 2016-06-30 10:48:34,920 INFO org.apache.hadoop.hdfs.server.common.Storage: Lock on /usr/local/hadoop-nn/in_use.lock acquired by nodename 13323@inf-v1.archive.com
  101. 2016-06-30 10:48:35,165 INFO org.apache.hadoop.http.HttpServer2: Process Thread Dump: jsp requested
  102. 2016-06-30 10:48:36,259 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Planning to load image: FSImageFile(file=/usr/local/hadoop/name/current/fsimage_0000000000142682428, cpktTxId=0000000000142682428)
  103. 2016-06-30 10:48:36,479 INFO org.apache.hadoop.hdfs.server.namenode.FSImageFormatPBINode: Loading 79327 INodes.
  104. 2016-06-30 10:48:37,961 INFO org.apache.hadoop.hdfs.server.namenode.FSImageFormatProtobuf: Loaded FSImage in 1 seconds.
  105. 2016-06-30 10:48:37,961 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Loaded image for txid 142682428 from /usr/local/hadoop/name/current/fsimage_0000000000142682428
  106. 2016-06-30 10:48:37,968 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Reading org.apache.hadoop.hdfs.server.namenode.RedundantEditLogInputStream@4e9d6c1e expecting start txid #142682429
  107. 2016-06-30 10:48:37,968 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Start loading edits file http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142682429&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54, http://adm-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142682429&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54
  108. 2016-06-30 10:48:37,972 INFO org.apache.hadoop.hdfs.server.namenode.EditLogInputStream: Fast-forwarding stream 'http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142682429&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54, http://adm-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142682429&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54' to transaction ID 142682429
  109. 2016-06-30 10:48:37,972 INFO org.apache.hadoop.hdfs.server.namenode.EditLogInputStream: Fast-forwarding stream 'http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142682429&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54' to transaction ID 142682429
  110. 2016-06-30 10:48:38,718 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Edits file http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142682429&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54, http://adm-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142682429&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54 of size 2853 edits # 22 loaded in 0 seconds
  111. 2016-06-30 10:48:38,718 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Reading org.apache.hadoop.hdfs.server.namenode.RedundantEditLogInputStream@41254de4 expecting start txid #142682451
  112. <<SNIP>>
  113. 2016-06-30 10:48:39,586 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Start loading edits file http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54, http://adm-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54
  114. 2016-06-30 10:48:39,587 INFO org.apache.hadoop.hdfs.server.namenode.EditLogInputStream: Fast-forwarding stream 'http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54, http://adm-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54' to transaction ID 142682429
  115. 2016-06-30 10:48:39,587 INFO org.apache.hadoop.hdfs.server.namenode.EditLogInputStream: Fast-forwarding stream 'http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54' to transaction ID 142682429
  116. 2016-06-30 10:48:40,445 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Edits file http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54, http://adm-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54 of size 2208108 edits # 11839 loaded in 0 seconds
  117. 2016-06-30 10:48:40,686 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Need to save fs image? false (staleImage=false, haEnabled=true, isRollingUpgrade=false)
  118. 2016-06-30 10:48:40,686 INFO org.apache.hadoop.hdfs.server.namenode.NameCache: initialized with 0 entries 0 lookups
  119. 2016-06-30 10:48:40,690 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Finished loading FSImage in 5904 msecs
  120. 2016-06-30 10:48:40,957 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Service RPC server is binding to inf-v1.archive.com:8022
  121. 2016-06-30 10:48:40,963 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
  122. 2016-06-30 10:48:40,983 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8022
  123. 2016-06-30 10:48:41,018 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Setting ADDRESS inf-v1.archive.com:8022
  124. 2016-06-30 10:48:41,019 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: RPC server is binding to inf-v1.archive.com:9000
  125. 2016-06-30 10:48:41,019 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
  126. 2016-06-30 10:48:41,020 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 9000
  127. 2016-06-30 10:48:41,030 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Registered FSNamesystemState MBean
  128. 2016-06-30 10:48:41,048 INFO org.apache.hadoop.hdfs.server.namenode.LeaseManager: Number of blocks under construction: 0
  129. 2016-06-30 10:48:41,049 INFO org.apache.hadoop.hdfs.server.namenode.LeaseManager: Number of blocks under construction: 0
  130. 2016-06-30 10:48:41,050 INFO org.apache.hadoop.hdfs.StateChange: STATE* Safe mode ON.
  131. 2016-06-30 10:48:41,102 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
  132. 2016-06-30 10:48:41,102 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 9000: starting
  133. 2016-06-30 10:48:41,111 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
  134. 2016-06-30 10:48:41,112 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8022: starting
  135. 2016-06-30 10:48:41,130 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: NameNode RPC up at: inf-v1.archive.com/10.10.10.82:9000
  136. 2016-06-30 10:48:41,130 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: NameNode service RPC up at: inf-v1.archive.com/10.10.10.82:8022
  137. 2016-06-30 10:48:41,130 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Starting services required for standby state
  138. 2016-06-30 10:48:41,138 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Will roll logs on active node at inf-v2.archive.com/10.10.10.83:8022 every 120 seconds.
  139. 2016-06-30 10:48:41,148 INFO org.apache.hadoop.hdfs.server.namenode.ha.StandbyCheckpointer: Starting standby checkpoint thread...
  140. 2016-06-30 10:48:42,582 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Stopping services started for standby state
  141. 2016-06-30 10:48:42,584 WARN org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Edit log tailer interrupted
  142. 2016-06-30 10:48:42,700 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Starting services required for active state
  143. 2016-06-30 10:48:42,720 INFO org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager: Starting recovery process for unclosed journal segments...
  144. 2016-06-30 10:48:42,881 INFO org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager: Successfully started new epoch 3
  145. 2016-06-30 10:48:42,881 INFO org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager: Beginning recovery of unclosed segment starting at txid 142694854
  146. 2016-06-30 10:48:42,966 INFO org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager: Recovery prepare phase complete. Responses:
  147. 2016-06-30 10:48:42,968 INFO org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager: Using longest log: 10.10.10.80:8485=segmentState {
  148. 2016-06-30 10:48:43,067 INFO org.apache.hadoop.hdfs.server.namenode.FileJournalManager: Recovering unfinalized segments in /usr/local/hadoop/name/current
  149. 2016-06-30 10:48:43,068 INFO org.apache.hadoop.hdfs.server.namenode.FileJournalManager: Recovering unfinalized segments in /usr/local/hadoop-nn/current
  150. 2016-06-30 10:48:43,068 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Catching up to latest edits from old active before taking over writer role in edits logs
  151. 2016-06-30 10:48:43,080 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Reading org.apache.hadoop.hdfs.server.namenode.RedundantEditLogInputStream@3354eefc expecting start txid #142694854
  152. 2016-06-30 10:48:43,082 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Start loading edits file http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142694854&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54, http://adm-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142694854&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54
  153. 2016-06-30 10:48:43,083 INFO org.apache.hadoop.hdfs.server.namenode.EditLogInputStream: Fast-forwarding stream 'http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142694854&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54, http://adm-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142694854&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54' to transaction ID 142694854
  154. 2016-06-30 10:48:43,083 INFO org.apache.hadoop.hdfs.server.namenode.EditLogInputStream: Fast-forwarding stream 'http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142694854&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54' to transaction ID 142694854
  155. 2016-06-30 10:48:43,112 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Edits file http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142694854&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54, http://adm-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142694854&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54 of size 1048576 edits # 9 loaded in 0 seconds
  156. 2016-06-30 10:48:43,122 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Loaded 9 edits starting from txid 142694853
  157. 2016-06-30 10:48:43,122 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager: Marking all datandoes as stale
  158. 2016-06-30 10:48:43,123 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Will take over writing edit logs at txnid 142694863
  159. 2016-06-30 10:48:43,131 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Starting log segment at 142694863
  160. 2016-06-30 10:48:43,482 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Starting CacheReplicationMonitor with interval 30000 milliseconds
  161. 2016-06-30 10:48:43,482 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 1110373523 milliseconds
  162. 2016-06-30 10:48:43,505 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 23 millisecond(s).
  163. 2016-06-30 10:48:47,537 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* registerDatanode: from DatanodeRegistration(10.10.10.85, datanodeUuid=dc43ee8e-42ea-4d17-afb0-dc4816c5e4ca, infoPort=50075, infoSecurePort=0, ipcPort=50020, storageInfo=lv=-56;cid=CID-5617173a-ed03-4180-a950-de0b5f407d54;nsid=978309183;c=1463427213312) storage dc43ee8e-42ea-4d17-afb0-dc4816c5e4ca
  164. 2016-06-30 10:48:47,544 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeDescriptor: Number of failed storage changes from 0 to 0
  165. 2016-06-30 10:48:47,546 INFO org.apache.hadoop.net.NetworkTopology: Adding a new node: /default/10.10.10.85:50010
  166. 2016-06-30 10:48:47,546 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockReportLeaseManager: Registered DN dc43ee8e-42ea-4d17-afb0-dc4816c5e4ca (10.10.10.85:50010).
  167. 2016-06-30 10:48:47,696 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeDescriptor: Number of failed storage changes from 0 to 0
  168. 2016-06-30 10:48:47,697 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeDescriptor: Adding new storage ID DS-9ed7edcd-8822-4ce0-bd9c-e755b327141a for DN 10.10.10.85:50010
  169. 2016-06-30 10:48:47,876 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* registerDatanode: from DatanodeRegistration(10.10.10.80, datanodeUuid=443b367a-f4c7-4abe-b705-fe3a06e32dbf, infoPort=50075, infoSecurePort=0, ipcPort=50020, storageInfo=lv=-56;cid=CID-5617173a-ed03-4180-a950-de0b5f407d54;nsid=978309183;c=1463427213312) storage 443b367a-f4c7-4abe-b705-fe3a06e32dbf
  170. 2016-06-30 10:48:47,877 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeDescriptor: Number of failed storage changes from 0 to 0
  171. 2016-06-30 10:48:47,877 INFO org.apache.hadoop.net.NetworkTopology: Adding a new node: /default/10.10.10.80:50010
  172. 2016-06-30 10:48:47,877 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockReportLeaseManager: Registered DN 443b367a-f4c7-4abe-b705-fe3a06e32dbf (10.10.10.80:50010).
  173. 2016-06-30 10:48:47,923 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Processing first storage report for DS-9ed7edcd-8822-4ce0-bd9c-e755b327141a from datanode dc43ee8e-42ea-4d17-afb0-dc4816c5e4ca
  174. 2016-06-30 10:48:48,310 INFO BlockStateChange: BLOCK* processReport: from storage DS-9ed7edcd-8822-4ce0-bd9c-e755b327141a node DatanodeRegistration(10.10.10.85, datanodeUuid=dc43ee8e-42ea-4d17-afb0-dc4816c5e4ca, infoPort=50075, infoSecurePort=0, ipcPort=50020, storageInfo=lv=-56;cid=CID-5617173a-ed03-4180-a950-de0b5f407d54;nsid=978309183;c=1463427213312), blocks: 44305, hasStaleStorage: false, processing time: 387 msecs
  175. 2016-06-30 10:48:48,311 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeDescriptor: Number of failed storage changes from 0 to 0
  176. 2016-06-30 10:48:48,312 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeDescriptor: Adding new storage ID DS-d7077514-495d-42b2-a2ec-9f76fcc43db4 for DN 10.10.10.80:50010
  177. 2016-06-30 10:48:48,454 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Processing first storage report for DS-d7077514-495d-42b2-a2ec-9f76fcc43db4 from datanode 443b367a-f4c7-4abe-b705-fe3a06e32dbf
  178. 2016-06-30 10:48:48,548 INFO BlockStateChange: BLOCK* processReport: from storage DS-d7077514-495d-42b2-a2ec-9f76fcc43db4 node DatanodeRegistration(10.10.10.80, datanodeUuid=443b367a-f4c7-4abe-b705-fe3a06e32dbf, infoPort=50075, infoSecurePort=0, ipcPort=50020, storageInfo=lv=-56;cid=CID-5617173a-ed03-4180-a950-de0b5f407d54;nsid=978309183;c=1463427213312), blocks: 35582, hasStaleStorage: false, processing time: 94 msecs
  179. 2016-06-30 10:48:48,918 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* registerDatanode: from DatanodeRegistration(10.10.10.83, datanodeUuid=8f0a3948-9579-4d60-b002-b2fec4811b08, infoPort=50075, infoSecurePort=0, ipcPort=50020, storageInfo=lv=-56;cid=CID-5617173a-ed03-4180-a950-de0b5f407d54;nsid=978309183;c=1463427213312) storage 8f0a3948-9579-4d60-b002-b2fec4811b08
  180. 2016-06-30 10:48:48,918 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeDescriptor: Number of failed storage changes from 0 to 0
  181. 2016-06-30 10:48:48,919 INFO org.apache.hadoop.net.NetworkTopology: Adding a new node: /default/10.10.10.83:50010
  182. 2016-06-30 10:48:48,919 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockReportLeaseManager: Registered DN 8f0a3948-9579-4d60-b002-b2fec4811b08 (10.10.10.83:50010).
  183. 2016-06-30 10:48:48,977 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeDescriptor: Number of failed storage changes from 0 to 0
  184. 2016-06-30 10:48:48,977 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeDescriptor: Adding new storage ID DS-6cb61d85-d3d4-4e98-ae2d-0313ab8941c4 for DN 10.10.10.83:50010
  185. 2016-06-30 10:48:49,141 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Processing first storage report for DS-6cb61d85-d3d4-4e98-ae2d-0313ab8941c4 from datanode 8f0a3948-9579-4d60-b002-b2fec4811b08
  186. 2016-06-30 10:48:49,183 INFO org.apache.hadoop.hdfs.StateChange: STATE* Safe mode extension entered.
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement