SHARE
TWEET

Untitled

a guest Aug 8th, 2016 200 Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
  1. 2016-06-30 10:45:43,814 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Triggering log roll on remote NameNode inf-v2.archive.com/10.10.10.83:8022
  2. 2016-06-30 10:45:43,943 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Reading org.apache.hadoop.hdfs.server.namenode.RedundantEditLogInputStream@628093a2 expecting start txid #142683015
  3. 2016-06-30 10:45:43,943 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Start loading edits file http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54, http://adm-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54
  4. 2016-06-30 10:45:43,943 INFO org.apache.hadoop.hdfs.server.namenode.EditLogInputStream: Fast-forwarding stream 'http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54, http://adm-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54' to transaction ID 142683015
  5. 2016-06-30 10:45:43,943 INFO org.apache.hadoop.hdfs.server.namenode.EditLogInputStream: Fast-forwarding stream 'http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54' to transaction ID 142683015
  6. 2016-06-30 10:45:43,953 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 10.10.10.83:50010 is added to blk_1074594200_1099546525800{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-6cb61d85-d3d4-4e98-ae2d-0313ab8941c4:NORMAL:10.10.10.83:50010|FINALIZED]]} size 0
  7. 2016-06-30 10:45:43,953 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 10.10.10.84:50010 is added to blk_1074594200_1099546525800{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-6cb61d85-d3d4-4e98-ae2d-0313ab8941c4:NORMAL:10.10.10.83:50010|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4b57fed3-06c0-444e-b217-e67f36edff97:NORMAL:10.10.10.84:50010|FINALIZED]]} size 0
  8. 2016-06-30 10:45:43,953 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 10.10.10.80:50010 is added to blk_1074594200_1099546525800{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-6cb61d85-d3d4-4e98-ae2d-0313ab8941c4:NORMAL:10.10.10.83:50010|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4b57fed3-06c0-444e-b217-e67f36edff97:NORMAL:10.10.10.84:50010|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d7077514-495d-42b2-a2ec-9f76fcc43db4:NORMAL:10.10.10.80:50010|FINALIZED]]} size 0
  9. 2016-06-30 10:45:44,103 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 10.10.10.83:50010 is added to blk_1074594201_1099546525801{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-6cb61d85-d3d4-4e98-ae2d-0313ab8941c4:NORMAL:10.10.10.83:50010|FINALIZED]]} size 0
  10. 2016-06-30 10:45:44,103 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 10.10.10.84:50010 is added to blk_1074594201_1099546525801{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-6cb61d85-d3d4-4e98-ae2d-0313ab8941c4:NORMAL:10.10.10.83:50010|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4b57fed3-06c0-444e-b217-e67f36edff97:NORMAL:10.10.10.84:50010|FINALIZED]]} size 0
  11. 2016-06-30 10:45:44,103 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 10.10.10.80:50010 is added to blk_1074594201_1099546525801{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-6cb61d85-d3d4-4e98-ae2d-0313ab8941c4:NORMAL:10.10.10.83:50010|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4b57fed3-06c0-444e-b217-e67f36edff97:NORMAL:10.10.10.84:50010|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d7077514-495d-42b2-a2ec-9f76fcc43db4:NORMAL:10.10.10.80:50010|FINALIZED]]} size 0
  12. 2016-06-30 10:45:44,104 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Edits file http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54, http://adm-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54 of size 2208108 edits # 11839 loaded in 0 seconds
  13. 2016-06-30 10:45:44,112 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Loaded 11839 edits starting from txid 142683014
  14. 2016-06-30 10:46:07,021 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Get corrupt file blocks returned error: Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error
  15. 2016-06-30 10:46:15,323 WARN org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:hdfs (auth:SIMPLE) cause:org.apache.hadoop.ipc.StandbyException: Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error
  16. 2016-06-30 10:46:15,323 INFO org.apache.hadoop.ipc.Server: IPC Server handler 25 on 9000, call org.apache.hadoop.hdfs.protocol.ClientProtocol.listCacheDirectives from 10.10.10.80:41553 Call#165869 Retry#0: org.apache.hadoop.ipc.StandbyException: Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error
  17. 2016-06-30 10:46:40,365 WARN org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:hdfs (auth:SIMPLE) cause:org.apache.hadoop.ipc.StandbyException: Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error
  18. 2016-06-30 10:46:40,365 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1 on 9000, call org.apache.hadoop.hdfs.protocol.ClientProtocol.getFileInfo from 10.10.10.80:41634 Call#165871 Retry#0: org.apache.hadoop.ipc.StandbyException: Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error
  19. 2016-06-30 10:46:40,380 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Get corrupt file blocks returned error: Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error
  20. 2016-06-30 10:47:06,987 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Get corrupt file blocks returned error: Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error
  21. 2016-06-30 10:47:25,116 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Get corrupt file blocks returned error: Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error
  22. 2016-06-30 10:47:25,134 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: RECEIVED SIGNAL 15: SIGTERM
  23. 2016-06-30 10:47:25,137 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
  24. 2016-06-30 10:48:29,790 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: STARTUP_MSG:
  25. 2016-06-30 10:48:29,877 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: registered UNIX signal handlers for [TERM, HUP, INT]
  26. 2016-06-30 10:48:29,889 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: createNameNode []
  27. 2016-06-30 10:48:30,678 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
  28. 2016-06-30 10:48:30,844 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
  29. 2016-06-30 10:48:30,844 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system started
  30. 2016-06-30 10:48:30,899 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: fs.defaultFS is hdfs://nameservice1
  31. 2016-06-30 10:48:30,900 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Clients are to use nameservice1 to access this namenode/service.
  32. 2016-06-30 10:48:32,275 INFO org.apache.hadoop.util.JvmPauseMonitor: Starting JVM pause monitor
  33. 2016-06-30 10:48:32,365 INFO org.apache.hadoop.hdfs.DFSUtil: Starting Web-server for hdfs at: http://inf-v1.archive.com:50070
  34. 2016-06-30 10:48:32,590 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
  35. 2016-06-30 10:48:32,625 INFO org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets.
  36. 2016-06-30 10:48:32,648 INFO org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.namenode is not defined
  37. 2016-06-30 10:48:32,687 INFO org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
  38. 2016-06-30 10:48:32,699 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs
  39. 2016-06-30 10:48:32,699 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
  40. 2016-06-30 10:48:32,699 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
  41. 2016-06-30 10:48:32,810 INFO org.apache.hadoop.http.HttpServer2: Added filter 'org.apache.hadoop.hdfs.web.AuthFilter' (class=org.apache.hadoop.hdfs.web.AuthFilter)
  42. 2016-06-30 10:48:32,812 INFO org.apache.hadoop.http.HttpServer2: addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
  43. 2016-06-30 10:48:32,857 INFO org.apache.hadoop.http.HttpServer2: Jetty bound to port 50070
  44. 2016-06-30 10:48:32,871 INFO org.mortbay.log: jetty-6.1.26.cloudera.4
  45. 2016-06-30 10:48:33,832 INFO org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@inf-v1.archive.com:50070
  46. 2016-06-30 10:48:34,066 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: No KeyProvider found.
  47. 2016-06-30 10:48:34,077 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: fsLock is fair:true
  48. 2016-06-30 10:48:34,135 INFO org.apache.hadoop.util.HostsFileReader: Adding 10.10.10.80 to the list of included hosts from /var/run/cloudera-scm-agent/process/1244-hdfs-NAMENODE/dfs_hosts_allow.txt
  49. 2016-06-30 10:48:34,135 INFO org.apache.hadoop.util.HostsFileReader: Adding 10.10.10.84 to the list of included hosts from /var/run/cloudera-scm-agent/process/1244-hdfs-NAMENODE/dfs_hosts_allow.txt
  50. 2016-06-30 10:48:34,135 INFO org.apache.hadoop.util.HostsFileReader: Adding 10.10.10.85 to the list of included hosts from /var/run/cloudera-scm-agent/process/1244-hdfs-NAMENODE/dfs_hosts_allow.txt
  51. 2016-06-30 10:48:34,136 INFO org.apache.hadoop.util.HostsFileReader: Adding 10.10.10.82 to the list of included hosts from /var/run/cloudera-scm-agent/process/1244-hdfs-NAMENODE/dfs_hosts_allow.txt
  52. 2016-06-30 10:48:34,136 INFO org.apache.hadoop.util.HostsFileReader: Adding 10.10.10.83 to the list of included hosts from /var/run/cloudera-scm-agent/process/1244-hdfs-NAMENODE/dfs_hosts_allow.txt
  53. 2016-06-30 10:48:34,190 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager: dfs.block.invalidate.limit=1000
  54. 2016-06-30 10:48:34,190 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager: dfs.namenode.datanode.registration.ip-hostname-check=true
  55. 2016-06-30 10:48:34,192 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
  56. 2016-06-30 10:48:34,193 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: The block deletion will start around 2016 Jun 30 10:48:34
  57. 2016-06-30 10:48:34,196 INFO org.apache.hadoop.util.GSet: Computing capacity for map BlocksMap
  58. 2016-06-30 10:48:34,196 INFO org.apache.hadoop.util.GSet: VM type       = 64-bit
  59. 2016-06-30 10:48:34,198 INFO org.apache.hadoop.util.GSet: 2.0% max memory 4.0 GB = 81.3 MB
  60. 2016-06-30 10:48:34,198 INFO org.apache.hadoop.util.GSet: capacity      = 2^23 = 8388608 entries
  61. 2016-06-30 10:48:34,223 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: dfs.block.access.token.enable=false
  62. 2016-06-30 10:48:34,226 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: defaultReplication         = 3
  63. 2016-06-30 10:48:34,226 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: maxReplication             = 512
  64. 2016-06-30 10:48:34,226 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: minReplication             = 1
  65. 2016-06-30 10:48:34,226 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: maxReplicationStreams      = 20
  66. 2016-06-30 10:48:34,226 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: replicationRecheckInterval = 3000
  67. 2016-06-30 10:48:34,226 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: encryptDataTransfer        = false
  68. 2016-06-30 10:48:34,227 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: maxNumBlocksToLog          = 1000
  69. 2016-06-30 10:48:34,234 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: fsOwner             = hdfs (auth:SIMPLE)
  70. 2016-06-30 10:48:34,235 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: supergroup          = supergroup
  71. 2016-06-30 10:48:34,235 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: isPermissionEnabled = false
  72. 2016-06-30 10:48:34,235 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Determined nameservice ID: nameservice1
  73. 2016-06-30 10:48:34,236 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: HA Enabled: true
  74. 2016-06-30 10:48:34,238 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Append Enabled: true
  75. 2016-06-30 10:48:34,563 INFO org.apache.hadoop.util.GSet: Computing capacity for map INodeMap
  76. 2016-06-30 10:48:34,564 INFO org.apache.hadoop.util.GSet: VM type       = 64-bit
  77. 2016-06-30 10:48:34,564 INFO org.apache.hadoop.util.GSet: 1.0% max memory 4.0 GB = 40.6 MB
  78. 2016-06-30 10:48:34,564 INFO org.apache.hadoop.util.GSet: capacity      = 2^22 = 4194304 entries
  79. 2016-06-30 10:48:34,733 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Caching file names occuring more than 10 times
  80. 2016-06-30 10:48:34,763 INFO org.apache.hadoop.util.GSet: Computing capacity for map cachedBlocks
  81. 2016-06-30 10:48:34,763 INFO org.apache.hadoop.util.GSet: VM type       = 64-bit
  82. 2016-06-30 10:48:34,763 INFO org.apache.hadoop.util.GSet: 0.25% max memory 4.0 GB = 10.2 MB
  83. 2016-06-30 10:48:34,764 INFO org.apache.hadoop.util.GSet: capacity      = 2^20 = 1048576 entries
  84. 2016-06-30 10:48:34,767 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: dfs.namenode.safemode.threshold-pct = 0.9990000128746033
  85. 2016-06-30 10:48:34,767 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: dfs.namenode.safemode.min.datanodes = 0
  86. 2016-06-30 10:48:34,767 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: dfs.namenode.safemode.extension     = 30000
  87. 2016-06-30 10:48:34,772 INFO org.apache.hadoop.hdfs.server.namenode.top.metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.num.buckets = 10
  88. 2016-06-30 10:48:34,772 INFO org.apache.hadoop.hdfs.server.namenode.top.metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.users = 10
  89. 2016-06-30 10:48:34,772 INFO org.apache.hadoop.hdfs.server.namenode.top.metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.minutes = 1,5,25
  90. 2016-06-30 10:48:34,774 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Retry cache on namenode is enabled
  91. 2016-06-30 10:48:34,775 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
  92. 2016-06-30 10:48:34,778 INFO org.apache.hadoop.util.GSet: Computing capacity for map NameNodeRetryCache
  93. 2016-06-30 10:48:34,778 INFO org.apache.hadoop.util.GSet: VM type       = 64-bit
  94. 2016-06-30 10:48:34,779 INFO org.apache.hadoop.util.GSet: 0.029999999329447746% max memory 4.0 GB = 1.2 MB
  95. 2016-06-30 10:48:34,779 INFO org.apache.hadoop.util.GSet: capacity      = 2^17 = 131072 entries
  96. 2016-06-30 10:48:34,786 INFO org.apache.hadoop.hdfs.server.namenode.NNConf: ACLs enabled? false
  97. 2016-06-30 10:48:34,786 INFO org.apache.hadoop.hdfs.server.namenode.NNConf: XAttrs enabled? true
  98. 2016-06-30 10:48:34,786 INFO org.apache.hadoop.hdfs.server.namenode.NNConf: Maximum size of an xattr: 16384
  99. 2016-06-30 10:48:34,808 INFO org.apache.hadoop.hdfs.server.common.Storage: Lock on /usr/local/hadoop/name/in_use.lock acquired by nodename 13323@inf-v1.archive.com
  100. 2016-06-30 10:48:34,920 INFO org.apache.hadoop.hdfs.server.common.Storage: Lock on /usr/local/hadoop-nn/in_use.lock acquired by nodename 13323@inf-v1.archive.com
  101. 2016-06-30 10:48:35,165 INFO org.apache.hadoop.http.HttpServer2: Process Thread Dump: jsp requested
  102. 2016-06-30 10:48:36,259 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Planning to load image: FSImageFile(file=/usr/local/hadoop/name/current/fsimage_0000000000142682428, cpktTxId=0000000000142682428)
  103. 2016-06-30 10:48:36,479 INFO org.apache.hadoop.hdfs.server.namenode.FSImageFormatPBINode: Loading 79327 INodes.
  104. 2016-06-30 10:48:37,961 INFO org.apache.hadoop.hdfs.server.namenode.FSImageFormatProtobuf: Loaded FSImage in 1 seconds.
  105. 2016-06-30 10:48:37,961 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Loaded image for txid 142682428 from /usr/local/hadoop/name/current/fsimage_0000000000142682428
  106. 2016-06-30 10:48:37,968 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Reading org.apache.hadoop.hdfs.server.namenode.RedundantEditLogInputStream@4e9d6c1e expecting start txid #142682429
  107. 2016-06-30 10:48:37,968 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Start loading edits file http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142682429&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54, http://adm-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142682429&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54
  108. 2016-06-30 10:48:37,972 INFO org.apache.hadoop.hdfs.server.namenode.EditLogInputStream: Fast-forwarding stream 'http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142682429&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54, http://adm-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142682429&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54' to transaction ID 142682429
  109. 2016-06-30 10:48:37,972 INFO org.apache.hadoop.hdfs.server.namenode.EditLogInputStream: Fast-forwarding stream 'http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142682429&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54' to transaction ID 142682429
  110. 2016-06-30 10:48:38,718 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Edits file http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142682429&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54, http://adm-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142682429&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54 of size 2853 edits # 22 loaded in 0 seconds
  111. 2016-06-30 10:48:38,718 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Reading org.apache.hadoop.hdfs.server.namenode.RedundantEditLogInputStream@41254de4 expecting start txid #142682451
  112. <<SNIP>>
  113. 2016-06-30 10:48:39,586 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Start loading edits file http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54, http://adm-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54
  114. 2016-06-30 10:48:39,587 INFO org.apache.hadoop.hdfs.server.namenode.EditLogInputStream: Fast-forwarding stream 'http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54, http://adm-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54' to transaction ID 142682429
  115. 2016-06-30 10:48:39,587 INFO org.apache.hadoop.hdfs.server.namenode.EditLogInputStream: Fast-forwarding stream 'http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54' to transaction ID 142682429
  116. 2016-06-30 10:48:40,445 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Edits file http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54, http://adm-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142683015&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54 of size 2208108 edits # 11839 loaded in 0 seconds
  117. 2016-06-30 10:48:40,686 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Need to save fs image? false (staleImage=false, haEnabled=true, isRollingUpgrade=false)
  118. 2016-06-30 10:48:40,686 INFO org.apache.hadoop.hdfs.server.namenode.NameCache: initialized with 0 entries 0 lookups
  119. 2016-06-30 10:48:40,690 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Finished loading FSImage in 5904 msecs
  120. 2016-06-30 10:48:40,957 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Service RPC server is binding to inf-v1.archive.com:8022
  121. 2016-06-30 10:48:40,963 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
  122. 2016-06-30 10:48:40,983 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8022
  123. 2016-06-30 10:48:41,018 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Setting ADDRESS inf-v1.archive.com:8022
  124. 2016-06-30 10:48:41,019 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: RPC server is binding to inf-v1.archive.com:9000
  125. 2016-06-30 10:48:41,019 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
  126. 2016-06-30 10:48:41,020 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 9000
  127. 2016-06-30 10:48:41,030 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Registered FSNamesystemState MBean
  128. 2016-06-30 10:48:41,048 INFO org.apache.hadoop.hdfs.server.namenode.LeaseManager: Number of blocks under construction: 0
  129. 2016-06-30 10:48:41,049 INFO org.apache.hadoop.hdfs.server.namenode.LeaseManager: Number of blocks under construction: 0
  130. 2016-06-30 10:48:41,050 INFO org.apache.hadoop.hdfs.StateChange: STATE* Safe mode ON.
  131. 2016-06-30 10:48:41,102 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
  132. 2016-06-30 10:48:41,102 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 9000: starting
  133. 2016-06-30 10:48:41,111 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
  134. 2016-06-30 10:48:41,112 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8022: starting
  135. 2016-06-30 10:48:41,130 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: NameNode RPC up at: inf-v1.archive.com/10.10.10.82:9000
  136. 2016-06-30 10:48:41,130 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: NameNode service RPC up at: inf-v1.archive.com/10.10.10.82:8022
  137. 2016-06-30 10:48:41,130 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Starting services required for standby state
  138. 2016-06-30 10:48:41,138 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Will roll logs on active node at inf-v2.archive.com/10.10.10.83:8022 every 120 seconds.
  139. 2016-06-30 10:48:41,148 INFO org.apache.hadoop.hdfs.server.namenode.ha.StandbyCheckpointer: Starting standby checkpoint thread...
  140. 2016-06-30 10:48:42,582 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Stopping services started for standby state
  141. 2016-06-30 10:48:42,584 WARN org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Edit log tailer interrupted
  142. 2016-06-30 10:48:42,700 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Starting services required for active state
  143. 2016-06-30 10:48:42,720 INFO org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager: Starting recovery process for unclosed journal segments...
  144. 2016-06-30 10:48:42,881 INFO org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager: Successfully started new epoch 3
  145. 2016-06-30 10:48:42,881 INFO org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager: Beginning recovery of unclosed segment starting at txid 142694854
  146. 2016-06-30 10:48:42,966 INFO org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager: Recovery prepare phase complete. Responses:
  147. 2016-06-30 10:48:42,968 INFO org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager: Using longest log: 10.10.10.80:8485=segmentState {
  148. 2016-06-30 10:48:43,067 INFO org.apache.hadoop.hdfs.server.namenode.FileJournalManager: Recovering unfinalized segments in /usr/local/hadoop/name/current
  149. 2016-06-30 10:48:43,068 INFO org.apache.hadoop.hdfs.server.namenode.FileJournalManager: Recovering unfinalized segments in /usr/local/hadoop-nn/current
  150. 2016-06-30 10:48:43,068 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Catching up to latest edits from old active before taking over writer role in edits logs
  151. 2016-06-30 10:48:43,080 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Reading org.apache.hadoop.hdfs.server.namenode.RedundantEditLogInputStream@3354eefc expecting start txid #142694854
  152. 2016-06-30 10:48:43,082 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Start loading edits file http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142694854&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54, http://adm-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142694854&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54
  153. 2016-06-30 10:48:43,083 INFO org.apache.hadoop.hdfs.server.namenode.EditLogInputStream: Fast-forwarding stream 'http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142694854&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54, http://adm-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142694854&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54' to transaction ID 142694854
  154. 2016-06-30 10:48:43,083 INFO org.apache.hadoop.hdfs.server.namenode.EditLogInputStream: Fast-forwarding stream 'http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142694854&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54' to transaction ID 142694854
  155. 2016-06-30 10:48:43,112 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Edits file http://inf-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142694854&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54, http://adm-v1.archive.com:8480/getJournal?jid=nameservice1&segmentTxId=142694854&storageInfo=-60%3A978309183%3A1463427213312%3ACID-5617173a-ed03-4180-a950-de0b5f407d54 of size 1048576 edits # 9 loaded in 0 seconds
  156. 2016-06-30 10:48:43,122 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Loaded 9 edits starting from txid 142694853
  157. 2016-06-30 10:48:43,122 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager: Marking all datandoes as stale
  158. 2016-06-30 10:48:43,123 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Will take over writing edit logs at txnid 142694863
  159. 2016-06-30 10:48:43,131 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Starting log segment at 142694863
  160. 2016-06-30 10:48:43,482 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Starting CacheReplicationMonitor with interval 30000 milliseconds
  161. 2016-06-30 10:48:43,482 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 1110373523 milliseconds
  162. 2016-06-30 10:48:43,505 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 23 millisecond(s).
  163. 2016-06-30 10:48:47,537 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* registerDatanode: from DatanodeRegistration(10.10.10.85, datanodeUuid=dc43ee8e-42ea-4d17-afb0-dc4816c5e4ca, infoPort=50075, infoSecurePort=0, ipcPort=50020, storageInfo=lv=-56;cid=CID-5617173a-ed03-4180-a950-de0b5f407d54;nsid=978309183;c=1463427213312) storage dc43ee8e-42ea-4d17-afb0-dc4816c5e4ca
  164. 2016-06-30 10:48:47,544 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeDescriptor: Number of failed storage changes from 0 to 0
  165. 2016-06-30 10:48:47,546 INFO org.apache.hadoop.net.NetworkTopology: Adding a new node: /default/10.10.10.85:50010
  166. 2016-06-30 10:48:47,546 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockReportLeaseManager: Registered DN dc43ee8e-42ea-4d17-afb0-dc4816c5e4ca (10.10.10.85:50010).
  167. 2016-06-30 10:48:47,696 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeDescriptor: Number of failed storage changes from 0 to 0
  168. 2016-06-30 10:48:47,697 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeDescriptor: Adding new storage ID DS-9ed7edcd-8822-4ce0-bd9c-e755b327141a for DN 10.10.10.85:50010
  169. 2016-06-30 10:48:47,876 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* registerDatanode: from DatanodeRegistration(10.10.10.80, datanodeUuid=443b367a-f4c7-4abe-b705-fe3a06e32dbf, infoPort=50075, infoSecurePort=0, ipcPort=50020, storageInfo=lv=-56;cid=CID-5617173a-ed03-4180-a950-de0b5f407d54;nsid=978309183;c=1463427213312) storage 443b367a-f4c7-4abe-b705-fe3a06e32dbf
  170. 2016-06-30 10:48:47,877 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeDescriptor: Number of failed storage changes from 0 to 0
  171. 2016-06-30 10:48:47,877 INFO org.apache.hadoop.net.NetworkTopology: Adding a new node: /default/10.10.10.80:50010
  172. 2016-06-30 10:48:47,877 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockReportLeaseManager: Registered DN 443b367a-f4c7-4abe-b705-fe3a06e32dbf (10.10.10.80:50010).
  173. 2016-06-30 10:48:47,923 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Processing first storage report for DS-9ed7edcd-8822-4ce0-bd9c-e755b327141a from datanode dc43ee8e-42ea-4d17-afb0-dc4816c5e4ca
  174. 2016-06-30 10:48:48,310 INFO BlockStateChange: BLOCK* processReport: from storage DS-9ed7edcd-8822-4ce0-bd9c-e755b327141a node DatanodeRegistration(10.10.10.85, datanodeUuid=dc43ee8e-42ea-4d17-afb0-dc4816c5e4ca, infoPort=50075, infoSecurePort=0, ipcPort=50020, storageInfo=lv=-56;cid=CID-5617173a-ed03-4180-a950-de0b5f407d54;nsid=978309183;c=1463427213312), blocks: 44305, hasStaleStorage: false, processing time: 387 msecs
  175. 2016-06-30 10:48:48,311 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeDescriptor: Number of failed storage changes from 0 to 0
  176. 2016-06-30 10:48:48,312 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeDescriptor: Adding new storage ID DS-d7077514-495d-42b2-a2ec-9f76fcc43db4 for DN 10.10.10.80:50010
  177. 2016-06-30 10:48:48,454 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Processing first storage report for DS-d7077514-495d-42b2-a2ec-9f76fcc43db4 from datanode 443b367a-f4c7-4abe-b705-fe3a06e32dbf
  178. 2016-06-30 10:48:48,548 INFO BlockStateChange: BLOCK* processReport: from storage DS-d7077514-495d-42b2-a2ec-9f76fcc43db4 node DatanodeRegistration(10.10.10.80, datanodeUuid=443b367a-f4c7-4abe-b705-fe3a06e32dbf, infoPort=50075, infoSecurePort=0, ipcPort=50020, storageInfo=lv=-56;cid=CID-5617173a-ed03-4180-a950-de0b5f407d54;nsid=978309183;c=1463427213312), blocks: 35582, hasStaleStorage: false, processing time: 94 msecs
  179. 2016-06-30 10:48:48,918 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* registerDatanode: from DatanodeRegistration(10.10.10.83, datanodeUuid=8f0a3948-9579-4d60-b002-b2fec4811b08, infoPort=50075, infoSecurePort=0, ipcPort=50020, storageInfo=lv=-56;cid=CID-5617173a-ed03-4180-a950-de0b5f407d54;nsid=978309183;c=1463427213312) storage 8f0a3948-9579-4d60-b002-b2fec4811b08
  180. 2016-06-30 10:48:48,918 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeDescriptor: Number of failed storage changes from 0 to 0
  181. 2016-06-30 10:48:48,919 INFO org.apache.hadoop.net.NetworkTopology: Adding a new node: /default/10.10.10.83:50010
  182. 2016-06-30 10:48:48,919 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockReportLeaseManager: Registered DN 8f0a3948-9579-4d60-b002-b2fec4811b08 (10.10.10.83:50010).
  183. 2016-06-30 10:48:48,977 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeDescriptor: Number of failed storage changes from 0 to 0
  184. 2016-06-30 10:48:48,977 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeDescriptor: Adding new storage ID DS-6cb61d85-d3d4-4e98-ae2d-0313ab8941c4 for DN 10.10.10.83:50010
  185. 2016-06-30 10:48:49,141 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Processing first storage report for DS-6cb61d85-d3d4-4e98-ae2d-0313ab8941c4 from datanode 8f0a3948-9579-4d60-b002-b2fec4811b08
  186. 2016-06-30 10:48:49,183 INFO org.apache.hadoop.hdfs.StateChange: STATE* Safe mode extension entered.
RAW Paste Data
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy. OK, I Understand
 
Top