Advertisement
Guest User

namenode.log

a guest
Feb 12th, 2017
246
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Bash 27.86 KB | None | 0 0
  1. 2017-02-12 16:24:58,249 INFO  namenode.NameNode (LogAdapter.java:info(47)) - STARTUP_MSG:
  2. /************************************************************
  3. STARTUP_MSG: Starting NameNode
  4. STARTUP_MSG:   user = hdfs
  5. STARTUP_MSG:   host = node0/127.0.1.1
  6. STARTUP_MSG:   args = []
  7. STARTUP_MSG:   version = 2.7.3.2.5.3.0-37
  8. STARTUP_MSG:   classpath = ...
  9. STARTUP_MSG:   build = git@github.com:hortonworks/hadoop.git -r 9828acfdec41a121f0121f556b09e2d112259e92; compiled by 'j
  10. enkins' on 2016-11-29T18:37Z
  11. STARTUP_MSG:   java = 1.8.0_77
  12. ************************************************************/
  13. 2017-02-12 16:24:58,268 INFO  namenode.NameNode (LogAdapter.java:info(47)) - registered UNIX signal handlers for [TERM,
  14. HUP, INT]
  15. 2017-02-12 16:24:58,271 INFO  namenode.NameNode (NameNode.java:createNameNode(1600)) - createNameNode []
  16. 2017-02-12 16:24:58,709 INFO  impl.MetricsConfig (MetricsConfig.java:loadFirst(112)) - loaded properties from hadoop-met
  17. rics2.properties
  18. 2017-02-12 16:24:58,868 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:startTimer(376)) - Scheduled snapshot perio
  19. d at 10 second(s).
  20. 2017-02-12 16:24:58,868 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:start(192)) - NameNode metrics system start
  21. ed
  22. 2017-02-12 16:24:58,878 INFO  namenode.NameNode (NameNode.java:setClientNamenodeAddress(450)) - fs.defaultFS is hdfs://n
  23. ode0:8020
  24. 2017-02-12 16:24:58,881 INFO  namenode.NameNode (NameNode.java:setClientNamenodeAddress(470)) - Clients are to use node0
  25. :8020 to access this namenode/service.
  26. 2017-02-12 16:24:59,149 INFO  util.JvmPauseMonitor (JvmPauseMonitor.java:run(179)) - Starting JVM pause monitor
  27. 2017-02-12 16:24:59,160 INFO  hdfs.DFSUtil (DFSUtil.java:httpServerTemplateForNNAndJN(1780)) - Starting Web-server for h
  28. dfs at: http://node0:50070
  29. 2017-02-12 16:24:59,237 INFO  mortbay.log (Slf4jLog.java:info(67)) - Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mo
  30. rtbay.log) via org.mortbay.log.Slf4jLog
  31. 2017-02-12 16:24:59,251 INFO  server.AuthenticationFilter (AuthenticationFilter.java:constructSecretProvider(293)) - Una
  32. ble to initialize FileSignerSecretProvider, falling back to use random secrets.
  33. 2017-02-12 16:24:59,259 INFO  http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.re
  34. quests.namenode is not defined
  35. 2017-02-12 16:24:59,267 INFO  http.HttpServer2 (HttpServer2.java:addGlobalFilter(754)) - Added global filter 'safety' (c
  36. lass=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
  37. 2017-02-12 16:24:59,274 INFO  http.HttpServer2 (HttpServer2.java:addFilter(729)) - Added filter static_user_filter (clas
  38. s=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs
  39. 2017-02-12 16:24:59,276 INFO  http.HttpServer2 (HttpServer2.java:addFilter(737)) - Added filter static_user_filter (clas
  40. s=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
  41. 2017-02-12 16:24:59,277 INFO  http.HttpServer2 (HttpServer2.java:addFilter(737)) - Added filter static_user_filter (clas
  42. s=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
  43. 2017-02-12 16:24:59,277 INFO  security.HttpCrossOriginFilterInitializer (HttpCrossOriginFilterInitializer.java:initFilte
  44. r(49)) - CORS filter not enabled. Please set hadoop.http.cross-origin.enabled to 'true' to enable it
  45. 2017-02-12 16:24:59,429 INFO  http.HttpServer2 (NameNodeHttpServer.java:initWebHdfs(93)) - Added filter 'org.apache.hado
  46. op.hdfs.web.AuthFilter' (class=org.apache.hadoop.hdfs.web.AuthFilter)
  47. 2017-02-12 16:24:59,430 INFO  http.HttpServer2 (HttpServer2.java:addJerseyResourcePackage(653)) - addJerseyResourcePacka
  48. ge: packageName=org.apache.hadoop.hdfs.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/web
  49. hdfs/v1/*
  50. 2017-02-12 16:24:59,454 INFO  http.HttpServer2 (HttpServer2.java:openListeners(959)) - Jetty bound to port 50070
  51. 2017-02-12 16:24:59,454 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.hwx
  52. 2017-02-12 16:24:59,734 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeS
  53. tartup@node0:50070
  54. 2017-02-12 16:24:59,774 WARN  common.Util (Util.java:stringAsURI(56)) - Path /hadoop/hdfs/namenode should be specified a
  55. s a URI in configuration files. Please update hdfs configuration.
  56. 2017-02-12 16:24:59,774 WARN  common.Util (Util.java:stringAsURI(56)) - Path /hadoop/hdfs/namenode should be specified a
  57. s a URI in configuration files. Please update hdfs configuration.
  58. 2017-02-12 16:24:59,774 WARN  namenode.FSNamesystem (FSNamesystem.java:checkConfiguration(656)) - Only one image storage
  59.  directory (dfs.namenode.name.dir) configured. Beware of data loss due to lack of redundant storage directories!
  60. 2017-02-12 16:24:59,776 WARN  namenode.FSNamesystem (FSNamesystem.java:checkConfiguration(661)) - Only one namespace edi
  61. ts storage directory (dfs.namenode.edits.dir) configured. Beware of data loss due to lack of redundant storage directori
  62. es!
  63. 2017-02-12 16:24:59,780 WARN  common.Util (Util.java:stringAsURI(56)) - Path /hadoop/hdfs/namenode should be specified a
  64. s a URI in configuration files. Please update hdfs configuration.
  65. 2017-02-12 16:24:59,784 WARN  common.Util (Util.java:stringAsURI(56)) - Path /hadoop/hdfs/namenode should be specified a
  66. s a URI in configuration files. Please update hdfs configuration.
  67. 2017-02-12 16:24:59,788 WARN  common.Storage (NNStorage.java:setRestoreFailedStorage(210)) - set restore failed storage
  68. to true
  69. 2017-02-12 16:24:59,827 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(725)) - No KeyProvider found.
  70. 2017-02-12 16:24:59,827 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(731)) - Enabling async auditlog
  71. 2017-02-12 16:24:59,830 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(735)) - fsLock is fair:false
  72. 2017-02-12 16:24:59,851 INFO  blockmanagement.HeartbeatManager (HeartbeatManager.java:<init>(90)) - Setting heartbeat re
  73. check interval to 30000 since dfs.namenode.stale.datanode.interval is less than dfs.namenode.heartbeat.recheck-interval
  74. 2017-02-12 16:24:59,867 INFO  blockmanagement.DatanodeManager (DatanodeManager.java:<init>(242)) - dfs.block.invalidate.
  75. limit=1000
  76. 2017-02-12 16:24:59,867 INFO  blockmanagement.DatanodeManager (DatanodeManager.java:<init>(248)) - dfs.namenode.datanode
  77. .registration.ip-hostname-check=true
  78. 2017-02-12 16:24:59,869 INFO  blockmanagement.BlockManager (InvalidateBlocks.java:printBlockDeletionTime(71)) - dfs.name
  79. node.startup.delay.block.deletion.sec is set to 000:01:00:00.000
  80. 2017-02-12 16:24:59,870 INFO  blockmanagement.BlockManager (InvalidateBlocks.java:printBlockDeletionTime(76)) - The bloc
  81. k deletion will start around 2017 Feb 12 17:24:59
  82. 2017-02-12 16:24:59,872 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map BlocksM
  83. ap
  84. 2017-02-12 16:24:59,872 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
  85. 2017-02-12 16:24:59,874 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 2.0% max memory 1011.3 MB = 20.2 M
  86. B
  87. 2017-02-12 16:24:59,874 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^21 = 2097152 ent
  88. ries
  89. 2017-02-12 16:24:59,879 INFO  blockmanagement.BlockManager (BlockManager.java:createBlockTokenSecretManager(401)) - dfs.
  90. block.access.token.enable=true
  91. 2017-02-12 16:24:59,879 INFO  blockmanagement.BlockManager (BlockManager.java:createBlockTokenSecretManager(422)) - dfs.
  92. block.access.key.update.interval=600 min(s), dfs.block.access.token.lifetime=600 min(s), dfs.encrypt.data.transfer.algor
  93. ithm=null
  94. 2017-02-12 16:25:00,094 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(387)) - defaultReplication
  95. = 3
  96. 2017-02-12 16:25:00,094 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(388)) - maxReplication
  97. = 50
  98. 2017-02-12 16:25:00,094 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(389)) - minReplication
  99. = 1
  100. 2017-02-12 16:25:00,094 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(390)) - maxReplicationStreams
  101. = 2
  102. 2017-02-12 16:25:00,094 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(391)) - replicationRecheckInterval
  103. = 3000
  104. 2017-02-12 16:25:00,094 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(392)) - encryptDataTransfer
  105. = false
  106. 2017-02-12 16:25:00,095 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(393)) - maxNumBlocksToLog
  107. = 1000
  108. 2017-02-12 16:25:00,103 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(755)) - fsOwner             = hdfs (auth:S
  109. IMPLE)
  110. 2017-02-12 16:25:00,103 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(756)) - supergroup          = hdfs
  111. 2017-02-12 16:25:00,103 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(757)) - isPermissionEnabled = true
  112. 2017-02-12 16:25:00,103 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(768)) - HA Enabled: false
  113. 2017-02-12 16:25:00,111 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(805)) - Append Enabled: true
  114. 2017-02-12 16:25:00,156 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map INodeMa
  115. p
  116. 2017-02-12 16:25:00,156 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
  117. 2017-02-12 16:25:00,160 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 1.0% max memory 1011.3 MB = 10.1 M
  118. B
  119. 2017-02-12 16:25:00,160 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^20 = 1048576 ent
  120. ries
  121. 2017-02-12 16:25:00,161 INFO  namenode.FSDirectory (FSDirectory.java:<init>(250)) - ACLs enabled? false
  122. 2017-02-12 16:25:00,161 INFO  namenode.FSDirectory (FSDirectory.java:<init>(254)) - XAttrs enabled? true
  123. 2017-02-12 16:25:00,162 INFO  namenode.FSDirectory (FSDirectory.java:<init>(262)) - Maximum size of an xattr: 16384
  124. 2017-02-12 16:25:00,162 INFO  namenode.NameNode (FSDirectory.java:<init>(315)) - Caching file names occuring more than 1
  125. 0 times
  126. 2017-02-12 16:25:00,174 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map cachedB
  127. locks
  128. 2017-02-12 16:25:00,175 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
  129. 2017-02-12 16:25:00,178 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.25% max memory 1011.3 MB = 2.5 M
  130. B
  131. 2017-02-12 16:25:00,178 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^18 = 262144 entr
  132. ies
  133. 2017-02-12 16:25:00,180 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(5354)) - dfs.namenode.safemode.threshold-p
  134. ct = 1.0
  135. 2017-02-12 16:25:00,180 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(5355)) - dfs.namenode.safemode.min.datanod
  136. es = 0
  137. 2017-02-12 16:25:00,180 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(5356)) - dfs.namenode.safemode.extension
  138.    = 30000
  139. 2017-02-12 16:25:00,182 INFO  metrics.TopMetrics (TopMetrics.java:logConf(65)) - NNTop conf: dfs.namenode.top.window.num
  140. .buckets = 10
  141. 2017-02-12 16:25:00,182 INFO  metrics.TopMetrics (TopMetrics.java:logConf(67)) - NNTop conf: dfs.namenode.top.num.users
  142. = 10
  143. 2017-02-12 16:25:00,182 INFO  metrics.TopMetrics (TopMetrics.java:logConf(69)) - NNTop conf: dfs.namenode.top.windows.mi
  144. nutes = 1,5,25
  145. 2017-02-12 16:25:00,187 INFO  namenode.FSNamesystem (FSNamesystem.java:initRetryCache(915)) - Retry cache on namenode is
  146.  enabled
  147. 2017-02-12 16:25:00,188 INFO  namenode.FSNamesystem (FSNamesystem.java:initRetryCache(923)) - Retry cache will use 0.03
  148. of total heap and retry cache entry expiry time is 600000 millis
  149. 2017-02-12 16:25:00,189 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map NameNod
  150. eRetryCache
  151. 2017-02-12 16:25:00,190 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
  152. 2017-02-12 16:25:00,190 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.029999999329447746% max memory 1
  153. 011.3 MB = 310.7 KB
  154. 2017-02-12 16:25:00,190 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^15 = 32768 entri
  155. es
  156. 2017-02-12 16:25:00,211 INFO  common.Storage (Storage.java:tryLock(774)) - Lock on /hadoop/hdfs/namenode/in_use.lock acq
  157. uired by nodename 10822@node0
  158. 2017-02-12 16:25:00,314 INFO  namenode.FileJournalManager (FileJournalManager.java:recoverUnfinalizedSegments(388)) - Re
  159. covering unfinalized segments in /hadoop/hdfs/namenode/current
  160. 2017-02-12 16:25:00,366 INFO  namenode.FileJournalManager (FileJournalManager.java:finalizeLogSegment(142)) - Finalizing
  161.  edits file /hadoop/hdfs/namenode/current/edits_inprogress_0000000000000000010 -> /hadoop/hdfs/namenode/current/edits_00
  162. 00000000000000010-0000000000000000010
  163. 2017-02-12 16:25:00,374 INFO  namenode.FSImage (FSImage.java:loadFSImageFile(736)) - Planning to load image: FSImageFile
  164. (file=/hadoop/hdfs/namenode/current/fsimage_0000000000000000009, cpktTxId=0000000000000000009)
  165. 2017-02-12 16:25:00,433 INFO  namenode.FSImageFormatPBINode (FSImageFormatPBINode.java:loadINodeSection(255)) - Loading
  166. 4 INodes.
  167. 2017-02-12 16:25:00,481 INFO  namenode.FSImageFormatProtobuf (FSImageFormatProtobuf.java:load(184)) - Loaded FSImage in
  168. 0 seconds.
  169. 2017-02-12 16:25:00,486 INFO  namenode.FSImage (FSImage.java:loadFSImage(976)) - Loaded image for txid 9 from /hadoop/hd
  170. fs/namenode/current/fsimage_0000000000000000009
  171. 2017-02-12 16:25:00,486 INFO  namenode.FSImage (FSImage.java:loadEdits(840)) - Reading org.apache.hadoop.hdfs.server.nam
  172. enode.RedundantEditLogInputStream@7651218e expecting start txid #10
  173. 2017-02-12 16:25:00,487 INFO  namenode.FSImage (FSEditLogLoader.java:loadFSEdits(142)) - Start loading edits file /hadoo
  174. p/hdfs/namenode/current/edits_0000000000000000010-0000000000000000010
  175. 2017-02-12 16:25:00,488 INFO  namenode.RedundantEditLogInputStream (RedundantEditLogInputStream.java:nextOp(177)) - Fast
  176. -forwarding stream '/hadoop/hdfs/namenode/current/edits_0000000000000000010-0000000000000000010' to transaction ID 10
  177. 2017-02-12 16:25:00,491 INFO  namenode.FSImage (FSEditLogLoader.java:loadFSEdits(145)) - Edits file /hadoop/hdfs/namenod
  178. e/current/edits_0000000000000000010-0000000000000000010 of size 1048576 edits # 1 loaded in 0 seconds
  179. 2017-02-12 16:25:00,498 INFO  namenode.FSNamesystem (FSNamesystem.java:loadFSImage(1022)) - Need to save fs image? true
  180. (staleImage=true, haEnabled=false, isRollingUpgrade=false)
  181. 2017-02-12 16:25:00,498 INFO  namenode.FSImage (FSImage.java:saveNamespace(1096)) - Save namespace ...
  182. 2017-02-12 16:25:00,503 INFO  namenode.FSImageFormatProtobuf (FSImageFormatProtobuf.java:save(413)) - Saving image file
  183. /hadoop/hdfs/namenode/current/fsimage.ckpt_0000000000000000010 using no compression
  184. 2017-02-12 16:25:00,650 INFO  namenode.FSImageFormatProtobuf (FSImageFormatProtobuf.java:save(416)) - Image file /hadoop
  185. /hdfs/namenode/current/fsimage.ckpt_0000000000000000010 of size 550 bytes saved in 0 seconds.
  186. 2017-02-12 16:25:00,682 INFO  namenode.NNStorageRetentionManager (NNStorageRetentionManager.java:getImageTxIdToRetain(20
  187. 3)) - Going to retain 2 images with txid >= 9
  188. 2017-02-12 16:25:00,682 INFO  namenode.NNStorageRetentionManager (NNStorageRetentionManager.java:purgeImage(225)) - Purg
  189. ing old image FSImageFile(file=/hadoop/hdfs/namenode/current/fsimage_0000000000000000000, cpktTxId=0000000000000000000)
  190. 2017-02-12 16:25:00,706 INFO  namenode.FSEditLog (FSEditLog.java:startLogSegment(1237)) - Starting log segment at 11
  191. 2017-02-12 16:25:00,894 INFO  namenode.NameCache (NameCache.java:initialized(143)) - initialized with 0 entries 0 lookup
  192. s
  193. 2017-02-12 16:25:00,894 INFO  namenode.FSNamesystem (FSNamesystem.java:loadFromDisk(697)) - Finished loading FSImage in
  194. 697 msecs
  195. 2017-02-12 16:25:01,248 INFO  namenode.NameNode (NameNodeRpcServer.java:<init>(422)) - RPC server is binding to node0:80
  196. 20
  197. 2017-02-12 16:25:01,262 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(75)) - Using callQueue: class java.util
  198. .concurrent.LinkedBlockingQueue scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler
  199. 2017-02-12 16:25:01,283 INFO  ipc.Server (Server.java:run(811)) - Starting Socket Reader #1 for port 8020
  200. 2017-02-12 16:25:01,327 INFO  namenode.FSNamesystem (FSNamesystem.java:registerMBean(6289)) - Registered FSNamesystemSta
  201. te MBean
  202. 2017-02-12 16:25:01,329 WARN  common.Util (Util.java:stringAsURI(56)) - Path /hadoop/hdfs/namenode should be specified a
  203. s a URI in configuration files. Please update hdfs configuration.
  204. 2017-02-12 16:25:01,344 INFO  namenode.LeaseManager (LeaseManager.java:getNumUnderConstructionBlocks(138)) - Number of b
  205. locks under construction: 0
  206. 2017-02-12 16:25:01,345 INFO  namenode.FSNamesystem (FSNamesystem.java:initializeReplQueues(1212)) - initializing replic
  207. ation queues
  208. 2017-02-12 16:25:01,348 INFO  hdfs.StateChange (FSNamesystem.java:leave(5441)) - STATE* Leaving safe mode after 1 secs
  209. 2017-02-12 16:25:01,348 INFO  hdfs.StateChange (FSNamesystem.java:leave(5453)) - STATE* Network topology has 0 racks and
  210.  0 datanodes
  211. 2017-02-12 16:25:01,348 INFO  hdfs.StateChange (FSNamesystem.java:leave(5456)) - STATE* UnderReplicatedBlocks has 0 bloc
  212. ks
  213. 2017-02-12 16:25:01,354 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateHeartbeatState(451)) - N
  214. umber of failed storage changes from 0 to 0
  215. 2017-02-12 16:25:01,364 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2915)) - Total n
  216. umber of blocks            = 0
  217. 2017-02-12 16:25:01,364 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2916)) - Number
  218. of invalid blocks          = 0
  219. 2017-02-12 16:25:01,364 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2917)) - Number
  220. of under-replicated blocks = 0
  221. 2017-02-12 16:25:01,364 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2918)) - Number
  222. of  over-replicated blocks = 0
  223. 2017-02-12 16:25:01,364 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2920)) - Number
  224. of blocks being written    = 0
  225. 2017-02-12 16:25:01,364 INFO  hdfs.StateChange (BlockManager.java:processMisReplicatesAsync(2921)) - STATE* Replication
  226. Queue initialization scan for invalid, over- and under-replicated blocks completed in 16 msec
  227. 2017-02-12 16:25:01,367 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  228. Replications = 0, pendingReplications = 0.
  229. 2017-02-12 16:25:01,416 INFO  ipc.Server (Server.java:run(1045)) - IPC Server Responder: starting
  230. 2017-02-12 16:25:01,417 INFO  ipc.Server (Server.java:run(881)) - IPC Server listener on 8020: starting
  231. 2017-02-12 16:25:01,429 INFO  namenode.NameNode (NameNode.java:startCommonServices(876)) - NameNode RPC up at: node0/127
  232. .0.1.1:8020
  233. 2017-02-12 16:25:01,430 INFO  namenode.FSNamesystem (FSNamesystem.java:startActiveServices(1130)) - Starting services re
  234. quired for active state
  235. 2017-02-12 16:25:01,436 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(161)) - Starting
  236.  CacheReplicationMonitor with interval 30000 milliseconds
  237. 2017-02-12 16:25:03,040 INFO  ipc.Server (Server.java:logException(2401)) - IPC Server handler 0 on 8020, call org.apach
  238. e.hadoop.hdfs.server.protocol.DatanodeProtocol.sendHeartbeat from 127.0.0.1:42972 Call#687 Retry#0
  239. org.apache.hadoop.ipc.RetriableException: NameNode still not started
  240.         at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.checkNNStartup(NameNodeRpcServer.java:2057)
  241.         at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.sendHeartbeat(NameNodeRpcServer.java:1414)
  242.         at org.apache.hadoop.hdfs.protocolPB.DatanodeProtocolServerSideTranslatorPB.sendHeartbeat(DatanodeProtocolServer
  243. SideTranslatorPB.java:118)
  244.         at org.apache.hadoop.hdfs.protocol.proto.DatanodeProtocolProtos$DatanodeProtocolService$2.callBlockingMethod(Dat
  245. anodeProtocolProtos.java:29064)
  246.         at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:640)
  247.         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:982)
  248.         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2313)
  249.         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2309)
  250.         at java.security.AccessController.doPrivileged(Native Method)
  251.         at javax.security.auth.Subject.doAs(Subject.java:422)
  252.         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
  253.         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2307)
  254. 2017-02-12 16:25:03,080 INFO  fs.TrashPolicyDefault (TrashPolicyDefault.java:<init>(224)) - The configured checkpoint in
  255. terval is 0 minutes. Using an interval of 360 minutes that is used for deletion instead
  256. 2017-02-12 16:25:04,204 INFO  hdfs.StateChange (DatanodeManager.java:registerDatanode(915)) - BLOCK* registerDatanode: f
  257. rom DatanodeRegistration(127.0.0.1:50010, datanodeUuid=5fd8a6b1-e4c9-420d-94a0-e80f3ff21e01, infoPort=50075, infoSecureP
  258. ort=0, ipcPort=8010, storageInfo=lv=-56;cid=CID-032ec285-ae65-4c80-9f81-dd0ad44b24af;nsid=1539198905;c=0) storage 5fd8a6
  259. b1-e4c9-420d-94a0-e80f3ff21e01
  260. 2017-02-12 16:25:04,211 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateHeartbeatState(451)) - N
  261. umber of failed storage changes from 0 to 0
  262. 2017-02-12 16:25:04,238 INFO  net.NetworkTopology (NetworkTopology.java:add(426)) - Adding a new node: /default-rack/127
  263. .0.0.1:50010
  264. 2017-02-12 16:25:04,238 INFO  blockmanagement.BlockReportLeaseManager (BlockReportLeaseManager.java:registerNode(205)) -
  265.  Registered DN 5fd8a6b1-e4c9-420d-94a0-e80f3ff21e01 (127.0.0.1:50010).
  266. 2017-02-12 16:25:04,265 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateHeartbeatState(451)) - N
  267. umber of failed storage changes from 0 to 0
  268. 2017-02-12 16:25:04,265 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(868)) - Adding n
  269. ew storage ID DS-d7dfb072-6922-4c87-8b11-4cfb567d1591 for DN 127.0.0.1:50010
  270. 2017-02-12 16:25:04,368 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  271. Replications = 0, pendingReplications = 0.
  272. 2017-02-12 16:25:07,368 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  273. Replications = 0, pendingReplications = 0.
  274. 2017-02-12 16:25:10,369 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  275. Replications = 0, pendingReplications = 0.
  276. 2017-02-12 16:25:13,369 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  277. Replications = 0, pendingReplications = 0.
  278. 2017-02-12 16:25:16,371 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  279. Replications = 0, pendingReplications = 0.
  280. 2017-02-12 16:25:19,372 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  281. Replications = 0, pendingReplications = 0.
  282. 2017-02-12 16:25:22,372 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  283. Replications = 0, pendingReplications = 0.
  284. 2017-02-12 16:25:25,373 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  285. Replications = 0, pendingReplications = 0.
  286. 2017-02-12 16:25:28,373 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  287. Replications = 0, pendingReplications = 0.
  288. 2017-02-12 16:25:31,374 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  289. Replications = 0, pendingReplications = 0.
  290. 2017-02-12 16:25:34,374 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  291. Replications = 0, pendingReplications = 0.
  292. 2017-02-12 16:25:37,374 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  293. Replications = 0, pendingReplications = 0.
  294. 2017-02-12 16:25:40,375 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  295. Replications = 0, pendingReplications = 0.
  296. 2017-02-12 16:25:43,375 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  297. Replications = 0, pendingReplications = 0.
  298. 2017-02-12 16:25:46,376 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  299. Replications = 0, pendingReplications = 0.
  300. 2017-02-12 16:25:49,376 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  301. Replications = 0, pendingReplications = 0.
  302. 2017-02-12 16:25:52,377 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  303. Replications = 0, pendingReplications = 0.
  304. 2017-02-12 16:25:55,378 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  305. Replications = 0, pendingReplications = 0.
  306. 2017-02-12 16:25:58,378 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  307. Replications = 0, pendingReplications = 0.
  308. 2017-02-12 16:26:01,379 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  309. Replications = 0, pendingReplications = 0.
  310. 2017-02-12 16:26:04,379 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  311. Replications = 0, pendingReplications = 0.
  312. 2017-02-12 16:26:07,380 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  313. Replications = 0, pendingReplications = 0.
  314. 2017-02-12 16:26:10,380 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  315. Replications = 0, pendingReplications = 0.
  316. 2017-02-12 16:26:13,381 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  317. Replications = 0, pendingReplications = 0.
  318. 2017-02-12 16:26:16,382 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  319. Replications = 0, pendingReplications = 0.
  320. 2017-02-12 16:26:19,382 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  321. Replications = 0, pendingReplications = 0.
  322. 2017-02-12 16:26:22,383 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  323. Replications = 0, pendingReplications = 0.
  324. 2017-02-12 16:26:25,384 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  325. Replications = 0, pendingReplications = 0.
  326. 2017-02-12 16:26:28,384 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  327. Replications = 0, pendingReplications = 0.
  328. 2017-02-12 16:26:31,385 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  329. Replications = 0, pendingReplications = 0.
  330. 2017-02-12 16:26:34,386 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  331. Replications = 0, pendingReplications = 0.
  332. 2017-02-12 16:26:37,387 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  333. Replications = 0, pendingReplications = 0.
  334. 2017-02-12 16:26:40,388 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  335. Replications = 0, pendingReplications = 0.
  336. 2017-02-12 16:26:43,390 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  337. Replications = 0, pendingReplications = 0.
  338. 2017-02-12 16:26:46,293 INFO  BlockStateChange (BlockManager.java:processReport(1998)) - BLOCK* processReport: from stor
  339. age DS-d7dfb072-6922-4c87-8b11-4cfb567d1591 node DatanodeRegistration(127.0.0.1:50010, datanodeUuid=5fd8a6b1-e4c9-420d-9
  340. 4a0-e80f3ff21e01, infoPort=50075, infoSecurePort=0, ipcPort=8010, storageInfo=lv=-56;cid=CID-032ec285-ae65-4c80-9f81-dd0
  341. ad44b24af;nsid=1539198905;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0
  342. 2017-02-12 16:26:46,391 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  343. Replications = 0, pendingReplications = 0.
  344. 2017-02-12 16:26:49,392 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1588)) - BLOCK* needed
  345. Replications = 0, pendingReplications = 0.
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement