API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Sep 6th, 2011
108
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 17.16 KB | None | 0 0
raw download clone embed print report
  1. 2011-09-06 13:55:16,280 INFO org.apache.hadoop.mapred.JobTracker: STARTUP_MSG:
  2. /************************************************************
  3. STARTUP_MSG: Starting JobTracker
  4. STARTUP_MSG: host = rip-pc/127.0.0.1
  5. STARTUP_MSG: args = []
  6. STARTUP_MSG: version = 0.20.3-SNAPSHOT
  7. STARTUP_MSG: build = http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r 1156729; compiled by 'rip' on Mon Sep 5 19:08:31 IST 2011
  8. ************************************************************/
  9. 2011-09-06 13:55:16,383 INFO org.apache.hadoop.mapred.JobTracker: Scheduler configured with (memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT, limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (-1, -1, -1, -1)
  10. 2011-09-06 13:55:16,471 INFO org.apache.hadoop.ipc.metrics.RpcMetrics: Initializing RPC Metrics with hostName=JobTracker, port=54311
  11. 2011-09-06 13:55:21,556 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
  12. 2011-09-06 13:55:21,673 INFO org.apache.hadoop.http.HttpServer: Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 50030
  13. 2011-09-06 13:55:21,675 INFO org.apache.hadoop.http.HttpServer: listener.getLocalPort() returned 50030 webServer.getConnectors()[0].getLocalPort() returned 50030
  14. 2011-09-06 13:55:21,675 INFO org.apache.hadoop.http.HttpServer: Jetty bound to port 50030
  15. 2011-09-06 13:55:21,675 INFO org.mortbay.log: jetty-6.1.26
  16. 2011-09-06 13:55:22,060 INFO org.mortbay.log: Started SelectChannelConnector@0.0.0.0:50030
  17. 2011-09-06 13:55:22,062 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
  18. 2011-09-06 13:55:22,063 INFO org.apache.hadoop.mapred.JobTracker: JobTracker up at: 54311
  19. 2011-09-06 13:55:22,063 INFO org.apache.hadoop.mapred.JobTracker: JobTracker webserver: 50030
  20. 2011-09-06 13:55:22,295 INFO org.apache.hadoop.mapred.JobTracker: Cleaning up the system directory
  21. 2011-09-06 13:55:22,302 INFO org.apache.hadoop.mapred.JobTracker: problem cleaning system directory: hdfs://rip-pc.local:54310/home/rip/testing-datastore/mapred/system
  22. org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot delete /home/rip/testing-datastore/mapred/system. Name node is in safe mode.
  23. The ratio of reported blocks 0.0000 has not reached the threshold 0.9990. Safe mode will be turned off automatically.
  24. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.deleteInternal(FSNamesystem.java:1700)
  25. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:1680)
  26. at org.apache.hadoop.hdfs.server.namenode.NameNode.delete(NameNode.java:517)
  27. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  28. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
  29. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  30. at java.lang.reflect.Method.invoke(Method.java:616)
  31. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:508)
  32. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:961)
  33. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:957)
  34. at java.security.AccessController.doPrivileged(Native Method)
  35. at javax.security.auth.Subject.doAs(Subject.java:416)
  36. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:955)
  37.  
  38. at org.apache.hadoop.ipc.Client.call(Client.java:743)
  39. at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
  40. at $Proxy4.delete(Unknown Source)
  41. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  42. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
  43. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  44. at java.lang.reflect.Method.invoke(Method.java:616)
  45. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
  46. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
  47. at $Proxy4.delete(Unknown Source)
  48. at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:582)
  49. at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:227)
  50. at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:1703)
  51. at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:191)
  52. at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:183)
  53. at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:3712)
  54. 2011-09-06 13:55:32,312 INFO org.apache.hadoop.mapred.JobTracker: Cleaning up the system directory
  55. 2011-09-06 13:55:32,315 INFO org.apache.hadoop.mapred.JobTracker: problem cleaning system directory: hdfs://rip-pc.local:54310/home/rip/testing-datastore/mapred/system
  56. org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot delete /home/rip/testing-datastore/mapred/system. Name node is in safe mode.
  57. The ratio of reported blocks 1.0000 has reached the threshold 0.9990. Safe mode will be turned off automatically in 22 seconds.
  58. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.deleteInternal(FSNamesystem.java:1700)
  59. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:1680)
  60. at org.apache.hadoop.hdfs.server.namenode.NameNode.delete(NameNode.java:517)
  61. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  62. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
  63. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  64. at java.lang.reflect.Method.invoke(Method.java:616)
  65. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:508)
  66. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:961)
  67. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:957)
  68. at java.security.AccessController.doPrivileged(Native Method)
  69. at javax.security.auth.Subject.doAs(Subject.java:416)
  70. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:955)
  71.  
  72. at org.apache.hadoop.ipc.Client.call(Client.java:743)
  73. at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
  74. at $Proxy4.delete(Unknown Source)
  75. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  76. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
  77. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  78. at java.lang.reflect.Method.invoke(Method.java:616)
  79. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
  80. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
  81. at $Proxy4.delete(Unknown Source)
  82. at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:582)
  83. at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:227)
  84. at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:1703)
  85. at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:191)
  86. at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:183)
  87. at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:3712)
  88. 2011-09-06 13:55:42,324 INFO org.apache.hadoop.mapred.JobTracker: Cleaning up the system directory
  89. 2011-09-06 13:55:42,327 INFO org.apache.hadoop.mapred.JobTracker: problem cleaning system directory: hdfs://rip-pc.local:54310/home/rip/testing-datastore/mapred/system
  90. org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot delete /home/rip/testing-datastore/mapred/system. Name node is in safe mode.
  91. The ratio of reported blocks 1.0000 has reached the threshold 0.9990. Safe mode will be turned off automatically in 12 seconds.
  92. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.deleteInternal(FSNamesystem.java:1700)
  93. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:1680)
  94. at org.apache.hadoop.hdfs.server.namenode.NameNode.delete(NameNode.java:517)
  95. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  96. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
  97. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  98. at java.lang.reflect.Method.invoke(Method.java:616)
  99. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:508)
  100. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:961)
  101. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:957)
  102. at java.security.AccessController.doPrivileged(Native Method)
  103. at javax.security.auth.Subject.doAs(Subject.java:416)
  104. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:955)
  105.  
  106. at org.apache.hadoop.ipc.Client.call(Client.java:743)
  107. at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
  108. at $Proxy4.delete(Unknown Source)
  109. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  110. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
  111. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  112. at java.lang.reflect.Method.invoke(Method.java:616)
  113. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
  114. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
  115. at $Proxy4.delete(Unknown Source)
  116. at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:582)
  117. at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:227)
  118. at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:1703)
  119. at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:191)
  120. at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:183)
  121. at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:3712)
  122. 2011-09-06 13:55:52,338 INFO org.apache.hadoop.mapred.JobTracker: Cleaning up the system directory
  123. 2011-09-06 13:55:52,341 INFO org.apache.hadoop.mapred.JobTracker: problem cleaning system directory: hdfs://rip-pc.local:54310/home/rip/testing-datastore/mapred/system
  124. org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot delete /home/rip/testing-datastore/mapred/system. Name node is in safe mode.
  125. The ratio of reported blocks 1.0000 has reached the threshold 0.9990. Safe mode will be turned off automatically in 2 seconds.
  126. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.deleteInternal(FSNamesystem.java:1700)
  127. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:1680)
  128. at org.apache.hadoop.hdfs.server.namenode.NameNode.delete(NameNode.java:517)
  129. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  130. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
  131. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  132. at java.lang.reflect.Method.invoke(Method.java:616)
  133. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:508)
  134. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:961)
  135. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:957)
  136. at java.security.AccessController.doPrivileged(Native Method)
  137. at javax.security.auth.Subject.doAs(Subject.java:416)
  138. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:955)
  139.  
  140. at org.apache.hadoop.ipc.Client.call(Client.java:743)
  141. at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
  142. at $Proxy4.delete(Unknown Source)
  143. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  144. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
  145. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  146. at java.lang.reflect.Method.invoke(Method.java:616)
  147. at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
  148. at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
  149. at $Proxy4.delete(Unknown Source)
  150. at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:582)
  151. at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:227)
  152. at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:1703)
  153. at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:191)
  154. at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:183)
  155. at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:3712)
  156. 2011-09-06 13:56:02,350 INFO org.apache.hadoop.mapred.JobTracker: Cleaning up the system directory
  157. 2011-09-06 13:56:02,566 INFO org.apache.hadoop.mapred.CompletedJobStatusStore: Completed job store is inactive
  158. 2011-09-06 13:56:02,739 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
  159. 2011-09-06 13:56:02,739 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 54311: starting
  160. 2011-09-06 13:56:02,743 INFO org.apache.hadoop.ipc.Server: IPC Server handler 0 on 54311: starting
  161. 2011-09-06 13:56:02,743 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1 on 54311: starting
  162. 2011-09-06 13:56:02,744 INFO org.apache.hadoop.ipc.Server: IPC Server handler 2 on 54311: starting
  163. 2011-09-06 13:56:02,744 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 54311: starting
  164. 2011-09-06 13:56:02,744 INFO org.apache.hadoop.ipc.Server: IPC Server handler 4 on 54311: starting
  165. 2011-09-06 13:56:02,744 INFO org.apache.hadoop.ipc.Server: IPC Server handler 5 on 54311: starting
  166. 2011-09-06 13:56:02,745 INFO org.apache.hadoop.ipc.Server: IPC Server handler 6 on 54311: starting
  167. 2011-09-06 13:56:02,745 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 54311: starting
  168. 2011-09-06 13:56:02,745 INFO org.apache.hadoop.ipc.Server: IPC Server handler 8 on 54311: starting
  169. 2011-09-06 13:56:02,751 INFO org.apache.hadoop.mapred.JobTracker: Starting RUNNING
  170. 2011-09-06 13:56:02,751 INFO org.apache.hadoop.ipc.Server: IPC Server handler 9 on 54311: starting
  171. 2011-09-06 13:56:02,763 INFO org.apache.hadoop.ipc.Server: Error register getProtocolVersion
  172. java.lang.IllegalArgumentException: Duplicate metricsName:getProtocolVersion
  173. at org.apache.hadoop.metrics.util.MetricsRegistry.add(MetricsRegistry.java:53)
  174. at org.apache.hadoop.metrics.util.MetricsTimeVaryingRate.<init>(MetricsTimeVaryingRate.java:89)
  175. at org.apache.hadoop.metrics.util.MetricsTimeVaryingRate.<init>(MetricsTimeVaryingRate.java:99)
  176. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:523)
  177. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:961)
  178. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:957)
  179. at java.security.AccessController.doPrivileged(Native Method)
  180. at javax.security.auth.Subject.doAs(Subject.java:416)
  181. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:955)
  182. 2011-09-06 13:57:24,705 INFO org.apache.hadoop.mapred.JobTracker: Initializing job_201109061355_0001
  183. 2011-09-06 13:57:24,705 INFO org.apache.hadoop.mapred.JobInProgress: Initializing job_201109061355_0001
  184. 2011-09-06 13:57:24,968 INFO org.apache.hadoop.mapred.JobInProgress: Input size for job job_201109061355_0001 = 489773380. Number of splits = 8
  185. 2011-09-06 13:57:24,970 INFO org.apache.hadoop.net.NetworkTopology: Adding a new node: /default-rack/master
  186. 2011-09-06 13:57:24,970 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201109061355_0001_m_000000 has split on node:/default-rack/master
  187. 2011-09-06 13:57:24,971 INFO org.apache.hadoop.net.NetworkTopology: Adding a new node: /default-rack/slave3
  188. 2011-09-06 13:57:24,971 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201109061355_0001_m_000000 has split on node:/default-rack/slave3
  189. 2011-09-06 13:57:24,972 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201109061355_0001_m_000001 has split on node:/default-rack/master
  190. 2011-09-06 13:57:24,972 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201109061355_0001_m_000001 has split on node:/default-rack/slave3
  191. 2011-09-06 13:57:24,972 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201109061355_0001_m_000002 has split on node:/default-rack/slave3
  192. 2011-09-06 13:57:24,972 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201109061355_0001_m_000002 has split on node:/default-rack/master
  193. 2011-09-06 13:57:24,972 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201109061355_0001_m_000003 has split on node:/default-rack/master
  194. 2011-09-06 13:57:24,972 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201109061355_0001_m_000003 has split on node:/default-rack/slave3
  195. 2011-09-06 13:57:24,973 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201109061355_0001_m_000004 has split on node:/default-rack/master
  196. 2011-09-06 13:57:24,973 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201109061355_0001_m_000004 has split on node:/default-rack/slave3
  197. 2011-09-06 13:57:24,973 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201109061355_0001_m_000005 has split on node:/default-rack/slave3
  198. 2011-09-06 13:57:24,973 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201109061355_0001_m_000005 has split on node:/default-rack/master
  199. 2011-09-06 13:57:24,973 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201109061355_0001_m_000006 has split on node:/default-rack/slave3
  200. 2011-09-06 13:57:24,973 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201109061355_0001_m_000006 has split on node:/default-rack/master
  201. 2011-09-06 13:57:24,973 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201109061355_0001_m_000007 has split on node:/default-rack/master
  202. 2011-09-06 13:57:24,973 INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201109061355_0001_m_000007 has split on node:/default-rack/slave3
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!