API tools faq
paste
Guest User

Giraph_Local_exec_log

a guest
Nov 4th, 2014
204
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 11.43 KB | None | 0 0
raw download clone embed print report
  1. 14/11/04 17:07:10 INFO Configuration.deprecation: mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
  2. 14/11/04 17:07:10 INFO Configuration.deprecation: mapred.job.map.memory.mb is deprecated. Instead, use mapreduce.map.memory.mb
  3. 14/11/04 17:07:10 INFO Configuration.deprecation: mapred.job.reduce.memory.mb is deprecated. Instead, use mapreduce.reduce.memory.mb
  4. 14/11/04 17:07:10 INFO Configuration.deprecation: mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
  5. 14/11/04 17:07:10 INFO Configuration.deprecation: mapreduce.user.classpath.first is deprecated. Instead, use mapreduce.job.user.classpath.first
  6. 14/11/04 17:07:10 INFO Configuration.deprecation: mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
  7. 14/11/04 17:07:10 INFO job.GiraphJob: run: Since checkpointing is disabled (default), do not allow any task retries (setting mapred.map.max.attempts = 1, old value = 4)
  8. 14/11/04 17:07:10 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
  9. 14/11/04 17:07:10 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
  10. 14/11/04 17:07:10 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
  11. 14/11/04 17:07:11 INFO mapreduce.JobSubmitter: number of splits:2
  12. 14/11/04 17:07:11 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_local168799338_0001
  13. 14/11/04 17:07:11 WARN conf.Configuration: file:/tmp/hadoop-kgarimella/mapred/staging/kgarimella168799338/.staging/job_local168799338_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
  14. 14/11/04 17:07:11 WARN conf.Configuration: file:/tmp/hadoop-kgarimella/mapred/staging/kgarimella168799338/.staging/job_local168799338_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
  15. 14/11/04 17:07:12 WARN conf.Configuration: file:/tmp/hadoop-kgarimella/mapred/local/localRunner/kgarimella/job_local168799338_0001/job_local168799338_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
  16. 14/11/04 17:07:12 WARN conf.Configuration: file:/tmp/hadoop-kgarimella/mapred/local/localRunner/kgarimella/job_local168799338_0001/job_local168799338_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
  17. 14/11/04 17:07:12 INFO mapreduce.Job: The url to track the job: http://localhost:8080/
  18. 14/11/04 17:07:12 INFO job.GiraphJob: Tracking URL: http://localhost:8080/
  19. 14/11/04 17:07:12 INFO job.GiraphJob: Waiting for resources... Job will start only when it gets all 2 mappers
  20. 14/11/04 17:07:12 INFO mapred.LocalJobRunner: OutputCommitter set in config null
  21. 14/11/04 17:07:12 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.giraph.io.internal.WrappedVertexOutputFormat$2
  22. 14/11/04 17:07:12 INFO mapred.LocalJobRunner: Waiting for map tasks
  23. 14/11/04 17:07:12 INFO mapred.LocalJobRunner: Starting task: attempt_local168799338_0001_m_000000_0
  24. 14/11/04 17:07:12 INFO util.ProcfsBasedProcessTree: ProcfsBasedProcessTree currently is supported only on Linux.
  25. 14/11/04 17:07:12 INFO mapred.Task: Using ResourceCalculatorProcessTree : null
  26. 14/11/04 17:07:12 INFO mapred.MapTask: Processing split: 'org.apache.giraph.bsp.BspInputSplit, index=-1, num=-1
  27. 14/11/04 17:07:12 INFO graph.GraphTaskManager: setup: Log level remains at info
  28. 14/11/04 17:07:12 INFO Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition
  29. 14/11/04 17:07:12 INFO Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id
  30. 14/11/04 17:07:12 INFO Configuration.deprecation: job.local.dir is deprecated. Instead, use mapreduce.job.local.dir
  31. 14/11/04 17:07:12 INFO zk.ZooKeeperManager: createCandidateStamp: Made the directory _bsp/_defaultZkManagerDir/job_local168799338_0001
  32. 14/11/04 17:07:12 INFO zk.ZooKeeperManager: createCandidateStamp: Made the directory _bsp/_defaultZkManagerDir/job_local168799338_0001/_zkServer
  33. 14/11/04 17:07:12 INFO zk.ZooKeeperManager: createCandidateStamp: Creating my filestamp _bsp/_defaultZkManagerDir/job_local168799338_0001/_task/**** 0
  34. 14/11/04 17:07:12 INFO zk.ZooKeeperManager: getZooKeeperServerList: Got [****] 1 hosts from 1 candidates when 1 required (polling period is 3000) on attempt 0
  35. 14/11/04 17:07:12 INFO zk.ZooKeeperManager: createZooKeeperServerList: Creating the final ZooKeeper file '_bsp/_defaultZkManagerDir/job_local168799338_0001/zkServerList_**** 0 '
  36. 14/11/04 17:07:12 INFO zk.ZooKeeperManager: getZooKeeperServerList: For task 0, got file 'zkServerList_**** 0 ' (polling period is 3000)
  37. 14/11/04 17:07:12 INFO zk.ZooKeeperManager: getZooKeeperServerList: Found [****, 0] 2 hosts in filename 'zkServerList_**** 0 '
  38. 14/11/04 17:07:12 INFO zk.ZooKeeperManager: onlineZooKeeperServers: Trying to delete old directory /Users/kgarimella/Documents/workspace/giraph-test32/_bsp/_defaultZkManagerDir
  39. 14/11/04 17:07:12 INFO zk.ZooKeeperManager: generateZooKeeperConfigFile: Creating file /Users/kgarimella/Documents/workspace/giraph-test32/_bsp/_defaultZkManagerDir/zoo.cfg in /Users/kgarimella/Documents/workspace/giraph-test32/_bsp/_defaultZkManagerDir with base port 22181
  40. 14/11/04 17:07:12 INFO zk.ZooKeeperManager: generateZooKeeperConfigFile: Make directory of _defaultZkManagerDir = true
  41. 14/11/04 17:07:12 INFO zk.ZooKeeperManager: generateZooKeeperConfigFile: Delete of zoo.cfg = false
  42. 14/11/04 17:07:12 INFO zk.ZooKeeperManager: onlineZooKeeperServers: Attempting to start ZooKeeper server with command ...
  43. /Users/kgarimella/Documents/workspace/giraph-test32/_bsp/_defaultZkManagerDir
  44. 14/11/04 17:07:12 INFO zk.ZooKeeperManager: onlineZooKeeperServers: Shutdown hook added.
  45. 14/11/04 17:07:12 INFO zk.ZooKeeperManager: onlineZooKeeperServers: Connect attempt 0 of 10 max trying to connect to **** with poll msecs = 3000
  46. 14/11/04 17:07:13 INFO zk.ZooKeeperManager: onlineZooKeeperServers: Connected to ****!
  47. 14/11/04 17:07:13 INFO zk.ZooKeeperManager: onlineZooKeeperServers: Creating my filestamp _bsp/_defaultZkManagerDir/job_local168799338_0001/_zkServer/**** 0
  48. 14/11/04 17:07:13 INFO graph.GraphTaskManager: setup: Chosen to run ZooKeeper...
  49. 14/11/04 17:07:13 INFO graph.GraphTaskManager: setup: Starting up BspServiceMaster (master thread)...
  50. 14/11/04 17:07:13 INFO bsp.BspService: BspService: Path to create to halt is /_hadoopBsp/job_local168799338_0001/_haltComputation
  51. 14/11/04 17:07:13 INFO bsp.BspService: BspService: Connecting to ZooKeeper with job job_local168799338_0001, 0 on ****
  52. 14/11/04 17:07:13 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
  53. 14/11/04 17:07:13 INFO zookeeper.ZooKeeper: Client environment:host.name=****
  54. 14/11/04 17:07:13 INFO zookeeper.ZooKeeper: Client environment:java.version=1.7.0_71
  55. 14/11/04 17:07:13 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
  56. 14/11/04 17:07:13 INFO zookeeper.ZooKeeper: Client environment:java.home=/Library/Java/JavaVirtualMachines/jdk1.7.0_71.jdk/Contents/Home/jre
  57. 14/11/04 17:07:13 INFO zookeeper.ZooKeeper: Client 14/11/04 17:07:13 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/Users/kgarimella/hadoop/lib/native
  58. 14/11/04 17:07:13 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/var/folders/k4/mgqgj2yx7tnb80342svrrl8w002ntw/T/
  59. 14/11/04 17:07:13 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
  60. 14/11/04 17:07:13 INFO zookeeper.ZooKeeper: Client environment:os.name=Mac OS X
  61. 14/11/04 17:07:13 INFO zookeeper.ZooKeeper: Client environment:os.arch=x86_64
  62. 14/11/04 17:07:13 INFO zookeeper.ZooKeeper: Client environment:os.version=10.10
  63. 14/11/04 17:07:13 INFO zookeeper.ZooKeeper: Client environment:user.name=kgarimella
  64. 14/11/04 17:07:13 INFO zookeeper.ZooKeeper: Client environment:user.home=/Users/kgarimella
  65. 14/11/04 17:07:13 INFO zookeeper.ZooKeeper: Client environment:user.dir=/Users/kgarimella/Documents/workspace/giraph-test32
  66. 14/11/04 17:07:13 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=**** sessionTimeout=60000 watcher=org.apache.giraph.master.BspServiceMaster@5a8e394c
  67. 14/11/04 17:07:13 INFO zookeeper.ClientCnxn: Opening socket connection to server ****. Will not attempt to authenticate using SASL (unknown error)
  68. 14/11/04 17:07:13 INFO zookeeper.ClientCnxn: Socket connection established to ****, initiating session
  69. 14/11/04 17:07:13 INFO zookeeper.ClientCnxn: Session establishment complete on server *****, sessionid = 0x1497b8f5ae30000, negotiated timeout = 600000
  70. 14/11/04 17:07:13 INFO bsp.BspService: process: Asynchronous connection complete.
  71. 14/11/04 17:07:13 INFO graph.GraphTaskManager: map: No need to do anything when not a worker
  72. 14/11/04 17:07:13 INFO graph.GraphTaskManager: cleanup: Starting for MASTER_ZOOKEEPER_ONLY
  73. 14/11/04 17:07:13 INFO master.BspServiceMaster: becomeMaster: First child is ......
  74. 14/11/04 17:07:13 INFO netty.NettyServer: NettyServer: Using execution group with 8 threads for requestFrameDecoder.
  75. 14/11/04 17:07:13 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
  76. 14/11/04 17:07:13 INFO netty.NettyServer: start: Started server communication server: **** with up to 16 threads on bind attempt 0 with sendBufferSize = 32768 receiveBufferSize = 524288
  77. 14/11/04 17:07:13 INFO netty.NettyClient: NettyClient: Using execution handler with 8 threads after request-encoder.
  78. 14/11/04 17:07:13 INFO master.BspServiceMaster: becomeMaster: I am now the master!
  79. 14/11/04 17:07:13 INFO bsp.BspService: process: applicationAttemptChanged signaled
  80. 14/11/04 17:07:13 WARN bsp.BspService: process: Unknown and unprocessed event (path=/_hadoopBsp/job_local168799338_0001/_applicationAttemptsDir/0/_superstepDir, type=NodeChildrenChanged, state=SyncConnected)
  81. 14/11/04 17:07:18 INFO mapred.LocalJobRunner: MASTER_ZOOKEEPER_ONLY checkWorkers: Only found 0 responses of 1 needed to start superstep -1 > map
  82. 14/11/04 17:07:18 INFO job.HaltApplicationUtils$DefaultHaltInstructionsWriter: writeHaltInstructions: To halt after next superstep execute: 'bin/halt-application --zkServer **** --zkNode /_hadoopBsp/job_local168799338_0001/_haltComputation'
  83. 14/11/04 17:07:18 INFO mapreduce.Job: Running job: job_local168799338_0001
  84. 14/11/04 17:07:19 INFO mapreduce.Job: Job job_local168799338_0001 running in uber mode : false
  85. 14/11/04 17:07:19 INFO mapreduce.Job: map 50% reduce 0%
  86. 14/11/04 17:07:27 INFO mapred.LocalJobRunner: MASTER_ZOOKEEPER_ONLY checkWorkers: Only found 0 responses of 1 needed to start superstep -1 > map
  87. 14/11/04 17:07:39 INFO mapred.LocalJobRunner: MASTER_ZOOKEEPER_ONLY checkWorkers: Only found 0 responses of 1 needed to start superstep -1 > map
  88. 14/11/04 17:07:43 INFO master.BspServiceMaster: checkWorkers: Only found 0 responses of 1 needed to start superstep -1. Reporting every 30000 msecs, 569973 more msecs left before giving up.
  89. 14/11/04 17:07:43 INFO master.BspServiceMaster: logMissingWorkersOnSuperstep: No response from partition 1 (could be master)
  90. 14/11/04 17:07:48 INFO mapred.LocalJobRunner: MASTER_ZOOKEEPER_ONLY checkWorkers: Only found 0 responses of 1 needed to start superstep -1 > map
  91. 14/11/04 17:07:57 INFO mapred.LocalJobRunner: MASTER_ZOOKEEPER_ONLY checkWorkers: Only found 0 responses of 1 needed to start superstep -1 > map
  92. 14/11/04 17:08:09 INFO mapred.LocalJobRunner: MASTER_ZOOKEEPER_ONLY checkWorkers: Only found 0 responses of 1 needed to start superstep -1 > map
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!