API tools faq
paste
Guest User

gridmix-generate-runtime

a guest
Dec 10th, 2015
231
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 4.85 KB | None | 0 0
raw download clone embed print report
  1. ubuntu@anmol-vm1-new:/home/hadoop/yarnpp/workloads$ ./gridmix-generate.sh
  2. setting variables:
  3. YARN_CONF_DIR=/home/hadoop/yarnpp/conf
  4. YARN_LOG_DIR=/mnt/data/1/local/log
  5. HADOOP_CONF_DIR=/home/hadoop/yarnpp/conf
  6. JAVA_HOME=/usr/lib/jvm/java-1.7.0-openjdk-amd64
  7. HADOOP_USER_CLASSPATH_FIRST=1
  8. HADOOP_COMMON_HOME=/home/hadoop/yarnpp/hadoop-2.4.2-SNAPSHOT
  9. HADOOP_HDFS_HOME=/home/hadoop/yarnpp/hadoop-2.4.2-SNAPSHOT
  10. HADOOP_YARN_HOME=/home/hadoop/yarnpp/hadoop-2.4.2-SNAPSHOT
  11. HADOOP_HOME=/home/hadoop/yarnpp/hadoop-2.4.2-SNAPSHOT
  12. YARN_HOME=/home/hadoop/yarnpp/hadoop-2.4.2-SNAPSHOT
  13. TEZ_HOME=/home/hadoop/yarnpp/tez-0.4.1-incubating
  14. HIVE_HOME=/home/hadoop/yarnpp/hive-1.2.1
  15. OOZIE_INSTALL=/home/hadoop/yarnpp/oozie-4.0.1
  16. Fri Dec 11 03:53:36 UTC 2015
  17. 15/12/11 03:53:38 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  18. rm: `/user/hadoop/gridmix-kon/gridmix': No such file or directory
  19. 15/12/11 03:53:40 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  20. rm: `/user/hadoop/syn.json': No such file or directory
  21. 15/12/11 03:53:42 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  22. 15/12/11 03:53:44 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  23. rm: `/user/hadoop/gridmix-kon/input': No such file or directory
  24. launching gridmix
  25. 15/12/11 03:53:47 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  26. 15/12/11 03:53:47 INFO gridmix.SubmitterUserResolver: Current user resolver is SubmitterUserResolver
  27. 15/12/11 03:53:48 INFO gridmix.Gridmix: Submission policy is REPLAY
  28. 15/12/11 03:53:48 INFO client.RMProxy: Connecting to ResourceManager at /10.0.1.190:8032
  29. 15/12/11 03:53:48 INFO client.AHSProxy: Connecting to Application History server at /10.0.1.190:10200
  30. 15/12/11 03:53:48 INFO client.RMProxy: Connecting to ResourceManager at /10.0.1.190:8032
  31. 15/12/11 03:53:48 INFO client.AHSProxy: Connecting to Application History server at /10.0.1.190:10200
  32. 15/12/11 03:53:49 INFO synthetic.SynthTraceJobProducer: SynthTraceJobProducer
  33. 15/12/11 03:53:49 INFO synthetic.SynthTraceJobProducer: Generated 7000 deadlines for 7000 jobs
  34. 15/12/11 03:53:49 INFO gridmix.Gridmix: Generating 9.1 T of test data...
  35. 15/12/11 03:53:49 INFO gridmix.JobSubmitter: Total number of queued jobs: 0
  36. 15/12/11 03:53:49 INFO gridmix.JobSubmitter: [JobSubmitter] Time taken to build splits for job null: 0 ms.
  37. 15/12/11 03:53:49 INFO gridmix.JobSubmitter: Going to sleep for -1449806029785000000 for job -1
  38. 15/12/11 03:53:50 INFO client.RMProxy: Connecting to ResourceManager at /10.0.1.190:8032
  39. 15/12/11 03:53:50 INFO client.AHSProxy: Connecting to Application History server at /10.0.1.190:10200
  40. 15/12/11 03:53:50 INFO client.RMProxy: Connecting to ResourceManager at /10.0.1.190:8032
  41. 15/12/11 03:53:50 INFO client.AHSProxy: Connecting to Application History server at /10.0.1.190:10200
  42. 15/12/11 03:53:51 INFO client.RMProxy: Connecting to ResourceManager at /10.0.1.190:8032
  43. 15/12/11 03:53:51 INFO client.AHSProxy: Connecting to Application History server at /10.0.1.190:10200
  44. 15/12/11 03:53:51 INFO client.RMProxy: Connecting to ResourceManager at /10.0.1.190:8032
  45. 15/12/11 03:53:51 INFO client.AHSProxy: Connecting to Application History server at /10.0.1.190:10200
  46. 15/12/11 03:53:51 WARN client.ResourceMgrDelegate: getBlacklistedTrackers - Not implemented yet
  47. 15/12/11 03:53:51 INFO mapreduce.JobSubmitter: number of splits:4
  48. 15/12/11 03:53:52 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1449805139484_0001
  49. 15/12/11 03:53:52 INFO client.YARNRunner: Number of stages: 1
  50. 15/12/11 03:53:53 INFO client.TezClient: Submitting DAG to YARN, applicationId=application_1449805139484_0001
  51. 15/12/11 03:53:53 INFO impl.YarnClientImpl: Submitted application application_1449805139484_0001
  52. 15/12/11 03:53:53 INFO client.RMProxy: Connecting to ResourceManager at /10.0.1.190:8032
  53. 15/12/11 03:53:53 INFO client.AHSProxy: Connecting to Application History server at /10.0.1.190:10200
  54. 15/12/11 03:53:53 INFO client.RMProxy: Connecting to ResourceManager at /10.0.1.190:8032
  55. 15/12/11 03:53:53 INFO client.AHSProxy: Connecting to Application History server at /10.0.1.190:10200
  56. 15/12/11 03:53:53 INFO mapreduce.Job: The url to track the job: http://anmol-vm1-new:8088/proxy/application_1449805139484_0001/
  57. 15/12/11 03:53:53 INFO gridmix.JobSubmitter: [JobSubmitter] Time taken to submit the job job_1449805139484_0001: 2889 ms.
  58. 15/12/11 03:53:53 INFO gridmix.Statistics: Not tracking job GRIDMIX_GENERATE_INPUT_DATA as seq id is less than zero: -1
  59. 15/12/11 03:53:53 INFO gridmix.JobSubmitter: [JobSubmitter] Release Buffer job_1449805139484_0001
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!