API tools faq
paste
Guest User

Untitled

a guest
Mar 1st, 2011
233
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 18.33 KB | None | 0 0
raw download clone embed print report
  1. Running on hadoop, using HADOOP_HOME=/var/toracluster/hadoop
  2. No HADOOP_CONF_DIR set, using /var/toracluster/hadoop/conf
  3. 11/03/01 18:32:03 INFO bayes.TrainClassifier: Training Complementary Bayes Classifier
  4. 11/03/01 18:32:03 INFO cbayes.CBayesDriver: Reading features...
  5. 11/03/01 18:32:03 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
  6. 11/03/01 18:32:08 INFO mapred.FileInputFormat: Total input paths to process : 20
  7. 11/03/01 18:32:09 INFO mapred.JobClient: Running job: job_201103011758_0003
  8. 11/03/01 18:32:10 INFO mapred.JobClient: map 0% reduce 0%
  9. 11/03/01 18:32:26 INFO mapred.JobClient: map 7% reduce 0%
  10. 11/03/01 18:32:28 INFO mapred.JobClient: map 24% reduce 0%
  11. 11/03/01 18:32:31 INFO mapred.JobClient: map 35% reduce 0%
  12. 11/03/01 18:32:37 INFO mapred.JobClient: map 49% reduce 0%
  13. 11/03/01 18:32:41 INFO mapred.JobClient: map 63% reduce 0%
  14. 11/03/01 18:32:43 INFO mapred.JobClient: map 78% reduce 0%
  15. 11/03/01 18:32:44 INFO mapred.JobClient: map 85% reduce 0%
  16. 11/03/01 18:32:46 INFO mapred.JobClient: map 85% reduce 2%
  17. 11/03/01 18:32:47 INFO mapred.JobClient: map 85% reduce 4%
  18. 11/03/01 18:32:48 INFO mapred.JobClient: map 85% reduce 5%
  19. 11/03/01 18:32:49 INFO mapred.JobClient: map 85% reduce 9%
  20. 11/03/01 18:32:50 INFO mapred.JobClient: map 99% reduce 10%
  21. 11/03/01 18:32:51 INFO mapred.JobClient: map 99% reduce 11%
  22. 11/03/01 18:32:52 INFO mapred.JobClient: map 99% reduce 17%
  23. 11/03/01 18:32:53 INFO mapred.JobClient: map 99% reduce 19%
  24. 11/03/01 18:32:54 INFO mapred.JobClient: map 100% reduce 20%
  25. 11/03/01 18:32:55 INFO mapred.JobClient: map 100% reduce 22%
  26. 11/03/01 18:32:56 INFO mapred.JobClient: map 100% reduce 24%
  27. 11/03/01 18:32:57 INFO mapred.JobClient: map 100% reduce 25%
  28. 11/03/01 18:32:59 INFO mapred.JobClient: map 100% reduce 27%
  29. 11/03/01 18:33:00 INFO mapred.JobClient: map 100% reduce 31%
  30. 11/03/01 18:33:01 INFO mapred.JobClient: map 100% reduce 36%
  31. 11/03/01 18:33:02 INFO mapred.JobClient: map 100% reduce 43%
  32. 11/03/01 18:33:03 INFO mapred.JobClient: map 100% reduce 45%
  33. 11/03/01 18:33:04 INFO mapred.JobClient: map 100% reduce 54%
  34. 11/03/01 18:33:05 INFO mapred.JobClient: map 100% reduce 58%
  35. 11/03/01 18:33:06 INFO mapred.JobClient: map 100% reduce 61%
  36. 11/03/01 18:33:07 INFO mapred.JobClient: map 100% reduce 74%
  37. 11/03/01 18:33:08 INFO mapred.JobClient: map 100% reduce 78%
  38. 11/03/01 18:33:10 INFO mapred.JobClient: map 100% reduce 79%
  39. 11/03/01 18:33:11 INFO mapred.JobClient: map 100% reduce 83%
  40. 11/03/01 18:33:12 INFO mapred.JobClient: map 100% reduce 84%
  41. 11/03/01 18:33:13 INFO mapred.JobClient: map 100% reduce 88%
  42. 11/03/01 18:33:16 INFO mapred.JobClient: map 100% reduce 89%
  43. 11/03/01 18:33:25 INFO mapred.JobClient: map 100% reduce 92%
  44. 11/03/01 18:33:26 INFO mapred.JobClient: map 100% reduce 95%
  45. 11/03/01 18:33:27 INFO mapred.JobClient: map 100% reduce 98%
  46. 11/03/01 18:33:31 INFO mapred.JobClient: map 100% reduce 100%
  47. 11/03/01 18:33:33 INFO mapred.JobClient: Job complete: job_201103011758_0003
  48. 11/03/01 18:33:33 INFO mapred.JobClient: Counters: 19
  49. 11/03/01 18:33:33 INFO mapred.JobClient: Job Counters
  50. 11/03/01 18:33:33 INFO mapred.JobClient: Launched reduce tasks=24
  51. 11/03/01 18:33:33 INFO mapred.JobClient: Rack-local map tasks=6
  52. 11/03/01 18:33:33 INFO mapred.JobClient: Launched map tasks=28
  53. 11/03/01 18:33:33 INFO mapred.JobClient: Data-local map tasks=22
  54. 11/03/01 18:33:33 INFO mapred.JobClient: FileSystemCounters
  55. 11/03/01 18:33:33 INFO mapred.JobClient: FILE_BYTES_READ=87594003
  56. 11/03/01 18:33:33 INFO mapred.JobClient: HDFS_BYTES_READ=16594816
  57. 11/03/01 18:33:33 INFO mapred.JobClient: FILE_BYTES_WRITTEN=142221509
  58. 11/03/01 18:33:33 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=36452620
  59. 11/03/01 18:33:33 INFO mapred.JobClient: Map-Reduce Framework
  60. 11/03/01 18:33:33 INFO mapred.JobClient: Reduce input groups=901416
  61. 11/03/01 18:33:33 INFO mapred.JobClient: Combine output records=1541960
  62. 11/03/01 18:33:33 INFO mapred.JobClient: Map input records=11314
  63. 11/03/01 18:33:33 INFO mapred.JobClient: Reduce shuffle bytes=54055945
  64. 11/03/01 18:33:33 INFO mapred.JobClient: Reduce output records=754846
  65. 11/03/01 18:33:33 INFO mapred.JobClient: Spilled Records=3958797
  66. 11/03/01 18:33:33 INFO mapred.JobClient: Map output bytes=205586582
  67. 11/03/01 18:33:33 INFO mapred.JobClient: Map input bytes=16537368
  68. 11/03/01 18:33:33 INFO mapred.JobClient: Combine input records=6337086
  69. 11/03/01 18:33:33 INFO mapred.JobClient: Map output records=6337086
  70. 11/03/01 18:33:33 INFO mapred.JobClient: Reduce input records=1541960
  71. 11/03/01 18:33:33 INFO cbayes.CBayesDriver: Calculating Tf-Idf...
  72. 11/03/01 18:33:33 INFO common.BayesTfIdfDriver: Counts of documents in Each Label
  73. 11/03/01 18:33:33 INFO common.BayesTfIdfDriver: {rec.motorcycles=598.0, comp.windows.x=593.0, talk.politics.mideast=564.0, talk.politics.guns=546.0, talk.religion.misc=377.0, rec.autos=594.0, rec.sport.baseball=597.0, rec.sport.hockey=600.0, comp.sys.mac.hardware=578.0, sci.space=593.0, comp.sys.ibm.pc.hardware=590.0, talk.politics.misc=465.0, sci.electronics=591.0, comp.graphics=584.0, sci.med=594.0, sci.crypt=595.0, soc.religion.christian=599.0, alt.atheism=480.0, misc.forsale=585.0, comp.os.ms-windows.misc=591.0}
  74. 11/03/01 18:33:33 INFO common.BayesTfIdfDriver: {dataSource=hdfs, alpha_i=1.0, minDf=1, gramSize=1}
  75. 11/03/01 18:33:33 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
  76. 11/03/01 18:33:39 INFO mapred.FileInputFormat: Total input paths to process : 60
  77. 11/03/01 18:33:39 INFO mapred.JobClient: Running job: job_201103011758_0004
  78. 11/03/01 18:33:40 INFO mapred.JobClient: map 0% reduce 0%
  79. 11/03/01 18:33:57 INFO mapred.JobClient: map 1% reduce 0%
  80. 11/03/01 18:34:00 INFO mapred.JobClient: map 19% reduce 0%
  81. 11/03/01 18:34:01 INFO mapred.JobClient: map 20% reduce 0%
  82. 11/03/01 18:34:02 INFO mapred.JobClient: map 30% reduce 0%
  83. 11/03/01 18:34:04 INFO mapred.JobClient: map 35% reduce 0%
  84. 11/03/01 18:34:06 INFO mapred.JobClient: map 41% reduce 0%
  85. 11/03/01 18:34:07 INFO mapred.JobClient: map 54% reduce 0%
  86. 11/03/01 18:34:09 INFO mapred.JobClient: map 61% reduce 1%
  87. 11/03/01 18:34:10 INFO mapred.JobClient: map 62% reduce 2%
  88. 11/03/01 18:34:11 INFO mapred.JobClient: map 72% reduce 3%
  89. 11/03/01 18:34:12 INFO mapred.JobClient: map 85% reduce 5%
  90. 11/03/01 18:34:13 INFO mapred.JobClient: map 93% reduce 8%
  91. 11/03/01 18:34:14 INFO mapred.JobClient: map 95% reduce 8%
  92. 11/03/01 18:34:15 INFO mapred.JobClient: map 95% reduce 11%
  93. 11/03/01 18:34:16 INFO mapred.JobClient: map 99% reduce 13%
  94. 11/03/01 18:34:17 INFO mapred.JobClient: map 100% reduce 15%
  95. 11/03/01 18:34:18 INFO mapred.JobClient: map 100% reduce 19%
  96. 11/03/01 18:34:19 INFO mapred.JobClient: map 100% reduce 20%
  97. 11/03/01 18:34:20 INFO mapred.JobClient: map 100% reduce 23%
  98. 11/03/01 18:34:22 INFO mapred.JobClient: map 100% reduce 26%
  99. 11/03/01 18:34:24 INFO mapred.JobClient: map 100% reduce 27%
  100. 11/03/01 18:34:26 INFO mapred.JobClient: map 100% reduce 28%
  101. 11/03/01 18:34:27 INFO mapred.JobClient: map 100% reduce 36%
  102. 11/03/01 18:34:28 INFO mapred.JobClient: map 100% reduce 47%
  103. 11/03/01 18:34:29 INFO mapred.JobClient: map 100% reduce 61%
  104. 11/03/01 18:34:30 INFO mapred.JobClient: map 100% reduce 72%
  105. 11/03/01 18:34:31 INFO mapred.JobClient: map 100% reduce 82%
  106. 11/03/01 18:34:32 INFO mapred.JobClient: map 100% reduce 85%
  107. 11/03/01 18:34:33 INFO mapred.JobClient: map 100% reduce 89%
  108. 11/03/01 18:34:54 INFO mapred.JobClient: map 100% reduce 92%
  109. 11/03/01 18:34:55 INFO mapred.JobClient: map 100% reduce 96%
  110. 11/03/01 18:35:03 INFO mapred.JobClient: map 100% reduce 100%
  111. 11/03/01 18:35:05 INFO mapred.JobClient: Job complete: job_201103011758_0004
  112. 11/03/01 18:35:05 INFO mapred.JobClient: Counters: 19
  113. 11/03/01 18:35:05 INFO mapred.JobClient: Job Counters
  114. 11/03/01 18:35:05 INFO mapred.JobClient: Launched reduce tasks=23
  115. 11/03/01 18:35:05 INFO mapred.JobClient: Rack-local map tasks=2
  116. 11/03/01 18:35:05 INFO mapred.JobClient: Launched map tasks=62
  117. 11/03/01 18:35:05 INFO mapred.JobClient: Data-local map tasks=60
  118. 11/03/01 18:35:05 INFO mapred.JobClient: FileSystemCounters
  119. 11/03/01 18:35:05 INFO mapred.JobClient: FILE_BYTES_READ=27335434
  120. 11/03/01 18:35:05 INFO mapred.JobClient: HDFS_BYTES_READ=36451677
  121. 11/03/01 18:35:05 INFO mapred.JobClient: FILE_BYTES_WRITTEN=54708444
  122. 11/03/01 18:35:05 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=15647158
  123. 11/03/01 18:35:05 INFO mapred.JobClient: Map-Reduce Framework
  124. 11/03/01 18:35:05 INFO mapred.JobClient: Reduce input groups=304129
  125. 11/03/01 18:35:05 INFO mapred.JobClient: Combine output records=608276
  126. 11/03/01 18:35:05 INFO mapred.JobClient: Map input records=754826
  127. 11/03/01 18:35:05 INFO mapred.JobClient: Reduce shuffle bytes=26960233
  128. 11/03/01 18:35:05 INFO mapred.JobClient: Reduce output records=304129
  129. 11/03/01 18:35:05 INFO mapred.JobClient: Spilled Records=1216552
  130. 11/03/01 18:35:05 INFO mapred.JobClient: Map output bytes=28610110
  131. 11/03/01 18:35:05 INFO mapred.JobClient: Map input bytes=36445253
  132. 11/03/01 18:35:05 INFO mapred.JobClient: Combine input records=754826
  133. 11/03/01 18:35:05 INFO mapred.JobClient: Map output records=754826
  134. 11/03/01 18:35:05 INFO mapred.JobClient: Reduce input records=608276
  135. 11/03/01 18:35:05 INFO cbayes.CBayesDriver: Calculating weight sums for labels and features...
  136. 11/03/01 18:35:05 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
  137. 11/03/01 18:35:07 INFO mapred.FileInputFormat: Total input paths to process : 20
  138. 11/03/01 18:35:08 INFO mapred.JobClient: Running job: job_201103011758_0005
  139. 11/03/01 18:35:09 INFO mapred.JobClient: map 0% reduce 0%
  140. 11/03/01 18:35:23 INFO mapred.JobClient: map 20% reduce 0%
  141. 11/03/01 18:35:25 INFO mapred.JobClient: map 38% reduce 0%
  142. 11/03/01 18:35:28 INFO mapred.JobClient: map 55% reduce 0%
  143. 11/03/01 18:35:31 INFO mapred.JobClient: map 70% reduce 0%
  144. 11/03/01 18:35:33 INFO mapred.JobClient: map 80% reduce 0%
  145. 11/03/01 18:35:34 INFO mapred.JobClient: map 80% reduce 1%
  146. 11/03/01 18:35:36 INFO mapred.JobClient: map 80% reduce 2%
  147. 11/03/01 18:35:37 INFO mapred.JobClient: map 80% reduce 5%
  148. 11/03/01 18:35:38 INFO mapred.JobClient: map 80% reduce 6%
  149. 11/03/01 18:35:39 INFO mapred.JobClient: map 100% reduce 10%
  150. 11/03/01 18:35:40 INFO mapred.JobClient: map 100% reduce 15%
  151. 11/03/01 18:35:41 INFO mapred.JobClient: map 100% reduce 16%
  152. 11/03/01 18:35:42 INFO mapred.JobClient: map 100% reduce 18%
  153. 11/03/01 18:35:43 INFO mapred.JobClient: map 100% reduce 19%
  154. 11/03/01 18:35:46 INFO mapred.JobClient: map 100% reduce 21%
  155. 11/03/01 18:35:47 INFO mapred.JobClient: map 100% reduce 29%
  156. 11/03/01 18:35:48 INFO mapred.JobClient: map 100% reduce 33%
  157. 11/03/01 18:35:49 INFO mapred.JobClient: map 100% reduce 40%
  158. 11/03/01 18:35:50 INFO mapred.JobClient: map 100% reduce 54%
  159. 11/03/01 18:35:51 INFO mapred.JobClient: map 100% reduce 61%
  160. 11/03/01 18:35:52 INFO mapred.JobClient: map 100% reduce 76%
  161. 11/03/01 18:35:53 INFO mapred.JobClient: map 100% reduce 80%
  162. 11/03/01 18:35:54 INFO mapred.JobClient: map 100% reduce 87%
  163. 11/03/01 18:35:56 INFO mapred.JobClient: map 100% reduce 89%
  164. 11/03/01 18:36:24 INFO mapred.JobClient: map 100% reduce 92%
  165. 11/03/01 18:36:26 INFO mapred.JobClient: map 100% reduce 100%
  166. 11/03/01 18:36:28 INFO mapred.JobClient: Job complete: job_201103011758_0005
  167. 11/03/01 18:36:28 INFO mapred.JobClient: Counters: 19
  168. 11/03/01 18:36:28 INFO mapred.JobClient: Job Counters
  169. 11/03/01 18:36:28 INFO mapred.JobClient: Launched reduce tasks=23
  170. 11/03/01 18:36:28 INFO mapred.JobClient: Rack-local map tasks=2
  171. 11/03/01 18:36:28 INFO mapred.JobClient: Launched map tasks=20
  172. 11/03/01 18:36:28 INFO mapred.JobClient: Data-local map tasks=18
  173. 11/03/01 18:36:28 INFO mapred.JobClient: FileSystemCounters
  174. 11/03/01 18:36:28 INFO mapred.JobClient: FILE_BYTES_READ=7573043
  175. 11/03/01 18:36:28 INFO mapred.JobClient: HDFS_BYTES_READ=15647034
  176. 11/03/01 18:36:28 INFO mapred.JobClient: FILE_BYTES_WRITTEN=15158126
  177. 11/03/01 18:36:28 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=5159311
  178. 11/03/01 18:36:28 INFO mapred.JobClient: Map-Reduce Framework
  179. 11/03/01 18:36:28 INFO mapred.JobClient: Reduce input groups=146591
  180. 11/03/01 18:36:28 INFO mapred.JobClient: Combine output records=271988
  181. 11/03/01 18:36:28 INFO mapred.JobClient: Map input records=304128
  182. 11/03/01 18:36:28 INFO mapred.JobClient: Reduce shuffle bytes=7428843
  183. 11/03/01 18:36:28 INFO mapred.JobClient: Reduce output records=146591
  184. 11/03/01 18:36:28 INFO mapred.JobClient: Spilled Records=543976
  185. 11/03/01 18:36:28 INFO mapred.JobClient: Map output bytes=23703690
  186. 11/03/01 18:36:28 INFO mapred.JobClient: Map input bytes=15645054
  187. 11/03/01 18:36:28 INFO mapred.JobClient: Combine input records=912384
  188. 11/03/01 18:36:28 INFO mapred.JobClient: Map output records=912384
  189. 11/03/01 18:36:28 INFO mapred.JobClient: Reduce input records=271988
  190. 11/03/01 18:36:28 INFO cbayes.CBayesDriver: Calculating the weight Normalisation factor for each complement class...
  191. 11/03/01 18:36:28 INFO cbayes.CBayesThetaNormalizerDriver: Sigma_k for Each Label
  192. 11/03/01 18:36:28 INFO cbayes.CBayesThetaNormalizerDriver: {rec.motorcycles=10950.08247078721, comp.windows.x=9140.402291913837, talk.politics.mideast=9774.792829912289, talk.politics.guns=9717.88489854203, talk.religion.misc=6253.280625101343, rec.autos=10318.471983615942, rec.sport.baseball=9964.975295683817, rec.sport.hockey=9689.106187278316, comp.sys.mac.hardware=9294.329591214331, comp.sys.ibm.pc.hardware=9261.965098785993, sci.space=10877.814564329747, talk.politics.misc=8292.138753814044, comp.graphics=9327.325741884963, sci.electronics=10382.850213940703, sci.crypt=10401.387454343785, soc.religion.christian=9581.585347264709, sci.med=10654.85260056476, alt.atheism=7503.4943930774525, misc.forsale=10119.779786780935, comp.os.ms-windows.misc=9063.881127402112}
  193. 11/03/01 18:36:28 INFO cbayes.CBayesThetaNormalizerDriver: Sigma_kSigma_j for each Label and for each Features
  194. 11/03/01 18:36:28 INFO cbayes.CBayesThetaNormalizerDriver: 190570.40125623858
  195. 11/03/01 18:36:28 INFO cbayes.CBayesThetaNormalizerDriver: Vocabulary Count
  196. 11/03/01 18:36:28 INFO cbayes.CBayesThetaNormalizerDriver: 146570.0
  197. 11/03/01 18:36:28 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
  198. 11/03/01 18:36:34 INFO mapred.FileInputFormat: Total input paths to process : 40
  199. 11/03/01 18:36:34 INFO mapred.JobClient: Running job: job_201103011758_0006
  200. 11/03/01 18:36:35 INFO mapred.JobClient: map 0% reduce 0%
  201. 11/03/01 18:36:46 INFO mapred.JobClient: map 1% reduce 0%
  202. 11/03/01 18:36:48 INFO mapred.JobClient: map 16% reduce 0%
  203. 11/03/01 18:36:49 INFO mapred.JobClient: map 25% reduce 0%
  204. 11/03/01 18:36:52 INFO mapred.JobClient: map 35% reduce 0%
  205. 11/03/01 18:36:56 INFO mapred.JobClient: map 42% reduce 0%
  206. 11/03/01 18:36:57 INFO mapred.JobClient: map 57% reduce 1%
  207. 11/03/01 18:36:58 INFO mapred.JobClient: map 68% reduce 2%
  208. 11/03/01 18:36:59 INFO mapred.JobClient: map 70% reduce 2%
  209. 11/03/01 18:37:00 INFO mapred.JobClient: map 70% reduce 4%
  210. 11/03/01 18:37:01 INFO mapred.JobClient: map 79% reduce 6%
  211. 11/03/01 18:37:02 INFO mapred.JobClient: map 79% reduce 7%
  212. 11/03/01 18:37:03 INFO mapred.JobClient: map 79% reduce 8%
  213. 11/03/01 18:37:04 INFO mapred.JobClient: map 89% reduce 13%
  214. 11/03/01 18:37:05 INFO mapred.JobClient: map 100% reduce 16%
  215. 11/03/01 18:37:07 INFO mapred.JobClient: map 100% reduce 19%
  216. 11/03/01 18:37:09 INFO mapred.JobClient: map 100% reduce 22%
  217. 11/03/01 18:37:11 INFO mapred.JobClient: map 100% reduce 23%
  218. 11/03/01 18:37:13 INFO mapred.JobClient: map 100% reduce 43%
  219. 11/03/01 18:37:14 INFO mapred.JobClient: map 100% reduce 47%
  220. 11/03/01 18:37:15 INFO mapred.JobClient: map 100% reduce 58%
  221. 11/03/01 18:37:16 INFO mapred.JobClient: map 100% reduce 70%
  222. 11/03/01 18:37:17 INFO mapred.JobClient: map 100% reduce 78%
  223. 11/03/01 18:37:18 INFO mapred.JobClient: map 100% reduce 84%
  224. 11/03/01 18:37:19 INFO mapred.JobClient: map 100% reduce 89%
  225. 11/03/01 18:37:48 INFO mapred.JobClient: map 100% reduce 96%
  226. 11/03/01 18:37:49 INFO mapred.JobClient: map 100% reduce 100%
  227. 11/03/01 18:37:51 INFO mapred.JobClient: Job complete: job_201103011758_0006
  228. 11/03/01 18:37:51 INFO mapred.JobClient: Counters: 19
  229. 11/03/01 18:37:51 INFO mapred.JobClient: Job Counters
  230. 11/03/01 18:37:51 INFO mapred.JobClient: Launched reduce tasks=23
  231. 11/03/01 18:37:51 INFO mapred.JobClient: Rack-local map tasks=3
  232. 11/03/01 18:37:51 INFO mapred.JobClient: Launched map tasks=40
  233. 11/03/01 18:37:51 INFO mapred.JobClient: Data-local map tasks=37
  234. 11/03/01 18:37:51 INFO mapred.JobClient: FileSystemCounters
  235. 11/03/01 18:37:51 INFO mapred.JobClient: FILE_BYTES_READ=28640
  236. 11/03/01 18:37:51 INFO mapred.JobClient: HDFS_BYTES_READ=20804199
  237. 11/03/01 18:37:51 INFO mapred.JobClient: FILE_BYTES_WRITTEN=81480
  238. 11/03/01 18:37:51 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=2813
  239. 11/03/01 18:37:51 INFO mapred.JobClient: Map-Reduce Framework
  240. 11/03/01 18:37:51 INFO mapred.JobClient: Reduce input groups=20
  241. 11/03/01 18:37:51 INFO mapred.JobClient: Combine output records=800
  242. 11/03/01 18:37:51 INFO mapred.JobClient: Map input records=450698
  243. 11/03/01 18:37:51 INFO mapred.JobClient: Reduce shuffle bytes=32959
  244. 11/03/01 18:37:51 INFO mapred.JobClient: Reduce output records=20
  245. 11/03/01 18:37:51 INFO mapred.JobClient: Spilled Records=1600
  246. 11/03/01 18:37:51 INFO mapred.JobClient: Map output bytes=109064638
  247. 11/03/01 18:37:51 INFO mapred.JobClient: Map input bytes=20800239
  248. 11/03/01 18:37:51 INFO mapred.JobClient: Combine input records=3235528
  249. 11/03/01 18:37:51 INFO mapred.JobClient: Map output records=3235528
  250. 11/03/01 18:37:51 INFO mapred.JobClient: Reduce input records=800
  251. 11/03/01 18:37:51 INFO common.HadoopUtil: Deleting scope/run_24/model/trainer-docCount
  252. 11/03/01 18:37:51 INFO common.HadoopUtil: Deleting scope/run_24/model/trainer-termDocCount
  253. 11/03/01 18:37:51 INFO common.HadoopUtil: Deleting scope/run_24/model/trainer-featureCount
  254. 11/03/01 18:37:51 INFO common.HadoopUtil: Deleting scope/run_24/model/trainer-wordFreq
  255. 11/03/01 18:37:51 INFO common.HadoopUtil: Deleting scope/run_24/model/trainer-tfIdf/trainer-vocabCount
  256. 11/03/01 18:37:51 INFO driver.MahoutDriver: Program took 348264 ms
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!