API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Apr 23rd, 2016
865
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 312.56 KB | None | 0 0
raw download clone embed print report
  1. ...
  2. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 107.0 in stage 7.0 (TID 582) in 147 ms on node06.hadoop.know-center.at (110/400)
  3. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 126.0 in stage 7.0 (TID 601, node06.hadoop.know-center.at, partition 126,NODE_LOCAL, 1894 bytes)
  4. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 109.0 in stage 7.0 (TID 584) in 137 ms on node06.hadoop.know-center.at (111/400)
  5. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 127.0 in stage 7.0 (TID 602, node12.hadoop.know-center.at, partition 127,NODE_LOCAL, 1894 bytes)
  6. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 128.0 in stage 7.0 (TID 603, node12.hadoop.know-center.at, partition 128,NODE_LOCAL, 1894 bytes)
  7. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 112.0 in stage 7.0 (TID 587) in 126 ms on node12.hadoop.know-center.at (112/400)
  8. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 113.0 in stage 7.0 (TID 588) in 117 ms on node12.hadoop.know-center.at (113/400)
  9. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 129.0 in stage 7.0 (TID 604, node06.hadoop.know-center.at, partition 129,NODE_LOCAL, 1894 bytes)
  10. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 111.0 in stage 7.0 (TID 586) in 142 ms on node06.hadoop.know-center.at (114/400)
  11. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 130.0 in stage 7.0 (TID 605, node12.hadoop.know-center.at, partition 130,NODE_LOCAL, 1894 bytes)
  12. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 115.0 in stage 7.0 (TID 590) in 120 ms on node12.hadoop.know-center.at (115/400)
  13. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 131.0 in stage 7.0 (TID 606, node06.hadoop.know-center.at, partition 131,NODE_LOCAL, 1894 bytes)
  14. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 114.0 in stage 7.0 (TID 589) in 141 ms on node06.hadoop.know-center.at (116/400)
  15. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 132.0 in stage 7.0 (TID 607, node12.hadoop.know-center.at, partition 132,NODE_LOCAL, 1894 bytes)
  16. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 117.0 in stage 7.0 (TID 592) in 120 ms on node12.hadoop.know-center.at (117/400)
  17. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 133.0 in stage 7.0 (TID 608, node06.hadoop.know-center.at, partition 133,NODE_LOCAL, 1894 bytes)
  18. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 116.0 in stage 7.0 (TID 591) in 138 ms on node06.hadoop.know-center.at (118/400)
  19. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 134.0 in stage 7.0 (TID 609, node12.hadoop.know-center.at, partition 134,NODE_LOCAL, 1894 bytes)
  20. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 119.0 in stage 7.0 (TID 594) in 119 ms on node12.hadoop.know-center.at (119/400)
  21. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 135.0 in stage 7.0 (TID 610, node06.hadoop.know-center.at, partition 135,NODE_LOCAL, 1894 bytes)
  22. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 118.0 in stage 7.0 (TID 593) in 137 ms on node06.hadoop.know-center.at (120/400)
  23. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 136.0 in stage 7.0 (TID 611, node12.hadoop.know-center.at, partition 136,NODE_LOCAL, 1894 bytes)
  24. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 121.0 in stage 7.0 (TID 596) in 120 ms on node12.hadoop.know-center.at (121/400)
  25. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 137.0 in stage 7.0 (TID 612, node06.hadoop.know-center.at, partition 137,NODE_LOCAL, 1894 bytes)
  26. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 138.0 in stage 7.0 (TID 613, node12.hadoop.know-center.at, partition 138,NODE_LOCAL, 1894 bytes)
  27. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 120.0 in stage 7.0 (TID 595) in 143 ms on node06.hadoop.know-center.at (122/400)
  28. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 123.0 in stage 7.0 (TID 598) in 117 ms on node12.hadoop.know-center.at (123/400)
  29. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 139.0 in stage 7.0 (TID 614, node12.hadoop.know-center.at, partition 139,NODE_LOCAL, 1894 bytes)
  30. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 124.0 in stage 7.0 (TID 599) in 119 ms on node12.hadoop.know-center.at (124/400)
  31. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 140.0 in stage 7.0 (TID 615, node06.hadoop.know-center.at, partition 140,NODE_LOCAL, 1894 bytes)
  32. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 122.0 in stage 7.0 (TID 597) in 143 ms on node06.hadoop.know-center.at (125/400)
  33. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 141.0 in stage 7.0 (TID 616, node12.hadoop.know-center.at, partition 141,NODE_LOCAL, 1894 bytes)
  34. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 128.0 in stage 7.0 (TID 603) in 112 ms on node12.hadoop.know-center.at (126/400)
  35. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 142.0 in stage 7.0 (TID 617, node06.hadoop.know-center.at, partition 142,NODE_LOCAL, 1894 bytes)
  36. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 125.0 in stage 7.0 (TID 600) in 138 ms on node06.hadoop.know-center.at (127/400)
  37. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 143.0 in stage 7.0 (TID 618, node12.hadoop.know-center.at, partition 143,NODE_LOCAL, 1894 bytes)
  38. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 127.0 in stage 7.0 (TID 602) in 120 ms on node12.hadoop.know-center.at (128/400)
  39. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 144.0 in stage 7.0 (TID 619, node06.hadoop.know-center.at, partition 144,NODE_LOCAL, 1894 bytes)
  40. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 145.0 in stage 7.0 (TID 620, node12.hadoop.know-center.at, partition 145,NODE_LOCAL, 1894 bytes)
  41. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 126.0 in stage 7.0 (TID 601) in 142 ms on node06.hadoop.know-center.at (129/400)
  42. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 130.0 in stage 7.0 (TID 605) in 121 ms on node12.hadoop.know-center.at (130/400)
  43. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 146.0 in stage 7.0 (TID 621, node06.hadoop.know-center.at, partition 146,NODE_LOCAL, 1894 bytes)
  44. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 129.0 in stage 7.0 (TID 604) in 137 ms on node06.hadoop.know-center.at (131/400)
  45. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 147.0 in stage 7.0 (TID 622, node12.hadoop.know-center.at, partition 147,NODE_LOCAL, 1894 bytes)
  46. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 132.0 in stage 7.0 (TID 607) in 119 ms on node12.hadoop.know-center.at (132/400)
  47. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 148.0 in stage 7.0 (TID 623, node06.hadoop.know-center.at, partition 148,NODE_LOCAL, 1894 bytes)
  48. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 131.0 in stage 7.0 (TID 606) in 136 ms on node06.hadoop.know-center.at (133/400)
  49. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 149.0 in stage 7.0 (TID 624, node12.hadoop.know-center.at, partition 149,NODE_LOCAL, 1894 bytes)
  50. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 134.0 in stage 7.0 (TID 609) in 121 ms on node12.hadoop.know-center.at (134/400)
  51. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 150.0 in stage 7.0 (TID 625, node12.hadoop.know-center.at, partition 150,NODE_LOCAL, 1894 bytes)
  52. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 136.0 in stage 7.0 (TID 611) in 114 ms on node12.hadoop.know-center.at (135/400)
  53. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 151.0 in stage 7.0 (TID 626, node06.hadoop.know-center.at, partition 151,NODE_LOCAL, 1894 bytes)
  54. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 133.0 in stage 7.0 (TID 608) in 145 ms on node06.hadoop.know-center.at (136/400)
  55. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 152.0 in stage 7.0 (TID 627, node12.hadoop.know-center.at, partition 152,NODE_LOCAL, 1894 bytes)
  56. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 138.0 in stage 7.0 (TID 613) in 119 ms on node12.hadoop.know-center.at (137/400)
  57. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 153.0 in stage 7.0 (TID 628, node06.hadoop.know-center.at, partition 153,NODE_LOCAL, 1894 bytes)
  58. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 135.0 in stage 7.0 (TID 610) in 144 ms on node06.hadoop.know-center.at (138/400)
  59. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 154.0 in stage 7.0 (TID 629, node12.hadoop.know-center.at, partition 154,NODE_LOCAL, 1894 bytes)
  60. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 139.0 in stage 7.0 (TID 614) in 122 ms on node12.hadoop.know-center.at (139/400)
  61. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 155.0 in stage 7.0 (TID 630, node06.hadoop.know-center.at, partition 155,NODE_LOCAL, 1894 bytes)
  62. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 137.0 in stage 7.0 (TID 612) in 148 ms on node06.hadoop.know-center.at (140/400)
  63. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 156.0 in stage 7.0 (TID 631, node12.hadoop.know-center.at, partition 156,NODE_LOCAL, 1894 bytes)
  64. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 141.0 in stage 7.0 (TID 616) in 117 ms on node12.hadoop.know-center.at (141/400)
  65. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 157.0 in stage 7.0 (TID 632, node12.hadoop.know-center.at, partition 157,NODE_LOCAL, 1894 bytes)
  66. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 158.0 in stage 7.0 (TID 633, node06.hadoop.know-center.at, partition 158,NODE_LOCAL, 1894 bytes)
  67. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 143.0 in stage 7.0 (TID 618) in 121 ms on node12.hadoop.know-center.at (142/400)
  68. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 140.0 in stage 7.0 (TID 615) in 139 ms on node06.hadoop.know-center.at (143/400)
  69. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 159.0 in stage 7.0 (TID 634, node12.hadoop.know-center.at, partition 159,NODE_LOCAL, 1894 bytes)
  70. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 145.0 in stage 7.0 (TID 620) in 118 ms on node12.hadoop.know-center.at (144/400)
  71. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 160.0 in stage 7.0 (TID 635, node06.hadoop.know-center.at, partition 160,NODE_LOCAL, 1894 bytes)
  72. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 142.0 in stage 7.0 (TID 617) in 143 ms on node06.hadoop.know-center.at (145/400)
  73. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 161.0 in stage 7.0 (TID 636, node06.hadoop.know-center.at, partition 161,NODE_LOCAL, 1894 bytes)
  74. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 144.0 in stage 7.0 (TID 619) in 138 ms on node06.hadoop.know-center.at (146/400)
  75. 16/04/23 20:27:42 INFO TaskSetManager: Starting task 162.0 in stage 7.0 (TID 637, node12.hadoop.know-center.at, partition 162,NODE_LOCAL, 1894 bytes)
  76. 16/04/23 20:27:42 INFO TaskSetManager: Finished task 147.0 in stage 7.0 (TID 622) in 122 ms on node12.hadoop.know-center.at (147/400)
  77. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 163.0 in stage 7.0 (TID 638, node12.hadoop.know-center.at, partition 163,NODE_LOCAL, 1894 bytes)
  78. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 149.0 in stage 7.0 (TID 624) in 117 ms on node12.hadoop.know-center.at (148/400)
  79. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 164.0 in stage 7.0 (TID 639, node06.hadoop.know-center.at, partition 164,NODE_LOCAL, 1894 bytes)
  80. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 146.0 in stage 7.0 (TID 621) in 142 ms on node06.hadoop.know-center.at (149/400)
  81. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 165.0 in stage 7.0 (TID 640, node12.hadoop.know-center.at, partition 165,NODE_LOCAL, 1894 bytes)
  82. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 150.0 in stage 7.0 (TID 625) in 118 ms on node12.hadoop.know-center.at (150/400)
  83. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 166.0 in stage 7.0 (TID 641, node06.hadoop.know-center.at, partition 166,NODE_LOCAL, 1894 bytes)
  84. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 148.0 in stage 7.0 (TID 623) in 143 ms on node06.hadoop.know-center.at (151/400)
  85. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 167.0 in stage 7.0 (TID 642, node12.hadoop.know-center.at, partition 167,NODE_LOCAL, 1894 bytes)
  86. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 152.0 in stage 7.0 (TID 627) in 119 ms on node12.hadoop.know-center.at (152/400)
  87. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 168.0 in stage 7.0 (TID 643, node06.hadoop.know-center.at, partition 168,NODE_LOCAL, 1894 bytes)
  88. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 151.0 in stage 7.0 (TID 626) in 139 ms on node06.hadoop.know-center.at (153/400)
  89. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 169.0 in stage 7.0 (TID 644, node12.hadoop.know-center.at, partition 169,NODE_LOCAL, 1894 bytes)
  90. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 154.0 in stage 7.0 (TID 629) in 115 ms on node12.hadoop.know-center.at (154/400)
  91. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 170.0 in stage 7.0 (TID 645, node06.hadoop.know-center.at, partition 170,NODE_LOCAL, 1894 bytes)
  92. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 153.0 in stage 7.0 (TID 628) in 147 ms on node06.hadoop.know-center.at (155/400)
  93. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 171.0 in stage 7.0 (TID 646, node12.hadoop.know-center.at, partition 171,NODE_LOCAL, 1894 bytes)
  94. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 156.0 in stage 7.0 (TID 631) in 120 ms on node12.hadoop.know-center.at (156/400)
  95. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 172.0 in stage 7.0 (TID 647, node12.hadoop.know-center.at, partition 172,NODE_LOCAL, 1894 bytes)
  96. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 157.0 in stage 7.0 (TID 632) in 121 ms on node12.hadoop.know-center.at (157/400)
  97. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 173.0 in stage 7.0 (TID 648, node06.hadoop.know-center.at, partition 173,NODE_LOCAL, 1894 bytes)
  98. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 155.0 in stage 7.0 (TID 630) in 144 ms on node06.hadoop.know-center.at (158/400)
  99. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 174.0 in stage 7.0 (TID 649, node12.hadoop.know-center.at, partition 174,NODE_LOCAL, 1894 bytes)
  100. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 159.0 in stage 7.0 (TID 634) in 122 ms on node12.hadoop.know-center.at (159/400)
  101. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 175.0 in stage 7.0 (TID 650, node06.hadoop.know-center.at, partition 175,NODE_LOCAL, 1894 bytes)
  102. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 158.0 in stage 7.0 (TID 633) in 143 ms on node06.hadoop.know-center.at (160/400)
  103. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 176.0 in stage 7.0 (TID 651, node12.hadoop.know-center.at, partition 176,NODE_LOCAL, 1894 bytes)
  104. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 162.0 in stage 7.0 (TID 637) in 117 ms on node12.hadoop.know-center.at (161/400)
  105. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 177.0 in stage 7.0 (TID 652, node06.hadoop.know-center.at, partition 177,NODE_LOCAL, 1894 bytes)
  106. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 160.0 in stage 7.0 (TID 635) in 139 ms on node06.hadoop.know-center.at (162/400)
  107. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 178.0 in stage 7.0 (TID 653, node12.hadoop.know-center.at, partition 178,NODE_LOCAL, 1894 bytes)
  108. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 163.0 in stage 7.0 (TID 638) in 118 ms on node12.hadoop.know-center.at (163/400)
  109. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 179.0 in stage 7.0 (TID 654, node06.hadoop.know-center.at, partition 179,NODE_LOCAL, 1894 bytes)
  110. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 161.0 in stage 7.0 (TID 636) in 143 ms on node06.hadoop.know-center.at (164/400)
  111. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 180.0 in stage 7.0 (TID 655, node12.hadoop.know-center.at, partition 180,NODE_LOCAL, 1894 bytes)
  112. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 165.0 in stage 7.0 (TID 640) in 122 ms on node12.hadoop.know-center.at (165/400)
  113. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 181.0 in stage 7.0 (TID 656, node12.hadoop.know-center.at, partition 181,NODE_LOCAL, 1894 bytes)
  114. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 182.0 in stage 7.0 (TID 657, node06.hadoop.know-center.at, partition 182,NODE_LOCAL, 1894 bytes)
  115. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 167.0 in stage 7.0 (TID 642) in 116 ms on node12.hadoop.know-center.at (166/400)
  116. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 164.0 in stage 7.0 (TID 639) in 140 ms on node06.hadoop.know-center.at (167/400)
  117. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 183.0 in stage 7.0 (TID 658, node12.hadoop.know-center.at, partition 183,NODE_LOCAL, 1894 bytes)
  118. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 184.0 in stage 7.0 (TID 659, node06.hadoop.know-center.at, partition 184,NODE_LOCAL, 1894 bytes)
  119. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 169.0 in stage 7.0 (TID 644) in 120 ms on node12.hadoop.know-center.at (168/400)
  120. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 166.0 in stage 7.0 (TID 641) in 143 ms on node06.hadoop.know-center.at (169/400)
  121. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 185.0 in stage 7.0 (TID 660, node12.hadoop.know-center.at, partition 185,NODE_LOCAL, 1894 bytes)
  122. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 171.0 in stage 7.0 (TID 646) in 113 ms on node12.hadoop.know-center.at (170/400)
  123. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 186.0 in stage 7.0 (TID 661, node06.hadoop.know-center.at, partition 186,NODE_LOCAL, 1894 bytes)
  124. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 168.0 in stage 7.0 (TID 643) in 145 ms on node06.hadoop.know-center.at (171/400)
  125. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 187.0 in stage 7.0 (TID 662, node12.hadoop.know-center.at, partition 187,NODE_LOCAL, 1894 bytes)
  126. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 172.0 in stage 7.0 (TID 647) in 119 ms on node12.hadoop.know-center.at (172/400)
  127. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 188.0 in stage 7.0 (TID 663, node06.hadoop.know-center.at, partition 188,NODE_LOCAL, 1894 bytes)
  128. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 170.0 in stage 7.0 (TID 645) in 144 ms on node06.hadoop.know-center.at (173/400)
  129. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 189.0 in stage 7.0 (TID 664, node12.hadoop.know-center.at, partition 189,NODE_LOCAL, 1894 bytes)
  130. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 174.0 in stage 7.0 (TID 649) in 116 ms on node12.hadoop.know-center.at (174/400)
  131. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 190.0 in stage 7.0 (TID 665, node06.hadoop.know-center.at, partition 190,NODE_LOCAL, 1894 bytes)
  132. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 173.0 in stage 7.0 (TID 648) in 142 ms on node06.hadoop.know-center.at (175/400)
  133. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 191.0 in stage 7.0 (TID 666, node12.hadoop.know-center.at, partition 191,NODE_LOCAL, 1894 bytes)
  134. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 176.0 in stage 7.0 (TID 651) in 118 ms on node12.hadoop.know-center.at (176/400)
  135. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 192.0 in stage 7.0 (TID 667, node12.hadoop.know-center.at, partition 192,NODE_LOCAL, 1894 bytes)
  136. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 178.0 in stage 7.0 (TID 653) in 118 ms on node12.hadoop.know-center.at (177/400)
  137. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 193.0 in stage 7.0 (TID 668, node06.hadoop.know-center.at, partition 193,NODE_LOCAL, 1894 bytes)
  138. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 175.0 in stage 7.0 (TID 650) in 145 ms on node06.hadoop.know-center.at (178/400)
  139. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 194.0 in stage 7.0 (TID 669, node12.hadoop.know-center.at, partition 194,NODE_LOCAL, 1894 bytes)
  140. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 180.0 in stage 7.0 (TID 655) in 113 ms on node12.hadoop.know-center.at (179/400)
  141. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 195.0 in stage 7.0 (TID 670, node06.hadoop.know-center.at, partition 195,NODE_LOCAL, 1894 bytes)
  142. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 177.0 in stage 7.0 (TID 652) in 141 ms on node06.hadoop.know-center.at (180/400)
  143. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 196.0 in stage 7.0 (TID 671, node12.hadoop.know-center.at, partition 196,NODE_LOCAL, 1894 bytes)
  144. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 181.0 in stage 7.0 (TID 656) in 121 ms on node12.hadoop.know-center.at (181/400)
  145. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 197.0 in stage 7.0 (TID 672, node06.hadoop.know-center.at, partition 197,NODE_LOCAL, 1894 bytes)
  146. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 179.0 in stage 7.0 (TID 654) in 138 ms on node06.hadoop.know-center.at (182/400)
  147. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 198.0 in stage 7.0 (TID 673, node12.hadoop.know-center.at, partition 198,NODE_LOCAL, 1894 bytes)
  148. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 183.0 in stage 7.0 (TID 658) in 118 ms on node12.hadoop.know-center.at (183/400)
  149. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 199.0 in stage 7.0 (TID 674, node06.hadoop.know-center.at, partition 199,NODE_LOCAL, 1894 bytes)
  150. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 182.0 in stage 7.0 (TID 657) in 144 ms on node06.hadoop.know-center.at (184/400)
  151. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 200.0 in stage 7.0 (TID 675, node12.hadoop.know-center.at, partition 200,NODE_LOCAL, 1894 bytes)
  152. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 185.0 in stage 7.0 (TID 660) in 122 ms on node12.hadoop.know-center.at (185/400)
  153. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 201.0 in stage 7.0 (TID 676, node06.hadoop.know-center.at, partition 201,NODE_LOCAL, 1894 bytes)
  154. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 184.0 in stage 7.0 (TID 659) in 143 ms on node06.hadoop.know-center.at (186/400)
  155. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 202.0 in stage 7.0 (TID 677, node12.hadoop.know-center.at, partition 202,NODE_LOCAL, 1894 bytes)
  156. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 187.0 in stage 7.0 (TID 662) in 117 ms on node12.hadoop.know-center.at (187/400)
  157. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 203.0 in stage 7.0 (TID 678, node12.hadoop.know-center.at, partition 203,NODE_LOCAL, 1894 bytes)
  158. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 189.0 in stage 7.0 (TID 664) in 118 ms on node12.hadoop.know-center.at (188/400)
  159. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 204.0 in stage 7.0 (TID 679, node06.hadoop.know-center.at, partition 204,NODE_LOCAL, 1894 bytes)
  160. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 186.0 in stage 7.0 (TID 661) in 143 ms on node06.hadoop.know-center.at (189/400)
  161. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 205.0 in stage 7.0 (TID 680, node12.hadoop.know-center.at, partition 205,NODE_LOCAL, 1894 bytes)
  162. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 191.0 in stage 7.0 (TID 666) in 119 ms on node12.hadoop.know-center.at (190/400)
  163. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 206.0 in stage 7.0 (TID 681, node06.hadoop.know-center.at, partition 206,NODE_LOCAL, 1894 bytes)
  164. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 188.0 in stage 7.0 (TID 663) in 141 ms on node06.hadoop.know-center.at (191/400)
  165. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 207.0 in stage 7.0 (TID 682, node12.hadoop.know-center.at, partition 207,NODE_LOCAL, 1894 bytes)
  166. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 192.0 in stage 7.0 (TID 667) in 116 ms on node12.hadoop.know-center.at (192/400)
  167. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 208.0 in stage 7.0 (TID 683, node06.hadoop.know-center.at, partition 208,NODE_LOCAL, 1894 bytes)
  168. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 190.0 in stage 7.0 (TID 665) in 137 ms on node06.hadoop.know-center.at (193/400)
  169. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 209.0 in stage 7.0 (TID 684, node12.hadoop.know-center.at, partition 209,NODE_LOCAL, 1894 bytes)
  170. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 194.0 in stage 7.0 (TID 669) in 121 ms on node12.hadoop.know-center.at (194/400)
  171. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 210.0 in stage 7.0 (TID 685, node06.hadoop.know-center.at, partition 210,NODE_LOCAL, 1894 bytes)
  172. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 211.0 in stage 7.0 (TID 686, node12.hadoop.know-center.at, partition 211,NODE_LOCAL, 1894 bytes)
  173. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 193.0 in stage 7.0 (TID 668) in 139 ms on node06.hadoop.know-center.at (195/400)
  174. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 196.0 in stage 7.0 (TID 671) in 119 ms on node12.hadoop.know-center.at (196/400)
  175. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 212.0 in stage 7.0 (TID 687, node06.hadoop.know-center.at, partition 212,NODE_LOCAL, 1894 bytes)
  176. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 195.0 in stage 7.0 (TID 670) in 139 ms on node06.hadoop.know-center.at (197/400)
  177. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 213.0 in stage 7.0 (TID 688, node12.hadoop.know-center.at, partition 213,NODE_LOCAL, 1894 bytes)
  178. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 198.0 in stage 7.0 (TID 673) in 120 ms on node12.hadoop.know-center.at (198/400)
  179. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 214.0 in stage 7.0 (TID 689, node06.hadoop.know-center.at, partition 214,NODE_LOCAL, 1894 bytes)
  180. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 197.0 in stage 7.0 (TID 672) in 142 ms on node06.hadoop.know-center.at (199/400)
  181. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 215.0 in stage 7.0 (TID 690, node12.hadoop.know-center.at, partition 215,NODE_LOCAL, 1894 bytes)
  182. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 200.0 in stage 7.0 (TID 675) in 115 ms on node12.hadoop.know-center.at (200/400)
  183. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 216.0 in stage 7.0 (TID 691, node12.hadoop.know-center.at, partition 216,NODE_LOCAL, 1894 bytes)
  184. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 202.0 in stage 7.0 (TID 677) in 118 ms on node12.hadoop.know-center.at (201/400)
  185. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 217.0 in stage 7.0 (TID 692, node06.hadoop.know-center.at, partition 217,NODE_LOCAL, 1894 bytes)
  186. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 199.0 in stage 7.0 (TID 674) in 141 ms on node06.hadoop.know-center.at (202/400)
  187. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 218.0 in stage 7.0 (TID 693, node12.hadoop.know-center.at, partition 218,NODE_LOCAL, 1894 bytes)
  188. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 203.0 in stage 7.0 (TID 678) in 120 ms on node12.hadoop.know-center.at (203/400)
  189. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 219.0 in stage 7.0 (TID 694, node06.hadoop.know-center.at, partition 219,NODE_LOCAL, 1894 bytes)
  190. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 201.0 in stage 7.0 (TID 676) in 145 ms on node06.hadoop.know-center.at (204/400)
  191. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 220.0 in stage 7.0 (TID 695, node12.hadoop.know-center.at, partition 220,NODE_LOCAL, 1894 bytes)
  192. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 205.0 in stage 7.0 (TID 680) in 117 ms on node12.hadoop.know-center.at (205/400)
  193. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 221.0 in stage 7.0 (TID 696, node06.hadoop.know-center.at, partition 221,NODE_LOCAL, 1894 bytes)
  194. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 204.0 in stage 7.0 (TID 679) in 142 ms on node06.hadoop.know-center.at (206/400)
  195. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 222.0 in stage 7.0 (TID 697, node12.hadoop.know-center.at, partition 222,NODE_LOCAL, 1894 bytes)
  196. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 207.0 in stage 7.0 (TID 682) in 124 ms on node12.hadoop.know-center.at (207/400)
  197. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 223.0 in stage 7.0 (TID 698, node06.hadoop.know-center.at, partition 223,NODE_LOCAL, 1894 bytes)
  198. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 206.0 in stage 7.0 (TID 681) in 138 ms on node06.hadoop.know-center.at (208/400)
  199. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 224.0 in stage 7.0 (TID 699, node12.hadoop.know-center.at, partition 224,NODE_LOCAL, 1894 bytes)
  200. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 209.0 in stage 7.0 (TID 684) in 117 ms on node12.hadoop.know-center.at (209/400)
  201. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 225.0 in stage 7.0 (TID 700, node06.hadoop.know-center.at, partition 225,NODE_LOCAL, 1894 bytes)
  202. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 208.0 in stage 7.0 (TID 683) in 139 ms on node06.hadoop.know-center.at (210/400)
  203. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 226.0 in stage 7.0 (TID 701, node12.hadoop.know-center.at, partition 226,NODE_LOCAL, 1894 bytes)
  204. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 211.0 in stage 7.0 (TID 686) in 122 ms on node12.hadoop.know-center.at (211/400)
  205. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 227.0 in stage 7.0 (TID 702, node06.hadoop.know-center.at, partition 227,NODE_LOCAL, 1894 bytes)
  206. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 210.0 in stage 7.0 (TID 685) in 134 ms on node06.hadoop.know-center.at (212/400)
  207. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 228.0 in stage 7.0 (TID 703, node12.hadoop.know-center.at, partition 228,NODE_LOCAL, 1894 bytes)
  208. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 213.0 in stage 7.0 (TID 688) in 119 ms on node12.hadoop.know-center.at (213/400)
  209. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 229.0 in stage 7.0 (TID 704, node12.hadoop.know-center.at, partition 229,NODE_LOCAL, 1894 bytes)
  210. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 215.0 in stage 7.0 (TID 690) in 120 ms on node12.hadoop.know-center.at (214/400)
  211. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 230.0 in stage 7.0 (TID 705, node06.hadoop.know-center.at, partition 230,NODE_LOCAL, 1894 bytes)
  212. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 212.0 in stage 7.0 (TID 687) in 143 ms on node06.hadoop.know-center.at (215/400)
  213. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 231.0 in stage 7.0 (TID 706, node12.hadoop.know-center.at, partition 231,NODE_LOCAL, 1894 bytes)
  214. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 216.0 in stage 7.0 (TID 691) in 120 ms on node12.hadoop.know-center.at (216/400)
  215. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 232.0 in stage 7.0 (TID 707, node06.hadoop.know-center.at, partition 232,NODE_LOCAL, 1894 bytes)
  216. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 214.0 in stage 7.0 (TID 689) in 145 ms on node06.hadoop.know-center.at (217/400)
  217. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 233.0 in stage 7.0 (TID 708, node12.hadoop.know-center.at, partition 233,NODE_LOCAL, 1894 bytes)
  218. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 218.0 in stage 7.0 (TID 693) in 117 ms on node12.hadoop.know-center.at (218/400)
  219. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 234.0 in stage 7.0 (TID 709, node06.hadoop.know-center.at, partition 234,NODE_LOCAL, 1894 bytes)
  220. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 217.0 in stage 7.0 (TID 692) in 147 ms on node06.hadoop.know-center.at (219/400)
  221. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 235.0 in stage 7.0 (TID 710, node12.hadoop.know-center.at, partition 235,NODE_LOCAL, 1894 bytes)
  222. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 220.0 in stage 7.0 (TID 695) in 123 ms on node12.hadoop.know-center.at (220/400)
  223. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 236.0 in stage 7.0 (TID 711, node12.hadoop.know-center.at, partition 236,NODE_LOCAL, 1894 bytes)
  224. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 222.0 in stage 7.0 (TID 697) in 118 ms on node12.hadoop.know-center.at (221/400)
  225. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 237.0 in stage 7.0 (TID 712, node06.hadoop.know-center.at, partition 237,NODE_LOCAL, 1894 bytes)
  226. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 219.0 in stage 7.0 (TID 694) in 145 ms on node06.hadoop.know-center.at (222/400)
  227. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 238.0 in stage 7.0 (TID 713, node12.hadoop.know-center.at, partition 238,NODE_LOCAL, 1894 bytes)
  228. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 224.0 in stage 7.0 (TID 699) in 121 ms on node12.hadoop.know-center.at (223/400)
  229. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 239.0 in stage 7.0 (TID 714, node06.hadoop.know-center.at, partition 239,NODE_LOCAL, 1894 bytes)
  230. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 221.0 in stage 7.0 (TID 696) in 142 ms on node06.hadoop.know-center.at (224/400)
  231. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 240.0 in stage 7.0 (TID 715, node12.hadoop.know-center.at, partition 240,NODE_LOCAL, 1894 bytes)
  232. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 226.0 in stage 7.0 (TID 701) in 115 ms on node12.hadoop.know-center.at (225/400)
  233. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 241.0 in stage 7.0 (TID 716, node06.hadoop.know-center.at, partition 241,NODE_LOCAL, 1894 bytes)
  234. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 223.0 in stage 7.0 (TID 698) in 146 ms on node06.hadoop.know-center.at (226/400)
  235. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 242.0 in stage 7.0 (TID 717, node12.hadoop.know-center.at, partition 242,NODE_LOCAL, 1894 bytes)
  236. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 228.0 in stage 7.0 (TID 703) in 118 ms on node12.hadoop.know-center.at (227/400)
  237. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 243.0 in stage 7.0 (TID 718, node06.hadoop.know-center.at, partition 243,NODE_LOCAL, 1894 bytes)
  238. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 225.0 in stage 7.0 (TID 700) in 146 ms on node06.hadoop.know-center.at (228/400)
  239. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 244.0 in stage 7.0 (TID 719, node12.hadoop.know-center.at, partition 244,NODE_LOCAL, 1894 bytes)
  240. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 229.0 in stage 7.0 (TID 704) in 118 ms on node12.hadoop.know-center.at (229/400)
  241. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 245.0 in stage 7.0 (TID 720, node12.hadoop.know-center.at, partition 245,NODE_LOCAL, 1894 bytes)
  242. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 246.0 in stage 7.0 (TID 721, node06.hadoop.know-center.at, partition 246,NODE_LOCAL, 1894 bytes)
  243. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 231.0 in stage 7.0 (TID 706) in 118 ms on node12.hadoop.know-center.at (230/400)
  244. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 227.0 in stage 7.0 (TID 702) in 150 ms on node06.hadoop.know-center.at (231/400)
  245. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 247.0 in stage 7.0 (TID 722, node12.hadoop.know-center.at, partition 247,NODE_LOCAL, 1894 bytes)
  246. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 233.0 in stage 7.0 (TID 708) in 122 ms on node12.hadoop.know-center.at (232/400)
  247. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 248.0 in stage 7.0 (TID 723, node06.hadoop.know-center.at, partition 248,NODE_LOCAL, 1894 bytes)
  248. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 230.0 in stage 7.0 (TID 705) in 150 ms on node06.hadoop.know-center.at (233/400)
  249. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 249.0 in stage 7.0 (TID 724, node12.hadoop.know-center.at, partition 249,NODE_LOCAL, 1894 bytes)
  250. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 235.0 in stage 7.0 (TID 710) in 115 ms on node12.hadoop.know-center.at (234/400)
  251. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 250.0 in stage 7.0 (TID 725, node06.hadoop.know-center.at, partition 250,NODE_LOCAL, 1894 bytes)
  252. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 232.0 in stage 7.0 (TID 707) in 151 ms on node06.hadoop.know-center.at (235/400)
  253. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 251.0 in stage 7.0 (TID 726, node12.hadoop.know-center.at, partition 251,NODE_LOCAL, 1894 bytes)
  254. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 236.0 in stage 7.0 (TID 711) in 121 ms on node12.hadoop.know-center.at (236/400)
  255. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 252.0 in stage 7.0 (TID 727, node06.hadoop.know-center.at, partition 252,NODE_LOCAL, 1894 bytes)
  256. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 253.0 in stage 7.0 (TID 728, node12.hadoop.know-center.at, partition 253,NODE_LOCAL, 1894 bytes)
  257. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 234.0 in stage 7.0 (TID 709) in 149 ms on node06.hadoop.know-center.at (237/400)
  258. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 238.0 in stage 7.0 (TID 713) in 119 ms on node12.hadoop.know-center.at (238/400)
  259. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 254.0 in stage 7.0 (TID 729, node06.hadoop.know-center.at, partition 254,NODE_LOCAL, 1894 bytes)
  260. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 237.0 in stage 7.0 (TID 712) in 143 ms on node06.hadoop.know-center.at (239/400)
  261. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 255.0 in stage 7.0 (TID 730, node12.hadoop.know-center.at, partition 255,NODE_LOCAL, 1894 bytes)
  262. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 240.0 in stage 7.0 (TID 715) in 119 ms on node12.hadoop.know-center.at (240/400)
  263. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 256.0 in stage 7.0 (TID 731, node12.hadoop.know-center.at, partition 256,NODE_LOCAL, 1894 bytes)
  264. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 242.0 in stage 7.0 (TID 717) in 118 ms on node12.hadoop.know-center.at (241/400)
  265. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 257.0 in stage 7.0 (TID 732, node06.hadoop.know-center.at, partition 257,NODE_LOCAL, 1894 bytes)
  266. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 239.0 in stage 7.0 (TID 714) in 146 ms on node06.hadoop.know-center.at (242/400)
  267. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 258.0 in stage 7.0 (TID 733, node12.hadoop.know-center.at, partition 258,NODE_LOCAL, 1894 bytes)
  268. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 244.0 in stage 7.0 (TID 719) in 118 ms on node12.hadoop.know-center.at (243/400)
  269. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 259.0 in stage 7.0 (TID 734, node06.hadoop.know-center.at, partition 259,NODE_LOCAL, 1894 bytes)
  270. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 241.0 in stage 7.0 (TID 716) in 141 ms on node06.hadoop.know-center.at (244/400)
  271. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 260.0 in stage 7.0 (TID 735, node12.hadoop.know-center.at, partition 260,NODE_LOCAL, 1894 bytes)
  272. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 245.0 in stage 7.0 (TID 720) in 121 ms on node12.hadoop.know-center.at (245/400)
  273. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 261.0 in stage 7.0 (TID 736, node06.hadoop.know-center.at, partition 261,NODE_LOCAL, 1894 bytes)
  274. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 243.0 in stage 7.0 (TID 718) in 144 ms on node06.hadoop.know-center.at (246/400)
  275. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 262.0 in stage 7.0 (TID 737, node12.hadoop.know-center.at, partition 262,NODE_LOCAL, 1894 bytes)
  276. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 247.0 in stage 7.0 (TID 722) in 120 ms on node12.hadoop.know-center.at (247/400)
  277. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 263.0 in stage 7.0 (TID 738, node06.hadoop.know-center.at, partition 263,NODE_LOCAL, 1894 bytes)
  278. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 246.0 in stage 7.0 (TID 721) in 145 ms on node06.hadoop.know-center.at (248/400)
  279. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 264.0 in stage 7.0 (TID 739, node12.hadoop.know-center.at, partition 264,NODE_LOCAL, 1894 bytes)
  280. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 249.0 in stage 7.0 (TID 724) in 124 ms on node12.hadoop.know-center.at (249/400)
  281. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 265.0 in stage 7.0 (TID 740, node12.hadoop.know-center.at, partition 265,NODE_LOCAL, 1894 bytes)
  282. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 266.0 in stage 7.0 (TID 741, node06.hadoop.know-center.at, partition 266,NODE_LOCAL, 1894 bytes)
  283. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 251.0 in stage 7.0 (TID 726) in 118 ms on node12.hadoop.know-center.at (250/400)
  284. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 248.0 in stage 7.0 (TID 723) in 147 ms on node06.hadoop.know-center.at (251/400)
  285. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 267.0 in stage 7.0 (TID 742, node12.hadoop.know-center.at, partition 267,NODE_LOCAL, 1894 bytes)
  286. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 253.0 in stage 7.0 (TID 728) in 119 ms on node12.hadoop.know-center.at (252/400)
  287. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 268.0 in stage 7.0 (TID 743, node06.hadoop.know-center.at, partition 268,NODE_LOCAL, 1894 bytes)
  288. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 250.0 in stage 7.0 (TID 725) in 143 ms on node06.hadoop.know-center.at (253/400)
  289. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 269.0 in stage 7.0 (TID 744, node12.hadoop.know-center.at, partition 269,NODE_LOCAL, 1894 bytes)
  290. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 255.0 in stage 7.0 (TID 730) in 120 ms on node12.hadoop.know-center.at (254/400)
  291. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 270.0 in stage 7.0 (TID 745, node06.hadoop.know-center.at, partition 270,NODE_LOCAL, 1894 bytes)
  292. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 252.0 in stage 7.0 (TID 727) in 139 ms on node06.hadoop.know-center.at (255/400)
  293. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 271.0 in stage 7.0 (TID 746, node12.hadoop.know-center.at, partition 271,NODE_LOCAL, 1894 bytes)
  294. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 256.0 in stage 7.0 (TID 731) in 118 ms on node12.hadoop.know-center.at (256/400)
  295. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 272.0 in stage 7.0 (TID 747, node06.hadoop.know-center.at, partition 272,NODE_LOCAL, 1894 bytes)
  296. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 254.0 in stage 7.0 (TID 729) in 145 ms on node06.hadoop.know-center.at (257/400)
  297. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 273.0 in stage 7.0 (TID 748, node12.hadoop.know-center.at, partition 273,NODE_LOCAL, 1894 bytes)
  298. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 258.0 in stage 7.0 (TID 733) in 121 ms on node12.hadoop.know-center.at (258/400)
  299. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 274.0 in stage 7.0 (TID 749, node06.hadoop.know-center.at, partition 274,NODE_LOCAL, 1894 bytes)
  300. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 257.0 in stage 7.0 (TID 732) in 142 ms on node06.hadoop.know-center.at (259/400)
  301. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 275.0 in stage 7.0 (TID 750, node12.hadoop.know-center.at, partition 275,NODE_LOCAL, 1894 bytes)
  302. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 260.0 in stage 7.0 (TID 735) in 119 ms on node12.hadoop.know-center.at (260/400)
  303. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 276.0 in stage 7.0 (TID 751, node06.hadoop.know-center.at, partition 276,NODE_LOCAL, 1894 bytes)
  304. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 259.0 in stage 7.0 (TID 734) in 149 ms on node06.hadoop.know-center.at (261/400)
  305. 16/04/23 20:27:43 INFO TaskSetManager: Starting task 277.0 in stage 7.0 (TID 752, node12.hadoop.know-center.at, partition 277,NODE_LOCAL, 1894 bytes)
  306. 16/04/23 20:27:43 INFO TaskSetManager: Finished task 262.0 in stage 7.0 (TID 737) in 121 ms on node12.hadoop.know-center.at (262/400)
  307. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 278.0 in stage 7.0 (TID 753, node12.hadoop.know-center.at, partition 278,NODE_LOCAL, 1894 bytes)
  308. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 279.0 in stage 7.0 (TID 754, node12.hadoop.know-center.at, partition 279,NODE_LOCAL, 1894 bytes)
  309. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 264.0 in stage 7.0 (TID 739) in 316 ms on node12.hadoop.know-center.at (263/400)
  310. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 280.0 in stage 7.0 (TID 755, node12.hadoop.know-center.at, partition 280,NODE_LOCAL, 1894 bytes)
  311. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 265.0 in stage 7.0 (TID 740) in 309 ms on node12.hadoop.know-center.at (264/400)
  312. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 267.0 in stage 7.0 (TID 742) in 296 ms on node12.hadoop.know-center.at (265/400)
  313. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 281.0 in stage 7.0 (TID 756, node12.hadoop.know-center.at, partition 281,NODE_LOCAL, 1894 bytes)
  314. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 269.0 in stage 7.0 (TID 744) in 288 ms on node12.hadoop.know-center.at (266/400)
  315. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 282.0 in stage 7.0 (TID 757, node12.hadoop.know-center.at, partition 282,NODE_LOCAL, 1894 bytes)
  316. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 271.0 in stage 7.0 (TID 746) in 283 ms on node12.hadoop.know-center.at (267/400)
  317. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 283.0 in stage 7.0 (TID 758, node06.hadoop.know-center.at, partition 283,NODE_LOCAL, 1894 bytes)
  318. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 284.0 in stage 7.0 (TID 759, node06.hadoop.know-center.at, partition 284,NODE_LOCAL, 1894 bytes)
  319. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 261.0 in stage 7.0 (TID 736) in 367 ms on node06.hadoop.know-center.at (268/400)
  320. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 263.0 in stage 7.0 (TID 738) in 347 ms on node06.hadoop.know-center.at (269/400)
  321. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 285.0 in stage 7.0 (TID 760, node12.hadoop.know-center.at, partition 285,NODE_LOCAL, 1894 bytes)
  322. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 273.0 in stage 7.0 (TID 748) in 271 ms on node12.hadoop.know-center.at (270/400)
  323. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 286.0 in stage 7.0 (TID 761, node12.hadoop.know-center.at, partition 286,NODE_LOCAL, 1894 bytes)
  324. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 287.0 in stage 7.0 (TID 762, node06.hadoop.know-center.at, partition 287,NODE_LOCAL, 1894 bytes)
  325. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 275.0 in stage 7.0 (TID 750) in 276 ms on node12.hadoop.know-center.at (271/400)
  326. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 266.0 in stage 7.0 (TID 741) in 349 ms on node06.hadoop.know-center.at (272/400)
  327. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 288.0 in stage 7.0 (TID 763, node06.hadoop.know-center.at, partition 288,NODE_LOCAL, 1894 bytes)
  328. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 268.0 in stage 7.0 (TID 743) in 341 ms on node06.hadoop.know-center.at (273/400)
  329. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 289.0 in stage 7.0 (TID 764, node12.hadoop.know-center.at, partition 289,NODE_LOCAL, 1894 bytes)
  330. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 277.0 in stage 7.0 (TID 752) in 286 ms on node12.hadoop.know-center.at (274/400)
  331. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 290.0 in stage 7.0 (TID 765, node06.hadoop.know-center.at, partition 290,NODE_LOCAL, 1894 bytes)
  332. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 270.0 in stage 7.0 (TID 745) in 347 ms on node06.hadoop.know-center.at (275/400)
  333. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 291.0 in stage 7.0 (TID 766, node12.hadoop.know-center.at, partition 291,NODE_LOCAL, 1894 bytes)
  334. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 278.0 in stage 7.0 (TID 753) in 88 ms on node12.hadoop.know-center.at (276/400)
  335. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 292.0 in stage 7.0 (TID 767, node06.hadoop.know-center.at, partition 292,NODE_LOCAL, 1894 bytes)
  336. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 272.0 in stage 7.0 (TID 747) in 345 ms on node06.hadoop.know-center.at (277/400)
  337. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 293.0 in stage 7.0 (TID 768, node06.hadoop.know-center.at, partition 293,NODE_LOCAL, 1894 bytes)
  338. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 274.0 in stage 7.0 (TID 749) in 339 ms on node06.hadoop.know-center.at (278/400)
  339. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 294.0 in stage 7.0 (TID 769, node12.hadoop.know-center.at, partition 294,NODE_LOCAL, 1894 bytes)
  340. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 279.0 in stage 7.0 (TID 754) in 102 ms on node12.hadoop.know-center.at (279/400)
  341. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 295.0 in stage 7.0 (TID 770, node12.hadoop.know-center.at, partition 295,NODE_LOCAL, 1894 bytes)
  342. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 280.0 in stage 7.0 (TID 755) in 116 ms on node12.hadoop.know-center.at (280/400)
  343. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 296.0 in stage 7.0 (TID 771, node06.hadoop.know-center.at, partition 296,NODE_LOCAL, 1894 bytes)
  344. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 276.0 in stage 7.0 (TID 751) in 354 ms on node06.hadoop.know-center.at (281/400)
  345. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 297.0 in stage 7.0 (TID 772, node12.hadoop.know-center.at, partition 297,NODE_LOCAL, 1894 bytes)
  346. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 281.0 in stage 7.0 (TID 756) in 128 ms on node12.hadoop.know-center.at (282/400)
  347. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 298.0 in stage 7.0 (TID 773, node06.hadoop.know-center.at, partition 298,NODE_LOCAL, 1894 bytes)
  348. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 284.0 in stage 7.0 (TID 759) in 125 ms on node06.hadoop.know-center.at (283/400)
  349. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 299.0 in stage 7.0 (TID 774, node12.hadoop.know-center.at, partition 299,NODE_LOCAL, 1894 bytes)
  350. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 282.0 in stage 7.0 (TID 757) in 133 ms on node12.hadoop.know-center.at (284/400)
  351. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 300.0 in stage 7.0 (TID 775, node06.hadoop.know-center.at, partition 300,NODE_LOCAL, 1894 bytes)
  352. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 283.0 in stage 7.0 (TID 758) in 140 ms on node06.hadoop.know-center.at (285/400)
  353. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 301.0 in stage 7.0 (TID 776, node12.hadoop.know-center.at, partition 301,NODE_LOCAL, 1894 bytes)
  354. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 285.0 in stage 7.0 (TID 760) in 141 ms on node12.hadoop.know-center.at (286/400)
  355. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 302.0 in stage 7.0 (TID 777, node06.hadoop.know-center.at, partition 302,NODE_LOCAL, 1894 bytes)
  356. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 287.0 in stage 7.0 (TID 762) in 133 ms on node06.hadoop.know-center.at (287/400)
  357. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 303.0 in stage 7.0 (TID 778, node12.hadoop.know-center.at, partition 303,NODE_LOCAL, 1894 bytes)
  358. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 286.0 in stage 7.0 (TID 761) in 144 ms on node12.hadoop.know-center.at (288/400)
  359. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 304.0 in stage 7.0 (TID 779, node06.hadoop.know-center.at, partition 304,NODE_LOCAL, 1894 bytes)
  360. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 288.0 in stage 7.0 (TID 763) in 140 ms on node06.hadoop.know-center.at (289/400)
  361. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 305.0 in stage 7.0 (TID 780, node12.hadoop.know-center.at, partition 305,NODE_LOCAL, 1894 bytes)
  362. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 306.0 in stage 7.0 (TID 781, node06.hadoop.know-center.at, partition 306,NODE_LOCAL, 1894 bytes)
  363. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 289.0 in stage 7.0 (TID 764) in 139 ms on node12.hadoop.know-center.at (290/400)
  364. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 290.0 in stage 7.0 (TID 765) in 133 ms on node06.hadoop.know-center.at (291/400)
  365. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 307.0 in stage 7.0 (TID 782, node12.hadoop.know-center.at, partition 307,NODE_LOCAL, 1894 bytes)
  366. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 308.0 in stage 7.0 (TID 783, node06.hadoop.know-center.at, partition 308,NODE_LOCAL, 1894 bytes)
  367. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 291.0 in stage 7.0 (TID 766) in 134 ms on node12.hadoop.know-center.at (292/400)
  368. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 292.0 in stage 7.0 (TID 767) in 132 ms on node06.hadoop.know-center.at (293/400)
  369. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 309.0 in stage 7.0 (TID 784, node12.hadoop.know-center.at, partition 309,NODE_LOCAL, 1894 bytes)
  370. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 294.0 in stage 7.0 (TID 769) in 136 ms on node12.hadoop.know-center.at (294/400)
  371. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 310.0 in stage 7.0 (TID 785, node06.hadoop.know-center.at, partition 310,NODE_LOCAL, 1894 bytes)
  372. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 293.0 in stage 7.0 (TID 768) in 146 ms on node06.hadoop.know-center.at (295/400)
  373. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 311.0 in stage 7.0 (TID 786, node12.hadoop.know-center.at, partition 311,NODE_LOCAL, 1894 bytes)
  374. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 295.0 in stage 7.0 (TID 770) in 135 ms on node12.hadoop.know-center.at (296/400)
  375. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 312.0 in stage 7.0 (TID 787, node12.hadoop.know-center.at, partition 312,NODE_LOCAL, 1894 bytes)
  376. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 297.0 in stage 7.0 (TID 772) in 130 ms on node12.hadoop.know-center.at (297/400)
  377. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 313.0 in stage 7.0 (TID 788, node06.hadoop.know-center.at, partition 313,NODE_LOCAL, 1894 bytes)
  378. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 296.0 in stage 7.0 (TID 771) in 134 ms on node06.hadoop.know-center.at (298/400)
  379. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 314.0 in stage 7.0 (TID 789, node12.hadoop.know-center.at, partition 314,NODE_LOCAL, 1894 bytes)
  380. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 299.0 in stage 7.0 (TID 774) in 132 ms on node12.hadoop.know-center.at (299/400)
  381. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 315.0 in stage 7.0 (TID 790, node06.hadoop.know-center.at, partition 315,NODE_LOCAL, 1894 bytes)
  382. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 298.0 in stage 7.0 (TID 773) in 140 ms on node06.hadoop.know-center.at (300/400)
  383. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 316.0 in stage 7.0 (TID 791, node12.hadoop.know-center.at, partition 316,NODE_LOCAL, 1894 bytes)
  384. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 301.0 in stage 7.0 (TID 776) in 135 ms on node12.hadoop.know-center.at (301/400)
  385. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 317.0 in stage 7.0 (TID 792, node06.hadoop.know-center.at, partition 317,NODE_LOCAL, 1894 bytes)
  386. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 300.0 in stage 7.0 (TID 775) in 142 ms on node06.hadoop.know-center.at (302/400)
  387. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 318.0 in stage 7.0 (TID 793, node06.hadoop.know-center.at, partition 318,NODE_LOCAL, 1894 bytes)
  388. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 302.0 in stage 7.0 (TID 777) in 143 ms on node06.hadoop.know-center.at (303/400)
  389. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 319.0 in stage 7.0 (TID 794, node12.hadoop.know-center.at, partition 319,NODE_LOCAL, 1894 bytes)
  390. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 303.0 in stage 7.0 (TID 778) in 136 ms on node12.hadoop.know-center.at (304/400)
  391. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 320.0 in stage 7.0 (TID 795, node06.hadoop.know-center.at, partition 320,NODE_LOCAL, 1894 bytes)
  392. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 321.0 in stage 7.0 (TID 796, node12.hadoop.know-center.at, partition 321,NODE_LOCAL, 1894 bytes)
  393. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 304.0 in stage 7.0 (TID 779) in 141 ms on node06.hadoop.know-center.at (305/400)
  394. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 305.0 in stage 7.0 (TID 780) in 127 ms on node12.hadoop.know-center.at (306/400)
  395. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 322.0 in stage 7.0 (TID 797, node06.hadoop.know-center.at, partition 322,NODE_LOCAL, 1894 bytes)
  396. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 306.0 in stage 7.0 (TID 781) in 139 ms on node06.hadoop.know-center.at (307/400)
  397. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 323.0 in stage 7.0 (TID 798, node12.hadoop.know-center.at, partition 323,NODE_LOCAL, 1894 bytes)
  398. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 307.0 in stage 7.0 (TID 782) in 127 ms on node12.hadoop.know-center.at (308/400)
  399. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 324.0 in stage 7.0 (TID 799, node12.hadoop.know-center.at, partition 324,NODE_LOCAL, 1894 bytes)
  400. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 309.0 in stage 7.0 (TID 784) in 123 ms on node12.hadoop.know-center.at (309/400)
  401. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 325.0 in stage 7.0 (TID 800, node06.hadoop.know-center.at, partition 325,NODE_LOCAL, 1894 bytes)
  402. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 308.0 in stage 7.0 (TID 783) in 149 ms on node06.hadoop.know-center.at (310/400)
  403. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 326.0 in stage 7.0 (TID 801, node12.hadoop.know-center.at, partition 326,NODE_LOCAL, 1894 bytes)
  404. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 311.0 in stage 7.0 (TID 786) in 121 ms on node12.hadoop.know-center.at (311/400)
  405. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 327.0 in stage 7.0 (TID 802, node12.hadoop.know-center.at, partition 327,NODE_LOCAL, 1894 bytes)
  406. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 312.0 in stage 7.0 (TID 787) in 122 ms on node12.hadoop.know-center.at (312/400)
  407. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 328.0 in stage 7.0 (TID 803, node06.hadoop.know-center.at, partition 328,NODE_LOCAL, 1894 bytes)
  408. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 310.0 in stage 7.0 (TID 785) in 147 ms on node06.hadoop.know-center.at (313/400)
  409. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 329.0 in stage 7.0 (TID 804, node12.hadoop.know-center.at, partition 329,NODE_LOCAL, 1894 bytes)
  410. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 314.0 in stage 7.0 (TID 789) in 124 ms on node12.hadoop.know-center.at (314/400)
  411. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 330.0 in stage 7.0 (TID 805, node06.hadoop.know-center.at, partition 330,NODE_LOCAL, 1894 bytes)
  412. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 313.0 in stage 7.0 (TID 788) in 140 ms on node06.hadoop.know-center.at (315/400)
  413. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 331.0 in stage 7.0 (TID 806, node12.hadoop.know-center.at, partition 331,NODE_LOCAL, 1894 bytes)
  414. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 316.0 in stage 7.0 (TID 791) in 126 ms on node12.hadoop.know-center.at (316/400)
  415. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 332.0 in stage 7.0 (TID 807, node06.hadoop.know-center.at, partition 332,NODE_LOCAL, 1894 bytes)
  416. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 315.0 in stage 7.0 (TID 790) in 142 ms on node06.hadoop.know-center.at (317/400)
  417. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 333.0 in stage 7.0 (TID 808, node12.hadoop.know-center.at, partition 333,NODE_LOCAL, 1894 bytes)
  418. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 319.0 in stage 7.0 (TID 794) in 118 ms on node12.hadoop.know-center.at (318/400)
  419. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 334.0 in stage 7.0 (TID 809, node06.hadoop.know-center.at, partition 334,NODE_LOCAL, 1894 bytes)
  420. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 317.0 in stage 7.0 (TID 792) in 141 ms on node06.hadoop.know-center.at (319/400)
  421. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 335.0 in stage 7.0 (TID 810, node12.hadoop.know-center.at, partition 335,NODE_LOCAL, 1894 bytes)
  422. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 321.0 in stage 7.0 (TID 796) in 120 ms on node12.hadoop.know-center.at (320/400)
  423. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 336.0 in stage 7.0 (TID 811, node06.hadoop.know-center.at, partition 336,NODE_LOCAL, 1894 bytes)
  424. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 318.0 in stage 7.0 (TID 793) in 139 ms on node06.hadoop.know-center.at (321/400)
  425. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 337.0 in stage 7.0 (TID 812, node12.hadoop.know-center.at, partition 337,NODE_LOCAL, 1894 bytes)
  426. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 323.0 in stage 7.0 (TID 798) in 119 ms on node12.hadoop.know-center.at (322/400)
  427. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 338.0 in stage 7.0 (TID 813, node06.hadoop.know-center.at, partition 338,NODE_LOCAL, 1894 bytes)
  428. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 320.0 in stage 7.0 (TID 795) in 137 ms on node06.hadoop.know-center.at (323/400)
  429. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 339.0 in stage 7.0 (TID 814, node12.hadoop.know-center.at, partition 339,NODE_LOCAL, 1894 bytes)
  430. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 324.0 in stage 7.0 (TID 799) in 122 ms on node12.hadoop.know-center.at (324/400)
  431. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 340.0 in stage 7.0 (TID 815, node06.hadoop.know-center.at, partition 340,NODE_LOCAL, 1894 bytes)
  432. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 322.0 in stage 7.0 (TID 797) in 145 ms on node06.hadoop.know-center.at (325/400)
  433. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 341.0 in stage 7.0 (TID 816, node12.hadoop.know-center.at, partition 341,NODE_LOCAL, 1894 bytes)
  434. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 326.0 in stage 7.0 (TID 801) in 122 ms on node12.hadoop.know-center.at (326/400)
  435. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 342.0 in stage 7.0 (TID 817, node12.hadoop.know-center.at, partition 342,NODE_LOCAL, 1894 bytes)
  436. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 327.0 in stage 7.0 (TID 802) in 122 ms on node12.hadoop.know-center.at (327/400)
  437. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 343.0 in stage 7.0 (TID 818, node06.hadoop.know-center.at, partition 343,NODE_LOCAL, 1894 bytes)
  438. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 325.0 in stage 7.0 (TID 800) in 146 ms on node06.hadoop.know-center.at (328/400)
  439. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 344.0 in stage 7.0 (TID 819, node12.hadoop.know-center.at, partition 344,NODE_LOCAL, 1894 bytes)
  440. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 329.0 in stage 7.0 (TID 804) in 123 ms on node12.hadoop.know-center.at (329/400)
  441. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 345.0 in stage 7.0 (TID 820, node06.hadoop.know-center.at, partition 345,NODE_LOCAL, 1894 bytes)
  442. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 328.0 in stage 7.0 (TID 803) in 140 ms on node06.hadoop.know-center.at (330/400)
  443. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 346.0 in stage 7.0 (TID 821, node12.hadoop.know-center.at, partition 346,NODE_LOCAL, 1894 bytes)
  444. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 331.0 in stage 7.0 (TID 806) in 120 ms on node12.hadoop.know-center.at (331/400)
  445. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 347.0 in stage 7.0 (TID 822, node06.hadoop.know-center.at, partition 347,NODE_LOCAL, 1894 bytes)
  446. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 330.0 in stage 7.0 (TID 805) in 142 ms on node06.hadoop.know-center.at (332/400)
  447. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 348.0 in stage 7.0 (TID 823, node12.hadoop.know-center.at, partition 348,NODE_LOCAL, 1894 bytes)
  448. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 333.0 in stage 7.0 (TID 808) in 121 ms on node12.hadoop.know-center.at (333/400)
  449. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 349.0 in stage 7.0 (TID 824, node06.hadoop.know-center.at, partition 349,NODE_LOCAL, 1894 bytes)
  450. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 332.0 in stage 7.0 (TID 807) in 138 ms on node06.hadoop.know-center.at (334/400)
  451. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 350.0 in stage 7.0 (TID 825, node12.hadoop.know-center.at, partition 350,NODE_LOCAL, 1894 bytes)
  452. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 335.0 in stage 7.0 (TID 810) in 116 ms on node12.hadoop.know-center.at (335/400)
  453. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 351.0 in stage 7.0 (TID 826, node06.hadoop.know-center.at, partition 351,NODE_LOCAL, 1894 bytes)
  454. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 334.0 in stage 7.0 (TID 809) in 138 ms on node06.hadoop.know-center.at (336/400)
  455. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 352.0 in stage 7.0 (TID 827, node12.hadoop.know-center.at, partition 352,NODE_LOCAL, 1894 bytes)
  456. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 337.0 in stage 7.0 (TID 812) in 118 ms on node12.hadoop.know-center.at (337/400)
  457. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 353.0 in stage 7.0 (TID 828, node06.hadoop.know-center.at, partition 353,NODE_LOCAL, 1894 bytes)
  458. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 336.0 in stage 7.0 (TID 811) in 139 ms on node06.hadoop.know-center.at (338/400)
  459. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 354.0 in stage 7.0 (TID 829, node12.hadoop.know-center.at, partition 354,NODE_LOCAL, 1894 bytes)
  460. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 339.0 in stage 7.0 (TID 814) in 116 ms on node12.hadoop.know-center.at (339/400)
  461. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 355.0 in stage 7.0 (TID 830, node12.hadoop.know-center.at, partition 355,NODE_LOCAL, 1894 bytes)
  462. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 356.0 in stage 7.0 (TID 831, node06.hadoop.know-center.at, partition 356,NODE_LOCAL, 1894 bytes)
  463. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 341.0 in stage 7.0 (TID 816) in 119 ms on node12.hadoop.know-center.at (340/400)
  464. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 338.0 in stage 7.0 (TID 813) in 144 ms on node06.hadoop.know-center.at (341/400)
  465. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 357.0 in stage 7.0 (TID 832, node12.hadoop.know-center.at, partition 357,NODE_LOCAL, 1894 bytes)
  466. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 342.0 in stage 7.0 (TID 817) in 121 ms on node12.hadoop.know-center.at (342/400)
  467. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 358.0 in stage 7.0 (TID 833, node06.hadoop.know-center.at, partition 358,NODE_LOCAL, 1894 bytes)
  468. 16/04/23 20:27:44 INFO TaskSetManager: Finished task 340.0 in stage 7.0 (TID 815) in 361 ms on node06.hadoop.know-center.at (343/400)
  469. 16/04/23 20:27:44 INFO TaskSetManager: Starting task 359.0 in stage 7.0 (TID 834, node06.hadoop.know-center.at, partition 359,NODE_LOCAL, 1894 bytes)
  470. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 343.0 in stage 7.0 (TID 818) in 348 ms on node06.hadoop.know-center.at (344/400)
  471. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 360.0 in stage 7.0 (TID 835, node12.hadoop.know-center.at, partition 360,NODE_LOCAL, 1894 bytes)
  472. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 344.0 in stage 7.0 (TID 819) in 344 ms on node12.hadoop.know-center.at (345/400)
  473. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 361.0 in stage 7.0 (TID 836, node06.hadoop.know-center.at, partition 361,NODE_LOCAL, 1894 bytes)
  474. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 345.0 in stage 7.0 (TID 820) in 342 ms on node06.hadoop.know-center.at (346/400)
  475. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 362.0 in stage 7.0 (TID 837, node06.hadoop.know-center.at, partition 362,NODE_LOCAL, 1894 bytes)
  476. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 349.0 in stage 7.0 (TID 824) in 316 ms on node06.hadoop.know-center.at (347/400)
  477. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 363.0 in stage 7.0 (TID 838, node06.hadoop.know-center.at, partition 363,NODE_LOCAL, 1894 bytes)
  478. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 351.0 in stage 7.0 (TID 826) in 303 ms on node06.hadoop.know-center.at (348/400)
  479. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 364.0 in stage 7.0 (TID 839, node12.hadoop.know-center.at, partition 364,NODE_LOCAL, 1894 bytes)
  480. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 365.0 in stage 7.0 (TID 840, node06.hadoop.know-center.at, partition 365,NODE_LOCAL, 1894 bytes)
  481. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 346.0 in stage 7.0 (TID 821) in 340 ms on node12.hadoop.know-center.at (349/400)
  482. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 347.0 in stage 7.0 (TID 822) in 334 ms on node06.hadoop.know-center.at (350/400)
  483. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 366.0 in stage 7.0 (TID 841, node12.hadoop.know-center.at, partition 366,NODE_LOCAL, 1894 bytes)
  484. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 348.0 in stage 7.0 (TID 823) in 335 ms on node12.hadoop.know-center.at (351/400)
  485. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 367.0 in stage 7.0 (TID 842, node06.hadoop.know-center.at, partition 367,NODE_LOCAL, 1894 bytes)
  486. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 353.0 in stage 7.0 (TID 828) in 310 ms on node06.hadoop.know-center.at (352/400)
  487. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 368.0 in stage 7.0 (TID 843, node12.hadoop.know-center.at, partition 368,NODE_LOCAL, 1894 bytes)
  488. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 350.0 in stage 7.0 (TID 825) in 343 ms on node12.hadoop.know-center.at (353/400)
  489. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 369.0 in stage 7.0 (TID 844, node12.hadoop.know-center.at, partition 369,NODE_LOCAL, 1894 bytes)
  490. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 352.0 in stage 7.0 (TID 827) in 339 ms on node12.hadoop.know-center.at (354/400)
  491. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 370.0 in stage 7.0 (TID 845, node06.hadoop.know-center.at, partition 370,NODE_LOCAL, 1894 bytes)
  492. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 356.0 in stage 7.0 (TID 831) in 313 ms on node06.hadoop.know-center.at (355/400)
  493. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 371.0 in stage 7.0 (TID 846, node12.hadoop.know-center.at, partition 371,NODE_LOCAL, 1894 bytes)
  494. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 354.0 in stage 7.0 (TID 829) in 346 ms on node12.hadoop.know-center.at (356/400)
  495. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 372.0 in stage 7.0 (TID 847, node12.hadoop.know-center.at, partition 372,NODE_LOCAL, 1894 bytes)
  496. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 355.0 in stage 7.0 (TID 830) in 342 ms on node12.hadoop.know-center.at (357/400)
  497. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 373.0 in stage 7.0 (TID 848, node12.hadoop.know-center.at, partition 373,NODE_LOCAL, 1894 bytes)
  498. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 357.0 in stage 7.0 (TID 832) in 343 ms on node12.hadoop.know-center.at (358/400)
  499. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 374.0 in stage 7.0 (TID 849, node06.hadoop.know-center.at, partition 374,NODE_LOCAL, 1894 bytes)
  500. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 358.0 in stage 7.0 (TID 833) in 126 ms on node06.hadoop.know-center.at (359/400)
  501. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 375.0 in stage 7.0 (TID 850, node12.hadoop.know-center.at, partition 375,NODE_LOCAL, 1894 bytes)
  502. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 360.0 in stage 7.0 (TID 835) in 122 ms on node12.hadoop.know-center.at (360/400)
  503. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 376.0 in stage 7.0 (TID 851, node06.hadoop.know-center.at, partition 376,NODE_LOCAL, 1894 bytes)
  504. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 359.0 in stage 7.0 (TID 834) in 134 ms on node06.hadoop.know-center.at (361/400)
  505. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 377.0 in stage 7.0 (TID 852, node12.hadoop.know-center.at, partition 377,NODE_LOCAL, 1894 bytes)
  506. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 364.0 in stage 7.0 (TID 839) in 122 ms on node12.hadoop.know-center.at (362/400)
  507. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 378.0 in stage 7.0 (TID 853, node06.hadoop.know-center.at, partition 378,NODE_LOCAL, 1894 bytes)
  508. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 361.0 in stage 7.0 (TID 836) in 140 ms on node06.hadoop.know-center.at (363/400)
  509. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 379.0 in stage 7.0 (TID 854, node12.hadoop.know-center.at, partition 379,NODE_LOCAL, 1894 bytes)
  510. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 366.0 in stage 7.0 (TID 841) in 129 ms on node12.hadoop.know-center.at (364/400)
  511. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 380.0 in stage 7.0 (TID 855, node06.hadoop.know-center.at, partition 380,NODE_LOCAL, 1894 bytes)
  512. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 362.0 in stage 7.0 (TID 837) in 151 ms on node06.hadoop.know-center.at (365/400)
  513. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 381.0 in stage 7.0 (TID 856, node12.hadoop.know-center.at, partition 381,NODE_LOCAL, 1894 bytes)
  514. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 368.0 in stage 7.0 (TID 843) in 122 ms on node12.hadoop.know-center.at (366/400)
  515. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 382.0 in stage 7.0 (TID 857, node06.hadoop.know-center.at, partition 382,NODE_LOCAL, 1894 bytes)
  516. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 363.0 in stage 7.0 (TID 838) in 169 ms on node06.hadoop.know-center.at (367/400)
  517. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 383.0 in stage 7.0 (TID 858, node12.hadoop.know-center.at, partition 383,NODE_LOCAL, 1894 bytes)
  518. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 369.0 in stage 7.0 (TID 844) in 133 ms on node12.hadoop.know-center.at (368/400)
  519. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 384.0 in stage 7.0 (TID 859, node12.hadoop.know-center.at, partition 384,NODE_LOCAL, 1894 bytes)
  520. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 371.0 in stage 7.0 (TID 846) in 121 ms on node12.hadoop.know-center.at (369/400)
  521. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 385.0 in stage 7.0 (TID 860, node06.hadoop.know-center.at, partition 385,NODE_LOCAL, 1894 bytes)
  522. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 365.0 in stage 7.0 (TID 840) in 191 ms on node06.hadoop.know-center.at (370/400)
  523. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 386.0 in stage 7.0 (TID 861, node12.hadoop.know-center.at, partition 386,NODE_LOCAL, 1894 bytes)
  524. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 372.0 in stage 7.0 (TID 847) in 121 ms on node12.hadoop.know-center.at (371/400)
  525. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 387.0 in stage 7.0 (TID 862, node12.hadoop.know-center.at, partition 387,NODE_LOCAL, 1894 bytes)
  526. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 373.0 in stage 7.0 (TID 848) in 121 ms on node12.hadoop.know-center.at (372/400)
  527. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 388.0 in stage 7.0 (TID 863, node06.hadoop.know-center.at, partition 388,NODE_LOCAL, 1894 bytes)
  528. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 367.0 in stage 7.0 (TID 842) in 198 ms on node06.hadoop.know-center.at (373/400)
  529. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 389.0 in stage 7.0 (TID 864, node12.hadoop.know-center.at, partition 389,NODE_LOCAL, 1894 bytes)
  530. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 375.0 in stage 7.0 (TID 850) in 118 ms on node12.hadoop.know-center.at (374/400)
  531. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 390.0 in stage 7.0 (TID 865, node06.hadoop.know-center.at, partition 390,NODE_LOCAL, 1894 bytes)
  532. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 370.0 in stage 7.0 (TID 845) in 191 ms on node06.hadoop.know-center.at (375/400)
  533. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 391.0 in stage 7.0 (TID 866, node12.hadoop.know-center.at, partition 391,NODE_LOCAL, 1894 bytes)
  534. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 377.0 in stage 7.0 (TID 852) in 122 ms on node12.hadoop.know-center.at (376/400)
  535. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 392.0 in stage 7.0 (TID 867, node12.hadoop.know-center.at, partition 392,NODE_LOCAL, 1894 bytes)
  536. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 379.0 in stage 7.0 (TID 854) in 118 ms on node12.hadoop.know-center.at (377/400)
  537. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 393.0 in stage 7.0 (TID 868, node12.hadoop.know-center.at, partition 393,NODE_LOCAL, 1894 bytes)
  538. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 381.0 in stage 7.0 (TID 856) in 120 ms on node12.hadoop.know-center.at (378/400)
  539. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 394.0 in stage 7.0 (TID 869, node06.hadoop.know-center.at, partition 394,NODE_LOCAL, 1894 bytes)
  540. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 374.0 in stage 7.0 (TID 849) in 178 ms on node06.hadoop.know-center.at (379/400)
  541. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 395.0 in stage 7.0 (TID 870, node06.hadoop.know-center.at, partition 395,NODE_LOCAL, 1894 bytes)
  542. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 376.0 in stage 7.0 (TID 851) in 177 ms on node06.hadoop.know-center.at (380/400)
  543. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 396.0 in stage 7.0 (TID 871, node12.hadoop.know-center.at, partition 396,NODE_LOCAL, 1894 bytes)
  544. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 383.0 in stage 7.0 (TID 858) in 120 ms on node12.hadoop.know-center.at (381/400)
  545. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 397.0 in stage 7.0 (TID 872, node12.hadoop.know-center.at, partition 397,NODE_LOCAL, 1894 bytes)
  546. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 384.0 in stage 7.0 (TID 859) in 116 ms on node12.hadoop.know-center.at (382/400)
  547. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 398.0 in stage 7.0 (TID 873, node12.hadoop.know-center.at, partition 398,NODE_LOCAL, 1894 bytes)
  548. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 386.0 in stage 7.0 (TID 861) in 124 ms on node12.hadoop.know-center.at (383/400)
  549. 16/04/23 20:27:45 INFO TaskSetManager: Starting task 399.0 in stage 7.0 (TID 874, node06.hadoop.know-center.at, partition 399,NODE_LOCAL, 1894 bytes)
  550. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 378.0 in stage 7.0 (TID 853) in 192 ms on node06.hadoop.know-center.at (384/400)
  551. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 387.0 in stage 7.0 (TID 862) in 120 ms on node12.hadoop.know-center.at (385/400)
  552. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 380.0 in stage 7.0 (TID 855) in 188 ms on node06.hadoop.know-center.at (386/400)
  553. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 389.0 in stage 7.0 (TID 864) in 118 ms on node12.hadoop.know-center.at (387/400)
  554. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 382.0 in stage 7.0 (TID 857) in 179 ms on node06.hadoop.know-center.at (388/400)
  555. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 391.0 in stage 7.0 (TID 866) in 117 ms on node12.hadoop.know-center.at (389/400)
  556. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 385.0 in stage 7.0 (TID 860) in 171 ms on node06.hadoop.know-center.at (390/400)
  557. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 392.0 in stage 7.0 (TID 867) in 119 ms on node12.hadoop.know-center.at (391/400)
  558. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 388.0 in stage 7.0 (TID 863) in 158 ms on node06.hadoop.know-center.at (392/400)
  559. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 393.0 in stage 7.0 (TID 868) in 120 ms on node12.hadoop.know-center.at (393/400)
  560. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 390.0 in stage 7.0 (TID 865) in 160 ms on node06.hadoop.know-center.at (394/400)
  561. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 396.0 in stage 7.0 (TID 871) in 115 ms on node12.hadoop.know-center.at (395/400)
  562. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 397.0 in stage 7.0 (TID 872) in 117 ms on node12.hadoop.know-center.at (396/400)
  563. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 394.0 in stage 7.0 (TID 869) in 146 ms on node06.hadoop.know-center.at (397/400)
  564. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 398.0 in stage 7.0 (TID 873) in 110 ms on node12.hadoop.know-center.at (398/400)
  565. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 395.0 in stage 7.0 (TID 870) in 145 ms on node06.hadoop.know-center.at (399/400)
  566. 16/04/23 20:27:45 INFO TaskSetManager: Finished task 399.0 in stage 7.0 (TID 874) in 139 ms on node06.hadoop.know-center.at (400/400)
  567. 16/04/23 20:27:45 INFO YarnClusterScheduler: Removed TaskSet 7.0, whose tasks have all completed, from pool
  568. 16/04/23 20:27:45 INFO DAGScheduler: ResultStage 7 (collect at Word2Vec.scala:170) finished in 4.130 s
  569. 16/04/23 20:27:45 INFO DAGScheduler: Job 2 finished: collect at Word2Vec.scala:170, took 16.428435 s
  570. 16/04/23 20:27:45 INFO Word2Vec: trainWordsCount = 27060305
  571. 16/04/23 20:27:45 INFO MemoryStore: Block broadcast_10 stored as values in memory (estimated size 3.9 KB, free 683.9 KB)
  572. 16/04/23 20:27:45 INFO MemoryStore: Block broadcast_10_piece0 stored as bytes in memory (estimated size 4.0 KB, free 687.9 KB)
  573. 16/04/23 20:27:45 INFO BlockManagerInfo: Added broadcast_10_piece0 in memory on 192.168.0.111:33952 (size: 4.0 KB, free: 13.1 GB)
  574. 16/04/23 20:27:45 INFO SparkContext: Created broadcast 10 from broadcast at Word2Vec.scala:290
  575. 16/04/23 20:27:45 INFO MemoryStore: Block broadcast_11 stored as values in memory (estimated size 68.4 MB, free 69.1 MB)
  576. 16/04/23 20:27:46 INFO MemoryStore: Block broadcast_11_piece0 stored as bytes in memory (estimated size 4.0 MB, free 73.1 MB)
  577. 16/04/23 20:27:46 INFO BlockManagerInfo: Added broadcast_11_piece0 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.1 GB)
  578. 16/04/23 20:27:46 INFO MemoryStore: Block broadcast_11_piece1 stored as bytes in memory (estimated size 2.9 MB, free 76.0 MB)
  579. 16/04/23 20:27:46 INFO BlockManagerInfo: Added broadcast_11_piece1 in memory on 192.168.0.111:33952 (size: 2.9 MB, free: 13.1 GB)
  580. 16/04/23 20:27:46 INFO SparkContext: Created broadcast 11 from broadcast at Word2Vec.scala:291
  581. 16/04/23 20:27:46 INFO MemoryStore: Block broadcast_12 stored as values in memory (estimated size 14.9 MB, free 90.9 MB)
  582. 16/04/23 20:27:46 INFO MemoryStore: Block broadcast_12_piece0 stored as bytes in memory (estimated size 2.3 MB, free 93.2 MB)
  583. 16/04/23 20:27:46 INFO BlockManagerInfo: Added broadcast_12_piece0 in memory on 192.168.0.111:33952 (size: 2.3 MB, free: 13.1 GB)
  584. 16/04/23 20:27:46 INFO SparkContext: Created broadcast 12 from broadcast at Word2Vec.scala:292
  585. 16/04/23 20:27:47 INFO BlockManagerInfo: Removed broadcast_7_piece0 on 192.168.0.111:33952 in memory (size: 2.6 KB, free: 13.1 GB)
  586. 16/04/23 20:27:47 INFO BlockManagerInfo: Removed broadcast_7_piece0 on node12.hadoop.know-center.at:53119 in memory (size: 2.6 KB, free: 14.2 GB)
  587. 16/04/23 20:27:47 INFO BlockManagerInfo: Removed broadcast_7_piece0 on node10.hadoop.know-center.at:52005 in memory (size: 2.6 KB, free: 14.2 GB)
  588. 16/04/23 20:27:47 INFO BlockManagerInfo: Removed broadcast_7_piece0 on node11.hadoop.know-center.at:55870 in memory (size: 2.6 KB, free: 14.2 GB)
  589. 16/04/23 20:27:47 INFO BlockManagerInfo: Removed broadcast_7_piece0 on node02.hadoop.know-center.at:43877 in memory (size: 2.6 KB, free: 14.2 GB)
  590. 16/04/23 20:27:47 INFO BlockManagerInfo: Removed broadcast_7_piece0 on node06.hadoop.know-center.at:38706 in memory (size: 2.6 KB, free: 14.2 GB)
  591. 16/04/23 20:27:47 INFO ContextCleaner: Cleaned accumulator 5
  592. 16/04/23 20:27:47 INFO ContextCleaner: Cleaned shuffle 3
  593. 16/04/23 20:27:47 INFO ContextCleaner: Cleaned accumulator 6
  594. 16/04/23 20:27:47 INFO BlockManagerInfo: Removed broadcast_9_piece0 on 192.168.0.111:33952 in memory (size: 2.2 KB, free: 13.1 GB)
  595. 16/04/23 20:27:47 INFO BlockManagerInfo: Removed broadcast_9_piece0 on node12.hadoop.know-center.at:53119 in memory (size: 2.2 KB, free: 14.2 GB)
  596. 16/04/23 20:27:47 INFO BlockManagerInfo: Removed broadcast_9_piece0 on node06.hadoop.know-center.at:38706 in memory (size: 2.2 KB, free: 14.2 GB)
  597. 16/04/23 20:27:47 INFO ContextCleaner: Cleaned accumulator 7
  598. 16/04/23 20:27:47 INFO BlockManagerInfo: Removed broadcast_8_piece0 on 192.168.0.111:33952 in memory (size: 2035.0 B, free: 13.1 GB)
  599. 16/04/23 20:27:47 INFO BlockManagerInfo: Removed broadcast_8_piece0 on node12.hadoop.know-center.at:53119 in memory (size: 2035.0 B, free: 14.2 GB)
  600. 16/04/23 20:27:47 INFO BlockManagerInfo: Removed broadcast_8_piece0 on node06.hadoop.know-center.at:38706 in memory (size: 2035.0 B, free: 14.2 GB)
  601. 16/04/23 20:27:50 INFO SparkContext: Starting job: collect at Word2Vec.scala:406
  602. 16/04/23 20:27:50 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 2 is 1446 bytes
  603. 16/04/23 20:27:50 INFO DAGScheduler: Registering RDD 25 (repartition at Word2Vec.scala:315)
  604. 16/04/23 20:27:50 INFO DAGScheduler: Registering RDD 29 (mapPartitionsWithIndex at Word2Vec.scala:329)
  605. 16/04/23 20:27:50 INFO DAGScheduler: Got job 3 (collect at Word2Vec.scala:406) with 1 output partitions
  606. 16/04/23 20:27:50 INFO DAGScheduler: Final stage: ResultStage 11 (collect at Word2Vec.scala:406)
  607. 16/04/23 20:27:50 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 10)
  608. 16/04/23 20:27:50 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 10)
  609. 16/04/23 20:27:50 INFO DAGScheduler: Submitting ShuffleMapStage 9 (MapPartitionsRDD[25] at repartition at Word2Vec.scala:315), which has no missing parents
  610. 16/04/23 20:27:50 INFO MemoryStore: Block broadcast_13 stored as values in memory (estimated size 5.2 KB, free 93.2 MB)
  611. 16/04/23 20:27:50 INFO MemoryStore: Block broadcast_13_piece0 stored as bytes in memory (estimated size 2.7 KB, free 93.2 MB)
  612. 16/04/23 20:27:50 INFO BlockManagerInfo: Added broadcast_13_piece0 in memory on 192.168.0.111:33952 (size: 2.7 KB, free: 13.1 GB)
  613. 16/04/23 20:27:50 INFO SparkContext: Created broadcast 13 from broadcast at DAGScheduler.scala:1006
  614. 16/04/23 20:27:50 INFO DAGScheduler: Submitting 400 missing tasks from ShuffleMapStage 9 (MapPartitionsRDD[25] at repartition at Word2Vec.scala:315)
  615. 16/04/23 20:27:50 INFO YarnClusterScheduler: Adding task set 9.0 with 400 tasks
  616. 16/04/23 20:27:50 INFO TaskSetManager: Starting task 0.0 in stage 9.0 (TID 875, node06.hadoop.know-center.at, partition 0,NODE_LOCAL, 2152 bytes)
  617. 16/04/23 20:27:50 INFO TaskSetManager: Starting task 1.0 in stage 9.0 (TID 876, node12.hadoop.know-center.at, partition 1,NODE_LOCAL, 2152 bytes)
  618. 16/04/23 20:27:50 INFO TaskSetManager: Starting task 2.0 in stage 9.0 (TID 877, node06.hadoop.know-center.at, partition 2,NODE_LOCAL, 2152 bytes)
  619. 16/04/23 20:27:50 INFO TaskSetManager: Starting task 3.0 in stage 9.0 (TID 878, node12.hadoop.know-center.at, partition 3,NODE_LOCAL, 2152 bytes)
  620. 16/04/23 20:27:50 INFO TaskSetManager: Starting task 4.0 in stage 9.0 (TID 879, node06.hadoop.know-center.at, partition 4,NODE_LOCAL, 2152 bytes)
  621. 16/04/23 20:27:50 INFO TaskSetManager: Starting task 5.0 in stage 9.0 (TID 880, node12.hadoop.know-center.at, partition 5,NODE_LOCAL, 2152 bytes)
  622. 16/04/23 20:27:50 INFO TaskSetManager: Starting task 6.0 in stage 9.0 (TID 881, node06.hadoop.know-center.at, partition 6,NODE_LOCAL, 2152 bytes)
  623. 16/04/23 20:27:50 INFO TaskSetManager: Starting task 7.0 in stage 9.0 (TID 882, node12.hadoop.know-center.at, partition 7,NODE_LOCAL, 2152 bytes)
  624. 16/04/23 20:27:50 INFO TaskSetManager: Starting task 8.0 in stage 9.0 (TID 883, node06.hadoop.know-center.at, partition 8,NODE_LOCAL, 2152 bytes)
  625. 16/04/23 20:27:50 INFO TaskSetManager: Starting task 9.0 in stage 9.0 (TID 884, node12.hadoop.know-center.at, partition 9,NODE_LOCAL, 2152 bytes)
  626. 16/04/23 20:27:50 INFO TaskSetManager: Starting task 10.0 in stage 9.0 (TID 885, node06.hadoop.know-center.at, partition 10,NODE_LOCAL, 2152 bytes)
  627. 16/04/23 20:27:50 INFO TaskSetManager: Starting task 11.0 in stage 9.0 (TID 886, node12.hadoop.know-center.at, partition 11,NODE_LOCAL, 2152 bytes)
  628. 16/04/23 20:27:50 INFO TaskSetManager: Starting task 12.0 in stage 9.0 (TID 887, node06.hadoop.know-center.at, partition 12,NODE_LOCAL, 2152 bytes)
  629. 16/04/23 20:27:50 INFO TaskSetManager: Starting task 13.0 in stage 9.0 (TID 888, node12.hadoop.know-center.at, partition 13,NODE_LOCAL, 2152 bytes)
  630. 16/04/23 20:27:50 INFO TaskSetManager: Starting task 14.0 in stage 9.0 (TID 889, node06.hadoop.know-center.at, partition 14,NODE_LOCAL, 2152 bytes)
  631. 16/04/23 20:27:50 INFO TaskSetManager: Starting task 15.0 in stage 9.0 (TID 890, node12.hadoop.know-center.at, partition 15,NODE_LOCAL, 2152 bytes)
  632. 16/04/23 20:27:50 INFO BlockManagerInfo: Added broadcast_13_piece0 in memory on node12.hadoop.know-center.at:53119 (size: 2.7 KB, free: 14.2 GB)
  633. 16/04/23 20:27:50 INFO BlockManagerInfo: Added broadcast_13_piece0 in memory on node06.hadoop.know-center.at:38706 (size: 2.7 KB, free: 14.2 GB)
  634. 16/04/23 20:27:50 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 2 to node12.hadoop.know-center.at:36254
  635. 16/04/23 20:27:50 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 2 to node06.hadoop.know-center.at:42120
  636. 16/04/23 20:27:50 INFO BlockManagerInfo: Added broadcast_12_piece0 in memory on node12.hadoop.know-center.at:53119 (size: 2.3 MB, free: 14.2 GB)
  637. 16/04/23 20:27:50 INFO BlockManagerInfo: Added broadcast_12_piece0 in memory on node06.hadoop.know-center.at:38706 (size: 2.3 MB, free: 14.2 GB)
  638. 16/04/23 20:27:50 INFO TaskSetManager: Starting task 16.0 in stage 9.0 (TID 891, node12.hadoop.know-center.at, partition 16,NODE_LOCAL, 2152 bytes)
  639. 16/04/23 20:27:50 INFO TaskSetManager: Finished task 11.0 in stage 9.0 (TID 886) in 482 ms on node12.hadoop.know-center.at (1/400)
  640. 16/04/23 20:27:50 INFO TaskSetManager: Starting task 17.0 in stage 9.0 (TID 892, node12.hadoop.know-center.at, partition 17,NODE_LOCAL, 2152 bytes)
  641. 16/04/23 20:27:50 INFO TaskSetManager: Finished task 13.0 in stage 9.0 (TID 888) in 485 ms on node12.hadoop.know-center.at (2/400)
  642. 16/04/23 20:27:50 INFO TaskSetManager: Starting task 18.0 in stage 9.0 (TID 893, node12.hadoop.know-center.at, partition 18,NODE_LOCAL, 2152 bytes)
  643. 16/04/23 20:27:50 INFO TaskSetManager: Finished task 15.0 in stage 9.0 (TID 890) in 496 ms on node12.hadoop.know-center.at (3/400)
  644. 16/04/23 20:27:50 INFO TaskSetManager: Starting task 19.0 in stage 9.0 (TID 894, node12.hadoop.know-center.at, partition 19,NODE_LOCAL, 2152 bytes)
  645. 16/04/23 20:27:50 INFO TaskSetManager: Finished task 9.0 in stage 9.0 (TID 884) in 503 ms on node12.hadoop.know-center.at (4/400)
  646. 16/04/23 20:27:50 INFO TaskSetManager: Starting task 20.0 in stage 9.0 (TID 895, node12.hadoop.know-center.at, partition 20,NODE_LOCAL, 2152 bytes)
  647. 16/04/23 20:27:50 INFO TaskSetManager: Finished task 5.0 in stage 9.0 (TID 880) in 511 ms on node12.hadoop.know-center.at (5/400)
  648. 16/04/23 20:27:50 INFO TaskSetManager: Starting task 21.0 in stage 9.0 (TID 896, node12.hadoop.know-center.at, partition 21,NODE_LOCAL, 2152 bytes)
  649. 16/04/23 20:27:50 INFO TaskSetManager: Finished task 1.0 in stage 9.0 (TID 876) in 522 ms on node12.hadoop.know-center.at (6/400)
  650. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 22.0 in stage 9.0 (TID 897, node12.hadoop.know-center.at, partition 22,NODE_LOCAL, 2152 bytes)
  651. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 7.0 in stage 9.0 (TID 882) in 540 ms on node12.hadoop.know-center.at (7/400)
  652. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 23.0 in stage 9.0 (TID 898, node06.hadoop.know-center.at, partition 23,NODE_LOCAL, 2152 bytes)
  653. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 2.0 in stage 9.0 (TID 877) in 556 ms on node06.hadoop.know-center.at (8/400)
  654. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 24.0 in stage 9.0 (TID 899, node06.hadoop.know-center.at, partition 24,NODE_LOCAL, 2152 bytes)
  655. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 14.0 in stage 9.0 (TID 889) in 557 ms on node06.hadoop.know-center.at (9/400)
  656. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 25.0 in stage 9.0 (TID 900, node06.hadoop.know-center.at, partition 25,NODE_LOCAL, 2152 bytes)
  657. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 12.0 in stage 9.0 (TID 887) in 560 ms on node06.hadoop.know-center.at (10/400)
  658. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 26.0 in stage 9.0 (TID 901, node06.hadoop.know-center.at, partition 26,NODE_LOCAL, 2152 bytes)
  659. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 8.0 in stage 9.0 (TID 883) in 563 ms on node06.hadoop.know-center.at (11/400)
  660. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 27.0 in stage 9.0 (TID 902, node06.hadoop.know-center.at, partition 27,NODE_LOCAL, 2152 bytes)
  661. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 4.0 in stage 9.0 (TID 879) in 567 ms on node06.hadoop.know-center.at (12/400)
  662. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 28.0 in stage 9.0 (TID 903, node12.hadoop.know-center.at, partition 28,NODE_LOCAL, 2152 bytes)
  663. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 3.0 in stage 9.0 (TID 878) in 567 ms on node12.hadoop.know-center.at (13/400)
  664. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 29.0 in stage 9.0 (TID 904, node06.hadoop.know-center.at, partition 29,NODE_LOCAL, 2152 bytes)
  665. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 0.0 in stage 9.0 (TID 875) in 571 ms on node06.hadoop.know-center.at (14/400)
  666. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 30.0 in stage 9.0 (TID 905, node06.hadoop.know-center.at, partition 30,NODE_LOCAL, 2152 bytes)
  667. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 6.0 in stage 9.0 (TID 881) in 586 ms on node06.hadoop.know-center.at (15/400)
  668. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 31.0 in stage 9.0 (TID 906, node06.hadoop.know-center.at, partition 31,NODE_LOCAL, 2152 bytes)
  669. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 10.0 in stage 9.0 (TID 885) in 594 ms on node06.hadoop.know-center.at (16/400)
  670. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 32.0 in stage 9.0 (TID 907, node12.hadoop.know-center.at, partition 32,NODE_LOCAL, 2152 bytes)
  671. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 18.0 in stage 9.0 (TID 893) in 184 ms on node12.hadoop.know-center.at (17/400)
  672. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 33.0 in stage 9.0 (TID 908, node12.hadoop.know-center.at, partition 33,NODE_LOCAL, 2152 bytes)
  673. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 16.0 in stage 9.0 (TID 891) in 200 ms on node12.hadoop.know-center.at (18/400)
  674. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 34.0 in stage 9.0 (TID 909, node12.hadoop.know-center.at, partition 34,NODE_LOCAL, 2152 bytes)
  675. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 20.0 in stage 9.0 (TID 895) in 172 ms on node12.hadoop.know-center.at (19/400)
  676. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 35.0 in stage 9.0 (TID 910, node12.hadoop.know-center.at, partition 35,NODE_LOCAL, 2152 bytes)
  677. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 21.0 in stage 9.0 (TID 896) in 160 ms on node12.hadoop.know-center.at (20/400)
  678. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 36.0 in stage 9.0 (TID 911, node12.hadoop.know-center.at, partition 36,NODE_LOCAL, 2152 bytes)
  679. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 17.0 in stage 9.0 (TID 892) in 198 ms on node12.hadoop.know-center.at (21/400)
  680. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 37.0 in stage 9.0 (TID 912, node12.hadoop.know-center.at, partition 37,NODE_LOCAL, 2152 bytes)
  681. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 19.0 in stage 9.0 (TID 894) in 180 ms on node12.hadoop.know-center.at (22/400)
  682. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 38.0 in stage 9.0 (TID 913, node12.hadoop.know-center.at, partition 38,NODE_LOCAL, 2152 bytes)
  683. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 22.0 in stage 9.0 (TID 897) in 158 ms on node12.hadoop.know-center.at (23/400)
  684. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 39.0 in stage 9.0 (TID 914, node12.hadoop.know-center.at, partition 39,NODE_LOCAL, 2152 bytes)
  685. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 28.0 in stage 9.0 (TID 903) in 145 ms on node12.hadoop.know-center.at (24/400)
  686. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 40.0 in stage 9.0 (TID 915, node12.hadoop.know-center.at, partition 40,NODE_LOCAL, 2152 bytes)
  687. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 33.0 in stage 9.0 (TID 908) in 79 ms on node12.hadoop.know-center.at (25/400)
  688. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 41.0 in stage 9.0 (TID 916, node12.hadoop.know-center.at, partition 41,NODE_LOCAL, 2152 bytes)
  689. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 42.0 in stage 9.0 (TID 917, node12.hadoop.know-center.at, partition 42,NODE_LOCAL, 2152 bytes)
  690. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 34.0 in stage 9.0 (TID 909) in 79 ms on node12.hadoop.know-center.at (26/400)
  691. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 43.0 in stage 9.0 (TID 918, node12.hadoop.know-center.at, partition 43,NODE_LOCAL, 2152 bytes)
  692. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 32.0 in stage 9.0 (TID 907) in 80 ms on node12.hadoop.know-center.at (27/400)
  693. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 35.0 in stage 9.0 (TID 910) in 79 ms on node12.hadoop.know-center.at (28/400)
  694. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 44.0 in stage 9.0 (TID 919, node12.hadoop.know-center.at, partition 44,NODE_LOCAL, 2152 bytes)
  695. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 38.0 in stage 9.0 (TID 913) in 85 ms on node12.hadoop.know-center.at (29/400)
  696. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 45.0 in stage 9.0 (TID 920, node12.hadoop.know-center.at, partition 45,NODE_LOCAL, 2152 bytes)
  697. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 37.0 in stage 9.0 (TID 912) in 100 ms on node12.hadoop.know-center.at (30/400)
  698. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 46.0 in stage 9.0 (TID 921, node12.hadoop.know-center.at, partition 46,NODE_LOCAL, 2152 bytes)
  699. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 36.0 in stage 9.0 (TID 911) in 109 ms on node12.hadoop.know-center.at (31/400)
  700. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 47.0 in stage 9.0 (TID 922, node12.hadoop.know-center.at, partition 47,NODE_LOCAL, 2152 bytes)
  701. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 39.0 in stage 9.0 (TID 914) in 99 ms on node12.hadoop.know-center.at (32/400)
  702. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 48.0 in stage 9.0 (TID 923, node06.hadoop.know-center.at, partition 48,NODE_LOCAL, 2152 bytes)
  703. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 23.0 in stage 9.0 (TID 898) in 258 ms on node06.hadoop.know-center.at (33/400)
  704. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 49.0 in stage 9.0 (TID 924, node06.hadoop.know-center.at, partition 49,NODE_LOCAL, 2152 bytes)
  705. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 27.0 in stage 9.0 (TID 902) in 250 ms on node06.hadoop.know-center.at (34/400)
  706. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 50.0 in stage 9.0 (TID 925, node06.hadoop.know-center.at, partition 50,NODE_LOCAL, 2152 bytes)
  707. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 26.0 in stage 9.0 (TID 901) in 255 ms on node06.hadoop.know-center.at (35/400)
  708. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 51.0 in stage 9.0 (TID 926, node06.hadoop.know-center.at, partition 51,NODE_LOCAL, 2152 bytes)
  709. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 25.0 in stage 9.0 (TID 900) in 257 ms on node06.hadoop.know-center.at (36/400)
  710. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 52.0 in stage 9.0 (TID 927, node06.hadoop.know-center.at, partition 52,NODE_LOCAL, 2152 bytes)
  711. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 24.0 in stage 9.0 (TID 899) in 261 ms on node06.hadoop.know-center.at (37/400)
  712. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 53.0 in stage 9.0 (TID 928, node06.hadoop.know-center.at, partition 53,NODE_LOCAL, 2152 bytes)
  713. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 29.0 in stage 9.0 (TID 904) in 250 ms on node06.hadoop.know-center.at (38/400)
  714. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 54.0 in stage 9.0 (TID 929, node06.hadoop.know-center.at, partition 54,NODE_LOCAL, 2152 bytes)
  715. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 30.0 in stage 9.0 (TID 905) in 237 ms on node06.hadoop.know-center.at (39/400)
  716. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 55.0 in stage 9.0 (TID 930, node12.hadoop.know-center.at, partition 55,NODE_LOCAL, 2152 bytes)
  717. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 43.0 in stage 9.0 (TID 918) in 64 ms on node12.hadoop.know-center.at (40/400)
  718. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 56.0 in stage 9.0 (TID 931, node06.hadoop.know-center.at, partition 56,NODE_LOCAL, 2152 bytes)
  719. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 31.0 in stage 9.0 (TID 906) in 232 ms on node06.hadoop.know-center.at (41/400)
  720. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 57.0 in stage 9.0 (TID 932, node12.hadoop.know-center.at, partition 57,NODE_LOCAL, 2152 bytes)
  721. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 40.0 in stage 9.0 (TID 915) in 69 ms on node12.hadoop.know-center.at (42/400)
  722. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 58.0 in stage 9.0 (TID 933, node12.hadoop.know-center.at, partition 58,NODE_LOCAL, 2152 bytes)
  723. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 41.0 in stage 9.0 (TID 916) in 71 ms on node12.hadoop.know-center.at (43/400)
  724. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 59.0 in stage 9.0 (TID 934, node12.hadoop.know-center.at, partition 59,NODE_LOCAL, 2152 bytes)
  725. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 42.0 in stage 9.0 (TID 917) in 74 ms on node12.hadoop.know-center.at (44/400)
  726. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 60.0 in stage 9.0 (TID 935, node12.hadoop.know-center.at, partition 60,NODE_LOCAL, 2152 bytes)
  727. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 44.0 in stage 9.0 (TID 919) in 62 ms on node12.hadoop.know-center.at (45/400)
  728. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 61.0 in stage 9.0 (TID 936, node12.hadoop.know-center.at, partition 61,NODE_LOCAL, 2152 bytes)
  729. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 45.0 in stage 9.0 (TID 920) in 85 ms on node12.hadoop.know-center.at (46/400)
  730. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 62.0 in stage 9.0 (TID 937, node12.hadoop.know-center.at, partition 62,NODE_LOCAL, 2152 bytes)
  731. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 46.0 in stage 9.0 (TID 921) in 76 ms on node12.hadoop.know-center.at (47/400)
  732. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 63.0 in stage 9.0 (TID 938, node06.hadoop.know-center.at, partition 63,NODE_LOCAL, 2152 bytes)
  733. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 48.0 in stage 9.0 (TID 923) in 69 ms on node06.hadoop.know-center.at (48/400)
  734. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 64.0 in stage 9.0 (TID 939, node06.hadoop.know-center.at, partition 64,NODE_LOCAL, 2152 bytes)
  735. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 50.0 in stage 9.0 (TID 925) in 66 ms on node06.hadoop.know-center.at (49/400)
  736. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 65.0 in stage 9.0 (TID 940, node12.hadoop.know-center.at, partition 65,NODE_LOCAL, 2152 bytes)
  737. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 55.0 in stage 9.0 (TID 930) in 59 ms on node12.hadoop.know-center.at (50/400)
  738. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 66.0 in stage 9.0 (TID 941, node06.hadoop.know-center.at, partition 66,NODE_LOCAL, 2152 bytes)
  739. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 51.0 in stage 9.0 (TID 926) in 68 ms on node06.hadoop.know-center.at (51/400)
  740. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 67.0 in stage 9.0 (TID 942, node06.hadoop.know-center.at, partition 67,NODE_LOCAL, 2152 bytes)
  741. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 49.0 in stage 9.0 (TID 924) in 72 ms on node06.hadoop.know-center.at (52/400)
  742. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 68.0 in stage 9.0 (TID 943, node06.hadoop.know-center.at, partition 68,NODE_LOCAL, 2152 bytes)
  743. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 54.0 in stage 9.0 (TID 929) in 70 ms on node06.hadoop.know-center.at (53/400)
  744. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 69.0 in stage 9.0 (TID 944, node06.hadoop.know-center.at, partition 69,NODE_LOCAL, 2152 bytes)
  745. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 56.0 in stage 9.0 (TID 931) in 70 ms on node06.hadoop.know-center.at (54/400)
  746. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 70.0 in stage 9.0 (TID 945, node12.hadoop.know-center.at, partition 70,NODE_LOCAL, 2152 bytes)
  747. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 58.0 in stage 9.0 (TID 933) in 67 ms on node12.hadoop.know-center.at (55/400)
  748. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 71.0 in stage 9.0 (TID 946, node06.hadoop.know-center.at, partition 71,NODE_LOCAL, 2152 bytes)
  749. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 72.0 in stage 9.0 (TID 947, node12.hadoop.know-center.at, partition 72,NODE_LOCAL, 2152 bytes)
  750. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 52.0 in stage 9.0 (TID 927) in 80 ms on node06.hadoop.know-center.at (56/400)
  751. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 57.0 in stage 9.0 (TID 932) in 70 ms on node12.hadoop.know-center.at (57/400)
  752. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 73.0 in stage 9.0 (TID 948, node06.hadoop.know-center.at, partition 73,NODE_LOCAL, 2152 bytes)
  753. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 53.0 in stage 9.0 (TID 928) in 80 ms on node06.hadoop.know-center.at (58/400)
  754. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 74.0 in stage 9.0 (TID 949, node12.hadoop.know-center.at, partition 74,NODE_LOCAL, 2152 bytes)
  755. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 60.0 in stage 9.0 (TID 935) in 58 ms on node12.hadoop.know-center.at (59/400)
  756. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 75.0 in stage 9.0 (TID 950, node12.hadoop.know-center.at, partition 75,NODE_LOCAL, 2152 bytes)
  757. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 59.0 in stage 9.0 (TID 934) in 67 ms on node12.hadoop.know-center.at (60/400)
  758. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 76.0 in stage 9.0 (TID 951, node12.hadoop.know-center.at, partition 76,NODE_LOCAL, 2152 bytes)
  759. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 47.0 in stage 9.0 (TID 922) in 96 ms on node12.hadoop.know-center.at (61/400)
  760. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 77.0 in stage 9.0 (TID 952, node12.hadoop.know-center.at, partition 77,NODE_LOCAL, 2152 bytes)
  761. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 62.0 in stage 9.0 (TID 937) in 72 ms on node12.hadoop.know-center.at (62/400)
  762. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 78.0 in stage 9.0 (TID 953, node12.hadoop.know-center.at, partition 78,NODE_LOCAL, 2152 bytes)
  763. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 65.0 in stage 9.0 (TID 940) in 58 ms on node12.hadoop.know-center.at (63/400)
  764. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 79.0 in stage 9.0 (TID 954, node12.hadoop.know-center.at, partition 79,NODE_LOCAL, 2152 bytes)
  765. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 61.0 in stage 9.0 (TID 936) in 78 ms on node12.hadoop.know-center.at (64/400)
  766. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 80.0 in stage 9.0 (TID 955, node06.hadoop.know-center.at, partition 80,NODE_LOCAL, 2152 bytes)
  767. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 63.0 in stage 9.0 (TID 938) in 70 ms on node06.hadoop.know-center.at (65/400)
  768. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 81.0 in stage 9.0 (TID 956, node06.hadoop.know-center.at, partition 81,NODE_LOCAL, 2152 bytes)
  769. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 64.0 in stage 9.0 (TID 939) in 69 ms on node06.hadoop.know-center.at (66/400)
  770. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 82.0 in stage 9.0 (TID 957, node06.hadoop.know-center.at, partition 82,NODE_LOCAL, 2152 bytes)
  771. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 66.0 in stage 9.0 (TID 941) in 68 ms on node06.hadoop.know-center.at (67/400)
  772. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 83.0 in stage 9.0 (TID 958, node06.hadoop.know-center.at, partition 83,NODE_LOCAL, 2152 bytes)
  773. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 67.0 in stage 9.0 (TID 942) in 67 ms on node06.hadoop.know-center.at (68/400)
  774. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 84.0 in stage 9.0 (TID 959, node06.hadoop.know-center.at, partition 84,NODE_LOCAL, 2152 bytes)
  775. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 68.0 in stage 9.0 (TID 943) in 70 ms on node06.hadoop.know-center.at (69/400)
  776. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 85.0 in stage 9.0 (TID 960, node06.hadoop.know-center.at, partition 85,NODE_LOCAL, 2152 bytes)
  777. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 71.0 in stage 9.0 (TID 946) in 66 ms on node06.hadoop.know-center.at (70/400)
  778. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 86.0 in stage 9.0 (TID 961, node06.hadoop.know-center.at, partition 86,NODE_LOCAL, 2152 bytes)
  779. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 69.0 in stage 9.0 (TID 944) in 71 ms on node06.hadoop.know-center.at (71/400)
  780. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 87.0 in stage 9.0 (TID 962, node12.hadoop.know-center.at, partition 87,NODE_LOCAL, 2152 bytes)
  781. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 88.0 in stage 9.0 (TID 963, node12.hadoop.know-center.at, partition 88,NODE_LOCAL, 2152 bytes)
  782. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 75.0 in stage 9.0 (TID 950) in 67 ms on node12.hadoop.know-center.at (72/400)
  783. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 70.0 in stage 9.0 (TID 945) in 72 ms on node12.hadoop.know-center.at (73/400)
  784. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 89.0 in stage 9.0 (TID 964, node12.hadoop.know-center.at, partition 89,NODE_LOCAL, 2152 bytes)
  785. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 74.0 in stage 9.0 (TID 949) in 70 ms on node12.hadoop.know-center.at (74/400)
  786. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 90.0 in stage 9.0 (TID 965, node06.hadoop.know-center.at, partition 90,NODE_LOCAL, 2152 bytes)
  787. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 73.0 in stage 9.0 (TID 948) in 71 ms on node06.hadoop.know-center.at (75/400)
  788. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 91.0 in stage 9.0 (TID 966, node12.hadoop.know-center.at, partition 91,NODE_LOCAL, 2152 bytes)
  789. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 72.0 in stage 9.0 (TID 947) in 88 ms on node12.hadoop.know-center.at (76/400)
  790. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 92.0 in stage 9.0 (TID 967, node12.hadoop.know-center.at, partition 92,NODE_LOCAL, 2152 bytes)
  791. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 78.0 in stage 9.0 (TID 953) in 58 ms on node12.hadoop.know-center.at (77/400)
  792. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 93.0 in stage 9.0 (TID 968, node06.hadoop.know-center.at, partition 93,NODE_LOCAL, 2152 bytes)
  793. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 80.0 in stage 9.0 (TID 955) in 69 ms on node06.hadoop.know-center.at (78/400)
  794. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 94.0 in stage 9.0 (TID 969, node06.hadoop.know-center.at, partition 94,NODE_LOCAL, 2152 bytes)
  795. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 82.0 in stage 9.0 (TID 957) in 66 ms on node06.hadoop.know-center.at (79/400)
  796. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 95.0 in stage 9.0 (TID 970, node06.hadoop.know-center.at, partition 95,NODE_LOCAL, 2152 bytes)
  797. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 81.0 in stage 9.0 (TID 956) in 69 ms on node06.hadoop.know-center.at (80/400)
  798. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 96.0 in stage 9.0 (TID 971, node06.hadoop.know-center.at, partition 96,NODE_LOCAL, 2152 bytes)
  799. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 83.0 in stage 9.0 (TID 958) in 67 ms on node06.hadoop.know-center.at (81/400)
  800. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 97.0 in stage 9.0 (TID 972, node12.hadoop.know-center.at, partition 97,NODE_LOCAL, 2152 bytes)
  801. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 77.0 in stage 9.0 (TID 952) in 87 ms on node12.hadoop.know-center.at (82/400)
  802. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 98.0 in stage 9.0 (TID 973, node12.hadoop.know-center.at, partition 98,NODE_LOCAL, 2152 bytes)
  803. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 76.0 in stage 9.0 (TID 951) in 122 ms on node12.hadoop.know-center.at (83/400)
  804. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 99.0 in stage 9.0 (TID 974, node12.hadoop.know-center.at, partition 99,NODE_LOCAL, 2152 bytes)
  805. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 79.0 in stage 9.0 (TID 954) in 82 ms on node12.hadoop.know-center.at (84/400)
  806. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 100.0 in stage 9.0 (TID 975, node06.hadoop.know-center.at, partition 100,NODE_LOCAL, 2152 bytes)
  807. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 84.0 in stage 9.0 (TID 959) in 66 ms on node06.hadoop.know-center.at (85/400)
  808. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 101.0 in stage 9.0 (TID 976, node06.hadoop.know-center.at, partition 101,NODE_LOCAL, 2152 bytes)
  809. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 85.0 in stage 9.0 (TID 960) in 65 ms on node06.hadoop.know-center.at (86/400)
  810. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 102.0 in stage 9.0 (TID 977, node12.hadoop.know-center.at, partition 102,NODE_LOCAL, 2152 bytes)
  811. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 88.0 in stage 9.0 (TID 963) in 65 ms on node12.hadoop.know-center.at (87/400)
  812. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 103.0 in stage 9.0 (TID 978, node12.hadoop.know-center.at, partition 103,NODE_LOCAL, 2152 bytes)
  813. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 87.0 in stage 9.0 (TID 962) in 67 ms on node12.hadoop.know-center.at (88/400)
  814. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 104.0 in stage 9.0 (TID 979, node06.hadoop.know-center.at, partition 104,NODE_LOCAL, 2152 bytes)
  815. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 86.0 in stage 9.0 (TID 961) in 67 ms on node06.hadoop.know-center.at (89/400)
  816. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 105.0 in stage 9.0 (TID 980, node12.hadoop.know-center.at, partition 105,NODE_LOCAL, 2152 bytes)
  817. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 89.0 in stage 9.0 (TID 964) in 68 ms on node12.hadoop.know-center.at (90/400)
  818. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 106.0 in stage 9.0 (TID 981, node06.hadoop.know-center.at, partition 106,NODE_LOCAL, 2152 bytes)
  819. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 90.0 in stage 9.0 (TID 965) in 70 ms on node06.hadoop.know-center.at (91/400)
  820. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 107.0 in stage 9.0 (TID 982, node12.hadoop.know-center.at, partition 107,NODE_LOCAL, 2152 bytes)
  821. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 91.0 in stage 9.0 (TID 966) in 70 ms on node12.hadoop.know-center.at (92/400)
  822. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 108.0 in stage 9.0 (TID 983, node12.hadoop.know-center.at, partition 108,NODE_LOCAL, 2152 bytes)
  823. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 92.0 in stage 9.0 (TID 967) in 58 ms on node12.hadoop.know-center.at (93/400)
  824. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 109.0 in stage 9.0 (TID 984, node06.hadoop.know-center.at, partition 109,NODE_LOCAL, 2152 bytes)
  825. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 93.0 in stage 9.0 (TID 968) in 68 ms on node06.hadoop.know-center.at (94/400)
  826. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 110.0 in stage 9.0 (TID 985, node06.hadoop.know-center.at, partition 110,NODE_LOCAL, 2152 bytes)
  827. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 111.0 in stage 9.0 (TID 986, node06.hadoop.know-center.at, partition 111,NODE_LOCAL, 2152 bytes)
  828. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 95.0 in stage 9.0 (TID 970) in 68 ms on node06.hadoop.know-center.at (95/400)
  829. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 112.0 in stage 9.0 (TID 987, node06.hadoop.know-center.at, partition 112,NODE_LOCAL, 2152 bytes)
  830. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 96.0 in stage 9.0 (TID 971) in 68 ms on node06.hadoop.know-center.at (96/400)
  831. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 94.0 in stage 9.0 (TID 969) in 69 ms on node06.hadoop.know-center.at (97/400)
  832. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 113.0 in stage 9.0 (TID 988, node06.hadoop.know-center.at, partition 113,NODE_LOCAL, 2152 bytes)
  833. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 101.0 in stage 9.0 (TID 976) in 66 ms on node06.hadoop.know-center.at (98/400)
  834. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 114.0 in stage 9.0 (TID 989, node12.hadoop.know-center.at, partition 114,NODE_LOCAL, 2152 bytes)
  835. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 105.0 in stage 9.0 (TID 980) in 58 ms on node12.hadoop.know-center.at (99/400)
  836. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 115.0 in stage 9.0 (TID 990, node06.hadoop.know-center.at, partition 115,NODE_LOCAL, 2152 bytes)
  837. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 100.0 in stage 9.0 (TID 975) in 68 ms on node06.hadoop.know-center.at (100/400)
  838. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 116.0 in stage 9.0 (TID 991, node06.hadoop.know-center.at, partition 116,NODE_LOCAL, 2152 bytes)
  839. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 104.0 in stage 9.0 (TID 979) in 66 ms on node06.hadoop.know-center.at (101/400)
  840. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 117.0 in stage 9.0 (TID 992, node12.hadoop.know-center.at, partition 117,NODE_LOCAL, 2152 bytes)
  841. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 103.0 in stage 9.0 (TID 978) in 68 ms on node12.hadoop.know-center.at (102/400)
  842. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 118.0 in stage 9.0 (TID 993, node06.hadoop.know-center.at, partition 118,NODE_LOCAL, 2152 bytes)
  843. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 106.0 in stage 9.0 (TID 981) in 69 ms on node06.hadoop.know-center.at (103/400)
  844. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 119.0 in stage 9.0 (TID 994, node12.hadoop.know-center.at, partition 119,NODE_LOCAL, 2152 bytes)
  845. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 99.0 in stage 9.0 (TID 974) in 88 ms on node12.hadoop.know-center.at (104/400)
  846. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 120.0 in stage 9.0 (TID 995, node12.hadoop.know-center.at, partition 120,NODE_LOCAL, 2152 bytes)
  847. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 102.0 in stage 9.0 (TID 977) in 84 ms on node12.hadoop.know-center.at (105/400)
  848. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 121.0 in stage 9.0 (TID 996, node12.hadoop.know-center.at, partition 121,NODE_LOCAL, 2152 bytes)
  849. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 108.0 in stage 9.0 (TID 983) in 69 ms on node12.hadoop.know-center.at (106/400)
  850. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 122.0 in stage 9.0 (TID 997, node12.hadoop.know-center.at, partition 122,NODE_LOCAL, 2152 bytes)
  851. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 107.0 in stage 9.0 (TID 982) in 72 ms on node12.hadoop.know-center.at (107/400)
  852. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 123.0 in stage 9.0 (TID 998, node12.hadoop.know-center.at, partition 123,NODE_LOCAL, 2152 bytes)
  853. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 97.0 in stage 9.0 (TID 972) in 101 ms on node12.hadoop.know-center.at (108/400)
  854. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 124.0 in stage 9.0 (TID 999, node12.hadoop.know-center.at, partition 124,NODE_LOCAL, 2152 bytes)
  855. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 98.0 in stage 9.0 (TID 973) in 101 ms on node12.hadoop.know-center.at (109/400)
  856. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 125.0 in stage 9.0 (TID 1000, node12.hadoop.know-center.at, partition 125,NODE_LOCAL, 2152 bytes)
  857. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 114.0 in stage 9.0 (TID 989) in 59 ms on node12.hadoop.know-center.at (110/400)
  858. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 126.0 in stage 9.0 (TID 1001, node06.hadoop.know-center.at, partition 126,NODE_LOCAL, 2152 bytes)
  859. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 109.0 in stage 9.0 (TID 984) in 70 ms on node06.hadoop.know-center.at (111/400)
  860. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 127.0 in stage 9.0 (TID 1002, node06.hadoop.know-center.at, partition 127,NODE_LOCAL, 2152 bytes)
  861. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 110.0 in stage 9.0 (TID 985) in 69 ms on node06.hadoop.know-center.at (112/400)
  862. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 128.0 in stage 9.0 (TID 1003, node06.hadoop.know-center.at, partition 128,NODE_LOCAL, 2152 bytes)
  863. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 112.0 in stage 9.0 (TID 987) in 70 ms on node06.hadoop.know-center.at (113/400)
  864. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 129.0 in stage 9.0 (TID 1004, node06.hadoop.know-center.at, partition 129,NODE_LOCAL, 2152 bytes)
  865. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 111.0 in stage 9.0 (TID 986) in 70 ms on node06.hadoop.know-center.at (114/400)
  866. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 130.0 in stage 9.0 (TID 1005, node06.hadoop.know-center.at, partition 130,NODE_LOCAL, 2152 bytes)
  867. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 115.0 in stage 9.0 (TID 990) in 65 ms on node06.hadoop.know-center.at (115/400)
  868. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 131.0 in stage 9.0 (TID 1006, node06.hadoop.know-center.at, partition 131,NODE_LOCAL, 2152 bytes)
  869. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 113.0 in stage 9.0 (TID 988) in 68 ms on node06.hadoop.know-center.at (116/400)
  870. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 132.0 in stage 9.0 (TID 1007, node06.hadoop.know-center.at, partition 132,NODE_LOCAL, 2152 bytes)
  871. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 133.0 in stage 9.0 (TID 1008, node12.hadoop.know-center.at, partition 133,NODE_LOCAL, 2152 bytes)
  872. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 116.0 in stage 9.0 (TID 991) in 68 ms on node06.hadoop.know-center.at (117/400)
  873. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 117.0 in stage 9.0 (TID 992) in 68 ms on node12.hadoop.know-center.at (118/400)
  874. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 134.0 in stage 9.0 (TID 1009, node06.hadoop.know-center.at, partition 134,NODE_LOCAL, 2152 bytes)
  875. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 118.0 in stage 9.0 (TID 993) in 70 ms on node06.hadoop.know-center.at (119/400)
  876. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 135.0 in stage 9.0 (TID 1010, node12.hadoop.know-center.at, partition 135,NODE_LOCAL, 2152 bytes)
  877. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 123.0 in stage 9.0 (TID 998) in 58 ms on node12.hadoop.know-center.at (120/400)
  878. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 136.0 in stage 9.0 (TID 1011, node12.hadoop.know-center.at, partition 136,NODE_LOCAL, 2152 bytes)
  879. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 120.0 in stage 9.0 (TID 995) in 77 ms on node12.hadoop.know-center.at (121/400)
  880. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 137.0 in stage 9.0 (TID 1012, node12.hadoop.know-center.at, partition 137,NODE_LOCAL, 2152 bytes)
  881. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 119.0 in stage 9.0 (TID 994) in 79 ms on node12.hadoop.know-center.at (122/400)
  882. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 138.0 in stage 9.0 (TID 1013, node12.hadoop.know-center.at, partition 138,NODE_LOCAL, 2152 bytes)
  883. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 124.0 in stage 9.0 (TID 999) in 68 ms on node12.hadoop.know-center.at (123/400)
  884. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 139.0 in stage 9.0 (TID 1014, node12.hadoop.know-center.at, partition 139,NODE_LOCAL, 2152 bytes)
  885. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 125.0 in stage 9.0 (TID 1000) in 69 ms on node12.hadoop.know-center.at (124/400)
  886. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 140.0 in stage 9.0 (TID 1015, node12.hadoop.know-center.at, partition 140,NODE_LOCAL, 2152 bytes)
  887. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 121.0 in stage 9.0 (TID 996) in 100 ms on node12.hadoop.know-center.at (125/400)
  888. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 141.0 in stage 9.0 (TID 1016, node06.hadoop.know-center.at, partition 141,NODE_LOCAL, 2152 bytes)
  889. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 126.0 in stage 9.0 (TID 1001) in 69 ms on node06.hadoop.know-center.at (126/400)
  890. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 142.0 in stage 9.0 (TID 1017, node06.hadoop.know-center.at, partition 142,NODE_LOCAL, 2152 bytes)
  891. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 128.0 in stage 9.0 (TID 1003) in 68 ms on node06.hadoop.know-center.at (127/400)
  892. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 143.0 in stage 9.0 (TID 1018, node06.hadoop.know-center.at, partition 143,NODE_LOCAL, 2152 bytes)
  893. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 144.0 in stage 9.0 (TID 1019, node06.hadoop.know-center.at, partition 144,NODE_LOCAL, 2152 bytes)
  894. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 130.0 in stage 9.0 (TID 1005) in 66 ms on node06.hadoop.know-center.at (128/400)
  895. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 145.0 in stage 9.0 (TID 1020, node06.hadoop.know-center.at, partition 145,NODE_LOCAL, 2152 bytes)
  896. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 131.0 in stage 9.0 (TID 1006) in 66 ms on node06.hadoop.know-center.at (129/400)
  897. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 146.0 in stage 9.0 (TID 1021, node06.hadoop.know-center.at, partition 146,NODE_LOCAL, 2152 bytes)
  898. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 127.0 in stage 9.0 (TID 1002) in 70 ms on node06.hadoop.know-center.at (130/400)
  899. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 129.0 in stage 9.0 (TID 1004) in 69 ms on node06.hadoop.know-center.at (131/400)
  900. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 147.0 in stage 9.0 (TID 1022, node12.hadoop.know-center.at, partition 147,NODE_LOCAL, 2152 bytes)
  901. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 122.0 in stage 9.0 (TID 997) in 101 ms on node12.hadoop.know-center.at (132/400)
  902. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 148.0 in stage 9.0 (TID 1023, node12.hadoop.know-center.at, partition 148,NODE_LOCAL, 2152 bytes)
  903. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 133.0 in stage 9.0 (TID 1008) in 68 ms on node12.hadoop.know-center.at (133/400)
  904. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 149.0 in stage 9.0 (TID 1024, node06.hadoop.know-center.at, partition 149,NODE_LOCAL, 2152 bytes)
  905. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 132.0 in stage 9.0 (TID 1007) in 70 ms on node06.hadoop.know-center.at (134/400)
  906. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 150.0 in stage 9.0 (TID 1025, node06.hadoop.know-center.at, partition 150,NODE_LOCAL, 2152 bytes)
  907. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 134.0 in stage 9.0 (TID 1009) in 67 ms on node06.hadoop.know-center.at (135/400)
  908. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 151.0 in stage 9.0 (TID 1026, node12.hadoop.know-center.at, partition 151,NODE_LOCAL, 2152 bytes)
  909. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 135.0 in stage 9.0 (TID 1010) in 68 ms on node12.hadoop.know-center.at (136/400)
  910. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 152.0 in stage 9.0 (TID 1027, node12.hadoop.know-center.at, partition 152,NODE_LOCAL, 2152 bytes)
  911. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 137.0 in stage 9.0 (TID 1012) in 70 ms on node12.hadoop.know-center.at (137/400)
  912. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 153.0 in stage 9.0 (TID 1028, node12.hadoop.know-center.at, partition 153,NODE_LOCAL, 2152 bytes)
  913. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 138.0 in stage 9.0 (TID 1013) in 83 ms on node12.hadoop.know-center.at (138/400)
  914. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 154.0 in stage 9.0 (TID 1029, node12.hadoop.know-center.at, partition 154,NODE_LOCAL, 2152 bytes)
  915. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 139.0 in stage 9.0 (TID 1014) in 58 ms on node12.hadoop.know-center.at (139/400)
  916. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 155.0 in stage 9.0 (TID 1030, node12.hadoop.know-center.at, partition 155,NODE_LOCAL, 2152 bytes)
  917. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 136.0 in stage 9.0 (TID 1011) in 87 ms on node12.hadoop.know-center.at (140/400)
  918. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 156.0 in stage 9.0 (TID 1031, node06.hadoop.know-center.at, partition 156,NODE_LOCAL, 2152 bytes)
  919. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 157.0 in stage 9.0 (TID 1032, node06.hadoop.know-center.at, partition 157,NODE_LOCAL, 2152 bytes)
  920. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 144.0 in stage 9.0 (TID 1019) in 66 ms on node06.hadoop.know-center.at (141/400)
  921. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 158.0 in stage 9.0 (TID 1033, node06.hadoop.know-center.at, partition 158,NODE_LOCAL, 2152 bytes)
  922. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 141.0 in stage 9.0 (TID 1016) in 68 ms on node06.hadoop.know-center.at (142/400)
  923. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 145.0 in stage 9.0 (TID 1020) in 67 ms on node06.hadoop.know-center.at (143/400)
  924. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 159.0 in stage 9.0 (TID 1034, node06.hadoop.know-center.at, partition 159,NODE_LOCAL, 2152 bytes)
  925. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 142.0 in stage 9.0 (TID 1017) in 68 ms on node06.hadoop.know-center.at (144/400)
  926. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 160.0 in stage 9.0 (TID 1035, node06.hadoop.know-center.at, partition 160,NODE_LOCAL, 2152 bytes)
  927. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 161.0 in stage 9.0 (TID 1036, node06.hadoop.know-center.at, partition 161,NODE_LOCAL, 2152 bytes)
  928. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 143.0 in stage 9.0 (TID 1018) in 70 ms on node06.hadoop.know-center.at (145/400)
  929. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 146.0 in stage 9.0 (TID 1021) in 69 ms on node06.hadoop.know-center.at (146/400)
  930. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 162.0 in stage 9.0 (TID 1037, node06.hadoop.know-center.at, partition 162,NODE_LOCAL, 2152 bytes)
  931. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 149.0 in stage 9.0 (TID 1024) in 70 ms on node06.hadoop.know-center.at (147/400)
  932. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 163.0 in stage 9.0 (TID 1038, node12.hadoop.know-center.at, partition 163,NODE_LOCAL, 2152 bytes)
  933. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 151.0 in stage 9.0 (TID 1026) in 59 ms on node12.hadoop.know-center.at (148/400)
  934. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 164.0 in stage 9.0 (TID 1039, node12.hadoop.know-center.at, partition 164,NODE_LOCAL, 2152 bytes)
  935. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 148.0 in stage 9.0 (TID 1023) in 77 ms on node12.hadoop.know-center.at (149/400)
  936. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 165.0 in stage 9.0 (TID 1040, node06.hadoop.know-center.at, partition 165,NODE_LOCAL, 2152 bytes)
  937. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 150.0 in stage 9.0 (TID 1025) in 69 ms on node06.hadoop.know-center.at (150/400)
  938. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 166.0 in stage 9.0 (TID 1041, node12.hadoop.know-center.at, partition 166,NODE_LOCAL, 2152 bytes)
  939. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 140.0 in stage 9.0 (TID 1015) in 98 ms on node12.hadoop.know-center.at (151/400)
  940. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 167.0 in stage 9.0 (TID 1042, node12.hadoop.know-center.at, partition 167,NODE_LOCAL, 2152 bytes)
  941. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 147.0 in stage 9.0 (TID 1022) in 100 ms on node12.hadoop.know-center.at (152/400)
  942. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 168.0 in stage 9.0 (TID 1043, node12.hadoop.know-center.at, partition 168,NODE_LOCAL, 2152 bytes)
  943. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 152.0 in stage 9.0 (TID 1027) in 68 ms on node12.hadoop.know-center.at (153/400)
  944. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 169.0 in stage 9.0 (TID 1044, node12.hadoop.know-center.at, partition 169,NODE_LOCAL, 2152 bytes)
  945. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 155.0 in stage 9.0 (TID 1030) in 66 ms on node12.hadoop.know-center.at (154/400)
  946. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 170.0 in stage 9.0 (TID 1045, node12.hadoop.know-center.at, partition 170,NODE_LOCAL, 2152 bytes)
  947. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 153.0 in stage 9.0 (TID 1028) in 77 ms on node12.hadoop.know-center.at (155/400)
  948. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 171.0 in stage 9.0 (TID 1046, node06.hadoop.know-center.at, partition 171,NODE_LOCAL, 2152 bytes)
  949. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 156.0 in stage 9.0 (TID 1031) in 68 ms on node06.hadoop.know-center.at (156/400)
  950. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 172.0 in stage 9.0 (TID 1047, node06.hadoop.know-center.at, partition 172,NODE_LOCAL, 2152 bytes)
  951. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 157.0 in stage 9.0 (TID 1032) in 68 ms on node06.hadoop.know-center.at (157/400)
  952. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 173.0 in stage 9.0 (TID 1048, node06.hadoop.know-center.at, partition 173,NODE_LOCAL, 2152 bytes)
  953. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 174.0 in stage 9.0 (TID 1049, node06.hadoop.know-center.at, partition 174,NODE_LOCAL, 2152 bytes)
  954. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 159.0 in stage 9.0 (TID 1034) in 68 ms on node06.hadoop.know-center.at (158/400)
  955. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 175.0 in stage 9.0 (TID 1050, node06.hadoop.know-center.at, partition 175,NODE_LOCAL, 2152 bytes)
  956. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 161.0 in stage 9.0 (TID 1036) in 66 ms on node06.hadoop.know-center.at (159/400)
  957. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 176.0 in stage 9.0 (TID 1051, node06.hadoop.know-center.at, partition 176,NODE_LOCAL, 2152 bytes)
  958. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 160.0 in stage 9.0 (TID 1035) in 68 ms on node06.hadoop.know-center.at (160/400)
  959. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 158.0 in stage 9.0 (TID 1033) in 70 ms on node06.hadoop.know-center.at (161/400)
  960. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 177.0 in stage 9.0 (TID 1052, node12.hadoop.know-center.at, partition 177,NODE_LOCAL, 2152 bytes)
  961. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 154.0 in stage 9.0 (TID 1029) in 86 ms on node12.hadoop.know-center.at (162/400)
  962. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 178.0 in stage 9.0 (TID 1053, node12.hadoop.know-center.at, partition 178,NODE_LOCAL, 2152 bytes)
  963. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 163.0 in stage 9.0 (TID 1038) in 58 ms on node12.hadoop.know-center.at (163/400)
  964. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 179.0 in stage 9.0 (TID 1054, node06.hadoop.know-center.at, partition 179,NODE_LOCAL, 2152 bytes)
  965. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 162.0 in stage 9.0 (TID 1037) in 72 ms on node06.hadoop.know-center.at (164/400)
  966. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 180.0 in stage 9.0 (TID 1055, node12.hadoop.know-center.at, partition 180,NODE_LOCAL, 2152 bytes)
  967. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 164.0 in stage 9.0 (TID 1039) in 71 ms on node12.hadoop.know-center.at (165/400)
  968. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 181.0 in stage 9.0 (TID 1056, node06.hadoop.know-center.at, partition 181,NODE_LOCAL, 2152 bytes)
  969. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 165.0 in stage 9.0 (TID 1040) in 84 ms on node06.hadoop.know-center.at (166/400)
  970. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 182.0 in stage 9.0 (TID 1057, node12.hadoop.know-center.at, partition 182,NODE_LOCAL, 2152 bytes)
  971. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 169.0 in stage 9.0 (TID 1044) in 59 ms on node12.hadoop.know-center.at (167/400)
  972. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 183.0 in stage 9.0 (TID 1058, node12.hadoop.know-center.at, partition 183,NODE_LOCAL, 2152 bytes)
  973. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 168.0 in stage 9.0 (TID 1043) in 79 ms on node12.hadoop.know-center.at (168/400)
  974. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 184.0 in stage 9.0 (TID 1059, node12.hadoop.know-center.at, partition 184,NODE_LOCAL, 2152 bytes)
  975. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 166.0 in stage 9.0 (TID 1041) in 92 ms on node12.hadoop.know-center.at (169/400)
  976. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 185.0 in stage 9.0 (TID 1060, node12.hadoop.know-center.at, partition 185,NODE_LOCAL, 2152 bytes)
  977. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 170.0 in stage 9.0 (TID 1045) in 67 ms on node12.hadoop.know-center.at (170/400)
  978. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 186.0 in stage 9.0 (TID 1061, node12.hadoop.know-center.at, partition 186,NODE_LOCAL, 2152 bytes)
  979. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 178.0 in stage 9.0 (TID 1053) in 58 ms on node12.hadoop.know-center.at (171/400)
  980. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 187.0 in stage 9.0 (TID 1062, node06.hadoop.know-center.at, partition 187,NODE_LOCAL, 2152 bytes)
  981. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 173.0 in stage 9.0 (TID 1048) in 65 ms on node06.hadoop.know-center.at (172/400)
  982. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 188.0 in stage 9.0 (TID 1063, node06.hadoop.know-center.at, partition 188,NODE_LOCAL, 2152 bytes)
  983. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 172.0 in stage 9.0 (TID 1047) in 67 ms on node06.hadoop.know-center.at (173/400)
  984. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 189.0 in stage 9.0 (TID 1064, node06.hadoop.know-center.at, partition 189,NODE_LOCAL, 2152 bytes)
  985. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 174.0 in stage 9.0 (TID 1049) in 67 ms on node06.hadoop.know-center.at (174/400)
  986. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 190.0 in stage 9.0 (TID 1065, node06.hadoop.know-center.at, partition 190,NODE_LOCAL, 2152 bytes)
  987. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 171.0 in stage 9.0 (TID 1046) in 70 ms on node06.hadoop.know-center.at (175/400)
  988. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 191.0 in stage 9.0 (TID 1066, node12.hadoop.know-center.at, partition 191,NODE_LOCAL, 2152 bytes)
  989. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 167.0 in stage 9.0 (TID 1042) in 109 ms on node12.hadoop.know-center.at (176/400)
  990. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 192.0 in stage 9.0 (TID 1067, node06.hadoop.know-center.at, partition 192,NODE_LOCAL, 2152 bytes)
  991. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 179.0 in stage 9.0 (TID 1054) in 67 ms on node06.hadoop.know-center.at (177/400)
  992. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 193.0 in stage 9.0 (TID 1068, node12.hadoop.know-center.at, partition 193,NODE_LOCAL, 2152 bytes)
  993. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 180.0 in stage 9.0 (TID 1055) in 64 ms on node12.hadoop.know-center.at (178/400)
  994. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 194.0 in stage 9.0 (TID 1069, node12.hadoop.know-center.at, partition 194,NODE_LOCAL, 2152 bytes)
  995. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 177.0 in stage 9.0 (TID 1052) in 85 ms on node12.hadoop.know-center.at (179/400)
  996. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 195.0 in stage 9.0 (TID 1070, node06.hadoop.know-center.at, partition 195,NODE_LOCAL, 2152 bytes)
  997. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 196.0 in stage 9.0 (TID 1071, node12.hadoop.know-center.at, partition 196,NODE_LOCAL, 2152 bytes)
  998. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 181.0 in stage 9.0 (TID 1056) in 66 ms on node06.hadoop.know-center.at (180/400)
  999. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 182.0 in stage 9.0 (TID 1057) in 59 ms on node12.hadoop.know-center.at (181/400)
  1000. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 197.0 in stage 9.0 (TID 1072, node06.hadoop.know-center.at, partition 197,NODE_LOCAL, 2152 bytes)
  1001. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 176.0 in stage 9.0 (TID 1051) in 108 ms on node06.hadoop.know-center.at (182/400)
  1002. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 198.0 in stage 9.0 (TID 1073, node06.hadoop.know-center.at, partition 198,NODE_LOCAL, 2152 bytes)
  1003. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 175.0 in stage 9.0 (TID 1050) in 111 ms on node06.hadoop.know-center.at (183/400)
  1004. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 199.0 in stage 9.0 (TID 1074, node12.hadoop.know-center.at, partition 199,NODE_LOCAL, 2152 bytes)
  1005. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 183.0 in stage 9.0 (TID 1058) in 71 ms on node12.hadoop.know-center.at (184/400)
  1006. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 200.0 in stage 9.0 (TID 1075, node06.hadoop.know-center.at, partition 200,NODE_LOCAL, 2152 bytes)
  1007. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 189.0 in stage 9.0 (TID 1064) in 65 ms on node06.hadoop.know-center.at (185/400)
  1008. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 201.0 in stage 9.0 (TID 1076, node12.hadoop.know-center.at, partition 201,NODE_LOCAL, 2152 bytes)
  1009. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 185.0 in stage 9.0 (TID 1060) in 73 ms on node12.hadoop.know-center.at (186/400)
  1010. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 202.0 in stage 9.0 (TID 1077, node06.hadoop.know-center.at, partition 202,NODE_LOCAL, 2152 bytes)
  1011. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 187.0 in stage 9.0 (TID 1062) in 69 ms on node06.hadoop.know-center.at (187/400)
  1012. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 203.0 in stage 9.0 (TID 1078, node06.hadoop.know-center.at, partition 203,NODE_LOCAL, 2152 bytes)
  1013. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 190.0 in stage 9.0 (TID 1065) in 65 ms on node06.hadoop.know-center.at (188/400)
  1014. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 204.0 in stage 9.0 (TID 1079, node12.hadoop.know-center.at, partition 204,NODE_LOCAL, 2152 bytes)
  1015. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 184.0 in stage 9.0 (TID 1059) in 84 ms on node12.hadoop.know-center.at (189/400)
  1016. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 205.0 in stage 9.0 (TID 1080, node12.hadoop.know-center.at, partition 205,NODE_LOCAL, 2152 bytes)
  1017. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 186.0 in stage 9.0 (TID 1061) in 74 ms on node12.hadoop.know-center.at (190/400)
  1018. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 206.0 in stage 9.0 (TID 1081, node06.hadoop.know-center.at, partition 206,NODE_LOCAL, 2152 bytes)
  1019. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 188.0 in stage 9.0 (TID 1063) in 72 ms on node06.hadoop.know-center.at (191/400)
  1020. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 207.0 in stage 9.0 (TID 1082, node12.hadoop.know-center.at, partition 207,NODE_LOCAL, 2152 bytes)
  1021. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 191.0 in stage 9.0 (TID 1066) in 75 ms on node12.hadoop.know-center.at (192/400)
  1022. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 208.0 in stage 9.0 (TID 1083, node06.hadoop.know-center.at, partition 208,NODE_LOCAL, 2152 bytes)
  1023. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 192.0 in stage 9.0 (TID 1067) in 68 ms on node06.hadoop.know-center.at (193/400)
  1024. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 209.0 in stage 9.0 (TID 1084, node12.hadoop.know-center.at, partition 209,NODE_LOCAL, 2152 bytes)
  1025. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 193.0 in stage 9.0 (TID 1068) in 72 ms on node12.hadoop.know-center.at (194/400)
  1026. 16/04/23 20:27:51 INFO TaskSetManager: Starting task 210.0 in stage 9.0 (TID 1085, node12.hadoop.know-center.at, partition 210,NODE_LOCAL, 2152 bytes)
  1027. 16/04/23 20:27:51 INFO TaskSetManager: Finished task 196.0 in stage 9.0 (TID 1071) in 58 ms on node12.hadoop.know-center.at (195/400)
  1028. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 211.0 in stage 9.0 (TID 1086, node12.hadoop.know-center.at, partition 211,NODE_LOCAL, 2152 bytes)
  1029. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 194.0 in stage 9.0 (TID 1069) in 81 ms on node12.hadoop.know-center.at (196/400)
  1030. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 212.0 in stage 9.0 (TID 1087, node06.hadoop.know-center.at, partition 212,NODE_LOCAL, 2152 bytes)
  1031. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 198.0 in stage 9.0 (TID 1073) in 66 ms on node06.hadoop.know-center.at (197/400)
  1032. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 213.0 in stage 9.0 (TID 1088, node06.hadoop.know-center.at, partition 213,NODE_LOCAL, 2152 bytes)
  1033. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 195.0 in stage 9.0 (TID 1070) in 77 ms on node06.hadoop.know-center.at (198/400)
  1034. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 214.0 in stage 9.0 (TID 1089, node12.hadoop.know-center.at, partition 214,NODE_LOCAL, 2152 bytes)
  1035. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 199.0 in stage 9.0 (TID 1074) in 63 ms on node12.hadoop.know-center.at (199/400)
  1036. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 215.0 in stage 9.0 (TID 1090, node06.hadoop.know-center.at, partition 215,NODE_LOCAL, 2152 bytes)
  1037. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 197.0 in stage 9.0 (TID 1072) in 77 ms on node06.hadoop.know-center.at (200/400)
  1038. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 216.0 in stage 9.0 (TID 1091, node12.hadoop.know-center.at, partition 216,NODE_LOCAL, 2152 bytes)
  1039. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 204.0 in stage 9.0 (TID 1079) in 59 ms on node12.hadoop.know-center.at (201/400)
  1040. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 217.0 in stage 9.0 (TID 1092, node06.hadoop.know-center.at, partition 217,NODE_LOCAL, 2152 bytes)
  1041. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 200.0 in stage 9.0 (TID 1075) in 66 ms on node06.hadoop.know-center.at (202/400)
  1042. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 218.0 in stage 9.0 (TID 1093, node12.hadoop.know-center.at, partition 218,NODE_LOCAL, 2152 bytes)
  1043. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 201.0 in stage 9.0 (TID 1076) in 66 ms on node12.hadoop.know-center.at (203/400)
  1044. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 219.0 in stage 9.0 (TID 1094, node06.hadoop.know-center.at, partition 219,NODE_LOCAL, 2152 bytes)
  1045. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 203.0 in stage 9.0 (TID 1078) in 65 ms on node06.hadoop.know-center.at (204/400)
  1046. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 220.0 in stage 9.0 (TID 1095, node06.hadoop.know-center.at, partition 220,NODE_LOCAL, 2152 bytes)
  1047. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 202.0 in stage 9.0 (TID 1077) in 72 ms on node06.hadoop.know-center.at (205/400)
  1048. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 221.0 in stage 9.0 (TID 1096, node06.hadoop.know-center.at, partition 221,NODE_LOCAL, 2152 bytes)
  1049. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 206.0 in stage 9.0 (TID 1081) in 69 ms on node06.hadoop.know-center.at (206/400)
  1050. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 222.0 in stage 9.0 (TID 1097, node12.hadoop.know-center.at, partition 222,NODE_LOCAL, 2152 bytes)
  1051. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 207.0 in stage 9.0 (TID 1082) in 66 ms on node12.hadoop.know-center.at (207/400)
  1052. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 223.0 in stage 9.0 (TID 1098, node12.hadoop.know-center.at, partition 223,NODE_LOCAL, 2152 bytes)
  1053. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 224.0 in stage 9.0 (TID 1099, node06.hadoop.know-center.at, partition 224,NODE_LOCAL, 2152 bytes)
  1054. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 210.0 in stage 9.0 (TID 1085) in 60 ms on node12.hadoop.know-center.at (208/400)
  1055. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 208.0 in stage 9.0 (TID 1083) in 67 ms on node06.hadoop.know-center.at (209/400)
  1056. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 225.0 in stage 9.0 (TID 1100, node12.hadoop.know-center.at, partition 225,NODE_LOCAL, 2152 bytes)
  1057. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 209.0 in stage 9.0 (TID 1084) in 64 ms on node12.hadoop.know-center.at (210/400)
  1058. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 226.0 in stage 9.0 (TID 1101, node12.hadoop.know-center.at, partition 226,NODE_LOCAL, 2152 bytes)
  1059. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 205.0 in stage 9.0 (TID 1080) in 85 ms on node12.hadoop.know-center.at (211/400)
  1060. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 227.0 in stage 9.0 (TID 1102, node06.hadoop.know-center.at, partition 227,NODE_LOCAL, 2152 bytes)
  1061. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 212.0 in stage 9.0 (TID 1087) in 65 ms on node06.hadoop.know-center.at (212/400)
  1062. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 228.0 in stage 9.0 (TID 1103, node06.hadoop.know-center.at, partition 228,NODE_LOCAL, 2152 bytes)
  1063. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 213.0 in stage 9.0 (TID 1088) in 63 ms on node06.hadoop.know-center.at (213/400)
  1064. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 229.0 in stage 9.0 (TID 1104, node12.hadoop.know-center.at, partition 229,NODE_LOCAL, 2152 bytes)
  1065. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 214.0 in stage 9.0 (TID 1089) in 61 ms on node12.hadoop.know-center.at (214/400)
  1066. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 230.0 in stage 9.0 (TID 1105, node12.hadoop.know-center.at, partition 230,NODE_LOCAL, 2152 bytes)
  1067. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 211.0 in stage 9.0 (TID 1086) in 77 ms on node12.hadoop.know-center.at (215/400)
  1068. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 231.0 in stage 9.0 (TID 1106, node06.hadoop.know-center.at, partition 231,NODE_LOCAL, 2152 bytes)
  1069. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 215.0 in stage 9.0 (TID 1090) in 67 ms on node06.hadoop.know-center.at (216/400)
  1070. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 232.0 in stage 9.0 (TID 1107, node12.hadoop.know-center.at, partition 232,NODE_LOCAL, 2152 bytes)
  1071. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 216.0 in stage 9.0 (TID 1091) in 58 ms on node12.hadoop.know-center.at (217/400)
  1072. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 233.0 in stage 9.0 (TID 1108, node06.hadoop.know-center.at, partition 233,NODE_LOCAL, 2152 bytes)
  1073. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 217.0 in stage 9.0 (TID 1092) in 69 ms on node06.hadoop.know-center.at (218/400)
  1074. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 234.0 in stage 9.0 (TID 1109, node12.hadoop.know-center.at, partition 234,NODE_LOCAL, 2152 bytes)
  1075. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 235.0 in stage 9.0 (TID 1110, node06.hadoop.know-center.at, partition 235,NODE_LOCAL, 2152 bytes)
  1076. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 218.0 in stage 9.0 (TID 1093) in 68 ms on node12.hadoop.know-center.at (219/400)
  1077. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 219.0 in stage 9.0 (TID 1094) in 67 ms on node06.hadoop.know-center.at (220/400)
  1078. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 236.0 in stage 9.0 (TID 1111, node06.hadoop.know-center.at, partition 236,NODE_LOCAL, 2152 bytes)
  1079. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 220.0 in stage 9.0 (TID 1095) in 67 ms on node06.hadoop.know-center.at (221/400)
  1080. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 237.0 in stage 9.0 (TID 1112, node06.hadoop.know-center.at, partition 237,NODE_LOCAL, 2152 bytes)
  1081. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 221.0 in stage 9.0 (TID 1096) in 67 ms on node06.hadoop.know-center.at (222/400)
  1082. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 238.0 in stage 9.0 (TID 1113, node12.hadoop.know-center.at, partition 238,NODE_LOCAL, 2152 bytes)
  1083. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 223.0 in stage 9.0 (TID 1098) in 57 ms on node12.hadoop.know-center.at (223/400)
  1084. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 239.0 in stage 9.0 (TID 1114, node06.hadoop.know-center.at, partition 239,NODE_LOCAL, 2152 bytes)
  1085. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 224.0 in stage 9.0 (TID 1099) in 66 ms on node06.hadoop.know-center.at (224/400)
  1086. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 240.0 in stage 9.0 (TID 1115, node12.hadoop.know-center.at, partition 240,NODE_LOCAL, 2152 bytes)
  1087. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 222.0 in stage 9.0 (TID 1097) in 71 ms on node12.hadoop.know-center.at (225/400)
  1088. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 241.0 in stage 9.0 (TID 1116, node12.hadoop.know-center.at, partition 241,NODE_LOCAL, 2152 bytes)
  1089. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 226.0 in stage 9.0 (TID 1101) in 67 ms on node12.hadoop.know-center.at (226/400)
  1090. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 242.0 in stage 9.0 (TID 1117, node06.hadoop.know-center.at, partition 242,NODE_LOCAL, 2152 bytes)
  1091. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 243.0 in stage 9.0 (TID 1118, node12.hadoop.know-center.at, partition 243,NODE_LOCAL, 2152 bytes)
  1092. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 227.0 in stage 9.0 (TID 1102) in 66 ms on node06.hadoop.know-center.at (227/400)
  1093. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 229.0 in stage 9.0 (TID 1104) in 63 ms on node12.hadoop.know-center.at (228/400)
  1094. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 244.0 in stage 9.0 (TID 1119, node06.hadoop.know-center.at, partition 244,NODE_LOCAL, 2152 bytes)
  1095. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 228.0 in stage 9.0 (TID 1103) in 65 ms on node06.hadoop.know-center.at (229/400)
  1096. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 245.0 in stage 9.0 (TID 1120, node12.hadoop.know-center.at, partition 245,NODE_LOCAL, 2152 bytes)
  1097. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 232.0 in stage 9.0 (TID 1107) in 58 ms on node12.hadoop.know-center.at (230/400)
  1098. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 246.0 in stage 9.0 (TID 1121, node12.hadoop.know-center.at, partition 246,NODE_LOCAL, 2152 bytes)
  1099. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 225.0 in stage 9.0 (TID 1100) in 93 ms on node12.hadoop.know-center.at (231/400)
  1100. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 247.0 in stage 9.0 (TID 1122, node06.hadoop.know-center.at, partition 247,NODE_LOCAL, 2152 bytes)
  1101. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 231.0 in stage 9.0 (TID 1106) in 68 ms on node06.hadoop.know-center.at (232/400)
  1102. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 248.0 in stage 9.0 (TID 1123, node06.hadoop.know-center.at, partition 248,NODE_LOCAL, 2152 bytes)
  1103. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 233.0 in stage 9.0 (TID 1108) in 66 ms on node06.hadoop.know-center.at (233/400)
  1104. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 249.0 in stage 9.0 (TID 1124, node06.hadoop.know-center.at, partition 249,NODE_LOCAL, 2152 bytes)
  1105. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 235.0 in stage 9.0 (TID 1110) in 67 ms on node06.hadoop.know-center.at (234/400)
  1106. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 250.0 in stage 9.0 (TID 1125, node12.hadoop.know-center.at, partition 250,NODE_LOCAL, 2152 bytes)
  1107. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 234.0 in stage 9.0 (TID 1109) in 69 ms on node12.hadoop.know-center.at (235/400)
  1108. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 251.0 in stage 9.0 (TID 1126, node12.hadoop.know-center.at, partition 251,NODE_LOCAL, 2152 bytes)
  1109. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 230.0 in stage 9.0 (TID 1105) in 89 ms on node12.hadoop.know-center.at (236/400)
  1110. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 252.0 in stage 9.0 (TID 1127, node06.hadoop.know-center.at, partition 252,NODE_LOCAL, 2152 bytes)
  1111. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 236.0 in stage 9.0 (TID 1111) in 70 ms on node06.hadoop.know-center.at (237/400)
  1112. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 253.0 in stage 9.0 (TID 1128, node06.hadoop.know-center.at, partition 253,NODE_LOCAL, 2152 bytes)
  1113. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 237.0 in stage 9.0 (TID 1112) in 69 ms on node06.hadoop.know-center.at (238/400)
  1114. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 254.0 in stage 9.0 (TID 1129, node12.hadoop.know-center.at, partition 254,NODE_LOCAL, 2152 bytes)
  1115. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 241.0 in stage 9.0 (TID 1116) in 60 ms on node12.hadoop.know-center.at (239/400)
  1116. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 255.0 in stage 9.0 (TID 1130, node12.hadoop.know-center.at, partition 255,NODE_LOCAL, 2152 bytes)
  1117. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 256.0 in stage 9.0 (TID 1131, node06.hadoop.know-center.at, partition 256,NODE_LOCAL, 2152 bytes)
  1118. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 238.0 in stage 9.0 (TID 1113) in 76 ms on node12.hadoop.know-center.at (240/400)
  1119. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 239.0 in stage 9.0 (TID 1114) in 66 ms on node06.hadoop.know-center.at (241/400)
  1120. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 257.0 in stage 9.0 (TID 1132, node12.hadoop.know-center.at, partition 257,NODE_LOCAL, 2152 bytes)
  1121. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 240.0 in stage 9.0 (TID 1115) in 75 ms on node12.hadoop.know-center.at (242/400)
  1122. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 258.0 in stage 9.0 (TID 1133, node12.hadoop.know-center.at, partition 258,NODE_LOCAL, 2152 bytes)
  1123. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 245.0 in stage 9.0 (TID 1120) in 57 ms on node12.hadoop.know-center.at (243/400)
  1124. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 259.0 in stage 9.0 (TID 1134, node12.hadoop.know-center.at, partition 259,NODE_LOCAL, 2152 bytes)
  1125. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 243.0 in stage 9.0 (TID 1118) in 63 ms on node12.hadoop.know-center.at (244/400)
  1126. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 260.0 in stage 9.0 (TID 1135, node06.hadoop.know-center.at, partition 260,NODE_LOCAL, 2152 bytes)
  1127. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 242.0 in stage 9.0 (TID 1117) in 66 ms on node06.hadoop.know-center.at (245/400)
  1128. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 261.0 in stage 9.0 (TID 1136, node06.hadoop.know-center.at, partition 261,NODE_LOCAL, 2152 bytes)
  1129. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 244.0 in stage 9.0 (TID 1119) in 66 ms on node06.hadoop.know-center.at (246/400)
  1130. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 262.0 in stage 9.0 (TID 1137, node06.hadoop.know-center.at, partition 262,NODE_LOCAL, 2152 bytes)
  1131. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 247.0 in stage 9.0 (TID 1122) in 70 ms on node06.hadoop.know-center.at (247/400)
  1132. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 263.0 in stage 9.0 (TID 1138, node12.hadoop.know-center.at, partition 263,NODE_LOCAL, 2152 bytes)
  1133. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 246.0 in stage 9.0 (TID 1121) in 81 ms on node12.hadoop.know-center.at (248/400)
  1134. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 264.0 in stage 9.0 (TID 1139, node06.hadoop.know-center.at, partition 264,NODE_LOCAL, 2152 bytes)
  1135. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 248.0 in stage 9.0 (TID 1123) in 68 ms on node06.hadoop.know-center.at (249/400)
  1136. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 265.0 in stage 9.0 (TID 1140, node06.hadoop.know-center.at, partition 265,NODE_LOCAL, 2152 bytes)
  1137. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 249.0 in stage 9.0 (TID 1124) in 68 ms on node06.hadoop.know-center.at (250/400)
  1138. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 266.0 in stage 9.0 (TID 1141, node12.hadoop.know-center.at, partition 266,NODE_LOCAL, 2152 bytes)
  1139. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 251.0 in stage 9.0 (TID 1126) in 67 ms on node12.hadoop.know-center.at (251/400)
  1140. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 267.0 in stage 9.0 (TID 1142, node12.hadoop.know-center.at, partition 267,NODE_LOCAL, 2152 bytes)
  1141. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 254.0 in stage 9.0 (TID 1129) in 61 ms on node12.hadoop.know-center.at (252/400)
  1142. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 268.0 in stage 9.0 (TID 1143, node06.hadoop.know-center.at, partition 268,NODE_LOCAL, 2152 bytes)
  1143. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 253.0 in stage 9.0 (TID 1128) in 67 ms on node06.hadoop.know-center.at (253/400)
  1144. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 269.0 in stage 9.0 (TID 1144, node12.hadoop.know-center.at, partition 269,NODE_LOCAL, 2152 bytes)
  1145. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 250.0 in stage 9.0 (TID 1125) in 78 ms on node12.hadoop.know-center.at (254/400)
  1146. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 270.0 in stage 9.0 (TID 1145, node06.hadoop.know-center.at, partition 270,NODE_LOCAL, 2152 bytes)
  1147. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 252.0 in stage 9.0 (TID 1127) in 72 ms on node06.hadoop.know-center.at (255/400)
  1148. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 271.0 in stage 9.0 (TID 1146, node12.hadoop.know-center.at, partition 271,NODE_LOCAL, 2152 bytes)
  1149. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 255.0 in stage 9.0 (TID 1130) in 63 ms on node12.hadoop.know-center.at (256/400)
  1150. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 272.0 in stage 9.0 (TID 1147, node06.hadoop.know-center.at, partition 272,NODE_LOCAL, 2152 bytes)
  1151. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 256.0 in stage 9.0 (TID 1131) in 66 ms on node06.hadoop.know-center.at (257/400)
  1152. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 273.0 in stage 9.0 (TID 1148, node12.hadoop.know-center.at, partition 273,NODE_LOCAL, 2152 bytes)
  1153. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 258.0 in stage 9.0 (TID 1133) in 61 ms on node12.hadoop.know-center.at (258/400)
  1154. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 274.0 in stage 9.0 (TID 1149, node12.hadoop.know-center.at, partition 274,NODE_LOCAL, 2152 bytes)
  1155. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 259.0 in stage 9.0 (TID 1134) in 67 ms on node12.hadoop.know-center.at (259/400)
  1156. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 275.0 in stage 9.0 (TID 1150, node12.hadoop.know-center.at, partition 275,NODE_LOCAL, 2152 bytes)
  1157. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 257.0 in stage 9.0 (TID 1132) in 74 ms on node12.hadoop.know-center.at (260/400)
  1158. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 276.0 in stage 9.0 (TID 1151, node06.hadoop.know-center.at, partition 276,NODE_LOCAL, 2152 bytes)
  1159. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 260.0 in stage 9.0 (TID 1135) in 67 ms on node06.hadoop.know-center.at (261/400)
  1160. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 277.0 in stage 9.0 (TID 1152, node06.hadoop.know-center.at, partition 277,NODE_LOCAL, 2152 bytes)
  1161. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 261.0 in stage 9.0 (TID 1136) in 68 ms on node06.hadoop.know-center.at (262/400)
  1162. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 278.0 in stage 9.0 (TID 1153, node06.hadoop.know-center.at, partition 278,NODE_LOCAL, 2152 bytes)
  1163. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 262.0 in stage 9.0 (TID 1137) in 69 ms on node06.hadoop.know-center.at (263/400)
  1164. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 279.0 in stage 9.0 (TID 1154, node12.hadoop.know-center.at, partition 279,NODE_LOCAL, 2152 bytes)
  1165. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 267.0 in stage 9.0 (TID 1142) in 59 ms on node12.hadoop.know-center.at (264/400)
  1166. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 280.0 in stage 9.0 (TID 1155, node06.hadoop.know-center.at, partition 280,NODE_LOCAL, 2152 bytes)
  1167. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 281.0 in stage 9.0 (TID 1156, node06.hadoop.know-center.at, partition 281,NODE_LOCAL, 2152 bytes)
  1168. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 264.0 in stage 9.0 (TID 1139) in 68 ms on node06.hadoop.know-center.at (265/400)
  1169. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 265.0 in stage 9.0 (TID 1140) in 67 ms on node06.hadoop.know-center.at (266/400)
  1170. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 282.0 in stage 9.0 (TID 1157, node12.hadoop.know-center.at, partition 282,NODE_LOCAL, 2152 bytes)
  1171. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 269.0 in stage 9.0 (TID 1144) in 56 ms on node12.hadoop.know-center.at (267/400)
  1172. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 283.0 in stage 9.0 (TID 1158, node12.hadoop.know-center.at, partition 283,NODE_LOCAL, 2152 bytes)
  1173. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 266.0 in stage 9.0 (TID 1141) in 68 ms on node12.hadoop.know-center.at (268/400)
  1174. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 284.0 in stage 9.0 (TID 1159, node06.hadoop.know-center.at, partition 284,NODE_LOCAL, 2152 bytes)
  1175. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 268.0 in stage 9.0 (TID 1143) in 66 ms on node06.hadoop.know-center.at (269/400)
  1176. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 285.0 in stage 9.0 (TID 1160, node12.hadoop.know-center.at, partition 285,NODE_LOCAL, 2152 bytes)
  1177. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 263.0 in stage 9.0 (TID 1138) in 84 ms on node12.hadoop.know-center.at (270/400)
  1178. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 286.0 in stage 9.0 (TID 1161, node06.hadoop.know-center.at, partition 286,NODE_LOCAL, 2152 bytes)
  1179. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 270.0 in stage 9.0 (TID 1145) in 68 ms on node06.hadoop.know-center.at (271/400)
  1180. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 287.0 in stage 9.0 (TID 1162, node06.hadoop.know-center.at, partition 287,NODE_LOCAL, 2152 bytes)
  1181. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 272.0 in stage 9.0 (TID 1147) in 67 ms on node06.hadoop.know-center.at (272/400)
  1182. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 288.0 in stage 9.0 (TID 1163, node12.hadoop.know-center.at, partition 288,NODE_LOCAL, 2152 bytes)
  1183. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 273.0 in stage 9.0 (TID 1148) in 62 ms on node12.hadoop.know-center.at (273/400)
  1184. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 289.0 in stage 9.0 (TID 1164, node12.hadoop.know-center.at, partition 289,NODE_LOCAL, 2152 bytes)
  1185. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 275.0 in stage 9.0 (TID 1150) in 56 ms on node12.hadoop.know-center.at (274/400)
  1186. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 290.0 in stage 9.0 (TID 1165, node12.hadoop.know-center.at, partition 290,NODE_LOCAL, 2152 bytes)
  1187. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 271.0 in stage 9.0 (TID 1146) in 79 ms on node12.hadoop.know-center.at (275/400)
  1188. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 291.0 in stage 9.0 (TID 1166, node12.hadoop.know-center.at, partition 291,NODE_LOCAL, 2152 bytes)
  1189. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 274.0 in stage 9.0 (TID 1149) in 69 ms on node12.hadoop.know-center.at (276/400)
  1190. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 292.0 in stage 9.0 (TID 1167, node06.hadoop.know-center.at, partition 292,NODE_LOCAL, 2152 bytes)
  1191. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 276.0 in stage 9.0 (TID 1151) in 66 ms on node06.hadoop.know-center.at (277/400)
  1192. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 293.0 in stage 9.0 (TID 1168, node06.hadoop.know-center.at, partition 293,NODE_LOCAL, 2152 bytes)
  1193. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 277.0 in stage 9.0 (TID 1152) in 65 ms on node06.hadoop.know-center.at (278/400)
  1194. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 294.0 in stage 9.0 (TID 1169, node12.hadoop.know-center.at, partition 294,NODE_LOCAL, 2152 bytes)
  1195. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 283.0 in stage 9.0 (TID 1158) in 59 ms on node12.hadoop.know-center.at (279/400)
  1196. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 295.0 in stage 9.0 (TID 1170, node12.hadoop.know-center.at, partition 295,NODE_LOCAL, 2152 bytes)
  1197. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 279.0 in stage 9.0 (TID 1154) in 65 ms on node12.hadoop.know-center.at (280/400)
  1198. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 296.0 in stage 9.0 (TID 1171, node06.hadoop.know-center.at, partition 296,NODE_LOCAL, 2152 bytes)
  1199. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 297.0 in stage 9.0 (TID 1172, node06.hadoop.know-center.at, partition 297,NODE_LOCAL, 2152 bytes)
  1200. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 281.0 in stage 9.0 (TID 1156) in 66 ms on node06.hadoop.know-center.at (281/400)
  1201. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 280.0 in stage 9.0 (TID 1155) in 66 ms on node06.hadoop.know-center.at (282/400)
  1202. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 298.0 in stage 9.0 (TID 1173, node12.hadoop.know-center.at, partition 298,NODE_LOCAL, 2152 bytes)
  1203. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 282.0 in stage 9.0 (TID 1157) in 66 ms on node12.hadoop.know-center.at (283/400)
  1204. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 299.0 in stage 9.0 (TID 1174, node06.hadoop.know-center.at, partition 299,NODE_LOCAL, 2152 bytes)
  1205. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 278.0 in stage 9.0 (TID 1153) in 76 ms on node06.hadoop.know-center.at (284/400)
  1206. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 300.0 in stage 9.0 (TID 1175, node06.hadoop.know-center.at, partition 300,NODE_LOCAL, 2152 bytes)
  1207. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 284.0 in stage 9.0 (TID 1159) in 67 ms on node06.hadoop.know-center.at (285/400)
  1208. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 301.0 in stage 9.0 (TID 1176, node06.hadoop.know-center.at, partition 301,NODE_LOCAL, 2152 bytes)
  1209. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 286.0 in stage 9.0 (TID 1161) in 67 ms on node06.hadoop.know-center.at (286/400)
  1210. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 302.0 in stage 9.0 (TID 1177, node12.hadoop.know-center.at, partition 302,NODE_LOCAL, 2152 bytes)
  1211. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 290.0 in stage 9.0 (TID 1165) in 57 ms on node12.hadoop.know-center.at (287/400)
  1212. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 303.0 in stage 9.0 (TID 1178, node12.hadoop.know-center.at, partition 303,NODE_LOCAL, 2152 bytes)
  1213. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 288.0 in stage 9.0 (TID 1163) in 61 ms on node12.hadoop.know-center.at (288/400)
  1214. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 304.0 in stage 9.0 (TID 1179, node06.hadoop.know-center.at, partition 304,NODE_LOCAL, 2152 bytes)
  1215. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 287.0 in stage 9.0 (TID 1162) in 69 ms on node06.hadoop.know-center.at (289/400)
  1216. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 305.0 in stage 9.0 (TID 1180, node12.hadoop.know-center.at, partition 305,NODE_LOCAL, 2152 bytes)
  1217. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 285.0 in stage 9.0 (TID 1160) in 86 ms on node12.hadoop.know-center.at (290/400)
  1218. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 306.0 in stage 9.0 (TID 1181, node12.hadoop.know-center.at, partition 306,NODE_LOCAL, 2152 bytes)
  1219. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 289.0 in stage 9.0 (TID 1164) in 78 ms on node12.hadoop.know-center.at (291/400)
  1220. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 307.0 in stage 9.0 (TID 1182, node12.hadoop.know-center.at, partition 307,NODE_LOCAL, 2152 bytes)
  1221. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 291.0 in stage 9.0 (TID 1166) in 66 ms on node12.hadoop.know-center.at (292/400)
  1222. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 308.0 in stage 9.0 (TID 1183, node06.hadoop.know-center.at, partition 308,NODE_LOCAL, 2152 bytes)
  1223. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 292.0 in stage 9.0 (TID 1167) in 66 ms on node06.hadoop.know-center.at (293/400)
  1224. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 309.0 in stage 9.0 (TID 1184, node06.hadoop.know-center.at, partition 309,NODE_LOCAL, 2152 bytes)
  1225. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 293.0 in stage 9.0 (TID 1168) in 67 ms on node06.hadoop.know-center.at (294/400)
  1226. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 310.0 in stage 9.0 (TID 1185, node12.hadoop.know-center.at, partition 310,NODE_LOCAL, 2152 bytes)
  1227. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 294.0 in stage 9.0 (TID 1169) in 59 ms on node12.hadoop.know-center.at (295/400)
  1228. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 311.0 in stage 9.0 (TID 1186, node12.hadoop.know-center.at, partition 311,NODE_LOCAL, 2152 bytes)
  1229. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 298.0 in stage 9.0 (TID 1173) in 60 ms on node12.hadoop.know-center.at (296/400)
  1230. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 312.0 in stage 9.0 (TID 1187, node06.hadoop.know-center.at, partition 312,NODE_LOCAL, 2152 bytes)
  1231. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 297.0 in stage 9.0 (TID 1172) in 66 ms on node06.hadoop.know-center.at (297/400)
  1232. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 313.0 in stage 9.0 (TID 1188, node06.hadoop.know-center.at, partition 313,NODE_LOCAL, 2152 bytes)
  1233. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 296.0 in stage 9.0 (TID 1171) in 66 ms on node06.hadoop.know-center.at (298/400)
  1234. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 314.0 in stage 9.0 (TID 1189, node12.hadoop.know-center.at, partition 314,NODE_LOCAL, 2152 bytes)
  1235. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 295.0 in stage 9.0 (TID 1170) in 71 ms on node12.hadoop.know-center.at (299/400)
  1236. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 315.0 in stage 9.0 (TID 1190, node06.hadoop.know-center.at, partition 315,NODE_LOCAL, 2152 bytes)
  1237. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 299.0 in stage 9.0 (TID 1174) in 67 ms on node06.hadoop.know-center.at (300/400)
  1238. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 316.0 in stage 9.0 (TID 1191, node06.hadoop.know-center.at, partition 316,NODE_LOCAL, 2152 bytes)
  1239. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 300.0 in stage 9.0 (TID 1175) in 67 ms on node06.hadoop.know-center.at (301/400)
  1240. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 317.0 in stage 9.0 (TID 1192, node12.hadoop.know-center.at, partition 317,NODE_LOCAL, 2152 bytes)
  1241. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 303.0 in stage 9.0 (TID 1178) in 59 ms on node12.hadoop.know-center.at (302/400)
  1242. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 318.0 in stage 9.0 (TID 1193, node12.hadoop.know-center.at, partition 318,NODE_LOCAL, 2152 bytes)
  1243. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 302.0 in stage 9.0 (TID 1177) in 64 ms on node12.hadoop.know-center.at (303/400)
  1244. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 319.0 in stage 9.0 (TID 1194, node06.hadoop.know-center.at, partition 319,NODE_LOCAL, 2152 bytes)
  1245. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 301.0 in stage 9.0 (TID 1176) in 68 ms on node06.hadoop.know-center.at (304/400)
  1246. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 320.0 in stage 9.0 (TID 1195, node06.hadoop.know-center.at, partition 320,NODE_LOCAL, 2152 bytes)
  1247. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 304.0 in stage 9.0 (TID 1179) in 68 ms on node06.hadoop.know-center.at (305/400)
  1248. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 321.0 in stage 9.0 (TID 1196, node12.hadoop.know-center.at, partition 321,NODE_LOCAL, 2152 bytes)
  1249. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 306.0 in stage 9.0 (TID 1181) in 67 ms on node12.hadoop.know-center.at (306/400)
  1250. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 322.0 in stage 9.0 (TID 1197, node06.hadoop.know-center.at, partition 322,NODE_LOCAL, 2152 bytes)
  1251. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 308.0 in stage 9.0 (TID 1183) in 66 ms on node06.hadoop.know-center.at (307/400)
  1252. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 323.0 in stage 9.0 (TID 1198, node12.hadoop.know-center.at, partition 323,NODE_LOCAL, 2152 bytes)
  1253. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 307.0 in stage 9.0 (TID 1182) in 70 ms on node12.hadoop.know-center.at (308/400)
  1254. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 324.0 in stage 9.0 (TID 1199, node06.hadoop.know-center.at, partition 324,NODE_LOCAL, 2152 bytes)
  1255. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 309.0 in stage 9.0 (TID 1184) in 68 ms on node06.hadoop.know-center.at (309/400)
  1256. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 325.0 in stage 9.0 (TID 1200, node12.hadoop.know-center.at, partition 325,NODE_LOCAL, 2152 bytes)
  1257. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 310.0 in stage 9.0 (TID 1185) in 57 ms on node12.hadoop.know-center.at (310/400)
  1258. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 326.0 in stage 9.0 (TID 1201, node12.hadoop.know-center.at, partition 326,NODE_LOCAL, 2152 bytes)
  1259. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 311.0 in stage 9.0 (TID 1186) in 61 ms on node12.hadoop.know-center.at (311/400)
  1260. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 327.0 in stage 9.0 (TID 1202, node06.hadoop.know-center.at, partition 327,NODE_LOCAL, 2152 bytes)
  1261. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 312.0 in stage 9.0 (TID 1187) in 66 ms on node06.hadoop.know-center.at (312/400)
  1262. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 328.0 in stage 9.0 (TID 1203, node06.hadoop.know-center.at, partition 328,NODE_LOCAL, 2152 bytes)
  1263. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 313.0 in stage 9.0 (TID 1188) in 66 ms on node06.hadoop.know-center.at (313/400)
  1264. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 329.0 in stage 9.0 (TID 1204, node12.hadoop.know-center.at, partition 329,NODE_LOCAL, 2152 bytes)
  1265. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 305.0 in stage 9.0 (TID 1180) in 104 ms on node12.hadoop.know-center.at (314/400)
  1266. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 330.0 in stage 9.0 (TID 1205, node12.hadoop.know-center.at, partition 330,NODE_LOCAL, 2152 bytes)
  1267. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 317.0 in stage 9.0 (TID 1192) in 57 ms on node12.hadoop.know-center.at (315/400)
  1268. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 331.0 in stage 9.0 (TID 1206, node06.hadoop.know-center.at, partition 331,NODE_LOCAL, 2152 bytes)
  1269. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 315.0 in stage 9.0 (TID 1190) in 66 ms on node06.hadoop.know-center.at (316/400)
  1270. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 332.0 in stage 9.0 (TID 1207, node06.hadoop.know-center.at, partition 332,NODE_LOCAL, 2152 bytes)
  1271. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 316.0 in stage 9.0 (TID 1191) in 65 ms on node06.hadoop.know-center.at (317/400)
  1272. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 333.0 in stage 9.0 (TID 1208, node12.hadoop.know-center.at, partition 333,NODE_LOCAL, 2152 bytes)
  1273. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 318.0 in stage 9.0 (TID 1193) in 64 ms on node12.hadoop.know-center.at (318/400)
  1274. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 334.0 in stage 9.0 (TID 1209, node06.hadoop.know-center.at, partition 334,NODE_LOCAL, 2152 bytes)
  1275. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 319.0 in stage 9.0 (TID 1194) in 67 ms on node06.hadoop.know-center.at (319/400)
  1276. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 335.0 in stage 9.0 (TID 1210, node06.hadoop.know-center.at, partition 335,NODE_LOCAL, 2152 bytes)
  1277. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 320.0 in stage 9.0 (TID 1195) in 67 ms on node06.hadoop.know-center.at (320/400)
  1278. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 336.0 in stage 9.0 (TID 1211, node12.hadoop.know-center.at, partition 336,NODE_LOCAL, 2152 bytes)
  1279. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 314.0 in stage 9.0 (TID 1189) in 90 ms on node12.hadoop.know-center.at (321/400)
  1280. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 337.0 in stage 9.0 (TID 1212, node06.hadoop.know-center.at, partition 337,NODE_LOCAL, 2152 bytes)
  1281. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 322.0 in stage 9.0 (TID 1197) in 67 ms on node06.hadoop.know-center.at (322/400)
  1282. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 338.0 in stage 9.0 (TID 1213, node12.hadoop.know-center.at, partition 338,NODE_LOCAL, 2152 bytes)
  1283. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 321.0 in stage 9.0 (TID 1196) in 68 ms on node12.hadoop.know-center.at (323/400)
  1284. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 339.0 in stage 9.0 (TID 1214, node12.hadoop.know-center.at, partition 339,NODE_LOCAL, 2152 bytes)
  1285. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 325.0 in stage 9.0 (TID 1200) in 66 ms on node12.hadoop.know-center.at (324/400)
  1286. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 340.0 in stage 9.0 (TID 1215, node12.hadoop.know-center.at, partition 340,NODE_LOCAL, 2152 bytes)
  1287. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 326.0 in stage 9.0 (TID 1201) in 63 ms on node12.hadoop.know-center.at (325/400)
  1288. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 341.0 in stage 9.0 (TID 1216, node12.hadoop.know-center.at, partition 341,NODE_LOCAL, 2152 bytes)
  1289. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 323.0 in stage 9.0 (TID 1198) in 81 ms on node12.hadoop.know-center.at (326/400)
  1290. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 342.0 in stage 9.0 (TID 1217, node06.hadoop.know-center.at, partition 342,NODE_LOCAL, 2152 bytes)
  1291. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 328.0 in stage 9.0 (TID 1203) in 67 ms on node06.hadoop.know-center.at (327/400)
  1292. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 343.0 in stage 9.0 (TID 1218, node06.hadoop.know-center.at, partition 343,NODE_LOCAL, 2152 bytes)
  1293. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 327.0 in stage 9.0 (TID 1202) in 68 ms on node06.hadoop.know-center.at (328/400)
  1294. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 344.0 in stage 9.0 (TID 1219, node12.hadoop.know-center.at, partition 344,NODE_LOCAL, 2152 bytes)
  1295. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 333.0 in stage 9.0 (TID 1208) in 57 ms on node12.hadoop.know-center.at (329/400)
  1296. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 345.0 in stage 9.0 (TID 1220, node06.hadoop.know-center.at, partition 345,NODE_LOCAL, 2152 bytes)
  1297. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 324.0 in stage 9.0 (TID 1199) in 93 ms on node06.hadoop.know-center.at (330/400)
  1298. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 346.0 in stage 9.0 (TID 1221, node12.hadoop.know-center.at, partition 346,NODE_LOCAL, 2152 bytes)
  1299. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 330.0 in stage 9.0 (TID 1205) in 69 ms on node12.hadoop.know-center.at (331/400)
  1300. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 347.0 in stage 9.0 (TID 1222, node06.hadoop.know-center.at, partition 347,NODE_LOCAL, 2152 bytes)
  1301. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 331.0 in stage 9.0 (TID 1206) in 72 ms on node06.hadoop.know-center.at (332/400)
  1302. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 348.0 in stage 9.0 (TID 1223, node06.hadoop.know-center.at, partition 348,NODE_LOCAL, 2152 bytes)
  1303. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 332.0 in stage 9.0 (TID 1207) in 68 ms on node06.hadoop.know-center.at (333/400)
  1304. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 349.0 in stage 9.0 (TID 1224, node06.hadoop.know-center.at, partition 349,NODE_LOCAL, 2152 bytes)
  1305. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 334.0 in stage 9.0 (TID 1209) in 67 ms on node06.hadoop.know-center.at (334/400)
  1306. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 350.0 in stage 9.0 (TID 1225, node12.hadoop.know-center.at, partition 350,NODE_LOCAL, 2152 bytes)
  1307. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 329.0 in stage 9.0 (TID 1204) in 83 ms on node12.hadoop.know-center.at (335/400)
  1308. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 351.0 in stage 9.0 (TID 1226, node06.hadoop.know-center.at, partition 351,NODE_LOCAL, 2152 bytes)
  1309. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 335.0 in stage 9.0 (TID 1210) in 67 ms on node06.hadoop.know-center.at (336/400)
  1310. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 352.0 in stage 9.0 (TID 1227, node12.hadoop.know-center.at, partition 352,NODE_LOCAL, 2152 bytes)
  1311. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 336.0 in stage 9.0 (TID 1211) in 66 ms on node12.hadoop.know-center.at (337/400)
  1312. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 353.0 in stage 9.0 (TID 1228, node12.hadoop.know-center.at, partition 353,NODE_LOCAL, 2152 bytes)
  1313. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 339.0 in stage 9.0 (TID 1214) in 58 ms on node12.hadoop.know-center.at (338/400)
  1314. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 354.0 in stage 9.0 (TID 1229, node06.hadoop.know-center.at, partition 354,NODE_LOCAL, 2152 bytes)
  1315. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 337.0 in stage 9.0 (TID 1212) in 67 ms on node06.hadoop.know-center.at (339/400)
  1316. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 355.0 in stage 9.0 (TID 1230, node12.hadoop.know-center.at, partition 355,NODE_LOCAL, 2152 bytes)
  1317. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 338.0 in stage 9.0 (TID 1213) in 70 ms on node12.hadoop.know-center.at (340/400)
  1318. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 356.0 in stage 9.0 (TID 1231, node12.hadoop.know-center.at, partition 356,NODE_LOCAL, 2152 bytes)
  1319. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 340.0 in stage 9.0 (TID 1215) in 67 ms on node12.hadoop.know-center.at (341/400)
  1320. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 357.0 in stage 9.0 (TID 1232, node12.hadoop.know-center.at, partition 357,NODE_LOCAL, 2152 bytes)
  1321. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 346.0 in stage 9.0 (TID 1221) in 57 ms on node12.hadoop.know-center.at (342/400)
  1322. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 358.0 in stage 9.0 (TID 1233, node06.hadoop.know-center.at, partition 358,NODE_LOCAL, 2152 bytes)
  1323. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 345.0 in stage 9.0 (TID 1220) in 64 ms on node06.hadoop.know-center.at (343/400)
  1324. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 359.0 in stage 9.0 (TID 1234, node06.hadoop.know-center.at, partition 359,NODE_LOCAL, 2152 bytes)
  1325. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 342.0 in stage 9.0 (TID 1217) in 68 ms on node06.hadoop.know-center.at (344/400)
  1326. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 360.0 in stage 9.0 (TID 1235, node06.hadoop.know-center.at, partition 360,NODE_LOCAL, 2152 bytes)
  1327. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 347.0 in stage 9.0 (TID 1222) in 65 ms on node06.hadoop.know-center.at (345/400)
  1328. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 361.0 in stage 9.0 (TID 1236, node12.hadoop.know-center.at, partition 361,NODE_LOCAL, 2152 bytes)
  1329. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 341.0 in stage 9.0 (TID 1216) in 89 ms on node12.hadoop.know-center.at (346/400)
  1330. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 362.0 in stage 9.0 (TID 1237, node12.hadoop.know-center.at, partition 362,NODE_LOCAL, 2152 bytes)
  1331. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 344.0 in stage 9.0 (TID 1219) in 76 ms on node12.hadoop.know-center.at (347/400)
  1332. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 363.0 in stage 9.0 (TID 1238, node06.hadoop.know-center.at, partition 363,NODE_LOCAL, 2152 bytes)
  1333. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 348.0 in stage 9.0 (TID 1223) in 69 ms on node06.hadoop.know-center.at (348/400)
  1334. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 364.0 in stage 9.0 (TID 1239, node06.hadoop.know-center.at, partition 364,NODE_LOCAL, 2152 bytes)
  1335. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 343.0 in stage 9.0 (TID 1218) in 79 ms on node06.hadoop.know-center.at (349/400)
  1336. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 365.0 in stage 9.0 (TID 1240, node06.hadoop.know-center.at, partition 365,NODE_LOCAL, 2152 bytes)
  1337. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 349.0 in stage 9.0 (TID 1224) in 68 ms on node06.hadoop.know-center.at (350/400)
  1338. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 366.0 in stage 9.0 (TID 1241, node06.hadoop.know-center.at, partition 366,NODE_LOCAL, 2152 bytes)
  1339. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 351.0 in stage 9.0 (TID 1226) in 64 ms on node06.hadoop.know-center.at (351/400)
  1340. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 367.0 in stage 9.0 (TID 1242, node12.hadoop.know-center.at, partition 367,NODE_LOCAL, 2152 bytes)
  1341. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 350.0 in stage 9.0 (TID 1225) in 70 ms on node12.hadoop.know-center.at (352/400)
  1342. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 368.0 in stage 9.0 (TID 1243, node12.hadoop.know-center.at, partition 368,NODE_LOCAL, 2152 bytes)
  1343. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 353.0 in stage 9.0 (TID 1228) in 57 ms on node12.hadoop.know-center.at (353/400)
  1344. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 369.0 in stage 9.0 (TID 1244, node12.hadoop.know-center.at, partition 369,NODE_LOCAL, 2152 bytes)
  1345. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 352.0 in stage 9.0 (TID 1227) in 65 ms on node12.hadoop.know-center.at (354/400)
  1346. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 370.0 in stage 9.0 (TID 1245, node06.hadoop.know-center.at, partition 370,NODE_LOCAL, 2152 bytes)
  1347. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 354.0 in stage 9.0 (TID 1229) in 67 ms on node06.hadoop.know-center.at (355/400)
  1348. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 371.0 in stage 9.0 (TID 1246, node12.hadoop.know-center.at, partition 371,NODE_LOCAL, 2152 bytes)
  1349. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 355.0 in stage 9.0 (TID 1230) in 66 ms on node12.hadoop.know-center.at (356/400)
  1350. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 372.0 in stage 9.0 (TID 1247, node12.hadoop.know-center.at, partition 372,NODE_LOCAL, 2152 bytes)
  1351. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 357.0 in stage 9.0 (TID 1232) in 57 ms on node12.hadoop.know-center.at (357/400)
  1352. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 373.0 in stage 9.0 (TID 1248, node12.hadoop.know-center.at, partition 373,NODE_LOCAL, 2152 bytes)
  1353. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 356.0 in stage 9.0 (TID 1231) in 84 ms on node12.hadoop.know-center.at (358/400)
  1354. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 374.0 in stage 9.0 (TID 1249, node06.hadoop.know-center.at, partition 374,NODE_LOCAL, 2152 bytes)
  1355. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 358.0 in stage 9.0 (TID 1233) in 68 ms on node06.hadoop.know-center.at (359/400)
  1356. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 375.0 in stage 9.0 (TID 1250, node06.hadoop.know-center.at, partition 375,NODE_LOCAL, 2152 bytes)
  1357. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 359.0 in stage 9.0 (TID 1234) in 68 ms on node06.hadoop.know-center.at (360/400)
  1358. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 376.0 in stage 9.0 (TID 1251, node06.hadoop.know-center.at, partition 376,NODE_LOCAL, 2152 bytes)
  1359. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 360.0 in stage 9.0 (TID 1235) in 64 ms on node06.hadoop.know-center.at (361/400)
  1360. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 377.0 in stage 9.0 (TID 1252, node06.hadoop.know-center.at, partition 377,NODE_LOCAL, 2152 bytes)
  1361. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 363.0 in stage 9.0 (TID 1238) in 66 ms on node06.hadoop.know-center.at (362/400)
  1362. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 378.0 in stage 9.0 (TID 1253, node12.hadoop.know-center.at, partition 378,NODE_LOCAL, 2152 bytes)
  1363. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 369.0 in stage 9.0 (TID 1244) in 57 ms on node12.hadoop.know-center.at (363/400)
  1364. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 379.0 in stage 9.0 (TID 1254, node06.hadoop.know-center.at, partition 379,NODE_LOCAL, 2152 bytes)
  1365. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 364.0 in stage 9.0 (TID 1239) in 66 ms on node06.hadoop.know-center.at (364/400)
  1366. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 380.0 in stage 9.0 (TID 1255, node06.hadoop.know-center.at, partition 380,NODE_LOCAL, 2152 bytes)
  1367. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 366.0 in stage 9.0 (TID 1241) in 64 ms on node06.hadoop.know-center.at (365/400)
  1368. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 381.0 in stage 9.0 (TID 1256, node06.hadoop.know-center.at, partition 381,NODE_LOCAL, 2152 bytes)
  1369. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 365.0 in stage 9.0 (TID 1240) in 69 ms on node06.hadoop.know-center.at (366/400)
  1370. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 382.0 in stage 9.0 (TID 1257, node12.hadoop.know-center.at, partition 382,NODE_LOCAL, 2152 bytes)
  1371. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 367.0 in stage 9.0 (TID 1242) in 73 ms on node12.hadoop.know-center.at (367/400)
  1372. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 383.0 in stage 9.0 (TID 1258, node12.hadoop.know-center.at, partition 383,NODE_LOCAL, 2152 bytes)
  1373. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 362.0 in stage 9.0 (TID 1237) in 83 ms on node12.hadoop.know-center.at (368/400)
  1374. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 384.0 in stage 9.0 (TID 1259, node12.hadoop.know-center.at, partition 384,NODE_LOCAL, 2152 bytes)
  1375. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 361.0 in stage 9.0 (TID 1236) in 83 ms on node12.hadoop.know-center.at (369/400)
  1376. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 385.0 in stage 9.0 (TID 1260, node12.hadoop.know-center.at, partition 385,NODE_LOCAL, 2152 bytes)
  1377. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 368.0 in stage 9.0 (TID 1243) in 73 ms on node12.hadoop.know-center.at (370/400)
  1378. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 386.0 in stage 9.0 (TID 1261, node06.hadoop.know-center.at, partition 386,NODE_LOCAL, 2152 bytes)
  1379. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 370.0 in stage 9.0 (TID 1245) in 64 ms on node06.hadoop.know-center.at (371/400)
  1380. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 387.0 in stage 9.0 (TID 1262, node12.hadoop.know-center.at, partition 387,NODE_LOCAL, 2152 bytes)
  1381. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 372.0 in stage 9.0 (TID 1247) in 57 ms on node12.hadoop.know-center.at (372/400)
  1382. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 388.0 in stage 9.0 (TID 1263, node12.hadoop.know-center.at, partition 388,NODE_LOCAL, 2152 bytes)
  1383. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 371.0 in stage 9.0 (TID 1246) in 74 ms on node12.hadoop.know-center.at (373/400)
  1384. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 389.0 in stage 9.0 (TID 1264, node12.hadoop.know-center.at, partition 389,NODE_LOCAL, 2152 bytes)
  1385. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 373.0 in stage 9.0 (TID 1248) in 60 ms on node12.hadoop.know-center.at (374/400)
  1386. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 390.0 in stage 9.0 (TID 1265, node06.hadoop.know-center.at, partition 390,NODE_LOCAL, 2152 bytes)
  1387. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 375.0 in stage 9.0 (TID 1250) in 65 ms on node06.hadoop.know-center.at (375/400)
  1388. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 391.0 in stage 9.0 (TID 1266, node06.hadoop.know-center.at, partition 391,NODE_LOCAL, 2152 bytes)
  1389. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 376.0 in stage 9.0 (TID 1251) in 63 ms on node06.hadoop.know-center.at (376/400)
  1390. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 392.0 in stage 9.0 (TID 1267, node06.hadoop.know-center.at, partition 392,NODE_LOCAL, 2152 bytes)
  1391. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 374.0 in stage 9.0 (TID 1249) in 68 ms on node06.hadoop.know-center.at (377/400)
  1392. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 393.0 in stage 9.0 (TID 1268, node12.hadoop.know-center.at, partition 393,NODE_LOCAL, 2152 bytes)
  1393. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 378.0 in stage 9.0 (TID 1253) in 58 ms on node12.hadoop.know-center.at (378/400)
  1394. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 394.0 in stage 9.0 (TID 1269, node06.hadoop.know-center.at, partition 394,NODE_LOCAL, 2152 bytes)
  1395. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 377.0 in stage 9.0 (TID 1252) in 68 ms on node06.hadoop.know-center.at (379/400)
  1396. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 395.0 in stage 9.0 (TID 1270, node06.hadoop.know-center.at, partition 395,NODE_LOCAL, 2152 bytes)
  1397. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 379.0 in stage 9.0 (TID 1254) in 68 ms on node06.hadoop.know-center.at (380/400)
  1398. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 396.0 in stage 9.0 (TID 1271, node06.hadoop.know-center.at, partition 396,NODE_LOCAL, 2152 bytes)
  1399. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 380.0 in stage 9.0 (TID 1255) in 65 ms on node06.hadoop.know-center.at (381/400)
  1400. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 397.0 in stage 9.0 (TID 1272, node06.hadoop.know-center.at, partition 397,NODE_LOCAL, 2152 bytes)
  1401. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 381.0 in stage 9.0 (TID 1256) in 66 ms on node06.hadoop.know-center.at (382/400)
  1402. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 398.0 in stage 9.0 (TID 1273, node12.hadoop.know-center.at, partition 398,NODE_LOCAL, 2152 bytes)
  1403. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 384.0 in stage 9.0 (TID 1259) in 64 ms on node12.hadoop.know-center.at (383/400)
  1404. 16/04/23 20:27:52 INFO TaskSetManager: Starting task 399.0 in stage 9.0 (TID 1274, node12.hadoop.know-center.at, partition 399,NODE_LOCAL, 2152 bytes)
  1405. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 387.0 in stage 9.0 (TID 1262) in 57 ms on node12.hadoop.know-center.at (384/400)
  1406. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 386.0 in stage 9.0 (TID 1261) in 66 ms on node06.hadoop.know-center.at (385/400)
  1407. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 385.0 in stage 9.0 (TID 1260) in 71 ms on node12.hadoop.know-center.at (386/400)
  1408. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 382.0 in stage 9.0 (TID 1257) in 79 ms on node12.hadoop.know-center.at (387/400)
  1409. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 383.0 in stage 9.0 (TID 1258) in 83 ms on node12.hadoop.know-center.at (388/400)
  1410. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 388.0 in stage 9.0 (TID 1263) in 66 ms on node12.hadoop.know-center.at (389/400)
  1411. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 389.0 in stage 9.0 (TID 1264) in 58 ms on node12.hadoop.know-center.at (390/400)
  1412. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 393.0 in stage 9.0 (TID 1268) in 57 ms on node12.hadoop.know-center.at (391/400)
  1413. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 390.0 in stage 9.0 (TID 1265) in 65 ms on node06.hadoop.know-center.at (392/400)
  1414. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 391.0 in stage 9.0 (TID 1266) in 64 ms on node06.hadoop.know-center.at (393/400)
  1415. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 392.0 in stage 9.0 (TID 1267) in 66 ms on node06.hadoop.know-center.at (394/400)
  1416. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 395.0 in stage 9.0 (TID 1270) in 62 ms on node06.hadoop.know-center.at (395/400)
  1417. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 394.0 in stage 9.0 (TID 1269) in 64 ms on node06.hadoop.know-center.at (396/400)
  1418. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 396.0 in stage 9.0 (TID 1271) in 64 ms on node06.hadoop.know-center.at (397/400)
  1419. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 397.0 in stage 9.0 (TID 1272) in 64 ms on node06.hadoop.know-center.at (398/400)
  1420. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 398.0 in stage 9.0 (TID 1273) in 61 ms on node12.hadoop.know-center.at (399/400)
  1421. 16/04/23 20:27:52 INFO TaskSetManager: Finished task 399.0 in stage 9.0 (TID 1274) in 55 ms on node12.hadoop.know-center.at (400/400)
  1422. 16/04/23 20:27:52 INFO YarnClusterScheduler: Removed TaskSet 9.0, whose tasks have all completed, from pool
  1423. 16/04/23 20:27:52 INFO DAGScheduler: ShuffleMapStage 9 (repartition at Word2Vec.scala:315) finished in 2.380 s
  1424. 16/04/23 20:27:52 INFO DAGScheduler: looking for newly runnable stages
  1425. 16/04/23 20:27:52 INFO DAGScheduler: running: Set()
  1426. 16/04/23 20:27:52 INFO DAGScheduler: waiting: Set(ShuffleMapStage 10, ResultStage 11)
  1427. 16/04/23 20:27:52 INFO DAGScheduler: failed: Set()
  1428. 16/04/23 20:27:52 INFO DAGScheduler: Submitting ShuffleMapStage 10 (MapPartitionsRDD[29] at mapPartitionsWithIndex at Word2Vec.scala:329), which has no missing parents
  1429. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14 stored as values in memory (estimated size 489.4 MB, free 582.6 MB)
  1430. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece0 stored as bytes in memory (estimated size 4.0 MB, free 586.6 MB)
  1431. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece0 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.1 GB)
  1432. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece1 stored as bytes in memory (estimated size 4.0 MB, free 590.6 MB)
  1433. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece1 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.1 GB)
  1434. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece2 stored as bytes in memory (estimated size 4.0 MB, free 594.6 MB)
  1435. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece2 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.1 GB)
  1436. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece3 stored as bytes in memory (estimated size 4.0 MB, free 598.6 MB)
  1437. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece3 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.1 GB)
  1438. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece4 stored as bytes in memory (estimated size 4.0 MB, free 602.6 MB)
  1439. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece4 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.1 GB)
  1440. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece5 stored as bytes in memory (estimated size 4.0 MB, free 606.6 MB)
  1441. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece5 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.1 GB)
  1442. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece6 stored as bytes in memory (estimated size 4.0 MB, free 610.6 MB)
  1443. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece6 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.1 GB)
  1444. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece7 stored as bytes in memory (estimated size 4.0 MB, free 614.6 MB)
  1445. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece7 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.1 GB)
  1446. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece8 stored as bytes in memory (estimated size 4.0 MB, free 618.6 MB)
  1447. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece8 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.1 GB)
  1448. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece9 stored as bytes in memory (estimated size 4.0 MB, free 622.6 MB)
  1449. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece9 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.1 GB)
  1450. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece10 stored as bytes in memory (estimated size 4.0 MB, free 626.6 MB)
  1451. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece10 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.1 GB)
  1452. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece11 stored as bytes in memory (estimated size 4.0 MB, free 630.6 MB)
  1453. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece11 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.1 GB)
  1454. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece12 stored as bytes in memory (estimated size 4.0 MB, free 634.6 MB)
  1455. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece12 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.1 GB)
  1456. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece13 stored as bytes in memory (estimated size 4.0 MB, free 638.6 MB)
  1457. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece13 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1458. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece14 stored as bytes in memory (estimated size 4.0 MB, free 642.6 MB)
  1459. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece14 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1460. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece15 stored as bytes in memory (estimated size 4.0 MB, free 646.6 MB)
  1461. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece15 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1462. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece16 stored as bytes in memory (estimated size 4.0 MB, free 650.6 MB)
  1463. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece16 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1464. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece17 stored as bytes in memory (estimated size 4.0 MB, free 654.6 MB)
  1465. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece17 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1466. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece18 stored as bytes in memory (estimated size 4.0 MB, free 658.6 MB)
  1467. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece18 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1468. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece19 stored as bytes in memory (estimated size 4.0 MB, free 662.6 MB)
  1469. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece19 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1470. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece20 stored as bytes in memory (estimated size 4.0 MB, free 666.6 MB)
  1471. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece20 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1472. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece21 stored as bytes in memory (estimated size 4.0 MB, free 670.6 MB)
  1473. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece21 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1474. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece22 stored as bytes in memory (estimated size 4.0 MB, free 674.6 MB)
  1475. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece22 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1476. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece23 stored as bytes in memory (estimated size 4.0 MB, free 678.6 MB)
  1477. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece23 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1478. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece24 stored as bytes in memory (estimated size 4.0 MB, free 682.6 MB)
  1479. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece24 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1480. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece25 stored as bytes in memory (estimated size 4.0 MB, free 686.6 MB)
  1481. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece25 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1482. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece26 stored as bytes in memory (estimated size 4.0 MB, free 690.6 MB)
  1483. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece26 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1484. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece27 stored as bytes in memory (estimated size 4.0 MB, free 694.6 MB)
  1485. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece27 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1486. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece28 stored as bytes in memory (estimated size 4.0 MB, free 698.6 MB)
  1487. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece28 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1488. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece29 stored as bytes in memory (estimated size 4.0 MB, free 702.6 MB)
  1489. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece29 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1490. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece30 stored as bytes in memory (estimated size 4.0 MB, free 706.6 MB)
  1491. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece30 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1492. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece31 stored as bytes in memory (estimated size 4.0 MB, free 710.6 MB)
  1493. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece31 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1494. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece32 stored as bytes in memory (estimated size 4.0 MB, free 714.6 MB)
  1495. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece32 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1496. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece33 stored as bytes in memory (estimated size 4.0 MB, free 718.6 MB)
  1497. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece33 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1498. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece34 stored as bytes in memory (estimated size 4.0 MB, free 722.6 MB)
  1499. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece34 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1500. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece35 stored as bytes in memory (estimated size 4.0 MB, free 726.6 MB)
  1501. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece35 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1502. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece36 stored as bytes in memory (estimated size 4.0 MB, free 730.6 MB)
  1503. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece36 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1504. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece37 stored as bytes in memory (estimated size 4.0 MB, free 734.6 MB)
  1505. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece37 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1506. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece38 stored as bytes in memory (estimated size 4.0 MB, free 738.6 MB)
  1507. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece38 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 13.0 GB)
  1508. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece39 stored as bytes in memory (estimated size 4.0 MB, free 742.6 MB)
  1509. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece39 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1510. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece40 stored as bytes in memory (estimated size 4.0 MB, free 746.6 MB)
  1511. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece40 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1512. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece41 stored as bytes in memory (estimated size 4.0 MB, free 750.6 MB)
  1513. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece41 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1514. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece42 stored as bytes in memory (estimated size 4.0 MB, free 754.6 MB)
  1515. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece42 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1516. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece43 stored as bytes in memory (estimated size 4.0 MB, free 758.6 MB)
  1517. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece43 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1518. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece44 stored as bytes in memory (estimated size 4.0 MB, free 762.6 MB)
  1519. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece44 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1520. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece45 stored as bytes in memory (estimated size 4.0 MB, free 766.6 MB)
  1521. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece45 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1522. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece46 stored as bytes in memory (estimated size 4.0 MB, free 770.6 MB)
  1523. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece46 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1524. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece47 stored as bytes in memory (estimated size 4.0 MB, free 774.6 MB)
  1525. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece47 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1526. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece48 stored as bytes in memory (estimated size 4.0 MB, free 778.6 MB)
  1527. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece48 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1528. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece49 stored as bytes in memory (estimated size 4.0 MB, free 782.6 MB)
  1529. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece49 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1530. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece50 stored as bytes in memory (estimated size 4.0 MB, free 786.6 MB)
  1531. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece50 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1532. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece51 stored as bytes in memory (estimated size 4.0 MB, free 790.6 MB)
  1533. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece51 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1534. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece52 stored as bytes in memory (estimated size 4.0 MB, free 794.6 MB)
  1535. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece52 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1536. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece53 stored as bytes in memory (estimated size 4.0 MB, free 798.6 MB)
  1537. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece53 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1538. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece54 stored as bytes in memory (estimated size 4.0 MB, free 802.6 MB)
  1539. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece54 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1540. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece55 stored as bytes in memory (estimated size 4.0 MB, free 806.6 MB)
  1541. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece55 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1542. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece56 stored as bytes in memory (estimated size 4.0 MB, free 810.6 MB)
  1543. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece56 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1544. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece57 stored as bytes in memory (estimated size 4.0 MB, free 814.6 MB)
  1545. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece57 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1546. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece58 stored as bytes in memory (estimated size 4.0 MB, free 818.6 MB)
  1547. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece58 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1548. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece59 stored as bytes in memory (estimated size 4.0 MB, free 822.6 MB)
  1549. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece59 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1550. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece60 stored as bytes in memory (estimated size 4.0 MB, free 826.6 MB)
  1551. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece60 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1552. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece61 stored as bytes in memory (estimated size 4.0 MB, free 830.6 MB)
  1553. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece61 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1554. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece62 stored as bytes in memory (estimated size 4.0 MB, free 834.6 MB)
  1555. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece62 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1556. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece63 stored as bytes in memory (estimated size 4.0 MB, free 838.6 MB)
  1557. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece63 in memory on 192.168.0.111:33952 (size: 4.0 MB, free: 12.9 GB)
  1558. 16/04/23 20:27:54 INFO MemoryStore: Block broadcast_14_piece64 stored as bytes in memory (estimated size 325.3 KB, free 838.9 MB)
  1559. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece64 in memory on 192.168.0.111:33952 (size: 325.3 KB, free: 12.9 GB)
  1560. 16/04/23 20:27:54 INFO SparkContext: Created broadcast 14 from broadcast at DAGScheduler.scala:1006
  1561. 16/04/23 20:27:54 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 10 (MapPartitionsRDD[29] at mapPartitionsWithIndex at Word2Vec.scala:329)
  1562. 16/04/23 20:27:54 INFO YarnClusterScheduler: Adding task set 10.0 with 1 tasks
  1563. 16/04/23 20:27:54 INFO TaskSetManager: Starting task 0.0 in stage 10.0 (TID 1275, node06.hadoop.know-center.at, partition 0,NODE_LOCAL, 2152 bytes)
  1564. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece41 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1565. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece57 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1566. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece25 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1567. 16/04/23 20:27:54 INFO BlockManagerInfo: Added broadcast_14_piece50 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1568. 16/04/23 20:27:55 INFO BlockManagerInfo: Added broadcast_14_piece4 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1569. 16/04/23 20:27:55 INFO BlockManagerInfo: Added broadcast_14_piece19 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1570. 16/04/23 20:27:55 INFO BlockManagerInfo: Added broadcast_14_piece48 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1571. 16/04/23 20:27:55 INFO BlockManagerInfo: Added broadcast_14_piece47 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1572. 16/04/23 20:27:55 INFO BlockManagerInfo: Added broadcast_14_piece56 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1573. 16/04/23 20:27:55 INFO BlockManagerInfo: Added broadcast_14_piece31 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1574. 16/04/23 20:27:55 INFO BlockManagerInfo: Added broadcast_14_piece61 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1575. 16/04/23 20:27:55 INFO BlockManagerInfo: Added broadcast_14_piece55 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1576. 16/04/23 20:27:55 INFO BlockManagerInfo: Added broadcast_14_piece43 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1577. 16/04/23 20:27:55 INFO BlockManagerInfo: Added broadcast_14_piece12 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1578. 16/04/23 20:27:55 INFO BlockManagerInfo: Added broadcast_14_piece9 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1579. 16/04/23 20:27:55 INFO BlockManagerInfo: Added broadcast_14_piece62 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1580. 16/04/23 20:27:55 INFO BlockManagerInfo: Added broadcast_14_piece44 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1581. 16/04/23 20:27:55 INFO BlockManagerInfo: Added broadcast_14_piece33 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1582. 16/04/23 20:27:55 INFO BlockManagerInfo: Added broadcast_14_piece10 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1583. 16/04/23 20:27:55 INFO BlockManagerInfo: Added broadcast_14_piece58 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1584. 16/04/23 20:27:55 INFO BlockManagerInfo: Added broadcast_14_piece6 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1585. 16/04/23 20:27:55 INFO BlockManagerInfo: Added broadcast_14_piece17 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1586. 16/04/23 20:27:56 INFO BlockManagerInfo: Added broadcast_14_piece24 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1587. 16/04/23 20:27:56 INFO BlockManagerInfo: Added broadcast_14_piece20 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1588. 16/04/23 20:27:56 INFO BlockManagerInfo: Added broadcast_14_piece22 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1589. 16/04/23 20:27:56 INFO BlockManagerInfo: Added broadcast_14_piece30 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.1 GB)
  1590. 16/04/23 20:27:56 INFO BlockManagerInfo: Added broadcast_14_piece16 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1591. 16/04/23 20:27:56 INFO BlockManagerInfo: Added broadcast_14_piece37 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1592. 16/04/23 20:27:56 INFO BlockManagerInfo: Added broadcast_14_piece21 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1593. 16/04/23 20:27:56 INFO BlockManagerInfo: Added broadcast_14_piece49 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1594. 16/04/23 20:27:56 INFO BlockManagerInfo: Added broadcast_14_piece8 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1595. 16/04/23 20:27:56 INFO BlockManagerInfo: Added broadcast_14_piece23 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1596. 16/04/23 20:27:56 INFO BlockManagerInfo: Added broadcast_14_piece36 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1597. 16/04/23 20:27:56 INFO BlockManagerInfo: Added broadcast_14_piece51 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1598. 16/04/23 20:27:56 INFO BlockManagerInfo: Added broadcast_14_piece26 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1599. 16/04/23 20:27:56 INFO BlockManagerInfo: Added broadcast_14_piece28 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1600. 16/04/23 20:27:56 INFO BlockManagerInfo: Added broadcast_14_piece13 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1601. 16/04/23 20:27:56 INFO BlockManagerInfo: Added broadcast_14_piece45 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1602. 16/04/23 20:27:56 INFO BlockManagerInfo: Added broadcast_14_piece29 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1603. 16/04/23 20:27:57 INFO BlockManagerInfo: Added broadcast_14_piece3 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1604. 16/04/23 20:27:57 INFO BlockManagerInfo: Added broadcast_14_piece7 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1605. 16/04/23 20:27:57 INFO BlockManagerInfo: Added broadcast_14_piece38 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1606. 16/04/23 20:27:57 INFO BlockManagerInfo: Added broadcast_14_piece34 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1607. 16/04/23 20:27:57 INFO BlockManagerInfo: Added broadcast_14_piece46 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1608. 16/04/23 20:27:57 INFO BlockManagerInfo: Added broadcast_14_piece32 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1609. 16/04/23 20:27:57 INFO BlockManagerInfo: Added broadcast_14_piece42 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1610. 16/04/23 20:27:57 INFO BlockManagerInfo: Added broadcast_14_piece1 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1611. 16/04/23 20:27:57 INFO BlockManagerInfo: Added broadcast_14_piece2 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1612. 16/04/23 20:27:57 INFO BlockManagerInfo: Added broadcast_14_piece40 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1613. 16/04/23 20:27:57 INFO BlockManagerInfo: Added broadcast_14_piece27 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1614. 16/04/23 20:27:57 INFO BlockManagerInfo: Added broadcast_14_piece14 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1615. 16/04/23 20:27:57 INFO BlockManagerInfo: Added broadcast_14_piece5 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 14.0 GB)
  1616. 16/04/23 20:27:57 INFO BlockManagerInfo: Added broadcast_14_piece52 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 13.9 GB)
  1617. 16/04/23 20:27:57 INFO BlockManagerInfo: Added broadcast_14_piece53 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 13.9 GB)
  1618. 16/04/23 20:27:57 INFO BlockManagerInfo: Added broadcast_14_piece54 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 13.9 GB)
  1619. 16/04/23 20:27:57 INFO BlockManagerInfo: Added broadcast_14_piece0 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 13.9 GB)
  1620. 16/04/23 20:27:57 INFO BlockManagerInfo: Added broadcast_14_piece39 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 13.9 GB)
  1621. 16/04/23 20:27:58 INFO BlockManagerInfo: Added broadcast_14_piece59 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 13.9 GB)
  1622. 16/04/23 20:27:58 INFO BlockManagerInfo: Added broadcast_14_piece15 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 13.9 GB)
  1623. 16/04/23 20:27:58 INFO BlockManagerInfo: Added broadcast_14_piece60 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 13.9 GB)
  1624. 16/04/23 20:27:58 INFO BlockManagerInfo: Added broadcast_14_piece63 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 13.9 GB)
  1625. 16/04/23 20:27:58 INFO BlockManagerInfo: Added broadcast_14_piece64 in memory on node06.hadoop.know-center.at:38706 (size: 325.3 KB, free: 13.9 GB)
  1626. 16/04/23 20:27:58 INFO BlockManagerInfo: Added broadcast_14_piece35 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 13.9 GB)
  1627. 16/04/23 20:27:58 INFO BlockManagerInfo: Added broadcast_14_piece18 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 13.9 GB)
  1628. 16/04/23 20:27:58 INFO BlockManagerInfo: Added broadcast_14_piece11 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 13.9 GB)
  1629. 16/04/23 20:27:59 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 4 to node06.hadoop.know-center.at:42120
  1630. 16/04/23 20:27:59 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 4 is 455 bytes
  1631. 16/04/23 20:28:00 INFO BlockManagerInfo: Added rdd_28_0 in memory on node06.hadoop.know-center.at:38706 (size: 101.7 MB, free: 13.8 GB)
  1632. 16/04/23 20:28:00 INFO BlockManagerInfo: Added broadcast_11_piece1 in memory on node06.hadoop.know-center.at:38706 (size: 2.9 MB, free: 13.8 GB)
  1633. 16/04/23 20:28:00 INFO BlockManagerInfo: Added broadcast_11_piece0 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 MB, free: 13.8 GB)
  1634. 16/04/23 20:28:00 INFO BlockManagerInfo: Added broadcast_10_piece0 in memory on node06.hadoop.know-center.at:38706 (size: 4.0 KB, free: 13.8 GB)
  1635. 16/04/23 20:57:02 INFO BlockManagerInfo: Removed broadcast_13_piece0 on 192.168.0.111:33952 in memory (size: 2.7 KB, free: 12.9 GB)
  1636. 16/04/23 20:57:02 INFO BlockManagerInfo: Removed broadcast_13_piece0 on node06.hadoop.know-center.at:38706 in memory (size: 2.7 KB, free: 13.8 GB)
  1637. 16/04/23 20:57:02 INFO BlockManagerInfo: Removed broadcast_13_piece0 on node12.hadoop.know-center.at:53119 in memory (size: 2.7 KB, free: 14.2 GB)
  1638. 16/04/23 21:02:17 INFO TaskSetManager: Finished task 0.0 in stage 10.0 (TID 1275) in 2062748 ms on node06.hadoop.know-center.at (1/1)
  1639. 16/04/23 21:02:17 INFO YarnClusterScheduler: Removed TaskSet 10.0, whose tasks have all completed, from pool
  1640. 16/04/23 21:02:17 INFO DAGScheduler: ShuffleMapStage 10 (mapPartitionsWithIndex at Word2Vec.scala:329) finished in 2062.749 s
  1641. 16/04/23 21:02:17 INFO DAGScheduler: looking for newly runnable stages
  1642. 16/04/23 21:02:17 INFO DAGScheduler: running: Set()
  1643. 16/04/23 21:02:17 INFO DAGScheduler: waiting: Set(ResultStage 11)
  1644. 16/04/23 21:02:17 INFO DAGScheduler: failed: Set()
  1645. 16/04/23 21:02:17 INFO DAGScheduler: Submitting ResultStage 11 (ShuffledRDD[30] at reduceByKey at Word2Vec.scala:403), which has no missing parents
  1646. 16/04/23 21:02:17 INFO MemoryStore: Block broadcast_15 stored as values in memory (estimated size 3.7 KB, free 838.9 MB)
  1647. 16/04/23 21:02:17 INFO MemoryStore: Block broadcast_15_piece0 stored as bytes in memory (estimated size 2.0 KB, free 838.9 MB)
  1648. 16/04/23 21:02:17 INFO BlockManagerInfo: Added broadcast_15_piece0 in memory on 192.168.0.111:33952 (size: 2.0 KB, free: 12.9 GB)
  1649. 16/04/23 21:02:17 INFO SparkContext: Created broadcast 15 from broadcast at DAGScheduler.scala:1006
  1650. 16/04/23 21:02:17 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 11 (ShuffledRDD[30] at reduceByKey at Word2Vec.scala:403)
  1651. 16/04/23 21:02:17 INFO YarnClusterScheduler: Adding task set 11.0 with 1 tasks
  1652. 16/04/23 21:02:17 INFO TaskSetManager: Starting task 0.0 in stage 11.0 (TID 1276, node06.hadoop.know-center.at, partition 0,NODE_LOCAL, 1894 bytes)
  1653. 16/04/23 21:02:17 INFO BlockManagerInfo: Added broadcast_15_piece0 in memory on node06.hadoop.know-center.at:38706 (size: 2.0 KB, free: 13.8 GB)
  1654. 16/04/23 21:02:17 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 5 to node06.hadoop.know-center.at:42120
  1655. 16/04/23 21:02:17 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 5 is 156 bytes
  1656. 16/04/23 21:05:00 WARN HeartbeatReceiver: Removing executor 3 with no recent heartbeats: 163365 ms exceeds timeout 120000 ms
  1657. 16/04/23 21:05:00 ERROR YarnClusterScheduler: Lost executor 3 on node06.hadoop.know-center.at: Executor heartbeat timed out after 163365 ms
  1658. 16/04/23 21:05:00 WARN TaskSetManager: Lost task 0.0 in stage 11.0 (TID 1276, node06.hadoop.know-center.at): ExecutorLostFailure (executor 3 exited caused by one of the running tasks) Reason: Executor heartbeat timed out after 163365 ms
  1659. 16/04/23 21:05:00 INFO DAGScheduler: Executor lost: 3 (epoch 6)
  1660. 16/04/23 21:05:00 INFO TaskSetManager: Starting task 0.1 in stage 11.0 (TID 1277, node06.hadoop.know-center.at, partition 0,NODE_LOCAL, 1894 bytes)
  1661. 16/04/23 21:05:00 INFO BlockManagerMasterEndpoint: Trying to remove executor 3 from BlockManagerMaster.
  1662. 16/04/23 21:05:00 INFO BlockManagerMasterEndpoint: Removing block manager BlockManagerId(3, node06.hadoop.know-center.at, 38706)
  1663. 16/04/23 21:05:00 INFO YarnClusterSchedulerBackend: Requesting to kill executor(s) 3
  1664. 16/04/23 21:05:00 INFO BlockManagerMaster: Removed 3 successfully in removeExecutor
  1665. 16/04/23 21:05:00 INFO ShuffleMapStage: ShuffleMapStage 8 is now unavailable on executor 3 (11/15, false)
  1666. 16/04/23 21:05:00 INFO ShuffleMapStage: ShuffleMapStage 10 is now unavailable on executor 3 (0/1, false)
  1667. 16/04/23 21:05:00 INFO ShuffleMapStage: ShuffleMapStage 9 is now unavailable on executor 3 (203/400, false)
  1668. 16/04/23 21:05:00 INFO DAGScheduler: Host added was in lost list earlier: node06.hadoop.know-center.at
  1669. 16/04/23 21:05:00 INFO ApplicationMaster$AMEndpoint: Driver requested to kill executor(s) 3.
  1670. 16/04/23 21:05:03 INFO YarnAllocator: Will request 1 executor containers, each with 8 cores and 20864 MB memory including 384 MB overhead
  1671. 16/04/23 21:05:03 INFO YarnAllocator: Container request (host: Any, capability: <memory:20864, vCores:8>)
  1672. 16/04/23 21:05:03 INFO AMRMClientImpl: Received new token for : node03.hadoop.know-center.at:45454
  1673. 16/04/23 21:05:03 INFO YarnAllocator: Launching container container_e05_1459928874908_0230_02_000011 for on host node03.hadoop.know-center.at
  1674. 16/04/23 21:05:03 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: spark://CoarseGrainedScheduler@192.168.0.111:59844, executorHostname: node03.hadoop.know-center.at
  1675. 16/04/23 21:05:03 INFO YarnAllocator: Received 1 containers from YARN, launching executors on 1 of them.
  1676. 16/04/23 21:05:03 INFO ExecutorRunnable: Starting Executor Container
  1677. 16/04/23 21:05:03 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0
  1678. 16/04/23 21:05:03 INFO ExecutorRunnable: Setting up ContainerLaunchContext
  1679. 16/04/23 21:05:03 INFO ExecutorRunnable: Preparing Local resources
  1680. 16/04/23 21:05:03 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "master01.hadoop.know-center.at" port: 8020 file: "/user/sfalk/.sparkStaging/application_1459928874908_0230/wordvectors-final.jar" } size: 1279239848 timestamp: 1461433144865 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "master01.hadoop.know-center.at" port: 8020 file: "/hdp/apps/2.4.0.0-169/spark/spark-hdp-assembly.jar" } size: 191724642 timestamp: 1456930414488 type: FILE visibility: PUBLIC)
  1681. 16/04/23 21:05:03 INFO Client: Using the spark assembly jar on HDFS because you are using HDP, defaultSparkAssembly:hdfs://master01.hadoop.know-center.at:8020/hdp/apps/2.4.0.0-169/spark/spark-hdp-assembly.jar
  1682. 16/04/23 21:05:03 INFO ExecutorRunnable:
  1683. ===============================================================================
  1684. YARN executor launch context:
  1685. env:
  1686. CLASSPATH -> {{PWD}}<CPS>{{PWD}}/__spark__.jar<CPS>$HADOOP_CONF_DIR<CPS>/usr/hdp/current/hadoop-client/*<CPS>/usr/hdp/current/hadoop-client/lib/*<CPS>/usr/hdp/current/hadoop-hdfs-client/*<CPS>/usr/hdp/current/hadoop-hdfs-client/lib/*<CPS>/usr/hdp/current/hadoop-yarn-client/*<CPS>/usr/hdp/current/hadoop-yarn-client/lib/*<CPS>$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:$PWD/mr-framework/hadoop/share/hadoop/tools/lib/*:/usr/hdp/2.4.0.0-169/hadoop/lib/hadoop-lzo-0.6.0.2.4.0.0-169.jar:/etc/hadoop/conf/secure
  1687. SPARK_LOG_URL_STDERR -> http://node03.hadoop.know-center.at:8042/node/containerlogs/container_e05_1459928874908_0230_02_000011/sfalk/stderr?start=-4096
  1688. SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1459928874908_0230
  1689. SPARK_YARN_CACHE_FILES_FILE_SIZES -> 191724642,1279239848
  1690. SPARK_USER -> sfalk
  1691. SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE
  1692. SPARK_YARN_MODE -> true
  1693. SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1456930414488,1461433144865
  1694. SPARK_LOG_URL_STDOUT -> http://node03.hadoop.know-center.at:8042/node/containerlogs/container_e05_1459928874908_0230_02_000011/sfalk/stdout?start=-4096
  1695. SPARK_YARN_CACHE_FILES -> hdfs://master01.hadoop.know-center.at:8020/hdp/apps/2.4.0.0-169/spark/spark-hdp-assembly.jar#__spark__.jar,hdfs://master01.hadoop.know-center.at:8020/user/sfalk/.sparkStaging/application_1459928874908_0230/wordvectors-final.jar#__app__.jar
  1696.  
  1697. command:
  1698. {{JAVA_HOME}}/bin/java -server -XX:OnOutOfMemoryError='kill %p' -Xms20480m -Xmx20480m -Djava.io.tmpdir={{PWD}}/tmp '-Dspark.driver.port=59844' '-Dspark.akka.frameSize=2000' '-Dspark.history.ui.port=18080' '-Dspark.ui.port=0' -Dspark.yarn.app.container.log.dir=<LOG_DIR> org.apache.spark.executor.CoarseGrainedExecutorBackend --driver-url spark://CoarseGrainedScheduler@192.168.0.111:59844 --executor-id 6 --hostname node03.hadoop.know-center.at --cores 8 --app-id application_1459928874908_0230 --user-class-path file:$PWD/__app__.jar 1> <LOG_DIR>/stdout 2> <LOG_DIR>/stderr
  1699. ===============================================================================
  1700.  
  1701. 16/04/23 21:05:03 INFO ContainerManagementProtocolProxy: Opening proxy : node03.hadoop.know-center.at:45454
  1702. 16/04/23 21:05:06 INFO YarnClusterSchedulerBackend: Registered executor NettyRpcEndpointRef(null) (node03.hadoop.know-center.at:38711) with ID 6
  1703. 16/04/23 21:05:06 INFO BlockManagerMasterEndpoint: Registering block manager node03.hadoop.know-center.at:54818 with 14.2 GB RAM, BlockManagerId(6, node03.hadoop.know-center.at, 54818)
  1704. 16/04/23 21:05:47 INFO YarnClusterSchedulerBackend: Disabling executor 3.
  1705. 16/04/23 21:05:47 ERROR TransportRequestHandler: Error sending result RpcResponse{requestId=5193600399768642103, body=NioManagedBuffer{buf=java.nio.HeapByteBuffer[pos=0 lim=81 cap=81]}} to node06.hadoop.know-center.at/192.168.0.106:42120; closing connection
  1706. java.nio.channels.ClosedChannelException
  1707. 16/04/23 21:05:47 INFO DAGScheduler: Executor lost: 3 (epoch 9)
  1708. 16/04/23 21:05:47 INFO BlockManagerMasterEndpoint: Trying to remove executor 3 from BlockManagerMaster.
  1709. 16/04/23 21:05:47 INFO BlockManagerMaster: Removed 3 successfully in removeExecutor
  1710. 16/04/23 21:05:47 ERROR TransportRequestHandler: Error sending result RpcResponse{requestId=8824134077700656577, body=NioManagedBuffer{buf=java.nio.HeapByteBuffer[pos=0 lim=81 cap=81]}} to node06.hadoop.know-center.at/192.168.0.106:42120; closing connection
  1711. java.nio.channels.ClosedChannelException
  1712. 16/04/23 21:05:47 ERROR YarnClusterScheduler: Lost executor 3 on node06.hadoop.know-center.at: Container container_e05_1459928874908_0230_02_000004 exited from explicit termination request.
  1713. 16/04/23 21:05:47 INFO TaskSetManager: Task 1277 failed because while it was being computed, its executorexited for a reason unrelated to the task. Not counting this failure towards the maximum number of failures for the task.
  1714. 16/04/23 21:05:47 INFO TaskSetManager: Starting task 0.2 in stage 11.0 (TID 1278, node03.hadoop.know-center.at, partition 0,RACK_LOCAL, 1894 bytes)
  1715. 16/04/23 21:05:48 INFO BlockManagerInfo: Added broadcast_15_piece0 in memory on node03.hadoop.know-center.at:54818 (size: 2.0 KB, free: 14.2 GB)
  1716. 16/04/23 21:05:48 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 5 to node03.hadoop.know-center.at:38711
  1717. 16/04/23 21:05:48 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 5 is 84 bytes
  1718. 16/04/23 21:05:48 WARN TaskSetManager: Lost task 0.2 in stage 11.0 (TID 1278, node03.hadoop.know-center.at): FetchFailed(null, shuffleId=5, mapId=-1, reduceId=0, message=
  1719. org.apache.spark.shuffle.MetadataFetchFailedException: Missing an output location for shuffle 5
  1720. at org.apache.spark.MapOutputTracker$$anonfun$org$apache$spark$MapOutputTracker$$convertMapStatuses$2.apply(MapOutputTracker.scala:542)
  1721. at org.apache.spark.MapOutputTracker$$anonfun$org$apache$spark$MapOutputTracker$$convertMapStatuses$2.apply(MapOutputTracker.scala:538)
  1722. at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:772)
  1723. at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
  1724. at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:108)
  1725. at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:771)
  1726. at org.apache.spark.MapOutputTracker$.org$apache$spark$MapOutputTracker$$convertMapStatuses(MapOutputTracker.scala:538)
  1727. at org.apache.spark.MapOutputTracker.getMapSizesByExecutorId(MapOutputTracker.scala:155)
  1728. at org.apache.spark.shuffle.BlockStoreShuffleReader.read(BlockStoreShuffleReader.scala:47)
  1729. at org.apache.spark.rdd.ShuffledRDD.compute(ShuffledRDD.scala:98)
  1730. at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
  1731. at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
  1732. at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66)
  1733. at org.apache.spark.scheduler.Task.run(Task.scala:89)
  1734. at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:213)
  1735. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  1736. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  1737. at java.lang.Thread.run(Thread.java:745)
  1738.  
  1739. )
  1740. 16/04/23 21:05:48 INFO YarnClusterScheduler: Removed TaskSet 11.0, whose tasks have all completed, from pool
  1741. 16/04/23 21:05:48 INFO DAGScheduler: Marking ResultStage 11 (collect at Word2Vec.scala:406) as failed due to a fetch failure from ShuffleMapStage 10 (mapPartitionsWithIndex at Word2Vec.scala:329)
  1742. 16/04/23 21:05:48 INFO DAGScheduler: ResultStage 11 (collect at Word2Vec.scala:406) failed in 210.909 s
  1743. 16/04/23 21:05:48 INFO DAGScheduler: Resubmitting ShuffleMapStage 10 (mapPartitionsWithIndex at Word2Vec.scala:329) and ResultStage 11 (collect at Word2Vec.scala:406) due to fetch failure
  1744. 16/04/23 21:05:48 INFO TaskSetManager: Ignoring task-finished event for 0.0 in stage 11.0 because task 0 has already completed successfully
  1745. 16/04/23 21:05:48 INFO YarnClusterScheduler: Removed TaskSet 11.0, whose tasks have all completed, from pool
  1746. 16/04/23 21:05:48 INFO DAGScheduler: ResultStage 11 (collect at Word2Vec.scala:406) finished in 211.034 s
  1747. 16/04/23 21:05:48 INFO DAGScheduler: Job 3 finished: collect at Word2Vec.scala:406, took 2278.084031 s
  1748. 16/04/23 21:05:48 INFO MapPartitionsRDD: Removing RDD 28 from persistence list
  1749. 16/04/23 21:05:48 INFO BlockManager: Removing RDD 28
  1750. 16/04/23 21:05:49 WARN BLAS: Failed to load implementation from: com.github.fommil.netlib.NativeSystemBLAS
  1751. 16/04/23 21:05:49 WARN BLAS: Failed to load implementation from: com.github.fommil.netlib.NativeRefBLAS
  1752. 16/04/23 21:05:49 INFO deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id
  1753. 16/04/23 21:05:49 INFO deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id
  1754. 16/04/23 21:05:49 INFO deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap
  1755. 16/04/23 21:05:49 INFO deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition
  1756. 16/04/23 21:05:49 INFO deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id
  1757. 16/04/23 21:05:49 INFO FileOutputCommitter: File Output Committer Algorithm version is 1
  1758. 16/04/23 21:05:49 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false
  1759. 16/04/23 21:05:49 INFO SparkContext: Starting job: saveAsTextFile at Word2VecOnCluster.scala:199
  1760. 16/04/23 21:05:49 INFO DAGScheduler: Got job 4 (saveAsTextFile at Word2VecOnCluster.scala:199) with 1 output partitions
  1761. 16/04/23 21:05:49 INFO DAGScheduler: Final stage: ResultStage 12 (saveAsTextFile at Word2VecOnCluster.scala:199)
  1762. 16/04/23 21:05:49 INFO DAGScheduler: Parents of final stage: List()
  1763. 16/04/23 21:05:49 INFO DAGScheduler: Missing parents: List()
  1764. 16/04/23 21:05:49 INFO DAGScheduler: Submitting ResultStage 12 (MapPartitionsRDD[32] at saveAsTextFile at Word2VecOnCluster.scala:199), which has no missing parents
  1765. 16/04/23 21:05:49 INFO MemoryStore: Block broadcast_16 stored as values in memory (estimated size 82.8 KB, free 839.0 MB)
  1766. 16/04/23 21:05:49 INFO MemoryStore: Block broadcast_16_piece0 stored as bytes in memory (estimated size 29.7 KB, free 839.0 MB)
  1767. 16/04/23 21:05:49 INFO BlockManagerInfo: Added broadcast_16_piece0 in memory on 192.168.0.111:33952 (size: 29.7 KB, free: 12.9 GB)
  1768. 16/04/23 21:05:49 INFO SparkContext: Created broadcast 16 from broadcast at DAGScheduler.scala:1006
  1769. 16/04/23 21:05:49 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 12 (MapPartitionsRDD[32] at saveAsTextFile at Word2VecOnCluster.scala:199)
  1770. 16/04/23 21:05:49 INFO YarnClusterScheduler: Adding task set 12.0 with 1 tasks
  1771. 16/04/23 21:05:49 INFO TaskSetManager: Starting task 0.0 in stage 12.0 (TID 1279, node02.hadoop.know-center.at, partition 0,PROCESS_LOCAL, 2362 bytes)
  1772. 16/04/23 21:05:49 INFO BlockManagerInfo: Added broadcast_16_piece0 in memory on node02.hadoop.know-center.at:43877 (size: 29.7 KB, free: 14.2 GB)
  1773. 16/04/23 21:05:50 INFO TaskSetManager: Finished task 0.0 in stage 12.0 (TID 1279) in 326 ms on node02.hadoop.know-center.at (1/1)
  1774. 16/04/23 21:05:50 INFO DAGScheduler: ResultStage 12 (saveAsTextFile at Word2VecOnCluster.scala:199) finished in 0.327 s
  1775. 16/04/23 21:05:50 INFO YarnClusterScheduler: Removed TaskSet 12.0, whose tasks have all completed, from pool
  1776. 16/04/23 21:05:50 INFO DAGScheduler: Job 4 finished: saveAsTextFile at Word2VecOnCluster.scala:199, took 0.348150 s
  1777. 16/04/23 21:05:50 INFO BlockManagerInfo: Removed broadcast_16_piece0 on 192.168.0.111:33952 in memory (size: 29.7 KB, free: 12.9 GB)
  1778. 16/04/23 21:05:50 INFO BlockManagerInfo: Removed broadcast_16_piece0 on node02.hadoop.know-center.at:43877 in memory (size: 29.7 KB, free: 14.2 GB)
  1779. 16/04/23 21:05:50 INFO ContextCleaner: Cleaned accumulator 11
  1780. 16/04/23 21:05:52 INFO SparkContext: Starting job: collect at Word2VecOnCluster.scala:264
  1781. 16/04/23 21:05:52 INFO DAGScheduler: Registering RDD 35 (repartition at Word2VecOnCluster.scala:262)
  1782. 16/04/23 21:05:52 INFO DAGScheduler: Got job 5 (collect at Word2VecOnCluster.scala:264) with 1 output partitions
  1783. 16/04/23 21:05:52 INFO DAGScheduler: Final stage: ResultStage 14 (collect at Word2VecOnCluster.scala:264)
  1784. 16/04/23 21:05:52 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 13)
  1785. 16/04/23 21:05:52 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 13)
  1786. 16/04/23 21:05:52 INFO DAGScheduler: Submitting ShuffleMapStage 13 (MapPartitionsRDD[35] at repartition at Word2VecOnCluster.scala:262), which has no missing parents
  1787. 16/04/23 21:05:52 INFO MemoryStore: Block broadcast_17 stored as values in memory (estimated size 2.9 KB, free 838.9 MB)
  1788. 16/04/23 21:05:52 INFO MemoryStore: Block broadcast_17_piece0 stored as bytes in memory (estimated size 1786.0 B, free 838.9 MB)
  1789. 16/04/23 21:05:52 INFO BlockManagerInfo: Added broadcast_17_piece0 in memory on 192.168.0.111:33952 (size: 1786.0 B, free: 12.9 GB)
  1790. 16/04/23 21:05:52 INFO SparkContext: Created broadcast 17 from broadcast at DAGScheduler.scala:1006
  1791. 16/04/23 21:05:52 INFO DAGScheduler: Submitting 10 missing tasks from ShuffleMapStage 13 (MapPartitionsRDD[35] at repartition at Word2VecOnCluster.scala:262)
  1792. 16/04/23 21:05:52 INFO YarnClusterScheduler: Adding task set 13.0 with 10 tasks
  1793. 16/04/23 21:05:52 WARN TaskSetManager: Stage 13 contains a task of very large size (25493 KB). The maximum recommended task size is 100 KB.
  1794. 16/04/23 21:05:52 INFO TaskSetManager: Starting task 0.0 in stage 13.0 (TID 1280, node03.hadoop.know-center.at, partition 0,PROCESS_LOCAL, 26105665 bytes)
  1795. 16/04/23 21:05:52 INFO TaskSetManager: Starting task 1.0 in stage 13.0 (TID 1281, node02.hadoop.know-center.at, partition 1,PROCESS_LOCAL, 26105840 bytes)
  1796. 16/04/23 21:05:52 INFO TaskSetManager: Starting task 2.0 in stage 13.0 (TID 1282, node11.hadoop.know-center.at, partition 2,PROCESS_LOCAL, 26108359 bytes)
  1797. 16/04/23 21:05:52 INFO TaskSetManager: Starting task 3.0 in stage 13.0 (TID 1283, node12.hadoop.know-center.at, partition 3,PROCESS_LOCAL, 26107866 bytes)
  1798. 16/04/23 21:05:52 INFO TaskSetManager: Starting task 4.0 in stage 13.0 (TID 1284, node10.hadoop.know-center.at, partition 4,PROCESS_LOCAL, 26106158 bytes)
  1799. 16/04/23 21:05:52 INFO TaskSetManager: Starting task 5.0 in stage 13.0 (TID 1285, node03.hadoop.know-center.at, partition 5,PROCESS_LOCAL, 26107698 bytes)
  1800. 16/04/23 21:05:52 INFO TaskSetManager: Starting task 6.0 in stage 13.0 (TID 1286, node02.hadoop.know-center.at, partition 6,PROCESS_LOCAL, 26108050 bytes)
  1801. 16/04/23 21:05:53 INFO TaskSetManager: Starting task 7.0 in stage 13.0 (TID 1287, node11.hadoop.know-center.at, partition 7,PROCESS_LOCAL, 26108335 bytes)
  1802. 16/04/23 21:05:53 INFO TaskSetManager: Starting task 8.0 in stage 13.0 (TID 1288, node12.hadoop.know-center.at, partition 8,PROCESS_LOCAL, 26107124 bytes)
  1803. 16/04/23 21:05:53 INFO TaskSetManager: Starting task 9.0 in stage 13.0 (TID 1289, node10.hadoop.know-center.at, partition 9,PROCESS_LOCAL, 26106786 bytes)
  1804. 16/04/23 21:05:54 INFO BlockManagerInfo: Added broadcast_17_piece0 in memory on node11.hadoop.know-center.at:55870 (size: 1786.0 B, free: 14.2 GB)
  1805. 16/04/23 21:05:55 INFO BlockManagerInfo: Added broadcast_17_piece0 in memory on node03.hadoop.know-center.at:54818 (size: 1786.0 B, free: 14.2 GB)
  1806. 16/04/23 21:05:55 INFO BlockManagerInfo: Added broadcast_17_piece0 in memory on node02.hadoop.know-center.at:43877 (size: 1786.0 B, free: 14.2 GB)
  1807. 16/04/23 21:05:55 INFO BlockManagerInfo: Added broadcast_17_piece0 in memory on node10.hadoop.know-center.at:52005 (size: 1786.0 B, free: 14.2 GB)
  1808. 16/04/23 21:05:56 INFO BlockManagerInfo: Added broadcast_17_piece0 in memory on node12.hadoop.know-center.at:53119 (size: 1786.0 B, free: 14.2 GB)
  1809. 16/04/23 21:05:57 INFO TaskSetManager: Finished task 7.0 in stage 13.0 (TID 1287) in 4736 ms on node11.hadoop.know-center.at (1/10)
  1810. 16/04/23 21:05:57 INFO TaskSetManager: Finished task 2.0 in stage 13.0 (TID 1282) in 5309 ms on node11.hadoop.know-center.at (2/10)
  1811. 16/04/23 21:05:58 INFO TaskSetManager: Finished task 5.0 in stage 13.0 (TID 1285) in 6090 ms on node03.hadoop.know-center.at (3/10)
  1812. 16/04/23 21:05:58 INFO TaskSetManager: Finished task 0.0 in stage 13.0 (TID 1280) in 6498 ms on node03.hadoop.know-center.at (4/10)
  1813. 16/04/23 21:05:59 INFO TaskSetManager: Finished task 1.0 in stage 13.0 (TID 1281) in 6783 ms on node02.hadoop.know-center.at (5/10)
  1814. 16/04/23 21:05:59 INFO TaskSetManager: Finished task 4.0 in stage 13.0 (TID 1284) in 6576 ms on node10.hadoop.know-center.at (6/10)
  1815. 16/04/23 21:05:59 INFO TaskSetManager: Finished task 6.0 in stage 13.0 (TID 1286) in 6415 ms on node02.hadoop.know-center.at (7/10)
  1816. 16/04/23 21:05:59 INFO TaskSetManager: Finished task 9.0 in stage 13.0 (TID 1289) in 6194 ms on node10.hadoop.know-center.at (8/10)
  1817. 16/04/23 21:06:00 INFO TaskSetManager: Finished task 8.0 in stage 13.0 (TID 1288) in 7144 ms on node12.hadoop.know-center.at (9/10)
  1818. 16/04/23 21:06:00 INFO TaskSetManager: Finished task 3.0 in stage 13.0 (TID 1283) in 7556 ms on node12.hadoop.know-center.at (10/10)
  1819. 16/04/23 21:06:00 INFO YarnClusterScheduler: Removed TaskSet 13.0, whose tasks have all completed, from pool
  1820. 16/04/23 21:06:00 INFO DAGScheduler: ShuffleMapStage 13 (repartition at Word2VecOnCluster.scala:262) finished in 7.799 s
  1821. 16/04/23 21:06:00 INFO DAGScheduler: looking for newly runnable stages
  1822. 16/04/23 21:06:00 INFO DAGScheduler: running: Set()
  1823. 16/04/23 21:06:00 INFO DAGScheduler: waiting: Set(ResultStage 14)
  1824. 16/04/23 21:06:00 INFO DAGScheduler: failed: Set()
  1825. 16/04/23 21:06:00 INFO DAGScheduler: Submitting ResultStage 14 (MapPartitionsRDD[38] at repartition at Word2VecOnCluster.scala:262), which has no missing parents
  1826. 16/04/23 21:06:00 INFO MemoryStore: Block broadcast_18 stored as values in memory (estimated size 3.1 KB, free 838.9 MB)
  1827. 16/04/23 21:06:00 INFO MemoryStore: Block broadcast_18_piece0 stored as bytes in memory (estimated size 1882.0 B, free 838.9 MB)
  1828. 16/04/23 21:06:00 INFO BlockManagerInfo: Added broadcast_18_piece0 in memory on 192.168.0.111:33952 (size: 1882.0 B, free: 12.9 GB)
  1829. 16/04/23 21:06:00 INFO SparkContext: Created broadcast 18 from broadcast at DAGScheduler.scala:1006
  1830. 16/04/23 21:06:00 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 14 (MapPartitionsRDD[38] at repartition at Word2VecOnCluster.scala:262)
  1831. 16/04/23 21:06:00 INFO YarnClusterScheduler: Adding task set 14.0 with 1 tasks
  1832. 16/04/23 21:06:00 INFO TaskSetManager: Starting task 0.0 in stage 14.0 (TID 1290, node12.hadoop.know-center.at, partition 0,NODE_LOCAL, 2163 bytes)
  1833. 16/04/23 21:06:00 INFO BlockManagerInfo: Added broadcast_18_piece0 in memory on node12.hadoop.know-center.at:53119 (size: 1882.0 B, free: 14.2 GB)
  1834. 16/04/23 21:06:00 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 6 to node12.hadoop.know-center.at:36254
  1835. 16/04/23 21:06:00 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 6 is 210 bytes
  1836. 16/04/23 21:09:00 WARN HeartbeatReceiver: Removing executor 4 with no recent heartbeats: 151683 ms exceeds timeout 120000 ms
  1837. 16/04/23 21:09:00 ERROR YarnClusterScheduler: Lost executor 4 on node12.hadoop.know-center.at: Executor heartbeat timed out after 151683 ms
  1838. 16/04/23 21:09:00 WARN TaskSetManager: Lost task 0.0 in stage 14.0 (TID 1290, node12.hadoop.know-center.at): ExecutorLostFailure (executor 4 exited caused by one of the running tasks) Reason: Executor heartbeat timed out after 151683 ms
  1839. 16/04/23 21:09:00 INFO DAGScheduler: Executor lost: 4 (epoch 13)
  1840. 16/04/23 21:09:00 INFO YarnClusterSchedulerBackend: Requesting to kill executor(s) 4
  1841. 16/04/23 21:09:00 INFO BlockManagerMasterEndpoint: Trying to remove executor 4 from BlockManagerMaster.
  1842. 16/04/23 21:09:00 INFO TaskSetManager: Starting task 0.1 in stage 14.0 (TID 1291, node02.hadoop.know-center.at, partition 0,NODE_LOCAL, 2163 bytes)
  1843. 16/04/23 21:09:00 INFO BlockManagerMasterEndpoint: Removing block manager BlockManagerId(4, node12.hadoop.know-center.at, 53119)
  1844. 16/04/23 21:09:00 INFO BlockManagerMaster: Removed 4 successfully in removeExecutor
  1845. 16/04/23 21:09:00 INFO ApplicationMaster$AMEndpoint: Driver requested to kill executor(s) 4.
  1846. 16/04/23 21:09:00 INFO ShuffleMapStage: ShuffleMapStage 13 is now unavailable on executor 4 (8/10, false)
  1847. 16/04/23 21:09:00 INFO DAGScheduler: Host added was in lost list earlier: node12.hadoop.know-center.at
  1848. 16/04/23 21:09:00 INFO BlockManagerInfo: Added broadcast_18_piece0 in memory on node02.hadoop.know-center.at:43877 (size: 1882.0 B, free: 14.2 GB)
  1849. 16/04/23 21:09:00 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 6 to node02.hadoop.know-center.at:51162
  1850. 16/04/23 21:09:00 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 6 is 203 bytes
  1851. 16/04/23 21:09:00 WARN TaskSetManager: Lost task 0.1 in stage 14.0 (TID 1291, node02.hadoop.know-center.at): FetchFailed(null, shuffleId=6, mapId=-1, reduceId=0, message=
  1852. org.apache.spark.shuffle.MetadataFetchFailedException: Missing an output location for shuffle 6
  1853. at org.apache.spark.MapOutputTracker$$anonfun$org$apache$spark$MapOutputTracker$$convertMapStatuses$2.apply(MapOutputTracker.scala:542)
  1854. at org.apache.spark.MapOutputTracker$$anonfun$org$apache$spark$MapOutputTracker$$convertMapStatuses$2.apply(MapOutputTracker.scala:538)
  1855. at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:772)
  1856. at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
  1857. at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:108)
  1858. at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:771)
  1859. at org.apache.spark.MapOutputTracker$.org$apache$spark$MapOutputTracker$$convertMapStatuses(MapOutputTracker.scala:538)
  1860. at org.apache.spark.MapOutputTracker.getMapSizesByExecutorId(MapOutputTracker.scala:155)
  1861. at org.apache.spark.shuffle.BlockStoreShuffleReader.read(BlockStoreShuffleReader.scala:47)
  1862. at org.apache.spark.rdd.ShuffledRDD.compute(ShuffledRDD.scala:98)
  1863. at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
  1864. at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
  1865. at org.apache.spark.rdd.CoalescedRDD$$anonfun$compute$1.apply(CoalescedRDD.scala:96)
  1866. at org.apache.spark.rdd.CoalescedRDD$$anonfun$compute$1.apply(CoalescedRDD.scala:95)
  1867. at scala.collection.Iterator$$anon$13.hasNext(Iterator.scala:371)
  1868. at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
  1869. at scala.collection.Iterator$class.foreach(Iterator.scala:727)
  1870. at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
  1871. at scala.collection.generic.Growable$class.$plus$plus$eq(Growable.scala:48)
  1872. at scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:103)
  1873. at scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:47)
  1874. at scala.collection.TraversableOnce$class.to(TraversableOnce.scala:273)
  1875. at scala.collection.AbstractIterator.to(Iterator.scala:1157)
  1876. at scala.collection.TraversableOnce$class.toBuffer(TraversableOnce.scala:265)
  1877. at scala.collection.AbstractIterator.toBuffer(Iterator.scala:1157)
  1878. at scala.collection.TraversableOnce$class.toArray(TraversableOnce.scala:252)
  1879. at scala.collection.AbstractIterator.toArray(Iterator.scala:1157)
  1880. at org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$12.apply(RDD.scala:927)
  1881. at org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$12.apply(RDD.scala:927)
  1882. at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1858)
  1883. at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1858)
  1884. at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66)
  1885. at org.apache.spark.scheduler.Task.run(Task.scala:89)
  1886. at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:213)
  1887. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  1888. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  1889. at java.lang.Thread.run(Thread.java:745)
  1890.  
  1891. )
  1892. 16/04/23 21:09:00 INFO DAGScheduler: Marking ResultStage 14 (collect at Word2VecOnCluster.scala:264) as failed due to a fetch failure from ShuffleMapStage 13 (repartition at Word2VecOnCluster.scala:262)
  1893. 16/04/23 21:09:00 INFO YarnClusterScheduler: Removed TaskSet 14.0, whose tasks have all completed, from pool
  1894. 16/04/23 21:09:00 INFO DAGScheduler: ResultStage 14 (collect at Word2VecOnCluster.scala:264) failed in 180.714 s
  1895. 16/04/23 21:09:00 INFO DAGScheduler: Resubmitting ShuffleMapStage 13 (repartition at Word2VecOnCluster.scala:262) and ResultStage 14 (collect at Word2VecOnCluster.scala:264) due to fetch failure
  1896. 16/04/23 21:09:01 INFO DAGScheduler: Resubmitting failed stages
  1897. 16/04/23 21:09:01 INFO DAGScheduler: Submitting ShuffleMapStage 13 (MapPartitionsRDD[35] at repartition at Word2VecOnCluster.scala:262), which has no missing parents
  1898. 16/04/23 21:09:01 INFO MemoryStore: Block broadcast_19 stored as values in memory (estimated size 2.9 KB, free 838.9 MB)
  1899. 16/04/23 21:09:01 INFO MemoryStore: Block broadcast_19_piece0 stored as bytes in memory (estimated size 1786.0 B, free 838.9 MB)
  1900. 16/04/23 21:09:01 INFO BlockManagerInfo: Added broadcast_19_piece0 in memory on 192.168.0.111:33952 (size: 1786.0 B, free: 12.9 GB)
  1901. 16/04/23 21:09:01 INFO SparkContext: Created broadcast 19 from broadcast at DAGScheduler.scala:1006
  1902. 16/04/23 21:09:01 INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 13 (MapPartitionsRDD[35] at repartition at Word2VecOnCluster.scala:262)
  1903. 16/04/23 21:09:01 INFO YarnClusterScheduler: Adding task set 13.1 with 2 tasks
  1904. 16/04/23 21:09:01 WARN TaskSetManager: Stage 13 contains a task of very large size (25495 KB). The maximum recommended task size is 100 KB.
  1905. 16/04/23 21:09:01 INFO TaskSetManager: Starting task 0.0 in stage 13.1 (TID 1292, node11.hadoop.know-center.at, partition 3,PROCESS_LOCAL, 26107866 bytes)
  1906. 16/04/23 21:09:01 INFO BlockManagerInfo: Removed broadcast_17_piece0 on 192.168.0.111:33952 in memory (size: 1786.0 B, free: 12.9 GB)
  1907. 16/04/23 21:09:01 INFO BlockManagerInfo: Removed broadcast_17_piece0 on node02.hadoop.know-center.at:43877 in memory (size: 1786.0 B, free: 14.2 GB)
  1908. 16/04/23 21:09:01 INFO BlockManagerInfo: Removed broadcast_17_piece0 on node11.hadoop.know-center.at:55870 in memory (size: 1786.0 B, free: 14.2 GB)
  1909. 16/04/23 21:09:01 INFO BlockManagerInfo: Removed broadcast_17_piece0 on node10.hadoop.know-center.at:52005 in memory (size: 1786.0 B, free: 14.2 GB)
  1910. 16/04/23 21:09:01 INFO BlockManagerInfo: Removed broadcast_17_piece0 on node03.hadoop.know-center.at:54818 in memory (size: 1786.0 B, free: 14.2 GB)
  1911. 16/04/23 21:09:01 INFO TaskSetManager: Starting task 1.0 in stage 13.1 (TID 1293, node03.hadoop.know-center.at, partition 8,PROCESS_LOCAL, 26107124 bytes)
  1912. 16/04/23 21:09:01 INFO BlockManagerInfo: Added broadcast_19_piece0 in memory on node11.hadoop.know-center.at:55870 (size: 1786.0 B, free: 14.2 GB)
  1913. 16/04/23 21:09:02 INFO BlockManagerInfo: Added broadcast_19_piece0 in memory on node03.hadoop.know-center.at:54818 (size: 1786.0 B, free: 14.2 GB)
  1914. 16/04/23 21:09:02 INFO YarnAllocator: Will request 1 executor containers, each with 8 cores and 20864 MB memory including 384 MB overhead
  1915. 16/04/23 21:09:02 INFO YarnAllocator: Container request (host: Any, capability: <memory:20864, vCores:8>)
  1916. 16/04/23 21:09:03 INFO YarnAllocator: Launching container container_e05_1459928874908_0230_02_000012 for on host node10.hadoop.know-center.at
  1917. 16/04/23 21:09:03 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: spark://CoarseGrainedScheduler@192.168.0.111:59844, executorHostname: node10.hadoop.know-center.at
  1918. 16/04/23 21:09:03 INFO YarnAllocator: Received 1 containers from YARN, launching executors on 1 of them.
  1919. 16/04/23 21:09:03 INFO ExecutorRunnable: Starting Executor Container
  1920. 16/04/23 21:09:03 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0
  1921. 16/04/23 21:09:03 INFO ExecutorRunnable: Setting up ContainerLaunchContext
  1922. 16/04/23 21:09:03 INFO ExecutorRunnable: Preparing Local resources
  1923. 16/04/23 21:09:03 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "master01.hadoop.know-center.at" port: 8020 file: "/user/sfalk/.sparkStaging/application_1459928874908_0230/wordvectors-final.jar" } size: 1279239848 timestamp: 1461433144865 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "master01.hadoop.know-center.at" port: 8020 file: "/hdp/apps/2.4.0.0-169/spark/spark-hdp-assembly.jar" } size: 191724642 timestamp: 1456930414488 type: FILE visibility: PUBLIC)
  1924. 16/04/23 21:09:03 INFO Client: Using the spark assembly jar on HDFS because you are using HDP, defaultSparkAssembly:hdfs://master01.hadoop.know-center.at:8020/hdp/apps/2.4.0.0-169/spark/spark-hdp-assembly.jar
  1925. 16/04/23 21:09:03 INFO ExecutorRunnable:
  1926. ===============================================================================
  1927. YARN executor launch context:
  1928. env:
  1929. CLASSPATH -> {{PWD}}<CPS>{{PWD}}/__spark__.jar<CPS>$HADOOP_CONF_DIR<CPS>/usr/hdp/current/hadoop-client/*<CPS>/usr/hdp/current/hadoop-client/lib/*<CPS>/usr/hdp/current/hadoop-hdfs-client/*<CPS>/usr/hdp/current/hadoop-hdfs-client/lib/*<CPS>/usr/hdp/current/hadoop-yarn-client/*<CPS>/usr/hdp/current/hadoop-yarn-client/lib/*<CPS>$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:$PWD/mr-framework/hadoop/share/hadoop/tools/lib/*:/usr/hdp/2.4.0.0-169/hadoop/lib/hadoop-lzo-0.6.0.2.4.0.0-169.jar:/etc/hadoop/conf/secure
  1930. SPARK_LOG_URL_STDERR -> http://node10.hadoop.know-center.at:8042/node/containerlogs/container_e05_1459928874908_0230_02_000012/sfalk/stderr?start=-4096
  1931. SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1459928874908_0230
  1932. SPARK_YARN_CACHE_FILES_FILE_SIZES -> 191724642,1279239848
  1933. SPARK_USER -> sfalk
  1934. SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE
  1935. SPARK_YARN_MODE -> true
  1936. SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1456930414488,1461433144865
  1937. SPARK_LOG_URL_STDOUT -> http://node10.hadoop.know-center.at:8042/node/containerlogs/container_e05_1459928874908_0230_02_000012/sfalk/stdout?start=-4096
  1938. SPARK_YARN_CACHE_FILES -> hdfs://master01.hadoop.know-center.at:8020/hdp/apps/2.4.0.0-169/spark/spark-hdp-assembly.jar#__spark__.jar,hdfs://master01.hadoop.know-center.at:8020/user/sfalk/.sparkStaging/application_1459928874908_0230/wordvectors-final.jar#__app__.jar
  1939.  
  1940. command:
  1941. {{JAVA_HOME}}/bin/java -server -XX:OnOutOfMemoryError='kill %p' -Xms20480m -Xmx20480m -Djava.io.tmpdir={{PWD}}/tmp '-Dspark.driver.port=59844' '-Dspark.akka.frameSize=2000' '-Dspark.history.ui.port=18080' '-Dspark.ui.port=0' -Dspark.yarn.app.container.log.dir=<LOG_DIR> org.apache.spark.executor.CoarseGrainedExecutorBackend --driver-url spark://CoarseGrainedScheduler@192.168.0.111:59844 --executor-id 7 --hostname node10.hadoop.know-center.at --cores 8 --app-id application_1459928874908_0230 --user-class-path file:$PWD/__app__.jar 1> <LOG_DIR>/stdout 2> <LOG_DIR>/stderr
  1942. ===============================================================================
  1943.  
  1944. 16/04/23 21:09:03 INFO ContainerManagementProtocolProxy: Opening proxy : node10.hadoop.know-center.at:45454
  1945. 16/04/23 21:09:05 INFO TaskSetManager: Finished task 0.0 in stage 13.1 (TID 1292) in 4107 ms on node11.hadoop.know-center.at (1/2)
  1946. 16/04/23 21:09:05 INFO TaskSetManager: Finished task 1.0 in stage 13.1 (TID 1293) in 4357 ms on node03.hadoop.know-center.at (2/2)
  1947. 16/04/23 21:09:05 INFO YarnClusterScheduler: Removed TaskSet 13.1, whose tasks have all completed, from pool
  1948. 16/04/23 21:09:05 INFO DAGScheduler: ShuffleMapStage 13 (repartition at Word2VecOnCluster.scala:262) finished in 4.632 s
  1949. 16/04/23 21:09:05 INFO DAGScheduler: looking for newly runnable stages
  1950. 16/04/23 21:09:05 INFO DAGScheduler: running: Set()
  1951. 16/04/23 21:09:05 INFO DAGScheduler: waiting: Set(ResultStage 14)
  1952. 16/04/23 21:09:05 INFO DAGScheduler: failed: Set()
  1953. 16/04/23 21:09:05 INFO DAGScheduler: Submitting ResultStage 14 (MapPartitionsRDD[38] at repartition at Word2VecOnCluster.scala:262), which has no missing parents
  1954. 16/04/23 21:09:05 INFO MemoryStore: Block broadcast_20 stored as values in memory (estimated size 3.1 KB, free 838.9 MB)
  1955. 16/04/23 21:09:05 INFO MemoryStore: Block broadcast_20_piece0 stored as bytes in memory (estimated size 1882.0 B, free 838.9 MB)
  1956. 16/04/23 21:09:05 INFO BlockManagerInfo: Added broadcast_20_piece0 in memory on 192.168.0.111:33952 (size: 1882.0 B, free: 12.9 GB)
  1957. 16/04/23 21:09:05 INFO SparkContext: Created broadcast 20 from broadcast at DAGScheduler.scala:1006
  1958. 16/04/23 21:09:05 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 14 (MapPartitionsRDD[38] at repartition at Word2VecOnCluster.scala:262)
  1959. 16/04/23 21:09:05 INFO YarnClusterScheduler: Adding task set 14.1 with 1 tasks
  1960. 16/04/23 21:09:05 INFO TaskSetManager: Starting task 0.0 in stage 14.1 (TID 1294, node10.hadoop.know-center.at, partition 0,NODE_LOCAL, 2163 bytes)
  1961. 16/04/23 21:09:05 INFO BlockManagerInfo: Added broadcast_20_piece0 in memory on node10.hadoop.know-center.at:52005 (size: 1882.0 B, free: 14.2 GB)
  1962. 16/04/23 21:09:05 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 6 to node10.hadoop.know-center.at:44308
  1963. 16/04/23 21:09:05 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 6 is 206 bytes
  1964. 16/04/23 21:11:08 INFO YarnAllocator: Completed container container_e05_1459928874908_0230_02_000012 on host: node10.hadoop.know-center.at (state: COMPLETE, exit status: 1)
  1965. 16/04/23 21:11:08 WARN YarnAllocator: Container marked as failed: container_e05_1459928874908_0230_02_000012 on host: node10.hadoop.know-center.at. Exit status: 1. Diagnostics: Exception from container-launch.
  1966. Container id: container_e05_1459928874908_0230_02_000012
  1967. Exit code: 1
  1968. Stack trace: ExitCodeException exitCode=1:
  1969. at org.apache.hadoop.util.Shell.runCommand(Shell.java:576)
  1970. at org.apache.hadoop.util.Shell.run(Shell.java:487)
  1971. at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:753)
  1972. at org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.launchContainer(LinuxContainerExecutor.java:371)
  1973. at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:303)
  1974. at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
  1975. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1976. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  1977. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  1978. at java.lang.Thread.run(Thread.java:745)
  1979.  
  1980. Shell output: main : command provided 1
  1981. main : run as user is sfalk
  1982. main : requested yarn user is sfalk
  1983.  
  1984.  
  1985. Container exited with a non-zero exit code 1
  1986.  
  1987. 16/04/23 21:11:08 WARN YarnSchedulerBackend$YarnSchedulerEndpoint: Container marked as failed: container_e05_1459928874908_0230_02_000012 on host: node10.hadoop.know-center.at. Exit status: 1. Diagnostics: Exception from container-launch.
  1988. Container id: container_e05_1459928874908_0230_02_000012
  1989. Exit code: 1
  1990. Stack trace: ExitCodeException exitCode=1:
  1991. at org.apache.hadoop.util.Shell.runCommand(Shell.java:576)
  1992. at org.apache.hadoop.util.Shell.run(Shell.java:487)
  1993. at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:753)
  1994. at org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.launchContainer(LinuxContainerExecutor.java:371)
  1995. at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:303)
  1996. at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
  1997. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1998. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  1999. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  2000. at java.lang.Thread.run(Thread.java:745)
  2001.  
  2002. Shell output: main : command provided 1
  2003. main : run as user is sfalk
  2004. main : requested yarn user is sfalk
  2005.  
  2006.  
  2007. Container exited with a non-zero exit code 1
  2008.  
  2009. 16/04/23 21:11:08 INFO YarnClusterSchedulerBackend: Asked to remove non-existent executor 7
  2010. 16/04/23 21:11:13 INFO YarnAllocator: Will request 1 executor containers, each with 8 cores and 20864 MB memory including 384 MB overhead
  2011. 16/04/23 21:11:13 INFO YarnAllocator: Container request (host: Any, capability: <memory:20864, vCores:8>)
  2012. 16/04/23 21:11:13 INFO YarnAllocator: Launching container container_e05_1459928874908_0230_02_000013 for on host node12.hadoop.know-center.at
  2013. 16/04/23 21:11:13 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: spark://CoarseGrainedScheduler@192.168.0.111:59844, executorHostname: node12.hadoop.know-center.at
  2014. 16/04/23 21:11:13 INFO YarnAllocator: Received 1 containers from YARN, launching executors on 1 of them.
  2015. 16/04/23 21:11:13 INFO ExecutorRunnable: Starting Executor Container
  2016. 16/04/23 21:11:13 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0
  2017. 16/04/23 21:11:13 INFO ExecutorRunnable: Setting up ContainerLaunchContext
  2018. 16/04/23 21:11:13 INFO ExecutorRunnable: Preparing Local resources
  2019. 16/04/23 21:11:13 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "master01.hadoop.know-center.at" port: 8020 file: "/user/sfalk/.sparkStaging/application_1459928874908_0230/wordvectors-final.jar" } size: 1279239848 timestamp: 1461433144865 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "master01.hadoop.know-center.at" port: 8020 file: "/hdp/apps/2.4.0.0-169/spark/spark-hdp-assembly.jar" } size: 191724642 timestamp: 1456930414488 type: FILE visibility: PUBLIC)
  2020. 16/04/23 21:11:13 INFO Client: Using the spark assembly jar on HDFS because you are using HDP, defaultSparkAssembly:hdfs://master01.hadoop.know-center.at:8020/hdp/apps/2.4.0.0-169/spark/spark-hdp-assembly.jar
  2021. 16/04/23 21:11:13 INFO ExecutorRunnable:
  2022. ===============================================================================
  2023. YARN executor launch context:
  2024. env:
  2025. CLASSPATH -> {{PWD}}<CPS>{{PWD}}/__spark__.jar<CPS>$HADOOP_CONF_DIR<CPS>/usr/hdp/current/hadoop-client/*<CPS>/usr/hdp/current/hadoop-client/lib/*<CPS>/usr/hdp/current/hadoop-hdfs-client/*<CPS>/usr/hdp/current/hadoop-hdfs-client/lib/*<CPS>/usr/hdp/current/hadoop-yarn-client/*<CPS>/usr/hdp/current/hadoop-yarn-client/lib/*<CPS>$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:$PWD/mr-framework/hadoop/share/hadoop/tools/lib/*:/usr/hdp/2.4.0.0-169/hadoop/lib/hadoop-lzo-0.6.0.2.4.0.0-169.jar:/etc/hadoop/conf/secure
  2026. SPARK_LOG_URL_STDERR -> http://node12.hadoop.know-center.at:8042/node/containerlogs/container_e05_1459928874908_0230_02_000013/sfalk/stderr?start=-4096
  2027. SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1459928874908_0230
  2028. SPARK_YARN_CACHE_FILES_FILE_SIZES -> 191724642,1279239848
  2029. SPARK_USER -> sfalk
  2030. SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE
  2031. SPARK_YARN_MODE -> true
  2032. SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1456930414488,1461433144865
  2033. SPARK_LOG_URL_STDOUT -> http://node12.hadoop.know-center.at:8042/node/containerlogs/container_e05_1459928874908_0230_02_000013/sfalk/stdout?start=-4096
  2034. SPARK_YARN_CACHE_FILES -> hdfs://master01.hadoop.know-center.at:8020/hdp/apps/2.4.0.0-169/spark/spark-hdp-assembly.jar#__spark__.jar,hdfs://master01.hadoop.know-center.at:8020/user/sfalk/.sparkStaging/application_1459928874908_0230/wordvectors-final.jar#__app__.jar
  2035.  
  2036. command:
  2037. {{JAVA_HOME}}/bin/java -server -XX:OnOutOfMemoryError='kill %p' -Xms20480m -Xmx20480m -Djava.io.tmpdir={{PWD}}/tmp '-Dspark.driver.port=59844' '-Dspark.akka.frameSize=2000' '-Dspark.history.ui.port=18080' '-Dspark.ui.port=0' -Dspark.yarn.app.container.log.dir=<LOG_DIR> org.apache.spark.executor.CoarseGrainedExecutorBackend --driver-url spark://CoarseGrainedScheduler@192.168.0.111:59844 --executor-id 8 --hostname node12.hadoop.know-center.at --cores 8 --app-id application_1459928874908_0230 --user-class-path file:$PWD/__app__.jar 1> <LOG_DIR>/stdout 2> <LOG_DIR>/stderr
  2038. ===============================================================================
  2039.  
  2040. 16/04/23 21:11:13 INFO ContainerManagementProtocolProxy: Opening proxy : node12.hadoop.know-center.at:45454
  2041. 16/04/23 21:11:16 INFO YarnClusterSchedulerBackend: Registered executor NettyRpcEndpointRef(null) (node12.hadoop.know-center.at:37231) with ID 8
  2042. 16/04/23 21:11:17 INFO BlockManagerMasterEndpoint: Registering block manager node12.hadoop.know-center.at:47788 with 14.2 GB RAM, BlockManagerId(8, node12.hadoop.know-center.at, 47788)
  2043. 16/04/23 21:12:00 WARN HeartbeatReceiver: Removing executor 2 with no recent heartbeats: 153286 ms exceeds timeout 120000 ms
  2044. 16/04/23 21:12:00 ERROR YarnClusterScheduler: Lost executor 2 on node10.hadoop.know-center.at: Executor heartbeat timed out after 153286 ms
  2045. 16/04/23 21:12:00 WARN TaskSetManager: Lost task 0.0 in stage 14.1 (TID 1294, node10.hadoop.know-center.at): ExecutorLostFailure (executor 2 exited caused by one of the running tasks) Reason: Executor heartbeat timed out after 153286 ms
  2046. 16/04/23 21:12:00 INFO DAGScheduler: Executor lost: 2 (epoch 15)
  2047. 16/04/23 21:12:00 INFO YarnClusterSchedulerBackend: Requesting to kill executor(s) 2
  2048. 16/04/23 21:12:00 INFO BlockManagerMasterEndpoint: Trying to remove executor 2 from BlockManagerMaster.
  2049. 16/04/23 21:12:00 INFO BlockManagerMasterEndpoint: Removing block manager BlockManagerId(2, node10.hadoop.know-center.at, 52005)
  2050. 16/04/23 21:12:00 INFO BlockManagerMaster: Removed 2 successfully in removeExecutor
  2051. 16/04/23 21:12:00 INFO ShuffleMapStage: ShuffleMapStage 13 is now unavailable on executor 2 (8/10, false)
  2052. 16/04/23 21:12:00 INFO DAGScheduler: Host added was in lost list earlier: node10.hadoop.know-center.at
  2053. 16/04/23 21:12:00 INFO TaskSetManager: Starting task 0.1 in stage 14.1 (TID 1295, node02.hadoop.know-center.at, partition 0,NODE_LOCAL, 2163 bytes)
  2054. 16/04/23 21:12:00 INFO ApplicationMaster$AMEndpoint: Driver requested to kill executor(s) 2.
  2055. 16/04/23 21:12:00 INFO BlockManagerInfo: Added broadcast_20_piece0 in memory on node02.hadoop.know-center.at:43877 (size: 1882.0 B, free: 14.2 GB)
  2056. 16/04/23 21:12:00 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 6 to node02.hadoop.know-center.at:51162
  2057. 16/04/23 21:12:00 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 6 is 197 bytes
  2058. 16/04/23 21:12:00 WARN TaskSetManager: Lost task 0.1 in stage 14.1 (TID 1295, node02.hadoop.know-center.at): FetchFailed(null, shuffleId=6, mapId=-1, reduceId=0, message=
  2059. org.apache.spark.shuffle.MetadataFetchFailedException: Missing an output location for shuffle 6
  2060. at org.apache.spark.MapOutputTracker$$anonfun$org$apache$spark$MapOutputTracker$$convertMapStatuses$2.apply(MapOutputTracker.scala:542)
  2061. at org.apache.spark.MapOutputTracker$$anonfun$org$apache$spark$MapOutputTracker$$convertMapStatuses$2.apply(MapOutputTracker.scala:538)
  2062. at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:772)
  2063. at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
  2064. at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:108)
  2065. at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:771)
  2066. at org.apache.spark.MapOutputTracker$.org$apache$spark$MapOutputTracker$$convertMapStatuses(MapOutputTracker.scala:538)
  2067. at org.apache.spark.MapOutputTracker.getMapSizesByExecutorId(MapOutputTracker.scala:155)
  2068. at org.apache.spark.shuffle.BlockStoreShuffleReader.read(BlockStoreShuffleReader.scala:47)
  2069. at org.apache.spark.rdd.ShuffledRDD.compute(ShuffledRDD.scala:98)
  2070. at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
  2071. at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
  2072. at org.apache.spark.rdd.CoalescedRDD$$anonfun$compute$1.apply(CoalescedRDD.scala:96)
  2073. at org.apache.spark.rdd.CoalescedRDD$$anonfun$compute$1.apply(CoalescedRDD.scala:95)
  2074. at scala.collection.Iterator$$anon$13.hasNext(Iterator.scala:371)
  2075. at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
  2076. at scala.collection.Iterator$class.foreach(Iterator.scala:727)
  2077. at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
  2078. at scala.collection.generic.Growable$class.$plus$plus$eq(Growable.scala:48)
  2079. at scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:103)
  2080. at scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:47)
  2081. at scala.collection.TraversableOnce$class.to(TraversableOnce.scala:273)
  2082. at scala.collection.AbstractIterator.to(Iterator.scala:1157)
  2083. at scala.collection.TraversableOnce$class.toBuffer(TraversableOnce.scala:265)
  2084. at scala.collection.AbstractIterator.toBuffer(Iterator.scala:1157)
  2085. at scala.collection.TraversableOnce$class.toArray(TraversableOnce.scala:252)
  2086. at scala.collection.AbstractIterator.toArray(Iterator.scala:1157)
  2087. at org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$12.apply(RDD.scala:927)
  2088. at org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$12.apply(RDD.scala:927)
  2089. at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1858)
  2090. at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1858)
  2091. at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66)
  2092. at org.apache.spark.scheduler.Task.run(Task.scala:89)
  2093. at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:213)
  2094. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  2095. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  2096. at java.lang.Thread.run(Thread.java:745)
  2097.  
  2098. )
  2099. 16/04/23 21:12:00 INFO DAGScheduler: Marking ResultStage 14 (collect at Word2VecOnCluster.scala:264) as failed due to a fetch failure from ShuffleMapStage 13 (repartition at Word2VecOnCluster.scala:262)
  2100. 16/04/23 21:12:00 INFO YarnClusterScheduler: Removed TaskSet 14.1, whose tasks have all completed, from pool
  2101. 16/04/23 21:12:00 INFO DAGScheduler: ResultStage 14 (collect at Word2VecOnCluster.scala:264) failed in 175.065 s
  2102. 16/04/23 21:12:00 INFO DAGScheduler: Resubmitting ShuffleMapStage 13 (repartition at Word2VecOnCluster.scala:262) and ResultStage 14 (collect at Word2VecOnCluster.scala:264) due to fetch failure
  2103. 16/04/23 21:12:01 INFO DAGScheduler: Resubmitting failed stages
  2104. 16/04/23 21:12:01 INFO DAGScheduler: Submitting ShuffleMapStage 13 (MapPartitionsRDD[35] at repartition at Word2VecOnCluster.scala:262), which has no missing parents
  2105. 16/04/23 21:12:01 INFO MemoryStore: Block broadcast_21 stored as values in memory (estimated size 2.9 KB, free 838.9 MB)
  2106. 16/04/23 21:12:01 INFO MemoryStore: Block broadcast_21_piece0 stored as bytes in memory (estimated size 1786.0 B, free 838.9 MB)
  2107. 16/04/23 21:12:01 INFO BlockManagerInfo: Added broadcast_21_piece0 in memory on 192.168.0.111:33952 (size: 1786.0 B, free: 12.9 GB)
  2108. 16/04/23 21:12:01 INFO SparkContext: Created broadcast 21 from broadcast at DAGScheduler.scala:1006
  2109. 16/04/23 21:12:01 INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 13 (MapPartitionsRDD[35] at repartition at Word2VecOnCluster.scala:262)
  2110. 16/04/23 21:12:01 INFO YarnClusterScheduler: Adding task set 13.2 with 2 tasks
  2111. 16/04/23 21:12:01 WARN TaskSetManager: Stage 13 contains a task of very large size (25494 KB). The maximum recommended task size is 100 KB.
  2112. 16/04/23 21:12:01 INFO TaskSetManager: Starting task 0.0 in stage 13.2 (TID 1296, node11.hadoop.know-center.at, partition 4,PROCESS_LOCAL, 26106158 bytes)
  2113. 16/04/23 21:12:01 INFO TaskSetManager: Starting task 1.0 in stage 13.2 (TID 1297, node02.hadoop.know-center.at, partition 9,PROCESS_LOCAL, 26106786 bytes)
  2114. 16/04/23 21:12:01 INFO BlockManagerInfo: Added broadcast_21_piece0 in memory on node11.hadoop.know-center.at:55870 (size: 1786.0 B, free: 14.2 GB)
  2115. 16/04/23 21:12:02 INFO BlockManagerInfo: Added broadcast_21_piece0 in memory on node02.hadoop.know-center.at:43877 (size: 1786.0 B, free: 14.2 GB)
  2116. 16/04/23 21:12:03 INFO YarnAllocator: Will request 1 executor containers, each with 8 cores and 20864 MB memory including 384 MB overhead
  2117. 16/04/23 21:12:03 INFO YarnAllocator: Container request (host: Any, capability: <memory:20864, vCores:8>)
  2118. 16/04/23 21:12:03 INFO YarnAllocator: Launching container container_e05_1459928874908_0230_02_000014 for on host node02.hadoop.know-center.at
  2119. 16/04/23 21:12:03 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: spark://CoarseGrainedScheduler@192.168.0.111:59844, executorHostname: node02.hadoop.know-center.at
  2120. 16/04/23 21:12:03 INFO YarnAllocator: Received 1 containers from YARN, launching executors on 1 of them.
  2121. 16/04/23 21:12:03 INFO ExecutorRunnable: Starting Executor Container
  2122. 16/04/23 21:12:03 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0
  2123. 16/04/23 21:12:03 INFO ExecutorRunnable: Setting up ContainerLaunchContext
  2124. 16/04/23 21:12:03 INFO ExecutorRunnable: Preparing Local resources
  2125. 16/04/23 21:12:03 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "master01.hadoop.know-center.at" port: 8020 file: "/user/sfalk/.sparkStaging/application_1459928874908_0230/wordvectors-final.jar" } size: 1279239848 timestamp: 1461433144865 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "master01.hadoop.know-center.at" port: 8020 file: "/hdp/apps/2.4.0.0-169/spark/spark-hdp-assembly.jar" } size: 191724642 timestamp: 1456930414488 type: FILE visibility: PUBLIC)
  2126. 16/04/23 21:12:03 INFO Client: Using the spark assembly jar on HDFS because you are using HDP, defaultSparkAssembly:hdfs://master01.hadoop.know-center.at:8020/hdp/apps/2.4.0.0-169/spark/spark-hdp-assembly.jar
  2127. 16/04/23 21:12:03 INFO ExecutorRunnable:
  2128. ===============================================================================
  2129. YARN executor launch context:
  2130. env:
  2131. CLASSPATH -> {{PWD}}<CPS>{{PWD}}/__spark__.jar<CPS>$HADOOP_CONF_DIR<CPS>/usr/hdp/current/hadoop-client/*<CPS>/usr/hdp/current/hadoop-client/lib/*<CPS>/usr/hdp/current/hadoop-hdfs-client/*<CPS>/usr/hdp/current/hadoop-hdfs-client/lib/*<CPS>/usr/hdp/current/hadoop-yarn-client/*<CPS>/usr/hdp/current/hadoop-yarn-client/lib/*<CPS>$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:$PWD/mr-framework/hadoop/share/hadoop/tools/lib/*:/usr/hdp/2.4.0.0-169/hadoop/lib/hadoop-lzo-0.6.0.2.4.0.0-169.jar:/etc/hadoop/conf/secure
  2132. SPARK_LOG_URL_STDERR -> http://node02.hadoop.know-center.at:8042/node/containerlogs/container_e05_1459928874908_0230_02_000014/sfalk/stderr?start=-4096
  2133. SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1459928874908_0230
  2134. SPARK_YARN_CACHE_FILES_FILE_SIZES -> 191724642,1279239848
  2135. SPARK_USER -> sfalk
  2136. SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE
  2137. SPARK_YARN_MODE -> true
  2138. SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1456930414488,1461433144865
  2139. SPARK_LOG_URL_STDOUT -> http://node02.hadoop.know-center.at:8042/node/containerlogs/container_e05_1459928874908_0230_02_000014/sfalk/stdout?start=-4096
  2140. SPARK_YARN_CACHE_FILES -> hdfs://master01.hadoop.know-center.at:8020/hdp/apps/2.4.0.0-169/spark/spark-hdp-assembly.jar#__spark__.jar,hdfs://master01.hadoop.know-center.at:8020/user/sfalk/.sparkStaging/application_1459928874908_0230/wordvectors-final.jar#__app__.jar
  2141.  
  2142. command:
  2143. {{JAVA_HOME}}/bin/java -server -XX:OnOutOfMemoryError='kill %p' -Xms20480m -Xmx20480m -Djava.io.tmpdir={{PWD}}/tmp '-Dspark.driver.port=59844' '-Dspark.akka.frameSize=2000' '-Dspark.history.ui.port=18080' '-Dspark.ui.port=0' -Dspark.yarn.app.container.log.dir=<LOG_DIR> org.apache.spark.executor.CoarseGrainedExecutorBackend --driver-url spark://CoarseGrainedScheduler@192.168.0.111:59844 --executor-id 9 --hostname node02.hadoop.know-center.at --cores 8 --app-id application_1459928874908_0230 --user-class-path file:$PWD/__app__.jar 1> <LOG_DIR>/stdout 2> <LOG_DIR>/stderr
  2144. ===============================================================================
  2145.  
  2146. 16/04/23 21:12:03 INFO ContainerManagementProtocolProxy: Opening proxy : node02.hadoop.know-center.at:45454
  2147. 16/04/23 21:12:05 INFO TaskSetManager: Finished task 0.0 in stage 13.2 (TID 1296) in 3859 ms on node11.hadoop.know-center.at (1/2)
  2148. 16/04/23 21:12:05 INFO TaskSetManager: Finished task 1.0 in stage 13.2 (TID 1297) in 4237 ms on node02.hadoop.know-center.at (2/2)
  2149. 16/04/23 21:12:05 INFO DAGScheduler: ShuffleMapStage 13 (repartition at Word2VecOnCluster.scala:262) finished in 4.322 s
  2150. 16/04/23 21:12:05 INFO YarnClusterScheduler: Removed TaskSet 13.2, whose tasks have all completed, from pool
  2151. 16/04/23 21:12:05 INFO DAGScheduler: looking for newly runnable stages
  2152. 16/04/23 21:12:05 INFO DAGScheduler: running: Set()
  2153. 16/04/23 21:12:05 INFO DAGScheduler: waiting: Set(ResultStage 14)
  2154. 16/04/23 21:12:05 INFO DAGScheduler: failed: Set()
  2155. 16/04/23 21:12:05 INFO DAGScheduler: Submitting ResultStage 14 (MapPartitionsRDD[38] at repartition at Word2VecOnCluster.scala:262), which has no missing parents
  2156. 16/04/23 21:12:05 INFO MemoryStore: Block broadcast_22 stored as values in memory (estimated size 3.1 KB, free 838.9 MB)
  2157. 16/04/23 21:12:05 INFO MemoryStore: Block broadcast_22_piece0 stored as bytes in memory (estimated size 1882.0 B, free 838.9 MB)
  2158. 16/04/23 21:12:05 INFO BlockManagerInfo: Added broadcast_22_piece0 in memory on 192.168.0.111:33952 (size: 1882.0 B, free: 12.9 GB)
  2159. 16/04/23 21:12:05 INFO SparkContext: Created broadcast 22 from broadcast at DAGScheduler.scala:1006
  2160. 16/04/23 21:12:05 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 14 (MapPartitionsRDD[38] at repartition at Word2VecOnCluster.scala:262)
  2161. 16/04/23 21:12:05 INFO YarnClusterScheduler: Adding task set 14.2 with 1 tasks
  2162. 16/04/23 21:12:05 INFO TaskSetManager: Starting task 0.0 in stage 14.2 (TID 1298, node02.hadoop.know-center.at, partition 0,NODE_LOCAL, 2163 bytes)
  2163. 16/04/23 21:12:05 INFO BlockManagerInfo: Added broadcast_22_piece0 in memory on node02.hadoop.know-center.at:43877 (size: 1882.0 B, free: 14.2 GB)
  2164. 16/04/23 21:12:05 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 6 to node02.hadoop.know-center.at:51162
  2165. 16/04/23 21:12:05 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 6 is 193 bytes
  2166. 16/04/23 21:12:06 INFO YarnClusterSchedulerBackend: Registered executor NettyRpcEndpointRef(null) (node02.hadoop.know-center.at:52014) with ID 9
  2167. 16/04/23 21:12:07 INFO BlockManagerMasterEndpoint: Registering block manager node02.hadoop.know-center.at:41125 with 14.2 GB RAM, BlockManagerId(9, node02.hadoop.know-center.at, 41125)
  2168. 16/04/23 21:15:00 WARN HeartbeatReceiver: Removing executor 5 with no recent heartbeats: 156711 ms exceeds timeout 120000 ms
  2169. 16/04/23 21:15:00 ERROR YarnClusterScheduler: Lost executor 5 on node02.hadoop.know-center.at: Executor heartbeat timed out after 156711 ms
  2170. 16/04/23 21:15:00 WARN TaskSetManager: Lost task 0.0 in stage 14.2 (TID 1298, node02.hadoop.know-center.at): ExecutorLostFailure (executor 5 exited caused by one of the running tasks) Reason: Executor heartbeat timed out after 156711 ms
  2171. 16/04/23 21:15:00 WARN HeartbeatReceiver: Removing executor 9 with no recent heartbeats: 137592 ms exceeds timeout 120000 ms
  2172. 16/04/23 21:15:00 INFO DAGScheduler: Executor lost: 5 (epoch 17)
  2173. 16/04/23 21:15:00 INFO YarnClusterSchedulerBackend: Requesting to kill executor(s) 5
  2174. 16/04/23 21:15:00 INFO BlockManagerMasterEndpoint: Trying to remove executor 5 from BlockManagerMaster.
  2175. 16/04/23 21:15:00 INFO BlockManagerMasterEndpoint: Removing block manager BlockManagerId(5, node02.hadoop.know-center.at, 43877)
  2176. 16/04/23 21:15:00 INFO TaskSetManager: Starting task 0.1 in stage 14.2 (TID 1299, node11.hadoop.know-center.at, partition 0,NODE_LOCAL, 2163 bytes)
  2177. 16/04/23 21:15:00 INFO BlockManagerMaster: Removed 5 successfully in removeExecutor
  2178. 16/04/23 21:15:00 ERROR YarnClusterScheduler: Lost executor 9 on node02.hadoop.know-center.at: Executor heartbeat timed out after 137592 ms
  2179. 16/04/23 21:15:00 INFO ShuffleMapStage: ShuffleMapStage 13 is now unavailable on executor 5 (7/10, false)
  2180. 16/04/23 21:15:00 INFO ApplicationMaster$AMEndpoint: Driver requested to kill executor(s) 5.
  2181. 16/04/23 21:15:00 INFO DAGScheduler: Host added was in lost list earlier: node02.hadoop.know-center.at
  2182. 16/04/23 21:15:00 INFO YarnClusterSchedulerBackend: Requesting to kill executor(s) 9
  2183. 16/04/23 21:15:00 INFO DAGScheduler: Executor lost: 9 (epoch 18)
  2184. 16/04/23 21:15:00 INFO BlockManagerMasterEndpoint: Trying to remove executor 9 from BlockManagerMaster.
  2185. 16/04/23 21:15:00 INFO BlockManagerMasterEndpoint: Removing block manager BlockManagerId(9, node02.hadoop.know-center.at, 41125)
  2186. 16/04/23 21:15:00 INFO BlockManagerMaster: Removed 9 successfully in removeExecutor
  2187. 16/04/23 21:15:00 INFO DAGScheduler: Host added was in lost list earlier: node02.hadoop.know-center.at
  2188. 16/04/23 21:15:00 INFO ApplicationMaster$AMEndpoint: Driver requested to kill executor(s) 9.
  2189. 16/04/23 21:15:00 INFO BlockManagerInfo: Added broadcast_22_piece0 in memory on node11.hadoop.know-center.at:55870 (size: 1882.0 B, free: 14.2 GB)
  2190. 16/04/23 21:15:00 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 6 to node11.hadoop.know-center.at:33949
  2191. 16/04/23 21:15:00 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 6 is 185 bytes
  2192. 16/04/23 21:15:00 WARN TaskSetManager: Lost task 0.1 in stage 14.2 (TID 1299, node11.hadoop.know-center.at): FetchFailed(null, shuffleId=6, mapId=-1, reduceId=0, message=
  2193. org.apache.spark.shuffle.MetadataFetchFailedException: Missing an output location for shuffle 6
  2194. at org.apache.spark.MapOutputTracker$$anonfun$org$apache$spark$MapOutputTracker$$convertMapStatuses$2.apply(MapOutputTracker.scala:542)
  2195. at org.apache.spark.MapOutputTracker$$anonfun$org$apache$spark$MapOutputTracker$$convertMapStatuses$2.apply(MapOutputTracker.scala:538)
  2196. at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:772)
  2197. at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
  2198. at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:108)
  2199. at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:771)
  2200. at org.apache.spark.MapOutputTracker$.org$apache$spark$MapOutputTracker$$convertMapStatuses(MapOutputTracker.scala:538)
  2201. at org.apache.spark.MapOutputTracker.getMapSizesByExecutorId(MapOutputTracker.scala:155)
  2202. at org.apache.spark.shuffle.BlockStoreShuffleReader.read(BlockStoreShuffleReader.scala:47)
  2203. at org.apache.spark.rdd.ShuffledRDD.compute(ShuffledRDD.scala:98)
  2204. at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
  2205. at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
  2206. at org.apache.spark.rdd.CoalescedRDD$$anonfun$compute$1.apply(CoalescedRDD.scala:96)
  2207. at org.apache.spark.rdd.CoalescedRDD$$anonfun$compute$1.apply(CoalescedRDD.scala:95)
  2208. at scala.collection.Iterator$$anon$13.hasNext(Iterator.scala:371)
  2209. at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
  2210. at scala.collection.Iterator$class.foreach(Iterator.scala:727)
  2211. at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
  2212. at scala.collection.generic.Growable$class.$plus$plus$eq(Growable.scala:48)
  2213. at scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:103)
  2214. at scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:47)
  2215. at scala.collection.TraversableOnce$class.to(TraversableOnce.scala:273)
  2216. at scala.collection.AbstractIterator.to(Iterator.scala:1157)
  2217. at scala.collection.TraversableOnce$class.toBuffer(TraversableOnce.scala:265)
  2218. at scala.collection.AbstractIterator.toBuffer(Iterator.scala:1157)
  2219. at scala.collection.TraversableOnce$class.toArray(TraversableOnce.scala:252)
  2220. at scala.collection.AbstractIterator.toArray(Iterator.scala:1157)
  2221. at org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$12.apply(RDD.scala:927)
  2222. at org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$12.apply(RDD.scala:927)
  2223. at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1858)
  2224. at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1858)
  2225. at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66)
  2226. at org.apache.spark.scheduler.Task.run(Task.scala:89)
  2227. at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:213)
  2228. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  2229. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  2230. at java.lang.Thread.run(Thread.java:745)
  2231.  
  2232. )
  2233. 16/04/23 21:15:00 INFO DAGScheduler: Marking ResultStage 14 (collect at Word2VecOnCluster.scala:264) as failed due to a fetch failure from ShuffleMapStage 13 (repartition at Word2VecOnCluster.scala:262)
  2234. 16/04/23 21:15:00 INFO YarnClusterScheduler: Removed TaskSet 14.2, whose tasks have all completed, from pool
  2235. 16/04/23 21:15:00 INFO DAGScheduler: ResultStage 14 (collect at Word2VecOnCluster.scala:264) failed in 175.436 s
  2236. 16/04/23 21:15:00 INFO DAGScheduler: Resubmitting ShuffleMapStage 13 (repartition at Word2VecOnCluster.scala:262) and ResultStage 14 (collect at Word2VecOnCluster.scala:264) due to fetch failure
  2237. 16/04/23 21:15:01 INFO DAGScheduler: Resubmitting failed stages
  2238. 16/04/23 21:15:01 INFO DAGScheduler: Submitting ShuffleMapStage 13 (MapPartitionsRDD[35] at repartition at Word2VecOnCluster.scala:262), which has no missing parents
  2239. 16/04/23 21:15:01 INFO MemoryStore: Block broadcast_23 stored as values in memory (estimated size 2.9 KB, free 838.9 MB)
  2240. 16/04/23 21:15:01 INFO MemoryStore: Block broadcast_23_piece0 stored as bytes in memory (estimated size 1786.0 B, free 838.9 MB)
  2241. 16/04/23 21:15:01 INFO BlockManagerInfo: Added broadcast_23_piece0 in memory on 192.168.0.111:33952 (size: 1786.0 B, free: 12.9 GB)
  2242. 16/04/23 21:15:01 INFO SparkContext: Created broadcast 23 from broadcast at DAGScheduler.scala:1006
  2243. 16/04/23 21:15:01 INFO DAGScheduler: Submitting 3 missing tasks from ShuffleMapStage 13 (MapPartitionsRDD[35] at repartition at Word2VecOnCluster.scala:262)
  2244. 16/04/23 21:15:01 INFO YarnClusterScheduler: Adding task set 13.3 with 3 tasks
  2245. 16/04/23 21:15:01 WARN TaskSetManager: Stage 13 contains a task of very large size (25493 KB). The maximum recommended task size is 100 KB.
  2246. 16/04/23 21:15:01 INFO TaskSetManager: Starting task 0.0 in stage 13.3 (TID 1300, node03.hadoop.know-center.at, partition 1,PROCESS_LOCAL, 26105840 bytes)
  2247. 16/04/23 21:15:01 INFO TaskSetManager: Starting task 1.0 in stage 13.3 (TID 1301, node12.hadoop.know-center.at, partition 6,PROCESS_LOCAL, 26108050 bytes)
  2248. 16/04/23 21:15:01 INFO TaskSetManager: Starting task 2.0 in stage 13.3 (TID 1302, node11.hadoop.know-center.at, partition 9,PROCESS_LOCAL, 26106786 bytes)
  2249. 16/04/23 21:15:01 INFO BlockManagerInfo: Added broadcast_23_piece0 in memory on node11.hadoop.know-center.at:55870 (size: 1786.0 B, free: 14.2 GB)
  2250. 16/04/23 21:15:02 INFO BlockManagerInfo: Added broadcast_23_piece0 in memory on node03.hadoop.know-center.at:54818 (size: 1786.0 B, free: 14.2 GB)
  2251. 16/04/23 21:15:03 INFO BlockManagerInfo: Added broadcast_23_piece0 in memory on node12.hadoop.know-center.at:47788 (size: 1786.0 B, free: 14.2 GB)
  2252. 16/04/23 21:15:04 INFO YarnAllocator: Will request 2 executor containers, each with 8 cores and 20864 MB memory including 384 MB overhead
  2253. 16/04/23 21:15:04 INFO YarnAllocator: Container request (host: Any, capability: <memory:20864, vCores:8>)
  2254. 16/04/23 21:15:04 INFO YarnAllocator: Container request (host: Any, capability: <memory:20864, vCores:8>)
  2255. 16/04/23 21:15:04 INFO AMRMClientImpl: Received new token for : node13.hadoop.know-center.at:45454
  2256. 16/04/23 21:15:04 INFO AMRMClientImpl: Received new token for : node14.hadoop.know-center.at:45454
  2257. 16/04/23 21:15:04 INFO YarnAllocator: Launching container container_e05_1459928874908_0230_02_000015 for on host node13.hadoop.know-center.at
  2258. 16/04/23 21:15:04 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: spark://CoarseGrainedScheduler@192.168.0.111:59844, executorHostname: node13.hadoop.know-center.at
  2259. 16/04/23 21:15:04 INFO YarnAllocator: Launching container container_e05_1459928874908_0230_02_000016 for on host node14.hadoop.know-center.at
  2260. 16/04/23 21:15:04 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: spark://CoarseGrainedScheduler@192.168.0.111:59844, executorHostname: node14.hadoop.know-center.at
  2261. 16/04/23 21:15:04 INFO YarnAllocator: Received 2 containers from YARN, launching executors on 2 of them.
  2262. 16/04/23 21:15:04 INFO ExecutorRunnable: Starting Executor Container
  2263. 16/04/23 21:15:04 INFO ExecutorRunnable: Starting Executor Container
  2264. 16/04/23 21:15:04 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0
  2265. 16/04/23 21:15:04 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0
  2266. 16/04/23 21:15:04 INFO ExecutorRunnable: Setting up ContainerLaunchContext
  2267. 16/04/23 21:15:04 INFO ExecutorRunnable: Setting up ContainerLaunchContext
  2268. 16/04/23 21:15:04 INFO ExecutorRunnable: Preparing Local resources
  2269. 16/04/23 21:15:04 INFO ExecutorRunnable: Preparing Local resources
  2270. 16/04/23 21:15:04 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "master01.hadoop.know-center.at" port: 8020 file: "/user/sfalk/.sparkStaging/application_1459928874908_0230/wordvectors-final.jar" } size: 1279239848 timestamp: 1461433144865 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "master01.hadoop.know-center.at" port: 8020 file: "/hdp/apps/2.4.0.0-169/spark/spark-hdp-assembly.jar" } size: 191724642 timestamp: 1456930414488 type: FILE visibility: PUBLIC)
  2271. 16/04/23 21:15:04 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "master01.hadoop.know-center.at" port: 8020 file: "/user/sfalk/.sparkStaging/application_1459928874908_0230/wordvectors-final.jar" } size: 1279239848 timestamp: 1461433144865 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "master01.hadoop.know-center.at" port: 8020 file: "/hdp/apps/2.4.0.0-169/spark/spark-hdp-assembly.jar" } size: 191724642 timestamp: 1456930414488 type: FILE visibility: PUBLIC)
  2272. 16/04/23 21:15:04 INFO Client: Using the spark assembly jar on HDFS because you are using HDP, defaultSparkAssembly:hdfs://master01.hadoop.know-center.at:8020/hdp/apps/2.4.0.0-169/spark/spark-hdp-assembly.jar
  2273. 16/04/23 21:15:04 INFO Client: Using the spark assembly jar on HDFS because you are using HDP, defaultSparkAssembly:hdfs://master01.hadoop.know-center.at:8020/hdp/apps/2.4.0.0-169/spark/spark-hdp-assembly.jar
  2274. 16/04/23 21:15:05 INFO ExecutorRunnable:
  2275. ===============================================================================
  2276. YARN executor launch context:
  2277. env:
  2278. CLASSPATH -> {{PWD}}<CPS>{{PWD}}/__spark__.jar<CPS>$HADOOP_CONF_DIR<CPS>/usr/hdp/current/hadoop-client/*<CPS>/usr/hdp/current/hadoop-client/lib/*<CPS>/usr/hdp/current/hadoop-hdfs-client/*<CPS>/usr/hdp/current/hadoop-hdfs-client/lib/*<CPS>/usr/hdp/current/hadoop-yarn-client/*<CPS>/usr/hdp/current/hadoop-yarn-client/lib/*<CPS>$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:$PWD/mr-framework/hadoop/share/hadoop/tools/lib/*:/usr/hdp/2.4.0.0-169/hadoop/lib/hadoop-lzo-0.6.0.2.4.0.0-169.jar:/etc/hadoop/conf/secure
  2279. SPARK_LOG_URL_STDERR -> http://node14.hadoop.know-center.at:8042/node/containerlogs/container_e05_1459928874908_0230_02_000016/sfalk/stderr?start=-4096
  2280. SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1459928874908_0230
  2281. SPARK_YARN_CACHE_FILES_FILE_SIZES -> 191724642,1279239848
  2282. SPARK_USER -> sfalk
  2283. SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE
  2284. SPARK_YARN_MODE -> true
  2285. SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1456930414488,1461433144865
  2286. SPARK_LOG_URL_STDOUT -> http://node14.hadoop.know-center.at:8042/node/containerlogs/container_e05_1459928874908_0230_02_000016/sfalk/stdout?start=-4096
  2287. SPARK_YARN_CACHE_FILES -> hdfs://master01.hadoop.know-center.at:8020/hdp/apps/2.4.0.0-169/spark/spark-hdp-assembly.jar#__spark__.jar,hdfs://master01.hadoop.know-center.at:8020/user/sfalk/.sparkStaging/application_1459928874908_0230/wordvectors-final.jar#__app__.jar
  2288.  
  2289. command:
  2290. {{JAVA_HOME}}/bin/java -server -XX:OnOutOfMemoryError='kill %p' -Xms20480m -Xmx20480m -Djava.io.tmpdir={{PWD}}/tmp '-Dspark.driver.port=59844' '-Dspark.akka.frameSize=2000' '-Dspark.history.ui.port=18080' '-Dspark.ui.port=0' -Dspark.yarn.app.container.log.dir=<LOG_DIR> org.apache.spark.executor.CoarseGrainedExecutorBackend --driver-url spark://CoarseGrainedScheduler@192.168.0.111:59844 --executor-id 11 --hostname node14.hadoop.know-center.at --cores 8 --app-id application_1459928874908_0230 --user-class-path file:$PWD/__app__.jar 1> <LOG_DIR>/stdout 2> <LOG_DIR>/stderr
  2291. ===============================================================================
  2292.  
  2293. 16/04/23 21:15:05 INFO ExecutorRunnable:
  2294. ===============================================================================
  2295. YARN executor launch context:
  2296. env:
  2297. CLASSPATH -> {{PWD}}<CPS>{{PWD}}/__spark__.jar<CPS>$HADOOP_CONF_DIR<CPS>/usr/hdp/current/hadoop-client/*<CPS>/usr/hdp/current/hadoop-client/lib/*<CPS>/usr/hdp/current/hadoop-hdfs-client/*<CPS>/usr/hdp/current/hadoop-hdfs-client/lib/*<CPS>/usr/hdp/current/hadoop-yarn-client/*<CPS>/usr/hdp/current/hadoop-yarn-client/lib/*<CPS>$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:$PWD/mr-framework/hadoop/share/hadoop/tools/lib/*:/usr/hdp/2.4.0.0-169/hadoop/lib/hadoop-lzo-0.6.0.2.4.0.0-169.jar:/etc/hadoop/conf/secure
  2298. SPARK_LOG_URL_STDERR -> http://node13.hadoop.know-center.at:8042/node/containerlogs/container_e05_1459928874908_0230_02_000015/sfalk/stderr?start=-4096
  2299. SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1459928874908_0230
  2300. SPARK_YARN_CACHE_FILES_FILE_SIZES -> 191724642,1279239848
  2301. SPARK_USER -> sfalk
  2302. SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE
  2303. SPARK_YARN_MODE -> true
  2304. SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1456930414488,1461433144865
  2305. SPARK_LOG_URL_STDOUT -> http://node13.hadoop.know-center.at:8042/node/containerlogs/container_e05_1459928874908_0230_02_000015/sfalk/stdout?start=-4096
  2306. SPARK_YARN_CACHE_FILES -> hdfs://master01.hadoop.know-center.at:8020/hdp/apps/2.4.0.0-169/spark/spark-hdp-assembly.jar#__spark__.jar,hdfs://master01.hadoop.know-center.at:8020/user/sfalk/.sparkStaging/application_1459928874908_0230/wordvectors-final.jar#__app__.jar
  2307.  
  2308. command:
  2309. {{JAVA_HOME}}/bin/java -server -XX:OnOutOfMemoryError='kill %p' -Xms20480m -Xmx20480m -Djava.io.tmpdir={{PWD}}/tmp '-Dspark.driver.port=59844' '-Dspark.akka.frameSize=2000' '-Dspark.history.ui.port=18080' '-Dspark.ui.port=0' -Dspark.yarn.app.container.log.dir=<LOG_DIR> org.apache.spark.executor.CoarseGrainedExecutorBackend --driver-url spark://CoarseGrainedScheduler@192.168.0.111:59844 --executor-id 10 --hostname node13.hadoop.know-center.at --cores 8 --app-id application_1459928874908_0230 --user-class-path file:$PWD/__app__.jar 1> <LOG_DIR>/stdout 2> <LOG_DIR>/stderr
  2310. ===============================================================================
  2311.  
  2312. 16/04/23 21:15:05 INFO ContainerManagementProtocolProxy: Opening proxy : node14.hadoop.know-center.at:45454
  2313. 16/04/23 21:15:05 INFO ContainerManagementProtocolProxy: Opening proxy : node13.hadoop.know-center.at:45454
  2314. 16/04/23 21:15:05 INFO TaskSetManager: Finished task 2.0 in stage 13.3 (TID 1302) in 3772 ms on node11.hadoop.know-center.at (1/3)
  2315. 16/04/23 21:15:06 INFO TaskSetManager: Finished task 0.0 in stage 13.3 (TID 1300) in 5036 ms on node03.hadoop.know-center.at (2/3)
  2316. 16/04/23 21:15:07 INFO TaskSetManager: Finished task 1.0 in stage 13.3 (TID 1301) in 5965 ms on node12.hadoop.know-center.at (3/3)
  2317. 16/04/23 21:15:07 INFO DAGScheduler: ShuffleMapStage 13 (repartition at Word2VecOnCluster.scala:262) finished in 6.052 s
  2318. 16/04/23 21:15:07 INFO YarnClusterScheduler: Removed TaskSet 13.3, whose tasks have all completed, from pool
  2319. 16/04/23 21:15:07 INFO DAGScheduler: looking for newly runnable stages
  2320. 16/04/23 21:15:07 INFO DAGScheduler: running: Set()
  2321. 16/04/23 21:15:07 INFO DAGScheduler: waiting: Set(ResultStage 14)
  2322. 16/04/23 21:15:07 INFO DAGScheduler: failed: Set()
  2323. 16/04/23 21:15:07 INFO DAGScheduler: Submitting ResultStage 14 (MapPartitionsRDD[38] at repartition at Word2VecOnCluster.scala:262), which has no missing parents
  2324. 16/04/23 21:15:07 INFO MemoryStore: Block broadcast_24 stored as values in memory (estimated size 3.1 KB, free 838.9 MB)
  2325. 16/04/23 21:15:07 INFO MemoryStore: Block broadcast_24_piece0 stored as bytes in memory (estimated size 1882.0 B, free 838.9 MB)
  2326. 16/04/23 21:15:07 INFO BlockManagerInfo: Added broadcast_24_piece0 in memory on 192.168.0.111:33952 (size: 1882.0 B, free: 12.9 GB)
  2327. 16/04/23 21:15:07 INFO SparkContext: Created broadcast 24 from broadcast at DAGScheduler.scala:1006
  2328. 16/04/23 21:15:07 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 14 (MapPartitionsRDD[38] at repartition at Word2VecOnCluster.scala:262)
  2329. 16/04/23 21:15:07 INFO YarnClusterScheduler: Adding task set 14.3 with 1 tasks
  2330. 16/04/23 21:15:07 INFO TaskSetManager: Starting task 0.0 in stage 14.3 (TID 1303, node03.hadoop.know-center.at, partition 0,NODE_LOCAL, 2163 bytes)
  2331. 16/04/23 21:15:07 INFO BlockManagerInfo: Added broadcast_24_piece0 in memory on node03.hadoop.know-center.at:54818 (size: 1882.0 B, free: 14.2 GB)
  2332. 16/04/23 21:15:07 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 6 to node03.hadoop.know-center.at:38711
  2333. 16/04/23 21:15:07 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 6 is 194 bytes
  2334. 16/04/23 21:15:08 INFO YarnClusterSchedulerBackend: Registered executor NettyRpcEndpointRef(null) (node13.hadoop.know-center.at:44284) with ID 10
  2335. 16/04/23 21:15:08 INFO BlockManagerMasterEndpoint: Registering block manager node13.hadoop.know-center.at:60950 with 14.2 GB RAM, BlockManagerId(10, node13.hadoop.know-center.at, 60950)
  2336. 16/04/23 21:15:56 INFO BlockManagerInfo: Removed broadcast_21_piece0 on 192.168.0.111:33952 in memory (size: 1786.0 B, free: 12.9 GB)
  2337. 16/04/23 21:15:56 ERROR TransportRequestHandler: Error sending result RpcResponse{requestId=5624666706194782998, body=NioManagedBuffer{buf=java.nio.HeapByteBuffer[pos=0 lim=81 cap=81]}} to node12.hadoop.know-center.at/192.168.0.112:36254; closing connection
  2338. java.io.IOException: Broken pipe
  2339. at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
  2340. at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
  2341. at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
  2342. at sun.nio.ch.IOUtil.write(IOUtil.java:65)
  2343. at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
  2344. at org.apache.spark.network.protocol.MessageWithHeader.copyByteBuf(MessageWithHeader.java:105)
  2345. at org.apache.spark.network.protocol.MessageWithHeader.transferTo(MessageWithHeader.java:79)
  2346. at io.netty.channel.socket.nio.NioSocketChannel.doWriteFileRegion(NioSocketChannel.java:254)
  2347. at io.netty.channel.nio.AbstractNioByteChannel.doWrite(AbstractNioByteChannel.java:237)
  2348. at io.netty.channel.socket.nio.NioSocketChannel.doWrite(NioSocketChannel.java:281)
  2349. at io.netty.channel.AbstractChannel$AbstractUnsafe.flush0(AbstractChannel.java:761)
  2350. at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.flush0(AbstractNioChannel.java:311)
  2351. at io.netty.channel.AbstractChannel$AbstractUnsafe.flush(AbstractChannel.java:729)
  2352. at io.netty.channel.DefaultChannelPipeline$HeadContext.flush(DefaultChannelPipeline.java:1127)
  2353. at io.netty.channel.AbstractChannelHandlerContext.invokeFlush(AbstractChannelHandlerContext.java:663)
  2354. at io.netty.channel.AbstractChannelHandlerContext.flush(AbstractChannelHandlerContext.java:644)
  2355. at io.netty.channel.ChannelOutboundHandlerAdapter.flush(ChannelOutboundHandlerAdapter.java:115)
  2356. at io.netty.channel.AbstractChannelHandlerContext.invokeFlush(AbstractChannelHandlerContext.java:663)
  2357. at io.netty.channel.AbstractChannelHandlerContext.flush(AbstractChannelHandlerContext.java:644)
  2358. at io.netty.channel.ChannelDuplexHandler.flush(ChannelDuplexHandler.java:117)
  2359. at io.netty.channel.AbstractChannelHandlerContext.invokeFlush(AbstractChannelHandlerContext.java:663)
  2360. at io.netty.channel.AbstractChannelHandlerContext.access$1500(AbstractChannelHandlerContext.java:32)
  2361. at io.netty.channel.AbstractChannelHandlerContext$WriteAndFlushTask.write(AbstractChannelHandlerContext.java:961)
  2362. at io.netty.channel.AbstractChannelHandlerContext$AbstractWriteTask.run(AbstractChannelHandlerContext.java:893)
  2363. at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
  2364. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
  2365. at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
  2366. at java.lang.Thread.run(Thread.java:745)
  2367. 16/04/23 21:15:56 INFO YarnClusterSchedulerBackend: Disabling executor 4.
  2368. 16/04/23 21:15:56 INFO DAGScheduler: Executor lost: 4 (epoch 20)
  2369. 16/04/23 21:15:56 ERROR YarnClusterScheduler: Lost executor 4 on node12.hadoop.know-center.at: Container container_e05_1459928874908_0230_02_000005 exited from explicit termination request.
  2370. 16/04/23 21:15:56 INFO BlockManagerMasterEndpoint: Trying to remove executor 4 from BlockManagerMaster.
  2371. 16/04/23 21:15:56 INFO BlockManagerMaster: Removed 4 successfully in removeExecutor
  2372. 16/04/23 21:15:56 INFO BlockManagerInfo: Removed broadcast_21_piece0 on node11.hadoop.know-center.at:55870 in memory (size: 1786.0 B, free: 14.2 GB)
  2373. 16/04/23 21:16:05 INFO TaskSetManager: Ignoring task-finished event for 0.0 in stage 14.0 because task 0 has already completed successfully
  2374. 16/04/23 21:16:05 INFO YarnClusterScheduler: Removed TaskSet 14.0, whose tasks have all completed, from pool
  2375. 16/04/23 21:16:05 INFO DAGScheduler: ResultStage 14 (collect at Word2VecOnCluster.scala:264) finished in 58.092 s
  2376. 16/04/23 21:16:05 INFO DAGScheduler: Job 5 finished: collect at Word2VecOnCluster.scala:264, took 612.863833 s
  2377. 16/04/23 21:16:09 INFO FileOutputCommitter: File Output Committer Algorithm version is 1
  2378. 16/04/23 21:16:09 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false
  2379. 16/04/23 21:16:09 INFO SparkContext: Starting job: saveAsTextFile at Word2VecOnCluster.scala:283
  2380. 16/04/23 21:16:09 INFO DAGScheduler: Got job 6 (saveAsTextFile at Word2VecOnCluster.scala:283) with 1 output partitions
  2381. 16/04/23 21:16:09 INFO DAGScheduler: Final stage: ResultStage 15 (saveAsTextFile at Word2VecOnCluster.scala:283)
  2382. 16/04/23 21:16:09 INFO DAGScheduler: Parents of final stage: List()
  2383. 16/04/23 21:16:09 INFO DAGScheduler: Missing parents: List()
  2384. 16/04/23 21:16:09 INFO DAGScheduler: Submitting ResultStage 15 (MapPartitionsRDD[40] at saveAsTextFile at Word2VecOnCluster.scala:283), which has no missing parents
  2385. 16/04/23 21:16:10 INFO MemoryStore: Block broadcast_25 stored as values in memory (estimated size 82.8 KB, free 839.0 MB)
  2386. 16/04/23 21:16:10 INFO MemoryStore: Block broadcast_25_piece0 stored as bytes in memory (estimated size 29.7 KB, free 839.0 MB)
  2387. 16/04/23 21:16:10 INFO BlockManagerInfo: Added broadcast_25_piece0 in memory on 192.168.0.111:33952 (size: 29.7 KB, free: 12.9 GB)
  2388. 16/04/23 21:16:10 INFO SparkContext: Created broadcast 25 from broadcast at DAGScheduler.scala:1006
  2389. 16/04/23 21:16:10 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 15 (MapPartitionsRDD[40] at saveAsTextFile at Word2VecOnCluster.scala:283)
  2390. 16/04/23 21:16:10 INFO YarnClusterScheduler: Adding task set 15.0 with 1 tasks
  2391. 16/04/23 21:16:14 WARN TaskSetManager: Stage 15 contains a task of very large size (804109 KB). The maximum recommended task size is 100 KB.
  2392. 16/04/23 21:16:14 INFO TaskSetManager: Starting task 0.0 in stage 15.0 (TID 1304, node13.hadoop.know-center.at, partition 0,PROCESS_LOCAL, 823407941 bytes)
  2393. 16/04/23 21:16:38 ERROR ApplicationMaster: RECEIVED SIGNAL 15: SIGTERM
  2394. 16/04/23 21:16:38 INFO SparkContext: Invoking stop() from shutdown hook
  2395. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/metrics/json,null}
  2396. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/stage/kill,null}
  2397. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/api,null}
  2398. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/,null}
  2399. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/static,null}
  2400. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/executors/threadDump/json,null}
  2401. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/executors/threadDump,null}
  2402. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/executors/json,null}
  2403. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/executors,null}
  2404. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/environment/json,null}
  2405. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/environment,null}
  2406. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/storage/rdd/json,null}
  2407. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/storage/rdd,null}
  2408. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/storage/json,null}
  2409. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/storage,null}
  2410. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/pool/json,null}
  2411. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/pool,null}
  2412. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/stage/json,null}
  2413. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/stage,null}
  2414. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/json,null}
  2415. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages,null}
  2416. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/jobs/job/json,null}
  2417. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/jobs/job,null}
  2418. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/jobs/json,null}
  2419. 16/04/23 21:16:38 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/jobs,null}
  2420. 16/04/23 21:16:38 INFO SparkUI: Stopped Spark web UI at http://192.168.0.111:38561
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!