API tools faq
paste
Advertisement
Guest User

Untitled

a guest
May 20th, 2022
27
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 61.86 KB | None | 0 0
raw download clone embed print report
  1.  
  2. 2022-05-19 13:36:04
  3. Full thread dump OpenJDK 64-Bit Server VM (25.312-b07 mixed mode):
  4.  
  5. "Attach Listener" #122 daemon prio=9 os_prio=0 tid=0x00007f9358001000 nid=0x6f9e waiting on condition [0x0000000000000000]
  6. java.lang.Thread.State: RUNNABLE
  7.  
  8. Locked ownable synchronizers:
  9. - None
  10.  
  11. "task-result-getter-3" #88 daemon prio=5 os_prio=0 tid=0x00007f93241fa800 nid=0x6f51 waiting on condition [0x00007f9382cf9000]
  12. java.lang.Thread.State: WAITING (parking)
  13. at sun.misc.Unsafe.park(Native Method)
  14. - parking to wait for <0x00000000c635fff0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  15. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  16. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  17. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  18. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
  19. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
  20. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  21. at java.lang.Thread.run(Thread.java:748)
  22.  
  23. Locked ownable synchronizers:
  24. - None
  25.  
  26. "task-result-getter-2" #87 daemon prio=5 os_prio=0 tid=0x00007f93241f8800 nid=0x6f50 waiting on condition [0x00007f9382dfa000]
  27. java.lang.Thread.State: WAITING (parking)
  28. at sun.misc.Unsafe.park(Native Method)
  29. - parking to wait for <0x00000000c635fff0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  30. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  31. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  32. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  33. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
  34. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
  35. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  36. at java.lang.Thread.run(Thread.java:748)
  37.  
  38. Locked ownable synchronizers:
  39. - None
  40.  
  41. "task-result-getter-1" #80 daemon prio=5 os_prio=0 tid=0x00007f9330010000 nid=0x6f48 waiting on condition [0x00007f93882bd000]
  42. java.lang.Thread.State: WAITING (parking)
  43. at sun.misc.Unsafe.park(Native Method)
  44. - parking to wait for <0x00000000c635fff0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  45. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  46. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  47. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  48. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
  49. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
  50. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  51. at java.lang.Thread.run(Thread.java:748)
  52.  
  53. Locked ownable synchronizers:
  54. - None
  55.  
  56. "task-result-getter-0" #70 daemon prio=5 os_prio=0 tid=0x00007f93242d0800 nid=0x6f39 waiting on condition [0x00007f938a1f6000]
  57. java.lang.Thread.State: WAITING (parking)
  58. at sun.misc.Unsafe.park(Native Method)
  59. - parking to wait for <0x00000000c635fff0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  60. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  61. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  62. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  63. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
  64. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
  65. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  66. at java.lang.Thread.run(Thread.java:748)
  67.  
  68. Locked ownable synchronizers:
  69. - None
  70.  
  71. "org.apache.hadoop.hdfs.PeerCache@13d2106b" #68 daemon prio=5 os_prio=0 tid=0x00007f928c09c800 nid=0x6f37 waiting on condition [0x00007f93891c4000]
  72. java.lang.Thread.State: TIMED_WAITING (sleeping)
  73. at java.lang.Thread.sleep(Native Method)
  74. at org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253)
  75. at org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46)
  76. at org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124)
  77. at java.lang.Thread.run(Thread.java:748)
  78.  
  79. Locked ownable synchronizers:
  80. - None
  81.  
  82. "org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner" #57 daemon prio=5 os_prio=0 tid=0x00007f93bb2d8800 nid=0x6f21 in Object.wait() [0x00007f938b6f9000]
  83. java.lang.Thread.State: WAITING (on object monitor)
  84. at java.lang.Object.wait(Native Method)
  85. at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
  86. - locked <0x00000000c613d578> (a java.lang.ref.ReferenceQueue$Lock)
  87. at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
  88. at org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3839)
  89. at java.lang.Thread.run(Thread.java:748)
  90.  
  91. Locked ownable synchronizers:
  92. - None
  93.  
  94. "spark-listener-group-shared" #52 daemon prio=5 os_prio=0 tid=0x00007f93bbd0c800 nid=0x6e75 waiting on condition [0x00007f938b9fa000]
  95. java.lang.Thread.State: WAITING (parking)
  96. at sun.misc.Unsafe.park(Native Method)
  97. - parking to wait for <0x00000000c61eb9b8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  98. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  99. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  100. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  101. at org.apache.spark.scheduler.AsyncEventQueue.$anonfun$dispatch$1(AsyncEventQueue.scala:110)
  102. at org.apache.spark.scheduler.AsyncEventQueue$$Lambda$1771/1583004424.apply$mcJ$sp(Unknown Source)
  103. at scala.runtime.java8.JFunction0$mcJ$sp.apply(JFunction0$mcJ$sp.java:23)
  104. at scala.util.DynamicVariable.withValue(DynamicVariable.scala:62)
  105. at org.apache.spark.scheduler.AsyncEventQueue.org$apache$spark$scheduler$AsyncEventQueue$$dispatch(AsyncEventQueue.scala:100)
  106. at org.apache.spark.scheduler.AsyncEventQueue$$anon$2.$anonfun$run$1(AsyncEventQueue.scala:96)
  107. at org.apache.spark.scheduler.AsyncEventQueue$$anon$2$$Lambda$1770/1516582044.apply$mcV$sp(Unknown Source)
  108. at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1381)
  109. at org.apache.spark.scheduler.AsyncEventQueue$$anon$2.run(AsyncEventQueue.scala:96)
  110.  
  111. Locked ownable synchronizers:
  112. - None
  113.  
  114. "element-tracking-store-worker" #51 daemon prio=5 os_prio=0 tid=0x00007f92b0014800 nid=0x6e74 waiting on condition [0x00007f938bafb000]
  115. java.lang.Thread.State: WAITING (parking)
  116. at sun.misc.Unsafe.park(Native Method)
  117. - parking to wait for <0x00000000c6190d60> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  118. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  119. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  120. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  121. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
  122. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
  123. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  124. at java.lang.Thread.run(Thread.java:748)
  125.  
  126. Locked ownable synchronizers:
  127. - None
  128.  
  129. "spark-listener-group-executorManagement" #40 daemon prio=5 os_prio=0 tid=0x00007f93bbcc0000 nid=0x6e73 waiting on condition [0x00007f938bbfc000]
  130. java.lang.Thread.State: WAITING (parking)
  131. at sun.misc.Unsafe.park(Native Method)
  132. - parking to wait for <0x00000000c61922f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  133. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  134. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  135. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  136. at org.apache.spark.scheduler.AsyncEventQueue.$anonfun$dispatch$1(AsyncEventQueue.scala:110)
  137. at org.apache.spark.scheduler.AsyncEventQueue$$Lambda$1771/1583004424.apply$mcJ$sp(Unknown Source)
  138. at scala.runtime.java8.JFunction0$mcJ$sp.apply(JFunction0$mcJ$sp.java:23)
  139. at scala.util.DynamicVariable.withValue(DynamicVariable.scala:62)
  140. at org.apache.spark.scheduler.AsyncEventQueue.org$apache$spark$scheduler$AsyncEventQueue$$dispatch(AsyncEventQueue.scala:100)
  141. at org.apache.spark.scheduler.AsyncEventQueue$$anon$2.$anonfun$run$1(AsyncEventQueue.scala:96)
  142. at org.apache.spark.scheduler.AsyncEventQueue$$anon$2$$Lambda$1770/1516582044.apply$mcV$sp(Unknown Source)
  143. at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1381)
  144. at org.apache.spark.scheduler.AsyncEventQueue$$anon$2.run(AsyncEventQueue.scala:96)
  145.  
  146. Locked ownable synchronizers:
  147. - None
  148.  
  149. "spark-listener-group-appStatus" #16 daemon prio=5 os_prio=0 tid=0x00007f93bbcbd800 nid=0x6e72 waiting on condition [0x00007f938bcfd000]
  150. java.lang.Thread.State: WAITING (parking)
  151. at sun.misc.Unsafe.park(Native Method)
  152. - parking to wait for <0x00000000c6071690> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  153. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  154. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  155. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  156. at org.apache.spark.scheduler.AsyncEventQueue.$anonfun$dispatch$1(AsyncEventQueue.scala:110)
  157. at org.apache.spark.scheduler.AsyncEventQueue$$Lambda$1771/1583004424.apply$mcJ$sp(Unknown Source)
  158. at scala.runtime.java8.JFunction0$mcJ$sp.apply(JFunction0$mcJ$sp.java:23)
  159. at scala.util.DynamicVariable.withValue(DynamicVariable.scala:62)
  160. at org.apache.spark.scheduler.AsyncEventQueue.org$apache$spark$scheduler$AsyncEventQueue$$dispatch(AsyncEventQueue.scala:100)
  161. at org.apache.spark.scheduler.AsyncEventQueue$$anon$2.$anonfun$run$1(AsyncEventQueue.scala:96)
  162. at org.apache.spark.scheduler.AsyncEventQueue$$anon$2$$Lambda$1770/1516582044.apply$mcV$sp(Unknown Source)
  163. at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1381)
  164. at org.apache.spark.scheduler.AsyncEventQueue$$anon$2.run(AsyncEventQueue.scala:96)
  165.  
  166. Locked ownable synchronizers:
  167. - None
  168.  
  169. "context-cleaner-periodic-gc" #50 daemon prio=5 os_prio=0 tid=0x00007f93bbcb4000 nid=0x6e71 waiting on condition [0x00007f938bdfe000]
  170. java.lang.Thread.State: TIMED_WAITING (parking)
  171. at sun.misc.Unsafe.park(Native Method)
  172. - parking to wait for <0x00000000c613dc50> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  173. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
  174. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
  175. at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
  176. at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
  177. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
  178. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
  179. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  180. at java.lang.Thread.run(Thread.java:748)
  181.  
  182. Locked ownable synchronizers:
  183. - None
  184.  
  185. "Spark Context Cleaner" #49 daemon prio=5 os_prio=0 tid=0x00007f93bbcb2800 nid=0x6e70 in Object.wait() [0x00007f9390154000]
  186. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  187. at java.lang.Object.wait(Native Method)
  188. at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
  189. - locked <0x00000000c613e340> (a java.lang.ref.ReferenceQueue$Lock)
  190. at org.apache.spark.ContextCleaner.$anonfun$keepCleaning$1(ContextCleaner.scala:191)
  191. at org.apache.spark.ContextCleaner$$Lambda$1765/1948791949.apply$mcV$sp(Unknown Source)
  192. at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1381)
  193. at org.apache.spark.ContextCleaner.org$apache$spark$ContextCleaner$$keepCleaning(ContextCleaner.scala:189)
  194. at org.apache.spark.ContextCleaner$$anon$1.run(ContextCleaner.scala:79)
  195.  
  196. Locked ownable synchronizers:
  197. - None
  198.  
  199. "shuffle-boss-6-1" #48 daemon prio=5 os_prio=0 tid=0x00007f93bba49800 nid=0x6e6f runnable [0x00007f9390455000]
  200. java.lang.Thread.State: RUNNABLE
  201. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  202. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  203. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
  204. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
  205. - locked <0x00000000c623a4c0> (a io.netty.channel.nio.SelectedSelectionKeySet)
  206. - locked <0x00000000c62824e8> (a java.util.Collections$UnmodifiableSet)
  207. - locked <0x00000000c623a428> (a sun.nio.ch.EPollSelectorImpl)
  208. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
  209. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
  210. at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68)
  211. at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:803)
  212. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
  213. at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
  214. at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
  215. at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
  216. at java.lang.Thread.run(Thread.java:748)
  217.  
  218. Locked ownable synchronizers:
  219. - None
  220.  
  221. "executor-heartbeater" #47 daemon prio=5 os_prio=0 tid=0x00007f93bba3f800 nid=0x6e6e waiting on condition [0x00007f9390556000]
  222. java.lang.Thread.State: TIMED_WAITING (parking)
  223. at sun.misc.Unsafe.park(Native Method)
  224. - parking to wait for <0x00000000c6317b58> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  225. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
  226. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
  227. at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
  228. at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
  229. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
  230. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
  231. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  232. at java.lang.Thread.run(Thread.java:748)
  233.  
  234. Locked ownable synchronizers:
  235. - None
  236.  
  237. "driver-heartbeater" #46 daemon prio=5 os_prio=0 tid=0x00007f93bba14000 nid=0x6e6d waiting on condition [0x00007f9390657000]
  238. java.lang.Thread.State: TIMED_WAITING (parking)
  239. at sun.misc.Unsafe.park(Native Method)
  240. - parking to wait for <0x00000000c6318e88> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  241. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
  242. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
  243. at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
  244. at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
  245. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
  246. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
  247. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  248. at java.lang.Thread.run(Thread.java:748)
  249.  
  250. Locked ownable synchronizers:
  251. - None
  252.  
  253. "dag-scheduler-event-loop" #45 daemon prio=5 os_prio=0 tid=0x00007f93bb9db000 nid=0x6e6c waiting on condition [0x00007f9390958000]
  254. java.lang.Thread.State: WAITING (parking)
  255. at sun.misc.Unsafe.park(Native Method)
  256. - parking to wait for <0x00000000c6319830> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  257. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  258. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  259. at java.util.concurrent.LinkedBlockingDeque.takeFirst(LinkedBlockingDeque.java:492)
  260. at java.util.concurrent.LinkedBlockingDeque.take(LinkedBlockingDeque.java:680)
  261. at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:47)
  262.  
  263. Locked ownable synchronizers:
  264. - None
  265.  
  266. "Timer-1" #44 daemon prio=5 os_prio=0 tid=0x00007f93bb9ab000 nid=0x6e6b in Object.wait() [0x00007f9390a59000]
  267. java.lang.Thread.State: WAITING (on object monitor)
  268. at java.lang.Object.wait(Native Method)
  269. - waiting on <0x00000000c6080ea0> (a java.util.TaskQueue)
  270. at java.lang.Object.wait(Object.java:502)
  271. at java.util.TimerThread.mainLoop(Timer.java:526)
  272. - locked <0x00000000c6080ea0> (a java.util.TaskQueue)
  273. at java.util.TimerThread.run(Timer.java:505)
  274.  
  275. Locked ownable synchronizers:
  276. - None
  277.  
  278. "Timer-0" #43 daemon prio=5 os_prio=0 tid=0x00007f93bb9a9000 nid=0x6e6a in Object.wait() [0x00007f9390b5a000]
  279. java.lang.Thread.State: WAITING (on object monitor)
  280. at java.lang.Object.wait(Native Method)
  281. - waiting on <0x00000000c60806f8> (a java.util.TaskQueue)
  282. at java.lang.Object.wait(Object.java:502)
  283. at java.util.TimerThread.mainLoop(Timer.java:526)
  284. - locked <0x00000000c60806f8> (a java.util.TaskQueue)
  285. at java.util.TimerThread.run(Timer.java:505)
  286.  
  287. Locked ownable synchronizers:
  288. - None
  289.  
  290. "netty-rpc-env-timeout" #42 daemon prio=5 os_prio=0 tid=0x00007f92d8003800 nid=0x6e69 waiting on condition [0x00007f9390c5b000]
  291. java.lang.Thread.State: TIMED_WAITING (parking)
  292. at sun.misc.Unsafe.park(Native Method)
  293. - parking to wait for <0x00000000c6319c10> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  294. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
  295. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
  296. at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
  297. at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
  298. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
  299. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
  300. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  301. at java.lang.Thread.run(Thread.java:748)
  302.  
  303. Locked ownable synchronizers:
  304. - None
  305.  
  306. "heartbeat-receiver-event-loop-thread" #41 daemon prio=5 os_prio=0 tid=0x00007f933000f800 nid=0x6e68 waiting on condition [0x00007f9390d5c000]
  307. java.lang.Thread.State: TIMED_WAITING (parking)
  308. at sun.misc.Unsafe.park(Native Method)
  309. - parking to wait for <0x00000000c631a240> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  310. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
  311. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
  312. at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
  313. at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
  314. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
  315. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
  316. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  317. at java.lang.Thread.run(Thread.java:748)
  318.  
  319. Locked ownable synchronizers:
  320. - None
  321.  
  322. "SparkUI-39" #39 daemon prio=5 os_prio=0 tid=0x00007f93bb8ba000 nid=0x6e67 waiting on condition [0x00007f939105d000]
  323. java.lang.Thread.State: TIMED_WAITING (parking)
  324. at sun.misc.Unsafe.park(Native Method)
  325. - parking to wait for <0x00000000c62a12c0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  326. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
  327. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
  328. at org.sparkproject.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382)
  329. at org.sparkproject.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:973)
  330. at org.sparkproject.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1023)
  331. at java.lang.Thread.run(Thread.java:748)
  332.  
  333. Locked ownable synchronizers:
  334. - None
  335.  
  336. "SparkUI-38-acceptor-0@3661dc58-Spark@38a634e4{HTTP/1.1, (http/1.1)}{0.0.0.0:4040}" #38 daemon prio=3 os_prio=0 tid=0x00007f93bb8b8800 nid=0x6e66 runnable [0x00007f939115e000]
  337. java.lang.Thread.State: RUNNABLE
  338. at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
  339. at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421)
  340. at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249)
  341. - locked <0x00000000c61f2490> (a java.lang.Object)
  342. at org.sparkproject.jetty.server.ServerConnector.accept(ServerConnector.java:388)
  343. at org.sparkproject.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:702)
  344. at org.sparkproject.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:882)
  345. at org.sparkproject.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1036)
  346. at java.lang.Thread.run(Thread.java:748)
  347.  
  348. Locked ownable synchronizers:
  349. - None
  350.  
  351. "SparkUI-37" #37 daemon prio=5 os_prio=0 tid=0x00007f93bb8b6800 nid=0x6e65 runnable [0x00007f939125f000]
  352. java.lang.Thread.State: RUNNABLE
  353. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  354. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  355. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
  356. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
  357. - locked <0x00000000c62a0d98> (a sun.nio.ch.Util$3)
  358. - locked <0x00000000c62a0d88> (a java.util.Collections$UnmodifiableSet)
  359. - locked <0x00000000c62a0c70> (a sun.nio.ch.EPollSelectorImpl)
  360. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
  361. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
  362. at org.sparkproject.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:183)
  363. at org.sparkproject.jetty.io.ManagedSelector.select(ManagedSelector.java:190)
  364. at org.sparkproject.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:606)
  365. at org.sparkproject.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:543)
  366. at org.sparkproject.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:360)
  367. at org.sparkproject.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:184)
  368. at org.sparkproject.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171)
  369. at org.sparkproject.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:135)
  370. at org.sparkproject.jetty.io.ManagedSelector$$Lambda$1602/811106744.run(Unknown Source)
  371. at org.sparkproject.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:882)
  372. at org.sparkproject.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1036)
  373. at java.lang.Thread.run(Thread.java:748)
  374.  
  375. Locked ownable synchronizers:
  376. - None
  377.  
  378. "SparkUI-36" #36 daemon prio=5 os_prio=0 tid=0x00007f93bb8b4800 nid=0x6e64 runnable [0x00007f9391360000]
  379. java.lang.Thread.State: RUNNABLE
  380. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  381. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  382. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
  383. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
  384. - locked <0x00000000c629ffc8> (a sun.nio.ch.Util$3)
  385. - locked <0x00000000c629ffb8> (a java.util.Collections$UnmodifiableSet)
  386. - locked <0x00000000c629fea0> (a sun.nio.ch.EPollSelectorImpl)
  387. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
  388. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
  389. at org.sparkproject.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:183)
  390. at org.sparkproject.jetty.io.ManagedSelector.select(ManagedSelector.java:190)
  391. at org.sparkproject.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:606)
  392. at org.sparkproject.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:543)
  393. at org.sparkproject.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:360)
  394. at org.sparkproject.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:184)
  395. at org.sparkproject.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171)
  396. at org.sparkproject.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:135)
  397. at org.sparkproject.jetty.io.ManagedSelector$$Lambda$1602/811106744.run(Unknown Source)
  398. at org.sparkproject.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:882)
  399. at org.sparkproject.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1036)
  400. at java.lang.Thread.run(Thread.java:748)
  401.  
  402. Locked ownable synchronizers:
  403. - None
  404.  
  405. "SparkUI-35" #35 daemon prio=5 os_prio=0 tid=0x00007f93bb8b3000 nid=0x6e63 runnable [0x00007f9391461000]
  406. java.lang.Thread.State: RUNNABLE
  407. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  408. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  409. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
  410. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
  411. - locked <0x00000000c62a06b0> (a sun.nio.ch.Util$3)
  412. - locked <0x00000000c62a06a0> (a java.util.Collections$UnmodifiableSet)
  413. - locked <0x00000000c62a0588> (a sun.nio.ch.EPollSelectorImpl)
  414. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
  415. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
  416. at org.sparkproject.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:183)
  417. at org.sparkproject.jetty.io.ManagedSelector.select(ManagedSelector.java:190)
  418. at org.sparkproject.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:606)
  419. at org.sparkproject.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:543)
  420. at org.sparkproject.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:360)
  421. at org.sparkproject.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:184)
  422. at org.sparkproject.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171)
  423. at org.sparkproject.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:135)
  424. at org.sparkproject.jetty.io.ManagedSelector$$Lambda$1602/811106744.run(Unknown Source)
  425. at org.sparkproject.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:882)
  426. at org.sparkproject.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1036)
  427. at java.lang.Thread.run(Thread.java:748)
  428.  
  429. Locked ownable synchronizers:
  430. - None
  431.  
  432. "SparkUI-34" #34 daemon prio=5 os_prio=0 tid=0x00007f93bb8b1000 nid=0x6e62 runnable [0x00007f9391562000]
  433. java.lang.Thread.State: RUNNABLE
  434. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  435. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  436. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
  437. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
  438. - locked <0x00000000c62a1f88> (a sun.nio.ch.Util$3)
  439. - locked <0x00000000c62a1f78> (a java.util.Collections$UnmodifiableSet)
  440. - locked <0x00000000c62a1e60> (a sun.nio.ch.EPollSelectorImpl)
  441. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
  442. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
  443. at org.sparkproject.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:183)
  444. at org.sparkproject.jetty.io.ManagedSelector.select(ManagedSelector.java:190)
  445. at org.sparkproject.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:606)
  446. at org.sparkproject.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:543)
  447. at org.sparkproject.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:360)
  448. at org.sparkproject.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:184)
  449. at org.sparkproject.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171)
  450. at org.sparkproject.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:135)
  451. at org.sparkproject.jetty.io.ManagedSelector$$Lambda$1602/811106744.run(Unknown Source)
  452. at org.sparkproject.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:882)
  453. at org.sparkproject.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1036)
  454. at java.lang.Thread.run(Thread.java:748)
  455.  
  456. Locked ownable synchronizers:
  457. - None
  458.  
  459. "SparkUI-33" #33 daemon prio=5 os_prio=0 tid=0x00007f93bb8af000 nid=0x6e61 runnable [0x00007f9391663000]
  460. java.lang.Thread.State: RUNNABLE
  461. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  462. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  463. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
  464. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
  465. - locked <0x00000000c62a2920> (a sun.nio.ch.Util$3)
  466. - locked <0x00000000c62a2910> (a java.util.Collections$UnmodifiableSet)
  467. - locked <0x00000000c62a27f8> (a sun.nio.ch.EPollSelectorImpl)
  468. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
  469. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
  470. at org.sparkproject.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:183)
  471. at org.sparkproject.jetty.io.ManagedSelector.select(ManagedSelector.java:190)
  472. at org.sparkproject.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:606)
  473. at org.sparkproject.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:543)
  474. at org.sparkproject.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:360)
  475. at org.sparkproject.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:184)
  476. at org.sparkproject.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171)
  477. at org.sparkproject.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:135)
  478. at org.sparkproject.jetty.io.ManagedSelector$$Lambda$1602/811106744.run(Unknown Source)
  479. at org.sparkproject.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:882)
  480. at org.sparkproject.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1036)
  481. at java.lang.Thread.run(Thread.java:748)
  482.  
  483. Locked ownable synchronizers:
  484. - None
  485.  
  486. "SparkUI-32" #32 daemon prio=5 os_prio=0 tid=0x00007f93bb8ad800 nid=0x6e60 runnable [0x00007f9391764000]
  487. java.lang.Thread.State: RUNNABLE
  488. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  489. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  490. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
  491. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
  492. - locked <0x00000000c62a18a0> (a sun.nio.ch.Util$3)
  493. - locked <0x00000000c62a1890> (a java.util.Collections$UnmodifiableSet)
  494. - locked <0x00000000c62a1778> (a sun.nio.ch.EPollSelectorImpl)
  495. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
  496. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
  497. at org.sparkproject.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:183)
  498. at org.sparkproject.jetty.io.ManagedSelector.select(ManagedSelector.java:190)
  499. at org.sparkproject.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:606)
  500. at org.sparkproject.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:543)
  501. at org.sparkproject.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:360)
  502. at org.sparkproject.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:184)
  503. at org.sparkproject.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171)
  504. at org.sparkproject.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:135)
  505. at org.sparkproject.jetty.io.ManagedSelector$$Lambda$1602/811106744.run(Unknown Source)
  506. at org.sparkproject.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:882)
  507. at org.sparkproject.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1036)
  508. at java.lang.Thread.run(Thread.java:748)
  509.  
  510. Locked ownable synchronizers:
  511. - None
  512.  
  513. "refresh progress" #31 daemon prio=5 os_prio=0 tid=0x00007f93bb7a5000 nid=0x6e5f in Object.wait() [0x00007f9391a65000]
  514. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  515. at java.lang.Object.wait(Native Method)
  516. at java.util.TimerThread.mainLoop(Timer.java:552)
  517. - locked <0x00000000c61ec3d8> (a java.util.TaskQueue)
  518. at java.util.TimerThread.run(Timer.java:505)
  519.  
  520. Locked ownable synchronizers:
  521. - None
  522.  
  523. "RemoteBlock-temp-file-clean-thread" #30 daemon prio=5 os_prio=0 tid=0x00007f93b91cf800 nid=0x6e5e in Object.wait() [0x00007f9391b66000]
  524. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  525. at java.lang.Object.wait(Native Method)
  526. at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
  527. - locked <0x00000000c6285a00> (a java.lang.ref.ReferenceQueue$Lock)
  528. at org.apache.spark.storage.BlockManager$RemoteBlockDownloadFileManager.org$apache$spark$storage$BlockManager$RemoteBlockDownloadFileManager$$keepCleaning(BlockManager.scala:2034)
  529. at org.apache.spark.storage.BlockManager$RemoteBlockDownloadFileManager$$anon$2.run(BlockManager.scala:2002)
  530.  
  531. Locked ownable synchronizers:
  532. - None
  533.  
  534. "dispatcher-BlockManagerEndpoint1" #29 daemon prio=5 os_prio=0 tid=0x00007f93b91cd000 nid=0x6e5d waiting on condition [0x00007f9391c67000]
  535. java.lang.Thread.State: WAITING (parking)
  536. at sun.misc.Unsafe.park(Native Method)
  537. - parking to wait for <0x00000000c6362108> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  538. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  539. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  540. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  541. at org.apache.spark.rpc.netty.MessageLoop.org$apache$spark$rpc$netty$MessageLoop$$receiveLoop(MessageLoop.scala:69)
  542. at org.apache.spark.rpc.netty.MessageLoop$$anon$1.run(MessageLoop.scala:41)
  543. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  544. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  545. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  546. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  547. at java.lang.Thread.run(Thread.java:748)
  548.  
  549. Locked ownable synchronizers:
  550. - <0x00000000c6362320> (a java.util.concurrent.ThreadPoolExecutor$Worker)
  551.  
  552. "dispatcher-BlockManagerMaster" #28 daemon prio=5 os_prio=0 tid=0x00007f93b8fc4000 nid=0x6e5a waiting on condition [0x00007f9391d68000]
  553. java.lang.Thread.State: WAITING (parking)
  554. at sun.misc.Unsafe.park(Native Method)
  555. - parking to wait for <0x00000000c6360bb8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  556. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  557. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  558. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  559. at org.apache.spark.rpc.netty.MessageLoop.org$apache$spark$rpc$netty$MessageLoop$$receiveLoop(MessageLoop.scala:69)
  560. at org.apache.spark.rpc.netty.MessageLoop$$anon$1.run(MessageLoop.scala:41)
  561. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  562. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  563. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  564. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  565. at java.lang.Thread.run(Thread.java:748)
  566.  
  567. Locked ownable synchronizers:
  568. - <0x00000000c6360dd0> (a java.util.concurrent.ThreadPoolExecutor$Worker)
  569.  
  570. "map-output-dispatcher-7" #27 daemon prio=5 os_prio=0 tid=0x00007f93ba22f800 nid=0x6e59 waiting on condition [0x00007f9392069000]
  571. java.lang.Thread.State: WAITING (parking)
  572. at sun.misc.Unsafe.park(Native Method)
  573. - parking to wait for <0x00000000c607e188> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  574. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  575. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  576. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  577. at org.apache.spark.MapOutputTrackerMaster$MessageLoop.run(MapOutputTracker.scala:452)
  578. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  579. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  580. at java.lang.Thread.run(Thread.java:748)
  581.  
  582. Locked ownable synchronizers:
  583. - <0x00000000c607e958> (a java.util.concurrent.ThreadPoolExecutor$Worker)
  584.  
  585. "map-output-dispatcher-6" #26 daemon prio=5 os_prio=0 tid=0x00007f93ba22d800 nid=0x6e58 waiting on condition [0x00007f939216a000]
  586. java.lang.Thread.State: WAITING (parking)
  587. at sun.misc.Unsafe.park(Native Method)
  588. - parking to wait for <0x00000000c607e188> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  589. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  590. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  591. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  592. at org.apache.spark.MapOutputTrackerMaster$MessageLoop.run(MapOutputTracker.scala:452)
  593. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  594. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  595. at java.lang.Thread.run(Thread.java:748)
  596.  
  597. Locked ownable synchronizers:
  598. - <0x00000000c607eff8> (a java.util.concurrent.ThreadPoolExecutor$Worker)
  599.  
  600. "map-output-dispatcher-5" #25 daemon prio=5 os_prio=0 tid=0x00007f93ba22c000 nid=0x6e57 waiting on condition [0x00007f939226b000]
  601. java.lang.Thread.State: WAITING (parking)
  602. at sun.misc.Unsafe.park(Native Method)
  603. - parking to wait for <0x00000000c607e188> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  604. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  605. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  606. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  607. at org.apache.spark.MapOutputTrackerMaster$MessageLoop.run(MapOutputTracker.scala:452)
  608. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  609. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  610. at java.lang.Thread.run(Thread.java:748)
  611.  
  612. Locked ownable synchronizers:
  613. - <0x00000000c607f348> (a java.util.concurrent.ThreadPoolExecutor$Worker)
  614.  
  615. "map-output-dispatcher-4" #24 daemon prio=5 os_prio=0 tid=0x00007f93ba22a800 nid=0x6e56 waiting on condition [0x00007f939236c000]
  616. java.lang.Thread.State: WAITING (parking)
  617. at sun.misc.Unsafe.park(Native Method)
  618. - parking to wait for <0x00000000c607e188> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  619. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  620. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  621. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  622. at org.apache.spark.MapOutputTrackerMaster$MessageLoop.run(MapOutputTracker.scala:452)
  623. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  624. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  625. at java.lang.Thread.run(Thread.java:748)
  626.  
  627. Locked ownable synchronizers:
  628. - <0x00000000c607e5e8> (a java.util.concurrent.ThreadPoolExecutor$Worker)
  629.  
  630. "map-output-dispatcher-3" #23 daemon prio=5 os_prio=0 tid=0x00007f93b9c2f000 nid=0x6e55 waiting on condition [0x00007f939246d000]
  631. java.lang.Thread.State: WAITING (parking)
  632. at sun.misc.Unsafe.park(Native Method)
  633. - parking to wait for <0x00000000c607e188> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  634. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  635. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  636. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  637. at org.apache.spark.MapOutputTrackerMaster$MessageLoop.run(MapOutputTracker.scala:452)
  638. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  639. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  640. at java.lang.Thread.run(Thread.java:748)
  641.  
  642. Locked ownable synchronizers:
  643. - <0x00000000c607f9e8> (a java.util.concurrent.ThreadPoolExecutor$Worker)
  644.  
  645. "map-output-dispatcher-2" #22 daemon prio=5 os_prio=0 tid=0x00007f93b9c2d800 nid=0x6e54 waiting on condition [0x00007f939256e000]
  646. java.lang.Thread.State: WAITING (parking)
  647. at sun.misc.Unsafe.park(Native Method)
  648. - parking to wait for <0x00000000c607e188> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  649. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  650. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  651. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  652. at org.apache.spark.MapOutputTrackerMaster$MessageLoop.run(MapOutputTracker.scala:452)
  653. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  654. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  655. at java.lang.Thread.run(Thread.java:748)
  656.  
  657. Locked ownable synchronizers:
  658. - <0x00000000c607f698> (a java.util.concurrent.ThreadPoolExecutor$Worker)
  659.  
  660. "map-output-dispatcher-1" #21 daemon prio=5 os_prio=0 tid=0x00007f93b9c2b000 nid=0x6e53 waiting on condition [0x00007f939266f000]
  661. java.lang.Thread.State: WAITING (parking)
  662. at sun.misc.Unsafe.park(Native Method)
  663. - parking to wait for <0x00000000c607e188> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  664. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  665. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  666. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  667. at org.apache.spark.MapOutputTrackerMaster$MessageLoop.run(MapOutputTracker.scala:452)
  668. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  669. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  670. at java.lang.Thread.run(Thread.java:748)
  671.  
  672. Locked ownable synchronizers:
  673. - <0x00000000c607eca8> (a java.util.concurrent.ThreadPoolExecutor$Worker)
  674.  
  675. "map-output-dispatcher-0" #20 daemon prio=5 os_prio=0 tid=0x00007f93b9c7f000 nid=0x6e52 waiting on condition [0x00007f9392770000]
  676. java.lang.Thread.State: WAITING (parking)
  677. at sun.misc.Unsafe.park(Native Method)
  678. - parking to wait for <0x00000000c607e188> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  679. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  680. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  681. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  682. at org.apache.spark.MapOutputTrackerMaster$MessageLoop.run(MapOutputTracker.scala:452)
  683. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  684. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  685. at java.lang.Thread.run(Thread.java:748)
  686.  
  687. Locked ownable synchronizers:
  688. - <0x00000000c607e390> (a java.util.concurrent.ThreadPoolExecutor$Worker)
  689.  
  690. "dispatcher-event-loop-1" #19 daemon prio=5 os_prio=0 tid=0x00007f93b8fc1800 nid=0x6e51 waiting on condition [0x00007f9392871000]
  691. java.lang.Thread.State: WAITING (parking)
  692. at sun.misc.Unsafe.park(Native Method)
  693. - parking to wait for <0x00000000c607cfe0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  694. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  695. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  696. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  697. at org.apache.spark.rpc.netty.MessageLoop.org$apache$spark$rpc$netty$MessageLoop$$receiveLoop(MessageLoop.scala:69)
  698. at org.apache.spark.rpc.netty.MessageLoop$$anon$1.run(MessageLoop.scala:41)
  699. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  700. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  701. at java.lang.Thread.run(Thread.java:748)
  702.  
  703. Locked ownable synchronizers:
  704. - <0x00000000c607d1e8> (a java.util.concurrent.ThreadPoolExecutor$Worker)
  705.  
  706. "dispatcher-event-loop-0" #18 daemon prio=5 os_prio=0 tid=0x00007f93b8fc0000 nid=0x6e50 waiting on condition [0x00007f9392972000]
  707. java.lang.Thread.State: WAITING (parking)
  708. at sun.misc.Unsafe.park(Native Method)
  709. - parking to wait for <0x00000000c607cfe0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  710. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  711. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  712. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  713. at org.apache.spark.rpc.netty.MessageLoop.org$apache$spark$rpc$netty$MessageLoop$$receiveLoop(MessageLoop.scala:69)
  714. at org.apache.spark.rpc.netty.MessageLoop$$anon$1.run(MessageLoop.scala:41)
  715. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  716. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  717. at java.lang.Thread.run(Thread.java:748)
  718.  
  719. Locked ownable synchronizers:
  720. - <0x00000000c607d460> (a java.util.concurrent.ThreadPoolExecutor$Worker)
  721.  
  722. "rpc-boss-3-1" #17 daemon prio=5 os_prio=0 tid=0x00007f93ba4dc000 nid=0x6e4e runnable [0x00007f93981d4000]
  723. java.lang.Thread.State: RUNNABLE
  724. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  725. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  726. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
  727. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
  728. - locked <0x00000000c631ad08> (a io.netty.channel.nio.SelectedSelectionKeySet)
  729. - locked <0x00000000c631ad20> (a java.util.Collections$UnmodifiableSet)
  730. - locked <0x00000000c631acc0> (a sun.nio.ch.EPollSelectorImpl)
  731. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
  732. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
  733. at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68)
  734. at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:803)
  735. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
  736. at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
  737. at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
  738. at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
  739. at java.lang.Thread.run(Thread.java:748)
  740.  
  741. Locked ownable synchronizers:
  742. - None
  743.  
  744. "NonBlockingInputStreamThread" #15 daemon prio=5 os_prio=0 tid=0x00007f93babb2800 nid=0x6dfd in Object.wait() [0x00007f939994b000]
  745. java.lang.Thread.State: WAITING (on object monitor)
  746. at java.lang.Object.wait(Native Method)
  747. at jline.internal.NonBlockingInputStream.run(NonBlockingInputStream.java:275)
  748. - locked <0x00000000c0430b48> (a jline.internal.NonBlockingInputStream)
  749. at java.lang.Thread.run(Thread.java:748)
  750.  
  751. Locked ownable synchronizers:
  752. - None
  753.  
  754. "Service Thread" #9 daemon prio=9 os_prio=0 tid=0x00007f93b814f000 nid=0x6de1 runnable [0x0000000000000000]
  755. java.lang.Thread.State: RUNNABLE
  756.  
  757. Locked ownable synchronizers:
  758. - None
  759.  
  760. "C1 CompilerThread3" #8 daemon prio=9 os_prio=0 tid=0x00007f93b813c000 nid=0x6de0 waiting on condition [0x0000000000000000]
  761. java.lang.Thread.State: RUNNABLE
  762.  
  763. Locked ownable synchronizers:
  764. - None
  765.  
  766. "C2 CompilerThread2" #7 daemon prio=9 os_prio=0 tid=0x00007f93b8139800 nid=0x6ddf waiting on condition [0x0000000000000000]
  767. java.lang.Thread.State: RUNNABLE
  768.  
  769. Locked ownable synchronizers:
  770. - None
  771.  
  772. "C2 CompilerThread1" #6 daemon prio=9 os_prio=0 tid=0x00007f93b8138000 nid=0x6dde waiting on condition [0x0000000000000000]
  773. java.lang.Thread.State: RUNNABLE
  774.  
  775. Locked ownable synchronizers:
  776. - None
  777.  
  778. "C2 CompilerThread0" #5 daemon prio=9 os_prio=0 tid=0x00007f93b8135800 nid=0x6ddd waiting on condition [0x0000000000000000]
  779. java.lang.Thread.State: RUNNABLE
  780.  
  781. Locked ownable synchronizers:
  782. - None
  783.  
  784. "Signal Dispatcher" #4 daemon prio=9 os_prio=0 tid=0x00007f93b8126800 nid=0x6ddc runnable [0x0000000000000000]
  785. java.lang.Thread.State: RUNNABLE
  786.  
  787. Locked ownable synchronizers:
  788. - None
  789.  
  790. "Finalizer" #3 daemon prio=8 os_prio=0 tid=0x00007f93b80fb000 nid=0x6ddb in Object.wait() [0x00007f93a02b9000]
  791. java.lang.Thread.State: WAITING (on object monitor)
  792. at java.lang.Object.wait(Native Method)
  793. at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
  794. - locked <0x00000000c000c5b8> (a java.lang.ref.ReferenceQueue$Lock)
  795. at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
  796. at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:216)
  797.  
  798. Locked ownable synchronizers:
  799. - None
  800.  
  801. "Reference Handler" #2 daemon prio=10 os_prio=0 tid=0x00007f93b80f6000 nid=0x6dda in Object.wait() [0x00007f93a03ba000]
  802. java.lang.Thread.State: WAITING (on object monitor)
  803. at java.lang.Object.wait(Native Method)
  804. at java.lang.Object.wait(Object.java:502)
  805. at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
  806. - locked <0x00000000c0004a58> (a java.lang.ref.Reference$Lock)
  807. at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)
  808.  
  809. Locked ownable synchronizers:
  810. - None
  811.  
  812. "main" #1 prio=5 os_prio=0 tid=0x00007f93b8054000 nid=0x6dce waiting on condition [0x00007f93c0658000]
  813. java.lang.Thread.State: WAITING (parking)
  814. at sun.misc.Unsafe.park(Native Method)
  815. - parking to wait for <0x00000000eb65eab8> (a scala.concurrent.impl.Promise$CompletionLatch)
  816. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  817. at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
  818. at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
  819. at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
  820. at scala.concurrent.impl.Promise$DefaultPromise.tryAwait(Promise.scala:242)
  821. at scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:258)
  822. at scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:187)
  823. at org.apache.spark.util.ThreadUtils$.awaitReady(ThreadUtils.scala:334)
  824. at org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:859)
  825. at org.apache.spark.SparkContext.runJob(SparkContext.scala:2196)
  826. at org.apache.spark.SparkContext.runJob(SparkContext.scala:2217)
  827. at org.apache.spark.SparkContext.runJob(SparkContext.scala:2236)
  828. at org.apache.spark.SparkContext.runJob(SparkContext.scala:2261)
  829. at org.apache.spark.rdd.RDD.$anonfun$collect$1(RDD.scala:1030)
  830. at org.apache.spark.rdd.RDD$$Lambda$2193/1084000875.apply(Unknown Source)
  831. at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
  832. at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:112)
  833. at org.apache.spark.rdd.RDD.withScope(RDD.scala:414)
  834. at org.apache.spark.rdd.RDD.collect(RDD.scala:1029)
  835. at org.apache.spark.sql.execution.SparkPlan.executeCollect(SparkPlan.scala:390)
  836. at org.apache.spark.sql.Dataset.$anonfun$count$1(Dataset.scala:3006)
  837. at org.apache.spark.sql.Dataset.$anonfun$count$1$adapted(Dataset.scala:3005)
  838. at org.apache.spark.sql.Dataset$$Lambda$2847/937335652.apply(Unknown Source)
  839. at org.apache.spark.sql.Dataset.$anonfun$withAction$1(Dataset.scala:3687)
  840. at org.apache.spark.sql.Dataset$$Lambda$2848/1831604445.apply(Unknown Source)
  841. at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$5(SQLExecution.scala:103)
  842. at org.apache.spark.sql.execution.SQLExecution$$$Lambda$2853/2038636888.apply(Unknown Source)
  843. at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:163)
  844. at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$1(SQLExecution.scala:90)
  845. at org.apache.spark.sql.execution.SQLExecution$$$Lambda$2849/1622269832.apply(Unknown Source)
  846. at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:775)
  847. at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:64)
  848. at org.apache.spark.sql.Dataset.withAction(Dataset.scala:3685)
  849. at org.apache.spark.sql.Dataset.count(Dataset.scala:3005)
  850. at $line19.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:24)
  851. at $line19.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:28)
  852. at $line19.$read$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:30)
  853. at $line19.$read$$iw$$iw$$iw$$iw$$iw.<init>(<console>:32)
  854. at $line19.$read$$iw$$iw$$iw$$iw.<init>(<console>:34)
  855. at $line19.$read$$iw$$iw$$iw.<init>(<console>:36)
  856. at $line19.$read$$iw$$iw.<init>(<console>:38)
  857. at $line19.$read$$iw.<init>(<console>:40)
  858. at $line19.$read.<init>(<console>:42)
  859. at $line19.$read$.<init>(<console>:46)
  860. at $line19.$read$.<clinit>(<console>)
  861. at $line19.$eval$.$print$lzycompute(<console>:7)
  862. - locked <0x00000000f67afed8> (a $line19.$eval$)
  863. at $line19.$eval$.$print(<console>:6)
  864. at $line19.$eval.$print(<console>)
  865. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  866. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  867. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  868. at java.lang.reflect.Method.invoke(Method.java:498)
  869. at scala.tools.nsc.interpreter.IMain$ReadEvalPrint.call(IMain.scala:745)
  870. at scala.tools.nsc.interpreter.IMain$Request.loadAndRun(IMain.scala:1021)
  871. at scala.tools.nsc.interpreter.IMain.$anonfun$interpret$1(IMain.scala:574)
  872. at scala.tools.nsc.interpreter.IMain$$Lambda$1216/588503940.apply(Unknown Source)
  873. at scala.reflect.internal.util.ScalaClassLoader.asContext(ScalaClassLoader.scala:41)
  874. at scala.reflect.internal.util.ScalaClassLoader.asContext$(ScalaClassLoader.scala:37)
  875. at scala.reflect.internal.util.AbstractFileClassLoader.asContext(AbstractFileClassLoader.scala:41)
  876. at scala.tools.nsc.interpreter.IMain.loadAndRunReq$1(IMain.scala:573)
  877. at scala.tools.nsc.interpreter.IMain.interpret(IMain.scala:600)
  878. at scala.tools.nsc.interpreter.IMain.interpret(IMain.scala:570)
  879. at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:894)
  880. at scala.tools.nsc.interpreter.ILoop.command(ILoop.scala:762)
  881. at scala.tools.nsc.interpreter.ILoop.processLine(ILoop.scala:464)
  882. at scala.tools.nsc.interpreter.ILoop.loop(ILoop.scala:485)
  883. at org.apache.spark.repl.SparkILoop.process(SparkILoop.scala:239)
  884. at org.apache.spark.repl.Main$.doMain(Main.scala:78)
  885. at org.apache.spark.repl.Main$.main(Main.scala:58)
  886. at org.apache.spark.repl.Main.main(Main.scala)
  887. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  888. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  889. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  890. at java.lang.reflect.Method.invoke(Method.java:498)
  891. at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
  892. at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:951)
  893. at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:180)
  894. at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:203)
  895. at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:90)
  896. at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1039)
  897. at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1048)
  898. at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
  899.  
  900. Locked ownable synchronizers:
  901. - None
  902.  
  903. "VM Thread" os_prio=0 tid=0x00007f93b80ec800 nid=0x6dd9 runnable
  904.  
  905. "GC task thread#0 (ParallelGC)" os_prio=0 tid=0x00007f93b8067000 nid=0x6dcf runnable
  906.  
  907. "GC task thread#1 (ParallelGC)" os_prio=0 tid=0x00007f93b8069000 nid=0x6dd0 runnable
  908.  
  909. "GC task thread#2 (ParallelGC)" os_prio=0 tid=0x00007f93b806a800 nid=0x6dd1 runnable
  910.  
  911. "GC task thread#3 (ParallelGC)" os_prio=0 tid=0x00007f93b806c800 nid=0x6dd2 runnable
  912.  
  913. "GC task thread#4 (ParallelGC)" os_prio=0 tid=0x00007f93b806e800 nid=0x6dd3 runnable
  914.  
  915. "GC task thread#5 (ParallelGC)" os_prio=0 tid=0x00007f93b8070800 nid=0x6dd4 runnable
  916.  
  917. "GC task thread#6 (ParallelGC)" os_prio=0 tid=0x00007f93b8072000 nid=0x6dd5 runnable
  918.  
  919. "GC task thread#7 (ParallelGC)" os_prio=0 tid=0x00007f93b8074000 nid=0x6dd6 runnable
  920.  
  921. "GC task thread#8 (ParallelGC)" os_prio=0 tid=0x00007f93b8076000 nid=0x6dd7 runnable
  922.  
  923. "GC task thread#9 (ParallelGC)" os_prio=0 tid=0x00007f93b8078000 nid=0x6dd8 runnable
  924.  
  925. "VM Periodic Task Thread" os_prio=0 tid=0x00007f93b8151800 nid=0x6de2 waiting on condition
  926.  
  927. JNI global references: 7687
  928.  
  929.  
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!