API tools faq
paste
Advertisement
Guest User

Reader error

a guest
Jan 24th, 2020
132
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 99.57 KB | None | 0 0
raw download clone embed print report
  1. "C:\Program Files\Java\jdk1.8.0_151\bin\java.exe" -Dmaven.multiModuleProjectDirectory=C:\Projects\audatex\spark\spark-reader "-Dmaven.home=C:\Program Files\JetBrains\IntelliJ IDEA 2019.1.3\plugins\maven\lib\maven3" "-Dclassworlds.conf=C:\Program Files\JetBrains\IntelliJ IDEA 2019.1.3\plugins\maven\lib\maven3\bin\m2.conf" "-javaagent:C:\Program Files\JetBrains\IntelliJ IDEA 2019.1.3\lib\idea_rt.jar=63433:C:\Program Files\JetBrains\IntelliJ IDEA 2019.1.3\bin" -Dfile.encoding=UTF-8 -classpath "C:\Program Files\JetBrains\IntelliJ IDEA 2019.1.3\lib\idea_rt.jar" com.intellij.rt.execution.CommandLineWrapper C:\Users\dejan.ostojic\AppData\Local\Temp\idea_classpath1260495135 org.codehaus.classworlds.Launcher -Didea.version2019.1.3 package
  2. [INFO] Scanning for projects...
  3. [INFO]
  4. [INFO] ------------------------------------------------------------------------
  5. [INFO] Building spark-reader 1.0.0-SNAPSHOT
  6. [INFO] ------------------------------------------------------------------------
  7. [INFO]
  8. [INFO] --- scalariform-maven-plugin:0.1.4:format (default) @ spark-reader ---
  9. [INFO] Modified 0 of 19 .scala files
  10. [INFO]
  11. [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-reader ---
  12. [INFO] Using 'UTF-8' encoding to copy filtered resources.
  13. [INFO] Copying 1 resource
  14. [INFO]
  15. [INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @ spark-reader ---
  16. [INFO] Nothing to compile - all classes are up to date
  17. [INFO]
  18. [INFO] --- scala-maven-plugin:3.3.1:compile (default) @ spark-reader ---
  19. [INFO] C:\Projects\audatex\spark\spark-reader\src\main\scala:-1: info: compiling
  20. [INFO] Compiling 12 source files to C:\Projects\audatex\spark\spark-reader\target\classes at 1579867450450
  21. [INFO] prepare-compile in 0 s
  22. [INFO] compile in 16 s
  23. [INFO]
  24. [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-reader ---
  25. [INFO] Using 'UTF-8' encoding to copy filtered resources.
  26. [INFO] Copying 8 resources
  27. [INFO]
  28. [INFO] --- maven-compiler-plugin:3.7.0:testCompile (default-testCompile) @ spark-reader ---
  29. [INFO] Nothing to compile - all classes are up to date
  30. [INFO]
  31. [INFO] --- scala-maven-plugin:3.3.1:testCompile (default) @ spark-reader ---
  32. [INFO] C:\Projects\audatex\spark\spark-reader\src\test\scala:-1: info: compiling
  33. [INFO] Compiling 7 source files to C:\Projects\audatex\spark\spark-reader\target\test-classes at 1579867467856
  34. [INFO] prepare-compile in 0 s
  35. [INFO] compile in 17 s
  36. [INFO]
  37. [INFO] --- maven-surefire-plugin:2.12.4:test (default-test) @ spark-reader ---
  38. [INFO] Surefire report directory: C:\Projects\audatex\spark\spark-reader\target\surefire-reports
  39.  
  40. -------------------------------------------------------
  41. T E S T S
  42. -------------------------------------------------------
  43. Running com.solera.gdc.vehicledataingestion.reader.manreader.CatHeaderGraphTest
  44. Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.022 sec
  45. Running com.solera.gdc.vehicledataingestion.reader.manreader.CatPositionGraphTest
  46. Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
  47. Running com.solera.gdc.vehicledataingestion.reader.manreader.GraphDeltaTest
  48. Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
  49. Running com.solera.gdc.vehicledataingestion.reader.manreader.packageTest
  50. Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
  51. Running com.solera.gdc.vehicledataingestion.reader.manreader.SgrpGraphTest
  52. Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
  53. Running com.solera.gdc.vehicledataingestion.reader.manreader.UdmGraphTest
  54. Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
  55.  
  56. Results :
  57.  
  58. Tests run: 0, Failures: 0, Errors: 0, Skipped: 0
  59.  
  60. [INFO]
  61. [INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-reader ---
  62. Discovery starting.
  63. Discovery completed in 529 milliseconds.
  64. Run starting. Expected test count is: 13
  65. packageTest:
  66. WARNING: An illegal reflective access operation has occurred
  67. WARNING: Illegal reflective access by org.apache.hadoop.security.authentication.util.KerberosUtil (file:/C:/Users/dejan.ostojic/.m2/repository/org/apache/hadoop/hadoop-auth/2.6.5/hadoop-auth-2.6.5.jar) to method sun.security.krb5.Config.getInstance()
  68. WARNING: Please consider reporting this to the maintainers of org.apache.hadoop.security.authentication.util.KerberosUtil
  69. WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
  70. WARNING: All illegal access operations will be denied in a future release
  71. 13:04:52 WARN: [ScalaTest-main-running-DiscoverySuite] o.a.h.u.NativeCodeLoader | Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  72. - Converting sgrp period (PAT, PET date) to real date test
  73. 13:04:56 INFO: [ScalaTest-main-running-packageTest] o.s.j.u.log | Logging initialized @7785ms
  74. 13:04:56 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.Server | jetty-9.3.z-SNAPSHOT, build timestamp: 2018-06-05T20:24:03+02:00, git hash: d5fc0523cfa96bfebfbda19606cad384d772f04c
  75. 13:04:56 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.Server | Started @7913ms
  76. 13:04:56 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.AbstractConnector | Started ServerConnector@7dd91ffc{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
  77. 13:04:56 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5c76fce4{/jobs,null,AVAILABLE,@Spark}
  78. 13:04:56 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6dece1f9{/jobs/json,null,AVAILABLE,@Spark}
  79. 13:04:56 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@2b936b04{/jobs/job,null,AVAILABLE,@Spark}
  80. 13:04:56 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5635bcd2{/jobs/job/json,null,AVAILABLE,@Spark}
  81. 13:04:56 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5c5c7cc4{/stages,null,AVAILABLE,@Spark}
  82. 13:04:56 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6c27e700{/stages/json,null,AVAILABLE,@Spark}
  83. 13:04:56 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@56b9d43f{/stages/stage,null,AVAILABLE,@Spark}
  84. 13:04:56 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@41582899{/stages/stage/json,null,AVAILABLE,@Spark}
  85. 13:04:56 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@595814a1{/stages/pool,null,AVAILABLE,@Spark}
  86. 13:04:56 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7de5871d{/stages/pool/json,null,AVAILABLE,@Spark}
  87. 13:04:56 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@49d42faf{/storage,null,AVAILABLE,@Spark}
  88. 13:04:56 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@4948daec{/storage/json,null,AVAILABLE,@Spark}
  89. 13:04:56 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@502c2278{/storage/rdd,null,AVAILABLE,@Spark}
  90. 13:04:56 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@1209a0f{/storage/rdd/json,null,AVAILABLE,@Spark}
  91. 13:04:56 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@696174d3{/environment,null,AVAILABLE,@Spark}
  92. 13:04:56 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@66715ca9{/environment/json,null,AVAILABLE,@Spark}
  93. 13:04:56 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@577f9dfd{/executors,null,AVAILABLE,@Spark}
  94. 13:04:57 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@520a95ff{/executors/json,null,AVAILABLE,@Spark}
  95. 13:04:57 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@30afb481{/executors/threadDump,null,AVAILABLE,@Spark}
  96. 13:04:57 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5c573229{/executors/threadDump/json,null,AVAILABLE,@Spark}
  97. 13:04:57 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@77ecdc2b{/static,null,AVAILABLE,@Spark}
  98. 13:04:57 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@467af68c{/,null,AVAILABLE,@Spark}
  99. 13:04:57 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@43786627{/api,null,AVAILABLE,@Spark}
  100. 13:04:57 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@74707df8{/jobs/job/kill,null,AVAILABLE,@Spark}
  101. 13:04:57 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@12c76d6e{/stages/stage/kill,null,AVAILABLE,@Spark}
  102. 13:04:57 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@226e07e7{/metrics/json,null,AVAILABLE,@Spark}
  103. 13:04:57 WARN: [ScalaTest-main-running-packageTest] c.s.g.v.r.m.packageTest$$anonfun$1$$anon$1 | spark.executor.cores is set to 1
  104. 13:04:57 INFO: [ScalaTest-main-running-packageTest] c.s.g.v.r.m.packageTest$$anonfun$1$$anon$1 | Starting Job f892694c-fc38-49f5-8a86-8a839172bc85
  105. 13:04:57 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@58ec8271{/SQL,null,AVAILABLE,@Spark}
  106. 13:04:57 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@a44effb{/SQL/json,null,AVAILABLE,@Spark}
  107. 13:04:57 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5eb2972f{/SQL/execution,null,AVAILABLE,@Spark}
  108. 13:04:57 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@29699283{/SQL/execution/json,null,AVAILABLE,@Spark}
  109. 13:04:57 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@bb50de6{/static/sql,null,AVAILABLE,@Spark}
  110. 13:05:02 INFO: [ScalaTest-main-running-packageTest] c.s.g.v.r.m.packageTest$$anonfun$1$$anon$1 | Stopping job f892694c-fc38-49f5-8a86-8a839172bc85.
  111. Job Summary:
  112. User: Dejan.Ostojic
  113. Job: f892694c-fc38-49f5-8a86-8a839172bc85
  114. Total time: 7099 millis
  115. cached RDD statistics:
  116.  
  117. 13:05:02 INFO: [ScalaTest-main-running-packageTest] o.s.j.s.AbstractConnector | Stopped Spark@7dd91ffc{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
  118. - Create hash value test *** FAILED ***
  119. java.lang.IllegalArgumentException:
  120. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  121. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  122. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  123. at org.apache.spark.util.ClosureCleaner$.getClassReader(ClosureCleaner.scala:46)
  124. at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:449)
  125. at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:432)
  126. at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:733)
  127. at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:103)
  128. at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:103)
  129. at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
  130. ...
  131. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.Server | jetty-9.3.z-SNAPSHOT, build timestamp: 2018-06-05T20:24:03+02:00, git hash: d5fc0523cfa96bfebfbda19606cad384d772f04c
  132. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.Server | Started @13724ms
  133. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.AbstractConnector | Started ServerConnector@23acd55e{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
  134. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@eaf3dd0{/jobs,null,AVAILABLE,@Spark}
  135. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5add0cc0{/jobs/json,null,AVAILABLE,@Spark}
  136. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5b04224a{/jobs/job,null,AVAILABLE,@Spark}
  137. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@1e470a51{/jobs/job/json,null,AVAILABLE,@Spark}
  138. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6971f5f4{/stages,null,AVAILABLE,@Spark}
  139. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5b784f16{/stages/json,null,AVAILABLE,@Spark}
  140. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@21143041{/stages/stage,null,AVAILABLE,@Spark}
  141. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@727b3b0{/stages/stage/json,null,AVAILABLE,@Spark}
  142. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@611f28f5{/stages/pool,null,AVAILABLE,@Spark}
  143. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7806db3f{/stages/pool/json,null,AVAILABLE,@Spark}
  144. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@78907a46{/storage,null,AVAILABLE,@Spark}
  145. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@4290fcd7{/storage/json,null,AVAILABLE,@Spark}
  146. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5a503cf0{/storage/rdd,null,AVAILABLE,@Spark}
  147. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@14c1cba6{/storage/rdd/json,null,AVAILABLE,@Spark}
  148. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6f78c132{/environment,null,AVAILABLE,@Spark}
  149. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@2a4bee4e{/environment/json,null,AVAILABLE,@Spark}
  150. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7127f04b{/executors,null,AVAILABLE,@Spark}
  151. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6ba19932{/executors/json,null,AVAILABLE,@Spark}
  152. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@42f9b425{/executors/threadDump,null,AVAILABLE,@Spark}
  153. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@37351baa{/executors/threadDump/json,null,AVAILABLE,@Spark}
  154. CatHeaderGraphTest:
  155. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@79de00af{/static,null,AVAILABLE,@Spark}
  156. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@14237e5{/,null,AVAILABLE,@Spark}
  157. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@33ed6546{/api,null,AVAILABLE,@Spark}
  158. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5eb4b746{/jobs/job/kill,null,AVAILABLE,@Spark}
  159. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@4ed94e6a{/stages/stage/kill,null,AVAILABLE,@Spark}
  160. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@19beeb61{/metrics/json,null,AVAILABLE,@Spark}
  161. 13:05:02 WARN: [ScalaTest-main-running-CatHeaderGraphTest] c.s.g.v.r.m.CatHeaderGraphTest$$anonfun$1$$anon$1 | spark.executor.cores is set to 1
  162. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] c.s.g.v.r.m.CatHeaderGraphTest$$anonfun$1$$anon$1 | Starting Job 0f339f1a-e4a3-4401-ad9f-c8586c6a7b75
  163. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6f2e0945{/SQL,null,AVAILABLE,@Spark}
  164. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@565fa7d2{/SQL/json,null,AVAILABLE,@Spark}
  165. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@16ecdb6d{/SQL/execution,null,AVAILABLE,@Spark}
  166. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@72a45b71{/SQL/execution/json,null,AVAILABLE,@Spark}
  167. 13:05:02 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@47541b42{/static/sql,null,AVAILABLE,@Spark}
  168. 13:05:05 WARN: [ScalaTest-main-running-CatHeaderGraphTest] o.a.s.u.Utils | Truncated the string representation of a plan since it was too large. This behavior can be adjusted by setting 'spark.debug.maxToStringFields' in SparkEnv.conf.
  169. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] c.s.g.v.r.m.CatHeaderGraphTest$$anonfun$1$$anon$1 | Stopping job 0f339f1a-e4a3-4401-ad9f-c8586c6a7b75.
  170. Job Summary:
  171. User: Dejan.Ostojic
  172. Job: 0f339f1a-e4a3-4401-ad9f-c8586c6a7b75
  173. Total time: 2956 millis
  174. cached RDD statistics:
  175.  
  176. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.AbstractConnector | Stopped Spark@23acd55e{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
  177. - getCatalogs template test *** FAILED ***
  178. org.apache.spark.SparkException: Exception thrown in awaitResult:
  179. at org.apache.spark.util.ThreadUtils$.awaitResult(ThreadUtils.scala:205)
  180. at org.apache.spark.sql.execution.exchange.BroadcastExchangeExec.doExecuteBroadcast(BroadcastExchangeExec.scala:136)
  181. at org.apache.spark.sql.execution.InputAdapter.doExecuteBroadcast(WholeStageCodegenExec.scala:367)
  182. at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeBroadcast$1.apply(SparkPlan.scala:144)
  183. at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeBroadcast$1.apply(SparkPlan.scala:140)
  184. at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeQuery$1.apply(SparkPlan.scala:155)
  185. at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
  186. at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:152)
  187. at org.apache.spark.sql.execution.SparkPlan.executeBroadcast(SparkPlan.scala:140)
  188. at org.apache.spark.sql.execution.joins.BroadcastHashJoinExec.prepareBroadcast(BroadcastHashJoinExec.scala:135)
  189. ...
  190. Cause: java.lang.IllegalArgumentException:
  191. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  192. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  193. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  194. at org.apache.spark.util.ClosureCleaner$.getClassReader(ClosureCleaner.scala:46)
  195. at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:449)
  196. at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:432)
  197. at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:733)
  198. at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:103)
  199. at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:103)
  200. at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
  201. ...
  202. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.Server | jetty-9.3.z-SNAPSHOT, build timestamp: 2018-06-05T20:24:03+02:00, git hash: d5fc0523cfa96bfebfbda19606cad384d772f04c
  203. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.Server | Started @16683ms
  204. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.AbstractConnector | Started ServerConnector@2c6b36d7{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
  205. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3f1485c3{/jobs,null,AVAILABLE,@Spark}
  206. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@17e03804{/jobs/json,null,AVAILABLE,@Spark}
  207. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@764bf20d{/jobs/job,null,AVAILABLE,@Spark}
  208. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@363bf9d{/jobs/job/json,null,AVAILABLE,@Spark}
  209. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@184218af{/stages,null,AVAILABLE,@Spark}
  210. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@e7423bb{/stages/json,null,AVAILABLE,@Spark}
  211. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@270663e2{/stages/stage,null,AVAILABLE,@Spark}
  212. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3987bfc8{/stages/stage/json,null,AVAILABLE,@Spark}
  213. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@31084f37{/stages/pool,null,AVAILABLE,@Spark}
  214. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@1ececb56{/stages/pool/json,null,AVAILABLE,@Spark}
  215. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@a43a21e{/storage,null,AVAILABLE,@Spark}
  216. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@ebe3561{/storage/json,null,AVAILABLE,@Spark}
  217. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7d3cb276{/storage/rdd,null,AVAILABLE,@Spark}
  218. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@15c042fc{/storage/rdd/json,null,AVAILABLE,@Spark}
  219. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@2045108{/environment,null,AVAILABLE,@Spark}
  220. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7dee7914{/environment/json,null,AVAILABLE,@Spark}
  221. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6559cbdd{/executors,null,AVAILABLE,@Spark}
  222. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7219a228{/executors/json,null,AVAILABLE,@Spark}
  223. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@52b53172{/executors/threadDump,null,AVAILABLE,@Spark}
  224. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5c1dc4e9{/executors/threadDump/json,null,AVAILABLE,@Spark}
  225. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7731fb94{/static,null,AVAILABLE,@Spark}
  226. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@48860fb8{/,null,AVAILABLE,@Spark}
  227. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3343997b{/api,null,AVAILABLE,@Spark}
  228. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@79de9f90{/jobs/job/kill,null,AVAILABLE,@Spark}
  229. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@15db4dc{/stages/stage/kill,null,AVAILABLE,@Spark}
  230. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@68fd0fba{/metrics/json,null,AVAILABLE,@Spark}
  231. 13:05:05 WARN: [ScalaTest-main-running-CatHeaderGraphTest] c.s.g.v.r.m.CatHeaderGraphTest$$anonfun$2$$anon$2 | spark.executor.cores is set to 1
  232. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] c.s.g.v.r.m.CatHeaderGraphTest$$anonfun$2$$anon$2 | Starting Job faa0a148-9ebc-4e59-8472-38b1b2d44588
  233. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@55732ae6{/SQL,null,AVAILABLE,@Spark}
  234. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@743167c7{/SQL/json,null,AVAILABLE,@Spark}
  235. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@640890bc{/SQL/execution,null,AVAILABLE,@Spark}
  236. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5b1f32e2{/SQL/execution/json,null,AVAILABLE,@Spark}
  237. 13:05:05 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7677d320{/static/sql,null,AVAILABLE,@Spark}
  238. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] c.s.g.v.r.m.CatHeaderGraphTest$$anonfun$2$$anon$2 | Stopping job faa0a148-9ebc-4e59-8472-38b1b2d44588.
  239. Job Summary:
  240. User: Dejan.Ostojic
  241. Job: faa0a148-9ebc-4e59-8472-38b1b2d44588
  242. Total time: 3142 millis
  243. cached RDD statistics:
  244.  
  245. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.AbstractConnector | Stopped Spark@2c6b36d7{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
  246. - getCatHeaderGraph: Relations must contain unique keys *** FAILED ***
  247. org.apache.spark.SparkException: Exception thrown in awaitResult:
  248. at org.apache.spark.util.ThreadUtils$.awaitResult(ThreadUtils.scala:205)
  249. at org.apache.spark.sql.execution.exchange.BroadcastExchangeExec.doExecuteBroadcast(BroadcastExchangeExec.scala:136)
  250. at org.apache.spark.sql.execution.InputAdapter.doExecuteBroadcast(WholeStageCodegenExec.scala:367)
  251. at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeBroadcast$1.apply(SparkPlan.scala:144)
  252. at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeBroadcast$1.apply(SparkPlan.scala:140)
  253. at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeQuery$1.apply(SparkPlan.scala:155)
  254. at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
  255. at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:152)
  256. at org.apache.spark.sql.execution.SparkPlan.executeBroadcast(SparkPlan.scala:140)
  257. at org.apache.spark.sql.execution.joins.BroadcastHashJoinExec.prepareBroadcast(BroadcastHashJoinExec.scala:135)
  258. ...
  259. Cause: java.lang.IllegalArgumentException:
  260. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  261. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  262. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  263. at org.apache.spark.util.ClosureCleaner$.getClassReader(ClosureCleaner.scala:46)
  264. at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:449)
  265. at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:432)
  266. at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:733)
  267. at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:103)
  268. at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:103)
  269. at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
  270. ...
  271. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.Server | jetty-9.3.z-SNAPSHOT, build timestamp: 2018-06-05T20:24:03+02:00, git hash: d5fc0523cfa96bfebfbda19606cad384d772f04c
  272. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.Server | Started @19857ms
  273. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.AbstractConnector | Started ServerConnector@44b860b1{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
  274. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@793937ec{/jobs,null,AVAILABLE,@Spark}
  275. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3f27a95b{/jobs/json,null,AVAILABLE,@Spark}
  276. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@1913188a{/jobs/job,null,AVAILABLE,@Spark}
  277. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@1e295ef1{/jobs/job/json,null,AVAILABLE,@Spark}
  278. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@2e9f8c8f{/stages,null,AVAILABLE,@Spark}
  279. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@2cf09576{/stages/json,null,AVAILABLE,@Spark}
  280. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@2d260f2a{/stages/stage,null,AVAILABLE,@Spark}
  281. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@79ac02a9{/stages/stage/json,null,AVAILABLE,@Spark}
  282. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@2b8502e7{/stages/pool,null,AVAILABLE,@Spark}
  283. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@37669c4{/stages/pool/json,null,AVAILABLE,@Spark}
  284. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@1e3469df{/storage,null,AVAILABLE,@Spark}
  285. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@79499fa{/storage/json,null,AVAILABLE,@Spark}
  286. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@48531d5{/storage/rdd,null,AVAILABLE,@Spark}
  287. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@340d50c8{/storage/rdd/json,null,AVAILABLE,@Spark}
  288. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@9cabd07{/environment,null,AVAILABLE,@Spark}
  289. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@2a32be8d{/environment/json,null,AVAILABLE,@Spark}
  290. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7942987{/executors,null,AVAILABLE,@Spark}
  291. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5941a2ad{/executors/json,null,AVAILABLE,@Spark}
  292. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5bf1e07{/executors/threadDump,null,AVAILABLE,@Spark}
  293. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3ac60eeb{/executors/threadDump/json,null,AVAILABLE,@Spark}
  294. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@1c38d025{/static,null,AVAILABLE,@Spark}
  295. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@48b85dc5{/,null,AVAILABLE,@Spark}
  296. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@350a3df3{/api,null,AVAILABLE,@Spark}
  297. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@65d28ad4{/jobs/job/kill,null,AVAILABLE,@Spark}
  298. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6f0ea5de{/stages/stage/kill,null,AVAILABLE,@Spark}
  299. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@32a37d12{/metrics/json,null,AVAILABLE,@Spark}
  300. 13:05:08 WARN: [ScalaTest-main-running-CatHeaderGraphTest] c.s.g.v.r.m.CatHeaderGraphTest$$anonfun$3$$anon$3 | spark.executor.cores is set to 1
  301. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] c.s.g.v.r.m.CatHeaderGraphTest$$anonfun$3$$anon$3 | Starting Job 3faaf534-96d5-4aa7-8a20-be6b35d25be6
  302. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@591b8f15{/SQL,null,AVAILABLE,@Spark}
  303. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7b5f886d{/SQL/json,null,AVAILABLE,@Spark}
  304. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@badf24b{/SQL/execution,null,AVAILABLE,@Spark}
  305. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@efa6a81{/SQL/execution/json,null,AVAILABLE,@Spark}
  306. 13:05:08 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5d5822bc{/static/sql,null,AVAILABLE,@Spark}
  307. 13:05:11 INFO: [ScalaTest-main-running-CatHeaderGraphTest] c.s.g.v.r.m.CatHeaderGraphTest$$anonfun$3$$anon$3 | Stopping job 3faaf534-96d5-4aa7-8a20-be6b35d25be6.
  308. Job Summary:
  309. User: Dejan.Ostojic
  310. Job: 3faaf534-96d5-4aa7-8a20-be6b35d25be6
  311. Total time: 2504 millis
  312. cached RDD statistics:
  313.  
  314. 13:05:11 INFO: [ScalaTest-main-running-CatHeaderGraphTest] o.s.j.s.AbstractConnector | Stopped Spark@44b860b1{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
  315. - getCatHeaderGraph: Nodes must include realDate *** FAILED ***
  316. org.apache.spark.SparkException: Exception thrown in awaitResult:
  317. at org.apache.spark.util.ThreadUtils$.awaitResult(ThreadUtils.scala:205)
  318. at org.apache.spark.sql.execution.exchange.BroadcastExchangeExec.doExecuteBroadcast(BroadcastExchangeExec.scala:136)
  319. at org.apache.spark.sql.execution.InputAdapter.doExecuteBroadcast(WholeStageCodegenExec.scala:367)
  320. at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeBroadcast$1.apply(SparkPlan.scala:144)
  321. at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeBroadcast$1.apply(SparkPlan.scala:140)
  322. at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeQuery$1.apply(SparkPlan.scala:155)
  323. at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
  324. at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:152)
  325. at org.apache.spark.sql.execution.SparkPlan.executeBroadcast(SparkPlan.scala:140)
  326. at org.apache.spark.sql.execution.joins.BroadcastHashJoinExec.prepareBroadcast(BroadcastHashJoinExec.scala:135)
  327. ...
  328. Cause: java.lang.IllegalArgumentException:
  329. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  330. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  331. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  332. at org.apache.spark.util.ClosureCleaner$.getClassReader(ClosureCleaner.scala:46)
  333. at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:449)
  334. at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:432)
  335. at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:733)
  336. at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:103)
  337. at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:103)
  338. at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
  339. ...
  340. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.Server | jetty-9.3.z-SNAPSHOT, build timestamp: 2018-06-05T20:24:03+02:00, git hash: d5fc0523cfa96bfebfbda19606cad384d772f04c
  341. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.Server | Started @22440ms
  342. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.AbstractConnector | Started ServerConnector@402e48d{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
  343. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@1daf79ab{/jobs,null,AVAILABLE,@Spark}
  344. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@1b84d2e{/jobs/json,null,AVAILABLE,@Spark}
  345. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7e3c5dbb{/jobs/job,null,AVAILABLE,@Spark}
  346. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6d89f87d{/jobs/job/json,null,AVAILABLE,@Spark}
  347. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@b8da646{/stages,null,AVAILABLE,@Spark}
  348. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@489f5b24{/stages/json,null,AVAILABLE,@Spark}
  349. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@54d20609{/stages/stage,null,AVAILABLE,@Spark}
  350. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@763a46fe{/stages/stage/json,null,AVAILABLE,@Spark}
  351. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@106361e9{/stages/pool,null,AVAILABLE,@Spark}
  352. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@22974eba{/stages/pool/json,null,AVAILABLE,@Spark}
  353. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6631e6af{/storage,null,AVAILABLE,@Spark}
  354. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@42985121{/storage/json,null,AVAILABLE,@Spark}
  355. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@497f0cb2{/storage/rdd,null,AVAILABLE,@Spark}
  356. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@510579b9{/storage/rdd/json,null,AVAILABLE,@Spark}
  357. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@38e8f9a8{/environment,null,AVAILABLE,@Spark}
  358. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@38f9b6cd{/environment/json,null,AVAILABLE,@Spark}
  359. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@95237fc{/executors,null,AVAILABLE,@Spark}
  360. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@73605fde{/executors/json,null,AVAILABLE,@Spark}
  361. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@c3acda3{/executors/threadDump,null,AVAILABLE,@Spark}
  362. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@79805d37{/executors/threadDump/json,null,AVAILABLE,@Spark}
  363. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6175782c{/static,null,AVAILABLE,@Spark}
  364. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@109a5573{/,null,AVAILABLE,@Spark}
  365. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@4a17c516{/api,null,AVAILABLE,@Spark}
  366. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7b7bfa82{/jobs/job/kill,null,AVAILABLE,@Spark}
  367. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@39081953{/stages/stage/kill,null,AVAILABLE,@Spark}
  368. SgrpGraphTest:
  369. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3817d886{/metrics/json,null,AVAILABLE,@Spark}
  370. 13:05:11 WARN: [ScalaTest-main-running-SgrpGraphTest] c.s.g.v.r.m.SgrpGraphTest$$anonfun$1$$anon$1 | spark.executor.cores is set to 1
  371. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] c.s.g.v.r.m.SgrpGraphTest$$anonfun$1$$anon$1 | Starting Job 151672c4-5bfc-4cbb-9d56-78acee488d80
  372. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7da3cbeb{/SQL,null,AVAILABLE,@Spark}
  373. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5e396d2c{/SQL/json,null,AVAILABLE,@Spark}
  374. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@755dae57{/SQL/execution,null,AVAILABLE,@Spark}
  375. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@18c49ecb{/SQL/execution/json,null,AVAILABLE,@Spark}
  376. 13:05:11 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@180c785d{/static/sql,null,AVAILABLE,@Spark}
  377. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] c.s.g.v.r.m.SgrpGraphTest$$anonfun$1$$anon$1 | Stopping job 151672c4-5bfc-4cbb-9d56-78acee488d80.
  378. Job Summary:
  379. User: Dejan.Ostojic
  380. Job: 151672c4-5bfc-4cbb-9d56-78acee488d80
  381. Total time: 658 millis
  382. cached RDD statistics:
  383.  
  384. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.AbstractConnector | Stopped Spark@402e48d{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
  385. - getSgrpGraph: Relations must contain unique keys *** FAILED ***
  386. java.lang.IllegalArgumentException:
  387. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  388. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  389. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  390. at org.apache.spark.util.ClosureCleaner$.getClassReader(ClosureCleaner.scala:46)
  391. at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:449)
  392. at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:432)
  393. at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:733)
  394. at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:103)
  395. at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:103)
  396. at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
  397. ...
  398. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.Server | jetty-9.3.z-SNAPSHOT, build timestamp: 2018-06-05T20:24:03+02:00, git hash: d5fc0523cfa96bfebfbda19606cad384d772f04c
  399. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.Server | Started @23128ms
  400. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.AbstractConnector | Started ServerConnector@43f06942{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
  401. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6aa060f6{/jobs,null,AVAILABLE,@Spark}
  402. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@579c15a7{/jobs/json,null,AVAILABLE,@Spark}
  403. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@1a29c848{/jobs/job,null,AVAILABLE,@Spark}
  404. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5a530836{/jobs/job/json,null,AVAILABLE,@Spark}
  405. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@331d645a{/stages,null,AVAILABLE,@Spark}
  406. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@49b7eb3{/stages/json,null,AVAILABLE,@Spark}
  407. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@50a48de0{/stages/stage,null,AVAILABLE,@Spark}
  408. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@12f43d7a{/stages/stage/json,null,AVAILABLE,@Spark}
  409. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@4a13a4ca{/stages/pool,null,AVAILABLE,@Spark}
  410. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@152225dd{/stages/pool/json,null,AVAILABLE,@Spark}
  411. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@611d6114{/storage,null,AVAILABLE,@Spark}
  412. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@52318fa0{/storage/json,null,AVAILABLE,@Spark}
  413. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5d354d8{/storage/rdd,null,AVAILABLE,@Spark}
  414. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@1db9572{/storage/rdd/json,null,AVAILABLE,@Spark}
  415. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@bc4419c{/environment,null,AVAILABLE,@Spark}
  416. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@55d683cb{/environment/json,null,AVAILABLE,@Spark}
  417. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@4a3c683d{/executors,null,AVAILABLE,@Spark}
  418. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@1791040d{/executors/json,null,AVAILABLE,@Spark}
  419. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3e706fc2{/executors/threadDump,null,AVAILABLE,@Spark}
  420. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5f597b1c{/executors/threadDump/json,null,AVAILABLE,@Spark}
  421. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@760d9d4a{/static,null,AVAILABLE,@Spark}
  422. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@69235eea{/,null,AVAILABLE,@Spark}
  423. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@54902273{/api,null,AVAILABLE,@Spark}
  424. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5a7810e1{/jobs/job/kill,null,AVAILABLE,@Spark}
  425. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@29dfc14a{/stages/stage/kill,null,AVAILABLE,@Spark}
  426. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@d57feda{/metrics/json,null,AVAILABLE,@Spark}
  427. 13:05:12 WARN: [ScalaTest-main-running-SgrpGraphTest] c.s.g.v.r.m.SgrpGraphTest$$anonfun$2$$anon$2 | spark.executor.cores is set to 1
  428. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] c.s.g.v.r.m.SgrpGraphTest$$anonfun$2$$anon$2 | Starting Job d5ab2da1-44cf-4ff7-98ca-68342d40471d
  429. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5df785d1{/SQL,null,AVAILABLE,@Spark}
  430. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6ce45045{/SQL/json,null,AVAILABLE,@Spark}
  431. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@4b85a64{/SQL/execution,null,AVAILABLE,@Spark}
  432. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@36c222ef{/SQL/execution/json,null,AVAILABLE,@Spark}
  433. 13:05:12 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@577d001f{/static/sql,null,AVAILABLE,@Spark}
  434. 13:05:13 INFO: [ScalaTest-main-running-SgrpGraphTest] c.s.g.v.r.m.SgrpGraphTest$$anonfun$2$$anon$2 | Stopping job d5ab2da1-44cf-4ff7-98ca-68342d40471d.
  435. Job Summary:
  436. User: Dejan.Ostojic
  437. Job: d5ab2da1-44cf-4ff7-98ca-68342d40471d
  438. Total time: 1191 millis
  439. cached RDD statistics:
  440.  
  441. 13:05:13 INFO: [ScalaTest-main-running-SgrpGraphTest] o.s.j.s.AbstractConnector | Stopped Spark@43f06942{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
  442. - getSgrpGraph: Nodes must include realDate *** FAILED ***
  443. java.lang.IllegalArgumentException:
  444. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  445. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  446. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  447. at org.apache.spark.util.ClosureCleaner$.getClassReader(ClosureCleaner.scala:46)
  448. at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:449)
  449. at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:432)
  450. at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:733)
  451. at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:103)
  452. at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:103)
  453. at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
  454. ...
  455. GraphDeltaTest:
  456. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.Server | jetty-9.3.z-SNAPSHOT, build timestamp: 2018-06-05T20:24:03+02:00, git hash: d5fc0523cfa96bfebfbda19606cad384d772f04c
  457. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.Server | Started @24396ms
  458. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.AbstractConnector | Started ServerConnector@6fc60b62{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
  459. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@73a91b68{/jobs,null,AVAILABLE,@Spark}
  460. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@24d25c43{/jobs/json,null,AVAILABLE,@Spark}
  461. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@772dfe03{/jobs/job,null,AVAILABLE,@Spark}
  462. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6157c26f{/jobs/job/json,null,AVAILABLE,@Spark}
  463. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5a9ee776{/stages,null,AVAILABLE,@Spark}
  464. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6c988822{/stages/json,null,AVAILABLE,@Spark}
  465. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@74ddae54{/stages/stage,null,AVAILABLE,@Spark}
  466. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@2b465e1a{/stages/stage/json,null,AVAILABLE,@Spark}
  467. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6ceb953{/stages/pool,null,AVAILABLE,@Spark}
  468. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@2e3fe830{/stages/pool/json,null,AVAILABLE,@Spark}
  469. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@37095cad{/storage,null,AVAILABLE,@Spark}
  470. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@2e2662d8{/storage/json,null,AVAILABLE,@Spark}
  471. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5dd1526e{/storage/rdd,null,AVAILABLE,@Spark}
  472. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@cfe4f8c{/storage/rdd/json,null,AVAILABLE,@Spark}
  473. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@716f968a{/environment,null,AVAILABLE,@Spark}
  474. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6cc20add{/environment/json,null,AVAILABLE,@Spark}
  475. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3b577709{/executors,null,AVAILABLE,@Spark}
  476. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@452bddc0{/executors/json,null,AVAILABLE,@Spark}
  477. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@48fdd829{/executors/threadDump,null,AVAILABLE,@Spark}
  478. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3495b709{/executors/threadDump/json,null,AVAILABLE,@Spark}
  479. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@34fa61ad{/static,null,AVAILABLE,@Spark}
  480. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@2fa46f2f{/,null,AVAILABLE,@Spark}
  481. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@9bec662{/api,null,AVAILABLE,@Spark}
  482. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@779af906{/jobs/job/kill,null,AVAILABLE,@Spark}
  483. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7b4b2dcd{/stages/stage/kill,null,AVAILABLE,@Spark}
  484. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@282506e1{/metrics/json,null,AVAILABLE,@Spark}
  485. 13:05:13 WARN: [ScalaTest-main-running-GraphDeltaTest] c.s.g.v.r.m.GraphDeltaTest$$anonfun$1$$anon$1 | spark.executor.cores is set to 1
  486. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] c.s.g.v.r.m.GraphDeltaTest$$anonfun$1$$anon$1 | Starting Job 32a76fd2-c364-4a3b-96e9-b1e7f403f32d
  487. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@4f67dbce{/SQL,null,AVAILABLE,@Spark}
  488. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7edad7d2{/SQL/json,null,AVAILABLE,@Spark}
  489. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@25370af5{/SQL/execution,null,AVAILABLE,@Spark}
  490. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6407c1b3{/SQL/execution/json,null,AVAILABLE,@Spark}
  491. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@486cb71f{/static/sql,null,AVAILABLE,@Spark}
  492. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] c.s.g.v.r.m.GraphDeltaTest$$anonfun$1$$anon$1 | Stopping job 32a76fd2-c364-4a3b-96e9-b1e7f403f32d.
  493. Job Summary:
  494. User: Dejan.Ostojic
  495. Job: 32a76fd2-c364-4a3b-96e9-b1e7f403f32d
  496. Total time: 580 millis
  497. cached RDD statistics:
  498.  
  499. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.AbstractConnector | Stopped Spark@6fc60b62{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
  500. - GraphDelta.getNodesDelta *** FAILED ***
  501. java.lang.IllegalArgumentException:
  502. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  503. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  504. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  505. at org.apache.spark.util.ClosureCleaner$.getClassReader(ClosureCleaner.scala:46)
  506. at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:449)
  507. at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:432)
  508. at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:733)
  509. at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:103)
  510. at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:103)
  511. at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
  512. ...
  513. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.Server | jetty-9.3.z-SNAPSHOT, build timestamp: 2018-06-05T20:24:03+02:00, git hash: d5fc0523cfa96bfebfbda19606cad384d772f04c
  514. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.Server | Started @24962ms
  515. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.AbstractConnector | Started ServerConnector@25b527c9{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
  516. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@568e814c{/jobs,null,AVAILABLE,@Spark}
  517. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@299d1bd6{/jobs/json,null,AVAILABLE,@Spark}
  518. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@4cecbf3e{/jobs/job,null,AVAILABLE,@Spark}
  519. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@54039b8a{/jobs/job/json,null,AVAILABLE,@Spark}
  520. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7625f4a7{/stages,null,AVAILABLE,@Spark}
  521. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3727021e{/stages/json,null,AVAILABLE,@Spark}
  522. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@1e1b4e8b{/stages/stage,null,AVAILABLE,@Spark}
  523. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@568c4909{/stages/stage/json,null,AVAILABLE,@Spark}
  524. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@fd51fb3{/stages/pool,null,AVAILABLE,@Spark}
  525. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6ddba5{/stages/pool/json,null,AVAILABLE,@Spark}
  526. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@4446b235{/storage,null,AVAILABLE,@Spark}
  527. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@70366fb5{/storage/json,null,AVAILABLE,@Spark}
  528. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@57b9ce87{/storage/rdd,null,AVAILABLE,@Spark}
  529. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@39e79726{/storage/rdd/json,null,AVAILABLE,@Spark}
  530. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@48c15d35{/environment,null,AVAILABLE,@Spark}
  531. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@b49c85f{/environment/json,null,AVAILABLE,@Spark}
  532. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@129df247{/executors,null,AVAILABLE,@Spark}
  533. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@17c60995{/executors/json,null,AVAILABLE,@Spark}
  534. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@552cd6ad{/executors/threadDump,null,AVAILABLE,@Spark}
  535. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@1062f767{/executors/threadDump/json,null,AVAILABLE,@Spark}
  536. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6d9020e6{/static,null,AVAILABLE,@Spark}
  537. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@4a3d0660{/,null,AVAILABLE,@Spark}
  538. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@79172834{/api,null,AVAILABLE,@Spark}
  539. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@1232a981{/jobs/job/kill,null,AVAILABLE,@Spark}
  540. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@309eb3a1{/stages/stage/kill,null,AVAILABLE,@Spark}
  541. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@76774d3f{/metrics/json,null,AVAILABLE,@Spark}
  542. 13:05:13 WARN: [ScalaTest-main-running-GraphDeltaTest] c.s.g.v.r.m.GraphDeltaTest$$anonfun$2$$anon$2 | spark.executor.cores is set to 1
  543. 13:05:13 INFO: [ScalaTest-main-running-GraphDeltaTest] c.s.g.v.r.m.GraphDeltaTest$$anonfun$2$$anon$2 | Starting Job e5148570-9a87-4f91-9c48-ff815ef5537b
  544. 13:05:14 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7f8b9fa7{/SQL,null,AVAILABLE,@Spark}
  545. 13:05:14 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3906de9{/SQL/json,null,AVAILABLE,@Spark}
  546. 13:05:14 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@1dfdddfa{/SQL/execution,null,AVAILABLE,@Spark}
  547. 13:05:14 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3335713{/SQL/execution/json,null,AVAILABLE,@Spark}
  548. 13:05:14 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7dbcbc7b{/static/sql,null,AVAILABLE,@Spark}
  549. 13:05:14 INFO: [ScalaTest-main-running-GraphDeltaTest] c.s.g.v.r.m.GraphDeltaTest$$anonfun$2$$anon$2 | Stopping job e5148570-9a87-4f91-9c48-ff815ef5537b.
  550. Job Summary:
  551. User: Dejan.Ostojic
  552. Job: e5148570-9a87-4f91-9c48-ff815ef5537b
  553. Total time: 264 millis
  554. cached RDD statistics:
  555.  
  556. 13:05:14 INFO: [ScalaTest-main-running-GraphDeltaTest] o.s.j.s.AbstractConnector | Stopped Spark@25b527c9{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
  557. - GraphDelta.getRelationsDelta *** FAILED ***
  558. java.lang.IllegalArgumentException:
  559. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  560. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  561. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  562. at org.apache.spark.util.ClosureCleaner$.getClassReader(ClosureCleaner.scala:46)
  563. at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:449)
  564. at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:432)
  565. at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:733)
  566. at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:103)
  567. at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:103)
  568. at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
  569. ...
  570. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.Server | jetty-9.3.z-SNAPSHOT, build timestamp: 2018-06-05T20:24:03+02:00, git hash: d5fc0523cfa96bfebfbda19606cad384d772f04c
  571. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.Server | Started @25280ms
  572. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.AbstractConnector | Started ServerConnector@49d5b1{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
  573. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@bf42a2a{/jobs,null,AVAILABLE,@Spark}
  574. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@16c90eac{/jobs/json,null,AVAILABLE,@Spark}
  575. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@664d4ee1{/jobs/job,null,AVAILABLE,@Spark}
  576. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@28e7fbc4{/jobs/job/json,null,AVAILABLE,@Spark}
  577. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@2e82188{/stages,null,AVAILABLE,@Spark}
  578. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5c0ae317{/stages/json,null,AVAILABLE,@Spark}
  579. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@503c8431{/stages/stage,null,AVAILABLE,@Spark}
  580. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@47127c29{/stages/stage/json,null,AVAILABLE,@Spark}
  581. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@435e122{/stages/pool,null,AVAILABLE,@Spark}
  582. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@faca8e8{/stages/pool/json,null,AVAILABLE,@Spark}
  583. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3b85a820{/storage,null,AVAILABLE,@Spark}
  584. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6f22784d{/storage/json,null,AVAILABLE,@Spark}
  585. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@44b5a87a{/storage/rdd,null,AVAILABLE,@Spark}
  586. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@2eb4a3ec{/storage/rdd/json,null,AVAILABLE,@Spark}
  587. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@38e6dab2{/environment,null,AVAILABLE,@Spark}
  588. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@44fa2df3{/environment/json,null,AVAILABLE,@Spark}
  589. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@2de5bb6e{/executors,null,AVAILABLE,@Spark}
  590. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@2645d6fd{/executors/json,null,AVAILABLE,@Spark}
  591. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@2878abcd{/executors/threadDump,null,AVAILABLE,@Spark}
  592. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3df88e84{/executors/threadDump/json,null,AVAILABLE,@Spark}
  593. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3dc67c9e{/static,null,AVAILABLE,@Spark}
  594. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@353cb7e5{/,null,AVAILABLE,@Spark}
  595. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@58f7544c{/api,null,AVAILABLE,@Spark}
  596. CatPositionGraphTest:
  597. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@2faec75a{/jobs/job/kill,null,AVAILABLE,@Spark}
  598. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7ffdded5{/stages/stage/kill,null,AVAILABLE,@Spark}
  599. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7bdc5700{/metrics/json,null,AVAILABLE,@Spark}
  600. 13:05:14 WARN: [ScalaTest-main-running-CatPositionGraphTest] c.s.g.v.r.m.CatPositionGraphTest$$anonfun$1$$anon$1 | spark.executor.cores is set to 1
  601. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] c.s.g.v.r.m.CatPositionGraphTest$$anonfun$1$$anon$1 | Starting Job dfcc3e6f-d296-40e0-acfc-4270726a9560
  602. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3752cff3{/SQL,null,AVAILABLE,@Spark}
  603. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@49253d1f{/SQL/json,null,AVAILABLE,@Spark}
  604. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@4df0eb55{/SQL/execution,null,AVAILABLE,@Spark}
  605. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@622b91dc{/SQL/execution/json,null,AVAILABLE,@Spark}
  606. 13:05:14 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6a5cb26f{/static/sql,null,AVAILABLE,@Spark}
  607. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] c.s.g.v.r.m.CatPositionGraphTest$$anonfun$1$$anon$1 | Stopping job dfcc3e6f-d296-40e0-acfc-4270726a9560.
  608. Job Summary:
  609. User: Dejan.Ostojic
  610. Job: dfcc3e6f-d296-40e0-acfc-4270726a9560
  611. Total time: 3007 millis
  612. cached RDD statistics:
  613.  
  614. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.AbstractConnector | Stopped Spark@49d5b1{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
  615. - getCatalogPositions template test *** FAILED ***
  616. org.apache.spark.SparkException: Exception thrown in awaitResult:
  617. at org.apache.spark.util.ThreadUtils$.awaitResult(ThreadUtils.scala:205)
  618. at org.apache.spark.sql.execution.exchange.BroadcastExchangeExec.doExecuteBroadcast(BroadcastExchangeExec.scala:136)
  619. at org.apache.spark.sql.execution.InputAdapter.doExecuteBroadcast(WholeStageCodegenExec.scala:367)
  620. at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeBroadcast$1.apply(SparkPlan.scala:144)
  621. at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeBroadcast$1.apply(SparkPlan.scala:140)
  622. at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeQuery$1.apply(SparkPlan.scala:155)
  623. at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
  624. at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:152)
  625. at org.apache.spark.sql.execution.SparkPlan.executeBroadcast(SparkPlan.scala:140)
  626. at org.apache.spark.sql.execution.joins.BroadcastHashJoinExec.prepareBroadcast(BroadcastHashJoinExec.scala:135)
  627. ...
  628. Cause: java.lang.IllegalArgumentException:
  629. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  630. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  631. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  632. at org.apache.spark.util.ClosureCleaner$.getClassReader(ClosureCleaner.scala:46)
  633. at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:449)
  634. at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:432)
  635. at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:733)
  636. at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:103)
  637. at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:103)
  638. at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
  639. ...
  640. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.Server | jetty-9.3.z-SNAPSHOT, build timestamp: 2018-06-05T20:24:03+02:00, git hash: d5fc0523cfa96bfebfbda19606cad384d772f04c
  641. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.Server | Started @28339ms
  642. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.AbstractConnector | Started ServerConnector@47c5ad11{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
  643. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7882f2e2{/jobs,null,AVAILABLE,@Spark}
  644. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@40fd518f{/jobs/json,null,AVAILABLE,@Spark}
  645. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@1dafe1d2{/jobs/job,null,AVAILABLE,@Spark}
  646. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@77e86a53{/jobs/job/json,null,AVAILABLE,@Spark}
  647. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@189283ae{/stages,null,AVAILABLE,@Spark}
  648. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3249c81a{/stages/json,null,AVAILABLE,@Spark}
  649. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@508a1ef0{/stages/stage,null,AVAILABLE,@Spark}
  650. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@64845c40{/stages/stage/json,null,AVAILABLE,@Spark}
  651. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@68073c8d{/stages/pool,null,AVAILABLE,@Spark}
  652. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@1472308f{/stages/pool/json,null,AVAILABLE,@Spark}
  653. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@140fc16f{/storage,null,AVAILABLE,@Spark}
  654. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@52afe9f2{/storage/json,null,AVAILABLE,@Spark}
  655. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@39d547e{/storage/rdd,null,AVAILABLE,@Spark}
  656. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@66efaca{/storage/rdd/json,null,AVAILABLE,@Spark}
  657. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6c8057d1{/environment,null,AVAILABLE,@Spark}
  658. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@414dc3ca{/environment/json,null,AVAILABLE,@Spark}
  659. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@281a5139{/executors,null,AVAILABLE,@Spark}
  660. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5953465a{/executors/json,null,AVAILABLE,@Spark}
  661. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3703bc7e{/executors/threadDump,null,AVAILABLE,@Spark}
  662. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@187f6ac7{/executors/threadDump/json,null,AVAILABLE,@Spark}
  663. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@62167368{/static,null,AVAILABLE,@Spark}
  664. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@213488e6{/,null,AVAILABLE,@Spark}
  665. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@b7e20f2{/api,null,AVAILABLE,@Spark}
  666. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3968e955{/jobs/job/kill,null,AVAILABLE,@Spark}
  667. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3c9e2526{/stages/stage/kill,null,AVAILABLE,@Spark}
  668. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@4acca937{/metrics/json,null,AVAILABLE,@Spark}
  669. 13:05:17 WARN: [ScalaTest-main-running-CatPositionGraphTest] c.s.g.v.r.m.CatPositionGraphTest$$anonfun$2$$anon$2 | spark.executor.cores is set to 1
  670. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] c.s.g.v.r.m.CatPositionGraphTest$$anonfun$2$$anon$2 | Starting Job b9a94f71-ce24-4d2b-8dce-3c66d2d39b51
  671. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@1b6c7e3c{/SQL,null,AVAILABLE,@Spark}
  672. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@778067f5{/SQL/json,null,AVAILABLE,@Spark}
  673. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@774e5726{/SQL/execution,null,AVAILABLE,@Spark}
  674. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@595dda6d{/SQL/execution/json,null,AVAILABLE,@Spark}
  675. 13:05:17 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@cfcab77{/static/sql,null,AVAILABLE,@Spark}
  676. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] c.s.g.v.r.m.CatPositionGraphTest$$anonfun$2$$anon$2 | Stopping job b9a94f71-ce24-4d2b-8dce-3c66d2d39b51.
  677. Job Summary:
  678. User: Dejan.Ostojic
  679. Job: b9a94f71-ce24-4d2b-8dce-3c66d2d39b51
  680. Total time: 3332 millis
  681. cached RDD statistics:
  682.  
  683. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.AbstractConnector | Stopped Spark@47c5ad11{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
  684. - getCatPositionGraph: Relations must contain unique keys *** FAILED ***
  685. org.apache.spark.SparkException: Exception thrown in awaitResult:
  686. at org.apache.spark.util.ThreadUtils$.awaitResult(ThreadUtils.scala:205)
  687. at org.apache.spark.sql.execution.exchange.BroadcastExchangeExec.doExecuteBroadcast(BroadcastExchangeExec.scala:136)
  688. at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeBroadcast$1.apply(SparkPlan.scala:144)
  689. at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeBroadcast$1.apply(SparkPlan.scala:140)
  690. at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeQuery$1.apply(SparkPlan.scala:155)
  691. at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
  692. at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:152)
  693. at org.apache.spark.sql.execution.SparkPlan.executeBroadcast(SparkPlan.scala:140)
  694. at org.apache.spark.sql.execution.exchange.ReusedExchangeExec.doExecuteBroadcast(Exchange.scala:60)
  695. at org.apache.spark.sql.execution.InputAdapter.doExecuteBroadcast(WholeStageCodegenExec.scala:367)
  696. ...
  697. Cause: java.lang.IllegalArgumentException:
  698. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  699. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  700. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  701. at org.apache.spark.util.ClosureCleaner$.getClassReader(ClosureCleaner.scala:46)
  702. at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:449)
  703. at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:432)
  704. at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:733)
  705. at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:103)
  706. at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:103)
  707. at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
  708. ...
  709. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.Server | jetty-9.3.z-SNAPSHOT, build timestamp: 2018-06-05T20:24:03+02:00, git hash: d5fc0523cfa96bfebfbda19606cad384d772f04c
  710. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.Server | Started @31706ms
  711. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.AbstractConnector | Started ServerConnector@5484eabe{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
  712. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@9b44d4f{/jobs,null,AVAILABLE,@Spark}
  713. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@d863a65{/jobs/json,null,AVAILABLE,@Spark}
  714. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7516aa4{/jobs/job,null,AVAILABLE,@Spark}
  715. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@19a98be6{/jobs/job/json,null,AVAILABLE,@Spark}
  716. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@325c63a9{/stages,null,AVAILABLE,@Spark}
  717. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@eb52295{/stages/json,null,AVAILABLE,@Spark}
  718. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@23d7dad{/stages/stage,null,AVAILABLE,@Spark}
  719. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@579e30b7{/stages/stage/json,null,AVAILABLE,@Spark}
  720. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@60e50c6{/stages/pool,null,AVAILABLE,@Spark}
  721. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@21886b18{/stages/pool/json,null,AVAILABLE,@Spark}
  722. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@48b1ba91{/storage,null,AVAILABLE,@Spark}
  723. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6e0c20b8{/storage/json,null,AVAILABLE,@Spark}
  724. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@1a70d5df{/storage/rdd,null,AVAILABLE,@Spark}
  725. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7842ad22{/storage/rdd/json,null,AVAILABLE,@Spark}
  726. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3de2e589{/environment,null,AVAILABLE,@Spark}
  727. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@32640b6d{/environment/json,null,AVAILABLE,@Spark}
  728. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@2e26eed3{/executors,null,AVAILABLE,@Spark}
  729. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@43e07d88{/executors/json,null,AVAILABLE,@Spark}
  730. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@690406d0{/executors/threadDump,null,AVAILABLE,@Spark}
  731. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7ba947fe{/executors/threadDump/json,null,AVAILABLE,@Spark}
  732. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@62e06e2e{/static,null,AVAILABLE,@Spark}
  733. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@222c53c7{/,null,AVAILABLE,@Spark}
  734. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6bd7f3d4{/api,null,AVAILABLE,@Spark}
  735. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3b805b99{/jobs/job/kill,null,AVAILABLE,@Spark}
  736. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@7bf28545{/stages/stage/kill,null,AVAILABLE,@Spark}
  737. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6afe49f5{/metrics/json,null,AVAILABLE,@Spark}
  738. 13:05:20 WARN: [ScalaTest-main-running-CatPositionGraphTest] c.s.g.v.r.m.CatPositionGraphTest$$anonfun$3$$anon$3 | spark.executor.cores is set to 1
  739. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] c.s.g.v.r.m.CatPositionGraphTest$$anonfun$3$$anon$3 | Starting Job 65ea32c1-9c81-4978-983f-437ebc33d3df
  740. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@d7da0ae{/SQL,null,AVAILABLE,@Spark}
  741. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@1510644f{/SQL/json,null,AVAILABLE,@Spark}
  742. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5046ad1c{/SQL/execution,null,AVAILABLE,@Spark}
  743. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@368f2959{/SQL/execution/json,null,AVAILABLE,@Spark}
  744. 13:05:20 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@761c9f11{/static/sql,null,AVAILABLE,@Spark}
  745. 13:05:23 INFO: [ScalaTest-main-running-CatPositionGraphTest] c.s.g.v.r.m.CatPositionGraphTest$$anonfun$3$$anon$3 | Stopping job 65ea32c1-9c81-4978-983f-437ebc33d3df.
  746. Job Summary:
  747. User: Dejan.Ostojic
  748. Job: 65ea32c1-9c81-4978-983f-437ebc33d3df
  749. Total time: 2961 millis
  750. cached RDD statistics:
  751.  
  752. 13:05:23 INFO: [ScalaTest-main-running-CatPositionGraphTest] o.s.j.s.AbstractConnector | Stopped Spark@5484eabe{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
  753. - getCatPositionGraph: Nodes must include realDate with null end dates *** FAILED ***
  754. org.apache.spark.SparkException: Exception thrown in awaitResult:
  755. at org.apache.spark.util.ThreadUtils$.awaitResult(ThreadUtils.scala:205)
  756. at org.apache.spark.sql.execution.exchange.BroadcastExchangeExec.doExecuteBroadcast(BroadcastExchangeExec.scala:136)
  757. at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeBroadcast$1.apply(SparkPlan.scala:144)
  758. at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeBroadcast$1.apply(SparkPlan.scala:140)
  759. at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeQuery$1.apply(SparkPlan.scala:155)
  760. at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
  761. at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:152)
  762. at org.apache.spark.sql.execution.SparkPlan.executeBroadcast(SparkPlan.scala:140)
  763. at org.apache.spark.sql.execution.exchange.ReusedExchangeExec.doExecuteBroadcast(Exchange.scala:60)
  764. at org.apache.spark.sql.execution.InputAdapter.doExecuteBroadcast(WholeStageCodegenExec.scala:367)
  765. ...
  766. Cause: java.lang.IllegalArgumentException:
  767. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  768. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  769. at org.apache.xbean.asm5.ClassReader.<init>(Unknown Source)
  770. at org.apache.spark.util.ClosureCleaner$.getClassReader(ClosureCleaner.scala:46)
  771. at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:449)
  772. at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:432)
  773. at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:733)
  774. at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:103)
  775. at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:103)
  776. at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
  777. ...
  778. UdmGraphTest:
  779. 13:05:30 INFO: [ScalaTest-main-running-UdmGraphTest] c.s.j.s.i.a.WebApplicationImpl | Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:43 PM'
  780. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] c.s.j.s.i.a.WebApplicationImpl | Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:43 PM'
  781. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] c.s.j.s.i.a.WebApplicationImpl | Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:43 PM'
  782. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.Server | jetty-9.3.z-SNAPSHOT, build timestamp: 2018-06-05T20:24:03+02:00, git hash: d5fc0523cfa96bfebfbda19606cad384d772f04c
  783. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.Server | Started @42972ms
  784. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.AbstractConnector | Started ServerConnector@551fe17a{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
  785. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6efffd0b{/jobs,null,AVAILABLE,@Spark}
  786. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@679ba4a9{/jobs/json,null,AVAILABLE,@Spark}
  787. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6fed4e20{/jobs/job,null,AVAILABLE,@Spark}
  788. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@1f54552e{/jobs/job/json,null,AVAILABLE,@Spark}
  789. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@e52e46a{/stages,null,AVAILABLE,@Spark}
  790. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3456b7e5{/stages/json,null,AVAILABLE,@Spark}
  791. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@314f7301{/stages/stage,null,AVAILABLE,@Spark}
  792. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@c0fad23{/stages/stage/json,null,AVAILABLE,@Spark}
  793. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@15e7797c{/stages/pool,null,AVAILABLE,@Spark}
  794. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@140f0dba{/stages/pool/json,null,AVAILABLE,@Spark}
  795. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@5e92a341{/storage,null,AVAILABLE,@Spark}
  796. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@2f057b05{/storage/json,null,AVAILABLE,@Spark}
  797. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@107db00{/storage/rdd,null,AVAILABLE,@Spark}
  798. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@6d097447{/storage/rdd/json,null,AVAILABLE,@Spark}
  799. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@264a4a0c{/environment,null,AVAILABLE,@Spark}
  800. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@2213c093{/environment/json,null,AVAILABLE,@Spark}
  801. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@1d73d00a{/executors,null,AVAILABLE,@Spark}
  802. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3b7e34af{/executors/json,null,AVAILABLE,@Spark}
  803. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@4f1013e6{/executors/threadDump,null,AVAILABLE,@Spark}
  804. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@733b45cf{/executors/threadDump/json,null,AVAILABLE,@Spark}
  805. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@704b2822{/static,null,AVAILABLE,@Spark}
  806. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@3adab1c8{/,null,AVAILABLE,@Spark}
  807. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@751a1a56{/api,null,AVAILABLE,@Spark}
  808. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@75050599{/jobs/job/kill,null,AVAILABLE,@Spark}
  809. 13:05:31 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@1abeae00{/stages/stage/kill,null,AVAILABLE,@Spark}
  810. 13:05:32 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.h.ContextHandler | Started o.s.j.s.ServletContextHandler@730e5640{/metrics/json,null,AVAILABLE,@Spark}
  811. 13:05:32 WARN: [ScalaTest-main-running-UdmGraphTest] c.s.g.v.r.m.ReaderJob$ | spark.executor.cores is set to 1
  812. 13:05:32 INFO: [ScalaTest-main-running-UdmGraphTest] c.s.g.v.r.m.ReaderJob$ | Starting Job ManReaderJob
  813. 13:05:32 INFO: [ScalaTest-main-running-UdmGraphTest] c.s.g.s.d.s.FileSourceService | Service registered with parameters:
  814. charset=UTF-8
  815. comment="#"
  816. concurrentTasks=1
  817. dateFormat=""
  818. delimiter=","
  819. escape="\\"
  820. fileDefinitions=[
  821. {
  822. sourcePrefix=""
  823. target=vertices
  824. }
  825. ]
  826. fileExtension=""
  827. fileFormat=parquet
  828. header="false"
  829. mode=FAILFAST
  830. name=oldGraphVerticesParquet
  831. "nullValue"=""
  832. parserLib=commons
  833. provider="com.solera.global.spark.dataservice.source.FileSourceService"
  834. quote="\""
  835. removeOnClose=false
  836. rowTag=ROW
  837. sourcePath="graph.parquet/vertices"
  838.  
  839. 13:05:32 INFO: [ScalaTest-main-running-UdmGraphTest] c.s.g.v.r.m.ReaderJob$ | Stopping job ManReaderJob.
  840. Job Summary:
  841. User: Dejan.Ostojic
  842. Job: ManReaderJob
  843. Total time: 165 millis
  844. cached RDD statistics:
  845.  
  846. 13:05:32 INFO: [ScalaTest-main-running-UdmGraphTest] o.s.j.s.AbstractConnector | Stopped Spark@551fe17a{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
  847. *** RUN ABORTED ***
  848. java.lang.ExceptionInInitializerError:
  849. at com.solera.gdc.vehicledataingestion.reader.manreader.ReaderJob$.run(ReaderJob.scala:21)
  850. at com.solera.global.spark.SparkJob$$anonfun$submit$1.apply(SparkJob.scala:52)
  851. at com.solera.global.spark.SparkJob$$anonfun$submit$1.apply(SparkJob.scala:52)
  852. at com.solera.global.spark.util.AutoResource$Arm.map(AutoResource.scala:19)
  853. at com.solera.global.spark.SparkJob$class.submit(SparkJob.scala:52)
  854. at com.solera.gdc.vehicledataingestion.reader.manreader.ReaderJob$.submit(ReaderJob.scala:15)
  855. at com.solera.gdc.vehicledataingestion.reader.manreader.UdmGraphTest$$anonfun$3.apply$mcV$sp(UdmGraphTest.scala:33)
  856. at com.solera.gdc.vehicledataingestion.reader.manreader.UdmGraphTest$$anonfun$3.apply(UdmGraphTest.scala:33)
  857. at com.solera.gdc.vehicledataingestion.reader.manreader.UdmGraphTest$$anonfun$3.apply(UdmGraphTest.scala:33)
  858. at org.scalatest.OutcomeOf$class.outcomeOf(OutcomeOf.scala:85)
  859. ...
  860. Cause: java.lang.IllegalStateException: sourcePath not found: graph.parquet/vertices in service oldGraphVerticesParquet
  861. at com.solera.global.spark.dataservice.source.FileSourceService$.validateParams(FileSourceService.scala:170)
  862. at com.solera.global.spark.dataservice.source.FileSourceService$.getFileSourceServiceParams(FileSourceService.scala:144)
  863. at com.solera.global.spark.dataservice.source.FileSourceService.buildParameters(FileSourceService.scala:81)
  864. at com.solera.global.spark.dataservice.source.FileSourceService.buildParameters(FileSourceService.scala:25)
  865. at com.solera.global.spark.dataservice.spi.DataService$class.getParameters(DataService.scala:25)
  866. at com.solera.global.spark.dataservice.source.FileSourceService.getParameters(FileSourceService.scala:25)
  867. at com.solera.global.spark.dataservice.spi.ServiceFactory$$anonfun$2.apply(ServiceFactory.scala:38)
  868. at com.solera.global.spark.dataservice.spi.ServiceFactory$$anonfun$2.apply(ServiceFactory.scala:30)
  869. at scala.collection.Iterator$class.foreach(Iterator.scala:893)
  870. at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
  871. ...
  872. [INFO] ------------------------------------------------------------------------
  873. [INFO] BUILD FAILURE
  874. [INFO] ------------------------------------------------------------------------
  875. [INFO] Total time: 01:47 min
  876. [INFO] Finished at: 2020-01-24T13:05:32+01:00
  877. [INFO] Final Memory: 41M/493M
  878. [INFO] ------------------------------------------------------------------------
  879. [ERROR] Failed to execute goal org.scalatest:scalatest-maven-plugin:1.0:test (test) on project spark-reader: There are test failures -> [Help 1]
  880. [ERROR]
  881. [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
  882. [ERROR] Re-run Maven using the -X switch to enable full debug logging.
  883. [ERROR]
  884. [ERROR] For more information about the errors and possible solutions, please read the following articles:
  885. [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
  886.  
  887. Process finished with exit code 1
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!