API tools faq
paste
Advertisement
Guest User

Jupyter Error!

a guest
Mar 14th, 2016
104
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 11.97 KB | None | 0 0
raw download clone embed print report
  1. [I 10:26:32.299 NotebookApp] Serving notebooks from local directory: /home/casimiro/rtb/ds/rtb/bidder-analysis
  2. [I 10:26:32.299 NotebookApp] 0 active kernels
  3. [I 10:26:32.299 NotebookApp] The Jupyter Notebook is running at: http://localhost:8888/
  4. [I 10:26:32.299 NotebookApp] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation).
  5. [29031:29072:0314/102632:ERROR:nss_util.cc(839)] After loading Root Certs, loaded==false: NSS error code: -8018
  6. Created new window in existing browser session.
  7. [I 10:26:39.527 NotebookApp] Kernel started: 5294bd3e-0bba-432c-9e50-d1b131414e9a
  8. 16/03/14 10:26:40 DEBUG PythonGatewayServer: Started PythonGatewayServer on port 58868
  9. 16/03/14 10:26:40 DEBUG PythonGatewayServer: Communicating GatewayServer port to Python driver at 127.0.0.1:36356
  10. 16/03/14 10:26:40 INFO SparkContext: Running Spark version 1.6.1
  11. 16/03/14 10:26:40 DEBUG MutableMetricsFactory: field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess with annotation @org.apache.hadoop.metrics2.annotation.Metric(sampleName=Ops, about=, always=false, type=DEFAULT, valueName=Time, value=[Rate of successful kerberos logins and latency (milliseconds)])
  12. 16/03/14 10:26:40 DEBUG MutableMetricsFactory: field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure with annotation @org.apache.hadoop.metrics2.annotation.Metric(sampleName=Ops, about=, always=false, type=DEFAULT, valueName=Time, value=[Rate of failed kerberos logins and latency (milliseconds)])
  13. 16/03/14 10:26:40 DEBUG MutableMetricsFactory: field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.getGroups with annotation @org.apache.hadoop.metrics2.annotation.Metric(sampleName=Ops, about=, always=false, type=DEFAULT, valueName=Time, value=[GetGroups])
  14. 16/03/14 10:26:40 DEBUG MetricsSystemImpl: UgiMetrics, User and group related metrics
  15. 16/03/14 10:26:41 DEBUG KerberosName: Kerberos krb5 configuration not found, setting default realm to empty
  16. 16/03/14 10:26:41 DEBUG Groups: Creating new Groups object
  17. 16/03/14 10:26:41 DEBUG NativeCodeLoader: Trying to load the custom-built native-hadoop library...
  18. 16/03/14 10:26:41 DEBUG NativeCodeLoader: Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: no hadoop in java.library.path
  19. 16/03/14 10:26:41 DEBUG NativeCodeLoader: java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
  20. 16/03/14 10:26:41 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  21. 16/03/14 10:26:41 DEBUG PerformanceAdvisory: Falling back to shell based
  22. 16/03/14 10:26:41 DEBUG JniBasedUnixGroupsMappingWithFallback: Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping
  23. 16/03/14 10:26:41 DEBUG Shell: Failed to detect a valid hadoop home directory
  24. java.io.IOException: Hadoop home directory dummy does not exist, is not a directory, or is not an absolute path.
  25. at org.apache.hadoop.util.Shell.checkHadoopHome(Shell.java:312)
  26. at org.apache.hadoop.util.Shell.<clinit>(Shell.java:327)
  27. at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:79)
  28. at org.apache.hadoop.security.Groups.parseStaticMapping(Groups.java:104)
  29. at org.apache.hadoop.security.Groups.<init>(Groups.java:86)
  30. at org.apache.hadoop.security.Groups.<init>(Groups.java:66)
  31. at org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:280)
  32. at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:271)
  33. at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:248)
  34. at org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:763)
  35. at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:748)
  36. at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:621)
  37. at org.apache.spark.util.Utils$$anonfun$getCurrentUserName$1.apply(Utils.scala:2160)
  38. at org.apache.spark.util.Utils$$anonfun$getCurrentUserName$1.apply(Utils.scala:2160)
  39. at scala.Option.getOrElse(Option.scala:120)
  40. at org.apache.spark.util.Utils$.getCurrentUserName(Utils.scala:2160)
  41. at org.apache.spark.SparkContext.<init>(SparkContext.scala:322)
  42. at org.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkContext.scala:59)
  43. at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
  44. at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
  45. at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
  46. at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
  47. at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:234)
  48. at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:381)
  49. at py4j.Gateway.invoke(Gateway.java:214)
  50. at py4j.commands.ConstructorCommand.invokeConstructor(ConstructorCommand.java:79)
  51. at py4j.commands.ConstructorCommand.execute(ConstructorCommand.java:68)
  52. at py4j.GatewayConnection.run(GatewayConnection.java:209)
  53. at java.lang.Thread.run(Thread.java:745)
  54. 16/03/14 10:26:41 DEBUG Shell: setsid exited with exit code 0
  55. 16/03/14 10:26:41 DEBUG Groups: Group mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback; cacheTimeout=300000; warningDeltaMs=5000
  56. 16/03/14 10:26:41 DEBUG UserGroupInformation: hadoop login
  57. 16/03/14 10:26:41 DEBUG UserGroupInformation: hadoop login commit
  58. 16/03/14 10:26:41 DEBUG UserGroupInformation: using local user:UnixPrincipal: casimiro
  59. 16/03/14 10:26:41 DEBUG UserGroupInformation: Using user: "UnixPrincipal: casimiro" with name casimiro
  60. 16/03/14 10:26:41 DEBUG UserGroupInformation: User entry: "casimiro"
  61. 16/03/14 10:26:41 DEBUG UserGroupInformation: UGI loginUser:casimiro (auth:SIMPLE)
  62. 16/03/14 10:26:41 WARN Utils: Your hostname, kletos resolves to a loopback address: 127.0.1.1; using 172.22.32.226 instead (on interface eth0)
  63. 16/03/14 10:26:41 WARN Utils: Set SPARK_LOCAL_IP if you need to bind to another address
  64. 16/03/14 10:26:41 INFO SecurityManager: Changing view acls to: casimiro
  65. 16/03/14 10:26:41 INFO SecurityManager: Changing modify acls to: casimiro
  66. 16/03/14 10:26:41 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(casimiro); users with modify permissions: Set(casimiro)
  67. 16/03/14 10:26:41 DEBUG SSLOptions: No SSL protocol specified
  68. 16/03/14 10:26:41 DEBUG SSLOptions: No SSL protocol specified
  69. 16/03/14 10:26:41 DEBUG SSLOptions: No SSL protocol specified
  70. 16/03/14 10:26:41 DEBUG SecurityManager: SSLConfiguration for file server: SSLOptions{enabled=false, keyStore=None, keyStorePassword=None, trustStore=None, trustStorePassword=None, protocol=None, enabledAlgorithms=Set()}
  71. 16/03/14 10:26:41 DEBUG SecurityManager: SSLConfiguration for Akka: SSLOptions{enabled=false, keyStore=None, keyStorePassword=None, trustStore=None, trustStorePassword=None, protocol=None, enabledAlgorithms=Set()}
  72. [I 10:26:41.341 NotebookApp] Saving file at /simulation/bidder-simulation.ipynb
  73. 16/03/14 10:26:41 DEBUG InternalLoggerFactory: Using SLF4J as the default logging framework
  74. 16/03/14 10:26:41 DEBUG PlatformDependent0: java.nio.Buffer.address: available
  75. 16/03/14 10:26:41 DEBUG PlatformDependent0: sun.misc.Unsafe.theUnsafe: available
  76. 16/03/14 10:26:41 DEBUG PlatformDependent0: sun.misc.Unsafe.copyMemory: available
  77. 16/03/14 10:26:41 DEBUG PlatformDependent0: java.nio.Bits.unaligned: true
  78. 16/03/14 10:26:41 DEBUG PlatformDependent: Java version: 8
  79. 16/03/14 10:26:41 DEBUG PlatformDependent: -Dio.netty.noUnsafe: false
  80. 16/03/14 10:26:41 DEBUG PlatformDependent: sun.misc.Unsafe: available
  81. 16/03/14 10:26:41 DEBUG PlatformDependent: -Dio.netty.noJavassist: false
  82. 16/03/14 10:26:41 DEBUG PlatformDependent: Javassist: unavailable
  83. 16/03/14 10:26:41 DEBUG PlatformDependent: You don't have Javassist in your class path or you don't have enough permission to load dynamically generated classes. Please check the configuration for better performance.
  84. 16/03/14 10:26:41 DEBUG PlatformDependent: -Dio.netty.tmpdir: /tmp (java.io.tmpdir)
  85. 16/03/14 10:26:41 DEBUG PlatformDependent: -Dio.netty.bitMode: 64 (sun.arch.data.model)
  86. 16/03/14 10:26:41 DEBUG PlatformDependent: -Dio.netty.noPreferDirect: false
  87. 16/03/14 10:26:41 DEBUG MultithreadEventLoopGroup: -Dio.netty.eventLoopThreads: 8
  88. 16/03/14 10:26:41 DEBUG NioEventLoop: -Dio.netty.noKeySetOptimization: false
  89. 16/03/14 10:26:41 DEBUG NioEventLoop: -Dio.netty.selectorAutoRebuildThreshold: 512
  90. 16/03/14 10:26:41 TRACE NioEventLoop: Instrumented an optimized java.util.Set into: sun.nio.ch.EPollSelectorImpl@4cd6059e
  91. 16/03/14 10:26:41 TRACE NioEventLoop: Instrumented an optimized java.util.Set into: sun.nio.ch.EPollSelectorImpl@31f14ff7
  92. 16/03/14 10:26:41 TRACE NioEventLoop: Instrumented an optimized java.util.Set into: sun.nio.ch.EPollSelectorImpl@1c949bef
  93. 16/03/14 10:26:41 TRACE NioEventLoop: Instrumented an optimized java.util.Set into: sun.nio.ch.EPollSelectorImpl@498c6256
  94. 16/03/14 10:26:41 DEBUG PooledByteBufAllocator: -Dio.netty.allocator.numHeapArenas: 8
  95. 16/03/14 10:26:41 DEBUG PooledByteBufAllocator: -Dio.netty.allocator.numDirectArenas: 8
  96. 16/03/14 10:26:41 DEBUG PooledByteBufAllocator: -Dio.netty.allocator.pageSize: 8192
  97. 16/03/14 10:26:41 DEBUG PooledByteBufAllocator: -Dio.netty.allocator.maxOrder: 11
  98. 16/03/14 10:26:41 DEBUG PooledByteBufAllocator: -Dio.netty.allocator.chunkSize: 16777216
  99. 16/03/14 10:26:41 DEBUG PooledByteBufAllocator: -Dio.netty.allocator.tinyCacheSize: 512
  100. 16/03/14 10:26:41 DEBUG PooledByteBufAllocator: -Dio.netty.allocator.smallCacheSize: 256
  101. 16/03/14 10:26:41 DEBUG PooledByteBufAllocator: -Dio.netty.allocator.normalCacheSize: 64
  102. 16/03/14 10:26:41 DEBUG PooledByteBufAllocator: -Dio.netty.allocator.maxCachedBufferCapacity: 32768
  103. 16/03/14 10:26:41 DEBUG PooledByteBufAllocator: -Dio.netty.allocator.cacheTrimInterval: 8192
  104. 16/03/14 10:26:41 TRACE NioEventLoop: Instrumented an optimized java.util.Set into: sun.nio.ch.EPollSelectorImpl@3fc67e0e
  105. 16/03/14 10:26:41 TRACE NioEventLoop: Instrumented an optimized java.util.Set into: sun.nio.ch.EPollSelectorImpl@25f53ab6
  106. 16/03/14 10:26:41 TRACE NioEventLoop: Instrumented an optimized java.util.Set into: sun.nio.ch.EPollSelectorImpl@1dd27cc1
  107. 16/03/14 10:26:41 TRACE NioEventLoop: Instrumented an optimized java.util.Set into: sun.nio.ch.EPollSelectorImpl@346fbd77
  108. 16/03/14 10:26:41 DEBUG ThreadLocalRandom: -Dio.netty.initialSeedUniquifier: 0x94fdc1e5e31394df (took 0 ms)
  109. 16/03/14 10:26:41 DEBUG ByteBufUtil: -Dio.netty.allocator.type: unpooled
  110. 16/03/14 10:26:41 DEBUG ByteBufUtil: -Dio.netty.threadLocalDirectBufferSize: 65536
  111. 16/03/14 10:26:41 DEBUG NetUtil: Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo)
  112. 16/03/14 10:26:41 DEBUG NetUtil: /proc/sys/net/core/somaxconn: 128
  113. 16/03/14 10:26:41 DEBUG TransportServer: Shuffle server started on port :49464
  114. 16/03/14 10:26:41 INFO Utils: Successfully started service 'sparkDriver' on port 49464.
  115. 16/03/14 10:26:41 DEBUG AkkaUtils: In createActorSystem, requireCookie is: off
  116. 16/03/14 10:26:41 INFO Slf4jLogger: Slf4jLogger started
  117. 16/03/14 10:26:41 INFO Remoting: Starting remoting
  118. 16/03/14 10:26:41 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkDriverActorSystem@172.22.32.226:46782]
  119. 16/03/14 10:26:41 INFO Utils: Successfully started service 'sparkDriverActorSystem' on port 46782.
  120. 16/03/14 10:26:41 DEBUG SparkEnv: Using serializer: class org.apache.spark.serializer.JavaSerializer
  121. 16/03/14 10:26:41 INFO SparkEnv: Registering MapOutputTracker
  122. 16/03/14 10:26:41 INFO SparkEnv: Registering BlockManagerMaster
  123. 16/03/14 10:26:41 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-4b52b814-aba6-4ee1-8c62-dc0bc47c6c31
  124. 16/03/14 10:26:41 INFO MemoryStore: MemoryStore started with capacity 511.1 MB
  125. 16/03/14 10:26:41 INFO SparkEnv: Registering OutputCommitCoordinator
  126. [W 10:26:49.577 NotebookApp] Timeout waiting for kernel_info reply from 5294bd3e-0bba-432c-9e50-d1b131414e9a
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!