Advertisement
aironman

exception hadoop.home

Apr 8th, 2015
286
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
  1. [DEBUG][FeedAdapter][2015-04-07 15:30:09] Shell:320 - Failed to detect a valid hadoop home directory
  2. java.io.IOException: HADOOP_HOME or hadoop.home.dir are not set.
  3. at org.apache.hadoop.util.Shell.checkHadoopHome(Shell.java:302)
  4. at org.apache.hadoop.util.Shell.<clinit>(Shell.java:327)
  5. at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:79)
  6. at org.apache.hadoop.security.Groups.parseStaticMapping(Groups.java:104)
  7. at org.apache.hadoop.security.Groups.<init>(Groups.java:86)
  8. at org.apache.hadoop.security.Groups.<init>(Groups.java:66)
  9. at org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:280)
  10. at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:257)
  11. at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:234)
  12. at org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:749)
  13. at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:734)
  14. at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:607)
  15. at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2753)
  16. at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2745)
  17. at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2611)
  18. at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
  19. at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169)
  20. at com.tekcomms.c2d.utils.MyHadoopUtils.<clinit>(MyHadoopUtils.java:28)
  21. at com.tekcomms.c2d.utils.MyWatchService.saveInputDataIntoHDFS(MyWatchService.java:697)
  22. at com.tekcomms.c2d.utils.MyWatchService.processDataCastFile(MyWatchService.java:434)
  23. at com.tekcomms.c2d.utils.MyWatchService.preScan(MyWatchService.java:160)
  24. at com.tekcomms.c2d.main.FeedAdaptor.main(FeedAdaptor.java:42)
  25. [DEBUG][FeedAdapter][2015-04-08 09:31:20] Shell:396 - setsid exited with exit code 0
  26. [DEBUG][FeedAdapter][2015-04-08 09:31:20] Groups:91 - Group mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback; cacheTimeout=300000; warningDeltaMs=5000
  27. [DEBUG][FeedAdapter][2015-04-08 09:31:20] UserGroupInformation:195 - hadoop login
  28. [DEBUG][FeedAdapter][2015-04-08 09:31:20] UserGroupInformation:144 - hadoop login commit
  29. [DEBUG][FeedAdapter][2015-04-08 09:31:20] UserGroupInformation:174 - using local user:UnixPrincipal: core
  30. [DEBUG][FeedAdapter][2015-04-08 09:31:20] UserGroupInformation:785 - UGI loginUser:core (auth:SIMPLE)
  31. [DEBUG][FeedAdapter][2015-04-08 09:31:20] BlockReaderLocal:412 - dfs.client.use.legacy.blockreader.local = false
  32. [DEBUG][FeedAdapter][2015-04-08 09:31:20] BlockReaderLocal:415 - dfs.client.read.shortcircuit = false
  33. [DEBUG][FeedAdapter][2015-04-08 09:31:20] BlockReaderLocal:418 - dfs.client.domain.socket.data.traffic = false
  34. [DEBUG][FeedAdapter][2015-04-08 09:31:20] BlockReaderLocal:421 - dfs.domain.socket.path =
  35. [DEBUG][FeedAdapter][2015-04-08 09:31:20] DFSClient:603 - No KeyProvider found.
  36. [DEBUG][FeedAdapter][2015-04-08 09:31:20] RetryUtils:74 - multipleLinearRandomRetry = null
  37. [DEBUG][FeedAdapter][2015-04-08 09:31:20] Server:228 - rpcKind=RPC_PROTOCOL_BUFFER, rpcRequestWrapperClass=class org.apache.hadoop.ipc.ProtobufRpcEngine$RpcRequestWrapper, rpcInvoker=org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker@409319ef
  38. [DEBUG][FeedAdapter][2015-04-08 09:31:20] Client:63 - getting client out of cache: org.apache.hadoop.ipc.Client@79319b74
  39. [DEBUG][FeedAdapter][2015-04-08 09:31:21] PerformanceAdvisory:109 - Both short-circuit local reads and UNIX domain socket are disabled.
  40. [DEBUG][FeedAdapter][2015-04-08 09:31:21] DataTransferSaslUtil:158 - DataTransferProtocol not using SaslPropertiesResolver, no QOP found in configuration for dfs.data.transfer.protection
  41. [INFO][FeedAdapter][2015-04-08 09:31:21] MyHadoopUtils:29 - HDFS instantiated! name: hdfs://dub-vcd-vms170.global.tektronix.net:8020
  42. [INFO][FeedAdapter][2015-04-08 09:31:21] MyHadoopUtils:43 - HDFS fs instantiated? true
  43. [DEBUG][FeedAdapter][2015-04-08 09:31:21] DFSClient:1616 - /hfc/sip/service/input/2015/4/8/10/0/SIP_Pub-generated_1428483600: masked=rw-r--r--
  44. [DEBUG][FeedAdapter][2015-04-08 09:31:21] Client:426 - The ping interval is 60000 ms.
  45. [DEBUG][FeedAdapter][2015-04-08 09:31:21] Client:695 - Connecting to dub-vcd-vms170.global.tektronix.net/192.158.76.219:8020
  46. ...
Advertisement
Advertisement
Advertisement
RAW Paste Data Copied
Advertisement