API tools faq
paste
Guest User

MapReduce Log

a guest
Jan 21st, 2015
222
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 5.19 KB | None | 0 0
raw download clone embed print report
  1. 2015-01-21 17:39:57,228 WARN [main]: common.LogUtils (LogUtils.java:logConfigLocation(145)) - hive-site.xml not found on CLASSPATH
  2. 2015-01-21 17:39:57,234 INFO [main]: mr.ExecDriver (SessionState.java:printInfo(824)) - Execution log at: /tmp/hduser/hduser_20150121173939_3c81cfdd-85d0-4cb4-a894-83a102602ebf.log
  3. 2015-01-21 17:39:57,449 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - <PERFLOG method=deserializePlan from=org.apache.hadoop.hive.ql.exec.Utilities>
  4. 2015-01-21 17:39:57,449 INFO [main]: exec.Utilities (Utilities.java:deserializePlan(926)) - Deserializing MapredLocalWork via kryo
  5. 2015-01-21 17:39:57,878 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - </PERFLOG method=deserializePlan start=1421858397449 end=1421858397878 duration=429 from=org.apache.hadoop.hive.ql.exec.Utilities>
  6. 2015-01-21 17:39:58,044 INFO [main]: mr.MapredLocalTask (SessionState.java:printInfo(824)) - 2015-01-21 05:39:58 Starting to launch local task to process map join; maximum memory = 477364224
  7. 2015-01-21 17:39:58,084 INFO [main]: mr.MapredLocalTask (MapredLocalTask.java:initializeOperators(436)) - fetchoperator for counties created
  8. 2015-01-21 17:39:58,467 INFO [main]: exec.TableScanOperator (Operator.java:initialize(346)) - Initializing Self TS[0]
  9. 2015-01-21 17:39:58,467 INFO [main]: exec.TableScanOperator (Operator.java:initializeChildren(419)) - Operator 0 TS initialized
  10. 2015-01-21 17:39:58,467 INFO [main]: exec.TableScanOperator (Operator.java:initializeChildren(423)) - Initializing children of 0 TS
  11. 2015-01-21 17:39:58,468 INFO [main]: exec.FilterOperator (Operator.java:initialize(458)) - Initializing child 1 FIL
  12. 2015-01-21 17:39:58,468 INFO [main]: exec.FilterOperator (Operator.java:initialize(346)) - Initializing Self FIL[1]
  13. 2015-01-21 17:39:58,997 INFO [main]: exec.FilterOperator (Operator.java:initializeChildren(419)) - Operator 1 FIL initialized
  14. 2015-01-21 17:39:58,997 INFO [main]: exec.FilterOperator (Operator.java:initializeChildren(423)) - Initializing children of 1 FIL
  15. 2015-01-21 17:39:58,997 INFO [main]: exec.HashTableSinkOperator (Operator.java:initialize(458)) - Initializing child 2 HASHTABLESINK
  16. 2015-01-21 17:39:58,998 INFO [main]: exec.HashTableSinkOperator (Operator.java:initialize(346)) - Initializing Self HASHTABLESINK[2]
  17. 2015-01-21 17:39:59,000 INFO [main]: mapjoin.MapJoinMemoryExhaustionHandler (MapJoinMemoryExhaustionHandler.java:<init>(72)) - JVM Max Heap Size: 477364224
  18. 2015-01-21 17:39:59,041 INFO [main]: persistence.HashMapWrapper (HashMapWrapper.java:calculateTableSize(102)) - Key count from statistics is -1; setting map size to 100000
  19. 2015-01-21 17:39:59,041 INFO [main]: exec.HashTableSinkOperator (Operator.java:initialize(394)) - Initialization Done 2 HASHTABLESINK
  20. 2015-01-21 17:39:59,041 INFO [main]: exec.FilterOperator (Operator.java:initialize(394)) - Initialization Done 1 FIL
  21. 2015-01-21 17:39:59,042 INFO [main]: exec.TableScanOperator (Operator.java:initialize(394)) - Initialization Done 0 TS
  22. 2015-01-21 17:39:59,042 INFO [main]: mr.MapredLocalTask (MapredLocalTask.java:initializeOperators(456)) - fetchoperator for counties initialized
  23. 2015-01-21 17:40:01,666 INFO [main]: Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1049)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
  24. 2015-01-21 17:40:01,798 INFO [main]: mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
  25. 2015-01-21 17:40:03,049 INFO [main]: exec.TableScanOperator (Operator.java:close(595)) - 0 finished. closing...
  26. 2015-01-21 17:40:03,049 INFO [main]: exec.FilterOperator (Operator.java:close(595)) - 1 finished. closing...
  27. 2015-01-21 17:40:03,049 INFO [main]: exec.HashTableSinkOperator (Operator.java:close(595)) - 2 finished. closing...
  28. 2015-01-21 17:40:03,050 INFO [main]: exec.HashTableSinkOperator (HashTableSinkOperator.java:flushToFile(285)) - Temp URI for side table: file:/tmp/hduser/ee15a3d9-83f9-4ca5-9f36-2339bd6e45ed/hive_2015-01-21_17-39-48_284_1393765451255998906-1/-local-10004/HashTable-Stage-2
  29. 2015-01-21 17:40:03,050 INFO [main]: exec.HashTableSinkOperator (SessionState.java:printInfo(824)) - 2015-01-21 05:40:03 Dump the side-table for tag: 1 with group count: 1 into file: file:/tmp/hduser/ee15a3d9-83f9-4ca5-9f36-2339bd6e45ed/hive_2015-01-21_17-39-48_284_1393765451255998906-1/-local-10004/HashTable-Stage-2/MapJoin-mapfile01--.hashtable
  30. 2015-01-21 17:40:03,184 INFO [main]: exec.HashTableSinkOperator (SessionState.java:printInfo(824)) - 2015-01-21 05:40:03 Uploaded 1 File to: file:/tmp/hduser/ee15a3d9-83f9-4ca5-9f36-2339bd6e45ed/hive_2015-01-21_17-39-48_284_1393765451255998906-1/-local-10004/HashTable-Stage-2/MapJoin-mapfile01--.hashtable (10381 bytes)
  31. 2015-01-21 17:40:03,185 INFO [main]: exec.HashTableSinkOperator (Operator.java:close(613)) - 2 Close done
  32. 2015-01-21 17:40:03,185 INFO [main]: exec.FilterOperator (Operator.java:close(613)) - 1 Close done
  33. 2015-01-21 17:40:03,185 INFO [main]: exec.TableScanOperator (Operator.java:close(613)) - 0 Close done
  34. 2015-01-21 17:40:03,185 INFO [main]: mr.MapredLocalTask (SessionState.java:printInfo(824)) - 2015-01-21 05:40:03 End of local task; Time Taken: 5.165 sec.
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!