Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- 2014-11-07 18:03:31,556 WARN org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
- 2014-11-07 18:03:32,592 INFO com.sirsidynix.Transform -
- spark.akka.frameSize=500
- spark.akka.threads=6
- spark.app.name=e4bd26a1-com.sirsidynix.Transform
- spark.cores.max=1
- spark.default.parallelism=32
- spark.driver.host=1.1.1.1
- spark.driver.port=43317
- spark.executor.memory=1G
- spark.executor.uri=
- spark.fileserver.uri=http://1.1.1.1:58083
- spark.httpBroadcast.uri=http://1.1.1.1:58889
- spark.master=spark://1.1.1.1:7077
- spark.tachyonStore.folderName=spark-c74890ee-9a0b-4d67-b27c-92e1bded27ba
- spark.ui.port=0
- 2014-11-07 18:03:32,623 INFO com.sirsidynix.Transform - I am doing symphony work!
- 2014-11-07 18:03:47,594 INFO com.sirsidynix.sym.transformers.SymCheckout -
- Running SymCheckout...
- 2014-11-07 18:03:57,063 INFO com.sirsidynix.util.ImpLoader$ - Drop and recreate Impala table: checkout with newly transformed data in hdfs://1.1.1.1:8020/jarvis/parquet/67fc0cb1-f220-482a-8e91-c6d669aae84d/checkout Impala IP = 1.1.1.1 dbName = abcdefg
- 2014-11-07 18:03:57,406 INFO com.sirsidynix.util.ImpLoader$ - [?1034h
- 2014-11-07 18:03:57,768 INFO com.sirsidynix.util.ImpLoader$ - [?1034h
- 2014-11-07 18:03:58,125 INFO com.sirsidynix.util.ImpLoader$ - [?1034h
- 2014-11-07 18:03:58,662 INFO com.sirsidynix.util.ImpLoader$ - [?1034h
- 2014-11-07 18:03:58,960 INFO com.sirsidynix.util.ImpLoader$ - [?1034h
- 2014-11-07 18:04:00,084 INFO com.sirsidynix.util.ImpLoader$ -
- [?1034h+------------------------------------------+
- | summary |
- +------------------------------------------+
- | Updated 1 partition(s) and 17 column(s). |
- +------------------------------------------+
- 2014-11-07 18:04:00,385 INFO com.sirsidynix.util.ImpLoader$ - [?1034hNo option called num_scanner_threads is set
- 2014-11-07 18:04:00,387 INFO com.sirsidynix.sym.transformers.SymUser -
- Running SymUser...
- 2014-11-07 18:08:01,759 INFO com.sirsidynix.util.ImpLoader$ - Drop and recreate Impala table: user with newly transformed data in hdfs://1.1.1.1:8020/jarvis/parquet/67fc0cb1-f220-482a-8e91-c6d669aae84d/user Impala IP = 1.1.1.1 dbName = abcdefg
- 2014-11-07 18:08:02,245 INFO com.sirsidynix.util.ImpLoader$ - [?1034h
- 2014-11-07 18:08:02,557 INFO com.sirsidynix.util.ImpLoader$ - [?1034h
- 2014-11-07 18:08:02,950 INFO com.sirsidynix.util.ImpLoader$ - [?1034h
- 2014-11-07 18:08:03,651 INFO com.sirsidynix.util.ImpLoader$ - [?1034h
- 2014-11-07 18:08:03,941 INFO com.sirsidynix.util.ImpLoader$ - [?1034h
- 2014-11-07 18:08:08,323 INFO com.sirsidynix.util.ImpLoader$ -
- [?1034h+------------------------------------------+
- | summary |
- +------------------------------------------+
- | Updated 1 partition(s) and 26 column(s). |
- +------------------------------------------+
- 2014-11-07 18:08:08,616 INFO com.sirsidynix.util.ImpLoader$ - [?1034hNo option called num_scanner_threads is set
- 2014-11-07 18:08:08,618 INFO com.sirsidynix.sym.transformers.SymUserAddress -
- Running SymUserAddress...
- 2014-11-07 18:09:37,452 INFO com.sirsidynix.util.ImpLoader$ - Drop and recreate Impala table: user_address with newly transformed data in hdfs://1.1.1.1:8020/jarvis/parquet/67fc0cb1-f220-482a-8e91-c6d669aae84d/user_address Impala IP = 1.1.1.1 dbName = abcdefg
- 2014-11-07 18:09:37,764 INFO com.sirsidynix.util.ImpLoader$ - [?1034h
- 2014-11-07 18:09:38,075 INFO com.sirsidynix.util.ImpLoader$ - [?1034h
- 2014-11-07 18:09:38,441 INFO com.sirsidynix.util.ImpLoader$ - [?1034h
- 2014-11-07 18:09:38,997 INFO com.sirsidynix.util.ImpLoader$ - [?1034h
- 2014-11-07 18:09:39,283 INFO com.sirsidynix.util.ImpLoader$ - [?1034h
- 2014-11-07 18:09:41,513 INFO com.sirsidynix.util.ImpLoader$ -
- [?1034h+------------------------------------------+
- | summary |
- +------------------------------------------+
- | Updated 1 partition(s) and 18 column(s). |
- +------------------------------------------+
- 2014-11-07 18:09:41,798 INFO com.sirsidynix.util.ImpLoader$ - [?1034hNo option called num_scanner_threads is set
- 2014-11-07 18:09:41,808 WARN spark.jobserver.RddManagerActor - Shutting down spark.jobserver.RddManagerActor
- 2014-11-07 18:09:41,808 WARN spark.jobserver.JobStatusActor - Shutting down spark.jobserver.JobStatusActor
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement