Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- p 2019-06-05 18:53:20 ustctdtus-xx-bbthti-0b1tvlt20190605.1833tvtt20190605.1833tvst20190508
- p 2019-06-05 18:53:20 ustctdtus-xx-bbthti-03atvlt20190605.1833tvtt20190605.1833
- p 2019-06-05 18:53:20 ustctdtus-xx-bbthti-030
- log_type time_stamp us d h vl vt vs
- p 2019-06-05 18:53:20 c us-xx-bb 0b1 20190605.1833 20190605.1833 20190508
- p 2019-06-05 18:53:20 c us-xx-bb 03a 20190605.1833 20190605.1833
- p 2019-06-05 18:53:20 c us-xx-bb 030
- val logSchema = new StructType().add("log_type",StringType).add("time_stamp",StringType).add("kvs",StringType)
- val logDF = spark.read.option("delimiter", "t").format("com.databricks.spark.csv").schema(logSchema).load("/tmp/log.tsv")
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement