Advertisement
lorenzo_gatto

Spark query standard toDebugString

Jun 15th, 2015
615
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 2.05 KB | None | 0 0
  1. (1) SchemaRDD[173] at RDD at SchemaRDD.scala:108
  2. == Query Plan ==
  3. == Physical Plan ==
  4. InsertIntoHiveTable (MetastoreRelation tpch_100gb, q3_shipping_priority, None), Map(), true
  5. Project [l_orderkey#496,revenue#474,CAST(o_orderdate#491, StringType) AS o_orderdate#512,o_shippriority#494]
  6. TakeOrdered 10, [revenue#474 DESC,o_orderdate#491 ASC]
  7. Aggregate false, [l_orderkey#496,o_orderdate#491,o_shippriority#494], [l_orderkey#496,SUM(PartialSum#514) AS revenue#474,o_orderdate#491,o_shippriority#494]
  8. Exchange (HashPartitioning [l_orderkey#496,o_orderdate#491,o_shippriority#494], 200)
  9. Aggregate true, [l_orderkey#496,o_orderdate#491,o_shippriority#494], [l_orderkey#496,o_orderdate#491,o_shippriority#494,SUM((l_extendedprice#501 * (1.0 - l_discount#502))) AS PartialSum#514]
  10. Project [l_orderkey#496,o_orderdate#491,o_shippriority#494,l_extendedprice#501,l_discount#502]
  11. ShuffledHashJoin [o_orderkey#487], [l_orderkey#496], BuildRight
  12. Exchange (HashPartitioning [o_orderkey#487], 200)
  13. Project [o_shippriority#494,o_orderkey#487,o_orderdate#491]
  14. ShuffledHashJoin [c_custkey#479], [o_custkey#488], BuildLeft
  15. Exchange (HashPartitioning [c_custkey#479], 200)
  16. Project [c_custkey#479]
  17. Filter (c_mktsegment#485 = BUILDING)
  18. HiveTableScan [c_custkey#479,c_mktsegment#485], (MetastoreRelation tpch_100gb, customer, None), None
  19. Exchange (HashPartitioning [o_custkey#488], 200)
  20. Filter (o_orderdate#491 < 1995-03-15)
  21. HiveTableScan [o_shippriority#494,o_orderkey#487,o_orderdate#491,o_custkey#488], (MetastoreRelation tpch_100gb, orders, None), None
  22. Exchange (HashPartitioning [l_orderkey#496], 200)
  23. Project [l_orderkey#496,l_extendedprice#501,l_discount#502]
  24. Filter (l_shipdate#506 > 1995-03-15)
  25. HiveTableScan [l_orderkey#496,l_extendedprice#501,l_discount#502,l_shipdate#506], (MetastoreRelation tpch_100gb, lineitem, None), None []
  26. | ParallelCollectionRDD[213] at parallelize at commands.scala:46 []
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement