daily pastebin goal
1%
SHARE
TWEET

Untitled

a guest Nov 23rd, 2017 40 Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
  1. ['https://irs-form-990.s3.amazonaws.com/201611339349202661_public.xml',
  2.  'https://irs-form-990.s3.amazonaws.com/201611309349201761_public.xml',
  3.  'https://irs-form-990.s3.amazonaws.com/201543179349200944_public.xml',
  4.  'https://irs-form-990.s3.amazonaws.com/201631099349200733_public.xml',
  5.  'https://irs-form-990.s3.amazonaws.com/201610909349200511_public.xml',
  6.  'https://irs-form-990.s3.amazonaws.com/201630749349201058_public.xml',
  7.  'https://irs-form-990.s3.amazonaws.com/201601319349200235_public.xml',
  8.  'https://irs-form-990.s3.amazonaws.com/201641069349200909_public.xml',]
  9.    
  10. df = sql.read.format("xml").options(rowTag="xyze").load(s).coalesce(10)
  11.    
  12. sc.addFile(s)
  13. df4 = sql.read.format("xml").options(rowTag="xyze").load(pyspark.SparkFiles.get("*_public.xml"))
RAW Paste Data
Top