Advertisement
Guest User

Untitled

a guest
Jan 19th, 2017
162
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.55 KB | None | 0 0
  1. DataFrame dataframe =
  2. hiveContext.createDataFrame(rowData, schema);
  3. dataframe.write().format("orc").options(new HashMap(){
  4. {
  5.  
  6. put("orc.compress","SNAPPY");
  7. put("hive.exec.orc.default.compress","SNAPPY");
  8.  
  9. put("orc.compress.size","524288");
  10. put("hive.exec.orc.default.buffer.size","524288");
  11.  
  12.  
  13. put("hive.exec.orc.compression.strategy", "COMPRESSION");
  14.  
  15. }
  16. }).save("spark_orc_output");
  17.  
  18. Compression: ZLIB
  19. Compression size: 262144
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement