Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- sqoop import -D --compress --compression-codec lzop --mapreduce-job-name interaction_sqoop_cartoes --connection-manager org.apache.sqoop.manager.OracleManager --connect "jdbc:Oracle:thin:@(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=VCBXP0+
- 024CTO)(PORT=1531)))(CONNECT_DATA=(SERVICE_NAME=OLPRC146)))" --username yyyyyyyy --password yyyyyxy$
- --table GACCUCSM.interaction --columns ID,ENTITYTYPEID,MEDIATYPEID,SUBTYPEID,OWNERID,CONTACTID,PARENTID,STARTDATE,ENDDATE,THREADID,SUBJECT,TEXT,STRUCTUREDTEXT,STRUCTTEXTMIMETYPE,THECOMMENT,TENANTID,CANBEPARENT,QUEUENAME,STRATTRIBUTE1,STRATTRIBUTE2,ST+
- RATTRIBUTE3,STRATTRIBUTE6,STRATTRIBUTE7,STRATTRIBUTE9,STRATTRIBUTE10,STOPPEDREASON --where "mediatypeid in('sms', 'chat', 'email') AND TO_CHAR(ENDDATE,'YYYYMMDD') = '20180414'"
- --null-string '' --null-non-string '' --fields-terminated-by '|' --map-column-java TEXT=String,STRUCTUREDTEXT=String,THECOMMENT=String
- --lines-terminated-by 'n' --warehouse-dir /dados/prod/rt2_wrk/RT2_AI6_L1_INTERACTION_CARTOES_001 --delete-target-dir
- --hive-import --hive-drop-import-delims --hive-partition-key "anomesdia" --hive-partition-value 20180414 --hive-overwrite --verbose -m 1 --hive-table RT2.RT2_AI6_L1_INTERACTION_CARTOES_001
- 18/04/15 03:12:50 INFO mapreduce.Job: Counters: 30
- File System Counters
- FILE: Number of bytes read=0
- FILE: Number of bytes written=156107
- FILE: Number of read operations=0
- FILE: Number of large read operations=0
- FILE: Number of write operations=0
- HDFS: Number of bytes read=87
- HDFS: Number of bytes written=67494005
- HDFS: Number of read operations=4
- HDFS: Number of large read operations=0
- HDFS: Number of write operations=2
- Job Counters
- Launched map tasks=1
- Other local map tasks=1
- Total time spent by all maps in occupied slots (ms)=1473198
- Total time spent by all reduces in occupied slots (ms)=0
- Total time spent by all map tasks (ms)=736599
- Total vcore-seconds taken by all map tasks=736599
- Total megabyte-seconds taken by all map tasks=3017109504
- Map-Reduce Framework
- Map input records=40301
- Map output records=40301
- Input split bytes=87
- Spilled Records=0
- Failed Shuffles=0
- Merged Map outputs=0
- GC time elapsed (ms)=2468
- CPU time spent (ms)=63700
- Physical memory (bytes) snapshot=1622859776
- Virtual memory (bytes) snapshot=4335001600
- Total committed heap usage (bytes)=1505755136
- File Input Format Counters
- Bytes Read=0
- File Output Format Counters
- Bytes Written=67494005
Add Comment
Please, Sign In to add comment