API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Aug 9th, 2016
304
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 18.72 KB | None | 0 0
raw download clone embed print report
  1. sqoop import --direct --connect jdbc:netezza://umabofanzd05h1:1234/dodsdb01 --table catalog_sales --username admin --password xxxxxxx -m 1
  2.  
  3. Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
  4.  
  5. 16/08/07 13:38:59 INFO mapreduce.Job: map 0% reduce 0%
  6. 16/08/07 13:39:12 INFO mapreduce.Job: map 100% reduce 0%
  7. 16/08/07 14:25:57 INFO mapreduce.Job: Job job_1467176512921_0015 completed successfully
  8. 16/08/07 14:25:57 INFO mapreduce.Job: Counters: 30
  9. File System Counters
  10. FILE: Number of bytes read=0
  11. FILE: Number of bytes written=142451
  12. FILE: Number of read operations=0
  13. FILE: Number of large read operations=0
  14. FILE: Number of write operations=0
  15. HDFS: Number of bytes read=70
  16. HDFS: Number of bytes written=117840708989
  17. HDFS: Number of read operations=4
  18. HDFS: Number of large read operations=0
  19. HDFS: Number of write operations=2
  20. Job Counters
  21. Launched map tasks=1
  22. Other local map tasks=1
  23. Total time spent by all maps in occupied slots (ms)=2815190
  24. Total time spent by all reduces in occupied slots (ms)=0
  25. Total time spent by all map tasks (ms)=2815190
  26. Total vcore-seconds taken by all map tasks=2815190
  27. Total megabyte-seconds taken by all map tasks=2882754560
  28. Map-Reduce Framework
  29. Map input records=1
  30. Map output records=576001697
  31. Input split bytes=70
  32. Spilled Records=0
  33. Failed Shuffles=0
  34. Merged Map outputs=0
  35. GC time elapsed (ms)=26051
  36. CPU time spent (ms)=2647890
  37. Physical memory (bytes) snapshot=302415872
  38. Virtual memory (bytes) snapshot=1586044928
  39. Total committed heap usage (bytes)=179306496
  40. File Input Format Counters
  41. Bytes Read=0
  42. File Output Format Counters
  43. Bytes Written=117840708989
  44. 16/08/07 14:25:57 INFO mapreduce.ImportJobBase: Transferred 109.7477 GB in 2,831.1265 seconds (39.695 MB/sec)
  45. 16/08/07 14:25:57 INFO mapreduce.ImportJobBase: Retrieved 576001697 records.
  46.  
  47. sqoop import --direct --connect jdbc:netezza://umabofanzd05h1:1234/dodsdb01 --table catalog_sales --username admin --password xxxxxx -m 3
  48.  
  49. Warning: /usr/lib/sqoop/../hbase does not exist! HBase imports will fail.
  50. Please set $HBASE_HOME to the root of your HBase installation.
  51. Warning: /usr/lib/sqoop/../accumulo does not exist! Accumulo imports will fail.
  52. Please set $ACCUMULO_HOME to the root of your Accumulo installation.
  53. 16/08/08 12:50:29 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6-cdh5.7.1
  54. 16/08/08 12:50:29 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
  55. 16/08/08 12:50:29 INFO manager.SqlManager: Using default fetchSize of 1000
  56. 16/08/08 12:50:29 INFO tool.CodeGenTool: The connection manager declares that it self manages mapping between records & fields and rows & columns. will be generated.
  57. 16/08/08 12:50:29 INFO manager.DirectNetezzaManager: Beginning netezza fast path import
  58. 16/08/08 12:50:29 INFO mapreduce.ImportJobBase: Beginning import of catalog_sales
  59. 16/08/08 12:50:30 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
  60. 16/08/08 12:50:30 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM "catalog_sales" AS t WHERE 1=0
  61. 16/08/08 12:50:31 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
  62. 16/08/08 12:50:31 INFO client.RMProxy: Connecting to ResourceManager at dmaubofadev01.bankofamerica.com/159.127.3.179:8032
  63. 16/08/08 12:50:35 INFO mapreduce.JobSubmitter: number of splits:3
  64. 16/08/08 12:50:36 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1467176512921_0018
  65. 16/08/08 12:50:36 INFO impl.YarnClientImpl: Submitted application application_1467176512921_0018
  66. 16/08/08 12:50:37 INFO mapreduce.Job: The url to track the job: http://dmaubofadev01.bankofamerica.com:8088/proxy/application_1467176512921_0018/
  67. 16/08/08 12:50:37 INFO mapreduce.Job: Running job: job_1467176512921_0018
  68. 16/08/08 12:50:47 INFO mapreduce.Job: Job job_1467176512921_0018 running in uber mode : false
  69. 16/08/08 12:50:47 INFO mapreduce.Job: map 0% reduce 0%
  70. 16/08/08 12:51:01 INFO mapreduce.Job: map 33% reduce 0%
  71. 16/08/08 12:51:05 INFO mapreduce.Job: map 67% reduce 0%
  72. 16/08/08 12:57:43 INFO mapreduce.Job: Task Id : attempt_1467176512921_0018_m_000000_0, Status : FAILED
  73. Error: java.io.IOException: java.sql.SQLException: Error occured while writing to file.
  74. at org.apache.sqoop.mapreduce.db.netezza.NetezzaExternalTableImportMapper.map(NetezzaExternalTableImportMapper.java:232)
  75. at org.apache.sqoop.mapreduce.db.netezza.NetezzaExternalTableImportMapper.map(NetezzaExternalTableImportMapper.java:53)
  76. at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
  77. at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
  78. at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
  79. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
  80. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  81. at java.security.AccessController.doPrivileged(Native Method)
  82. at javax.security.auth.Subject.doAs(Subject.java:415)
  83. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  84. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  85. Caused by: java.sql.SQLException: Error occured while writing to file.
  86. at org.netezza.externaltable.NzUnload.cleanupUnload(NzUnload.java:238)
  87. at org.netezza.externaltable.NzUnload.unload(NzUnload.java:143)
  88. at org.netezza.internal.QueryExecutor.getNextResult(QueryExecutor.java:252)
  89. at org.netezza.internal.QueryExecutor.execute(QueryExecutor.java:76)
  90. at org.netezza.sql.NzConnection.execute(NzConnection.java:2904)
  91. at org.netezza.sql.NzStatement._execute(NzStatement.java:885)
  92. at org.netezza.sql.NzPreparedStatament.execute(NzPreparedStatament.java:187)
  93. at org.apache.sqoop.mapreduce.db.netezza.NetezzaJDBCStatementRunner.run(NetezzaJDBCStatementRunner.java:75)
  94.  
  95. 16/08/08 12:57:44 INFO mapreduce.Job: map 33% reduce 0%
  96. 16/08/08 12:57:48 INFO mapreduce.Job: Task Id : attempt_1467176512921_0018_m_000001_0, Status : FAILED
  97. Exception from container-launch.
  98. Container id: container_1467176512921_0018_01_000003
  99. Exit code: 1
  100. Stack trace: ExitCodeException exitCode=1:
  101. at org.apache.hadoop.util.Shell.runCommand(Shell.java:561)
  102. at org.apache.hadoop.util.Shell.run(Shell.java:478)
  103. at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:738)
  104. at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:213)
  105. at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
  106. at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
  107. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  108. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  109. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  110. at java.lang.Thread.run(Thread.java:745)
  111.  
  112.  
  113. Container exited with a non-zero exit code 1
  114.  
  115. 16/08/08 12:57:49 INFO mapreduce.Job: map 0% reduce 0%
  116. 16/08/08 12:57:50 INFO mapreduce.Job: Task Id : attempt_1467176512921_0018_m_000000_1, Status : FAILED
  117. Error: java.lang.InterruptedException
  118. at java.lang.Object.wait(Native Method)
  119. at java.lang.Thread.join(Thread.java:1281)
  120. at java.lang.Thread.join(Thread.java:1355)
  121. at org.apache.sqoop.mapreduce.db.netezza.NetezzaExternalTableImportMapper.map(NetezzaExternalTableImportMapper.java:227)
  122. at org.apache.sqoop.mapreduce.db.netezza.NetezzaExternalTableImportMapper.map(NetezzaExternalTableImportMapper.java:53)
  123. at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
  124. at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
  125. at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
  126. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
  127. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  128. at java.security.AccessController.doPrivileged(Native Method)
  129. at javax.security.auth.Subject.doAs(Subject.java:415)
  130. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  131. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  132.  
  133. 16/08/08 12:57:59 INFO mapreduce.Job: map 33% reduce 0%
  134. 16/08/08 12:58:02 INFO mapreduce.Job: map 67% reduce 0%
  135. 16/08/08 13:01:41 INFO mapreduce.Job: Task Id : attempt_1467176512921_0018_m_000002_0, Status : FAILED
  136. Error: java.io.IOException: java.sql.SQLException: Error occured while writing to file.
  137. at org.apache.sqoop.mapreduce.db.netezza.NetezzaExternalTableImportMapper.map(NetezzaExternalTableImportMapper.java:232)
  138. at org.apache.sqoop.mapreduce.db.netezza.NetezzaExternalTableImportMapper.map(NetezzaExternalTableImportMapper.java:53)
  139. at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
  140. at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
  141. at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
  142. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
  143. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  144. at java.security.AccessController.doPrivileged(Native Method)
  145. at javax.security.auth.Subject.doAs(Subject.java:415)
  146. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  147. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  148. Caused by: java.sql.SQLException: Error occured while writing to file.
  149. at org.netezza.externaltable.NzUnload.cleanupUnload(NzUnload.java:238)
  150. at org.netezza.externaltable.NzUnload.unload(NzUnload.java:143)
  151. at org.netezza.internal.QueryExecutor.getNextResult(QueryExecutor.java:252)
  152. at org.netezza.internal.QueryExecutor.execute(QueryExecutor.java:76)
  153. at org.netezza.sql.NzConnection.execute(NzConnection.java:2904)
  154. at org.netezza.sql.NzStatement._execute(NzStatement.java:885)
  155. at org.netezza.sql.NzPreparedStatament.execute(NzPreparedStatament.java:187)
  156. at org.apache.sqoop.mapreduce.db.netezza.NetezzaJDBCStatementRunner.run(NetezzaJDBCStatementRunner.java:75)
  157.  
  158. 16/08/08 13:01:42 INFO mapreduce.Job: map 33% reduce 0%
  159. 16/08/08 13:01:45 INFO mapreduce.Job: Task Id : attempt_1467176512921_0018_m_000001_1, Status : FAILED
  160. Error: java.io.IOException: java.sql.SQLException: Error occured while writing to file.
  161. at org.apache.sqoop.mapreduce.db.netezza.NetezzaExternalTableImportMapper.map(NetezzaExternalTableImportMapper.java:232)
  162. at org.apache.sqoop.mapreduce.db.netezza.NetezzaExternalTableImportMapper.map(NetezzaExternalTableImportMapper.java:53)
  163. at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
  164. at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
  165. at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
  166. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
  167. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  168. at java.security.AccessController.doPrivileged(Native Method)
  169. at javax.security.auth.Subject.doAs(Subject.java:415)
  170. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  171. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  172. Caused by: java.sql.SQLException: Error occured while writing to file.
  173. at org.netezza.externaltable.NzUnload.cleanupUnload(NzUnload.java:238)
  174. at org.netezza.externaltable.NzUnload.unload(NzUnload.java:143)
  175. at org.netezza.internal.QueryExecutor.getNextResult(QueryExecutor.java:252)
  176. at org.netezza.internal.QueryExecutor.execute(QueryExecutor.java:76)
  177. at org.netezza.sql.NzConnection.execute(NzConnection.java:2904)
  178. at org.netezza.sql.NzStatement._execute(NzStatement.java:885)
  179. at org.netezza.sql.NzPreparedStatament.execute(NzPreparedStatament.java:187)
  180. at org.apache.sqoop.mapreduce.db.netezza.NetezzaJDBCStatementRunner.run(NetezzaJDBCStatementRunner.java:75)
  181.  
  182. 16/08/08 13:01:46 INFO mapreduce.Job: map 0% reduce 0%
  183. 16/08/08 13:01:48 INFO mapreduce.Job: Task Id : attempt_1467176512921_0018_m_000000_2, Status : FAILED
  184. Error: java.io.IOException: java.sql.SQLException: Error occured while writing to file.
  185. at org.apache.sqoop.mapreduce.db.netezza.NetezzaExternalTableImportMapper.map(NetezzaExternalTableImportMapper.java:232)
  186. at org.apache.sqoop.mapreduce.db.netezza.NetezzaExternalTableImportMapper.map(NetezzaExternalTableImportMapper.java:53)
  187. at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
  188. at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
  189. at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
  190. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
  191. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  192. at java.security.AccessController.doPrivileged(Native Method)
  193. at javax.security.auth.Subject.doAs(Subject.java:415)
  194. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  195. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  196. Caused by: java.sql.SQLException: Error occured while writing to file.
  197. at org.netezza.externaltable.NzUnload.cleanupUnload(NzUnload.java:238)
  198. at org.netezza.externaltable.NzUnload.unload(NzUnload.java:143)
  199. at org.netezza.internal.QueryExecutor.getNextResult(QueryExecutor.java:252)
  200. at org.netezza.internal.QueryExecutor.execute(QueryExecutor.java:76)
  201. at org.netezza.sql.NzConnection.execute(NzConnection.java:2904)
  202. at org.netezza.sql.NzStatement._execute(NzStatement.java:885)
  203. at org.netezza.sql.NzPreparedStatament.execute(NzPreparedStatament.java:187)
  204. at org.apache.sqoop.mapreduce.db.netezza.NetezzaJDBCStatementRunner.run(NetezzaJDBCStatementRunner.java:75)
  205.  
  206. 16/08/08 13:01:59 INFO mapreduce.Job: map 33% reduce 0%
  207. 16/08/08 13:02:01 INFO mapreduce.Job: map 67% reduce 0%
  208. 16/08/08 13:05:54 INFO mapreduce.Job: Task Id : attempt_1467176512921_0018_m_000002_1, Status : FAILED
  209. Error: java.lang.InterruptedException
  210. at java.lang.Object.wait(Native Method)
  211. at java.lang.Thread.join(Thread.java:1281)
  212. at java.lang.Thread.join(Thread.java:1355)
  213. at org.apache.sqoop.mapreduce.db.netezza.NetezzaExternalTableImportMapper.map(NetezzaExternalTableImportMapper.java:227)
  214. at org.apache.sqoop.mapreduce.db.netezza.NetezzaExternalTableImportMapper.map(NetezzaExternalTableImportMapper.java:53)
  215. at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
  216. at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
  217. at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
  218. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
  219. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  220. at java.security.AccessController.doPrivileged(Native Method)
  221. at javax.security.auth.Subject.doAs(Subject.java:415)
  222. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  223. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  224.  
  225. 16/08/08 13:05:55 INFO mapreduce.Job: map 33% reduce 0%
  226. 16/08/08 13:05:55 INFO mapreduce.Job: Task Id : attempt_1467176512921_0018_m_000001_2, Status : FAILED
  227. Error: java.lang.InterruptedException
  228. at java.lang.Object.wait(Native Method)
  229. at java.lang.Thread.join(Thread.java:1281)
  230. at java.lang.Thread.join(Thread.java:1355)
  231. at org.apache.sqoop.mapreduce.db.netezza.NetezzaExternalTableImportMapper.map(NetezzaExternalTableImportMapper.java:227)
  232. at org.apache.sqoop.mapreduce.db.netezza.NetezzaExternalTableImportMapper.map(NetezzaExternalTableImportMapper.java:53)
  233. at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
  234. at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
  235. at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
  236. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
  237. at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
  238. at java.security.AccessController.doPrivileged(Native Method)
  239. at javax.security.auth.Subject.doAs(Subject.java:415)
  240. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
  241. at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  242.  
  243. 16/08/08 13:05:56 INFO mapreduce.Job: map 0% reduce 0%
  244. 16/08/08 13:06:02 INFO mapreduce.Job: map 100% reduce 0%
  245. 16/08/08 13:06:02 INFO mapreduce.Job: Job job_1467176512921_0018 failed with state FAILED due to: Task failed task_1467176512921_0018_m_000000
  246. Job failed as tasks failed. failedMaps:1 failedReduces:0
  247.  
  248. 16/08/08 13:06:02 INFO mapreduce.Job: Counters: 11
  249. Job Counters
  250. Failed map tasks=9
  251. Killed map tasks=1
  252. Launched map tasks=10
  253. Other local map tasks=10
  254. Total time spent by all maps in occupied slots (ms)=1813316
  255. Total time spent by all map tasks (ms)=1813316
  256. Total vcore-seconds taken by all map tasks=1813316
  257. Total megabyte-seconds taken by all map tasks=1856835584
  258. Map-Reduce Framework
  259. CPU time spent (ms)=0
  260. Physical memory (bytes) snapshot=0
  261. Virtual memory (bytes) snapshot=0
  262. 16/08/08 13:06:02 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
  263. 16/08/08 13:06:02 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 931.1929 seconds (0 bytes/sec)
  264. 16/08/08 13:06:02 INFO mapreduce.ImportJobBase: Retrieved 0 records.
  265. 16/08/08 13:06:02 ERROR tool.ImportTool: Error during import: Import job failed!
  266.  
  267. Hadoop 2.6.0-cdh5.4.3
  268. Subversion http://github.com/cloudera/hadoop -r 4cd9f51a3f1ef748d45b8d77d0f211ad44296d4b
  269. Compiled by jenkins on 2015-06-25T02:34Z
  270. Compiled with protoc 2.5.0
  271. From source with checksum 4acea6ac185376e0b48b33695e88e7a7
  272. This command was run using /usr/lib/hadoop/hadoop-common-2.6.0-cdh5.4.3.jar
  273.  
  274. 16/08/09 09:50:09 INFO sqoop.Sqoop: Running Sqoop version: 1.4.5-cdh5.4.3
  275. Sqoop 1.4.5-cdh5.4.3
  276. git commit id
  277. Compiled by jenkins on Wed Jun 24 19:29:11 PDT 2015
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!