API tools faq
paste
Advertisement
Guest User

impala-query-error

a guest
May 17th, 2019
78
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 97.92 KB | None | 0 0
raw download clone embed print report
  1. Query (id=944de89e766071b4:207b376900000000):
  2. Summary:
  3. Session ID: 1549b0a348475e83:85f064df8900b198
  4. Session Type: BEESWAX
  5. Start Time: 2019-05-17 22:03:41.198572000
  6. End Time: 2019-05-17 22:09:49.360936000
  7. Query Type: DML
  8. Query State: EXCEPTION
  9. Query Status:
  10.  
  11. Impala Version: impalad version 2.10.0-cdh5.13.1 RELEASE (build 1e4b23c4eb52dac95c5be6316f49685c41783c51)
  12. User: root
  13. Connected User: root
  14. Delegated User:
  15. Network Address: ::ffff:172.16.207.4:42010
  16. Default Db: default
  17. Sql Statement: insert into cyt_checkpoint.dec_firmadosiq2
  18. select
  19. d.origen,
  20. d.coddocumento,
  21. f.corrorigen,
  22. f.nroaudit,
  23. d.institucion,
  24. f.fechafirma,
  25. f.rol,
  26. f.rut,
  27. d.tamano,
  28. 0,
  29. d.sistema,
  30. d.feccreacion
  31. from autentia.dec_documento d
  32. left outer join autentia.dec_firmante f
  33. on d.origen = f.origen and d.coddocumento = f.coddocumento
  34. where feccreacion >= '2019-05-15 00:00:00'
  35. and feccreacion <= '2019-05-16 23:59:59'
  36. and d.origen is not null
  37. and d.coddocumento is not null
  38. and f.corrorigen is not null
  39. and not exists (
  40. select 1
  41. from autentia.dec_firmadosiq
  42. where origendec = d.origen
  43. and coddocumento = d.coddocumento
  44. and corrorigen = f.corrorigen ) limit 100
  45. Coordinator: tanuki.akainix.local:22000
  46. Query Options (set by configuration):
  47. Query Options (set by configuration and planner): MT_DOP=0
  48. Plan:
  49. ----------------
  50. Max Per-Host Resource Reservation: Memory=72.00MB
  51. Per-Host Resource Estimates: Memory=4.00GB
  52. WARNING: The following tables are missing relevant table and/or column statistics.
  53. autentia.dec_documento, autentia.dec_firmadosiq, autentia.dec_firmante
  54.  
  55. F04:PLAN FRAGMENT [KUDU(KuduPartition(d.origen, d.coddocumento))] hosts=4 instances=4
  56. | Per-Host Resources: mem-estimate=4.00MB mem-reservation=4.00MB
  57. INSERT INTO KUDU [cyt_checkpoint.dec_firmadosiq2]
  58. | mem-estimate=0B mem-reservation=0B
  59. |
  60. 09:PARTIAL SORT
  61. | order by: KuduPartition(d.origen, d.coddocumento) ASC NULLS LAST, origen ASC NULLS LAST, coddocumento ASC NULLS LAST, corrorigen ASC NULLS LAST
  62. | materialized: KuduPartition(d.origen, d.coddocumento)
  63. | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB
  64. | tuple-ids=4 row-size=147B cardinality=100
  65. |
  66. 08:EXCHANGE [KUDU(KuduPartition(d.origen, d.coddocumento))]
  67. | mem-estimate=0B mem-reservation=0B
  68. | tuple-ids=0,1N row-size=173B cardinality=100
  69. |
  70. F03:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
  71. Per-Host Resources: mem-estimate=0B mem-reservation=0B
  72. 07:EXCHANGE [UNPARTITIONED]
  73. | limit: 100
  74. | mem-estimate=0B mem-reservation=0B
  75. | tuple-ids=0,1N row-size=173B cardinality=100
  76. |
  77. F00:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
  78. Per-Host Resources: mem-estimate=4.00GB mem-reservation=68.00MB
  79. 04:HASH JOIN [LEFT ANTI JOIN, BROADCAST]
  80. | hash predicates: f.corrorigen = corrorigen, d.coddocumento = coddocumento, d.origen = origendec
  81. | limit: 100
  82. | mem-estimate=2.00GB mem-reservation=34.00MB spill-buffer=2.00MB
  83. | tuple-ids=0,1N row-size=173B cardinality=100
  84. |
  85. |--06:EXCHANGE [BROADCAST]
  86. | | mem-estimate=0B mem-reservation=0B
  87. | | tuple-ids=2 row-size=34B cardinality=unavailable
  88. | |
  89. | F02:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
  90. | Per-Host Resources: mem-estimate=0B mem-reservation=0B
  91. | 02:SCAN KUDU [autentia.dec_firmadosiq]
  92. | kudu predicates: autentia.dec_firmadosiq.coddocumento IS NOT NULL, autentia.dec_firmadosiq.corrorigen IS NOT NULL, autentia.dec_firmadosiq.origendec IS NOT NULL
  93. | mem-estimate=0B mem-reservation=0B
  94. | tuple-ids=2 row-size=34B cardinality=unavailable
  95. |
  96. 03:HASH JOIN [LEFT OUTER JOIN, BROADCAST]
  97. | hash predicates: d.coddocumento = f.coddocumento, d.origen = f.origen
  98. | fk/pk conjuncts: assumed fk/pk
  99. | other predicates: f.corrorigen IS NOT NULL
  100. | mem-estimate=2.00GB mem-reservation=34.00MB spill-buffer=2.00MB
  101. | tuple-ids=0,1N row-size=173B cardinality=unavailable
  102. |
  103. |--05:EXCHANGE [BROADCAST]
  104. | | mem-estimate=0B mem-reservation=0B
  105. | | tuple-ids=1 row-size=94B cardinality=unavailable
  106. | |
  107. | F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
  108. | Per-Host Resources: mem-estimate=0B mem-reservation=0B
  109. | 01:SCAN KUDU [autentia.dec_firmante f]
  110. | kudu predicates: f.coddocumento IS NOT NULL, f.corrorigen IS NOT NULL, f.origen IS NOT NULL
  111. | mem-estimate=0B mem-reservation=0B
  112. | tuple-ids=1 row-size=94B cardinality=unavailable
  113. |
  114. 00:SCAN KUDU [autentia.dec_documento d]
  115. kudu predicates: d.coddocumento IS NOT NULL, d.origen IS NOT NULL, feccreacion <= '2019-05-16 23:59:59', feccreacion >= '2019-05-15 00:00:00'
  116. mem-estimate=0B mem-reservation=0B
  117. tuple-ids=0 row-size=79B cardinality=unavailable
  118. ----------------
  119. Estimated Per-Host Mem: 4299161600
  120. Tables Missing Stats: autentia.dec_documento,autentia.dec_firmadosiq,autentia.dec_firmante
  121. Per Host Min Reservation: ginyu.akainix.local:22000(68.00 MB) seiya.akainix.local:22000(68.00 MB) shun.akainix.local:22000(68.00 MB) tanuki.akainix.local:22000(72.00 MB)
  122. Request Pool: root.root
  123. Admission result: Admitted immediately
  124. ExecSummary:
  125. Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail
  126. --------------------------------------------------------------------------------------------------------------------------------------------
  127. 09:PARTIAL SORT 1 105.216us 105.216us 0 100 16.00 KB 4.00 MB
  128. 08:EXCHANGE 1 0.000ns 0.000ns 0 100 0 0 KUDU(KuduPartition(d.origen, d.coddocumento))
  129. 07:EXCHANGE 1 6m7s 6m7s 100 100 0 0 UNPARTITIONED
  130. 04:HASH JOIN 4 190.898ms 212.790ms 100 100 20.25 GB 2.00 GB LEFT ANTI JOIN, BROADCAST
  131. |--06:EXCHANGE 4 1m32s 1m39s 211.30M -1 0 0 BROADCAST
  132. | 02:SCAN KUDU 4 295.591ms 316.797ms 211.30M -1 14.05 MB 0 autentia.dec_firmadosiq
  133. 03:HASH JOIN 4 39s658ms 2m38s 1.02K -1 43.75 GB 2.00 GB LEFT OUTER JOIN, BROADCAST
  134. |--05:EXCHANGE 4 3m29s 4m2s 260.82M -1 0 0 BROADCAST
  135. | 01:SCAN KUDU 4 376.197ms 578.463ms 260.82M -1 37.36 MB 0 autentia.dec_firmante f
  136. 00:SCAN KUDU 4 1.977ms 2.358ms 2.05K -1 31.33 MB 0 autentia.dec_documento d
  137. Errors:
  138. Planner Timeline: 56.180ms
  139. - Analysis finished: 14.626ms (14.626ms)
  140. - Equivalence classes computed: 15.717ms (1.090ms)
  141. - Single node plan created: 47.333ms (31.615ms)
  142. - Runtime filters computed: 47.410ms (77.621us)
  143. - Distributed plan created: 48.622ms (1.211ms)
  144. - Lineage info computed: 49.563ms (940.990us)
  145. - Planning finished: 56.180ms (6.616ms)
  146. Query Timeline: 6m8s
  147. - Query submitted: 79.838us (79.838us)
  148. - Planning finished: 60.011ms (59.931ms)
  149. - Submit for admission: 61.307ms (1.296ms)
  150. - Completed admission: 61.522ms (214.844us)
  151. - Ready to start on 4 backends: 62.422ms (900.451us)
  152. - All 4 execution backends (14 fragment instances) started: 64.746ms (2.323ms)
  153. - Request finished: 6m8s (6m8s)
  154. - Unregister query: 6m8s (75.948ms)
  155. - ComputeScanRangeAssignmentTimer: 241.902us
  156. ImpalaServer:
  157. - ClientFetchWaitTimer: 0.000ns
  158. - RowMaterializationTimer: 0.000ns
  159. Execution Profile 944de89e766071b4:207b376900000000:(Total: 6m8s, non-child: 0.000ns, % non-child: 0.00%)
  160. Number of filters: 0
  161. Filter routing table:
  162. ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled
  163. -------------------------------------------------------------------------------------------------------------------
  164.  
  165. Backend startup latencies: Count: 4, min / max: 1ms / 1ms, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms
  166. Per Node Peak Memory Usage: ginyu.akainix.local:22000(64.01 GB) seiya.akainix.local:22000(64.02 GB) shun.akainix.local:22000(64.03 GB) tanuki.akainix.local:22000(64.04 GB)
  167. - FiltersReceived: 0 (0)
  168. - FinalizationTimer: 0.000ns
  169. Averaged Fragment F04:(Total: 40.453ms, non-child: 0.000ns, % non-child: 0.00%)
  170. split sizes: min: 0, max: 0, avg: 0, stddev: 0
  171. completion times: min:6m8s max:6m8s mean: 6m8s stddev:0.000ns
  172. execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
  173. num instances: 1
  174. - AverageThreadTokens: 1.00
  175. - BloomFilterBytes: 0
  176. - PeakMemoryUsage: 350.50 KB (358912)
  177. - PeakReservation: 0
  178. - PeakUsedReservation: 0
  179. - PerHostPeakMemUsage: 63.98 GB (68702446285)
  180. - RowsProduced: 0 (0)
  181. - TotalNetworkReceiveTime: 0.000ns
  182. - TotalNetworkSendTime: 0.000ns
  183. - TotalStorageWaitTime: 0.000ns
  184. - TotalThreadsInvoluntaryContextSwitches: 0 (0)
  185. - TotalThreadsTotalWallClockTime: 0.000ns
  186. - TotalThreadsSysTime: 0.000ns
  187. - TotalThreadsUserTime: 0.000ns
  188. - TotalThreadsVoluntaryContextSwitches: 0 (0)
  189. Fragment Instance Lifecycle Timings:
  190. - OpenTime: 0.000ns
  191. - ExecTreeOpenTime: 0.000ns
  192. - PrepareTime: 40.398ms
  193. - ExecTreePrepareTime: 106.350us
  194. KuduTableSink:(Total: 9.270us, non-child: 9.270us, % non-child: 100.00%)
  195. - KuduApplyTimer: 0.000ns
  196. - NumRowErrors: 0 (0)
  197. - PeakMemoryUsage: 0
  198. - RowsProcessedRate: 0
  199. - TotalNumRows: 0 (0)
  200. CodeGen:(Total: 100.431ms, non-child: 100.431ms, % non-child: 100.00%)
  201. - CodegenTime: 2.769ms
  202. - CompileTime: 8.789ms
  203. - LoadTime: 0.000ns
  204. - ModuleBitcodeSize: 1.96 MB (2050188)
  205. - NumFunctions: 28 (28)
  206. - NumInstructions: 653 (653)
  207. - OptimizationTime: 52.937ms
  208. - PeakMemoryUsage: 326.50 KB (334336)
  209. - PrepareTime: 37.012ms
  210. SORT_NODE (id=9):(Total: 105.216us, non-child: 105.216us, % non-child: 100.00%)
  211. - InMemorySortTime: 0.000ns
  212. - InitialRunsCreated: 0 (0)
  213. - PeakMemoryUsage: 16.00 KB (16384)
  214. - RowsReturned: 0 (0)
  215. - RowsReturnedRate: 0
  216. - SortDataSize: 0
  217. - SpilledRuns: 0 (0)
  218. - TotalMergesPerformed: 0 (0)
  219. EXCHANGE_NODE (id=8):
  220. - ConvertRowBatchTime: 0.000ns
  221. - PeakMemoryUsage: 0
  222. - RowsReturned: 0 (0)
  223. - RowsReturnedRate: 0
  224. DataStreamReceiver:
  225. - BytesReceived: 0
  226. - DeserializeRowBatchTimer: 0.000ns
  227. - FirstBatchArrivalWaitTime: 0.000ns
  228. - PeakMemoryUsage: 0
  229. - SendersBlockedTimer: 0.000ns
  230. - SendersBlockedTotalTimer(*): 0.000ns
  231. Fragment F04:
  232. Instance 944de89e766071b4:207b37690000000d (host=tanuki.akainix.local:22000):(Total: 40.453ms, non-child: 0.000ns, % non-child: 0.00%)
  233. MemoryUsage(8s000ms): 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB, 24.50 KB
  234. ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
  235. - AverageThreadTokens: 1.00
  236. - BloomFilterBytes: 0
  237. - PeakMemoryUsage: 350.50 KB (358912)
  238. - PeakReservation: 0
  239. - PeakUsedReservation: 0
  240. - PerHostPeakMemUsage: 63.98 GB (68702446285)
  241. - RowsProduced: 0 (0)
  242. - TotalNetworkReceiveTime: 0.000ns
  243. - TotalNetworkSendTime: 0.000ns
  244. - TotalStorageWaitTime: 0.000ns
  245. - TotalThreadsInvoluntaryContextSwitches: 0 (0)
  246. - TotalThreadsTotalWallClockTime: 0.000ns
  247. - TotalThreadsSysTime: 0.000ns
  248. - TotalThreadsUserTime: 0.000ns
  249. - TotalThreadsVoluntaryContextSwitches: 0 (0)
  250. Fragment Instance Lifecycle Timings:
  251. - OpenTime: 0.000ns
  252. - ExecTreeOpenTime: 0.000ns
  253. - PrepareTime: 40.398ms
  254. - ExecTreePrepareTime: 106.350us
  255. KuduTableSink:(Total: 9.270us, non-child: 9.270us, % non-child: 100.00%)
  256. - KuduApplyTimer: 0.000ns
  257. - NumRowErrors: 0 (0)
  258. - PeakMemoryUsage: 0
  259. - RowsProcessedRate: 0
  260. - TotalNumRows: 0 (0)
  261. CodeGen:(Total: 100.431ms, non-child: 100.431ms, % non-child: 100.00%)
  262. - CodegenTime: 2.769ms
  263. - CompileTime: 8.789ms
  264. - LoadTime: 0.000ns
  265. - ModuleBitcodeSize: 1.96 MB (2050188)
  266. - NumFunctions: 28 (28)
  267. - NumInstructions: 653 (653)
  268. - OptimizationTime: 52.937ms
  269. - PeakMemoryUsage: 326.50 KB (334336)
  270. - PrepareTime: 37.012ms
  271. SORT_NODE (id=9):(Total: 105.216us, non-child: 105.216us, % non-child: 100.00%)
  272. ExecOption: Codegen Enabled
  273. - NumRowsPerRun: 0 (0) (Number of samples: 0)
  274. - InMemorySortTime: 0.000ns
  275. - InitialRunsCreated: 0 (0)
  276. - PeakMemoryUsage: 16.00 KB (16384)
  277. - RowsReturned: 0 (0)
  278. - RowsReturnedRate: 0
  279. - SortDataSize: 0
  280. - SpilledRuns: 0 (0)
  281. - TotalMergesPerformed: 0 (0)
  282. EXCHANGE_NODE (id=8):
  283. - ConvertRowBatchTime: 0.000ns
  284. - PeakMemoryUsage: 0
  285. - RowsReturned: 0 (0)
  286. - RowsReturnedRate: 0
  287. DataStreamReceiver:
  288. BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  289. - BytesReceived: 0
  290. - DeserializeRowBatchTimer: 0.000ns
  291. - FirstBatchArrivalWaitTime: 0.000ns
  292. - PeakMemoryUsage: 0
  293. - SendersBlockedTimer: 0.000ns
  294. - SendersBlockedTotalTimer(*): 0.000ns
  295. Averaged Fragment F03:(Total: 6m7s, non-child: 2.645ms, % non-child: 0.00%)
  296. split sizes: min: 0, max: 0, avg: 0, stddev: 0
  297. completion times: min:6m7s max:6m7s mean: 6m7s stddev:0.000ns
  298. execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
  299. num instances: 1
  300. - AverageThreadTokens: 1.00
  301. - BloomFilterBytes: 0
  302. - PeakMemoryUsage: 50.82 KB (52039)
  303. - PeakReservation: 0
  304. - PeakUsedReservation: 0
  305. - PerHostPeakMemUsage: 64.04 GB (68759137883)
  306. - RowsProduced: 100 (100)
  307. - TotalNetworkReceiveTime: 6m7s
  308. - TotalNetworkSendTime: 448.559us
  309. - TotalStorageWaitTime: 0.000ns
  310. - TotalThreadsInvoluntaryContextSwitches: 1 (1)
  311. - TotalThreadsTotalWallClockTime: 6m7s
  312. - TotalThreadsSysTime: 22.000us
  313. - TotalThreadsUserTime: 259.000us
  314. - TotalThreadsVoluntaryContextSwitches: 3 (3)
  315. Fragment Instance Lifecycle Timings:
  316. - ExecTime: 729.481us
  317. - ExecTreeExecTime: 8.563us
  318. - OpenTime: 6m7s
  319. - ExecTreeOpenTime: 6m7s
  320. - PrepareTime: 53.963ms
  321. - ExecTreePrepareTime: 46.216us
  322. DataStreamSender (dst_id=8):(Total: 423.437us, non-child: 423.437us, % non-child: 100.00%)
  323. - BytesSent: 13.38 KB (13703)
  324. - NetworkThroughput(*): 177.66 MB/sec
  325. - OverallThroughput: 30.86 MB/sec
  326. - PeakMemoryUsage: 1.38 KB (1408)
  327. - RowsReturned: 100 (100)
  328. - SerializeBatchTime: 150.348us
  329. - TransmitDataRPCTime: 73.556us
  330. - UncompressedRowBatchSize: 32.67 KB (33455)
  331. CodeGen:(Total: 51.688ms, non-child: 51.688ms, % non-child: 100.00%)
  332. - CodegenTime: 0.000ns
  333. - CompileTime: 0.000ns
  334. - LoadTime: 0.000ns
  335. - ModuleBitcodeSize: 1.96 MB (2050188)
  336. - NumFunctions: 0 (0)
  337. - NumInstructions: 0 (0)
  338. - OptimizationTime: 0.000ns
  339. - PeakMemoryUsage: 0
  340. - PrepareTime: 50.677ms
  341. EXCHANGE_NODE (id=7):(Total: 6m7s, non-child: 6m7s, % non-child: 100.00%)
  342. - ConvertRowBatchTime: 7.022us
  343. - PeakMemoryUsage: 0
  344. - RowsReturned: 100 (100)
  345. - RowsReturnedRate: 0
  346. DataStreamReceiver:
  347. - BytesReceived: 13.38 KB (13703)
  348. - DeserializeRowBatchTimer: 87.262us
  349. - FirstBatchArrivalWaitTime: 6m7s
  350. - PeakMemoryUsage: 33.44 KB (34247)
  351. - SendersBlockedTimer: 0.000ns
  352. - SendersBlockedTotalTimer(*): 0.000ns
  353. Fragment F03:
  354. Instance 944de89e766071b4:207b37690000000c (host=tanuki.akainix.local:22000):(Total: 6m7s, non-child: 2.645ms, % non-child: 0.00%)
  355. MemoryUsage(8s000ms): 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB, 17.38 KB
  356. ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
  357. - AverageThreadTokens: 1.00
  358. - BloomFilterBytes: 0
  359. - PeakMemoryUsage: 50.82 KB (52039)
  360. - PeakReservation: 0
  361. - PeakUsedReservation: 0
  362. - PerHostPeakMemUsage: 64.04 GB (68759137883)
  363. - RowsProduced: 100 (100)
  364. - TotalNetworkReceiveTime: 6m7s
  365. - TotalNetworkSendTime: 448.559us
  366. - TotalStorageWaitTime: 0.000ns
  367. - TotalThreadsInvoluntaryContextSwitches: 1 (1)
  368. - TotalThreadsTotalWallClockTime: 6m7s
  369. - TotalThreadsSysTime: 22.000us
  370. - TotalThreadsUserTime: 259.000us
  371. - TotalThreadsVoluntaryContextSwitches: 3 (3)
  372. Fragment Instance Lifecycle Timings:
  373. - ExecTime: 729.481us
  374. - ExecTreeExecTime: 8.563us
  375. - OpenTime: 6m7s
  376. - ExecTreeOpenTime: 6m7s
  377. - PrepareTime: 53.963ms
  378. - ExecTreePrepareTime: 46.216us
  379. DataStreamSender (dst_id=8):(Total: 423.437us, non-child: 423.437us, % non-child: 100.00%)
  380. - BytesSent: 13.38 KB (13703)
  381. - NetworkThroughput(*): 177.66 MB/sec
  382. - OverallThroughput: 30.86 MB/sec
  383. - PeakMemoryUsage: 1.38 KB (1408)
  384. - RowsReturned: 100 (100)
  385. - SerializeBatchTime: 150.348us
  386. - TransmitDataRPCTime: 73.556us
  387. - UncompressedRowBatchSize: 32.67 KB (33455)
  388. CodeGen:(Total: 51.688ms, non-child: 51.688ms, % non-child: 100.00%)
  389. - CodegenTime: 0.000ns
  390. - CompileTime: 0.000ns
  391. - LoadTime: 0.000ns
  392. - ModuleBitcodeSize: 1.96 MB (2050188)
  393. - NumFunctions: 0 (0)
  394. - NumInstructions: 0 (0)
  395. - OptimizationTime: 0.000ns
  396. - PeakMemoryUsage: 0
  397. - PrepareTime: 50.677ms
  398. EXCHANGE_NODE (id=7):(Total: 6m7s, non-child: 6m7s, % non-child: 100.00%)
  399. - ConvertRowBatchTime: 7.022us
  400. - PeakMemoryUsage: 0
  401. - RowsReturned: 100 (100)
  402. - RowsReturnedRate: 0
  403. DataStreamReceiver:
  404. BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  405. - BytesReceived: 13.38 KB (13703)
  406. - DeserializeRowBatchTimer: 87.262us
  407. - FirstBatchArrivalWaitTime: 6m7s
  408. - PeakMemoryUsage: 33.44 KB (34247)
  409. - SendersBlockedTimer: 0.000ns
  410. - SendersBlockedTotalTimer(*): 0.000ns
  411. Averaged Fragment F00:(Total: 1m32s, non-child: 0.000ns, % non-child: 0.00%)
  412. split sizes: min: 0, max: 0, avg: 0, stddev: 0
  413. completion times: min:6m7s max:6m8s mean: 6m8s stddev:15.423ms
  414. execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
  415. num instances: 4
  416. - AverageThreadTokens: 3.48
  417. - BloomFilterBytes: 0
  418. - PeakMemoryUsage: 64.02 GB (68738053704)
  419. - PeakReservation: 63.99 GB (68712136704)
  420. - PeakUsedReservation: 0
  421. - PerHostPeakMemUsage: 64.02 GB (68739113001)
  422. - RowsProduced: 25 (25)
  423. - TotalNetworkReceiveTime: 4m53s
  424. - TotalNetworkSendTime: 139.210us
  425. - TotalStorageWaitTime: 2s012ms
  426. - TotalThreadsInvoluntaryContextSwitches: 405 (405)
  427. - TotalThreadsTotalWallClockTime: 6m
  428. - TotalThreadsSysTime: 43s435ms
  429. - TotalThreadsUserTime: 1m18s
  430. - TotalThreadsVoluntaryContextSwitches: 213.44K (213445)
  431. Fragment Instance Lifecycle Timings:
  432. - ExecTime: 82.902ms
  433. - ExecTreeExecTime: 28.049ms
  434. - OpenTime: 1m31s
  435. - ExecTreeOpenTime: 1m31s
  436. - PrepareTime: 56.681ms
  437. - ExecTreePrepareTime: 769.241us
  438. DataStreamSender (dst_id=7):(Total: 343.129us, non-child: 343.129us, % non-child: 100.00%)
  439. - BytesSent: 3.34 KB (3425)
  440. - NetworkThroughput(*): 42.27 MB/sec
  441. - OverallThroughput: 4.48 MB/sec
  442. - PeakMemoryUsage: 1.38 KB (1408)
  443. - RowsReturned: 25 (25)
  444. - SerializeBatchTime: 104.716us
  445. - TransmitDataRPCTime: 19.324us
  446. - UncompressedRowBatchSize: 8.17 KB (8363)
  447. CodeGen:(Total: 698.646ms, non-child: 698.646ms, % non-child: 100.00%)
  448. - CodegenTime: 0.000ns
  449. - CompileTime: 242.119ms
  450. - LoadTime: 0.000ns
  451. - ModuleBitcodeSize: 1.96 MB (2050188)
  452. - NumFunctions: 86 (86)
  453. - NumInstructions: 5.24K (5242)
  454. - OptimizationTime: 414.739ms
  455. - PeakMemoryUsage: 2.56 MB (2683904)
  456. - PrepareTime: 40.855ms
  457. HASH_JOIN_NODE (id=4):(Total: 1m31s, non-child: 190.898ms, % non-child: 0.21%)
  458. - BuildRows: 211.30M (211298301)
  459. - BuildTime: 1m22s
  460. - NumHashTableBuildsSkipped: 0 (0)
  461. - PeakMemoryUsage: 20.25 GB (21743464448)
  462. - ProbeRows: 256 (256)
  463. - ProbeRowsPartitioned: 0 (0)
  464. - ProbeTime: 7.010ms
  465. - RowsReturned: 25 (25)
  466. - RowsReturnedRate: 0
  467. Buffer pool:
  468. - AllocTime: 7s298ms
  469. - CumulativeAllocationBytes: 20.25 GB (21743271936)
  470. - CumulativeAllocations: 6.29K (6288)
  471. - PeakReservation: 20.25 GB (21743271936)
  472. - PeakUnpinnedBytes: 0
  473. - PeakUsedReservation: 20.25 GB (21743271936)
  474. - ReadIoBytes: 0
  475. - ReadIoOps: 0 (0)
  476. - ReadIoWaitTime: 0.000ns
  477. - WriteIoBytes: 0
  478. - WriteIoOps: 0 (0)
  479. - WriteIoWaitTime: 0.000ns
  480. Hash Join Builder (join_node_id=4):
  481. - BuildRowsPartitionTime: 47s042ms
  482. - BuildRowsPartitioned: 211.30M (211298301)
  483. - HashBuckets: 536.87M (536870912)
  484. - HashCollisions: 0 (0)
  485. - HashTablesBuildTime: 35s717ms
  486. - LargestPartitionPercent: 6 (6)
  487. - MaxPartitionLevel: 0 (0)
  488. - NumRepartitions: 0 (0)
  489. - PartitionsCreated: 16 (16)
  490. - PeakMemoryUsage: 55.12 KB (56448)
  491. - RepartitionTime: 0.000ns
  492. - SpilledPartitions: 0 (0)
  493. EXCHANGE_NODE (id=6):(Total: 1m32s, non-child: 1m32s, % non-child: 100.00%)
  494. - ConvertRowBatchTime: 3s718ms
  495. - PeakMemoryUsage: 0
  496. - RowsReturned: 211.30M (211298301)
  497. - RowsReturnedRate: 2.28 M/sec
  498. DataStreamReceiver:
  499. - BytesReceived: 4.84 GB (5201852371)
  500. - DeserializeRowBatchTimer: 24s790ms
  501. - FirstBatchArrivalWaitTime: 0.000ns
  502. - PeakMemoryUsage: 10.67 MB (11183104)
  503. - SendersBlockedTimer: 568.528ms
  504. - SendersBlockedTotalTimer(*): 1s563ms
  505. HASH_JOIN_NODE (id=3):(Total: 1m31s, non-child: 39s658ms, % non-child: 43.20%)
  506. - BuildRows: 260.82M (260824206)
  507. - BuildTime: 2m2s
  508. - NumHashTableBuildsSkipped: 0 (0)
  509. - PeakMemoryUsage: 43.74 GB (46969030656)
  510. - ProbeRows: 512 (512)
  511. - ProbeRowsPartitioned: 0 (0)
  512. - ProbeTime: 285.987us
  513. - RowsReturned: 256 (256)
  514. - RowsReturnedRate: 0
  515. Buffer pool:
  516. - AllocTime: 36s929ms
  517. - CumulativeAllocationBytes: 47.52 GB (51023183872)
  518. - CumulativeAllocations: 21.01K (21014)
  519. - PeakReservation: 43.74 GB (46968864768)
  520. - PeakUnpinnedBytes: 4.76 GB (5108662272)
  521. - PeakUsedReservation: 43.74 GB (46968864768)
  522. - ReadIoBytes: 0
  523. - ReadIoOps: 0 (0)
  524. - ReadIoWaitTime: 0.000ns
  525. - WriteIoBytes: 3.66 GB (3933208576)
  526. - WriteIoOps: 1.88K (1875)
  527. - WriteIoWaitTime: 142.566ms
  528. Hash Join Builder (join_node_id=3):
  529. - BuildRowsPartitionTime: 1m53s
  530. - BuildRowsPartitioned: 260.82M (260824206)
  531. - HashBuckets: 377.49M (377487360)
  532. - HashCollisions: 0 (0)
  533. - HashTablesBuildTime: 32s431ms
  534. - LargestPartitionPercent: 6 (6)
  535. - MaxPartitionLevel: 0 (0)
  536. - NumRepartitions: 0 (0)
  537. - PartitionsCreated: 16 (16)
  538. - PeakMemoryUsage: 46.12 KB (47232)
  539. - RepartitionTime: 0.000ns
  540. - SpilledPartitions: 2 (2)
  541. EXCHANGE_NODE (id=5):(Total: 3m29s, non-child: 3m29s, % non-child: 100.00%)
  542. - ConvertRowBatchTime: 4s951ms
  543. - PeakMemoryUsage: 0
  544. - RowsReturned: 260.82M (260824206)
  545. - RowsReturnedRate: 1.25 M/sec
  546. DataStreamReceiver:
  547. - BytesReceived: 13.16 GB (14125460142)
  548. - DeserializeRowBatchTimer: 1m47s
  549. - FirstBatchArrivalWaitTime: 0.000ns
  550. - PeakMemoryUsage: 10.34 MB (10845516)
  551. - SendersBlockedTimer: 644.993ms
  552. - SendersBlockedTotalTimer(*): 2s161ms
  553. KUDU_SCAN_NODE (id=0):(Total: 1.977ms, non-child: 1.977ms, % non-child: 100.00%)
  554. - BytesRead: 0
  555. - KuduRemoteScanTokens: 0 (0)
  556. - NumScannerThreadsStarted: 1 (1)
  557. - PeakMemoryUsage: 24.46 MB (25651968)
  558. - RowsRead: 100.39K (100389)
  559. - RowsReturned: 512 (512)
  560. - RowsReturnedRate: 281.81 K/sec
  561. - ScanRangesComplete: 0 (0)
  562. - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
  563. - ScannerThreadsTotalWallClockTime: 709.338ms
  564. - MaterializeTupleTime(*): 3.723us
  565. - ScannerThreadsSysTime: 4.218ms
  566. - ScannerThreadsUserTime: 8.802ms
  567. - ScannerThreadsVoluntaryContextSwitches: 7 (7)
  568. - TotalKuduScanRoundTrips: 14 (14)
  569. - TotalReadThroughput: 0.00 /sec
  570. Fragment F00:
  571. Instance 944de89e766071b4:207b376900000008 (host=seiya.akainix.local:22000):(Total: 6m7s, non-child: 67.779ms, % non-child: 0.02%)
  572. Hdfs split stats (<volume id>:<# splits>/<split lengths>):
  573. MemoryUsage(8s000ms): 672.05 MB, 2.32 GB, 4.17 GB, 5.94 GB, 7.70 GB, 9.58 GB, 11.31 GB, 13.13 GB, 14.85 GB, 16.59 GB, 18.23 GB, 19.73 GB, 21.19 GB, 22.79 GB, 24.42 GB, 25.98 GB, 27.52 GB, 29.03 GB, 31.81 GB, 34.80 GB, 37.84 GB, 40.81 GB, 42.22 GB, 43.32 GB, 44.45 GB, 45.42 GB, 46.27 GB, 47.00 GB, 47.84 GB, 48.67 GB, 49.51 GB, 50.36 GB, 51.17 GB, 52.03 GB, 52.88 GB, 53.76 GB, 54.57 GB, 55.30 GB, 56.05 GB, 56.94 GB, 57.74 GB, 58.48 GB, 60.41 GB, 62.77 GB, 63.65 GB, 64.02 GB
  574. ThreadUsage(8s000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1
  575. - AverageThreadTokens: 2.47
  576. - BloomFilterBytes: 0
  577. - PeakMemoryUsage: 64.02 GB (68738324296)
  578. - PeakReservation: 64.00 GB (68719476736)
  579. - PeakUsedReservation: 0
  580. - PerHostPeakMemUsage: 64.02 GB (68738324296)
  581. - RowsProduced: 100 (100)
  582. - TotalNetworkReceiveTime: 4m49s
  583. - TotalNetworkSendTime: 556.841us
  584. - TotalStorageWaitTime: 1s369ms
  585. - TotalThreadsInvoluntaryContextSwitches: 767 (767)
  586. - TotalThreadsTotalWallClockTime: 15m9s
  587. - TotalThreadsSysTime: 1m34s
  588. - TotalThreadsUserTime: 2m19s
  589. - TotalThreadsVoluntaryContextSwitches: 374.23K (374227)
  590. Fragment Instance Lifecycle Timings:
  591. - ExecTime: 82.902ms
  592. - ExecTreeExecTime: 28.049ms
  593. - OpenTime: 6m7s
  594. - ExecTreeOpenTime: 6m7s
  595. - PrepareTime: 55.850ms
  596. - ExecTreePrepareTime: 962.259us
  597. DataStreamSender (dst_id=7):(Total: 730.029us, non-child: 730.029us, % non-child: 100.00%)
  598. - BytesSent: 13.38 KB (13703)
  599. - NetworkThroughput(*): 169.06 MB/sec
  600. - OverallThroughput: 17.90 MB/sec
  601. - PeakMemoryUsage: 1.38 KB (1408)
  602. - RowsReturned: 100 (100)
  603. - SerializeBatchTime: 418.864us
  604. - TransmitDataRPCTime: 77.298us
  605. - UncompressedRowBatchSize: 32.67 KB (33455)
  606. CodeGen:(Total: 672.047ms, non-child: 672.047ms, % non-child: 100.00%)
  607. - CodegenTime: 0.000ns
  608. - CompileTime: 228.986ms
  609. - LoadTime: 0.000ns
  610. - ModuleBitcodeSize: 1.96 MB (2050188)
  611. - NumFunctions: 86 (86)
  612. - NumInstructions: 5.24K (5242)
  613. - OptimizationTime: 401.033ms
  614. - PeakMemoryUsage: 2.56 MB (2683904)
  615. - PrepareTime: 41.174ms
  616. HASH_JOIN_NODE (id=4):(Total: 6m7s, non-child: 212.790ms, % non-child: 0.06%)
  617. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  618. - BuildRows: 211.30M (211298301)
  619. - BuildTime: 1m21s
  620. - NumHashTableBuildsSkipped: 0 (0)
  621. - PeakMemoryUsage: 20.25 GB (21743654144)
  622. - ProbeRows: 1.02K (1024)
  623. - ProbeRowsPartitioned: 0 (0)
  624. - ProbeTime: 28.040ms
  625. - RowsReturned: 100 (100)
  626. - RowsReturnedRate: 0
  627. Buffer pool:
  628. - AllocTime: 9s642ms
  629. - CumulativeAllocationBytes: 20.25 GB (21743271936)
  630. - CumulativeAllocations: 6.29K (6288)
  631. - PeakReservation: 20.25 GB (21743271936)
  632. - PeakUnpinnedBytes: 0
  633. - PeakUsedReservation: 20.25 GB (21743271936)
  634. - ReadIoBytes: 0
  635. - ReadIoOps: 0 (0)
  636. - ReadIoWaitTime: 0.000ns
  637. - WriteIoBytes: 0
  638. - WriteIoOps: 0 (0)
  639. - WriteIoWaitTime: 0.000ns
  640. Hash Join Builder (join_node_id=4):
  641. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  642. - BuildRowsPartitionTime: 49s329ms
  643. - BuildRowsPartitioned: 211.30M (211298301)
  644. - HashBuckets: 536.87M (536870912)
  645. - HashCollisions: 0 (0)
  646. - HashTablesBuildTime: 32s431ms
  647. - LargestPartitionPercent: 6 (6)
  648. - MaxPartitionLevel: 0 (0)
  649. - NumRepartitions: 0 (0)
  650. - PartitionsCreated: 16 (16)
  651. - PeakMemoryUsage: 55.12 KB (56448)
  652. - RepartitionTime: 0.000ns
  653. - SpilledPartitions: 0 (0)
  654. EXCHANGE_NODE (id=6):(Total: 1m30s, non-child: 1m30s, % non-child: 100.00%)
  655. - ConvertRowBatchTime: 3s981ms
  656. - PeakMemoryUsage: 0
  657. - RowsReturned: 211.30M (211298301)
  658. - RowsReturnedRate: 2.33 M/sec
  659. DataStreamReceiver:
  660. BytesReceived(4s000ms): 42.60 MB, 163.06 MB, 313.71 MB, 463.61 MB, 624.52 MB, 777.82 MB, 931.30 MB, 1.07 GB, 1.21 GB, 1.36 GB, 1.51 GB, 1.64 GB, 1.77 GB, 1.94 GB, 2.09 GB, 2.25 GB, 2.41 GB, 2.54 GB, 2.68 GB, 2.82 GB, 2.95 GB, 3.10 GB, 3.22 GB, 3.34 GB, 3.48 GB, 3.59 GB, 3.74 GB, 3.89 GB, 4.02 GB, 4.16 GB, 4.30 GB, 4.45 GB, 4.58 GB, 4.68 GB, 4.78 GB, 4.84 GB, 4.84 GB, 4.84 GB, 4.84 GB, 4.84 GB, 4.84 GB, 4.84 GB, 4.84 GB
  661. - BytesReceived: 4.84 GB (5201852371)
  662. - DeserializeRowBatchTimer: 27s044ms
  663. - FirstBatchArrivalWaitTime: 0.000ns
  664. - PeakMemoryUsage: 10.67 MB (11183104)
  665. - SendersBlockedTimer: 538.932ms
  666. - SendersBlockedTotalTimer(*): 1s358ms
  667. HASH_JOIN_NODE (id=3):(Total: 6m7s, non-child: 2m38s, % non-child: 43.20%)
  668. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  669. - BuildRows: 260.82M (260824206)
  670. - BuildTime: 2m29s
  671. - NumHashTableBuildsSkipped: 0 (0)
  672. - PeakMemoryUsage: 43.75 GB (46976560384)
  673. - ProbeRows: 2.05K (2048)
  674. - ProbeRowsPartitioned: 0 (0)
  675. - ProbeTime: 1.143ms
  676. - RowsReturned: 1.02K (1024)
  677. - RowsReturnedRate: 2.00 /sec
  678. Buffer pool:
  679. - AllocTime: 43s307ms
  680. - CumulativeAllocationBytes: 49.05 GB (52667875328)
  681. - CumulativeAllocations: 21.29K (21289)
  682. - PeakReservation: 43.75 GB (46976204800)
  683. - PeakUnpinnedBytes: 7.14 GB (7662993408)
  684. - PeakUsedReservation: 43.75 GB (46976204800)
  685. - ReadIoBytes: 0
  686. - ReadIoOps: 0 (0)
  687. - ReadIoWaitTime: 0.000ns
  688. - WriteIoBytes: 4.84 GB (5194645504)
  689. - WriteIoOps: 2.48K (2477)
  690. - WriteIoWaitTime: 120.688ms
  691. Hash Join Builder (join_node_id=3):
  692. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled
  693. - BuildRowsPartitionTime: 1m54s
  694. - BuildRowsPartitioned: 260.82M (260824206)
  695. - HashBuckets: 436.21M (436207616)
  696. - HashCollisions: 0 (0)
  697. - HashTablesBuildTime: 34s990ms
  698. - LargestPartitionPercent: 6 (6)
  699. - MaxPartitionLevel: 0 (0)
  700. - NumRepartitions: 0 (0)
  701. - PartitionsCreated: 16 (16)
  702. - PeakMemoryUsage: 46.12 KB (47232)
  703. - RepartitionTime: 0.000ns
  704. - SpilledPartitions: 3 (3)
  705. EXCHANGE_NODE (id=5):(Total: 3m28s, non-child: 3m28s, % non-child: 100.00%)
  706. - ConvertRowBatchTime: 5s418ms
  707. - PeakMemoryUsage: 0
  708. - RowsReturned: 260.82M (260824206)
  709. - RowsReturnedRate: 1.25 M/sec
  710. DataStreamReceiver:
  711. BytesReceived(8s000ms): 163.07 MB, 538.95 MB, 892.04 MB, 1.21 GB, 1.53 GB, 1.87 GB, 2.18 GB, 2.47 GB, 2.76 GB, 3.09 GB, 3.38 GB, 3.69 GB, 3.99 GB, 4.30 GB, 4.62 GB, 4.89 GB, 5.19 GB, 5.49 GB, 5.90 GB, 6.27 GB, 6.66 GB, 7.07 GB, 7.45 GB, 7.84 GB, 8.24 GB, 8.58 GB, 8.91 GB, 9.20 GB, 9.51 GB, 9.80 GB, 10.10 GB, 10.38 GB, 10.69 GB, 11.01 GB, 11.29 GB, 11.57 GB, 11.85 GB, 12.14 GB, 12.41 GB, 12.70 GB, 12.98 GB, 13.12 GB, 13.16 GB, 13.16 GB, 13.16 GB
  712. - BytesReceived: 13.16 GB (14125460142)
  713. - DeserializeRowBatchTimer: 1m53s
  714. - FirstBatchArrivalWaitTime: 0.000ns
  715. - PeakMemoryUsage: 10.40 MB (10903630)
  716. - SendersBlockedTimer: 745.351ms
  717. - SendersBlockedTotalTimer(*): 2s442ms
  718. KUDU_SCAN_NODE (id=0):(Total: 1.816ms, non-child: 1.816ms, % non-child: 100.00%)
  719. BytesRead(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  720. - BytesRead: 0
  721. - KuduRemoteScanTokens: 0 (0)
  722. - NumScannerThreadsStarted: 1 (1)
  723. - PeakMemoryUsage: 17.72 MB (18582528)
  724. - RowsRead: 69.95K (69951)
  725. - RowsReturned: 2.05K (2048)
  726. - RowsReturnedRate: 1.13 M/sec
  727. - ScanRangesComplete: 1 (1)
  728. - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
  729. - ScannerThreadsTotalWallClockTime: 1s390ms
  730. - MaterializeTupleTime(*): 14.893us
  731. - ScannerThreadsSysTime: 6.858ms
  732. - ScannerThreadsUserTime: 16.831ms
  733. - ScannerThreadsVoluntaryContextSwitches: 13 (13)
  734. - TotalKuduScanRoundTrips: 10 (10)
  735. - TotalReadThroughput: 0.00 /sec
  736. Instance 944de89e766071b4:207b37690000000b (host=shun.akainix.local:22000):(Total: 60.319ms, non-child: 0.000ns, % non-child: 0.00%)
  737. Hdfs split stats (<volume id>:<# splits>/<split lengths>):
  738. MemoryUsage(8s000ms): 669.53 MB, 2.32 GB, 4.17 GB, 5.94 GB, 7.71 GB, 9.58 GB, 11.32 GB, 13.13 GB, 14.85 GB, 16.59 GB, 18.23 GB, 19.74 GB, 21.19 GB, 22.79 GB, 24.42 GB, 25.99 GB, 27.53 GB, 29.07 GB, 31.94 GB, 35.03 GB, 38.19 GB, 41.04 GB, 42.23 GB, 43.33 GB, 44.46 GB, 45.43 GB, 46.27 GB, 47.01 GB, 47.85 GB, 48.68 GB, 49.51 GB, 50.37 GB, 51.18 GB, 52.04 GB, 52.89 GB, 53.77 GB, 54.58 GB, 55.31 GB, 56.06 GB, 56.93 GB, 57.73 GB, 58.49 GB, 60.64 GB, 63.03 GB, 63.71 GB
  739. ThreadUsage(8s000ms): 4, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4
  740. - AverageThreadTokens: 4.46
  741. - BloomFilterBytes: 0
  742. - PeakMemoryUsage: 64.03 GB (68752597832)
  743. - PeakReservation: 64.00 GB (68719476736)
  744. - PeakUsedReservation: 0
  745. - PerHostPeakMemUsage: 64.03 GB (68752597832)
  746. - RowsProduced: 0 (0)
  747. - TotalNetworkReceiveTime: 5m31s
  748. - TotalNetworkSendTime: 0.000ns
  749. - TotalStorageWaitTime: 2s652ms
  750. - TotalThreadsInvoluntaryContextSwitches: 253 (253)
  751. - TotalThreadsTotalWallClockTime: 2m51s
  752. - TotalThreadsSysTime: 18s223ms
  753. - TotalThreadsUserTime: 57s767ms
  754. - TotalThreadsVoluntaryContextSwitches: 165.73K (165728)
  755. Fragment Instance Lifecycle Timings:
  756. - OpenTime: 0.000ns
  757. - ExecTreeOpenTime: 0.000ns
  758. - PrepareTime: 60.159ms
  759. - ExecTreePrepareTime: 586.645us
  760. DataStreamSender (dst_id=7):(Total: 189.966us, non-child: 189.966us, % non-child: 100.00%)
  761. - BytesSent: 0
  762. - NetworkThroughput(*): 0.00 /sec
  763. - OverallThroughput: 0.00 /sec
  764. - PeakMemoryUsage: 1.38 KB (1408)
  765. - RowsReturned: 0 (0)
  766. - SerializeBatchTime: 0.000ns
  767. - TransmitDataRPCTime: 0.000ns
  768. - UncompressedRowBatchSize: 0
  769. CodeGen:(Total: 695.749ms, non-child: 695.749ms, % non-child: 100.00%)
  770. - CodegenTime: 0.000ns
  771. - CompileTime: 230.761ms
  772. - LoadTime: 0.000ns
  773. - ModuleBitcodeSize: 1.96 MB (2050188)
  774. - NumFunctions: 86 (86)
  775. - NumInstructions: 5.24K (5242)
  776. - OptimizationTime: 421.780ms
  777. - PeakMemoryUsage: 2.56 MB (2683904)
  778. - PrepareTime: 42.222ms
  779. HASH_JOIN_NODE (id=4):(Total: 965.638us, non-child: 184.172ms, % non-child: 100.00%)
  780. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  781. - BuildRows: 211.30M (211298301)
  782. - BuildTime: 1m11s
  783. - NumHashTableBuildsSkipped: 0 (0)
  784. - PeakMemoryUsage: 20.25 GB (21743401216)
  785. - ProbeRows: 0 (0)
  786. - ProbeRowsPartitioned: 0 (0)
  787. - ProbeTime: 0.000ns
  788. - RowsReturned: 0 (0)
  789. - RowsReturnedRate: 0
  790. Buffer pool:
  791. - AllocTime: 2s313ms
  792. - CumulativeAllocationBytes: 20.25 GB (21743271936)
  793. - CumulativeAllocations: 6.29K (6288)
  794. - PeakReservation: 20.25 GB (21743271936)
  795. - PeakUnpinnedBytes: 0
  796. - PeakUsedReservation: 20.25 GB (21743271936)
  797. - ReadIoBytes: 0
  798. - ReadIoOps: 0 (0)
  799. - ReadIoWaitTime: 0.000ns
  800. - WriteIoBytes: 0
  801. - WriteIoOps: 0 (0)
  802. - WriteIoWaitTime: 0.000ns
  803. Hash Join Builder (join_node_id=4):
  804. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  805. - BuildRowsPartitionTime: 40s508ms
  806. - BuildRowsPartitioned: 211.30M (211298301)
  807. - HashBuckets: 536.87M (536870912)
  808. - HashCollisions: 0 (0)
  809. - HashTablesBuildTime: 30s692ms
  810. - LargestPartitionPercent: 6 (6)
  811. - MaxPartitionLevel: 0 (0)
  812. - NumRepartitions: 0 (0)
  813. - PartitionsCreated: 16 (16)
  814. - PeakMemoryUsage: 55.12 KB (56448)
  815. - RepartitionTime: 0.000ns
  816. - SpilledPartitions: 0 (0)
  817. EXCHANGE_NODE (id=6):(Total: 1m39s, non-child: 1m39s, % non-child: 100.00%)
  818. - ConvertRowBatchTime: 3s890ms
  819. - PeakMemoryUsage: 0
  820. - RowsReturned: 211.30M (211298301)
  821. - RowsReturnedRate: 2.12 M/sec
  822. DataStreamReceiver:
  823. BytesReceived(4s000ms): 41.13 MB, 161.58 MB, 311.82 MB, 461.49 MB, 622.52 MB, 776.06 MB, 929.03 MB, 1.06 GB, 1.21 GB, 1.36 GB, 1.51 GB, 1.64 GB, 1.77 GB, 1.94 GB, 2.09 GB, 2.25 GB, 2.41 GB, 2.54 GB, 2.68 GB, 2.82 GB, 2.95 GB, 3.10 GB, 3.22 GB, 3.33 GB, 3.48 GB, 3.59 GB, 3.74 GB, 3.89 GB, 4.02 GB, 4.16 GB, 4.30 GB, 4.44 GB, 4.58 GB, 4.68 GB, 4.78 GB, 4.84 GB, 4.84 GB, 4.84 GB, 4.84 GB, 4.84 GB, 4.84 GB, 4.84 GB, 4.84 GB
  824. - BytesReceived: 4.84 GB (5201852371)
  825. - DeserializeRowBatchTimer: 21s138ms
  826. - FirstBatchArrivalWaitTime: 0.000ns
  827. - PeakMemoryUsage: 10.67 MB (11183104)
  828. - SendersBlockedTimer: 567.431ms
  829. - SendersBlockedTotalTimer(*): 1s587ms
  830. HASH_JOIN_NODE (id=3):(Total: 423.291us, non-child: 0.000ns, % non-child: 0.00%)
  831. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  832. - BuildRows: 260.82M (260824206)
  833. - BuildTime: 1m23s
  834. - NumHashTableBuildsSkipped: 0 (0)
  835. - PeakMemoryUsage: 43.75 GB (46976307456)
  836. - ProbeRows: 0 (0)
  837. - ProbeRowsPartitioned: 0 (0)
  838. - ProbeTime: 0.000ns
  839. - RowsReturned: 0 (0)
  840. - RowsReturnedRate: 0
  841. Buffer pool:
  842. - AllocTime: 14s282ms
  843. - CumulativeAllocationBytes: 48.13 GB (51684311040)
  844. - CumulativeAllocations: 21.07K (21075)
  845. - PeakReservation: 43.75 GB (46976204800)
  846. - PeakUnpinnedBytes: 4.76 GB (5108662272)
  847. - PeakUsedReservation: 43.75 GB (46976204800)
  848. - ReadIoBytes: 0
  849. - ReadIoOps: 0 (0)
  850. - ReadIoWaitTime: 0.000ns
  851. - WriteIoBytes: 4.76 GB (5108662272)
  852. - WriteIoOps: 2.44K (2436)
  853. - WriteIoWaitTime: 109.559ms
  854. Hash Join Builder (join_node_id=3):
  855. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled
  856. - BuildRowsPartitionTime: 1m22s
  857. - BuildRowsPartitioned: 260.82M (260824206)
  858. - HashBuckets: 402.65M (402653184)
  859. - HashCollisions: 0 (0)
  860. - HashTablesBuildTime: 31s463ms
  861. - LargestPartitionPercent: 6 (6)
  862. - MaxPartitionLevel: 0 (0)
  863. - NumRepartitions: 0 (0)
  864. - PartitionsCreated: 16 (16)
  865. - PeakMemoryUsage: 46.12 KB (47232)
  866. - RepartitionTime: 0.000ns
  867. - SpilledPartitions: 2 (2)
  868. EXCHANGE_NODE (id=5):(Total: 4m2s, non-child: 4m2s, % non-child: 100.00%)
  869. - ConvertRowBatchTime: 5s250ms
  870. - PeakMemoryUsage: 0
  871. - RowsReturned: 260.82M (260824206)
  872. - RowsReturnedRate: 1.08 M/sec
  873. DataStreamReceiver:
  874. BytesReceived(8s000ms): 160.95 MB, 536.70 MB, 889.68 MB, 1.21 GB, 1.52 GB, 1.87 GB, 2.17 GB, 2.47 GB, 2.76 GB, 3.08 GB, 3.38 GB, 3.69 GB, 3.99 GB, 4.30 GB, 4.61 GB, 4.89 GB, 5.18 GB, 5.49 GB, 5.89 GB, 6.27 GB, 6.66 GB, 7.07 GB, 7.45 GB, 7.84 GB, 8.23 GB, 8.58 GB, 8.91 GB, 9.20 GB, 9.51 GB, 9.80 GB, 10.09 GB, 10.38 GB, 10.69 GB, 11.01 GB, 11.29 GB, 11.57 GB, 11.85 GB, 12.14 GB, 12.41 GB, 12.69 GB, 12.97 GB, 13.12 GB, 13.16 GB, 13.16 GB, 13.16 GB
  875. - BytesReceived: 13.16 GB (14125460142)
  876. - DeserializeRowBatchTimer: 1m22s
  877. - FirstBatchArrivalWaitTime: 0.000ns
  878. - PeakMemoryUsage: 10.22 MB (10718985)
  879. - SendersBlockedTimer: 595.209ms
  880. - SendersBlockedTotalTimer(*): 2s206ms
  881. KUDU_SCAN_NODE (id=0):(Total: 1.755ms, non-child: 1.755ms, % non-child: 100.00%)
  882. BytesRead(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  883. - BytesRead: 0
  884. - KuduRemoteScanTokens: 0 (0)
  885. - NumScannerThreadsStarted: 2 (2)
  886. - PeakMemoryUsage: 31.33 MB (32856064)
  887. - RowsRead: 128.54K (128541)
  888. - RowsReturned: 0 (0)
  889. - RowsReturnedRate: 0
  890. - ScanRangesComplete: 0 (0)
  891. - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
  892. - ScannerThreadsTotalWallClockTime: 0.000ns
  893. - MaterializeTupleTime(*): 0.000ns
  894. - ScannerThreadsSysTime: 0.000ns
  895. - ScannerThreadsUserTime: 0.000ns
  896. - ScannerThreadsVoluntaryContextSwitches: 0 (0)
  897. - TotalKuduScanRoundTrips: 18 (18)
  898. - TotalReadThroughput: 0.00 /sec
  899. Instance 944de89e766071b4:207b37690000000a (host=tanuki.akainix.local:22000):(Total: 55.553ms, non-child: 0.000ns, % non-child: 0.00%)
  900. Hdfs split stats (<volume id>:<# splits>/<split lengths>):
  901. MemoryUsage(8s000ms): 693.07 MB, 2.35 GB, 4.20 GB, 5.96 GB, 7.73 GB, 9.61 GB, 11.34 GB, 13.15 GB, 14.87 GB, 16.61 GB, 18.25 GB, 19.75 GB, 21.21 GB, 22.82 GB, 24.44 GB, 26.01 GB, 27.55 GB, 29.05 GB, 31.45 GB, 33.97 GB, 36.54 GB, 39.08 GB, 41.49 GB, 43.34 GB, 44.46 GB, 45.44 GB, 46.28 GB, 47.01 GB, 47.85 GB, 48.68 GB, 49.52 GB, 50.37 GB, 51.18 GB, 52.04 GB, 52.90 GB, 53.78 GB, 54.58 GB, 55.31 GB, 56.07 GB, 56.93 GB, 57.73 GB, 58.48 GB, 60.21 GB, 62.16 GB, 63.51 GB
  902. ThreadUsage(8s000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2
  903. - AverageThreadTokens: 2.51
  904. - BloomFilterBytes: 0
  905. - PeakMemoryUsage: 64.01 GB (68733860680)
  906. - PeakReservation: 64.00 GB (68715282432)
  907. - PeakUsedReservation: 0
  908. - PerHostPeakMemUsage: 64.02 GB (68738097869)
  909. - RowsProduced: 0 (0)
  910. - TotalNetworkReceiveTime: 4m36s
  911. - TotalNetworkSendTime: 0.000ns
  912. - TotalStorageWaitTime: 1s422ms
  913. - TotalThreadsInvoluntaryContextSwitches: 345 (345)
  914. - TotalThreadsTotalWallClockTime: 3m5s
  915. - TotalThreadsSysTime: 31s516ms
  916. - TotalThreadsUserTime: 1m
  917. - TotalThreadsVoluntaryContextSwitches: 157.39K (157390)
  918. Fragment Instance Lifecycle Timings:
  919. - OpenTime: 0.000ns
  920. - ExecTreeOpenTime: 0.000ns
  921. - PrepareTime: 55.507ms
  922. - ExecTreePrepareTime: 853.372us
  923. DataStreamSender (dst_id=7):(Total: 262.774us, non-child: 262.774us, % non-child: 100.00%)
  924. - BytesSent: 0
  925. - NetworkThroughput(*): 0.00 /sec
  926. - OverallThroughput: 0.00 /sec
  927. - PeakMemoryUsage: 1.38 KB (1408)
  928. - RowsReturned: 0 (0)
  929. - SerializeBatchTime: 0.000ns
  930. - TransmitDataRPCTime: 0.000ns
  931. - UncompressedRowBatchSize: 0
  932. CodeGen:(Total: 746.932ms, non-child: 746.932ms, % non-child: 100.00%)
  933. - CodegenTime: 0.000ns
  934. - CompileTime: 276.386ms
  935. - LoadTime: 0.000ns
  936. - ModuleBitcodeSize: 1.96 MB (2050188)
  937. - NumFunctions: 86 (86)
  938. - NumInstructions: 5.24K (5242)
  939. - OptimizationTime: 430.216ms
  940. - PeakMemoryUsage: 2.56 MB (2683904)
  941. - PrepareTime: 39.252ms
  942. HASH_JOIN_NODE (id=4):(Total: 1.477ms, non-child: 180.579ms, % non-child: 100.00%)
  943. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  944. - BuildRows: 211.30M (211298301)
  945. - BuildTime: 1m33s
  946. - NumHashTableBuildsSkipped: 0 (0)
  947. - PeakMemoryUsage: 20.25 GB (21743401216)
  948. - ProbeRows: 0 (0)
  949. - ProbeRowsPartitioned: 0 (0)
  950. - ProbeTime: 0.000ns
  951. - RowsReturned: 0 (0)
  952. - RowsReturnedRate: 0
  953. Buffer pool:
  954. - AllocTime: 10s083ms
  955. - CumulativeAllocationBytes: 20.25 GB (21743271936)
  956. - CumulativeAllocations: 6.29K (6288)
  957. - PeakReservation: 20.25 GB (21743271936)
  958. - PeakUnpinnedBytes: 0
  959. - PeakUsedReservation: 20.25 GB (21743271936)
  960. - ReadIoBytes: 0
  961. - ReadIoOps: 0 (0)
  962. - ReadIoWaitTime: 0.000ns
  963. - WriteIoBytes: 0
  964. - WriteIoOps: 0 (0)
  965. - WriteIoWaitTime: 0.000ns
  966. Hash Join Builder (join_node_id=4):
  967. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  968. - BuildRowsPartitionTime: 49s382ms
  969. - BuildRowsPartitioned: 211.30M (211298301)
  970. - HashBuckets: 536.87M (536870912)
  971. - HashCollisions: 0 (0)
  972. - HashTablesBuildTime: 43s862ms
  973. - LargestPartitionPercent: 6 (6)
  974. - MaxPartitionLevel: 0 (0)
  975. - NumRepartitions: 0 (0)
  976. - PartitionsCreated: 16 (16)
  977. - PeakMemoryUsage: 55.12 KB (56448)
  978. - RepartitionTime: 0.000ns
  979. - SpilledPartitions: 0 (0)
  980. EXCHANGE_NODE (id=6):(Total: 1m30s, non-child: 1m30s, % non-child: 100.00%)
  981. - ConvertRowBatchTime: 3s438ms
  982. - PeakMemoryUsage: 0
  983. - RowsReturned: 211.30M (211298301)
  984. - RowsReturnedRate: 2.34 M/sec
  985. DataStreamReceiver:
  986. BytesReceived(4s000ms): 44.96 MB, 167.17 MB, 318.14 MB, 468.39 MB, 628.82 MB, 781.92 MB, 936.40 MB, 1.07 GB, 1.21 GB, 1.36 GB, 1.51 GB, 1.65 GB, 1.78 GB, 1.95 GB, 2.10 GB, 2.25 GB, 2.41 GB, 2.55 GB, 2.69 GB, 2.83 GB, 2.96 GB, 3.10 GB, 3.22 GB, 3.34 GB, 3.48 GB, 3.60 GB, 3.75 GB, 3.90 GB, 4.02 GB, 4.17 GB, 4.30 GB, 4.45 GB, 4.58 GB, 4.69 GB, 4.79 GB, 4.84 GB, 4.84 GB, 4.84 GB, 4.84 GB, 4.84 GB, 4.84 GB, 4.84 GB, 4.84 GB, 4.84 GB, 4.84 GB, 4.84 GB
  987. - BytesReceived: 4.84 GB (5201852371)
  988. - DeserializeRowBatchTimer: 26s228ms
  989. - FirstBatchArrivalWaitTime: 0.000ns
  990. - PeakMemoryUsage: 10.67 MB (11183104)
  991. - SendersBlockedTimer: 620.596ms
  992. - SendersBlockedTotalTimer(*): 1s798ms
  993. HASH_JOIN_NODE (id=3):(Total: 663.837us, non-child: 0.000ns, % non-child: 0.00%)
  994. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  995. - BuildRows: 260.82M (260824206)
  996. - BuildTime: 2m7s
  997. - NumHashTableBuildsSkipped: 0 (0)
  998. - PeakMemoryUsage: 43.75 GB (46972113152)
  999. - ProbeRows: 0 (0)
  1000. - ProbeRowsPartitioned: 0 (0)
  1001. - ProbeTime: 0.000ns
  1002. - RowsReturned: 0 (0)
  1003. - RowsReturnedRate: 0
  1004. Buffer pool:
  1005. - AllocTime: 47s897ms
  1006. - CumulativeAllocationBytes: 46.79 GB (50235179008)
  1007. - CumulativeAllocations: 20.89K (20894)
  1008. - PeakReservation: 43.75 GB (46972010496)
  1009. - PeakUnpinnedBytes: 4.76 GB (5108662272)
  1010. - PeakUsedReservation: 43.75 GB (46972010496)
  1011. - ReadIoBytes: 0
  1012. - ReadIoOps: 0 (0)
  1013. - ReadIoWaitTime: 0.000ns
  1014. - WriteIoBytes: 2.68 GB (2875195392)
  1015. - WriteIoOps: 1.37K (1371)
  1016. - WriteIoWaitTime: 225.994ms
  1017. Hash Join Builder (join_node_id=3):
  1018. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled
  1019. - BuildRowsPartitionTime: 2m7s
  1020. - BuildRowsPartitioned: 260.82M (260824206)
  1021. - HashBuckets: 335.54M (335544320)
  1022. - HashCollisions: 0 (0)
  1023. - HashTablesBuildTime: 32s720ms
  1024. - LargestPartitionPercent: 6 (6)
  1025. - MaxPartitionLevel: 0 (0)
  1026. - NumRepartitions: 0 (0)
  1027. - PartitionsCreated: 16 (16)
  1028. - PeakMemoryUsage: 46.12 KB (47232)
  1029. - RepartitionTime: 0.000ns
  1030. - SpilledPartitions: 2 (2)
  1031. EXCHANGE_NODE (id=5):(Total: 3m14s, non-child: 3m14s, % non-child: 100.00%)
  1032. - ConvertRowBatchTime: 4s480ms
  1033. - PeakMemoryUsage: 0
  1034. - RowsReturned: 260.82M (260824206)
  1035. - RowsReturnedRate: 1.34 M/sec
  1036. DataStreamReceiver:
  1037. BytesReceived(8s000ms): 168.95 MB, 543.87 MB, 897.78 MB, 1.21 GB, 1.53 GB, 1.87 GB, 2.18 GB, 2.48 GB, 2.77 GB, 3.09 GB, 3.39 GB, 3.69 GB, 3.99 GB, 4.31 GB, 4.62 GB, 4.89 GB, 5.19 GB, 5.50 GB, 5.90 GB, 6.28 GB, 6.67 GB, 7.07 GB, 7.45 GB, 7.85 GB, 8.24 GB, 8.59 GB, 8.92 GB, 9.20 GB, 9.52 GB, 9.81 GB, 10.10 GB, 10.39 GB, 10.69 GB, 11.02 GB, 11.29 GB, 11.58 GB, 11.86 GB, 12.15 GB, 12.42 GB, 12.70 GB, 12.98 GB, 13.12 GB, 13.16 GB, 13.16 GB, 13.16 GB
  1038. - BytesReceived: 13.16 GB (14125460142)
  1039. - DeserializeRowBatchTimer: 1m56s
  1040. - FirstBatchArrivalWaitTime: 0.000ns
  1041. - PeakMemoryUsage: 10.35 MB (10853238)
  1042. - SendersBlockedTimer: 664.724ms
  1043. - SendersBlockedTotalTimer(*): 1s867ms
  1044. KUDU_SCAN_NODE (id=0):(Total: 2.358ms, non-child: 2.358ms, % non-child: 100.00%)
  1045. BytesRead(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  1046. - BytesRead: 0
  1047. - KuduRemoteScanTokens: 0 (0)
  1048. - NumScannerThreadsStarted: 1 (1)
  1049. - PeakMemoryUsage: 17.46 MB (18313216)
  1050. - RowsRead: 69.58K (69581)
  1051. - RowsReturned: 0 (0)
  1052. - RowsReturnedRate: 0
  1053. - ScanRangesComplete: 1 (1)
  1054. - ScannerThreadsInvoluntaryContextSwitches: 1 (1)
  1055. - ScannerThreadsTotalWallClockTime: 1s446ms
  1056. - MaterializeTupleTime(*): 0.000ns
  1057. - ScannerThreadsSysTime: 10.014ms
  1058. - ScannerThreadsUserTime: 18.380ms
  1059. - ScannerThreadsVoluntaryContextSwitches: 15 (15)
  1060. - TotalKuduScanRoundTrips: 10 (10)
  1061. - TotalReadThroughput: 0.00 /sec
  1062. Instance 944de89e766071b4:207b376900000009 (host=ginyu.akainix.local:22000):(Total: 55.257ms, non-child: 0.000ns, % non-child: 0.00%)
  1063. Hdfs split stats (<volume id>:<# splits>/<split lengths>):
  1064. MemoryUsage(8s000ms): 685.86 MB, 2.33 GB, 4.18 GB, 5.95 GB, 7.72 GB, 9.59 GB, 11.33 GB, 13.14 GB, 14.86 GB, 16.60 GB, 18.24 GB, 19.75 GB, 21.20 GB, 22.80 GB, 24.43 GB, 26.00 GB, 27.54 GB, 29.08 GB, 31.82 GB, 34.50 GB, 37.32 GB, 40.26 GB, 42.24 GB, 43.34 GB, 44.47 GB, 45.44 GB, 46.28 GB, 47.02 GB, 47.86 GB, 48.68 GB, 49.52 GB, 50.38 GB, 51.18 GB, 52.05 GB, 52.90 GB, 53.78 GB, 54.58 GB, 55.31 GB, 56.07 GB, 56.94 GB, 57.74 GB, 58.44 GB, 60.16 GB, 62.16 GB, 63.56 GB
  1065. ThreadUsage(8s000ms): 4, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4
  1066. - AverageThreadTokens: 4.48
  1067. - BloomFilterBytes: 0
  1068. - PeakMemoryUsage: 64.01 GB (68727432008)
  1069. - PeakReservation: 63.98 GB (68694310912)
  1070. - PeakUsedReservation: 0
  1071. - PerHostPeakMemUsage: 64.01 GB (68727432008)
  1072. - RowsProduced: 0 (0)
  1073. - TotalNetworkReceiveTime: 4m35s
  1074. - TotalNetworkSendTime: 0.000ns
  1075. - TotalStorageWaitTime: 2s604ms
  1076. - TotalThreadsInvoluntaryContextSwitches: 256 (256)
  1077. - TotalThreadsTotalWallClockTime: 2m56s
  1078. - TotalThreadsSysTime: 29s136ms
  1079. - TotalThreadsUserTime: 57s278ms
  1080. - TotalThreadsVoluntaryContextSwitches: 156.44K (156437)
  1081. Fragment Instance Lifecycle Timings:
  1082. - OpenTime: 0.000ns
  1083. - ExecTreeOpenTime: 0.000ns
  1084. - PrepareTime: 55.209ms
  1085. - ExecTreePrepareTime: 674.690us
  1086. DataStreamSender (dst_id=7):(Total: 189.749us, non-child: 189.749us, % non-child: 100.00%)
  1087. - BytesSent: 0
  1088. - NetworkThroughput(*): 0.00 /sec
  1089. - OverallThroughput: 0.00 /sec
  1090. - PeakMemoryUsage: 1.38 KB (1408)
  1091. - RowsReturned: 0 (0)
  1092. - SerializeBatchTime: 0.000ns
  1093. - TransmitDataRPCTime: 0.000ns
  1094. - UncompressedRowBatchSize: 0
  1095. CodeGen:(Total: 679.855ms, non-child: 679.855ms, % non-child: 100.00%)
  1096. - CodegenTime: 0.000ns
  1097. - CompileTime: 232.344ms
  1098. - LoadTime: 0.000ns
  1099. - ModuleBitcodeSize: 1.96 MB (2050188)
  1100. - NumFunctions: 86 (86)
  1101. - NumInstructions: 5.24K (5242)
  1102. - OptimizationTime: 405.925ms
  1103. - PeakMemoryUsage: 2.56 MB (2683904)
  1104. - PrepareTime: 40.770ms
  1105. HASH_JOIN_NODE (id=4):(Total: 1.128ms, non-child: 186.051ms, % non-child: 100.00%)
  1106. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  1107. - BuildRows: 211.30M (211298301)
  1108. - BuildTime: 1m24s
  1109. - NumHashTableBuildsSkipped: 0 (0)
  1110. - PeakMemoryUsage: 20.25 GB (21743401216)
  1111. - ProbeRows: 0 (0)
  1112. - ProbeRowsPartitioned: 0 (0)
  1113. - ProbeTime: 0.000ns
  1114. - RowsReturned: 0 (0)
  1115. - RowsReturnedRate: 0
  1116. Buffer pool:
  1117. - AllocTime: 7s155ms
  1118. - CumulativeAllocationBytes: 20.25 GB (21743271936)
  1119. - CumulativeAllocations: 6.29K (6288)
  1120. - PeakReservation: 20.25 GB (21743271936)
  1121. - PeakUnpinnedBytes: 0
  1122. - PeakUsedReservation: 20.25 GB (21743271936)
  1123. - ReadIoBytes: 0
  1124. - ReadIoOps: 0 (0)
  1125. - ReadIoWaitTime: 0.000ns
  1126. - WriteIoBytes: 0
  1127. - WriteIoOps: 0 (0)
  1128. - WriteIoWaitTime: 0.000ns
  1129. Hash Join Builder (join_node_id=4):
  1130. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  1131. - BuildRowsPartitionTime: 48s948ms
  1132. - BuildRowsPartitioned: 211.30M (211298301)
  1133. - HashBuckets: 536.87M (536870912)
  1134. - HashCollisions: 0 (0)
  1135. - HashTablesBuildTime: 35s882ms
  1136. - LargestPartitionPercent: 6 (6)
  1137. - MaxPartitionLevel: 0 (0)
  1138. - NumRepartitions: 0 (0)
  1139. - PartitionsCreated: 16 (16)
  1140. - PeakMemoryUsage: 55.12 KB (56448)
  1141. - RepartitionTime: 0.000ns
  1142. - SpilledPartitions: 0 (0)
  1143. EXCHANGE_NODE (id=6):(Total: 1m30s, non-child: 1m30s, % non-child: 100.00%)
  1144. - ConvertRowBatchTime: 3s563ms
  1145. - PeakMemoryUsage: 0
  1146. - RowsReturned: 211.30M (211298301)
  1147. - RowsReturnedRate: 2.32 M/sec
  1148. DataStreamReceiver:
  1149. BytesReceived(4s000ms): 42.78 MB, 163.28 MB, 313.96 MB, 463.89 MB, 624.78 MB, 778.06 MB, 931.64 MB, 1.07 GB, 1.21 GB, 1.36 GB, 1.51 GB, 1.64 GB, 1.77 GB, 1.94 GB, 2.09 GB, 2.25 GB, 2.41 GB, 2.54 GB, 2.68 GB, 2.82 GB, 2.95 GB, 3.10 GB, 3.22 GB, 3.34 GB, 3.48 GB, 3.59 GB, 3.74 GB, 3.89 GB, 4.02 GB, 4.16 GB, 4.30 GB, 4.45 GB, 4.58 GB, 4.68 GB, 4.78 GB, 4.84 GB, 4.84 GB, 4.84 GB, 4.84 GB, 4.84 GB, 4.84 GB, 4.84 GB, 4.84 GB, 4.84 GB
  1150. - BytesReceived: 4.84 GB (5201852371)
  1151. - DeserializeRowBatchTimer: 24s750ms
  1152. - FirstBatchArrivalWaitTime: 0.000ns
  1153. - PeakMemoryUsage: 10.67 MB (11183104)
  1154. - SendersBlockedTimer: 547.154ms
  1155. - SendersBlockedTotalTimer(*): 1s508ms
  1156. HASH_JOIN_NODE (id=3):(Total: 519.702us, non-child: 0.000ns, % non-child: 0.00%)
  1157. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  1158. - BuildRows: 260.82M (260824206)
  1159. - BuildTime: 2m8s
  1160. - NumHashTableBuildsSkipped: 0 (0)
  1161. - PeakMemoryUsage: 43.73 GB (46951141632)
  1162. - ProbeRows: 0 (0)
  1163. - ProbeRowsPartitioned: 0 (0)
  1164. - ProbeTime: 0.000ns
  1165. - RowsReturned: 0 (0)
  1166. - RowsReturnedRate: 0
  1167. Buffer pool:
  1168. - AllocTime: 42s230ms
  1169. - CumulativeAllocationBytes: 46.11 GB (49505370112)
  1170. - CumulativeAllocations: 20.80K (20801)
  1171. - PeakReservation: 43.73 GB (46951038976)
  1172. - PeakUnpinnedBytes: 2.38 GB (2554331136)
  1173. - PeakUsedReservation: 43.73 GB (46951038976)
  1174. - ReadIoBytes: 0
  1175. - ReadIoOps: 0 (0)
  1176. - ReadIoWaitTime: 0.000ns
  1177. - WriteIoBytes: 2.38 GB (2554331136)
  1178. - WriteIoOps: 1.22K (1218)
  1179. - WriteIoWaitTime: 114.025ms
  1180. Hash Join Builder (join_node_id=3):
  1181. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled
  1182. - BuildRowsPartitionTime: 2m8s
  1183. - BuildRowsPartitioned: 260.82M (260824206)
  1184. - HashBuckets: 335.54M (335544320)
  1185. - HashCollisions: 0 (0)
  1186. - HashTablesBuildTime: 30s551ms
  1187. - LargestPartitionPercent: 6 (6)
  1188. - MaxPartitionLevel: 0 (0)
  1189. - NumRepartitions: 0 (0)
  1190. - PartitionsCreated: 16 (16)
  1191. - PeakMemoryUsage: 46.12 KB (47232)
  1192. - RepartitionTime: 0.000ns
  1193. - SpilledPartitions: 1 (1)
  1194. EXCHANGE_NODE (id=5):(Total: 3m13s, non-child: 3m13s, % non-child: 100.00%)
  1195. - ConvertRowBatchTime: 4s656ms
  1196. - PeakMemoryUsage: 0
  1197. - RowsReturned: 260.82M (260824206)
  1198. - RowsReturnedRate: 1.35 M/sec
  1199. DataStreamReceiver:
  1200. BytesReceived(8s000ms): 163.46 MB, 539.31 MB, 892.41 MB, 1.21 GB, 1.53 GB, 1.87 GB, 2.18 GB, 2.47 GB, 2.76 GB, 3.09 GB, 3.38 GB, 3.69 GB, 3.99 GB, 4.30 GB, 4.62 GB, 4.89 GB, 5.19 GB, 5.49 GB, 5.90 GB, 6.27 GB, 6.66 GB, 7.07 GB, 7.45 GB, 7.85 GB, 8.24 GB, 8.58 GB, 8.91 GB, 9.20 GB, 9.51 GB, 9.80 GB, 10.10 GB, 10.38 GB, 10.69 GB, 11.01 GB, 11.29 GB, 11.57 GB, 11.85 GB, 12.14 GB, 12.42 GB, 12.69 GB, 12.98 GB, 13.12 GB, 13.16 GB, 13.16 GB, 13.16 GB
  1201. - BytesReceived: 13.16 GB (14125460142)
  1202. - DeserializeRowBatchTimer: 1m56s
  1203. - FirstBatchArrivalWaitTime: 0.000ns
  1204. - PeakMemoryUsage: 10.40 MB (10906213)
  1205. - SendersBlockedTimer: 574.688ms
  1206. - SendersBlockedTotalTimer(*): 2s126ms
  1207. KUDU_SCAN_NODE (id=0):(Total: 1.978ms, non-child: 1.978ms, % non-child: 100.00%)
  1208. BytesRead(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  1209. - BytesRead: 0
  1210. - KuduRemoteScanTokens: 0 (0)
  1211. - NumScannerThreadsStarted: 2 (2)
  1212. - PeakMemoryUsage: 31.33 MB (32856064)
  1213. - RowsRead: 133.49K (133486)
  1214. - RowsReturned: 0 (0)
  1215. - RowsReturnedRate: 0
  1216. - ScanRangesComplete: 0 (0)
  1217. - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
  1218. - ScannerThreadsTotalWallClockTime: 0.000ns
  1219. - MaterializeTupleTime(*): 0.000ns
  1220. - ScannerThreadsSysTime: 0.000ns
  1221. - ScannerThreadsUserTime: 0.000ns
  1222. - ScannerThreadsVoluntaryContextSwitches: 0 (0)
  1223. - TotalKuduScanRoundTrips: 18 (18)
  1224. - TotalReadThroughput: 0.00 /sec
  1225. Averaged Fragment F01:(Total: 4m23s, non-child: 3m27s, % non-child: 78.54%)
  1226. split sizes: min: 0, max: 0, avg: 0, stddev: 0
  1227. completion times: min:3m12s max:5m32s mean: 4m23s stddev:1m4s
  1228. execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
  1229. num instances: 4
  1230. - AverageThreadTokens: 2.50
  1231. - BloomFilterBytes: 0
  1232. - PeakMemoryUsage: 36.46 MB (38229056)
  1233. - PeakReservation: 0
  1234. - PeakUsedReservation: 0
  1235. - PerHostPeakMemUsage: 51.59 GB (55391287704)
  1236. - RowsProduced: 65.21M (65206051)
  1237. - TotalNetworkReceiveTime: 0.000ns
  1238. - TotalNetworkSendTime: 3m20s
  1239. - TotalStorageWaitTime: 45s134ms
  1240. - TotalThreadsInvoluntaryContextSwitches: 497 (497)
  1241. - TotalThreadsTotalWallClockTime: 11m30s
  1242. - TotalThreadsSysTime: 17s606ms
  1243. - TotalThreadsUserTime: 1m6s
  1244. - TotalThreadsVoluntaryContextSwitches: 188.46K (188461)
  1245. Fragment Instance Lifecycle Timings:
  1246. - ExecTime: 4m23s
  1247. - ExecTreeExecTime: 513.282ms
  1248. - OpenTime: 946.899us
  1249. - ExecTreeOpenTime: 934.711us
  1250. - PrepareTime: 41.423ms
  1251. - ExecTreePrepareTime: 61.246us
  1252. DataStreamSender (dst_id=5):(Total: 56s209ms, non-child: 56s209ms, % non-child: 100.00%)
  1253. - BytesSent: 13.16 GB (14125460142)
  1254. - NetworkThroughput(*): 1.20 GB/sec
  1255. - OverallThroughput: 241.86 MB/sec
  1256. - PeakMemoryUsage: 5.06 KB (5184)
  1257. - RowsReturned: 65.21M (65206051)
  1258. - SerializeBatchTime: 45s081ms
  1259. - TransmitDataRPCTime: 11s108ms
  1260. - UncompressedRowBatchSize: 39.01 GB (41888841864)
  1261. CodeGen:(Total: 40.203ms, non-child: 40.203ms, % non-child: 100.00%)
  1262. - CodegenTime: 0.000ns
  1263. - CompileTime: 0.000ns
  1264. - LoadTime: 0.000ns
  1265. - ModuleBitcodeSize: 1.96 MB (2050188)
  1266. - NumFunctions: 0 (0)
  1267. - NumInstructions: 0 (0)
  1268. - OptimizationTime: 0.000ns
  1269. - PeakMemoryUsage: 0
  1270. - PrepareTime: 39.254ms
  1271. KUDU_SCAN_NODE (id=1):(Total: 376.197ms, non-child: 376.197ms, % non-child: 100.00%)
  1272. - BytesRead: 0
  1273. - KuduRemoteScanTokens: 0 (0)
  1274. - NumScannerThreadsStarted: 1 (1)
  1275. - PeakMemoryUsage: 36.35 MB (38112256)
  1276. - RowsRead: 65.21M (65206051)
  1277. - RowsReturned: 65.21M (65206051)
  1278. - RowsReturnedRate: 177.96 M/sec
  1279. - ScanRangesComplete: 1 (1)
  1280. - ScannerThreadsInvoluntaryContextSwitches: 260 (260)
  1281. - ScannerThreadsTotalWallClockTime: 7m6s
  1282. - MaterializeTupleTime(*): 357.090ms
  1283. - ScannerThreadsSysTime: 11s641ms
  1284. - ScannerThreadsUserTime: 19s441ms
  1285. - ScannerThreadsVoluntaryContextSwitches: 72.02K (72018)
  1286. - TotalKuduScanRoundTrips: 9.66K (9659)
  1287. - TotalReadThroughput: 0.00 /sec
  1288. Fragment F01:
  1289. Instance 944de89e766071b4:207b376900000002 (host=shun.akainix.local:22000):(Total: 5m32s, non-child: 4m18s, % non-child: 77.73%)
  1290. Hdfs split stats (<volume id>:<# splits>/<split lengths>):
  1291. MemoryUsage(8s000ms): 37.36 MB, 37.36 MB, 37.35 MB, 37.36 MB, 37.36 MB, 37.35 MB, 37.36 MB, 37.36 MB, 37.36 MB, 37.36 MB, 37.36 MB, 37.36 MB, 37.36 MB, 37.36 MB, 37.36 MB, 37.36 MB, 37.36 MB, 37.36 MB, 37.35 MB, 37.36 MB, 37.36 MB, 37.36 MB, 37.36 MB, 37.36 MB, 37.36 MB, 37.36 MB, 37.36 MB, 37.34 MB, 37.34 MB, 37.36 MB, 37.36 MB, 37.33 MB, 37.35 MB, 37.36 MB, 37.34 MB, 37.34 MB, 37.36 MB, 37.36 MB, 37.32 MB, 37.35 MB, 37.34 MB
  1292. ThreadUsage(8s000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3
  1293. - AverageThreadTokens: 3.00
  1294. - BloomFilterBytes: 0
  1295. - PeakMemoryUsage: 37.37 MB (39184448)
  1296. - PeakReservation: 0
  1297. - PeakUsedReservation: 0
  1298. - PerHostPeakMemUsage: 58.84 GB (63176284040)
  1299. - RowsProduced: 86.96M (86957146)
  1300. - TotalNetworkReceiveTime: 0.000ns
  1301. - TotalNetworkSendTime: 4m21s
  1302. - TotalStorageWaitTime: 58s570ms
  1303. - TotalThreadsInvoluntaryContextSwitches: 748 (748)
  1304. - TotalThreadsTotalWallClockTime: 16m37s
  1305. - TotalThreadsSysTime: 21s197ms
  1306. - TotalThreadsUserTime: 1m27s
  1307. - TotalThreadsVoluntaryContextSwitches: 245.64K (245637)
  1308. Fragment Instance Lifecycle Timings:
  1309. - ExecTime: 5m32s
  1310. - ExecTreeExecTime: 638.898ms
  1311. - OpenTime: 894.261us
  1312. - ExecTreeOpenTime: 885.249us
  1313. - PrepareTime: 35.508ms
  1314. - ExecTreePrepareTime: 59.248us
  1315. DataStreamSender (dst_id=5):(Total: 1m13s, non-child: 1m13s, % non-child: 100.00%)
  1316. - BytesSent: 17.54 GB (18837413904)
  1317. - NetworkThroughput(*): 1.12 GB/sec
  1318. - OverallThroughput: 244.01 MB/sec
  1319. - PeakMemoryUsage: 5.06 KB (5184)
  1320. - RowsReturned: 86.96M (86957146)
  1321. - SerializeBatchTime: 57s923ms
  1322. - TransmitDataRPCTime: 15s679ms
  1323. - UncompressedRowBatchSize: 52.03 GB (55862022220)
  1324. CodeGen:(Total: 34.499ms, non-child: 34.499ms, % non-child: 100.00%)
  1325. - CodegenTime: 0.000ns
  1326. - CompileTime: 0.000ns
  1327. - LoadTime: 0.000ns
  1328. - ModuleBitcodeSize: 1.96 MB (2050188)
  1329. - NumFunctions: 0 (0)
  1330. - NumInstructions: 0 (0)
  1331. - OptimizationTime: 0.000ns
  1332. - PeakMemoryUsage: 0
  1333. - PrepareTime: 33.743ms
  1334. KUDU_SCAN_NODE (id=1):(Total: 459.108ms, non-child: 459.108ms, % non-child: 100.00%)
  1335. BytesRead(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  1336. - BytesRead: 0
  1337. - KuduRemoteScanTokens: 0 (0)
  1338. - NumScannerThreadsStarted: 2 (2)
  1339. - PeakMemoryUsage: 37.36 MB (39171072)
  1340. - RowsRead: 86.96M (86957146)
  1341. - RowsReturned: 86.96M (86957146)
  1342. - RowsReturnedRate: 189.40 M/sec
  1343. - ScanRangesComplete: 2 (2)
  1344. - ScannerThreadsInvoluntaryContextSwitches: 442 (442)
  1345. - ScannerThreadsTotalWallClockTime: 11m4s
  1346. - MaterializeTupleTime(*): 436.279ms
  1347. - ScannerThreadsSysTime: 14s415ms
  1348. - ScannerThreadsUserTime: 26s243ms
  1349. - ScannerThreadsVoluntaryContextSwitches: 100.57K (100571)
  1350. - TotalKuduScanRoundTrips: 12.88K (12882)
  1351. - TotalReadThroughput: 0.00 /sec
  1352. Instance 944de89e766071b4:207b376900000003 (host=ginyu.akainix.local:22000):(Total: 5m23s, non-child: 4m4s, % non-child: 75.50%)
  1353. Hdfs split stats (<volume id>:<# splits>/<split lengths>):
  1354. MemoryUsage(8s000ms): 37.36 MB, 37.36 MB, 37.34 MB, 37.36 MB, 37.34 MB, 37.36 MB, 37.36 MB, 37.36 MB, 37.35 MB, 37.36 MB, 37.36 MB, 37.36 MB, 37.35 MB, 37.36 MB, 37.36 MB, 37.35 MB, 37.36 MB, 37.32 MB, 37.36 MB, 37.36 MB, 37.36 MB, 37.36 MB, 37.36 MB, 37.36 MB, 37.35 MB, 37.34 MB, 37.36 MB, 37.36 MB, 37.35 MB, 37.34 MB, 37.34 MB, 37.36 MB, 37.36 MB, 37.33 MB, 37.34 MB, 37.36 MB, 37.36 MB, 37.34 MB, 37.36 MB, 37.34 MB
  1355. ThreadUsage(8s000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3
  1356. - AverageThreadTokens: 3.00
  1357. - BloomFilterBytes: 0
  1358. - PeakMemoryUsage: 37.37 MB (39184448)
  1359. - PeakReservation: 0
  1360. - PeakUsedReservation: 0
  1361. - PerHostPeakMemUsage: 57.78 GB (62040344099)
  1362. - RowsProduced: 86.94M (86935979)
  1363. - TotalNetworkReceiveTime: 0.000ns
  1364. - TotalNetworkSendTime: 3m50s
  1365. - TotalStorageWaitTime: 1m4s
  1366. - TotalThreadsInvoluntaryContextSwitches: 613 (613)
  1367. - TotalThreadsTotalWallClockTime: 16m9s
  1368. - TotalThreadsSysTime: 27s083ms
  1369. - TotalThreadsUserTime: 1m33s
  1370. - TotalThreadsVoluntaryContextSwitches: 265.14K (265137)
  1371. Fragment Instance Lifecycle Timings:
  1372. - ExecTime: 5m23s
  1373. - ExecTreeExecTime: 777.571ms
  1374. - OpenTime: 1.294ms
  1375. - ExecTreeOpenTime: 1.282ms
  1376. - PrepareTime: 39.131ms
  1377. - ExecTreePrepareTime: 67.371us
  1378. DataStreamSender (dst_id=5):(Total: 1m18s, non-child: 1m18s, % non-child: 100.00%)
  1379. - BytesSent: 17.54 GB (18832394576)
  1380. - NetworkThroughput(*): 1.20 GB/sec
  1381. - OverallThroughput: 228.36 MB/sec
  1382. - PeakMemoryUsage: 5.06 KB (5184)
  1383. - RowsReturned: 86.94M (86935979)
  1384. - SerializeBatchTime: 1m3s
  1385. - TransmitDataRPCTime: 14s642ms
  1386. - UncompressedRowBatchSize: 52.01 GB (55847581884)
  1387. CodeGen:(Total: 37.983ms, non-child: 37.983ms, % non-child: 100.00%)
  1388. - CodegenTime: 0.000ns
  1389. - CompileTime: 0.000ns
  1390. - LoadTime: 0.000ns
  1391. - ModuleBitcodeSize: 1.96 MB (2050188)
  1392. - NumFunctions: 0 (0)
  1393. - NumInstructions: 0 (0)
  1394. - OptimizationTime: 0.000ns
  1395. - PeakMemoryUsage: 0
  1396. - PrepareTime: 37.053ms
  1397. KUDU_SCAN_NODE (id=1):(Total: 578.463ms, non-child: 578.463ms, % non-child: 100.00%)
  1398. BytesRead(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  1399. - BytesRead: 0
  1400. - KuduRemoteScanTokens: 0 (0)
  1401. - NumScannerThreadsStarted: 2 (2)
  1402. - PeakMemoryUsage: 37.16 MB (38964224)
  1403. - RowsRead: 86.94M (86935979)
  1404. - RowsReturned: 86.94M (86935979)
  1405. - RowsReturnedRate: 150.29 M/sec
  1406. - ScanRangesComplete: 2 (2)
  1407. - ScannerThreadsInvoluntaryContextSwitches: 320 (320)
  1408. - ScannerThreadsTotalWallClockTime: 10m45s
  1409. - MaterializeTupleTime(*): 553.671ms
  1410. - ScannerThreadsSysTime: 17s697ms
  1411. - ScannerThreadsUserTime: 27s084ms
  1412. - ScannerThreadsVoluntaryContextSwitches: 102.96K (102962)
  1413. - TotalKuduScanRoundTrips: 12.88K (12879)
  1414. - TotalReadThroughput: 0.00 /sec
  1415. Instance 944de89e766071b4:207b376900000000 (host=seiya.akainix.local:22000):(Total: 3m26s, non-child: 2m49s, % non-child: 82.09%)
  1416. Hdfs split stats (<volume id>:<# splits>/<split lengths>):
  1417. MemoryUsage(4s000ms): 37.06 MB, 37.06 MB, 36.98 MB, 37.02 MB, 37.06 MB, 37.02 MB, 37.06 MB, 36.98 MB, 37.02 MB, 36.94 MB, 36.83 MB, 37.06 MB, 37.02 MB, 36.98 MB, 36.98 MB, 37.06 MB, 37.06 MB, 37.06 MB, 37.02 MB, 37.06 MB, 36.94 MB, 37.03 MB, 37.06 MB, 37.02 MB, 37.06 MB, 36.98 MB, 37.03 MB, 37.02 MB, 37.02 MB, 37.02 MB, 37.06 MB, 37.02 MB, 37.06 MB, 37.06 MB, 37.02 MB, 37.06 MB, 37.06 MB, 37.06 MB, 37.02 MB, 37.06 MB, 37.02 MB, 37.06 MB, 37.06 MB, 37.06 MB, 36.98 MB, 37.06 MB, 36.98 MB, 36.91 MB, 37.03 MB, 36.96 MB, 36.91 MB
  1418. ThreadUsage(4s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2
  1419. - AverageThreadTokens: 2.00
  1420. - BloomFilterBytes: 0
  1421. - PeakMemoryUsage: 37.07 MB (38865984)
  1422. - PeakReservation: 0
  1423. - PeakUsedReservation: 0
  1424. - PerHostPeakMemUsage: 45.72 GB (49086527402)
  1425. - RowsProduced: 43.47M (43465279)
  1426. - TotalNetworkReceiveTime: 0.000ns
  1427. - TotalNetworkSendTime: 2m42s
  1428. - TotalStorageWaitTime: 29s661ms
  1429. - TotalThreadsInvoluntaryContextSwitches: 348 (348)
  1430. - TotalThreadsTotalWallClockTime: 6m52s
  1431. - TotalThreadsSysTime: 10s936ms
  1432. - TotalThreadsUserTime: 44s249ms
  1433. - TotalThreadsVoluntaryContextSwitches: 119.33K (119331)
  1434. Fragment Instance Lifecycle Timings:
  1435. - ExecTime: 3m26s
  1436. - ExecTreeExecTime: 317.169ms
  1437. - OpenTime: 776.415us
  1438. - ExecTreeOpenTime: 765.485us
  1439. - PrepareTime: 37.785ms
  1440. - ExecTreePrepareTime: 62.571us
  1441. DataStreamSender (dst_id=5):(Total: 36s769ms, non-child: 36s769ms, % non-child: 100.00%)
  1442. - BytesSent: 8.77 GB (9416031200)
  1443. - NetworkThroughput(*): 1.21 GB/sec
  1444. - OverallThroughput: 244.22 MB/sec
  1445. - PeakMemoryUsage: 5.06 KB (5184)
  1446. - RowsReturned: 43.47M (43465279)
  1447. - SerializeBatchTime: 29s509ms
  1448. - TransmitDataRPCTime: 7s249ms
  1449. - UncompressedRowBatchSize: 26.01 GB (27922701380)
  1450. CodeGen:(Total: 36.520ms, non-child: 36.520ms, % non-child: 100.00%)
  1451. - CodegenTime: 0.000ns
  1452. - CompileTime: 0.000ns
  1453. - LoadTime: 0.000ns
  1454. - ModuleBitcodeSize: 1.96 MB (2050188)
  1455. - NumFunctions: 0 (0)
  1456. - NumInstructions: 0 (0)
  1457. - OptimizationTime: 0.000ns
  1458. - PeakMemoryUsage: 0
  1459. - PrepareTime: 35.655ms
  1460. KUDU_SCAN_NODE (id=1):(Total: 232.389ms, non-child: 232.389ms, % non-child: 100.00%)
  1461. BytesRead(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  1462. - BytesRead: 0
  1463. - KuduRemoteScanTokens: 0 (0)
  1464. - NumScannerThreadsStarted: 1 (1)
  1465. - PeakMemoryUsage: 37.05 MB (38852608)
  1466. - RowsRead: 43.47M (43465279)
  1467. - RowsReturned: 43.47M (43465279)
  1468. - RowsReturnedRate: 187.04 M/sec
  1469. - ScanRangesComplete: 1 (1)
  1470. - ScannerThreadsInvoluntaryContextSwitches: 161 (161)
  1471. - ScannerThreadsTotalWallClockTime: 3m25s
  1472. - MaterializeTupleTime(*): 220.857ms
  1473. - ScannerThreadsSysTime: 7s252ms
  1474. - ScannerThreadsUserTime: 12s998ms
  1475. - ScannerThreadsVoluntaryContextSwitches: 42.24K (42244)
  1476. - TotalKuduScanRoundTrips: 6.44K (6439)
  1477. - TotalReadThroughput: 0.00 /sec
  1478. Instance 944de89e766071b4:207b376900000001 (host=tanuki.akainix.local:22000):(Total: 3m12s, non-child: 2m36s, % non-child: 81.22%)
  1479. Hdfs split stats (<volume id>:<# splits>/<split lengths>):
  1480. MemoryUsage(4s000ms): 34.02 MB, 34.02 MB, 34.02 MB, 34.02 MB, 34.02 MB, 34.02 MB, 33.98 MB, 33.94 MB, 34.02 MB, 34.02 MB, 34.02 MB, 33.84 MB, 33.98 MB, 33.94 MB, 33.98 MB, 33.91 MB, 34.02 MB, 34.02 MB, 33.98 MB, 34.00 MB, 34.02 MB, 34.02 MB, 34.02 MB, 34.02 MB, 33.94 MB, 34.02 MB, 33.94 MB, 33.98 MB, 34.02 MB, 33.92 MB, 33.94 MB, 33.96 MB, 34.00 MB, 33.97 MB, 34.02 MB, 33.98 MB, 34.02 MB, 34.02 MB, 34.02 MB, 33.94 MB, 34.02 MB, 33.98 MB, 33.94 MB, 34.02 MB, 33.98 MB, 33.94 MB, 33.98 MB, 30.98 MB
  1481. ThreadUsage(4s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1
  1482. - AverageThreadTokens: 2.00
  1483. - BloomFilterBytes: 0
  1484. - PeakMemoryUsage: 34.03 MB (35681344)
  1485. - PeakReservation: 0
  1486. - PeakUsedReservation: 0
  1487. - PerHostPeakMemUsage: 44.02 GB (47261995276)
  1488. - RowsProduced: 43.47M (43465802)
  1489. - TotalNetworkReceiveTime: 0.000ns
  1490. - TotalNetworkSendTime: 2m27s
  1491. - TotalStorageWaitTime: 27s658ms
  1492. - TotalThreadsInvoluntaryContextSwitches: 282 (282)
  1493. - TotalThreadsTotalWallClockTime: 6m23s
  1494. - TotalThreadsSysTime: 11s207ms
  1495. - TotalThreadsUserTime: 41s531ms
  1496. - TotalThreadsVoluntaryContextSwitches: 123.74K (123740)
  1497. Fragment Instance Lifecycle Timings:
  1498. - ExecTime: 3m12s
  1499. - ExecTreeExecTime: 319.492ms
  1500. - OpenTime: 822.356us
  1501. - ExecTreeOpenTime: 805.508us
  1502. - PrepareTime: 53.268ms
  1503. - ExecTreePrepareTime: 55.797us
  1504. DataStreamSender (dst_id=5):(Total: 35s798ms, non-child: 35s798ms, % non-child: 100.00%)
  1505. - BytesSent: 8.77 GB (9416000888)
  1506. - NetworkThroughput(*): 1.28 GB/sec
  1507. - OverallThroughput: 250.84 MB/sec
  1508. - PeakMemoryUsage: 5.06 KB (5184)
  1509. - RowsReturned: 43.47M (43465802)
  1510. - SerializeBatchTime: 28s926ms
  1511. - TransmitDataRPCTime: 6s860ms
  1512. - UncompressedRowBatchSize: 26.01 GB (27923061972)
  1513. CodeGen:(Total: 51.809ms, non-child: 51.809ms, % non-child: 100.00%)
  1514. - CodegenTime: 0.000ns
  1515. - CompileTime: 0.000ns
  1516. - LoadTime: 0.000ns
  1517. - ModuleBitcodeSize: 1.96 MB (2050188)
  1518. - NumFunctions: 0 (0)
  1519. - NumInstructions: 0 (0)
  1520. - OptimizationTime: 0.000ns
  1521. - PeakMemoryUsage: 0
  1522. - PrepareTime: 50.564ms
  1523. KUDU_SCAN_NODE (id=1):(Total: 234.828ms, non-child: 234.828ms, % non-child: 100.00%)
  1524. BytesRead(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  1525. - BytesRead: 0
  1526. - KuduRemoteScanTokens: 0 (0)
  1527. - NumScannerThreadsStarted: 1 (1)
  1528. - PeakMemoryUsage: 33.82 MB (35461120)
  1529. - RowsRead: 43.47M (43465802)
  1530. - RowsReturned: 43.47M (43465802)
  1531. - RowsReturnedRate: 185.10 M/sec
  1532. - ScanRangesComplete: 1 (1)
  1533. - ScannerThreadsInvoluntaryContextSwitches: 120 (120)
  1534. - ScannerThreadsTotalWallClockTime: 3m11s
  1535. - MaterializeTupleTime(*): 217.554ms
  1536. - ScannerThreadsSysTime: 7s199ms
  1537. - ScannerThreadsUserTime: 11s440ms
  1538. - ScannerThreadsVoluntaryContextSwitches: 42.30K (42295)
  1539. - TotalKuduScanRoundTrips: 6.44K (6439)
  1540. - TotalReadThroughput: 0.00 /sec
  1541. Averaged Fragment F02:(Total: 2m18s, non-child: 1m57s, % non-child: 84.95%)
  1542. split sizes: min: 0, max: 0, avg: 0, stddev: 0
  1543. completion times: min:2m14s max:2m21s mean: 2m18s stddev:2s793ms
  1544. execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
  1545. num instances: 4
  1546. - AverageThreadTokens: 2.25
  1547. - BloomFilterBytes: 0
  1548. - PeakMemoryUsage: 13.79 MB (14455008)
  1549. - PeakReservation: 0
  1550. - PeakUsedReservation: 0
  1551. - PerHostPeakMemUsage: 28.82 GB (30945190576)
  1552. - RowsProduced: 52.82M (52824575)
  1553. - TotalNetworkReceiveTime: 0.000ns
  1554. - TotalNetworkSendTime: 2m2s
  1555. - TotalStorageWaitTime: 14s065ms
  1556. - TotalThreadsInvoluntaryContextSwitches: 199 (199)
  1557. - TotalThreadsTotalWallClockTime: 5m12s
  1558. - TotalThreadsSysTime: 2s340ms
  1559. - TotalThreadsUserTime: 22s856ms
  1560. - TotalThreadsVoluntaryContextSwitches: 139.67K (139668)
  1561. Fragment Instance Lifecycle Timings:
  1562. - ExecTime: 2m18s
  1563. - ExecTreeExecTime: 381.433ms
  1564. - OpenTime: 1.394ms
  1565. - ExecTreeOpenTime: 1.383ms
  1566. - PrepareTime: 35.654ms
  1567. - ExecTreePrepareTime: 108.061us
  1568. DataStreamSender (dst_id=6):(Total: 20s537ms, non-child: 20s537ms, % non-child: 100.00%)
  1569. - BytesSent: 4.84 GB (5201852371)
  1570. - NetworkThroughput(*): 798.90 MB/sec
  1571. - OverallThroughput: 242.90 MB/sec
  1572. - PeakMemoryUsage: 14.22 KB (14560)
  1573. - RowsReturned: 52.82M (52824575)
  1574. - SerializeBatchTime: 14s283ms
  1575. - TransmitDataRPCTime: 6s238ms
  1576. - UncompressedRowBatchSize: 13.02 GB (13981473257)
  1577. CodeGen:(Total: 34.496ms, non-child: 34.496ms, % non-child: 100.00%)
  1578. - CodegenTime: 0.000ns
  1579. - CompileTime: 0.000ns
  1580. - LoadTime: 0.000ns
  1581. - ModuleBitcodeSize: 1.96 MB (2050188)
  1582. - NumFunctions: 0 (0)
  1583. - NumInstructions: 0 (0)
  1584. - OptimizationTime: 0.000ns
  1585. - PeakMemoryUsage: 0
  1586. - PrepareTime: 33.699ms
  1587. KUDU_SCAN_NODE (id=2):(Total: 295.591ms, non-child: 295.591ms, % non-child: 100.00%)
  1588. - BytesRead: 0
  1589. - KuduRemoteScanTokens: 0 (0)
  1590. - NumScannerThreadsStarted: 4 (4)
  1591. - PeakMemoryUsage: 13.73 MB (14395392)
  1592. - RowsRead: 52.82M (52824575)
  1593. - RowsReturned: 52.82M (52824575)
  1594. - RowsReturnedRate: 179.23 M/sec
  1595. - ScanRangesComplete: 4 (4)
  1596. - ScannerThreadsInvoluntaryContextSwitches: 90 (90)
  1597. - ScannerThreadsTotalWallClockTime: 2m53s
  1598. - MaterializeTupleTime(*): 281.652ms
  1599. - ScannerThreadsSysTime: 1s076ms
  1600. - ScannerThreadsUserTime: 7s405ms
  1601. - ScannerThreadsVoluntaryContextSwitches: 47.78K (47783)
  1602. - TotalKuduScanRoundTrips: 3.12K (3124)
  1603. - TotalReadThroughput: 0.00 /sec
  1604. Fragment F02:
  1605. Instance 944de89e766071b4:207b376900000005 (host=seiya.akainix.local:22000):(Total: 2m21s, non-child: 1m57s, % non-child: 83.32%)
  1606. Hdfs split stats (<volume id>:<# splits>/<split lengths>):
  1607. MemoryUsage(4s000ms): 14.06 MB, 14.06 MB, 14.06 MB, 14.05 MB, 13.95 MB, 13.88 MB, 13.83 MB, 13.83 MB, 13.83 MB, 13.83 MB, 13.83 MB, 13.83 MB, 13.83 MB, 13.81 MB, 13.69 MB, 13.83 MB, 13.79 MB, 13.81 MB, 13.83 MB, 13.83 MB, 13.79 MB, 13.83 MB, 13.83 MB, 13.79 MB, 13.83 MB, 13.83 MB, 13.81 MB, 13.82 MB, 13.82 MB, 13.81 MB, 13.74 MB, 13.81 MB, 13.79 MB, 13.83 MB, 13.79 MB
  1608. ThreadUsage(4s000ms): 4, 4, 4, 4, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2
  1609. - AverageThreadTokens: 2.26
  1610. - BloomFilterBytes: 0
  1611. - PeakMemoryUsage: 14.07 MB (14751968)
  1612. - PeakReservation: 0
  1613. - PeakUsedReservation: 0
  1614. - PerHostPeakMemUsage: 29.65 GB (31838671848)
  1615. - RowsProduced: 52.83M (52834349)
  1616. - TotalNetworkReceiveTime: 0.000ns
  1617. - TotalNetworkSendTime: 2m3s
  1618. - TotalStorageWaitTime: 14s169ms
  1619. - TotalThreadsInvoluntaryContextSwitches: 251 (251)
  1620. - TotalThreadsTotalWallClockTime: 5m19s
  1621. - TotalThreadsSysTime: 2s168ms
  1622. - TotalThreadsUserTime: 25s436ms
  1623. - TotalThreadsVoluntaryContextSwitches: 136.35K (136353)
  1624. Fragment Instance Lifecycle Timings:
  1625. - ExecTime: 2m21s
  1626. - ExecTreeExecTime: 394.978ms
  1627. - OpenTime: 1.292ms
  1628. - ExecTreeOpenTime: 1.281ms
  1629. - PrepareTime: 38.229ms
  1630. - ExecTreePrepareTime: 260.913us
  1631. DataStreamSender (dst_id=6):(Total: 23s242ms, non-child: 23s242ms, % non-child: 100.00%)
  1632. - BytesSent: 4.85 GB (5202748476)
  1633. - NetworkThroughput(*): 715.18 MB/sec
  1634. - OverallThroughput: 213.47 MB/sec
  1635. - PeakMemoryUsage: 14.22 KB (14560)
  1636. - RowsReturned: 52.83M (52834349)
  1637. - SerializeBatchTime: 16s290ms
  1638. - TransmitDataRPCTime: 6s937ms
  1639. - UncompressedRowBatchSize: 13.02 GB (13984130096)
  1640. CodeGen:(Total: 37.004ms, non-child: 37.004ms, % non-child: 100.00%)
  1641. - CodegenTime: 0.000ns
  1642. - CompileTime: 0.000ns
  1643. - LoadTime: 0.000ns
  1644. - ModuleBitcodeSize: 1.96 MB (2050188)
  1645. - NumFunctions: 0 (0)
  1646. - NumInstructions: 0 (0)
  1647. - OptimizationTime: 0.000ns
  1648. - PeakMemoryUsage: 0
  1649. - PrepareTime: 36.171ms
  1650. KUDU_SCAN_NODE (id=2):(Total: 304.196ms, non-child: 304.196ms, % non-child: 100.00%)
  1651. BytesRead(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  1652. - BytesRead: 0
  1653. - KuduRemoteScanTokens: 0 (0)
  1654. - NumScannerThreadsStarted: 4 (4)
  1655. - PeakMemoryUsage: 14.05 MB (14729216)
  1656. - RowsRead: 52.83M (52834349)
  1657. - RowsReturned: 52.83M (52834349)
  1658. - RowsReturnedRate: 173.68 M/sec
  1659. - ScanRangesComplete: 4 (4)
  1660. - ScannerThreadsInvoluntaryContextSwitches: 109 (109)
  1661. - ScannerThreadsTotalWallClockTime: 2m58s
  1662. - MaterializeTupleTime(*): 289.587ms
  1663. - ScannerThreadsSysTime: 1s059ms
  1664. - ScannerThreadsUserTime: 8s152ms
  1665. - ScannerThreadsVoluntaryContextSwitches: 47.86K (47860)
  1666. - TotalKuduScanRoundTrips: 3.12K (3124)
  1667. - TotalReadThroughput: 0.00 /sec
  1668. Instance 944de89e766071b4:207b376900000004 (host=tanuki.akainix.local:22000):(Total: 2m21s, non-child: 2m1s, % non-child: 86.21%)
  1669. Hdfs split stats (<volume id>:<# splits>/<split lengths>):
  1670. MemoryUsage(4s000ms): 12.93 MB, 12.93 MB, 12.93 MB, 12.89 MB, 12.80 MB, 12.70 MB, 12.70 MB, 12.66 MB, 12.70 MB, 12.70 MB, 12.69 MB, 12.70 MB, 12.63 MB, 12.69 MB, 12.70 MB, 12.70 MB, 12.69 MB, 12.70 MB, 12.68 MB, 12.63 MB, 12.70 MB, 12.70 MB, 12.69 MB, 12.70 MB, 12.69 MB, 12.69 MB, 12.70 MB, 12.70 MB, 12.69 MB, 12.56 MB, 12.69 MB, 12.64 MB, 12.69 MB, 12.69 MB, 12.67 MB
  1671. ThreadUsage(4s000ms): 4, 4, 4, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2
  1672. - AverageThreadTokens: 2.24
  1673. - BloomFilterBytes: 0
  1674. - PeakMemoryUsage: 12.94 MB (13564128)
  1675. - PeakReservation: 0
  1676. - PeakUsedReservation: 0
  1677. - PerHostPeakMemUsage: 29.13 GB (31274993469)
  1678. - RowsProduced: 52.82M (52816362)
  1679. - TotalNetworkReceiveTime: 0.000ns
  1680. - TotalNetworkSendTime: 2m6s
  1681. - TotalStorageWaitTime: 14s559ms
  1682. - TotalThreadsInvoluntaryContextSwitches: 181 (181)
  1683. - TotalThreadsTotalWallClockTime: 5m16s
  1684. - TotalThreadsSysTime: 2s465ms
  1685. - TotalThreadsUserTime: 20s708ms
  1686. - TotalThreadsVoluntaryContextSwitches: 143.29K (143289)
  1687. Fragment Instance Lifecycle Timings:
  1688. - ExecTime: 2m21s
  1689. - ExecTreeExecTime: 365.139ms
  1690. - OpenTime: 1.204ms
  1691. - ExecTreeOpenTime: 1.192ms
  1692. - PrepareTime: 33.384ms
  1693. - ExecTreePrepareTime: 50.863us
  1694. DataStreamSender (dst_id=6):(Total: 19s158ms, non-child: 19s158ms, % non-child: 100.00%)
  1695. - BytesSent: 4.84 GB (5201094588)
  1696. - NetworkThroughput(*): 860.41 MB/sec
  1697. - OverallThroughput: 258.90 MB/sec
  1698. - PeakMemoryUsage: 14.22 KB (14560)
  1699. - RowsReturned: 52.82M (52816362)
  1700. - SerializeBatchTime: 13s378ms
  1701. - TransmitDataRPCTime: 5s764ms
  1702. - UncompressedRowBatchSize: 13.02 GB (13979317400)
  1703. CodeGen:(Total: 31.968ms, non-child: 31.968ms, % non-child: 100.00%)
  1704. - CodegenTime: 0.000ns
  1705. - CompileTime: 0.000ns
  1706. - LoadTime: 0.000ns
  1707. - ModuleBitcodeSize: 1.96 MB (2050188)
  1708. - NumFunctions: 0 (0)
  1709. - NumInstructions: 0 (0)
  1710. - OptimizationTime: 0.000ns
  1711. - PeakMemoryUsage: 0
  1712. - PrepareTime: 31.218ms
  1713. KUDU_SCAN_NODE (id=2):(Total: 285.555ms, non-child: 285.555ms, % non-child: 100.00%)
  1714. BytesRead(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  1715. - BytesRead: 0
  1716. - KuduRemoteScanTokens: 0 (0)
  1717. - NumScannerThreadsStarted: 4 (4)
  1718. - PeakMemoryUsage: 12.91 MB (13541376)
  1719. - RowsRead: 52.82M (52816362)
  1720. - RowsReturned: 52.82M (52816362)
  1721. - RowsReturnedRate: 184.96 M/sec
  1722. - ScanRangesComplete: 4 (4)
  1723. - ScannerThreadsInvoluntaryContextSwitches: 83 (83)
  1724. - ScannerThreadsTotalWallClockTime: 2m55s
  1725. - MaterializeTupleTime(*): 272.206ms
  1726. - ScannerThreadsSysTime: 1s089ms
  1727. - ScannerThreadsUserTime: 6s408ms
  1728. - ScannerThreadsVoluntaryContextSwitches: 48.13K (48134)
  1729. - TotalKuduScanRoundTrips: 3.12K (3123)
  1730. - TotalReadThroughput: 0.00 /sec
  1731. Instance 944de89e766071b4:207b376900000007 (host=shun.akainix.local:22000):(Total: 2m17s, non-child: 1m57s, % non-child: 85.35%)
  1732. Hdfs split stats (<volume id>:<# splits>/<split lengths>):
  1733. MemoryUsage(4s000ms): 14.05 MB, 14.06 MB, 14.06 MB, 14.03 MB, 13.95 MB, 13.85 MB, 13.81 MB, 13.83 MB, 13.82 MB, 13.81 MB, 13.83 MB, 13.81 MB, 13.83 MB, 13.83 MB, 13.83 MB, 13.83 MB, 13.81 MB, 13.83 MB, 13.83 MB, 13.78 MB, 13.83 MB, 13.81 MB, 13.79 MB, 13.81 MB, 13.83 MB, 13.83 MB, 13.81 MB, 13.82 MB, 13.79 MB, 13.81 MB, 13.83 MB, 13.83 MB, 13.83 MB, 13.83 MB
  1734. ThreadUsage(4s000ms): 4, 4, 4, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2
  1735. - AverageThreadTokens: 2.25
  1736. - BloomFilterBytes: 0
  1737. - PeakMemoryUsage: 14.07 MB (14751968)
  1738. - PeakReservation: 0
  1739. - PeakUsedReservation: 0
  1740. - PerHostPeakMemUsage: 28.49 GB (30589081092)
  1741. - RowsProduced: 52.83M (52826863)
  1742. - TotalNetworkReceiveTime: 0.000ns
  1743. - TotalNetworkSendTime: 2m2s
  1744. - TotalStorageWaitTime: 12s816ms
  1745. - TotalThreadsInvoluntaryContextSwitches: 198 (198)
  1746. - TotalThreadsTotalWallClockTime: 5m10s
  1747. - TotalThreadsSysTime: 2s114ms
  1748. - TotalThreadsUserTime: 23s035ms
  1749. - TotalThreadsVoluntaryContextSwitches: 137.83K (137833)
  1750. Fragment Instance Lifecycle Timings:
  1751. - ExecTime: 2m17s
  1752. - ExecTreeExecTime: 365.577ms
  1753. - OpenTime: 1.185ms
  1754. - ExecTreeOpenTime: 1.175ms
  1755. - PrepareTime: 34.420ms
  1756. - ExecTreePrepareTime: 61.971us
  1757. DataStreamSender (dst_id=6):(Total: 19s805ms, non-child: 19s805ms, % non-child: 100.00%)
  1758. - BytesSent: 4.84 GB (5202017108)
  1759. - NetworkThroughput(*): 823.86 MB/sec
  1760. - OverallThroughput: 250.49 MB/sec
  1761. - PeakMemoryUsage: 14.22 KB (14560)
  1762. - RowsReturned: 52.83M (52826863)
  1763. - SerializeBatchTime: 13s765ms
  1764. - TransmitDataRPCTime: 6s021ms
  1765. - UncompressedRowBatchSize: 13.02 GB (13982026964)
  1766. CodeGen:(Total: 33.551ms, non-child: 33.551ms, % non-child: 100.00%)
  1767. - CodegenTime: 0.000ns
  1768. - CompileTime: 0.000ns
  1769. - LoadTime: 0.000ns
  1770. - ModuleBitcodeSize: 1.96 MB (2050188)
  1771. - NumFunctions: 0 (0)
  1772. - NumInstructions: 0 (0)
  1773. - OptimizationTime: 0.000ns
  1774. - PeakMemoryUsage: 0
  1775. - PrepareTime: 32.776ms
  1776. KUDU_SCAN_NODE (id=2):(Total: 275.813ms, non-child: 275.813ms, % non-child: 100.00%)
  1777. BytesRead(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  1778. - BytesRead: 0
  1779. - KuduRemoteScanTokens: 0 (0)
  1780. - NumScannerThreadsStarted: 4 (4)
  1781. - PeakMemoryUsage: 13.98 MB (14655488)
  1782. - RowsRead: 52.83M (52826863)
  1783. - RowsReturned: 52.83M (52826863)
  1784. - RowsReturnedRate: 191.53 M/sec
  1785. - ScanRangesComplete: 4 (4)
  1786. - ScannerThreadsInvoluntaryContextSwitches: 95 (95)
  1787. - ScannerThreadsTotalWallClockTime: 2m52s
  1788. - MaterializeTupleTime(*): 262.862ms
  1789. - ScannerThreadsSysTime: 1s009ms
  1790. - ScannerThreadsUserTime: 7s745ms
  1791. - ScannerThreadsVoluntaryContextSwitches: 48.05K (48046)
  1792. - TotalKuduScanRoundTrips: 3.12K (3125)
  1793. - TotalReadThroughput: 0.00 /sec
  1794. Instance 944de89e766071b4:207b376900000006 (host=ginyu.akainix.local:22000):(Total: 2m14s, non-child: 1m54s, % non-child: 84.93%)
  1795. Hdfs split stats (<volume id>:<# splits>/<split lengths>):
  1796. MemoryUsage(4s000ms): 14.06 MB, 14.06 MB, 14.06 MB, 14.03 MB, 13.95 MB, 13.83 MB, 13.82 MB, 13.81 MB, 13.82 MB, 13.79 MB, 13.83 MB, 13.83 MB, 13.83 MB, 13.82 MB, 13.83 MB, 13.79 MB, 13.79 MB, 13.83 MB, 13.78 MB, 13.83 MB, 13.83 MB, 13.83 MB, 13.82 MB, 13.83 MB, 13.83 MB, 13.78 MB, 13.83 MB, 13.83 MB, 13.83 MB, 13.81 MB, 13.83 MB, 13.78 MB, 13.81 MB
  1797. ThreadUsage(4s000ms): 4, 4, 4, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2
  1798. - AverageThreadTokens: 2.26
  1799. - BloomFilterBytes: 0
  1800. - PeakMemoryUsage: 14.07 MB (14751968)
  1801. - PeakReservation: 0
  1802. - PeakUsedReservation: 0
  1803. - PerHostPeakMemUsage: 28.01 GB (30078015895)
  1804. - RowsProduced: 52.82M (52820727)
  1805. - TotalNetworkReceiveTime: 0.000ns
  1806. - TotalNetworkSendTime: 1m59s
  1807. - TotalStorageWaitTime: 14s715ms
  1808. - TotalThreadsInvoluntaryContextSwitches: 167 (167)
  1809. - TotalThreadsTotalWallClockTime: 5m4s
  1810. - TotalThreadsSysTime: 2s612ms
  1811. - TotalThreadsUserTime: 22s247ms
  1812. - TotalThreadsVoluntaryContextSwitches: 141.20K (141199)
  1813. Fragment Instance Lifecycle Timings:
  1814. - ExecTime: 2m14s
  1815. - ExecTreeExecTime: 400.038ms
  1816. - OpenTime: 1.896ms
  1817. - ExecTreeOpenTime: 1.884ms
  1818. - PrepareTime: 36.585ms
  1819. - ExecTreePrepareTime: 58.500us
  1820. DataStreamSender (dst_id=6):(Total: 19s943ms, non-child: 19s943ms, % non-child: 100.00%)
  1821. - BytesSent: 4.84 GB (5201549312)
  1822. - NetworkThroughput(*): 796.14 MB/sec
  1823. - OverallThroughput: 248.73 MB/sec
  1824. - PeakMemoryUsage: 14.22 KB (14560)
  1825. - RowsReturned: 52.82M (52820727)
  1826. - SerializeBatchTime: 13s698ms
  1827. - TransmitDataRPCTime: 6s230ms
  1828. - UncompressedRowBatchSize: 13.02 GB (13980418568)
  1829. CodeGen:(Total: 35.463ms, non-child: 35.463ms, % non-child: 100.00%)
  1830. - CodegenTime: 0.000ns
  1831. - CompileTime: 0.000ns
  1832. - LoadTime: 0.000ns
  1833. - ModuleBitcodeSize: 1.96 MB (2050188)
  1834. - NumFunctions: 0 (0)
  1835. - NumInstructions: 0 (0)
  1836. - OptimizationTime: 0.000ns
  1837. - PeakMemoryUsage: 0
  1838. - PrepareTime: 34.631ms
  1839. KUDU_SCAN_NODE (id=2):(Total: 316.797ms, non-child: 316.797ms, % non-child: 100.00%)
  1840. BytesRead(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  1841. - BytesRead: 0
  1842. - KuduRemoteScanTokens: 0 (0)
  1843. - NumScannerThreadsStarted: 4 (4)
  1844. - PeakMemoryUsage: 13.98 MB (14655488)
  1845. - RowsRead: 52.82M (52820727)
  1846. - RowsReturned: 52.82M (52820727)
  1847. - RowsReturnedRate: 166.73 M/sec
  1848. - ScanRangesComplete: 4 (4)
  1849. - ScannerThreadsInvoluntaryContextSwitches: 76 (76)
  1850. - ScannerThreadsTotalWallClockTime: 2m49s
  1851. - MaterializeTupleTime(*): 301.953ms
  1852. - ScannerThreadsSysTime: 1s149ms
  1853. - ScannerThreadsUserTime: 7s315ms
  1854. - ScannerThreadsVoluntaryContextSwitches: 47.09K (47095)
  1855. - TotalKuduScanRoundTrips: 3.12K (3124)
  1856. - TotalReadThroughput: 0.00 /sec
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!