Guest User

Untitled

a guest
Aug 19th, 2018
245
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
  1.  
  2.  
  3. Query (id=984ea1ea895ca2cf:a12d79aa00000000):
  4. Summary:
  5. Session ID: 6b47c6050e2bebca:644e2b83aa0ac4b0
  6. Session Type: BEESWAX
  7. Start Time: 2018-08-16 01:24:20.196188000
  8. End Time: 2018-08-16 01:33:46.044764000
  9. Query Type: QUERY
  10. Query State: FINISHED
  11. Query Status: OK
  12. Impala Version: impalad version 2.12.0-cdh5.15.0 RELEASE (build 23f574543323301846b41fa5433690df32efe085)
  13. User: root
  14. Connected User: root
  15. Delegated User:
  16. Network Address: 10.0.9.3:55616
  17. Default Db: default
  18. Sql Statement: SELECT pp.event_id, ts.x, ts.y, ts.z, ts.tx, ts.ty, ts.qOverP, pp.`track_track_id` AS track_id FROM protoparticles_16 AS pp, track_16 AS tr, track_state_16 AS ts WHERE pp.track_track_id IS NOT NULL AND tr.type = 3 AND pp.hasMuonPIDStatus = true AND pp.muonPID_IsMuon = true AND (tr.CloneDist IS NULL OR tr.CloneDist > 5000) AND ABS(ts.qOverP) > 1e-20 AND tr.chi2PerDoF * tr.nDoF > 0.0 AND pp.event_id = tr.event_id AND pp.track_track_id = tr.track_id AND ts.event_id = pp.event_id AND ts.track_id = pp.track_track_id AND ts.`location` = 1
  19. Coordinator: slave-cn02:22000
  20. Query Options (set by configuration):
  21. Query Options (set by configuration and planner): MT_DOP=0
  22. Plan:
  23. ----------------
  24. Max Per-Host Resource Reservation: Memory=50.50MB
  25. Per-Host Resource Estimates: Memory=1.34GB
  26.  
  27. F04:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
  28. | Per-Host Resources: mem-estimate=0B mem-reservation=0B
  29. PLAN-ROOT SINK
  30. | mem-estimate=0B mem-reservation=0B
  31. |
  32. 08:EXCHANGE [UNPARTITIONED]
  33. | mem-estimate=0B mem-reservation=0B
  34. | tuple-ids=1,2,0 row-size=102B cardinality=19071
  35. |
  36. F03:PLAN FRAGMENT [HASH(tr.event_id,tr.track_id)] hosts=6 instances=6
  37. Per-Host Resources: mem-estimate=10.50MB mem-reservation=10.50MB runtime-filters-memory=2.00MB
  38. 04:HASH JOIN [INNER JOIN, PARTITIONED]
  39. | hash predicates: tr.event_id = pp.event_id, tr.track_id = pp.track_track_id
  40. | fk/pk conjuncts: tr.event_id = pp.event_id, tr.track_id = pp.track_track_id
  41. | runtime filters: RF000[bloom] <- pp.event_id, RF001[bloom] <- pp.track_track_id
  42. | mem-estimate=8.50MB mem-reservation=8.50MB spill-buffer=512.00KB
  43. | tuple-ids=1,2,0 row-size=102B cardinality=19071
  44. |
  45. |--07:EXCHANGE [HASH(pp.event_id,pp.track_track_id)]
  46. | | mem-estimate=0B mem-reservation=0B
  47. | | tuple-ids=2,0 row-size=70B cardinality=467130
  48. | |
  49. | F01:PLAN FRAGMENT [RANDOM] hosts=6 instances=6
  50. | Per-Host Resources: mem-estimate=721.01MB mem-reservation=38.00MB runtime-filters-memory=4.00MB
  51. | 03:HASH JOIN [INNER JOIN, BROADCAST]
  52. | | hash predicates: ts.event_id = pp.event_id, ts.track_id = pp.track_track_id
  53. | | fk/pk conjuncts: ts.event_id = pp.event_id, ts.track_id = pp.track_track_id
  54. | | runtime filters: RF004[bloom] <- pp.event_id, RF005[bloom] <- pp.track_track_id
  55. | | mem-estimate=69.01MB mem-reservation=34.00MB spill-buffer=2.00MB
  56. | | tuple-ids=2,0 row-size=70B cardinality=467130
  57. | |
  58. | |--05:EXCHANGE [BROADCAST]
  59. | | | mem-estimate=0B mem-reservation=0B
  60. | | | tuple-ids=0 row-size=10B cardinality=6578104
  61. | | |
  62. | | F02:PLAN FRAGMENT [RANDOM] hosts=6 instances=6
  63. | | Per-Host Resources: mem-estimate=256.00MB mem-reservation=0B
  64. | | 00:SCAN HDFS [default.protoparticles_16 pp, RANDOM]
  65. | | partitions=1/1 files=32 size=1.71GB
  66. | | predicates: pp.track_track_id IS NOT NULL, pp.hasMuonPIDStatus = TRUE, pp.muonPID_IsMuon = TRUE
  67. | | stored statistics:
  68. | | table: rows=117208496 size=1.71GB
  69. | | columns: all
  70. | | extrapolated-rows=disabled
  71. | | parquet statistics predicates: pp.hasMuonPIDStatus = TRUE, pp.muonPID_IsMuon = TRUE
  72. | | parquet dictionary predicates: pp.track_track_id IS NOT NULL, pp.hasMuonPIDStatus = TRUE, pp.muonPID_IsMuon = TRUE
  73. | | mem-estimate=256.00MB mem-reservation=0B
  74. | | tuple-ids=0 row-size=10B cardinality=6578104
  75. | |
  76. | 02:SCAN HDFS [default.track_state_16 ts, RANDOM]
  77. | partitions=1/1 files=379 size=22.98GB
  78. | predicates: ts.`location` = 1, ts.track_id IS NOT NULL, abs(ts.qOverP) > 1E-20
  79. | runtime filters: RF004[bloom] -> ts.event_id, RF005[bloom] -> ts.track_id
  80. | stored statistics:
  81. | table: rows=314739136 size=22.98GB
  82. | columns: all
  83. | extrapolated-rows=disabled
  84. | parquet statistics predicates: ts.`location` = 1
  85. | parquet dictionary predicates: ts.`location` = 1, ts.track_id IS NOT NULL, abs(ts.qOverP) > 1E-20
  86. | mem-estimate=648.00MB mem-reservation=0B
  87. | tuple-ids=2 row-size=60B cardinality=15736957
  88. |
  89. 06:EXCHANGE [HASH(tr.event_id,tr.track_id)]
  90. | mem-estimate=0B mem-reservation=0B
  91. | tuple-ids=1 row-size=32B cardinality=6541816
  92. |
  93. F00:PLAN FRAGMENT [RANDOM] hosts=6 instances=6
  94. Per-Host Resources: mem-estimate=386.00MB mem-reservation=2.00MB runtime-filters-memory=2.00MB
  95. 01:SCAN HDFS [default.track_16 tr, RANDOM]
  96. partitions=1/1 files=65 size=3.41GB
  97. predicates: tr.type = 3, tr.track_id IS NOT NULL, (tr.CloneDist IS NULL OR tr.CloneDist > 5000), tr.chi2PerDoF * tr.nDoF > 0.0
  98. runtime filters: RF000[bloom] -> tr.event_id, RF001[bloom] -> tr.track_id
  99. stored statistics:
  100. table: rows=160241120 size=3.41GB
  101. columns: all
  102. extrapolated-rows=disabled
  103. parquet statistics predicates: tr.type = 3
  104. parquet dictionary predicates: tr.type = 3, tr.track_id IS NOT NULL
  105. mem-estimate=384.00MB mem-reservation=0B
  106. tuple-ids=1 row-size=32B cardinality=6541816
  107. ----------------
  108. Estimated Per-Host Mem: 1440226536
  109. Per Host Min Reservation: slave-cn02:22000(50.50 MB) slave-cn03:22000(50.50 MB) slave-cn04:22000(50.50 MB) slave-cn05:22000(50.50 MB) slave-cn06:22000(50.50 MB) slave-cn07:22000(50.50 MB)
  110. Request Pool: root.root
  111. Admission result: Admitted immediately
  112. ExecSummary:
  113. Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail
  114. -------------------------------------------------------------------------------------------------------------------------------------
  115. 08:EXCHANGE 1 96.004ms 96.004ms 2.73M 19.07K 12.99 MB 0 UNPARTITIONED
  116. 04:HASH JOIN 6 1s220ms 1s572ms 2.73M 19.07K 53.07 MB 8.50 MB INNER JOIN, PARTITIONED
  117. |--07:EXCHANGE 6 16.000ms 28.001ms 2.76M 467.13K 272.00 KB 0 HASH(pp.event_id,pp.track_track_id)
  118. | 03:HASH JOIN 6 2s416ms 2s480ms 2.76M 467.13K 192.40 MB 69.01 MB INNER JOIN, BROADCAST
  119. | |--05:EXCHANGE 6 59.336ms 68.003ms 3.68M 6.58M 12.70 MB 0 BROADCAST
  120. | | 00:SCAN HDFS 6 156.673ms 188.010ms 3.68M 6.58M 21.22 MB 256.00 MB default.protoparticles_16 pp
  121. | 02:SCAN HDFS 6 2s374ms 3s368ms 98.47M 15.74M 1.58 GB 648.00 MB default.track_state_16 ts
  122. 06:EXCHANGE 6 139.339ms 188.006ms 44.21M 6.54M 12.79 MB 0 HASH(tr.event_id,tr.track_id)
  123. 01:SCAN HDFS 6 1s209ms 1s236ms 44.21M 6.54M 254.93 MB 384.00 MB default.track_16 tr
  124. Errors:
  125. Query Compilation: 4s908ms
  126. - Metadata load started: 2.868ms (2.868ms)
  127. - Metadata load finished. loaded-tables=3/3 load-requests=1 catalog-updates=5: 4s886ms (4s883ms)
  128. - Analysis finished: 4s890ms (3.811ms)
  129. - Value transfer graph computed: 4s890ms (538.464us)
  130. - Single node plan created: 4s901ms (10.708ms)
  131. - Runtime filters computed: 4s902ms (828.626us)
  132. - Distributed plan created: 4s902ms (102.096us)
  133. - Lineage info computed: 4s903ms (465.594us)
  134. - Planning finished: 4s908ms (5.437ms)
  135. Query Timeline: 9m25s
  136. - Query submitted: 0.000ns (0.000ns)
  137. - Planning finished: 4s916ms (4s916ms)
  138. - Submit for admission: 4s916ms (0.000ns)
  139. - Completed admission: 4s916ms (0.000ns)
  140. - Ready to start on 6 backends: 4s920ms (4.000ms)
  141. - All 6 execution backends (25 fragment instances) started: 4s920ms (0.000ns)
  142. - First dynamic filter received: 12s460ms (7s540ms)
  143. - Rows available: 12s504ms (44.002ms)
  144. - First row fetched: 12s564ms (60.002ms)
  145. - Last row fetched: 9m25s (9m13s)
  146. - Released admission control resources: 9m25s (4.000ms)
  147. - Unregister query: 9m25s (136.006ms)
  148. - ComputeScanRangeAssignmentTimer: 0.000ns
  149. ImpalaServer:
  150. - ClientFetchWaitTimer: 8m57s
  151. - RowMaterializationTimer: 15s412ms
  152. Execution Profile 984ea1ea895ca2cf:a12d79aa00000000:(Total: 22s953ms, non-child: 0.000ns, % non-child: 0.00%)
  153. Number of filters: 4
  154. Filter routing table:
  155. ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled
  156. -------------------------------------------------------------------------------------------------------------------
  157. 5 3 2 LOCAL false 0 (6) N/A N/A true
  158. 4 3 2 LOCAL false 0 (6) N/A N/A true
  159. 1 4 1 REMOTE false 6 (6) N/A N/A true
  160. 0 4 1 REMOTE false 6 (6) N/A N/A true
  161. Backend startup latencies: Count: 6, min / max: 1ms / 2ms, 25th %-ile: 2ms, 50th %-ile: 2ms, 75th %-ile: 2ms, 90th %-ile: 2ms, 95th %-ile: 2ms, 99.9th %-ile: 2ms
  162. Final filter table:
  163. ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled
  164. -------------------------------------------------------------------------------------------------------------------
  165. 5 3 2 LOCAL false 0 (6) N/A N/A true
  166. 4 3 2 LOCAL false 0 (6) N/A N/A true
  167. 1 4 1 REMOTE false 0 (6) 12s460ms 12s504ms false
  168. 0 4 1 REMOTE false 0 (6) 12s460ms 12s508ms false
  169. Per Node Peak Memory Usage: slave-cn02:22000(1.90 GB) slave-cn03:22000(1.57 GB) slave-cn04:22000(1.79 GB) slave-cn05:22000(2.03 GB) slave-cn06:22000(938.16 MB) slave-cn07:22000(2.05 GB)
  170. - FiltersReceived: 12 (12)
  171. - FinalizationTimer: 0.000ns
  172. - NumBackends: 6 (6)
  173. - NumFragmentInstances: 25 (25)
  174. - NumFragments: 5 (5)
  175. Averaged Fragment F04:(Total: 9m20s, non-child: 9m13s, % non-child: 98.63%)
  176. split sizes: min: 0, max: 0, avg: 0, stddev: 0
  177. completion times: min:9m20s max:9m20s mean: 9m20s stddev:0.000ns
  178. execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
  179. num instances: 1
  180. - AverageThreadTokens: 0.00
  181. - BloomFilterBytes: 0
  182. - PeakMemoryUsage: 13.01 MB (13647101)
  183. - PeakReservation: 0
  184. - PeakUsedReservation: 0
  185. - PerHostPeakMemUsage: 1.90 GB (2039715865)
  186. - RowsProduced: 2.73M (2733728)
  187. - TotalNetworkReceiveTime: 7s600ms
  188. - TotalNetworkSendTime: 0.000ns
  189. - TotalStorageWaitTime: 0.000ns
  190. - TotalThreadsInvoluntaryContextSwitches: 23 (23)
  191. - TotalThreadsTotalWallClockTime: 9m20s
  192. - TotalThreadsSysTime: 836.531ms
  193. - TotalThreadsUserTime: 14s504ms
  194. - TotalThreadsVoluntaryContextSwitches: 2.69K (2687)
  195. Buffer pool:
  196. - AllocTime: 0.000ns
  197. - CumulativeAllocationBytes: 0
  198. - CumulativeAllocations: 0 (0)
  199. - PeakReservation: 0
  200. - PeakUnpinnedBytes: 0
  201. - PeakUsedReservation: 0
  202. - ReadIoBytes: 0
  203. - ReadIoOps: 0 (0)
  204. - ReadIoWaitTime: 0.000ns
  205. - ReservationLimit: 0
  206. - WriteIoBytes: 0
  207. - WriteIoOps: 0 (0)
  208. - WriteIoWaitTime: 0.000ns
  209. Fragment Instance Lifecycle Timings:
  210. - ExecTime: 9m13s
  211. - ExecTreeExecTime: 100.004ms
  212. - OpenTime: 7s584ms
  213. - ExecTreeOpenTime: 7s564ms
  214. - PrepareTime: 0.000ns
  215. - ExecTreePrepareTime: 0.000ns
  216. PLAN_ROOT_SINK:
  217. - PeakMemoryUsage: 0
  218. EXCHANGE_NODE (id=8):(Total: 7s660ms, non-child: 7s660ms, % non-child: 100.00%)
  219. - ConvertRowBatchTime: 60.002ms
  220. - PeakMemoryUsage: 12.99 MB (13622525)
  221. - RowsReturned: 2.73M (2733728)
  222. - RowsReturnedRate: 356.87 K/sec
  223. Buffer pool:
  224. - AllocTime: 20.000ms
  225. - CumulativeAllocationBytes: 417.26 MB (437526528)
  226. - CumulativeAllocations: 5.35K (5348)
  227. - PeakReservation: 12.70 MB (13312000)
  228. - PeakUnpinnedBytes: 0
  229. - PeakUsedReservation: 12.70 MB (13312000)
  230. - ReadIoBytes: 0
  231. - ReadIoOps: 0 (0)
  232. - ReadIoWaitTime: 0.000ns
  233. - WriteIoBytes: 0
  234. - WriteIoOps: 0 (0)
  235. - WriteIoWaitTime: 0.000ns
  236. Dequeue:
  237. - FirstBatchWaitTime: 7s564ms
  238. - TotalBytesDequeued: 338.92 MB (355384640)
  239. - TotalGetBatchTime: 7s600ms
  240. - DataWaitTime: 7s564ms
  241. Enqueue:
  242. - DeserializeRowBatchTime: 380.017ms
  243. - TotalBatchesEnqueued: 2.67K (2674)
  244. - TotalBatchesReceived: 2.67K (2674)
  245. - TotalBytesReceived: 231.81 MB (243067985)
  246. - TotalEarlySenders: 0 (0)
  247. - TotalEosReceived: 6 (6)
  248. - TotalHasDeferredRPCsTime: 8m56s
  249. - TotalRPCsDeferred: 2.59K (2594)
  250. CodeGen:(Total: 20.000ms, non-child: 20.000ms, % non-child: 100.00%)
  251. - CodegenTime: 0.000ns
  252. - CompileTime: 0.000ns
  253. - LoadTime: 0.000ns
  254. - ModuleBitcodeSize: 1.95 MB (2040108)
  255. - NumFunctions: 0 (0)
  256. - NumInstructions: 0 (0)
  257. - OptimizationTime: 0.000ns
  258. - PeakMemoryUsage: 0
  259. - PrepareTime: 16.000ms
  260. Coordinator Fragment F04:
  261. Instance 984ea1ea895ca2cf:a12d79aa00000000 (host=slave-cn02:22000):(Total: 9m20s, non-child: 9m13s, % non-child: 98.63%)
  262. Fragment Instance Lifecycle Event Timeline: 9m20s
  263. - Prepare Finished: 0.000ns (0.000ns)
  264. - Open Finished: 7s584ms (7s584ms)
  265. - First Batch Produced: 7s584ms (0.000ns)
  266. - First Batch Sent: 7s652ms (68.003ms)
  267. - ExecInternal Finished: 9m20s (9m13s)
  268. MemoryUsage(16s000ms): 6.92 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 12.98 MB, 12.72 MB
  269. - AverageThreadTokens: 0.00
  270. - BloomFilterBytes: 0
  271. - PeakMemoryUsage: 13.01 MB (13647101)
  272. - PeakReservation: 0
  273. - PeakUsedReservation: 0
  274. - PerHostPeakMemUsage: 1.90 GB (2039715865)
  275. - RowsProduced: 2.73M (2733728)
  276. - TotalNetworkReceiveTime: 7s600ms
  277. - TotalNetworkSendTime: 0.000ns
  278. - TotalStorageWaitTime: 0.000ns
  279. - TotalThreadsInvoluntaryContextSwitches: 23 (23)
  280. - TotalThreadsTotalWallClockTime: 9m20s
  281. - TotalThreadsSysTime: 836.531ms
  282. - TotalThreadsUserTime: 14s504ms
  283. - TotalThreadsVoluntaryContextSwitches: 2.69K (2687)
  284. Buffer pool:
  285. - AllocTime: 0.000ns
  286. - CumulativeAllocationBytes: 0
  287. - CumulativeAllocations: 0 (0)
  288. - PeakReservation: 0
  289. - PeakUnpinnedBytes: 0
  290. - PeakUsedReservation: 0
  291. - ReadIoBytes: 0
  292. - ReadIoOps: 0 (0)
  293. - ReadIoWaitTime: 0.000ns
  294. - ReservationLimit: 0
  295. - WriteIoBytes: 0
  296. - WriteIoOps: 0 (0)
  297. - WriteIoWaitTime: 0.000ns
  298. Fragment Instance Lifecycle Timings:
  299. - ExecTime: 9m13s
  300. - ExecTreeExecTime: 100.004ms
  301. - OpenTime: 7s584ms
  302. - ExecTreeOpenTime: 7s564ms
  303. - PrepareTime: 0.000ns
  304. - ExecTreePrepareTime: 0.000ns
  305. PLAN_ROOT_SINK:
  306. - PeakMemoryUsage: 0
  307. EXCHANGE_NODE (id=8):(Total: 7s660ms, non-child: 96.004ms, % non-child: 1.25%)
  308. - ConvertRowBatchTime: 60.002ms
  309. - PeakMemoryUsage: 12.99 MB (13622525)
  310. - RowsReturned: 2.73M (2733728)
  311. - RowsReturnedRate: 356.87 K/sec
  312. Buffer pool:
  313. - AllocTime: 20.000ms
  314. - CumulativeAllocationBytes: 417.26 MB (437526528)
  315. - CumulativeAllocations: 5.35K (5348)
  316. - PeakReservation: 12.70 MB (13312000)
  317. - PeakUnpinnedBytes: 0
  318. - PeakUsedReservation: 12.70 MB (13312000)
  319. - ReadIoBytes: 0
  320. - ReadIoOps: 0 (0)
  321. - ReadIoWaitTime: 0.000ns
  322. - WriteIoBytes: 0
  323. - WriteIoOps: 0 (0)
  324. - WriteIoWaitTime: 0.000ns
  325. Dequeue:
  326. BytesDequeued(16s000ms): 1.41 MB, 10.14 MB, 19.99 MB, 29.57 MB, 39.12 MB, 48.67 MB, 58.50 MB, 68.10 MB, 77.86 MB, 87.59 MB, 97.35 MB, 106.88 MB, 116.60 MB, 126.38 MB, 136.15 MB, 145.85 MB, 155.68 MB, 165.48 MB, 175.34 MB, 184.95 MB, 194.75 MB, 204.78 MB, 214.75 MB, 224.71 MB, 234.71 MB, 244.76 MB, 254.58 MB, 264.46 MB, 274.51 MB, 284.51 MB, 294.41 MB, 304.19 MB, 314.02 MB, 323.89 MB, 333.65 MB
  327. - FirstBatchWaitTime: 7s564ms
  328. - TotalBytesDequeued: 338.92 MB (355384640)
  329. - TotalGetBatchTime: 7s600ms
  330. - DataWaitTime: 7s564ms
  331. Enqueue:
  332. BytesReceived(16s000ms): 4.80 MB, 14.16 MB, 20.90 MB, 27.46 MB, 33.99 MB, 40.52 MB, 47.25 MB, 53.81 MB, 60.49 MB, 67.15 MB, 73.83 MB, 80.35 MB, 87.00 MB, 93.69 MB, 100.37 MB, 107.01 MB, 113.74 MB, 120.45 MB, 127.19 MB, 133.76 MB, 140.46 MB, 147.32 MB, 154.14 MB, 160.96 MB, 167.79 MB, 174.67 MB, 181.39 MB, 188.15 MB, 195.03 MB, 201.87 MB, 208.65 MB, 215.34 MB, 222.07 MB, 228.78 MB, 231.81 MB
  333. DeferredQueueSize(16s000ms): 2, 5, 6, 6, 6, 5, 6, 5, 6, 6, 6, 6, 6, 5, 5, 6, 6, 6, 6, 6, 6, 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 6, 5, 0
  334. - DispatchTime: (Avg: 77.207us ; Min: 26.899us ; Max: 745.813us ; Number of samples: 2674)
  335. - DeserializeRowBatchTime: 380.017ms
  336. - TotalBatchesEnqueued: 2.67K (2674)
  337. - TotalBatchesReceived: 2.67K (2674)
  338. - TotalBytesReceived: 231.81 MB (243067985)
  339. - TotalEarlySenders: 0 (0)
  340. - TotalEosReceived: 6 (6)
  341. - TotalHasDeferredRPCsTime: 8m56s
  342. - TotalRPCsDeferred: 2.59K (2594)
  343. CodeGen:(Total: 20.000ms, non-child: 20.000ms, % non-child: 100.00%)
  344. - CodegenTime: 0.000ns
  345. - CompileTime: 0.000ns
  346. - LoadTime: 0.000ns
  347. - ModuleBitcodeSize: 1.95 MB (2040108)
  348. - NumFunctions: 0 (0)
  349. - NumInstructions: 0 (0)
  350. - OptimizationTime: 0.000ns
  351. - PeakMemoryUsage: 0
  352. - PrepareTime: 16.000ms
  353. Averaged Fragment F03:(Total: 9m3s, non-child: 18.000ms, % non-child: 0.00%)
  354. split sizes: min: 0, max: 0, avg: 0, stddev: 0
  355. completion times: min:9m2s max:9m4s mean: 9m3s stddev:645.181ms
  356. execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
  357. num instances: 6
  358. - AverageThreadTokens: 1.01
  359. - BloomFilterBytes: 2.00 MB (2097152)
  360. - PeakMemoryUsage: 66.37 MB (69593836)
  361. - PeakReservation: 53.83 MB (56448341)
  362. - PeakUsedReservation: 0
  363. - PerHostPeakMemUsage: 1.71 GB (1836833523)
  364. - RowsProduced: 455.62K (455621)
  365. - TotalNetworkReceiveTime: 8s027ms
  366. - TotalNetworkSendTime: 8m54s
  367. - TotalStorageWaitTime: 0.000ns
  368. - TotalThreadsInvoluntaryContextSwitches: 4 (4)
  369. - TotalThreadsTotalWallClockTime: 9m10s
  370. - TotalThreadsSysTime: 375.320ms
  371. - TotalThreadsUserTime: 1s955ms
  372. - TotalThreadsVoluntaryContextSwitches: 13.10K (13103)
  373. Buffer pool:
  374. - AllocTime: 666.697us
  375. - CumulativeAllocationBytes: 2.00 MB (2097152)
  376. - CumulativeAllocations: 2 (2)
  377. - PeakReservation: 2.00 MB (2097152)
  378. - PeakUnpinnedBytes: 0
  379. - PeakUsedReservation: 2.00 MB (2097152)
  380. - ReadIoBytes: 0
  381. - ReadIoOps: 0 (0)
  382. - ReadIoWaitTime: 0.000ns
  383. - ReservationLimit: 2.00 MB (2097152)
  384. - WriteIoBytes: 0
  385. - WriteIoOps: 0 (0)
  386. - WriteIoWaitTime: 0.000ns
  387. Fragment Instance Lifecycle Timings:
  388. - ExecTime: 8m55s
  389. - ExecTreeExecTime: 1s132ms
  390. - OpenTime: 7s577ms
  391. - ExecTreeOpenTime: 7s307ms
  392. - PrepareTime: 1.333ms
  393. - ExecTreePrepareTime: 666.697us
  394. KrpcDataStreamSender (dst_id=8):(Total: 8m54s, non-child: 8m54s, % non-child: 100.00%)
  395. - EosSent: 1 (1)
  396. - NetworkThroughput: 76.00 MB/sec
  397. - PeakMemoryUsage: 3.61 KB (3696)
  398. - RowsSent: 455.62K (455621)
  399. - RpcFailure: 0 (0)
  400. - RpcRetry: 0 (0)
  401. - SerializeBatchTime: 244.677ms
  402. - TotalBytesSent: 38.63 MB (40511330)
  403. - UncompressedRowBatchSize: 56.49 MB (59230773)
  404. HASH_JOIN_NODE (id=4):(Total: 8s438ms, non-child: 1s220ms, % non-child: 14.47%)
  405. - BuildRows: 459.47K (459466)
  406. - BuildTime: 224.677ms
  407. - NumHashTableBuildsSkipped: 0 (0)
  408. - PeakMemoryUsage: 51.90 MB (54421077)
  409. - ProbeRows: 7.37M (7368006)
  410. - ProbeRowsPartitioned: 0 (0)
  411. - ProbeTime: 981.378ms
  412. - RowsReturned: 455.62K (455621)
  413. - RowsReturnedRate: 54.02 K/sec
  414. Buffer pool:
  415. - AllocTime: 32.001ms
  416. - CumulativeAllocationBytes: 51.83 MB (54351189)
  417. - CumulativeAllocations: 87 (87)
  418. - PeakReservation: 51.83 MB (54351189)
  419. - PeakUnpinnedBytes: 0
  420. - PeakUsedReservation: 51.83 MB (54351189)
  421. - ReadIoBytes: 0
  422. - ReadIoOps: 0 (0)
  423. - ReadIoWaitTime: 0.000ns
  424. - WriteIoBytes: 0
  425. - WriteIoOps: 0 (0)
  426. - WriteIoWaitTime: 0.000ns
  427. Hash Join Builder (join_node_id=4):
  428. - BuildRowsPartitionTime: 179.341ms
  429. - BuildRowsPartitioned: 459.47K (459466)
  430. - HashBuckets: 1.05M (1048576)
  431. - HashCollisions: 0 (0)
  432. - HashTablesBuildTime: 40.668ms
  433. - LargestPartitionPercent: 6 (6)
  434. - MaxPartitionLevel: 0 (0)
  435. - NumRepartitions: 0 (0)
  436. - PartitionsCreated: 16 (16)
  437. - PeakMemoryUsage: 30.12 KB (30848)
  438. - RepartitionTime: 0.000ns
  439. - SpilledPartitions: 0 (0)
  440. EXCHANGE_NODE (id=7):(Total: 7s078ms, non-child: 7s078ms, % non-child: 100.00%)
  441. - ConvertRowBatchTime: 8.667ms
  442. - PeakMemoryUsage: 206.67 KB (211626)
  443. - RowsReturned: 459.47K (459466)
  444. - RowsReturnedRate: 64.91 K/sec
  445. Buffer pool:
  446. - AllocTime: 57.336ms
  447. - CumulativeAllocationBytes: 48.12 MB (50454528)
  448. - CumulativeAllocations: 4.11K (4108)
  449. - PeakReservation: 206.67 KB (211626)
  450. - PeakUnpinnedBytes: 0
  451. - PeakUsedReservation: 206.67 KB (211626)
  452. - ReadIoBytes: 0
  453. - ReadIoOps: 0 (0)
  454. - ReadIoWaitTime: 0.000ns
  455. - WriteIoBytes: 0
  456. - WriteIoOps: 0 (0)
  457. - WriteIoWaitTime: 0.000ns
  458. Dequeue:
  459. - FirstBatchWaitTime: 1s029ms
  460. - TotalBytesDequeued: 39.00 MB (40892533)
  461. - TotalGetBatchTime: 7s068ms
  462. - DataWaitTime: 7s062ms
  463. Enqueue:
  464. - DeserializeRowBatchTime: 93.337ms
  465. - TotalBatchesEnqueued: 2.05K (2054)
  466. - TotalBatchesReceived: 2.05K (2054)
  467. - TotalBytesReceived: 28.25 MB (29623056)
  468. - TotalEarlySenders: 0 (0)
  469. - TotalEosReceived: 6 (6)
  470. - TotalHasDeferredRPCsTime: 0.000ns
  471. - TotalRPCsDeferred: 0 (0)
  472. EXCHANGE_NODE (id=6):(Total: 1s064ms, non-child: 1s064ms, % non-child: 100.00%)
  473. - ConvertRowBatchTime: 97.337ms
  474. - PeakMemoryUsage: 12.36 MB (12958185)
  475. - RowsReturned: 7.37M (7368006)
  476. - RowsReturnedRate: 6.93 M/sec
  477. Buffer pool:
  478. - AllocTime: 216.677ms
  479. - CumulativeAllocationBytes: 348.20 MB (365118805)
  480. - CumulativeAllocations: 29.71K (29715)
  481. - PeakReservation: 12.34 MB (12939264)
  482. - PeakUnpinnedBytes: 0
  483. - PeakUsedReservation: 12.34 MB (12939264)
  484. - ReadIoBytes: 0
  485. - ReadIoOps: 0 (0)
  486. - ReadIoWaitTime: 0.000ns
  487. - WriteIoBytes: 0
  488. - WriteIoOps: 0 (0)
  489. - WriteIoWaitTime: 0.000ns
  490. Dequeue:
  491. - FirstBatchWaitTime: 925.376ms
  492. - TotalBytesDequeued: 288.09 MB (302088273)
  493. - TotalGetBatchTime: 957.377ms
  494. - DataWaitTime: 925.376ms
  495. Enqueue:
  496. - DeserializeRowBatchTime: 551.359ms
  497. - TotalBatchesEnqueued: 14.86K (14857)
  498. - TotalBatchesReceived: 14.86K (14857)
  499. - TotalBytesReceived: 155.12 MB (162656546)
  500. - TotalEarlySenders: 0 (0)
  501. - TotalEosReceived: 6 (6)
  502. - TotalHasDeferredRPCsTime: 1m32s
  503. - TotalRPCsDeferred: 422 (422)
  504. CodeGen:(Total: 264.679ms, non-child: 264.679ms, % non-child: 100.00%)
  505. - CodegenTime: 0.000ns
  506. - CompileTime: 76.670ms
  507. - LoadTime: 0.000ns
  508. - ModuleBitcodeSize: 1.95 MB (2040108)
  509. - NumFunctions: 78 (78)
  510. - NumInstructions: 2.75K (2748)
  511. - OptimizationTime: 168.674ms
  512. - PeakMemoryUsage: 1.34 MB (1406976)
  513. - PrepareTime: 18.667ms
  514. Fragment F03:
  515. Instance 984ea1ea895ca2cf:a12d79aa00000013 (host=slave-cn02:22000):(Total: 9m4s, non-child: 16.000ms, % non-child: 0.00%)
  516. Fragment Instance Lifecycle Event Timeline: 9m4s
  517. - Prepare Finished: 4.000ms (4.000ms)
  518. - Open Finished: 7s592ms (7s588ms)
  519. - First Batch Produced: 7s596ms (4.000ms)
  520. - First Batch Sent: 7s596ms (0.000ns)
  521. - ExecInternal Finished: 9m4s (8m56s)
  522. MemoryUsage(16s000ms): 47.21 MB, 65.60 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB
  523. ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
  524. - AverageThreadTokens: 1.01
  525. - BloomFilterBytes: 2.00 MB (2097152)
  526. - PeakMemoryUsage: 65.63 MB (68821452)
  527. - PeakReservation: 53.00 MB (55574528)
  528. - PeakUsedReservation: 0
  529. - PerHostPeakMemUsage: 1.90 GB (2039715865)
  530. - RowsProduced: 455.80K (455797)
  531. - TotalNetworkReceiveTime: 8s044ms
  532. - TotalNetworkSendTime: 8m54s
  533. - TotalStorageWaitTime: 0.000ns
  534. - TotalThreadsInvoluntaryContextSwitches: 2 (2)
  535. - TotalThreadsTotalWallClockTime: 9m11s
  536. - TotalThreadsSysTime: 665.423ms
  537. - TotalThreadsUserTime: 1s844ms
  538. - TotalThreadsVoluntaryContextSwitches: 13.27K (13272)
  539. Buffer pool:
  540. - AllocTime: 4.000ms
  541. - CumulativeAllocationBytes: 2.00 MB (2097152)
  542. - CumulativeAllocations: 2 (2)
  543. - PeakReservation: 2.00 MB (2097152)
  544. - PeakUnpinnedBytes: 0
  545. - PeakUsedReservation: 2.00 MB (2097152)
  546. - ReadIoBytes: 0
  547. - ReadIoOps: 0 (0)
  548. - ReadIoWaitTime: 0.000ns
  549. - ReservationLimit: 2.00 MB (2097152)
  550. - WriteIoBytes: 0
  551. - WriteIoOps: 0 (0)
  552. - WriteIoWaitTime: 0.000ns
  553. Fragment Instance Lifecycle Timings:
  554. - ExecTime: 8m56s
  555. - ExecTreeExecTime: 1s472ms
  556. - OpenTime: 7s588ms
  557. - ExecTreeOpenTime: 7s320ms
  558. - PrepareTime: 4.000ms
  559. - ExecTreePrepareTime: 4.000ms
  560. KrpcDataStreamSender (dst_id=8):(Total: 8m55s, non-child: 252.011ms, % non-child: 0.05%)
  561. BytesSent(16s000ms): 732.11 KB, 2.20 MB, 3.32 MB, 4.41 MB, 5.50 MB, 6.59 MB, 7.71 MB, 8.81 MB, 9.92 MB, 11.03 MB, 12.14 MB, 13.23 MB, 14.34 MB, 15.45 MB, 16.56 MB, 17.67 MB, 18.79 MB, 19.91 MB, 21.03 MB, 22.13 MB, 23.25 MB, 24.39 MB, 25.53 MB, 26.66 MB, 27.80 MB, 28.95 MB, 30.07 MB, 31.20 MB, 32.34 MB, 33.48 MB, 34.61 MB, 35.72 MB, 36.85 MB, 37.97 MB
  562. - EosSent: 1 (1)
  563. - NetworkThroughput: 231.23 MB/sec
  564. - PeakMemoryUsage: 3.61 KB (3696)
  565. - RowsSent: 455.80K (455797)
  566. - RpcFailure: 0 (0)
  567. - RpcRetry: 0 (0)
  568. - SerializeBatchTime: 236.010ms
  569. - TotalBytesSent: 38.65 MB (40530415)
  570. - UncompressedRowBatchSize: 56.51 MB (59253610)
  571. HASH_JOIN_NODE (id=4):(Total: 8s796ms, non-child: 1s572ms, % non-child: 17.87%)
  572. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  573. - BuildRows: 459.64K (459644)
  574. - BuildTime: 224.010ms
  575. - NumHashTableBuildsSkipped: 0 (0)
  576. - PeakMemoryUsage: 51.07 MB (53547264)
  577. - ProbeRows: 7.37M (7368309)
  578. - ProbeRowsPartitioned: 0 (0)
  579. - ProbeTime: 1s328ms
  580. - RowsReturned: 455.80K (455797)
  581. - RowsReturnedRate: 51.82 K/sec
  582. Buffer pool:
  583. - AllocTime: 44.002ms
  584. - CumulativeAllocationBytes: 51.00 MB (53477376)
  585. - CumulativeAllocations: 86 (86)
  586. - PeakReservation: 51.00 MB (53477376)
  587. - PeakUnpinnedBytes: 0
  588. - PeakUsedReservation: 51.00 MB (53477376)
  589. - ReadIoBytes: 0
  590. - ReadIoOps: 0 (0)
  591. - ReadIoWaitTime: 0.000ns
  592. - WriteIoBytes: 0
  593. - WriteIoOps: 0 (0)
  594. - WriteIoWaitTime: 0.000ns
  595. Hash Join Builder (join_node_id=4):
  596. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  597. Runtime filters: 2 of 2 Runtime Filters Published
  598. - BuildRowsPartitionTime: 164.007ms
  599. - BuildRowsPartitioned: 459.64K (459644)
  600. - HashBuckets: 1.05M (1048576)
  601. - HashCollisions: 0 (0)
  602. - HashTablesBuildTime: 56.002ms
  603. - LargestPartitionPercent: 6 (6)
  604. - MaxPartitionLevel: 0 (0)
  605. - NumRepartitions: 0 (0)
  606. - PartitionsCreated: 16 (16)
  607. - PeakMemoryUsage: 30.12 KB (30848)
  608. - RepartitionTime: 0.000ns
  609. - SpilledPartitions: 0 (0)
  610. EXCHANGE_NODE (id=7):(Total: 7s088ms, non-child: 24.001ms, % non-child: 0.34%)
  611. - ConvertRowBatchTime: 12.000ms
  612. - PeakMemoryUsage: 272.00 KB (278528)
  613. - RowsReturned: 459.64K (459644)
  614. - RowsReturnedRate: 64.84 K/sec
  615. Buffer pool:
  616. - AllocTime: 72.003ms
  617. - CumulativeAllocationBytes: 48.14 MB (50479104)
  618. - CumulativeAllocations: 4.11K (4110)
  619. - PeakReservation: 272.00 KB (278528)
  620. - PeakUnpinnedBytes: 0
  621. - PeakUsedReservation: 272.00 KB (278528)
  622. - ReadIoBytes: 0
  623. - ReadIoOps: 0 (0)
  624. - ReadIoWaitTime: 0.000ns
  625. - WriteIoBytes: 0
  626. - WriteIoOps: 0 (0)
  627. - WriteIoWaitTime: 0.000ns
  628. Dequeue:
  629. BytesDequeued(500.000ms): 0, 0, 0, 895.56 KB, 1.81 MB, 3.06 MB, 4.45 MB, 7.47 MB, 11.50 MB, 16.07 MB, 20.80 MB, 25.55 MB, 29.97 MB, 33.58 MB, 37.41 MB
  630. - FirstBatchWaitTime: 1s032ms
  631. - TotalBytesDequeued: 39.01 MB (40908316)
  632. - TotalGetBatchTime: 7s076ms
  633. - DataWaitTime: 7s064ms
  634. Enqueue:
  635. BytesReceived(500.000ms): 0, 0, 0, 644.66 KB, 1.30 MB, 2.20 MB, 3.21 MB, 5.39 MB, 8.31 MB, 11.62 MB, 15.05 MB, 18.50 MB, 21.70 MB, 24.32 MB, 27.10 MB
  636. DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  637. - DispatchTime: (Avg: 50.298us ; Min: 23.835us ; Max: 201.541us ; Number of samples: 2055)
  638. - DeserializeRowBatchTime: 96.004ms
  639. - TotalBatchesEnqueued: 2.06K (2055)
  640. - TotalBatchesReceived: 2.06K (2055)
  641. - TotalBytesReceived: 28.26 MB (29634329)
  642. - TotalEarlySenders: 0 (0)
  643. - TotalEosReceived: 6 (6)
  644. - TotalHasDeferredRPCsTime: 0.000ns
  645. - TotalRPCsDeferred: 0 (0)
  646. EXCHANGE_NODE (id=6):(Total: 1s064ms, non-child: 136.006ms, % non-child: 12.78%)
  647. - ConvertRowBatchTime: 96.004ms
  648. - PeakMemoryUsage: 12.56 MB (13172736)
  649. - RowsReturned: 7.37M (7368309)
  650. - RowsReturnedRate: 6.92 M/sec
  651. Buffer pool:
  652. - AllocTime: 144.006ms
  653. - CumulativeAllocationBytes: 348.20 MB (365109248)
  654. - CumulativeAllocations: 29.71K (29714)
  655. - PeakReservation: 12.56 MB (13172736)
  656. - PeakUnpinnedBytes: 0
  657. - PeakUsedReservation: 12.56 MB (13172736)
  658. - ReadIoBytes: 0
  659. - ReadIoOps: 0 (0)
  660. - ReadIoWaitTime: 0.000ns
  661. - WriteIoBytes: 0
  662. - WriteIoOps: 0 (0)
  663. - WriteIoWaitTime: 0.000ns
  664. Dequeue:
  665. BytesDequeued(16s000ms): 6.02 MB, 17.45 MB, 25.41 MB, 33.36 MB, 41.38 MB, 49.45 MB, 57.81 MB, 65.91 MB, 74.22 MB, 82.55 MB, 90.95 MB, 99.11 MB, 107.42 MB, 115.70 MB, 123.99 MB, 132.33 MB, 140.69 MB, 149.11 MB, 157.55 MB, 165.87 MB, 174.25 MB, 182.83 MB, 191.39 MB, 199.86 MB, 208.38 MB, 216.85 MB, 225.10 MB, 233.65 MB, 242.24 MB, 250.74 MB, 259.20 MB, 267.53 MB, 275.93 MB, 284.28 MB
  666. - FirstBatchWaitTime: 928.042ms
  667. - TotalBytesDequeued: 288.11 MB (302100669)
  668. - TotalGetBatchTime: 968.044ms
  669. - DataWaitTime: 928.042ms
  670. Enqueue:
  671. BytesReceived(16s000ms): 7.89 MB, 14.46 MB, 18.72 MB, 23.00 MB, 27.31 MB, 31.62 MB, 36.06 MB, 40.42 MB, 44.84 MB, 49.26 MB, 53.70 MB, 58.06 MB, 62.56 MB, 67.11 MB, 71.55 MB, 76.01 MB, 80.59 MB, 85.11 MB, 89.60 MB, 93.99 MB, 98.55 MB, 103.19 MB, 107.75 MB, 112.37 MB, 116.98 MB, 121.63 MB, 126.16 MB, 130.70 MB, 135.34 MB, 139.98 MB, 144.57 MB, 149.02 MB, 153.46 MB, 155.13 MB
  672. DeferredQueueSize(16s000ms): 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  673. - DispatchTime: (Avg: 42.205us ; Min: 10.476us ; Max: 976.886us ; Number of samples: 14857)
  674. - DeserializeRowBatchTime: 528.024ms
  675. - TotalBatchesEnqueued: 14.86K (14857)
  676. - TotalBatchesReceived: 14.86K (14857)
  677. - TotalBytesReceived: 155.13 MB (162669524)
  678. - TotalEarlySenders: 0 (0)
  679. - TotalEosReceived: 6 (6)
  680. - TotalHasDeferredRPCsTime: 6s271ms
  681. - TotalRPCsDeferred: 7 (7)
  682. CodeGen:(Total: 268.012ms, non-child: 268.012ms, % non-child: 100.00%)
  683. - CodegenTime: 0.000ns
  684. - CompileTime: 76.003ms
  685. - LoadTime: 0.000ns
  686. - ModuleBitcodeSize: 1.95 MB (2040108)
  687. - NumFunctions: 78 (78)
  688. - NumInstructions: 2.75K (2748)
  689. - OptimizationTime: 168.007ms
  690. - PeakMemoryUsage: 1.34 MB (1406976)
  691. - PrepareTime: 24.001ms
  692. Instance 984ea1ea895ca2cf:a12d79aa00000014 (host=slave-cn04:22000):(Total: 9m4s, non-child: 20.001ms, % non-child: 0.00%)
  693. Fragment Instance Lifecycle Event Timeline: 9m4s
  694. - Prepare Finished: 4.000ms (4.000ms)
  695. - Open Finished: 7s584ms (7s580ms)
  696. - First Batch Produced: 7s588ms (4.000ms)
  697. - First Batch Sent: 7s588ms (0.000ns)
  698. - ExecInternal Finished: 9m4s (8m56s)
  699. MemoryUsage(16s000ms): 47.42 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.33 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.35 MB, 66.35 MB, 66.35 MB, 66.35 MB, 66.35 MB, 66.36 MB, 66.33 MB, 66.31 MB
  700. ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
  701. - AverageThreadTokens: 1.01
  702. - BloomFilterBytes: 2.00 MB (2097152)
  703. - PeakMemoryUsage: 66.36 MB (69581585)
  704. - PeakReservation: 53.50 MB (56098816)
  705. - PeakUsedReservation: 0
  706. - PerHostPeakMemUsage: 1.79 GB (1925754349)
  707. - RowsProduced: 455.28K (455282)
  708. - TotalNetworkReceiveTime: 8s056ms
  709. - TotalNetworkSendTime: 8m55s
  710. - TotalStorageWaitTime: 0.000ns
  711. - TotalThreadsInvoluntaryContextSwitches: 6 (6)
  712. - TotalThreadsTotalWallClockTime: 9m11s
  713. - TotalThreadsSysTime: 172.514ms
  714. - TotalThreadsUserTime: 2s120ms
  715. - TotalThreadsVoluntaryContextSwitches: 13.04K (13037)
  716. Buffer pool:
  717. - AllocTime: 0.000ns
  718. - CumulativeAllocationBytes: 2.00 MB (2097152)
  719. - CumulativeAllocations: 2 (2)
  720. - PeakReservation: 2.00 MB (2097152)
  721. - PeakUnpinnedBytes: 0
  722. - PeakUsedReservation: 2.00 MB (2097152)
  723. - ReadIoBytes: 0
  724. - ReadIoOps: 0 (0)
  725. - ReadIoWaitTime: 0.000ns
  726. - ReservationLimit: 2.00 MB (2097152)
  727. - WriteIoBytes: 0
  728. - WriteIoOps: 0 (0)
  729. - WriteIoWaitTime: 0.000ns
  730. Fragment Instance Lifecycle Timings:
  731. - ExecTime: 8m56s
  732. - ExecTreeExecTime: 996.052ms
  733. - OpenTime: 7s580ms
  734. - ExecTreeOpenTime: 7s320ms
  735. - PrepareTime: 0.000ns
  736. - ExecTreePrepareTime: 0.000ns
  737. KrpcDataStreamSender (dst_id=8):(Total: 8m55s, non-child: 256.013ms, % non-child: 0.05%)
  738. BytesSent(16s000ms): 618.22 KB, 2.04 MB, 3.17 MB, 4.26 MB, 5.35 MB, 6.44 MB, 7.56 MB, 8.65 MB, 9.77 MB, 10.88 MB, 11.99 MB, 13.08 MB, 14.18 MB, 15.29 MB, 16.41 MB, 17.52 MB, 18.65 MB, 19.76 MB, 20.88 MB, 21.98 MB, 23.10 MB, 24.24 MB, 25.38 MB, 26.51 MB, 27.65 MB, 28.80 MB, 29.92 MB, 31.05 MB, 32.19 MB, 33.33 MB, 34.46 MB, 35.58 MB, 36.70 MB, 37.83 MB
  739. - EosSent: 1 (1)
  740. - NetworkThroughput: 44.11 MB/sec
  741. - PeakMemoryUsage: 3.61 KB (3696)
  742. - RowsSent: 455.28K (455282)
  743. - RpcFailure: 0 (0)
  744. - RpcRetry: 0 (0)
  745. - SerializeBatchTime: 236.012ms
  746. - TotalBytesSent: 38.61 MB (40486743)
  747. - UncompressedRowBatchSize: 56.44 MB (59186660)
  748. HASH_JOIN_NODE (id=4):(Total: 8s312ms, non-child: 1s076ms, % non-child: 12.95%)
  749. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  750. - BuildRows: 459.11K (459110)
  751. - BuildTime: 240.012ms
  752. - NumHashTableBuildsSkipped: 0 (0)
  753. - PeakMemoryUsage: 51.57 MB (54071552)
  754. - ProbeRows: 7.37M (7369719)
  755. - ProbeRowsPartitioned: 0 (0)
  756. - ProbeTime: 820.043ms
  757. - RowsReturned: 455.28K (455282)
  758. - RowsReturnedRate: 54.77 K/sec
  759. Buffer pool:
  760. - AllocTime: 56.002ms
  761. - CumulativeAllocationBytes: 51.50 MB (54001664)
  762. - CumulativeAllocations: 87 (87)
  763. - PeakReservation: 51.50 MB (54001664)
  764. - PeakUnpinnedBytes: 0
  765. - PeakUsedReservation: 51.50 MB (54001664)
  766. - ReadIoBytes: 0
  767. - ReadIoOps: 0 (0)
  768. - ReadIoWaitTime: 0.000ns
  769. - WriteIoBytes: 0
  770. - WriteIoOps: 0 (0)
  771. - WriteIoWaitTime: 0.000ns
  772. Hash Join Builder (join_node_id=4):
  773. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  774. Runtime filters: 2 of 2 Runtime Filters Published
  775. - BuildRowsPartitionTime: 188.009ms
  776. - BuildRowsPartitioned: 459.11K (459110)
  777. - HashBuckets: 1.05M (1048576)
  778. - HashCollisions: 0 (0)
  779. - HashTablesBuildTime: 44.002ms
  780. - LargestPartitionPercent: 6 (6)
  781. - MaxPartitionLevel: 0 (0)
  782. - NumRepartitions: 0 (0)
  783. - PartitionsCreated: 16 (16)
  784. - PeakMemoryUsage: 30.12 KB (30848)
  785. - RepartitionTime: 0.000ns
  786. - SpilledPartitions: 0 (0)
  787. EXCHANGE_NODE (id=7):(Total: 7s072ms, non-child: 16.000ms, % non-child: 0.23%)
  788. - ConvertRowBatchTime: 4.000ms
  789. - PeakMemoryUsage: 248.00 KB (253952)
  790. - RowsReturned: 459.11K (459110)
  791. - RowsReturnedRate: 64.92 K/sec
  792. Buffer pool:
  793. - AllocTime: 84.004ms
  794. - CumulativeAllocationBytes: 48.07 MB (50405376)
  795. - CumulativeAllocations: 4.10K (4104)
  796. - PeakReservation: 248.00 KB (253952)
  797. - PeakUnpinnedBytes: 0
  798. - PeakUsedReservation: 248.00 KB (253952)
  799. - ReadIoBytes: 0
  800. - ReadIoOps: 0 (0)
  801. - ReadIoWaitTime: 0.000ns
  802. - WriteIoBytes: 0
  803. - WriteIoOps: 0 (0)
  804. - WriteIoWaitTime: 0.000ns
  805. Dequeue:
  806. BytesDequeued(500.000ms): 0, 0, 0, 603.53 KB, 1.69 MB, 2.79 MB, 3.99 MB, 6.83 MB, 10.70 MB, 15.27 MB, 19.96 MB, 24.70 MB, 29.33 MB, 32.79 MB, 36.75 MB, 38.97 MB
  807. - FirstBatchWaitTime: 1s040ms
  808. - TotalBytesDequeued: 38.97 MB (40860790)
  809. - TotalGetBatchTime: 7s064ms
  810. - DataWaitTime: 7s056ms
  811. Enqueue:
  812. BytesReceived(500.000ms): 0, 0, 0, 434.54 KB, 1.22 MB, 2.01 MB, 2.88 MB, 4.93 MB, 7.73 MB, 11.04 MB, 14.44 MB, 17.88 MB, 21.24 MB, 23.77 MB, 26.62 MB, 28.23 MB
  813. DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  814. - DispatchTime: (Avg: 49.691us ; Min: 25.790us ; Max: 179.419us ; Number of samples: 2052)
  815. - DeserializeRowBatchTime: 132.006ms
  816. - TotalBatchesEnqueued: 2.05K (2052)
  817. - TotalBatchesReceived: 2.05K (2052)
  818. - TotalBytesReceived: 28.23 MB (29599485)
  819. - TotalEarlySenders: 0 (0)
  820. - TotalEosReceived: 6 (6)
  821. - TotalHasDeferredRPCsTime: 0.000ns
  822. - TotalRPCsDeferred: 0 (0)
  823. EXCHANGE_NODE (id=6):(Total: 1s100ms, non-child: 164.008ms, % non-child: 14.91%)
  824. - ConvertRowBatchTime: 92.004ms
  825. - PeakMemoryUsage: 12.79 MB (13408565)
  826. - RowsReturned: 7.37M (7369719)
  827. - RowsReturnedRate: 6.70 M/sec
  828. Buffer pool:
  829. - AllocTime: 460.024ms
  830. - CumulativeAllocationBytes: 348.29 MB (365207552)
  831. - CumulativeAllocations: 29.72K (29722)
  832. - PeakReservation: 12.73 MB (13352960)
  833. - PeakUnpinnedBytes: 0
  834. - PeakUsedReservation: 12.73 MB (13352960)
  835. - ReadIoBytes: 0
  836. - ReadIoOps: 0 (0)
  837. - ReadIoWaitTime: 0.000ns
  838. - WriteIoBytes: 0
  839. - WriteIoOps: 0 (0)
  840. - WriteIoWaitTime: 0.000ns
  841. Dequeue:
  842. BytesDequeued(16s000ms): 5.25 MB, 16.69 MB, 24.66 MB, 32.59 MB, 40.59 MB, 48.61 MB, 56.89 MB, 64.95 MB, 73.10 MB, 81.40 MB, 89.65 MB, 97.76 MB, 106.09 MB, 114.42 MB, 122.71 MB, 131.03 MB, 139.47 MB, 147.88 MB, 156.24 MB, 164.38 MB, 172.78 MB, 181.43 MB, 189.92 MB, 198.41 MB, 207.01 MB, 215.66 MB, 224.08 MB, 232.54 MB, 241.15 MB, 249.75 MB, 258.25 MB, 266.59 MB, 275.05 MB, 283.58 MB
  843. - FirstBatchWaitTime: 936.049ms
  844. - TotalBytesDequeued: 288.16 MB (302158479)
  845. - TotalGetBatchTime: 984.051ms
  846. - DataWaitTime: 936.049ms
  847. Enqueue:
  848. BytesReceived(16s000ms): 7.74 MB, 14.40 MB, 18.70 MB, 22.97 MB, 27.28 MB, 31.60 MB, 36.05 MB, 40.39 MB, 44.78 MB, 49.25 MB, 53.70 MB, 58.06 MB, 62.55 MB, 67.04 MB, 71.49 MB, 75.98 MB, 80.53 MB, 85.05 MB, 89.56 MB, 93.94 MB, 98.47 MB, 103.13 MB, 107.69 MB, 112.27 MB, 116.90 MB, 121.55 MB, 126.09 MB, 130.64 MB, 135.28 MB, 139.91 MB, 144.48 MB, 148.97 MB, 153.46 MB, 155.16 MB
  849. DeferredQueueSize(16s000ms): 5, 5, 6, 6, 6, 6, 6, 6, 6, 5, 6, 6, 6, 6, 5, 6, 6, 6, 6, 6, 6, 6, 5, 6, 6, 5, 6, 6, 6, 5, 5, 4, 2, 0
  850. - DispatchTime: (Avg: 43.567us ; Min: 12.349us ; Max: 753.314us ; Number of samples: 14861)
  851. - DeserializeRowBatchTime: 768.040ms
  852. - TotalBatchesEnqueued: 14.86K (14861)
  853. - TotalBatchesReceived: 14.86K (14861)
  854. - TotalBytesReceived: 155.16 MB (162694927)
  855. - TotalEarlySenders: 0 (0)
  856. - TotalEosReceived: 6 (6)
  857. - TotalHasDeferredRPCsTime: 8m42s
  858. - TotalRPCsDeferred: 2.51K (2507)
  859. CodeGen:(Total: 252.013ms, non-child: 252.013ms, % non-child: 100.00%)
  860. - CodegenTime: 0.000ns
  861. - CompileTime: 80.004ms
  862. - LoadTime: 0.000ns
  863. - ModuleBitcodeSize: 1.95 MB (2040108)
  864. - NumFunctions: 78 (78)
  865. - NumInstructions: 2.75K (2748)
  866. - OptimizationTime: 160.008ms
  867. - PeakMemoryUsage: 1.34 MB (1406976)
  868. - PrepareTime: 12.000ms
  869. Instance 984ea1ea895ca2cf:a12d79aa00000017 (host=slave-cn05:22000):(Total: 9m3s, non-child: 28.001ms, % non-child: 0.01%)
  870. Fragment Instance Lifecycle Event Timeline: 9m3s
  871. - Prepare Finished: 0.000ns (0.000ns)
  872. - Open Finished: 7s576ms (7s576ms)
  873. - First Batch Produced: 7s576ms (0.000ns)
  874. - First Batch Sent: 7s576ms (0.000ns)
  875. - ExecInternal Finished: 9m3s (8m56s)
  876. MemoryUsage(16s000ms): 47.65 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB
  877. ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
  878. - AverageThreadTokens: 1.01
  879. - BloomFilterBytes: 2.00 MB (2097152)
  880. - PeakMemoryUsage: 66.46 MB (69690188)
  881. - PeakReservation: 54.00 MB (56623104)
  882. - PeakUsedReservation: 0
  883. - PerHostPeakMemUsage: 2.03 GB (2177414655)
  884. - RowsProduced: 455.68K (455681)
  885. - TotalNetworkReceiveTime: 7s980ms
  886. - TotalNetworkSendTime: 8m54s
  887. - TotalStorageWaitTime: 0.000ns
  888. - TotalThreadsInvoluntaryContextSwitches: 7 (7)
  889. - TotalThreadsTotalWallClockTime: 9m11s
  890. - TotalThreadsSysTime: 371.292ms
  891. - TotalThreadsUserTime: 1s958ms
  892. - TotalThreadsVoluntaryContextSwitches: 13.16K (13163)
  893. Buffer pool:
  894. - AllocTime: 0.000ns
  895. - CumulativeAllocationBytes: 2.00 MB (2097152)
  896. - CumulativeAllocations: 2 (2)
  897. - PeakReservation: 2.00 MB (2097152)
  898. - PeakUnpinnedBytes: 0
  899. - PeakUsedReservation: 2.00 MB (2097152)
  900. - ReadIoBytes: 0
  901. - ReadIoOps: 0 (0)
  902. - ReadIoWaitTime: 0.000ns
  903. - ReservationLimit: 2.00 MB (2097152)
  904. - WriteIoBytes: 0
  905. - WriteIoOps: 0 (0)
  906. - WriteIoWaitTime: 0.000ns
  907. Fragment Instance Lifecycle Timings:
  908. - ExecTime: 8m56s
  909. - ExecTreeExecTime: 1s100ms
  910. - OpenTime: 7s576ms
  911. - ExecTreeOpenTime: 7s288ms
  912. - PrepareTime: 0.000ns
  913. - ExecTreePrepareTime: 0.000ns
  914. KrpcDataStreamSender (dst_id=8):(Total: 8m55s, non-child: 276.015ms, % non-child: 0.05%)
  915. BytesSent(16s000ms): 769.23 KB, 2.26 MB, 3.39 MB, 4.48 MB, 5.57 MB, 6.65 MB, 7.78 MB, 8.87 MB, 9.98 MB, 11.09 MB, 12.20 MB, 13.29 MB, 14.40 MB, 15.52 MB, 16.63 MB, 17.74 MB, 18.85 MB, 19.97 MB, 21.10 MB, 22.19 MB, 23.31 MB, 24.46 MB, 25.59 MB, 26.73 MB, 27.87 MB, 29.02 MB, 30.13 MB, 31.26 MB, 32.41 MB, 33.54 MB, 34.68 MB, 35.79 MB, 36.92 MB, 38.04 MB
  916. - EosSent: 1 (1)
  917. - NetworkThroughput: 45.08 MB/sec
  918. - PeakMemoryUsage: 3.61 KB (3696)
  919. - RowsSent: 455.68K (455681)
  920. - RpcFailure: 0 (0)
  921. - RpcRetry: 0 (0)
  922. - SerializeBatchTime: 252.013ms
  923. - TotalBytesSent: 38.64 MB (40513410)
  924. - UncompressedRowBatchSize: 56.49 MB (59238530)
  925. HASH_JOIN_NODE (id=4):(Total: 8s388ms, non-child: 1s208ms, % non-child: 14.40%)
  926. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  927. - BuildRows: 459.53K (459528)
  928. - BuildTime: 232.012ms
  929. - NumHashTableBuildsSkipped: 0 (0)
  930. - PeakMemoryUsage: 52.07 MB (54595840)
  931. - ProbeRows: 7.37M (7365206)
  932. - ProbeRowsPartitioned: 0 (0)
  933. - ProbeTime: 960.052ms
  934. - RowsReturned: 455.68K (455681)
  935. - RowsReturnedRate: 54.32 K/sec
  936. Buffer pool:
  937. - AllocTime: 32.001ms
  938. - CumulativeAllocationBytes: 52.00 MB (54525952)
  939. - CumulativeAllocations: 88 (88)
  940. - PeakReservation: 52.00 MB (54525952)
  941. - PeakUnpinnedBytes: 0
  942. - PeakUsedReservation: 52.00 MB (54525952)
  943. - ReadIoBytes: 0
  944. - ReadIoOps: 0 (0)
  945. - ReadIoWaitTime: 0.000ns
  946. - WriteIoBytes: 0
  947. - WriteIoOps: 0 (0)
  948. - WriteIoWaitTime: 0.000ns
  949. Hash Join Builder (join_node_id=4):
  950. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  951. Runtime filters: 2 of 2 Runtime Filters Published
  952. - BuildRowsPartitionTime: 192.010ms
  953. - BuildRowsPartitioned: 459.53K (459528)
  954. - HashBuckets: 1.05M (1048576)
  955. - HashCollisions: 0 (0)
  956. - HashTablesBuildTime: 36.001ms
  957. - LargestPartitionPercent: 6 (6)
  958. - MaxPartitionLevel: 0 (0)
  959. - NumRepartitions: 0 (0)
  960. - PartitionsCreated: 16 (16)
  961. - PeakMemoryUsage: 30.12 KB (30848)
  962. - RepartitionTime: 0.000ns
  963. - SpilledPartitions: 0 (0)
  964. EXCHANGE_NODE (id=7):(Total: 7s056ms, non-child: 8.000ms, % non-child: 0.11%)
  965. - ConvertRowBatchTime: 4.000ms
  966. - PeakMemoryUsage: 208.00 KB (212992)
  967. - RowsReturned: 459.53K (459528)
  968. - RowsReturnedRate: 65.12 K/sec
  969. Buffer pool:
  970. - AllocTime: 72.003ms
  971. - CumulativeAllocationBytes: 48.12 MB (50462720)
  972. - CumulativeAllocations: 4.11K (4110)
  973. - PeakReservation: 208.00 KB (212992)
  974. - PeakUnpinnedBytes: 0
  975. - PeakUsedReservation: 208.00 KB (212992)
  976. - ReadIoBytes: 0
  977. - ReadIoOps: 0 (0)
  978. - ReadIoWaitTime: 0.000ns
  979. - WriteIoBytes: 0
  980. - WriteIoOps: 0 (0)
  981. - WriteIoWaitTime: 0.000ns
  982. Dequeue:
  983. BytesDequeued(500.000ms): 0, 0, 0, 739.81 KB, 1.73 MB, 2.89 MB, 4.20 MB, 7.09 MB, 11.10 MB, 15.69 MB, 20.36 MB, 25.13 MB, 29.68 MB, 33.22 MB, 37.12 MB
  984. - FirstBatchWaitTime: 1s012ms
  985. - TotalBytesDequeued: 39.00 MB (40897992)
  986. - TotalGetBatchTime: 7s052ms
  987. - DataWaitTime: 7s048ms
  988. Enqueue:
  989. BytesReceived(500.000ms): 0, 0, 0, 546.64 KB, 1.25 MB, 2.08 MB, 3.03 MB, 5.12 MB, 8.02 MB, 11.34 MB, 14.74 MB, 18.20 MB, 21.50 MB, 24.09 MB, 26.89 MB
  990. DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  991. - DispatchTime: (Avg: 49.372us ; Min: 20.699us ; Max: 190.919us ; Number of samples: 2055)
  992. - DeserializeRowBatchTime: 112.006ms
  993. - TotalBatchesEnqueued: 2.06K (2055)
  994. - TotalBatchesReceived: 2.06K (2055)
  995. - TotalBytesReceived: 28.26 MB (29629084)
  996. - TotalEarlySenders: 0 (0)
  997. - TotalEosReceived: 6 (6)
  998. - TotalHasDeferredRPCsTime: 0.000ns
  999. - TotalRPCsDeferred: 0 (0)
  1000. EXCHANGE_NODE (id=6):(Total: 1s032ms, non-child: 124.006ms, % non-child: 12.02%)
  1001. - ConvertRowBatchTime: 96.005ms
  1002. - PeakMemoryUsage: 12.21 MB (12801469)
  1003. - RowsReturned: 7.37M (7365206)
  1004. - RowsReturnedRate: 7.14 M/sec
  1005. Buffer pool:
  1006. - AllocTime: 192.010ms
  1007. - CumulativeAllocationBytes: 348.08 MB (364986368)
  1008. - CumulativeAllocations: 29.71K (29706)
  1009. - PeakReservation: 12.19 MB (12779520)
  1010. - PeakUnpinnedBytes: 0
  1011. - PeakUsedReservation: 12.19 MB (12779520)
  1012. - ReadIoBytes: 0
  1013. - ReadIoOps: 0 (0)
  1014. - ReadIoWaitTime: 0.000ns
  1015. - WriteIoBytes: 0
  1016. - WriteIoOps: 0 (0)
  1017. - WriteIoWaitTime: 0.000ns
  1018. Dequeue:
  1019. BytesDequeued(16s000ms): 6.34 MB, 18.01 MB, 26.00 MB, 33.97 MB, 42.04 MB, 50.03 MB, 58.23 MB, 66.32 MB, 74.57 MB, 82.91 MB, 91.11 MB, 99.27 MB, 107.56 MB, 115.91 MB, 124.15 MB, 132.54 MB, 140.86 MB, 149.34 MB, 157.70 MB, 165.86 MB, 174.33 MB, 182.89 MB, 191.37 MB, 199.71 MB, 208.27 MB, 216.93 MB, 225.37 MB, 233.81 MB, 242.36 MB, 250.82 MB, 259.34 MB, 267.76 MB, 276.31 MB, 284.72 MB
  1020. - FirstBatchWaitTime: 908.049ms
  1021. - TotalBytesDequeued: 287.98 MB (301973446)
  1022. - TotalGetBatchTime: 928.051ms
  1023. - DataWaitTime: 908.049ms
  1024. Enqueue:
  1025. BytesReceived(16s000ms): 7.80 MB, 14.45 MB, 18.75 MB, 23.03 MB, 27.33 MB, 31.66 MB, 36.08 MB, 40.42 MB, 44.82 MB, 49.28 MB, 53.71 MB, 58.08 MB, 62.56 MB, 67.06 MB, 71.54 MB, 75.96 MB, 80.53 MB, 85.03 MB, 89.54 MB, 93.89 MB, 98.46 MB, 103.09 MB, 107.66 MB, 112.26 MB, 116.87 MB, 121.53 MB, 126.07 MB, 130.61 MB, 135.23 MB, 139.86 MB, 144.46 MB, 148.94 MB, 153.37 MB, 155.06 MB
  1026. DeferredQueueSize(16s000ms): 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  1027. - DispatchTime: (Avg: 45.028us ; Min: 11.977us ; Max: 1.048ms ; Number of samples: 14853)
  1028. - DeserializeRowBatchTime: 592.032ms
  1029. - TotalBatchesEnqueued: 14.85K (14853)
  1030. - TotalBatchesReceived: 14.85K (14853)
  1031. - TotalBytesReceived: 155.06 MB (162589483)
  1032. - TotalEarlySenders: 0 (0)
  1033. - TotalEosReceived: 6 (6)
  1034. - TotalHasDeferredRPCsTime: 6s257ms
  1035. - TotalRPCsDeferred: 6 (6)
  1036. CodeGen:(Total: 280.015ms, non-child: 280.015ms, % non-child: 100.00%)
  1037. - CodegenTime: 0.000ns
  1038. - CompileTime: 76.004ms
  1039. - LoadTime: 0.000ns
  1040. - ModuleBitcodeSize: 1.95 MB (2040108)
  1041. - NumFunctions: 78 (78)
  1042. - NumInstructions: 2.75K (2748)
  1043. - OptimizationTime: 180.009ms
  1044. - PeakMemoryUsage: 1.34 MB (1406976)
  1045. - PrepareTime: 24.001ms
  1046. Instance 984ea1ea895ca2cf:a12d79aa00000015 (host=slave-cn03:22000):(Total: 9m3s, non-child: 12.000ms, % non-child: 0.00%)
  1047. Fragment Instance Lifecycle Event Timeline: 9m3s
  1048. - Prepare Finished: 0.000ns (0.000ns)
  1049. - Open Finished: 7s572ms (7s572ms)
  1050. - First Batch Produced: 7s576ms (4.000ms)
  1051. - First Batch Sent: 7s576ms (0.000ns)
  1052. - ExecInternal Finished: 9m3s (8m55s)
  1053. MemoryUsage(16s000ms): 47.23 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB
  1054. ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
  1055. - AverageThreadTokens: 1.01
  1056. - BloomFilterBytes: 2.00 MB (2097152)
  1057. - PeakMemoryUsage: 67.42 MB (70689909)
  1058. - PeakReservation: 55.00 MB (57671680)
  1059. - PeakUsedReservation: 0
  1060. - PerHostPeakMemUsage: 1.57 GB (1688006861)
  1061. - RowsProduced: 456.30K (456302)
  1062. - TotalNetworkReceiveTime: 8s056ms
  1063. - TotalNetworkSendTime: 8m54s
  1064. - TotalStorageWaitTime: 0.000ns
  1065. - TotalThreadsInvoluntaryContextSwitches: 2 (2)
  1066. - TotalThreadsTotalWallClockTime: 9m10s
  1067. - TotalThreadsSysTime: 243.519ms
  1068. - TotalThreadsUserTime: 1s912ms
  1069. - TotalThreadsVoluntaryContextSwitches: 13.01K (13014)
  1070. Buffer pool:
  1071. - AllocTime: 0.000ns
  1072. - CumulativeAllocationBytes: 2.00 MB (2097152)
  1073. - CumulativeAllocations: 2 (2)
  1074. - PeakReservation: 2.00 MB (2097152)
  1075. - PeakUnpinnedBytes: 0
  1076. - PeakUsedReservation: 2.00 MB (2097152)
  1077. - ReadIoBytes: 0
  1078. - ReadIoOps: 0 (0)
  1079. - ReadIoWaitTime: 0.000ns
  1080. - ReservationLimit: 2.00 MB (2097152)
  1081. - WriteIoBytes: 0
  1082. - WriteIoOps: 0 (0)
  1083. - WriteIoWaitTime: 0.000ns
  1084. Fragment Instance Lifecycle Timings:
  1085. - ExecTime: 8m55s
  1086. - ExecTreeExecTime: 924.042ms
  1087. - OpenTime: 7s572ms
  1088. - ExecTreeOpenTime: 7s312ms
  1089. - PrepareTime: 0.000ns
  1090. - ExecTreePrepareTime: 0.000ns
  1091. KrpcDataStreamSender (dst_id=8):(Total: 8m54s, non-child: 316.014ms, % non-child: 0.06%)
  1092. BytesSent(16s000ms): 785.81 KB, 2.37 MB, 3.50 MB, 4.59 MB, 5.68 MB, 6.77 MB, 7.89 MB, 8.98 MB, 10.09 MB, 11.21 MB, 12.32 MB, 13.41 MB, 14.51 MB, 15.62 MB, 16.74 MB, 17.85 MB, 18.97 MB, 20.09 MB, 21.21 MB, 22.30 MB, 23.42 MB, 24.56 MB, 25.70 MB, 26.83 MB, 27.98 MB, 29.12 MB, 30.24 MB, 31.37 MB, 32.52 MB, 33.66 MB, 34.78 MB, 35.90 MB, 37.02 MB
  1093. - EosSent: 1 (1)
  1094. - NetworkThroughput: 47.04 MB/sec
  1095. - PeakMemoryUsage: 3.61 KB (3696)
  1096. - RowsSent: 456.30K (456302)
  1097. - RpcFailure: 0 (0)
  1098. - RpcRetry: 0 (0)
  1099. - SerializeBatchTime: 296.013ms
  1100. - TotalBytesSent: 38.69 MB (40571812)
  1101. - UncompressedRowBatchSize: 56.57 MB (59319260)
  1102. HASH_JOIN_NODE (id=4):(Total: 8s236ms, non-child: 1s012ms, % non-child: 12.29%)
  1103. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  1104. - BuildRows: 460.13K (460132)
  1105. - BuildTime: 212.009ms
  1106. - NumHashTableBuildsSkipped: 0 (0)
  1107. - PeakMemoryUsage: 53.07 MB (55644416)
  1108. - ProbeRows: 7.37M (7367140)
  1109. - ProbeRowsPartitioned: 0 (0)
  1110. - ProbeTime: 800.036ms
  1111. - RowsReturned: 456.30K (456302)
  1112. - RowsReturnedRate: 55.40 K/sec
  1113. Buffer pool:
  1114. - AllocTime: 24.001ms
  1115. - CumulativeAllocationBytes: 53.00 MB (55574528)
  1116. - CumulativeAllocations: 90 (90)
  1117. - PeakReservation: 53.00 MB (55574528)
  1118. - PeakUnpinnedBytes: 0
  1119. - PeakUsedReservation: 53.00 MB (55574528)
  1120. - ReadIoBytes: 0
  1121. - ReadIoOps: 0 (0)
  1122. - ReadIoWaitTime: 0.000ns
  1123. - WriteIoBytes: 0
  1124. - WriteIoOps: 0 (0)
  1125. - WriteIoWaitTime: 0.000ns
  1126. Hash Join Builder (join_node_id=4):
  1127. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  1128. Runtime filters: 2 of 2 Runtime Filters Published
  1129. - BuildRowsPartitionTime: 172.007ms
  1130. - BuildRowsPartitioned: 460.13K (460132)
  1131. - HashBuckets: 1.05M (1048576)
  1132. - HashCollisions: 0 (0)
  1133. - HashTablesBuildTime: 36.001ms
  1134. - LargestPartitionPercent: 6 (6)
  1135. - MaxPartitionLevel: 0 (0)
  1136. - NumRepartitions: 0 (0)
  1137. - PartitionsCreated: 16 (16)
  1138. - PeakMemoryUsage: 30.12 KB (30848)
  1139. - RepartitionTime: 0.000ns
  1140. - SpilledPartitions: 0 (0)
  1141. EXCHANGE_NODE (id=7):(Total: 7s100ms, non-child: 8.000ms, % non-child: 0.11%)
  1142. - ConvertRowBatchTime: 4.000ms
  1143. - PeakMemoryUsage: 160.00 KB (163840)
  1144. - RowsReturned: 460.13K (460132)
  1145. - RowsReturnedRate: 64.80 K/sec
  1146. Buffer pool:
  1147. - AllocTime: 56.002ms
  1148. - CumulativeAllocationBytes: 48.19 MB (50528256)
  1149. - CumulativeAllocations: 4.11K (4114)
  1150. - PeakReservation: 160.00 KB (163840)
  1151. - PeakUnpinnedBytes: 0
  1152. - PeakUsedReservation: 160.00 KB (163840)
  1153. - ReadIoBytes: 0
  1154. - ReadIoOps: 0 (0)
  1155. - ReadIoWaitTime: 0.000ns
  1156. - WriteIoBytes: 0
  1157. - WriteIoOps: 0 (0)
  1158. - WriteIoWaitTime: 0.000ns
  1159. Dequeue:
  1160. BytesDequeued(500.000ms): 0, 0, 0, 428.31 KB, 1.56 MB, 2.62 MB, 3.80 MB, 6.52 MB, 10.23 MB, 14.79 MB, 19.47 MB, 24.18 MB, 28.90 MB, 32.46 MB, 36.45 MB, 39.05 MB
  1161. - FirstBatchWaitTime: 1s040ms
  1162. - TotalBytesDequeued: 39.05 MB (40951748)
  1163. - TotalGetBatchTime: 7s096ms
  1164. - DataWaitTime: 7s092ms
  1165. Enqueue:
  1166. BytesReceived(500.000ms): 0, 0, 0, 308.61 KB, 1.12 MB, 1.89 MB, 2.74 MB, 4.71 MB, 7.39 MB, 10.69 MB, 14.11 MB, 17.51 MB, 20.93 MB, 23.51 MB, 26.40 MB, 28.28 MB
  1167. DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  1168. - DispatchTime: (Avg: 48.567us ; Min: 24.726us ; Max: 981.167us ; Number of samples: 2057)
  1169. - DeserializeRowBatchTime: 100.004ms
  1170. - TotalBatchesEnqueued: 2.06K (2057)
  1171. - TotalBatchesReceived: 2.06K (2057)
  1172. - TotalBytesReceived: 28.29 MB (29665538)
  1173. - TotalEarlySenders: 0 (0)
  1174. - TotalEosReceived: 6 (6)
  1175. - TotalHasDeferredRPCsTime: 0.000ns
  1176. - TotalRPCsDeferred: 0 (0)
  1177. EXCHANGE_NODE (id=6):(Total: 1s060ms, non-child: 124.005ms, % non-child: 11.70%)
  1178. - ConvertRowBatchTime: 96.004ms
  1179. - PeakMemoryUsage: 12.20 MB (12790564)
  1180. - RowsReturned: 7.37M (7367140)
  1181. - RowsReturnedRate: 6.95 M/sec
  1182. Buffer pool:
  1183. - AllocTime: 152.006ms
  1184. - CumulativeAllocationBytes: 348.16 MB (365076480)
  1185. - CumulativeAllocations: 29.71K (29712)
  1186. - PeakReservation: 12.19 MB (12779520)
  1187. - PeakUnpinnedBytes: 0
  1188. - PeakUsedReservation: 12.19 MB (12779520)
  1189. - ReadIoBytes: 0
  1190. - ReadIoOps: 0 (0)
  1191. - ReadIoWaitTime: 0.000ns
  1192. - WriteIoBytes: 0
  1193. - WriteIoOps: 0 (0)
  1194. - WriteIoWaitTime: 0.000ns
  1195. Dequeue:
  1196. BytesDequeued(16s000ms): 6.42 MB, 18.72 MB, 26.81 MB, 34.80 MB, 42.88 MB, 50.95 MB, 59.22 MB, 67.33 MB, 75.58 MB, 83.74 MB, 91.93 MB, 100.12 MB, 108.34 MB, 116.66 MB, 125.01 MB, 133.27 MB, 141.69 MB, 150.05 MB, 158.41 MB, 166.63 MB, 174.96 MB, 183.47 MB, 191.99 MB, 200.48 MB, 209.05 MB, 217.61 MB, 226.05 MB, 234.56 MB, 243.18 MB, 251.67 MB, 260.11 MB, 268.50 MB, 276.92 MB
  1197. - FirstBatchWaitTime: 936.042ms
  1198. - TotalBytesDequeued: 288.06 MB (302052740)
  1199. - TotalGetBatchTime: 960.043ms
  1200. - DataWaitTime: 936.042ms
  1201. Enqueue:
  1202. BytesReceived(16s000ms): 7.77 MB, 14.43 MB, 18.72 MB, 22.98 MB, 27.30 MB, 31.58 MB, 36.07 MB, 40.42 MB, 44.80 MB, 49.27 MB, 53.70 MB, 58.07 MB, 62.54 MB, 67.05 MB, 71.49 MB, 75.97 MB, 80.48 MB, 85.05 MB, 89.56 MB, 93.91 MB, 98.45 MB, 103.10 MB, 107.67 MB, 112.27 MB, 116.88 MB, 121.54 MB, 126.11 MB, 130.65 MB, 135.28 MB, 139.88 MB, 144.47 MB, 148.92 MB, 153.41 MB
  1203. DeferredQueueSize(16s000ms): 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  1204. - DispatchTime: (Avg: 45.330us ; Min: 11.505us ; Max: 852.644us ; Number of samples: 14856)
  1205. - DeserializeRowBatchTime: 428.019ms
  1206. - TotalBatchesEnqueued: 14.86K (14856)
  1207. - TotalBatchesReceived: 14.86K (14856)
  1208. - TotalBytesReceived: 155.11 MB (162640691)
  1209. - TotalEarlySenders: 0 (0)
  1210. - TotalEosReceived: 6 (6)
  1211. - TotalHasDeferredRPCsTime: 6s255ms
  1212. - TotalRPCsDeferred: 6 (6)
  1213. CodeGen:(Total: 256.011ms, non-child: 256.011ms, % non-child: 100.00%)
  1214. - CodegenTime: 0.000ns
  1215. - CompileTime: 76.003ms
  1216. - LoadTime: 0.000ns
  1217. - ModuleBitcodeSize: 1.95 MB (2040108)
  1218. - NumFunctions: 78 (78)
  1219. - NumInstructions: 2.75K (2748)
  1220. - OptimizationTime: 160.007ms
  1221. - PeakMemoryUsage: 1.34 MB (1406976)
  1222. - PrepareTime: 20.000ms
  1223. Instance 984ea1ea895ca2cf:a12d79aa00000016 (host=slave-cn06:22000):(Total: 9m2s, non-child: 16.000ms, % non-child: 0.00%)
  1224. Fragment Instance Lifecycle Event Timeline: 9m2s
  1225. - Prepare Finished: 4.000ms (4.000ms)
  1226. - Open Finished: 7s576ms (7s572ms)
  1227. - First Batch Produced: 7s576ms (0.000ns)
  1228. - First Batch Sent: 7s580ms (4.000ms)
  1229. - ExecInternal Finished: 9m2s (8m55s)
  1230. MemoryUsage(16s000ms): 47.37 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB
  1231. ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
  1232. - AverageThreadTokens: 1.01
  1233. - BloomFilterBytes: 2.00 MB (2097152)
  1234. - PeakMemoryUsage: 65.92 MB (69122315)
  1235. - PeakReservation: 53.50 MB (56098816)
  1236. - PeakUsedReservation: 0
  1237. - PerHostPeakMemUsage: 938.16 MB (983735960)
  1238. - RowsProduced: 454.79K (454788)
  1239. - TotalNetworkReceiveTime: 8s056ms
  1240. - TotalNetworkSendTime: 8m53s
  1241. - TotalStorageWaitTime: 0.000ns
  1242. - TotalThreadsInvoluntaryContextSwitches: 3 (3)
  1243. - TotalThreadsTotalWallClockTime: 9m10s
  1244. - TotalThreadsSysTime: 443.492ms
  1245. - TotalThreadsUserTime: 2s006ms
  1246. - TotalThreadsVoluntaryContextSwitches: 13.12K (13120)
  1247. Buffer pool:
  1248. - AllocTime: 0.000ns
  1249. - CumulativeAllocationBytes: 2.00 MB (2097152)
  1250. - CumulativeAllocations: 2 (2)
  1251. - PeakReservation: 2.00 MB (2097152)
  1252. - PeakUnpinnedBytes: 0
  1253. - PeakUsedReservation: 2.00 MB (2097152)
  1254. - ReadIoBytes: 0
  1255. - ReadIoOps: 0 (0)
  1256. - ReadIoWaitTime: 0.000ns
  1257. - ReservationLimit: 2.00 MB (2097152)
  1258. - WriteIoBytes: 0
  1259. - WriteIoOps: 0 (0)
  1260. - WriteIoWaitTime: 0.000ns
  1261. Fragment Instance Lifecycle Timings:
  1262. - ExecTime: 8m55s
  1263. - ExecTreeExecTime: 1s212ms
  1264. - OpenTime: 7s572ms
  1265. - ExecTreeOpenTime: 7s300ms
  1266. - PrepareTime: 4.000ms
  1267. - ExecTreePrepareTime: 0.000ns
  1268. KrpcDataStreamSender (dst_id=8):(Total: 8m53s, non-child: 284.009ms, % non-child: 0.05%)
  1269. BytesSent(16s000ms): 804.66 KB, 2.34 MB, 3.46 MB, 4.56 MB, 5.64 MB, 6.74 MB, 7.85 MB, 8.95 MB, 10.06 MB, 11.17 MB, 12.28 MB, 13.37 MB, 14.48 MB, 15.60 MB, 16.71 MB, 17.81 MB, 18.94 MB, 20.05 MB, 21.18 MB, 22.27 MB, 23.39 MB, 24.53 MB, 25.67 MB, 26.81 MB, 27.95 MB, 29.09 MB, 30.21 MB, 31.34 MB, 32.49 MB, 33.63 MB, 34.76 MB, 35.87 MB, 36.99 MB
  1270. - EosSent: 1 (1)
  1271. - NetworkThroughput: 44.92 MB/sec
  1272. - PeakMemoryUsage: 3.61 KB (3696)
  1273. - RowsSent: 454.79K (454788)
  1274. - RpcFailure: 0 (0)
  1275. - RpcRetry: 0 (0)
  1276. - SerializeBatchTime: 268.008ms
  1277. - TotalBytesSent: 38.56 MB (40435024)
  1278. - UncompressedRowBatchSize: 56.38 MB (59122440)
  1279. HASH_JOIN_NODE (id=4):(Total: 8s512ms, non-child: 1s224ms, % non-child: 14.38%)
  1280. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  1281. - BuildRows: 458.72K (458721)
  1282. - BuildTime: 196.006ms
  1283. - NumHashTableBuildsSkipped: 0 (0)
  1284. - PeakMemoryUsage: 51.57 MB (54071552)
  1285. - ProbeRows: 7.37M (7367418)
  1286. - ProbeRowsPartitioned: 0 (0)
  1287. - ProbeTime: 1s004ms
  1288. - RowsReturned: 454.79K (454788)
  1289. - RowsReturnedRate: 53.43 K/sec
  1290. Buffer pool:
  1291. - AllocTime: 8.000ms
  1292. - CumulativeAllocationBytes: 51.50 MB (54001664)
  1293. - CumulativeAllocations: 87 (87)
  1294. - PeakReservation: 51.50 MB (54001664)
  1295. - PeakUnpinnedBytes: 0
  1296. - PeakUsedReservation: 51.50 MB (54001664)
  1297. - ReadIoBytes: 0
  1298. - ReadIoOps: 0 (0)
  1299. - ReadIoWaitTime: 0.000ns
  1300. - WriteIoBytes: 0
  1301. - WriteIoOps: 0 (0)
  1302. - WriteIoWaitTime: 0.000ns
  1303. Hash Join Builder (join_node_id=4):
  1304. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  1305. Runtime filters: 2 of 2 Runtime Filters Published
  1306. - BuildRowsPartitionTime: 156.005ms
  1307. - BuildRowsPartitioned: 458.72K (458721)
  1308. - HashBuckets: 1.05M (1048576)
  1309. - HashCollisions: 0 (0)
  1310. - HashTablesBuildTime: 36.001ms
  1311. - LargestPartitionPercent: 6 (6)
  1312. - MaxPartitionLevel: 0 (0)
  1313. - NumRepartitions: 0 (0)
  1314. - PartitionsCreated: 16 (16)
  1315. - PeakMemoryUsage: 30.12 KB (30848)
  1316. - RepartitionTime: 0.000ns
  1317. - SpilledPartitions: 0 (0)
  1318. EXCHANGE_NODE (id=7):(Total: 7s100ms, non-child: 12.000ms, % non-child: 0.17%)
  1319. - ConvertRowBatchTime: 12.000ms
  1320. - PeakMemoryUsage: 176.00 KB (180224)
  1321. - RowsReturned: 458.72K (458721)
  1322. - RowsReturnedRate: 64.61 K/sec
  1323. Buffer pool:
  1324. - AllocTime: 12.000ms
  1325. - CumulativeAllocationBytes: 48.04 MB (50372608)
  1326. - CumulativeAllocations: 4.10K (4102)
  1327. - PeakReservation: 176.00 KB (180224)
  1328. - PeakUnpinnedBytes: 0
  1329. - PeakUsedReservation: 176.00 KB (180224)
  1330. - ReadIoBytes: 0
  1331. - ReadIoOps: 0 (0)
  1332. - ReadIoWaitTime: 0.000ns
  1333. - WriteIoBytes: 0
  1334. - WriteIoOps: 0 (0)
  1335. - WriteIoWaitTime: 0.000ns
  1336. Dequeue:
  1337. BytesDequeued(500.000ms): 0, 0, 0, 1.05 MB, 1.79 MB, 3.14 MB, 4.72 MB, 7.78 MB, 12.00 MB, 16.64 MB, 21.31 MB, 26.07 MB, 30.32 MB, 34.05 MB, 37.65 MB
  1338. - FirstBatchWaitTime: 1s028ms
  1339. - TotalBytesDequeued: 38.93 MB (40826169)
  1340. - TotalGetBatchTime: 7s088ms
  1341. - DataWaitTime: 7s088ms
  1342. Enqueue:
  1343. BytesReceived(500.000ms): 0, 0, 0, 771.28 KB, 1.29 MB, 2.26 MB, 3.40 MB, 5.62 MB, 8.67 MB, 12.03 MB, 15.42 MB, 18.87 MB, 21.96 MB, 24.67 MB, 27.28 MB
  1344. DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  1345. - DispatchTime: (Avg: 51.528us ; Min: 23.228us ; Max: 183.720us ; Number of samples: 2051)
  1346. - DeserializeRowBatchTime: 56.001ms
  1347. - TotalBatchesEnqueued: 2.05K (2051)
  1348. - TotalBatchesReceived: 2.05K (2051)
  1349. - TotalBytesReceived: 28.20 MB (29574471)
  1350. - TotalEarlySenders: 0 (0)
  1351. - TotalEosReceived: 6 (6)
  1352. - TotalHasDeferredRPCsTime: 0.000ns
  1353. - TotalRPCsDeferred: 0 (0)
  1354. EXCHANGE_NODE (id=6):(Total: 1s112ms, non-child: 188.006ms, % non-child: 16.91%)
  1355. - ConvertRowBatchTime: 132.004ms
  1356. - PeakMemoryUsage: 12.18 MB (12774204)
  1357. - RowsReturned: 7.37M (7367418)
  1358. - RowsReturnedRate: 6.63 M/sec
  1359. Buffer pool:
  1360. - AllocTime: 104.003ms
  1361. - CumulativeAllocationBytes: 348.18 MB (365092864)
  1362. - CumulativeAllocations: 29.71K (29712)
  1363. - PeakReservation: 12.17 MB (12763136)
  1364. - PeakUnpinnedBytes: 0
  1365. - PeakUsedReservation: 12.17 MB (12763136)
  1366. - ReadIoBytes: 0
  1367. - ReadIoOps: 0 (0)
  1368. - ReadIoWaitTime: 0.000ns
  1369. - WriteIoBytes: 0
  1370. - WriteIoOps: 0 (0)
  1371. - WriteIoWaitTime: 0.000ns
  1372. Dequeue:
  1373. BytesDequeued(16s000ms): 6.75 MB, 18.91 MB, 26.89 MB, 34.86 MB, 42.86 MB, 50.92 MB, 59.25 MB, 67.43 MB, 75.81 MB, 84.03 MB, 92.23 MB, 100.39 MB, 108.73 MB, 117.11 MB, 125.47 MB, 133.76 MB, 142.26 MB, 150.51 MB, 159.00 MB, 167.18 MB, 175.54 MB, 184.06 MB, 192.54 MB, 201.13 MB, 209.79 MB, 218.35 MB, 226.77 MB, 235.40 MB, 244.12 MB, 252.59 MB, 261.15 MB, 269.43 MB, 277.72 MB
  1374. - FirstBatchWaitTime: 924.030ms
  1375. - TotalBytesDequeued: 288.07 MB (302064138)
  1376. - TotalGetBatchTime: 968.031ms
  1377. - DataWaitTime: 924.030ms
  1378. Enqueue:
  1379. BytesReceived(16s000ms): 7.93 MB, 14.47 MB, 18.73 MB, 22.99 MB, 27.28 MB, 31.59 MB, 36.06 MB, 40.41 MB, 44.82 MB, 49.27 MB, 53.67 MB, 58.06 MB, 62.57 MB, 67.08 MB, 71.52 MB, 76.00 MB, 80.52 MB, 85.08 MB, 89.55 MB, 93.95 MB, 98.46 MB, 103.10 MB, 107.68 MB, 112.30 MB, 116.93 MB, 121.57 MB, 126.14 MB, 130.71 MB, 135.33 MB, 139.94 MB, 144.54 MB, 149.00 MB, 153.47 MB
  1380. DeferredQueueSize(16s000ms): 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  1381. - DispatchTime: (Avg: 45.963us ; Min: 11.945us ; Max: 951.535us ; Number of samples: 14856)
  1382. - DeserializeRowBatchTime: 516.016ms
  1383. - TotalBatchesEnqueued: 14.86K (14856)
  1384. - TotalBatchesReceived: 14.86K (14856)
  1385. - TotalBytesReceived: 155.11 MB (162647601)
  1386. - TotalEarlySenders: 0 (0)
  1387. - TotalEosReceived: 6 (6)
  1388. - TotalHasDeferredRPCsTime: 6s255ms
  1389. - TotalRPCsDeferred: 5 (5)
  1390. CodeGen:(Total: 264.008ms, non-child: 264.008ms, % non-child: 100.00%)
  1391. - CodegenTime: 0.000ns
  1392. - CompileTime: 80.002ms
  1393. - LoadTime: 0.000ns
  1394. - ModuleBitcodeSize: 1.95 MB (2040108)
  1395. - NumFunctions: 78 (78)
  1396. - NumInstructions: 2.75K (2748)
  1397. - OptimizationTime: 168.005ms
  1398. - PeakMemoryUsage: 1.34 MB (1406976)
  1399. - PrepareTime: 16.000ms
  1400. Instance 984ea1ea895ca2cf:a12d79aa00000018 (host=slave-cn07:22000):(Total: 9m2s, non-child: 16.000ms, % non-child: 0.00%)
  1401. Fragment Instance Lifecycle Event Timeline: 9m2s
  1402. - Prepare Finished: 0.000ns (0.000ns)
  1403. - Open Finished: 7s576ms (7s576ms)
  1404. - First Batch Produced: 7s576ms (0.000ns)
  1405. - First Batch Sent: 7s580ms (4.000ms)
  1406. - ExecInternal Finished: 9m2s (8m55s)
  1407. MemoryUsage(16s000ms): 46.60 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB
  1408. ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
  1409. - AverageThreadTokens: 1.01
  1410. - BloomFilterBytes: 2.00 MB (2097152)
  1411. - PeakMemoryUsage: 66.43 MB (69657570)
  1412. - PeakReservation: 54.00 MB (56623104)
  1413. - PeakUsedReservation: 0
  1414. - PerHostPeakMemUsage: 2.05 GB (2206373452)
  1415. - RowsProduced: 455.88K (455878)
  1416. - TotalNetworkReceiveTime: 7s972ms
  1417. - TotalNetworkSendTime: 8m53s
  1418. - TotalStorageWaitTime: 0.000ns
  1419. - TotalThreadsInvoluntaryContextSwitches: 5 (5)
  1420. - TotalThreadsTotalWallClockTime: 9m10s
  1421. - TotalThreadsSysTime: 355.681ms
  1422. - TotalThreadsUserTime: 1s889ms
  1423. - TotalThreadsVoluntaryContextSwitches: 13.01K (13013)
  1424. Buffer pool:
  1425. - AllocTime: 0.000ns
  1426. - CumulativeAllocationBytes: 2.00 MB (2097152)
  1427. - CumulativeAllocations: 2 (2)
  1428. - PeakReservation: 2.00 MB (2097152)
  1429. - PeakUnpinnedBytes: 0
  1430. - PeakUsedReservation: 2.00 MB (2097152)
  1431. - ReadIoBytes: 0
  1432. - ReadIoOps: 0 (0)
  1433. - ReadIoWaitTime: 0.000ns
  1434. - ReservationLimit: 2.00 MB (2097152)
  1435. - WriteIoBytes: 0
  1436. - WriteIoOps: 0 (0)
  1437. - WriteIoWaitTime: 0.000ns
  1438. Fragment Instance Lifecycle Timings:
  1439. - ExecTime: 8m55s
  1440. - ExecTreeExecTime: 1s088ms
  1441. - OpenTime: 7s576ms
  1442. - ExecTreeOpenTime: 7s300ms
  1443. - PrepareTime: 0.000ns
  1444. - ExecTreePrepareTime: 0.000ns
  1445. KrpcDataStreamSender (dst_id=8):(Total: 8m54s, non-child: 192.009ms, % non-child: 0.04%)
  1446. BytesSent(16s000ms): 802.85 KB, 2.40 MB, 3.53 MB, 4.61 MB, 5.70 MB, 6.79 MB, 7.91 MB, 9.01 MB, 10.12 MB, 11.23 MB, 12.34 MB, 13.43 MB, 14.54 MB, 15.66 MB, 16.77 MB, 17.88 MB, 18.99 MB, 20.11 MB, 21.23 MB, 22.33 MB, 23.45 MB, 24.59 MB, 25.73 MB, 26.86 MB, 28.00 MB, 29.15 MB, 30.27 MB, 31.39 MB, 32.54 MB, 33.68 MB, 34.81 MB, 35.93 MB, 37.05 MB
  1447. - EosSent: 1 (1)
  1448. - NetworkThroughput: 43.59 MB/sec
  1449. - PeakMemoryUsage: 3.61 KB (3696)
  1450. - RowsSent: 455.88K (455878)
  1451. - RpcFailure: 0 (0)
  1452. - RpcRetry: 0 (0)
  1453. - SerializeBatchTime: 180.008ms
  1454. - TotalBytesSent: 38.65 MB (40530581)
  1455. - UncompressedRowBatchSize: 56.52 MB (59264140)
  1456. HASH_JOIN_NODE (id=4):(Total: 8s384ms, non-child: 1s232ms, % non-child: 14.69%)
  1457. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  1458. - BuildRows: 459.67K (459665)
  1459. - BuildTime: 244.011ms
  1460. - NumHashTableBuildsSkipped: 0 (0)
  1461. - PeakMemoryUsage: 52.07 MB (54595840)
  1462. - ProbeRows: 7.37M (7370248)
  1463. - ProbeRowsPartitioned: 0 (0)
  1464. - ProbeTime: 976.046ms
  1465. - RowsReturned: 455.88K (455878)
  1466. - RowsReturnedRate: 54.37 K/sec
  1467. Buffer pool:
  1468. - AllocTime: 28.001ms
  1469. - CumulativeAllocationBytes: 52.00 MB (54525952)
  1470. - CumulativeAllocations: 88 (88)
  1471. - PeakReservation: 52.00 MB (54525952)
  1472. - PeakUnpinnedBytes: 0
  1473. - PeakUsedReservation: 52.00 MB (54525952)
  1474. - ReadIoBytes: 0
  1475. - ReadIoOps: 0 (0)
  1476. - ReadIoWaitTime: 0.000ns
  1477. - WriteIoBytes: 0
  1478. - WriteIoOps: 0 (0)
  1479. - WriteIoWaitTime: 0.000ns
  1480. Hash Join Builder (join_node_id=4):
  1481. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  1482. Runtime filters: 2 of 2 Runtime Filters Published
  1483. - BuildRowsPartitionTime: 204.009ms
  1484. - BuildRowsPartitioned: 459.67K (459665)
  1485. - HashBuckets: 1.05M (1048576)
  1486. - HashCollisions: 0 (0)
  1487. - HashTablesBuildTime: 36.001ms
  1488. - LargestPartitionPercent: 6 (6)
  1489. - MaxPartitionLevel: 0 (0)
  1490. - NumRepartitions: 0 (0)
  1491. - PartitionsCreated: 16 (16)
  1492. - PeakMemoryUsage: 30.12 KB (30848)
  1493. - RepartitionTime: 0.000ns
  1494. - SpilledPartitions: 0 (0)
  1495. EXCHANGE_NODE (id=7):(Total: 7s052ms, non-child: 28.001ms, % non-child: 0.40%)
  1496. - ConvertRowBatchTime: 16.000ms
  1497. - PeakMemoryUsage: 176.00 KB (180224)
  1498. - RowsReturned: 459.67K (459665)
  1499. - RowsReturnedRate: 65.18 K/sec
  1500. Buffer pool:
  1501. - AllocTime: 48.002ms
  1502. - CumulativeAllocationBytes: 48.14 MB (50479104)
  1503. - CumulativeAllocations: 4.11K (4110)
  1504. - PeakReservation: 176.00 KB (180224)
  1505. - PeakUnpinnedBytes: 0
  1506. - PeakUsedReservation: 176.00 KB (180224)
  1507. - ReadIoBytes: 0
  1508. - ReadIoOps: 0 (0)
  1509. - ReadIoWaitTime: 0.000ns
  1510. - WriteIoBytes: 0
  1511. - WriteIoOps: 0 (0)
  1512. - WriteIoWaitTime: 0.000ns
  1513. Dequeue:
  1514. BytesDequeued(500.000ms): 0, 0, 0, 389.38 KB, 1.52 MB, 2.57 MB, 3.75 MB, 6.33 MB, 10.11 MB, 14.58 MB, 19.34 MB, 24.01 MB, 28.78 MB, 32.33 MB, 36.25 MB, 38.96 MB
  1515. - FirstBatchWaitTime: 1s024ms
  1516. - TotalBytesDequeued: 39.01 MB (40910185)
  1517. - TotalGetBatchTime: 7s036ms
  1518. - DataWaitTime: 7s024ms
  1519. Enqueue:
  1520. BytesReceived(500.000ms): 0, 0, 0, 280.34 KB, 1.09 MB, 1.85 MB, 2.70 MB, 4.57 MB, 7.30 MB, 10.54 MB, 13.99 MB, 17.38 MB, 20.85 MB, 23.42 MB, 26.26 MB, 28.22 MB
  1521. DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  1522. - DispatchTime: (Avg: 51.635us ; Min: 14.486us ; Max: 209.925us ; Number of samples: 2055)
  1523. - DeserializeRowBatchTime: 64.003ms
  1524. - TotalBatchesEnqueued: 2.06K (2055)
  1525. - TotalBatchesReceived: 2.06K (2055)
  1526. - TotalBytesReceived: 28.26 MB (29635433)
  1527. - TotalEarlySenders: 0 (0)
  1528. - TotalEosReceived: 6 (6)
  1529. - TotalHasDeferredRPCsTime: 0.000ns
  1530. - TotalRPCsDeferred: 0 (0)
  1531. EXCHANGE_NODE (id=6):(Total: 1s020ms, non-child: 100.004ms, % non-child: 9.80%)
  1532. - ConvertRowBatchTime: 72.003ms
  1533. - PeakMemoryUsage: 12.21 MB (12801575)
  1534. - RowsReturned: 7.37M (7370248)
  1535. - RowsReturnedRate: 7.23 M/sec
  1536. Buffer pool:
  1537. - AllocTime: 248.011ms
  1538. - CumulativeAllocationBytes: 348.32 MB (365240320)
  1539. - CumulativeAllocations: 29.73K (29726)
  1540. - PeakReservation: 12.20 MB (12787712)
  1541. - PeakUnpinnedBytes: 0
  1542. - PeakUsedReservation: 12.20 MB (12787712)
  1543. - ReadIoBytes: 0
  1544. - ReadIoOps: 0 (0)
  1545. - ReadIoWaitTime: 0.000ns
  1546. - WriteIoBytes: 0
  1547. - WriteIoOps: 0 (0)
  1548. - WriteIoWaitTime: 0.000ns
  1549. Dequeue:
  1550. BytesDequeued(16s000ms): 6.60 MB, 19.15 MB, 27.16 MB, 35.04 MB, 42.94 MB, 50.87 MB, 59.15 MB, 67.31 MB, 75.57 MB, 83.78 MB, 92.14 MB, 100.32 MB, 108.53 MB, 116.88 MB, 125.02 MB, 133.36 MB, 141.72 MB, 150.18 MB, 158.74 MB, 167.14 MB, 175.61 MB, 184.19 MB, 192.65 MB, 201.16 MB, 209.68 MB, 218.21 MB, 226.60 MB, 234.98 MB, 243.61 MB, 252.15 MB, 260.64 MB, 269.01 MB, 277.45 MB
  1551. - FirstBatchWaitTime: 920.043ms
  1552. - TotalBytesDequeued: 288.18 MB (302180168)
  1553. - TotalGetBatchTime: 936.044ms
  1554. - DataWaitTime: 920.043ms
  1555. Enqueue:
  1556. BytesReceived(16s000ms): 7.77 MB, 14.44 MB, 18.74 MB, 22.99 MB, 27.31 MB, 31.60 MB, 36.08 MB, 40.42 MB, 44.80 MB, 49.27 MB, 53.70 MB, 58.10 MB, 62.57 MB, 67.06 MB, 71.51 MB, 76.00 MB, 80.49 MB, 85.07 MB, 89.55 MB, 93.94 MB, 98.46 MB, 103.11 MB, 107.67 MB, 112.28 MB, 116.88 MB, 121.57 MB, 126.13 MB, 130.65 MB, 135.30 MB, 139.92 MB, 144.52 MB, 148.98 MB, 153.46 MB
  1557. DeferredQueueSize(16s000ms): 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  1558. - DispatchTime: (Avg: 44.406us ; Min: 11.160us ; Max: 779.821us ; Number of samples: 14863)
  1559. - DeserializeRowBatchTime: 476.022ms
  1560. - TotalBatchesEnqueued: 14.86K (14863)
  1561. - TotalBatchesReceived: 14.86K (14863)
  1562. - TotalBytesReceived: 155.16 MB (162697052)
  1563. - TotalEarlySenders: 0 (0)
  1564. - TotalEosReceived: 6 (6)
  1565. - TotalHasDeferredRPCsTime: 6s256ms
  1566. - TotalRPCsDeferred: 6 (6)
  1567. CodeGen:(Total: 268.012ms, non-child: 268.012ms, % non-child: 100.00%)
  1568. - CodegenTime: 0.000ns
  1569. - CompileTime: 72.003ms
  1570. - LoadTime: 0.000ns
  1571. - ModuleBitcodeSize: 1.95 MB (2040108)
  1572. - NumFunctions: 78 (78)
  1573. - NumInstructions: 2.75K (2748)
  1574. - OptimizationTime: 176.008ms
  1575. - PeakMemoryUsage: 1.34 MB (1406976)
  1576. - PrepareTime: 16.000ms
  1577. Averaged Fragment F00:(Total: 8m32s, non-child: 40.668ms, % non-child: 0.01%)
  1578. split sizes: min: 556.85 MB, max: 612.99 MB, avg: 581.16 MB, stddev: 19.58 MB
  1579. completion times: min:7m58s max:8m46s mean: 8m32s stddev:16s012ms
  1580. execution rates: min:1.09 MB/sec max:1.17 MB/sec mean:1.13 MB/sec stddev:27.38 KB/sec
  1581. num instances: 6
  1582. - AverageThreadTokens: 10.95
  1583. - BloomFilterBytes: 2.00 MB (2097152)
  1584. - PeakMemoryUsage: 247.98 MB (260028936)
  1585. - PeakReservation: 2.00 MB (2097152)
  1586. - PeakUsedReservation: 0
  1587. - PerHostPeakMemUsage: 1.71 GB (1836833523)
  1588. - RowsProduced: 7.37M (7368006)
  1589. - TotalNetworkReceiveTime: 0.000ns
  1590. - TotalNetworkSendTime: 8m29s
  1591. - TotalStorageWaitTime: 9s619ms
  1592. - TotalThreadsInvoluntaryContextSwitches: 12 (12)
  1593. - TotalThreadsTotalWallClockTime: 1h33m
  1594. - TotalThreadsSysTime: 986.538ms
  1595. - TotalThreadsUserTime: 3s929ms
  1596. - TotalThreadsVoluntaryContextSwitches: 19.85K (19848)
  1597. Buffer pool:
  1598. - AllocTime: 666.698us
  1599. - CumulativeAllocationBytes: 2.00 MB (2097152)
  1600. - CumulativeAllocations: 2 (2)
  1601. - PeakReservation: 2.00 MB (2097152)
  1602. - PeakUnpinnedBytes: 0
  1603. - PeakUsedReservation: 2.00 MB (2097152)
  1604. - ReadIoBytes: 0
  1605. - ReadIoOps: 0 (0)
  1606. - ReadIoWaitTime: 0.000ns
  1607. - ReservationLimit: 2.00 MB (2097152)
  1608. - WriteIoBytes: 0
  1609. - WriteIoOps: 0 (0)
  1610. - WriteIoWaitTime: 0.000ns
  1611. Fragment Instance Lifecycle Timings:
  1612. - ExecTime: 8m32s
  1613. - ExecTreeExecTime: 1s212ms
  1614. - OpenTime: 112.005ms
  1615. - ExecTreeOpenTime: 0.000ns
  1616. - PrepareTime: 666.697us
  1617. - ExecTreePrepareTime: 666.697us
  1618. KrpcDataStreamSender (dst_id=6):(Total: 8m31s, non-child: 8m31s, % non-child: 100.00%)
  1619. - EosSent: 6 (6)
  1620. - NetworkThroughput: 18.54 MB/sec
  1621. - PeakMemoryUsage: 191.25 KB (195840)
  1622. - RowsSent: 7.37M (7368006)
  1623. - RpcFailure: 0 (0)
  1624. - RpcRetry: 0 (0)
  1625. - SerializeBatchTime: 834.038ms
  1626. - TotalBytesSent: 155.12 MB (162656546)
  1627. - UncompressedRowBatchSize: 288.09 MB (302088273)
  1628. HDFS_SCAN_NODE (id=1):(Total: 1s209ms, non-child: 1s209ms, % non-child: 100.00%)
  1629. - AverageHdfsReadThreadConcurrency: 0.00
  1630. - AverageScannerThreadConcurrency: 9.96
  1631. - BytesRead: 214.18 MB (224586931)
  1632. - BytesReadDataNodeCache: 0
  1633. - BytesReadLocal: 214.18 MB (224586931)
  1634. - BytesReadRemoteUnexpected: 0
  1635. - BytesReadShortCircuit: 214.18 MB (224586931)
  1636. - CachedFileHandlesHitCount: 85 (85)
  1637. - CachedFileHandlesMissCount: 10 (10)
  1638. - CollectionItemsRead: 0 (0)
  1639. - DecompressionTime: 624.029ms
  1640. - MaxCompressedTextFileLength: 0
  1641. - NumColumns: 6 (6)
  1642. - NumDictFilteredRowGroups: 0 (0)
  1643. - NumDisksAccessed: 1 (1)
  1644. - NumRowGroups: 10 (10)
  1645. - NumScannerThreadsStarted: 10 (10)
  1646. - NumScannersWithNoReads: 0 (0)
  1647. - NumStatsFilteredRowGroups: 0 (0)
  1648. - PeakMemoryUsage: 245.71 MB (257643049)
  1649. - PerReadThreadRawHdfsThroughput: 398.89 MB/sec
  1650. - RemoteScanRanges: 0 (0)
  1651. - RowBatchQueueGetWaitTime: 214.009ms
  1652. - RowBatchQueuePutWaitTime: 1h24m
  1653. - RowsRead: 26.71M (26706853)
  1654. - RowsReturned: 7.37M (7368006)
  1655. - RowsReturnedRate: 6.09 M/sec
  1656. - ScanRangesComplete: 10 (10)
  1657. - ScannerThreadsInvoluntaryContextSwitches: 7 (7)
  1658. - ScannerThreadsTotalWallClockTime: 1h25m
  1659. - MaterializeTupleTime(*): 1s284ms
  1660. - ScannerThreadsSysTime: 653.212ms
  1661. - ScannerThreadsUserTime: 1s769ms
  1662. - ScannerThreadsVoluntaryContextSwitches: 7.38K (7384)
  1663. - TotalRawHdfsOpenFileTime(*): 211.342ms
  1664. - TotalRawHdfsReadTime(*): 631.362ms
  1665. - TotalReadThroughput: 428.26 KB/sec
  1666. Filter 0 (1.00 MB):
  1667. - Files processed: 0 (0)
  1668. - Files rejected: 0 (0)
  1669. - Files total: 0 (0)
  1670. - RowGroups processed: 0 (0)
  1671. - RowGroups rejected: 0 (0)
  1672. - RowGroups total: 0 (0)
  1673. - Rows processed: 2.15M (2148457)
  1674. - Rows rejected: 208.74K (208736)
  1675. - Rows total: 26.71M (26706853)
  1676. - Splits processed: 0 (0)
  1677. - Splits rejected: 0 (0)
  1678. - Splits total: 0 (0)
  1679. Filter 1 (1.00 MB):
  1680. - Files processed: 0 (0)
  1681. - Files rejected: 0 (0)
  1682. - Files total: 0 (0)
  1683. - RowGroups processed: 0 (0)
  1684. - RowGroups rejected: 0 (0)
  1685. - RowGroups total: 0 (0)
  1686. - Rows processed: 833.76K (833756)
  1687. - Rows rejected: 75.31K (75313)
  1688. - Rows total: 26.50M (26498116)
  1689. - Splits processed: 0 (0)
  1690. - Splits rejected: 0 (0)
  1691. - Splits total: 0 (0)
  1692. CodeGen:(Total: 109.338ms, non-child: 109.338ms, % non-child: 100.00%)
  1693. - CodegenTime: 2.666ms
  1694. - CompileTime: 20.000ms
  1695. - LoadTime: 0.000ns
  1696. - ModuleBitcodeSize: 1.95 MB (2040108)
  1697. - NumFunctions: 64 (64)
  1698. - NumInstructions: 1.09K (1091)
  1699. - OptimizationTime: 71.336ms
  1700. - PeakMemoryUsage: 545.50 KB (558592)
  1701. - PrepareTime: 17.334ms
  1702. Fragment F00:
  1703. Instance 984ea1ea895ca2cf:a12d79aa00000005 (host=slave-cn05:22000):(Total: 8m46s, non-child: 32.001ms, % non-child: 0.01%)
  1704. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:12/590.25 MB
  1705. Filter 1 arrival: 7s636ms
  1706. Filter 0 arrival: 7s638ms
  1707. Fragment Instance Lifecycle Event Timeline: 8m46s
  1708. - Prepare Finished: 0.000ns (0.000ns)
  1709. - Open Finished: 104.005ms (104.005ms)
  1710. - First Batch Produced: 1s248ms (1s144ms)
  1711. - First Batch Sent: 1s248ms (0.000ns)
  1712. - ExecInternal Finished: 8m46s (8m44s)
  1713. MemoryUsage(16s000ms): 213.16 MB, 249.66 MB, 249.14 MB, 245.64 MB, 245.65 MB, 245.65 MB, 245.63 MB, 245.65 MB, 245.67 MB, 245.68 MB, 245.65 MB, 245.61 MB, 245.66 MB, 243.38 MB, 222.96 MB, 191.00 MB, 169.94 MB, 161.45 MB, 161.36 MB, 161.30 MB, 160.95 MB, 153.91 MB, 153.41 MB, 153.40 MB, 153.42 MB, 153.45 MB, 153.48 MB, 153.45 MB, 151.23 MB, 142.76 MB, 114.07 MB, 89.45 MB
  1714. ThreadUsage(16s000ms): 12, 13, 13, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 11, 11, 11, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10
  1715. - AverageThreadTokens: 11.20
  1716. - BloomFilterBytes: 2.00 MB (2097152)
  1717. - PeakMemoryUsage: 250.45 MB (262620415)
  1718. - PeakReservation: 2.00 MB (2097152)
  1719. - PeakUsedReservation: 0
  1720. - PerHostPeakMemUsage: 2.03 GB (2177414655)
  1721. - RowsProduced: 7.47M (7465322)
  1722. - TotalNetworkReceiveTime: 0.000ns
  1723. - TotalNetworkSendTime: 8m42s
  1724. - TotalStorageWaitTime: 11s552ms
  1725. - TotalThreadsInvoluntaryContextSwitches: 13 (13)
  1726. - TotalThreadsTotalWallClockTime: 1h38m
  1727. - TotalThreadsSysTime: 1s184ms
  1728. - TotalThreadsUserTime: 4s003ms
  1729. - TotalThreadsVoluntaryContextSwitches: 20.02K (20017)
  1730. Buffer pool:
  1731. - AllocTime: 0.000ns
  1732. - CumulativeAllocationBytes: 2.00 MB (2097152)
  1733. - CumulativeAllocations: 2 (2)
  1734. - PeakReservation: 2.00 MB (2097152)
  1735. - PeakUnpinnedBytes: 0
  1736. - PeakUsedReservation: 2.00 MB (2097152)
  1737. - ReadIoBytes: 0
  1738. - ReadIoOps: 0 (0)
  1739. - ReadIoWaitTime: 0.000ns
  1740. - ReservationLimit: 2.00 MB (2097152)
  1741. - WriteIoBytes: 0
  1742. - WriteIoOps: 0 (0)
  1743. - WriteIoWaitTime: 0.000ns
  1744. Fragment Instance Lifecycle Timings:
  1745. - ExecTime: 8m45s
  1746. - ExecTreeExecTime: 1s212ms
  1747. - OpenTime: 104.005ms
  1748. - ExecTreeOpenTime: 0.000ns
  1749. - PrepareTime: 0.000ns
  1750. - ExecTreePrepareTime: 0.000ns
  1751. KrpcDataStreamSender (dst_id=6):(Total: 8m44s, non-child: 2s080ms, % non-child: 0.40%)
  1752. BytesSent(16s000ms): 7.67 MB, 14.40 MB, 18.51 MB, 22.72 MB, 26.85 MB, 31.02 MB, 35.51 MB, 39.87 MB, 44.31 MB, 48.57 MB, 52.97 MB, 57.30 MB, 61.64 MB, 66.05 MB, 70.54 MB, 75.08 MB, 79.56 MB, 83.52 MB, 87.93 MB, 91.98 MB, 96.47 MB, 100.62 MB, 105.05 MB, 109.10 MB, 113.68 MB, 118.16 MB, 122.35 MB, 126.63 MB, 131.25 MB, 135.41 MB, 139.09 MB, 144.53 MB
  1753. - EosSent: 6 (6)
  1754. - NetworkThroughput: 18.81 MB/sec
  1755. - PeakMemoryUsage: 191.25 KB (195840)
  1756. - RowsSent: 7.47M (7465322)
  1757. - RpcFailure: 0 (0)
  1758. - RpcRetry: 0 (0)
  1759. - SerializeBatchTime: 968.053ms
  1760. - TotalBytesSent: 157.18 MB (164817658)
  1761. - UncompressedRowBatchSize: 291.90 MB (306078202)
  1762. HDFS_SCAN_NODE (id=1):(Total: 1s212ms, non-child: 1s212ms, % non-child: 100.00%)
  1763. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:12/590.25 MB
  1764. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12
  1765. Runtime filters: Not all filters arrived (arrived: [], missing [0, 1]), waited for 924ms
  1766. Hdfs Read Thread Concurrency Bucket: 0:99.9% 1:0.09506% 2:0% 3:0% 4:0% 5:0%
  1767. File Formats: PARQUET/SNAPPY:12
  1768. BytesRead(16s000ms): 185.10 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB
  1769. - FooterProcessingTime: (Avg: 161.342ms ; Min: 32.001ms ; Max: 356.019ms ; Number of samples: 12)
  1770. - AverageHdfsReadThreadConcurrency: 0.00
  1771. - AverageScannerThreadConcurrency: 10.20
  1772. - BytesRead: 217.75 MB (228329065)
  1773. - BytesReadDataNodeCache: 0
  1774. - BytesReadLocal: 217.75 MB (228329065)
  1775. - BytesReadRemoteUnexpected: 0
  1776. - BytesReadShortCircuit: 217.75 MB (228329065)
  1777. - CachedFileHandlesHitCount: 93 (93)
  1778. - CachedFileHandlesMissCount: 12 (12)
  1779. - CollectionItemsRead: 0 (0)
  1780. - DecompressionTime: 604.033ms
  1781. - MaxCompressedTextFileLength: 0
  1782. - NumColumns: 6 (6)
  1783. - NumDictFilteredRowGroups: 0 (0)
  1784. - NumDisksAccessed: 1 (1)
  1785. - NumRowGroups: 12 (12)
  1786. - NumScannerThreadsStarted: 12 (12)
  1787. - NumScannersWithNoReads: 0 (0)
  1788. - NumStatsFilteredRowGroups: 0 (0)
  1789. - PeakMemoryUsage: 248.17 MB (260223264)
  1790. - PerReadThreadRawHdfsThroughput: 333.96 MB/sec
  1791. - RemoteScanRanges: 0 (0)
  1792. - RowBatchQueueGetWaitTime: 220.012ms
  1793. - RowBatchQueuePutWaitTime: 1h29m
  1794. - RowsRead: 27.11M (27113379)
  1795. - RowsReturned: 7.47M (7465322)
  1796. - RowsReturnedRate: 6.16 M/sec
  1797. - ScanRangesComplete: 12 (12)
  1798. - ScannerThreadsInvoluntaryContextSwitches: 7 (7)
  1799. - ScannerThreadsTotalWallClockTime: 1h29m
  1800. - MaterializeTupleTime(*): 1s436ms
  1801. - ScannerThreadsSysTime: 700.085ms
  1802. - ScannerThreadsUserTime: 1s763ms
  1803. - ScannerThreadsVoluntaryContextSwitches: 7.44K (7436)
  1804. - TotalRawHdfsOpenFileTime(*): 208.011ms
  1805. - TotalRawHdfsReadTime(*): 652.035ms
  1806. - TotalReadThroughput: 423.91 KB/sec
  1807. Filter 0 (1.00 MB):
  1808. - Files processed: 0 (0)
  1809. - Files rejected: 0 (0)
  1810. - Files total: 0 (0)
  1811. - RowGroups processed: 0 (0)
  1812. - RowGroups rejected: 0 (0)
  1813. - RowGroups total: 0 (0)
  1814. - Rows processed: 2.83M (2827126)
  1815. - Rows rejected: 275.38K (275384)
  1816. - Rows total: 27.11M (27113379)
  1817. - Splits processed: 0 (0)
  1818. - Splits rejected: 0 (0)
  1819. - Splits total: 0 (0)
  1820. Filter 1 (1.00 MB):
  1821. - Files processed: 0 (0)
  1822. - Files rejected: 0 (0)
  1823. - Files total: 0 (0)
  1824. - RowGroups processed: 0 (0)
  1825. - RowGroups rejected: 0 (0)
  1826. - RowGroups total: 0 (0)
  1827. - Rows processed: 766.02K (766020)
  1828. - Rows rejected: 68.69K (68695)
  1829. - Rows total: 26.84M (26837995)
  1830. - Splits processed: 0 (0)
  1831. - Splits rejected: 0 (0)
  1832. - Splits total: 0 (0)
  1833. CodeGen:(Total: 104.005ms, non-child: 104.005ms, % non-child: 100.00%)
  1834. - CodegenTime: 0.000ns
  1835. - CompileTime: 20.001ms
  1836. - LoadTime: 0.000ns
  1837. - ModuleBitcodeSize: 1.95 MB (2040108)
  1838. - NumFunctions: 64 (64)
  1839. - NumInstructions: 1.09K (1091)
  1840. - OptimizationTime: 64.003ms
  1841. - PeakMemoryUsage: 545.50 KB (558592)
  1842. - PrepareTime: 20.001ms
  1843. Instance 984ea1ea895ca2cf:a12d79aa00000003 (host=slave-cn03:22000):(Total: 8m44s, non-child: 44.002ms, % non-child: 0.01%)
  1844. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/612.99 MB
  1845. Filter 1 arrival: 7s606ms
  1846. Filter 0 arrival: 7s608ms
  1847. Fragment Instance Lifecycle Event Timeline: 8m44s
  1848. - Prepare Finished: 0.000ns (0.000ns)
  1849. - Open Finished: 108.004ms (108.004ms)
  1850. - First Batch Produced: 1s240ms (1s132ms)
  1851. - First Batch Sent: 1s240ms (0.000ns)
  1852. - ExecInternal Finished: 8m44s (8m43s)
  1853. MemoryUsage(16s000ms): 215.21 MB, 256.70 MB, 256.52 MB, 256.57 MB, 256.46 MB, 256.39 MB, 256.43 MB, 256.43 MB, 256.38 MB, 256.23 MB, 256.21 MB, 253.85 MB, 249.24 MB, 248.51 MB, 218.87 MB, 186.15 MB, 183.79 MB, 179.33 MB, 179.29 MB, 179.20 MB, 179.00 MB, 174.90 MB, 169.44 MB, 169.49 MB, 169.49 MB, 169.53 MB, 169.49 MB, 166.72 MB, 161.47 MB, 154.11 MB, 116.28 MB, 98.06 MB
  1854. ThreadUsage(16s000ms): 11, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 10
  1855. - AverageThreadTokens: 11.57
  1856. - BloomFilterBytes: 2.00 MB (2097152)
  1857. - PeakMemoryUsage: 257.20 MB (269698512)
  1858. - PeakReservation: 2.00 MB (2097152)
  1859. - PeakUsedReservation: 0
  1860. - PerHostPeakMemUsage: 1.57 GB (1688006861)
  1861. - RowsProduced: 7.74M (7739854)
  1862. - TotalNetworkReceiveTime: 0.000ns
  1863. - TotalNetworkSendTime: 8m41s
  1864. - TotalStorageWaitTime: 11s664ms
  1865. - TotalThreadsInvoluntaryContextSwitches: 14 (14)
  1866. - TotalThreadsTotalWallClockTime: 1h41m
  1867. - TotalThreadsSysTime: 902.758ms
  1868. - TotalThreadsUserTime: 4s068ms
  1869. - TotalThreadsVoluntaryContextSwitches: 20.53K (20531)
  1870. Buffer pool:
  1871. - AllocTime: 0.000ns
  1872. - CumulativeAllocationBytes: 2.00 MB (2097152)
  1873. - CumulativeAllocations: 2 (2)
  1874. - PeakReservation: 2.00 MB (2097152)
  1875. - PeakUnpinnedBytes: 0
  1876. - PeakUsedReservation: 2.00 MB (2097152)
  1877. - ReadIoBytes: 0
  1878. - ReadIoOps: 0 (0)
  1879. - ReadIoWaitTime: 0.000ns
  1880. - ReservationLimit: 2.00 MB (2097152)
  1881. - WriteIoBytes: 0
  1882. - WriteIoOps: 0 (0)
  1883. - WriteIoWaitTime: 0.000ns
  1884. Fragment Instance Lifecycle Timings:
  1885. - ExecTime: 8m44s
  1886. - ExecTreeExecTime: 1s212ms
  1887. - OpenTime: 108.004ms
  1888. - ExecTreeOpenTime: 0.000ns
  1889. - PrepareTime: 0.000ns
  1890. - ExecTreePrepareTime: 0.000ns
  1891. KrpcDataStreamSender (dst_id=6):(Total: 8m43s, non-child: 1s796ms, % non-child: 0.34%)
  1892. BytesSent(16s000ms): 8.11 MB, 14.85 MB, 19.11 MB, 23.33 MB, 27.78 MB, 31.90 MB, 36.29 MB, 40.59 MB, 44.97 MB, 49.31 MB, 53.53 MB, 57.95 MB, 62.33 MB, 66.76 MB, 71.16 MB, 75.81 MB, 80.34 MB, 84.93 MB, 89.23 MB, 93.65 MB, 98.15 MB, 102.98 MB, 107.56 MB, 112.02 MB, 116.64 MB, 121.33 MB, 126.00 MB, 130.52 MB, 135.16 MB, 139.78 MB, 145.15 MB, 150.73 MB
  1893. - EosSent: 6 (6)
  1894. - NetworkThroughput: 18.42 MB/sec
  1895. - PeakMemoryUsage: 191.25 KB (195840)
  1896. - RowsSent: 7.74M (7739854)
  1897. - RpcFailure: 0 (0)
  1898. - RpcRetry: 0 (0)
  1899. - SerializeBatchTime: 900.040ms
  1900. - TotalBytesSent: 162.95 MB (170862528)
  1901. - UncompressedRowBatchSize: 302.63 MB (317334014)
  1902. HDFS_SCAN_NODE (id=1):(Total: 1s212ms, non-child: 1s212ms, % non-child: 100.00%)
  1903. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/612.99 MB
  1904. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11
  1905. Runtime filters: Not all filters arrived (arrived: [], missing [0, 1]), waited for 924ms
  1906. Hdfs Read Thread Concurrency Bucket: 0:99.9% 1:0.09533% 2:0% 3:0% 4:0% 5:0%
  1907. File Formats: PARQUET/SNAPPY:11
  1908. BytesRead(16s000ms): 188.96 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB
  1909. - FooterProcessingTime: (Avg: 204.009ms ; Min: 24.001ms ; Max: 488.022ms ; Number of samples: 11)
  1910. - AverageHdfsReadThreadConcurrency: 0.00
  1911. - AverageScannerThreadConcurrency: 10.58
  1912. - BytesRead: 226.05 MB (237035044)
  1913. - BytesReadDataNodeCache: 0
  1914. - BytesReadLocal: 226.05 MB (237035044)
  1915. - BytesReadRemoteUnexpected: 0
  1916. - BytesReadShortCircuit: 226.05 MB (237035044)
  1917. - CachedFileHandlesHitCount: 88 (88)
  1918. - CachedFileHandlesMissCount: 11 (11)
  1919. - CollectionItemsRead: 0 (0)
  1920. - DecompressionTime: 612.027ms
  1921. - MaxCompressedTextFileLength: 0
  1922. - NumColumns: 6 (6)
  1923. - NumDictFilteredRowGroups: 0 (0)
  1924. - NumDisksAccessed: 1 (1)
  1925. - NumRowGroups: 11 (11)
  1926. - NumScannerThreadsStarted: 11 (11)
  1927. - NumScannersWithNoReads: 0 (0)
  1928. - NumStatsFilteredRowGroups: 0 (0)
  1929. - PeakMemoryUsage: 254.93 MB (267310577)
  1930. - PerReadThreadRawHdfsThroughput: 267.82 MB/sec
  1931. - RemoteScanRanges: 0 (0)
  1932. - RowBatchQueueGetWaitTime: 208.009ms
  1933. - RowBatchQueuePutWaitTime: 1h32m
  1934. - RowsRead: 28.16M (28158141)
  1935. - RowsReturned: 7.74M (7739854)
  1936. - RowsReturnedRate: 6.39 M/sec
  1937. - ScanRangesComplete: 11 (11)
  1938. - ScannerThreadsInvoluntaryContextSwitches: 9 (9)
  1939. - ScannerThreadsTotalWallClockTime: 1h32m
  1940. - MaterializeTupleTime(*): 1s300ms
  1941. - ScannerThreadsSysTime: 634.173ms
  1942. - ScannerThreadsUserTime: 1s844ms
  1943. - ScannerThreadsVoluntaryContextSwitches: 7.64K (7639)
  1944. - TotalRawHdfsOpenFileTime(*): 208.009ms
  1945. - TotalRawHdfsReadTime(*): 844.038ms
  1946. - TotalReadThroughput: 440.91 KB/sec
  1947. Filter 0 (1.00 MB):
  1948. - Files processed: 0 (0)
  1949. - Files rejected: 0 (0)
  1950. - Files total: 0 (0)
  1951. - RowGroups processed: 0 (0)
  1952. - RowGroups rejected: 0 (0)
  1953. - RowGroups total: 0 (0)
  1954. - Rows processed: 3.36M (3363127)
  1955. - Rows rejected: 329.58K (329581)
  1956. - Rows total: 28.16M (28158141)
  1957. - Splits processed: 0 (0)
  1958. - Splits rejected: 0 (0)
  1959. - Splits total: 0 (0)
  1960. Filter 1 (1.00 MB):
  1961. - Files processed: 0 (0)
  1962. - Files rejected: 0 (0)
  1963. - Files total: 0 (0)
  1964. - RowGroups processed: 0 (0)
  1965. - RowGroups rejected: 0 (0)
  1966. - RowGroups total: 0 (0)
  1967. - Rows processed: 1.32M (1324751)
  1968. - Rows rejected: 121.76K (121756)
  1969. - Rows total: 27.83M (27828560)
  1970. - Splits processed: 0 (0)
  1971. - Splits rejected: 0 (0)
  1972. - Splits total: 0 (0)
  1973. CodeGen:(Total: 104.004ms, non-child: 104.004ms, % non-child: 100.00%)
  1974. - CodegenTime: 4.000ms
  1975. - CompileTime: 20.000ms
  1976. - LoadTime: 0.000ns
  1977. - ModuleBitcodeSize: 1.95 MB (2040108)
  1978. - NumFunctions: 64 (64)
  1979. - NumInstructions: 1.09K (1091)
  1980. - OptimizationTime: 68.003ms
  1981. - PeakMemoryUsage: 545.50 KB (558592)
  1982. - PrepareTime: 16.000ms
  1983. Instance 984ea1ea895ca2cf:a12d79aa00000004 (host=slave-cn06:22000):(Total: 8m41s, non-child: 40.001ms, % non-child: 0.01%)
  1984. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/584.82 MB
  1985. Filter 1 arrival: 7s647ms
  1986. Filter 0 arrival: 7s648ms
  1987. Fragment Instance Lifecycle Event Timeline: 8m41s
  1988. - Prepare Finished: 4.000ms (4.000ms)
  1989. - Open Finished: 116.003ms (112.003ms)
  1990. - First Batch Produced: 1s256ms (1s140ms)
  1991. - First Batch Sent: 1s256ms (0.000ns)
  1992. - ExecInternal Finished: 8m41s (8m39s)
  1993. MemoryUsage(16s000ms): 213.09 MB, 245.62 MB, 245.62 MB, 245.59 MB, 245.52 MB, 245.48 MB, 245.47 MB, 245.50 MB, 245.41 MB, 245.40 MB, 245.38 MB, 245.41 MB, 245.38 MB, 241.65 MB, 207.07 MB, 175.51 MB, 166.57 MB, 166.32 MB, 165.35 MB, 160.78 MB, 155.98 MB, 153.20 MB, 153.22 MB, 153.18 MB, 153.14 MB, 153.17 MB, 153.19 MB, 147.93 MB, 143.07 MB, 117.99 MB, 81.85 MB, 75.38 MB
  1994. ThreadUsage(16s000ms): 11, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 11, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 9, 9
  1995. - AverageThreadTokens: 11.10
  1996. - BloomFilterBytes: 2.00 MB (2097152)
  1997. - PeakMemoryUsage: 252.25 MB (264506569)
  1998. - PeakReservation: 2.00 MB (2097152)
  1999. - PeakUsedReservation: 0
  2000. - PerHostPeakMemUsage: 938.16 MB (983735960)
  2001. - RowsProduced: 7.36M (7359961)
  2002. - TotalNetworkReceiveTime: 0.000ns
  2003. - TotalNetworkSendTime: 8m37s
  2004. - TotalStorageWaitTime: 10s864ms
  2005. - TotalThreadsInvoluntaryContextSwitches: 6 (6)
  2006. - TotalThreadsTotalWallClockTime: 1h36m
  2007. - TotalThreadsSysTime: 960.845ms
  2008. - TotalThreadsUserTime: 4s057ms
  2009. - TotalThreadsVoluntaryContextSwitches: 20.02K (20015)
  2010. Buffer pool:
  2011. - AllocTime: 0.000ns
  2012. - CumulativeAllocationBytes: 2.00 MB (2097152)
  2013. - CumulativeAllocations: 2 (2)
  2014. - PeakReservation: 2.00 MB (2097152)
  2015. - PeakUnpinnedBytes: 0
  2016. - PeakUsedReservation: 2.00 MB (2097152)
  2017. - ReadIoBytes: 0
  2018. - ReadIoOps: 0 (0)
  2019. - ReadIoWaitTime: 0.000ns
  2020. - ReservationLimit: 2.00 MB (2097152)
  2021. - WriteIoBytes: 0
  2022. - WriteIoOps: 0 (0)
  2023. - WriteIoWaitTime: 0.000ns
  2024. Fragment Instance Lifecycle Timings:
  2025. - ExecTime: 8m40s
  2026. - ExecTreeExecTime: 1s220ms
  2027. - OpenTime: 112.003ms
  2028. - ExecTreeOpenTime: 0.000ns
  2029. - PrepareTime: 0.000ns
  2030. - ExecTreePrepareTime: 0.000ns
  2031. KrpcDataStreamSender (dst_id=6):(Total: 8m39s, non-child: 1s836ms, % non-child: 0.35%)
  2032. BytesSent(16s000ms): 7.49 MB, 14.08 MB, 18.46 MB, 22.69 MB, 26.88 MB, 31.25 MB, 35.63 MB, 40.10 MB, 44.47 MB, 48.95 MB, 53.54 MB, 57.92 MB, 62.36 MB, 66.64 MB, 71.12 MB, 75.49 MB, 79.84 MB, 84.60 MB, 89.17 MB, 93.41 MB, 97.65 MB, 102.09 MB, 106.80 MB, 111.50 MB, 115.56 MB, 120.00 MB, 124.37 MB, 128.77 MB, 132.85 MB, 137.23 MB, 142.55 MB, 147.56 MB
  2033. - EosSent: 6 (6)
  2034. - NetworkThroughput: 18.77 MB/sec
  2035. - PeakMemoryUsage: 191.25 KB (195840)
  2036. - RowsSent: 7.36M (7359961)
  2037. - RpcFailure: 0 (0)
  2038. - RpcRetry: 0 (0)
  2039. - SerializeBatchTime: 824.026ms
  2040. - TotalBytesSent: 154.92 MB (162446039)
  2041. - UncompressedRowBatchSize: 287.78 MB (301758401)
  2042. HDFS_SCAN_NODE (id=1):(Total: 1s212ms, non-child: 1s212ms, % non-child: 100.00%)
  2043. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/584.82 MB
  2044. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11
  2045. Runtime filters: Not all filters arrived (arrived: [], missing [0, 1]), waited for 924ms
  2046. Hdfs Read Thread Concurrency Bucket: 0:99.9% 1:0.09597% 2:0% 3:0% 4:0% 5:0%
  2047. File Formats: PARQUET/SNAPPY:11
  2048. BytesRead(16s000ms): 183.95 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB
  2049. - FooterProcessingTime: (Avg: 176.369ms ; Min: 36.001ms ; Max: 424.013ms ; Number of samples: 11)
  2050. - AverageHdfsReadThreadConcurrency: 0.00
  2051. - AverageScannerThreadConcurrency: 10.10
  2052. - BytesRead: 215.42 MB (225882544)
  2053. - BytesReadDataNodeCache: 0
  2054. - BytesReadLocal: 215.42 MB (225882544)
  2055. - BytesReadRemoteUnexpected: 0
  2056. - BytesReadShortCircuit: 215.42 MB (225882544)
  2057. - CachedFileHandlesHitCount: 87 (87)
  2058. - CachedFileHandlesMissCount: 11 (11)
  2059. - CollectionItemsRead: 0 (0)
  2060. - DecompressionTime: 588.019ms
  2061. - MaxCompressedTextFileLength: 0
  2062. - NumColumns: 6 (6)
  2063. - NumDictFilteredRowGroups: 0 (0)
  2064. - NumDisksAccessed: 1 (1)
  2065. - NumRowGroups: 11 (11)
  2066. - NumScannerThreadsStarted: 11 (11)
  2067. - NumScannersWithNoReads: 0 (0)
  2068. - NumStatsFilteredRowGroups: 0 (0)
  2069. - PeakMemoryUsage: 249.97 MB (262109418)
  2070. - PerReadThreadRawHdfsThroughput: 287.98 MB/sec
  2071. - RemoteScanRanges: 0 (0)
  2072. - RowBatchQueueGetWaitTime: 216.007ms
  2073. - RowBatchQueuePutWaitTime: 1h27m
  2074. - RowsRead: 26.88M (26883304)
  2075. - RowsReturned: 7.36M (7359961)
  2076. - RowsReturnedRate: 6.07 M/sec
  2077. - ScanRangesComplete: 11 (11)
  2078. - ScannerThreadsInvoluntaryContextSwitches: 2 (2)
  2079. - ScannerThreadsTotalWallClockTime: 1h27m
  2080. - MaterializeTupleTime(*): 1s292ms
  2081. - ScannerThreadsSysTime: 628.239ms
  2082. - ScannerThreadsUserTime: 1s789ms
  2083. - ScannerThreadsVoluntaryContextSwitches: 7.44K (7442)
  2084. - TotalRawHdfsOpenFileTime(*): 300.009ms
  2085. - TotalRawHdfsReadTime(*): 748.024ms
  2086. - TotalReadThroughput: 423.39 KB/sec
  2087. Filter 0 (1.00 MB):
  2088. - Files processed: 0 (0)
  2089. - Files rejected: 0 (0)
  2090. - Files total: 0 (0)
  2091. - RowGroups processed: 0 (0)
  2092. - RowGroups rejected: 0 (0)
  2093. - RowGroups total: 0 (0)
  2094. - Rows processed: 4.13M (4130836)
  2095. - Rows rejected: 412.24K (412236)
  2096. - Rows total: 26.88M (26883304)
  2097. - Splits processed: 0 (0)
  2098. - Splits rejected: 0 (0)
  2099. - Splits total: 0 (0)
  2100. Filter 1 (1.00 MB):
  2101. - Files processed: 0 (0)
  2102. - Files rejected: 0 (0)
  2103. - Files total: 0 (0)
  2104. - RowGroups processed: 0 (0)
  2105. - RowGroups rejected: 0 (0)
  2106. - RowGroups total: 0 (0)
  2107. - Rows processed: 669.20K (669204)
  2108. - Rows rejected: 61.13K (61135)
  2109. - Rows total: 26.47M (26471068)
  2110. - Splits processed: 0 (0)
  2111. - Splits rejected: 0 (0)
  2112. - Splits total: 0 (0)
  2113. CodeGen:(Total: 108.003ms, non-child: 108.003ms, % non-child: 100.00%)
  2114. - CodegenTime: 4.000ms
  2115. - CompileTime: 20.000ms
  2116. - LoadTime: 0.000ns
  2117. - ModuleBitcodeSize: 1.95 MB (2040108)
  2118. - NumFunctions: 64 (64)
  2119. - NumInstructions: 1.09K (1091)
  2120. - OptimizationTime: 72.002ms
  2121. - PeakMemoryUsage: 545.50 KB (558592)
  2122. - PrepareTime: 16.000ms
  2123. Instance 984ea1ea895ca2cf:a12d79aa00000001 (host=slave-cn02:22000):(Total: 8m32s, non-child: 32.001ms, % non-child: 0.01%)
  2124. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/585.05 MB
  2125. Filter 1 arrival: 7s587ms
  2126. Filter 0 arrival: 7s592ms
  2127. Fragment Instance Lifecycle Event Timeline: 8m32s
  2128. - Prepare Finished: 4.000ms (4.000ms)
  2129. - Open Finished: 116.005ms (112.005ms)
  2130. - First Batch Produced: 1s196ms (1s080ms)
  2131. - First Batch Sent: 1s196ms (0.000ns)
  2132. - ExecInternal Finished: 8m32s (8m31s)
  2133. MemoryUsage(16s000ms): 217.48 MB, 245.94 MB, 245.91 MB, 245.87 MB, 245.55 MB, 238.72 MB, 238.68 MB, 238.54 MB, 233.87 MB, 232.36 MB, 232.33 MB, 232.36 MB, 232.32 MB, 232.32 MB, 205.80 MB, 169.72 MB, 162.42 MB, 162.40 MB, 162.38 MB, 162.00 MB, 152.79 MB, 152.66 MB, 152.68 MB, 152.67 MB, 152.73 MB, 152.78 MB, 152.75 MB, 152.77 MB, 130.21 MB, 91.08 MB, 88.66 MB, 57.60 MB
  2134. ThreadUsage(16s000ms): 11, 12, 12, 12, 12, 12, 12, 12, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 6
  2135. - AverageThreadTokens: 10.79
  2136. - BloomFilterBytes: 2.00 MB (2097152)
  2137. - PeakMemoryUsage: 246.71 MB (258689027)
  2138. - PeakReservation: 2.00 MB (2097152)
  2139. - PeakUsedReservation: 0
  2140. - PerHostPeakMemUsage: 1.90 GB (2039715865)
  2141. - RowsProduced: 7.44M (7437400)
  2142. - TotalNetworkReceiveTime: 0.000ns
  2143. - TotalNetworkSendTime: 8m29s
  2144. - TotalStorageWaitTime: 6s956ms
  2145. - TotalThreadsInvoluntaryContextSwitches: 29 (29)
  2146. - TotalThreadsTotalWallClockTime: 1h32m
  2147. - TotalThreadsSysTime: 1s060ms
  2148. - TotalThreadsUserTime: 3s812ms
  2149. - TotalThreadsVoluntaryContextSwitches: 19.91K (19905)
  2150. Buffer pool:
  2151. - AllocTime: 0.000ns
  2152. - CumulativeAllocationBytes: 2.00 MB (2097152)
  2153. - CumulativeAllocations: 2 (2)
  2154. - PeakReservation: 2.00 MB (2097152)
  2155. - PeakUnpinnedBytes: 0
  2156. - PeakUsedReservation: 2.00 MB (2097152)
  2157. - ReadIoBytes: 0
  2158. - ReadIoOps: 0 (0)
  2159. - ReadIoWaitTime: 0.000ns
  2160. - ReservationLimit: 2.00 MB (2097152)
  2161. - WriteIoBytes: 0
  2162. - WriteIoOps: 0 (0)
  2163. - WriteIoWaitTime: 0.000ns
  2164. Fragment Instance Lifecycle Timings:
  2165. - ExecTime: 8m32s
  2166. - ExecTreeExecTime: 1s164ms
  2167. - OpenTime: 112.005ms
  2168. - ExecTreeOpenTime: 0.000ns
  2169. - PrepareTime: 4.000ms
  2170. - ExecTreePrepareTime: 4.000ms
  2171. KrpcDataStreamSender (dst_id=6):(Total: 8m31s, non-child: 1s908ms, % non-child: 0.37%)
  2172. BytesSent(16s000ms): 10.44 MB, 16.94 MB, 21.26 MB, 25.34 MB, 29.52 MB, 33.90 MB, 38.28 MB, 42.43 MB, 46.73 MB, 51.10 MB, 55.45 MB, 59.56 MB, 63.84 MB, 68.20 MB, 72.45 MB, 76.83 MB, 81.27 MB, 85.75 MB, 90.26 MB, 94.68 MB, 99.24 MB, 104.10 MB, 108.45 MB, 113.01 MB, 117.72 MB, 122.31 MB, 127.01 MB, 131.79 MB, 136.86 MB, 141.78 MB, 147.68 MB, 153.63 MB
  2173. - EosSent: 6 (6)
  2174. - NetworkThroughput: 18.23 MB/sec
  2175. - PeakMemoryUsage: 191.25 KB (195840)
  2176. - RowsSent: 7.44M (7437400)
  2177. - RpcFailure: 0 (0)
  2178. - RpcRetry: 0 (0)
  2179. - SerializeBatchTime: 828.038ms
  2180. - TotalBytesSent: 156.57 MB (164179434)
  2181. - UncompressedRowBatchSize: 290.81 MB (304933400)
  2182. HDFS_SCAN_NODE (id=1):(Total: 1s176ms, non-child: 1s176ms, % non-child: 100.00%)
  2183. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/585.05 MB
  2184. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11
  2185. Runtime filters: Not all filters arrived (arrived: [], missing [0, 1]), waited for 923ms
  2186. Hdfs Read Thread Concurrency Bucket: 0:99.8% 1:0.1951% 2:0% 3:0% 4:0% 5:0%
  2187. File Formats: PARQUET/SNAPPY:11
  2188. BytesRead(16s000ms): 190.02 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB
  2189. - FooterProcessingTime: (Avg: 109.823ms ; Min: 20.000ms ; Max: 264.012ms ; Number of samples: 11)
  2190. - AverageHdfsReadThreadConcurrency: 0.00
  2191. - AverageScannerThreadConcurrency: 9.79
  2192. - BytesRead: 215.59 MB (226067617)
  2193. - BytesReadDataNodeCache: 0
  2194. - BytesReadLocal: 215.59 MB (226067617)
  2195. - BytesReadRemoteUnexpected: 0
  2196. - BytesReadShortCircuit: 215.59 MB (226067617)
  2197. - CachedFileHandlesHitCount: 87 (87)
  2198. - CachedFileHandlesMissCount: 11 (11)
  2199. - CollectionItemsRead: 0 (0)
  2200. - DecompressionTime: 552.025ms
  2201. - MaxCompressedTextFileLength: 0
  2202. - NumColumns: 6 (6)
  2203. - NumDictFilteredRowGroups: 0 (0)
  2204. - NumDisksAccessed: 1 (1)
  2205. - NumRowGroups: 11 (11)
  2206. - NumScannerThreadsStarted: 11 (11)
  2207. - NumScannersWithNoReads: 0 (0)
  2208. - NumStatsFilteredRowGroups: 0 (0)
  2209. - PeakMemoryUsage: 244.45 MB (256324644)
  2210. - PerReadThreadRawHdfsThroughput: 869.29 MB/sec
  2211. - RemoteScanRanges: 0 (0)
  2212. - RowBatchQueueGetWaitTime: 176.008ms
  2213. - RowBatchQueuePutWaitTime: 1h23m
  2214. - RowsRead: 26.89M (26887271)
  2215. - RowsReturned: 7.44M (7437400)
  2216. - RowsReturnedRate: 6.32 M/sec
  2217. - ScanRangesComplete: 11 (11)
  2218. - ScannerThreadsInvoluntaryContextSwitches: 25 (25)
  2219. - ScannerThreadsTotalWallClockTime: 1h23m
  2220. - MaterializeTupleTime(*): 1s428ms
  2221. - ScannerThreadsSysTime: 733.385ms
  2222. - ScannerThreadsUserTime: 1s737ms
  2223. - ScannerThreadsVoluntaryContextSwitches: 7.45K (7450)
  2224. - TotalRawHdfsOpenFileTime(*): 164.007ms
  2225. - TotalRawHdfsReadTime(*): 248.011ms
  2226. - TotalReadThroughput: 430.77 KB/sec
  2227. Filter 0 (1.00 MB):
  2228. - Files processed: 0 (0)
  2229. - Files rejected: 0 (0)
  2230. - Files total: 0 (0)
  2231. - RowGroups processed: 0 (0)
  2232. - RowGroups rejected: 0 (0)
  2233. - RowGroups total: 0 (0)
  2234. - Rows processed: 1.45M (1451225)
  2235. - Rows rejected: 139.27K (139267)
  2236. - Rows total: 26.89M (26887271)
  2237. - Splits processed: 0 (0)
  2238. - Splits rejected: 0 (0)
  2239. - Splits total: 0 (0)
  2240. Filter 1 (1.00 MB):
  2241. - Files processed: 0 (0)
  2242. - Files rejected: 0 (0)
  2243. - Files total: 0 (0)
  2244. - RowGroups processed: 0 (0)
  2245. - RowGroups rejected: 0 (0)
  2246. - RowGroups total: 0 (0)
  2247. - Rows processed: 924.57K (924574)
  2248. - Rows rejected: 83.70K (83705)
  2249. - Rows total: 26.75M (26748004)
  2250. - Splits processed: 0 (0)
  2251. - Splits rejected: 0 (0)
  2252. - Splits total: 0 (0)
  2253. CodeGen:(Total: 108.004ms, non-child: 108.004ms, % non-child: 100.00%)
  2254. - CodegenTime: 4.000ms
  2255. - CompileTime: 20.000ms
  2256. - LoadTime: 0.000ns
  2257. - ModuleBitcodeSize: 1.95 MB (2040108)
  2258. - NumFunctions: 64 (64)
  2259. - NumInstructions: 1.09K (1091)
  2260. - OptimizationTime: 72.003ms
  2261. - PeakMemoryUsage: 545.50 KB (558592)
  2262. - PrepareTime: 16.000ms
  2263. Instance 984ea1ea895ca2cf:a12d79aa00000006 (host=slave-cn07:22000):(Total: 8m31s, non-child: 28.001ms, % non-child: 0.01%)
  2264. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/556.99 MB
  2265. Filter 0 arrival: 7s661ms
  2266. Filter 1 arrival: 7s663ms
  2267. Fragment Instance Lifecycle Event Timeline: 8m31s
  2268. - Prepare Finished: 0.000ns (0.000ns)
  2269. - Open Finished: 128.006ms (128.006ms)
  2270. - First Batch Produced: 1s276ms (1s148ms)
  2271. - First Batch Sent: 1s276ms (0.000ns)
  2272. - ExecInternal Finished: 8m31s (8m29s)
  2273. MemoryUsage(8s000ms): 170.97 MB, 240.70 MB, 240.37 MB, 240.27 MB, 240.20 MB, 240.18 MB, 237.09 MB, 233.15 MB, 233.09 MB, 233.09 MB, 233.08 MB, 233.06 MB, 233.14 MB, 233.08 MB, 233.12 MB, 233.13 MB, 233.02 MB, 233.11 MB, 233.06 MB, 233.13 MB, 233.10 MB, 233.05 MB, 233.09 MB, 233.09 MB, 233.08 MB, 226.44 MB, 201.67 MB, 181.29 MB, 169.38 MB, 169.39 MB, 169.40 MB, 169.34 MB, 169.33 MB, 169.42 MB, 169.39 MB, 169.32 MB, 169.39 MB, 168.91 MB, 161.38 MB, 161.33 MB, 161.33 MB, 161.25 MB, 161.30 MB, 161.24 MB, 160.91 MB, 158.48 MB, 153.23 MB, 153.34 MB, 153.32 MB, 153.33 MB, 153.33 MB, 153.35 MB, 153.35 MB, 153.37 MB, 148.42 MB, 130.25 MB, 105.62 MB, 93.87 MB, 86.57 MB, 86.21 MB, 85.38 MB, 80.43 MB, 60.04 MB
  2274. ThreadUsage(8s000ms): 9, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 9, 8
  2275. - AverageThreadTokens: 10.54
  2276. - BloomFilterBytes: 2.00 MB (2097152)
  2277. - PeakMemoryUsage: 240.85 MB (252553327)
  2278. - PeakReservation: 2.00 MB (2097152)
  2279. - PeakUsedReservation: 0
  2280. - PerHostPeakMemUsage: 2.05 GB (2206373452)
  2281. - RowsProduced: 7.10M (7096514)
  2282. - TotalNetworkReceiveTime: 0.000ns
  2283. - TotalNetworkSendTime: 8m28s
  2284. - TotalStorageWaitTime: 8s444ms
  2285. - TotalThreadsInvoluntaryContextSwitches: 3 (3)
  2286. - TotalThreadsTotalWallClockTime: 1h29m
  2287. - TotalThreadsSysTime: 1s039ms
  2288. - TotalThreadsUserTime: 3s706ms
  2289. - TotalThreadsVoluntaryContextSwitches: 19.55K (19548)
  2290. Buffer pool:
  2291. - AllocTime: 4.000ms
  2292. - CumulativeAllocationBytes: 2.00 MB (2097152)
  2293. - CumulativeAllocations: 2 (2)
  2294. - PeakReservation: 2.00 MB (2097152)
  2295. - PeakUnpinnedBytes: 0
  2296. - PeakUsedReservation: 2.00 MB (2097152)
  2297. - ReadIoBytes: 0
  2298. - ReadIoOps: 0 (0)
  2299. - ReadIoWaitTime: 0.000ns
  2300. - ReservationLimit: 2.00 MB (2097152)
  2301. - WriteIoBytes: 0
  2302. - WriteIoOps: 0 (0)
  2303. - WriteIoWaitTime: 0.000ns
  2304. Fragment Instance Lifecycle Timings:
  2305. - ExecTime: 8m31s
  2306. - ExecTreeExecTime: 1s236ms
  2307. - OpenTime: 128.006ms
  2308. - ExecTreeOpenTime: 0.000ns
  2309. - PrepareTime: 0.000ns
  2310. - ExecTreePrepareTime: 0.000ns
  2311. KrpcDataStreamSender (dst_id=6):(Total: 8m29s, non-child: 1s736ms, % non-child: 0.34%)
  2312. BytesSent(8s000ms): 2.63 MB, 9.39 MB, 11.70 MB, 13.86 MB, 16.03 MB, 18.27 MB, 20.24 MB, 22.39 MB, 24.48 MB, 26.58 MB, 28.68 MB, 30.88 MB, 33.15 MB, 35.24 MB, 37.34 MB, 39.52 MB, 41.71 MB, 43.87 MB, 46.08 MB, 48.33 MB, 50.37 MB, 52.52 MB, 54.62 MB, 56.76 MB, 59.04 MB, 61.41 MB, 63.72 MB, 66.00 MB, 68.24 MB, 70.55 MB, 72.84 MB, 75.03 MB, 77.41 MB, 79.72 MB, 81.99 MB, 84.19 MB, 86.29 MB, 88.49 MB, 90.63 MB, 92.93 MB, 95.28 MB, 97.59 MB, 100.11 MB, 102.37 MB, 104.64 MB, 106.93 MB, 109.38 MB, 111.76 MB, 114.05 MB, 116.38 MB, 118.63 MB, 120.96 MB, 123.12 MB, 125.17 MB, 127.18 MB, 129.48 MB, 131.57 MB, 133.83 MB, 136.21 MB, 138.64 MB, 141.60 MB, 144.14 MB, 146.55 MB
  2313. - EosSent: 6 (6)
  2314. - NetworkThroughput: 18.40 MB/sec
  2315. - PeakMemoryUsage: 191.25 KB (195840)
  2316. - RowsSent: 7.10M (7096514)
  2317. - RpcFailure: 0 (0)
  2318. - RpcRetry: 0 (0)
  2319. - SerializeBatchTime: 764.036ms
  2320. - TotalBytesSent: 149.42 MB (156676693)
  2321. - UncompressedRowBatchSize: 277.48 MB (290957074)
  2322. HDFS_SCAN_NODE (id=1):(Total: 1s236ms, non-child: 1s236ms, % non-child: 100.00%)
  2323. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/556.99 MB
  2324. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10
  2325. Runtime filters: Not all filters arrived (arrived: [], missing [0, 1]), waited for 904ms
  2326. Hdfs Read Thread Concurrency Bucket: 0:99.9% 1:0.09785% 2:0% 3:0% 4:0% 5:0%
  2327. File Formats: PARQUET/SNAPPY:10
  2328. BytesRead(8s000ms): 144.03 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB
  2329. - FooterProcessingTime: (Avg: 130.006ms ; Min: 16.000ms ; Max: 316.015ms ; Number of samples: 10)
  2330. - AverageHdfsReadThreadConcurrency: 0.00
  2331. - AverageScannerThreadConcurrency: 9.55
  2332. - BytesRead: 205.15 MB (215120266)
  2333. - BytesReadDataNodeCache: 0
  2334. - BytesReadLocal: 205.15 MB (215120266)
  2335. - BytesReadRemoteUnexpected: 0
  2336. - BytesReadShortCircuit: 205.15 MB (215120266)
  2337. - CachedFileHandlesHitCount: 80 (80)
  2338. - CachedFileHandlesMissCount: 10 (10)
  2339. - CollectionItemsRead: 0 (0)
  2340. - DecompressionTime: 604.028ms
  2341. - MaxCompressedTextFileLength: 0
  2342. - NumColumns: 6 (6)
  2343. - NumDictFilteredRowGroups: 0 (0)
  2344. - NumDisksAccessed: 1 (1)
  2345. - NumRowGroups: 10 (10)
  2346. - NumScannerThreadsStarted: 10 (10)
  2347. - NumScannersWithNoReads: 0 (0)
  2348. - NumStatsFilteredRowGroups: 0 (0)
  2349. - PeakMemoryUsage: 238.59 MB (250181776)
  2350. - PerReadThreadRawHdfsThroughput: 303.47 MB/sec
  2351. - RemoteScanRanges: 0 (0)
  2352. - RowBatchQueueGetWaitTime: 244.011ms
  2353. - RowBatchQueuePutWaitTime: 1h21m
  2354. - RowsRead: 25.60M (25599571)
  2355. - RowsReturned: 7.10M (7096514)
  2356. - RowsReturnedRate: 5.74 M/sec
  2357. - ScanRangesComplete: 10 (10)
  2358. - ScannerThreadsInvoluntaryContextSwitches: 2 (2)
  2359. - ScannerThreadsTotalWallClockTime: 1h21m
  2360. - MaterializeTupleTime(*): 1s152ms
  2361. - ScannerThreadsSysTime: 690.571ms
  2362. - ScannerThreadsUserTime: 1s611ms
  2363. - ScannerThreadsVoluntaryContextSwitches: 7.17K (7173)
  2364. - TotalRawHdfsOpenFileTime(*): 208.009ms
  2365. - TotalRawHdfsReadTime(*): 676.032ms
  2366. - TotalReadThroughput: 410.71 KB/sec
  2367. Filter 0 (1.00 MB):
  2368. - Files processed: 0 (0)
  2369. - Files rejected: 0 (0)
  2370. - Files total: 0 (0)
  2371. - RowGroups processed: 0 (0)
  2372. - RowGroups rejected: 0 (0)
  2373. - RowGroups total: 0 (0)
  2374. - Rows processed: 725.71K (725707)
  2375. - Rows rejected: 65.01K (65012)
  2376. - Rows total: 25.60M (25599571)
  2377. - Splits processed: 0 (0)
  2378. - Splits rejected: 0 (0)
  2379. - Splits total: 0 (0)
  2380. Filter 1 (1.00 MB):
  2381. - Files processed: 0 (0)
  2382. - Files rejected: 0 (0)
  2383. - Files total: 0 (0)
  2384. - RowGroups processed: 0 (0)
  2385. - RowGroups rejected: 0 (0)
  2386. - RowGroups total: 0 (0)
  2387. - Rows processed: 819.49K (819493)
  2388. - Rows rejected: 73.53K (73528)
  2389. - Rows total: 25.53M (25534559)
  2390. - Splits processed: 0 (0)
  2391. - Splits rejected: 0 (0)
  2392. - Splits total: 0 (0)
  2393. CodeGen:(Total: 128.006ms, non-child: 128.006ms, % non-child: 100.00%)
  2394. - CodegenTime: 0.000ns
  2395. - CompileTime: 20.000ms
  2396. - LoadTime: 0.000ns
  2397. - ModuleBitcodeSize: 1.95 MB (2040108)
  2398. - NumFunctions: 64 (64)
  2399. - NumInstructions: 1.09K (1091)
  2400. - OptimizationTime: 84.004ms
  2401. - PeakMemoryUsage: 545.50 KB (558592)
  2402. - PrepareTime: 20.000ms
  2403. Instance 984ea1ea895ca2cf:a12d79aa00000002 (host=slave-cn04:22000):(Total: 7m58s, non-child: 68.003ms, % non-child: 0.01%)
  2404. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/556.85 MB
  2405. Filter 1 arrival: 7s626ms
  2406. Filter 0 arrival: 7s629ms
  2407. Fragment Instance Lifecycle Event Timeline: 7m58s
  2408. - Prepare Finished: 4.000ms (4.000ms)
  2409. - Open Finished: 112.005ms (108.005ms)
  2410. - First Batch Produced: 1s252ms (1s140ms)
  2411. - First Batch Sent: 1s252ms (0.000ns)
  2412. - ExecInternal Finished: 7m58s (7m57s)
  2413. MemoryUsage(8s000ms): 173.32 MB, 232.67 MB, 232.63 MB, 232.66 MB, 232.65 MB, 232.63 MB, 232.65 MB, 232.61 MB, 232.66 MB, 232.69 MB, 232.61 MB, 232.68 MB, 232.67 MB, 232.63 MB, 232.61 MB, 232.72 MB, 232.63 MB, 232.65 MB, 232.63 MB, 232.69 MB, 232.59 MB, 232.70 MB, 232.74 MB, 232.75 MB, 220.75 MB, 190.67 MB, 170.70 MB, 169.04 MB, 169.03 MB, 169.01 MB, 168.48 MB, 160.97 MB, 160.97 MB, 161.04 MB, 160.91 MB, 160.94 MB, 160.91 MB, 160.55 MB, 159.63 MB, 152.97 MB, 153.01 MB, 152.98 MB, 152.94 MB, 152.89 MB, 152.97 MB, 152.94 MB, 152.97 MB, 152.94 MB, 152.92 MB, 152.97 MB, 152.95 MB, 138.06 MB, 116.66 MB, 92.94 MB, 91.65 MB, 91.09 MB, 90.64 MB, 89.08 MB, 69.69 MB
  2414. ThreadUsage(8s000ms): 9, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 8
  2415. - AverageThreadTokens: 10.50
  2416. - BloomFilterBytes: 2.00 MB (2097152)
  2417. - PeakMemoryUsage: 240.43 MB (252105768)
  2418. - PeakReservation: 2.00 MB (2097152)
  2419. - PeakUsedReservation: 0
  2420. - PerHostPeakMemUsage: 1.79 GB (1925754349)
  2421. - RowsProduced: 7.11M (7108989)
  2422. - TotalNetworkReceiveTime: 0.000ns
  2423. - TotalNetworkSendTime: 7m55s
  2424. - TotalStorageWaitTime: 8s236ms
  2425. - TotalThreadsInvoluntaryContextSwitches: 8 (8)
  2426. - TotalThreadsTotalWallClockTime: 1h23m
  2427. - TotalThreadsSysTime: 770.754ms
  2428. - TotalThreadsUserTime: 3s927ms
  2429. - TotalThreadsVoluntaryContextSwitches: 19.07K (19074)
  2430. Buffer pool:
  2431. - AllocTime: 0.000ns
  2432. - CumulativeAllocationBytes: 2.00 MB (2097152)
  2433. - CumulativeAllocations: 2 (2)
  2434. - PeakReservation: 2.00 MB (2097152)
  2435. - PeakUnpinnedBytes: 0
  2436. - PeakUsedReservation: 2.00 MB (2097152)
  2437. - ReadIoBytes: 0
  2438. - ReadIoOps: 0 (0)
  2439. - ReadIoWaitTime: 0.000ns
  2440. - ReservationLimit: 2.00 MB (2097152)
  2441. - WriteIoBytes: 0
  2442. - WriteIoOps: 0 (0)
  2443. - WriteIoWaitTime: 0.000ns
  2444. Fragment Instance Lifecycle Timings:
  2445. - ExecTime: 7m58s
  2446. - ExecTreeExecTime: 1s228ms
  2447. - OpenTime: 108.005ms
  2448. - ExecTreeOpenTime: 0.000ns
  2449. - PrepareTime: 0.000ns
  2450. - ExecTreePrepareTime: 0.000ns
  2451. KrpcDataStreamSender (dst_id=6):(Total: 7m57s, non-child: 1s628ms, % non-child: 0.34%)
  2452. BytesSent(8s000ms): 3.76 MB, 10.21 MB, 12.52 MB, 14.53 MB, 16.68 MB, 18.95 MB, 21.32 MB, 23.64 MB, 26.03 MB, 28.32 MB, 30.63 MB, 32.82 MB, 35.26 MB, 37.59 MB, 39.86 MB, 42.13 MB, 44.39 MB, 46.69 MB, 49.11 MB, 51.65 MB, 53.99 MB, 56.37 MB, 58.76 MB, 61.15 MB, 63.66 MB, 66.08 MB, 68.56 MB, 71.06 MB, 73.36 MB, 75.38 MB, 77.56 MB, 79.86 MB, 82.22 MB, 84.74 MB, 87.24 MB, 89.65 MB, 92.04 MB, 94.59 MB, 96.92 MB, 99.21 MB, 101.66 MB, 104.02 MB, 106.44 MB, 108.81 MB, 111.16 MB, 113.71 MB, 116.19 MB, 118.81 MB, 121.31 MB, 123.82 MB, 126.45 MB, 129.01 MB, 131.55 MB, 133.97 MB, 136.47 MB, 139.26 MB, 141.70 MB, 144.08 MB, 146.63 MB
  2453. - EosSent: 6 (6)
  2454. - NetworkThroughput: 18.59 MB/sec
  2455. - PeakMemoryUsage: 191.25 KB (195840)
  2456. - RowsSent: 7.11M (7108989)
  2457. - RpcFailure: 0 (0)
  2458. - RpcRetry: 0 (0)
  2459. - SerializeBatchTime: 720.037ms
  2460. - TotalBytesSent: 149.69 MB (156956926)
  2461. - UncompressedRowBatchSize: 277.97 MB (291468549)
  2462. HDFS_SCAN_NODE (id=1):(Total: 1s208ms, non-child: 1s208ms, % non-child: 100.00%)
  2463. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/556.85 MB
  2464. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10
  2465. Runtime filters: Not all filters arrived (arrived: [], missing [0, 1]), waited for 924ms
  2466. Hdfs Read Thread Concurrency Bucket: 0:99.79% 1:0.2096% 2:0% 3:0% 4:0% 5:0%
  2467. File Formats: PARQUET/SNAPPY:10
  2468. BytesRead(8s000ms): 146.40 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB
  2469. - FooterProcessingTime: (Avg: 143.607ms ; Min: 44.002ms ; Max: 316.016ms ; Number of samples: 10)
  2470. - AverageHdfsReadThreadConcurrency: 0.00
  2471. - AverageScannerThreadConcurrency: 9.54
  2472. - BytesRead: 205.12 MB (215087055)
  2473. - BytesReadDataNodeCache: 0
  2474. - BytesReadLocal: 205.12 MB (215087055)
  2475. - BytesReadRemoteUnexpected: 0
  2476. - BytesReadShortCircuit: 205.12 MB (215087055)
  2477. - CachedFileHandlesHitCount: 80 (80)
  2478. - CachedFileHandlesMissCount: 10 (10)
  2479. - CollectionItemsRead: 0 (0)
  2480. - DecompressionTime: 784.041ms
  2481. - MaxCompressedTextFileLength: 0
  2482. - NumColumns: 6 (6)
  2483. - NumDictFilteredRowGroups: 0 (0)
  2484. - NumDisksAccessed: 1 (1)
  2485. - NumRowGroups: 10 (10)
  2486. - NumScannerThreadsStarted: 10 (10)
  2487. - NumScannersWithNoReads: 0 (0)
  2488. - NumStatsFilteredRowGroups: 0 (0)
  2489. - PeakMemoryUsage: 238.14 MB (249708617)
  2490. - PerReadThreadRawHdfsThroughput: 330.83 MB/sec
  2491. - RemoteScanRanges: 0 (0)
  2492. - RowBatchQueueGetWaitTime: 220.011ms
  2493. - RowBatchQueuePutWaitTime: 1h15m
  2494. - RowsRead: 25.60M (25599454)
  2495. - RowsReturned: 7.11M (7108989)
  2496. - RowsReturnedRate: 5.88 M/sec
  2497. - ScanRangesComplete: 10 (10)
  2498. - ScannerThreadsInvoluntaryContextSwitches: 1 (1)
  2499. - ScannerThreadsTotalWallClockTime: 1h15m
  2500. - MaterializeTupleTime(*): 1s096ms
  2501. - ScannerThreadsSysTime: 532.821ms
  2502. - ScannerThreadsUserTime: 1s870ms
  2503. - ScannerThreadsVoluntaryContextSwitches: 7.17K (7166)
  2504. - TotalRawHdfsOpenFileTime(*): 180.009ms
  2505. - TotalRawHdfsReadTime(*): 620.032ms
  2506. - TotalReadThroughput: 439.89 KB/sec
  2507. Filter 0 (1.00 MB):
  2508. - Files processed: 0 (0)
  2509. - Files rejected: 0 (0)
  2510. - Files total: 0 (0)
  2511. - RowGroups processed: 0 (0)
  2512. - RowGroups rejected: 0 (0)
  2513. - RowGroups total: 0 (0)
  2514. - Rows processed: 392.72K (392722)
  2515. - Rows rejected: 30.94K (30939)
  2516. - Rows total: 25.60M (25599454)
  2517. - Splits processed: 0 (0)
  2518. - Splits rejected: 0 (0)
  2519. - Splits total: 0 (0)
  2520. Filter 1 (1.00 MB):
  2521. - Files processed: 0 (0)
  2522. - Files rejected: 0 (0)
  2523. - Files total: 0 (0)
  2524. - RowGroups processed: 0 (0)
  2525. - RowGroups rejected: 0 (0)
  2526. - RowGroups total: 0 (0)
  2527. - Rows processed: 498.49K (498494)
  2528. - Rows rejected: 43.06K (43061)
  2529. - Rows total: 25.57M (25568515)
  2530. - Splits processed: 0 (0)
  2531. - Splits rejected: 0 (0)
  2532. - Splits total: 0 (0)
  2533. CodeGen:(Total: 104.005ms, non-child: 104.005ms, % non-child: 100.00%)
  2534. - CodegenTime: 4.000ms
  2535. - CompileTime: 20.001ms
  2536. - LoadTime: 0.000ns
  2537. - ModuleBitcodeSize: 1.95 MB (2040108)
  2538. - NumFunctions: 64 (64)
  2539. - NumInstructions: 1.09K (1091)
  2540. - OptimizationTime: 68.003ms
  2541. - PeakMemoryUsage: 545.50 KB (558592)
  2542. - PrepareTime: 16.000ms
  2543. Averaged Fragment F01:(Total: 7s120ms, non-child: 1s624ms, % non-child: 22.81%)
  2544. split sizes: min: 3.77 GB, max: 3.86 GB, avg: 3.83 GB, stddev: 30.23 MB
  2545. completion times: min:6s072ms max:7s544ms mean: 7s126ms stddev:501.560ms
  2546. execution rates: min:523.66 MB/sec max:644.90 MB/sec mean:553.22 MB/sec stddev:42.17 MB/sec
  2547. num instances: 6
  2548. - AverageThreadTokens: 29.40
  2549. - BloomFilterBytes: 4.00 MB (4194304)
  2550. - PeakMemoryUsage: 1.43 GB (1535860372)
  2551. - PeakReservation: 196.00 MB (205520896)
  2552. - PeakUsedReservation: 0
  2553. - PerHostPeakMemUsage: 1.71 GB (1836833523)
  2554. - RowsProduced: 459.47K (459466)
  2555. - TotalNetworkReceiveTime: 77.336ms
  2556. - TotalNetworkSendTime: 6.000ms
  2557. - TotalStorageWaitTime: 2m15s
  2558. - TotalThreadsInvoluntaryContextSwitches: 23 (23)
  2559. - TotalThreadsTotalWallClockTime: 3m29s
  2560. - TotalThreadsSysTime: 7s574ms
  2561. - TotalThreadsUserTime: 10s268ms
  2562. - TotalThreadsVoluntaryContextSwitches: 43.65K (43650)
  2563. Buffer pool:
  2564. - AllocTime: 0.000ns
  2565. - CumulativeAllocationBytes: 4.00 MB (4194304)
  2566. - CumulativeAllocations: 2 (2)
  2567. - PeakReservation: 4.00 MB (4194304)
  2568. - PeakUnpinnedBytes: 0
  2569. - PeakUsedReservation: 4.00 MB (4194304)
  2570. - ReadIoBytes: 0
  2571. - ReadIoOps: 0 (0)
  2572. - ReadIoWaitTime: 0.000ns
  2573. - ReservationLimit: 4.00 MB (4194304)
  2574. - WriteIoBytes: 0
  2575. - WriteIoOps: 0 (0)
  2576. - WriteIoWaitTime: 0.000ns
  2577. Fragment Instance Lifecycle Timings:
  2578. - ExecTime: 5s759ms
  2579. - ExecTreeExecTime: 3s868ms
  2580. - OpenTime: 1s358ms
  2581. - ExecTreeOpenTime: 1s052ms
  2582. - PrepareTime: 3.333ms
  2583. - ExecTreePrepareTime: 666.698us
  2584. KrpcDataStreamSender (dst_id=7):(Total: 273.346ms, non-child: 273.346ms, % non-child: 100.00%)
  2585. - EosSent: 6 (6)
  2586. - NetworkThroughput: 26.55 MB/sec
  2587. - PeakMemoryUsage: 189.00 KB (193536)
  2588. - RowsSent: 459.47K (459466)
  2589. - RpcFailure: 0 (0)
  2590. - RpcRetry: 0 (0)
  2591. - SerializeBatchTime: 121.338ms
  2592. - TotalBytesSent: 28.25 MB (29623056)
  2593. - UncompressedRowBatchSize: 39.00 MB (40892533)
  2594. HASH_JOIN_NODE (id=3):(Total: 4s921ms, non-child: 2s416ms, % non-child: 49.11%)
  2595. - BuildRows: 3.68M (3679360)
  2596. - BuildTime: 570.693ms
  2597. - NumHashTableBuildsSkipped: 0 (0)
  2598. - PeakMemoryUsage: 192.39 MB (201734058)
  2599. - ProbeRows: 16.41M (16411896)
  2600. - ProbeRowsPartitioned: 0 (0)
  2601. - ProbeTime: 1s811ms
  2602. - RowsReturned: 459.47K (459466)
  2603. - RowsReturnedRate: 94.90 K/sec
  2604. Buffer pool:
  2605. - AllocTime: 6.666ms
  2606. - CumulativeAllocationBytes: 192.00 MB (201326592)
  2607. - CumulativeAllocations: 48 (48)
  2608. - PeakReservation: 192.00 MB (201326592)
  2609. - PeakUnpinnedBytes: 0
  2610. - PeakUsedReservation: 192.00 MB (201326592)
  2611. - ReadIoBytes: 0
  2612. - ReadIoOps: 0 (0)
  2613. - ReadIoWaitTime: 0.000ns
  2614. - WriteIoBytes: 0
  2615. - WriteIoOps: 0 (0)
  2616. - WriteIoWaitTime: 0.000ns
  2617. Hash Join Builder (join_node_id=3):
  2618. - BuildRowsPartitionTime: 294.680ms
  2619. - BuildRowsPartitioned: 3.68M (3679360)
  2620. - HashBuckets: 8.39M (8388608)
  2621. - HashCollisions: 0 (0)
  2622. - HashTablesBuildTime: 269.345ms
  2623. - LargestPartitionPercent: 6 (6)
  2624. - MaxPartitionLevel: 0 (0)
  2625. - NumRepartitions: 0 (0)
  2626. - PartitionsCreated: 16 (16)
  2627. - PeakMemoryUsage: 22.12 KB (22656)
  2628. - RepartitionTime: 0.000ns
  2629. - SpilledPartitions: 0 (0)
  2630. EXCHANGE_NODE (id=5):(Total: 130.672ms, non-child: 130.672ms, % non-child: 100.00%)
  2631. - ConvertRowBatchTime: 48.668ms
  2632. - PeakMemoryUsage: 12.70 MB (13318628)
  2633. - RowsReturned: 3.68M (3679360)
  2634. - RowsReturnedRate: 28.73 M/sec
  2635. Buffer pool:
  2636. - AllocTime: 20.667ms
  2637. - CumulativeAllocationBytes: 84.43 MB (88530944)
  2638. - CumulativeAllocations: 7.22K (7218)
  2639. - PeakReservation: 12.65 MB (13262848)
  2640. - PeakUnpinnedBytes: 0
  2641. - PeakUsedReservation: 12.65 MB (13262848)
  2642. - ReadIoBytes: 0
  2643. - ReadIoOps: 0 (0)
  2644. - ReadIoWaitTime: 0.000ns
  2645. - WriteIoBytes: 0
  2646. - WriteIoOps: 0 (0)
  2647. - WriteIoWaitTime: 0.000ns
  2648. Dequeue:
  2649. - FirstBatchWaitTime: 0.000ns
  2650. - TotalBytesDequeued: 66.67 MB (69907840)
  2651. - TotalGetBatchTime: 77.336ms
  2652. - DataWaitTime: 72.003ms
  2653. Enqueue:
  2654. - DeserializeRowBatchTime: 96.004ms
  2655. - TotalBatchesEnqueued: 3.61K (3609)
  2656. - TotalBatchesReceived: 3.61K (3609)
  2657. - TotalBytesReceived: 33.37 MB (34992608)
  2658. - TotalEarlySenders: 0 (0)
  2659. - TotalEosReceived: 6 (6)
  2660. - TotalHasDeferredRPCsTime: 51.163ms
  2661. - TotalRPCsDeferred: 7 (7)
  2662. HDFS_SCAN_NODE (id=2):(Total: 2s374ms, non-child: 2s374ms, % non-child: 100.00%)
  2663. - AverageHdfsReadThreadConcurrency: 0.64
  2664. - AverageScannerThreadConcurrency: 30.44
  2665. - BytesRead: 1.96 GB (2101966945)
  2666. - BytesReadDataNodeCache: 0
  2667. - BytesReadLocal: 1.96 GB (2101966945)
  2668. - BytesReadRemoteUnexpected: 0
  2669. - BytesReadShortCircuit: 1.96 GB (2101966945)
  2670. - CachedFileHandlesHitCount: 568 (568)
  2671. - CachedFileHandlesMissCount: 63 (63)
  2672. - CollectionItemsRead: 0 (0)
  2673. - DecompressionTime: 4s547ms
  2674. - MaxCompressedTextFileLength: 0
  2675. - NumColumns: 9 (9)
  2676. - NumDictFilteredRowGroups: 0 (0)
  2677. - NumDisksAccessed: 1 (1)
  2678. - NumRowGroups: 63 (63)
  2679. - NumScannerThreadsStarted: 37 (37)
  2680. - NumScannersWithNoReads: 0 (0)
  2681. - NumStatsFilteredRowGroups: 0 (0)
  2682. - PeakMemoryUsage: 1.23 GB (1322851030)
  2683. - PerReadThreadRawHdfsThroughput: 694.43 MB/sec
  2684. - RemoteScanRanges: 0 (0)
  2685. - RowBatchQueueGetWaitTime: 2s280ms
  2686. - RowBatchQueuePutWaitTime: 35s283ms
  2687. - RowsRead: 52.46M (52456522)
  2688. - RowsReturned: 16.41M (16411896)
  2689. - RowsReturnedRate: 7.57 M/sec
  2690. - ScanRangesComplete: 63 (63)
  2691. - ScannerThreadsInvoluntaryContextSwitches: 17 (17)
  2692. - ScannerThreadsTotalWallClockTime: 3m21s
  2693. - MaterializeTupleTime(*): 12s195ms
  2694. - ScannerThreadsSysTime: 5s963ms
  2695. - ScannerThreadsUserTime: 7s302ms
  2696. - ScannerThreadsVoluntaryContextSwitches: 41.06K (41063)
  2697. - TotalRawHdfsOpenFileTime(*): 1s079ms
  2698. - TotalRawHdfsReadTime(*): 3s046ms
  2699. - TotalReadThroughput: 280.23 MB/sec
  2700. Filter 4 (2.00 MB):
  2701. - Files processed: 0 (0)
  2702. - Files rejected: 0 (0)
  2703. - Files total: 0 (0)
  2704. - RowGroups processed: 0 (0)
  2705. - RowGroups rejected: 0 (0)
  2706. - RowGroups total: 0 (0)
  2707. - Rows processed: 3.97M (3971547)
  2708. - Rows rejected: 278.23K (278227)
  2709. - Rows total: 52.46M (52456522)
  2710. - Splits processed: 0 (0)
  2711. - Splits rejected: 0 (0)
  2712. - Splits total: 0 (0)
  2713. Filter 5 (2.00 MB):
  2714. - Files processed: 0 (0)
  2715. - Files rejected: 0 (0)
  2716. - Files total: 0 (0)
  2717. - RowGroups processed: 0 (0)
  2718. - RowGroups rejected: 0 (0)
  2719. - RowGroups total: 0 (0)
  2720. - Rows processed: 3.42M (3422175)
  2721. - Rows rejected: 79.07K (79074)
  2722. - Rows total: 52.18M (52178295)
  2723. - Splits processed: 0 (0)
  2724. - Splits rejected: 0 (0)
  2725. - Splits total: 0 (0)
  2726. CodeGen:(Total: 302.014ms, non-child: 302.014ms, % non-child: 100.00%)
  2727. - CodegenTime: 2.666ms
  2728. - CompileTime: 80.003ms
  2729. - LoadTime: 0.000ns
  2730. - ModuleBitcodeSize: 1.95 MB (2040108)
  2731. - NumFunctions: 113 (113)
  2732. - NumInstructions: 3.40K (3401)
  2733. - OptimizationTime: 200.009ms
  2734. - PeakMemoryUsage: 1.66 MB (1741312)
  2735. - PrepareTime: 22.001ms
  2736. Fragment F01:
  2737. Instance 984ea1ea895ca2cf:a12d79aa0000000d (host=slave-cn06:22000):(Total: 7s536ms, non-child: 1s124ms, % non-child: 14.92%)
  2738. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:64/3.86 GB
  2739. Filter 4 arrival: 746ms
  2740. Filter 5 arrival: 746ms
  2741. Fragment Instance Lifecycle Event Timeline: 7s540ms
  2742. - Prepare Finished: 4.000ms (4.000ms)
  2743. - Open Finished: 1s428ms (1s424ms)
  2744. - First Batch Produced: 1s448ms (20.000ms)
  2745. - First Batch Sent: 1s448ms (0.000ns)
  2746. - ExecInternal Finished: 7s540ms (6s092ms)
  2747. MemoryUsage(500.000ms): 10.09 MB, 80.74 MB, 221.76 MB, 273.35 MB, 235.18 MB, 253.55 MB, 294.91 MB, 444.34 MB, 563.90 MB, 595.20 MB, 536.74 MB, 579.72 MB, 342.47 MB, 474.36 MB, 500.05 MB
  2748. ThreadUsage(500.000ms): 1, 2, 40, 40, 40, 40, 40, 40, 40, 40, 39, 31, 22, 17, 9
  2749. - AverageThreadTokens: 29.40
  2750. - BloomFilterBytes: 4.00 MB (4194304)
  2751. - PeakMemoryUsage: 647.60 MB (679059652)
  2752. - PeakReservation: 196.00 MB (205520896)
  2753. - PeakUsedReservation: 0
  2754. - PerHostPeakMemUsage: 938.16 MB (983735960)
  2755. - RowsProduced: 462.47K (462469)
  2756. - TotalNetworkReceiveTime: 116.003ms
  2757. - TotalNetworkSendTime: 8.000ms
  2758. - TotalStorageWaitTime: 3m4s
  2759. - TotalThreadsInvoluntaryContextSwitches: 18 (18)
  2760. - TotalThreadsTotalWallClockTime: 3m39s
  2761. - TotalThreadsSysTime: 6s080ms
  2762. - TotalThreadsUserTime: 9s343ms
  2763. - TotalThreadsVoluntaryContextSwitches: 25.47K (25470)
  2764. Buffer pool:
  2765. - AllocTime: 0.000ns
  2766. - CumulativeAllocationBytes: 4.00 MB (4194304)
  2767. - CumulativeAllocations: 2 (2)
  2768. - PeakReservation: 4.00 MB (4194304)
  2769. - PeakUnpinnedBytes: 0
  2770. - PeakUsedReservation: 4.00 MB (4194304)
  2771. - ReadIoBytes: 0
  2772. - ReadIoOps: 0 (0)
  2773. - ReadIoWaitTime: 0.000ns
  2774. - ReservationLimit: 4.00 MB (4194304)
  2775. - WriteIoBytes: 0
  2776. - WriteIoOps: 0 (0)
  2777. - WriteIoWaitTime: 0.000ns
  2778. Fragment Instance Lifecycle Timings:
  2779. - ExecTime: 6s112ms
  2780. - ExecTreeExecTime: 4s744ms
  2781. - OpenTime: 1s424ms
  2782. - ExecTreeOpenTime: 1s128ms
  2783. - PrepareTime: 0.000ns
  2784. - ExecTreePrepareTime: 0.000ns
  2785. KrpcDataStreamSender (dst_id=7):(Total: 248.008ms, non-child: 240.007ms, % non-child: 96.77%)
  2786. BytesSent(500.000ms): 0, 0, 0, 532.40 KB, 1.29 MB, 1.72 MB, 1.72 MB, 2.89 MB, 4.92 MB, 7.86 MB, 11.75 MB, 15.97 MB, 18.93 MB, 21.62 MB, 25.86 MB
  2787. - EosSent: 6 (6)
  2788. - NetworkThroughput: 26.97 MB/sec
  2789. - PeakMemoryUsage: 189.00 KB (193536)
  2790. - RowsSent: 462.47K (462469)
  2791. - RpcFailure: 0 (0)
  2792. - RpcRetry: 0 (0)
  2793. - SerializeBatchTime: 124.004ms
  2794. - TotalBytesSent: 28.36 MB (29741400)
  2795. - UncompressedRowBatchSize: 39.25 MB (41159741)
  2796. HASH_JOIN_NODE (id=3):(Total: 5s872ms, non-child: 2s344ms, % non-child: 39.92%)
  2797. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  2798. - BuildRows: 3.68M (3679360)
  2799. - BuildTime: 560.018ms
  2800. - NumHashTableBuildsSkipped: 0 (0)
  2801. - PeakMemoryUsage: 192.34 MB (201681152)
  2802. - ProbeRows: 16.55M (16545313)
  2803. - ProbeRowsPartitioned: 0 (0)
  2804. - ProbeTime: 1s760ms
  2805. - RowsReturned: 462.47K (462469)
  2806. - RowsReturnedRate: 78.75 K/sec
  2807. Buffer pool:
  2808. - AllocTime: 0.000ns
  2809. - CumulativeAllocationBytes: 192.00 MB (201326592)
  2810. - CumulativeAllocations: 48 (48)
  2811. - PeakReservation: 192.00 MB (201326592)
  2812. - PeakUnpinnedBytes: 0
  2813. - PeakUsedReservation: 192.00 MB (201326592)
  2814. - ReadIoBytes: 0
  2815. - ReadIoOps: 0 (0)
  2816. - ReadIoWaitTime: 0.000ns
  2817. - WriteIoBytes: 0
  2818. - WriteIoOps: 0 (0)
  2819. - WriteIoWaitTime: 0.000ns
  2820. Hash Join Builder (join_node_id=3):
  2821. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  2822. Runtime filters: 2 of 2 Runtime Filters Published
  2823. - BuildRowsPartitionTime: 280.009ms
  2824. - BuildRowsPartitioned: 3.68M (3679360)
  2825. - HashBuckets: 8.39M (8388608)
  2826. - HashCollisions: 0 (0)
  2827. - HashTablesBuildTime: 276.008ms
  2828. - LargestPartitionPercent: 6 (6)
  2829. - MaxPartitionLevel: 0 (0)
  2830. - NumRepartitions: 0 (0)
  2831. - PartitionsCreated: 16 (16)
  2832. - PeakMemoryUsage: 22.12 KB (22656)
  2833. - RepartitionTime: 0.000ns
  2834. - SpilledPartitions: 0 (0)
  2835. EXCHANGE_NODE (id=5):(Total: 160.005ms, non-child: 56.001ms, % non-child: 35.00%)
  2836. - ConvertRowBatchTime: 44.001ms
  2837. - PeakMemoryUsage: 12.70 MB (13321854)
  2838. - RowsReturned: 3.68M (3679360)
  2839. - RowsReturnedRate: 23.00 M/sec
  2840. Buffer pool:
  2841. - AllocTime: 24.000ms
  2842. - CumulativeAllocationBytes: 84.43 MB (88530944)
  2843. - CumulativeAllocations: 7.22K (7218)
  2844. - PeakReservation: 12.65 MB (13262848)
  2845. - PeakUnpinnedBytes: 0
  2846. - PeakUsedReservation: 12.65 MB (13262848)
  2847. - ReadIoBytes: 0
  2848. - ReadIoOps: 0 (0)
  2849. - ReadIoWaitTime: 0.000ns
  2850. - WriteIoBytes: 0
  2851. - WriteIoOps: 0 (0)
  2852. - WriteIoWaitTime: 0.000ns
  2853. Dequeue:
  2854. BytesDequeued(500.000ms): 0, 65.97 MB
  2855. - FirstBatchWaitTime: 0.000ns
  2856. - TotalBytesDequeued: 66.67 MB (69907840)
  2857. - TotalGetBatchTime: 116.003ms
  2858. - DataWaitTime: 108.003ms
  2859. Enqueue:
  2860. BytesReceived(500.000ms): 2.38 MB, 33.02 MB
  2861. DeferredQueueSize(500.000ms): 0, 0
  2862. - DispatchTime: (Avg: 31.711us ; Min: 13.217us ; Max: 185.442us ; Number of samples: 3609)
  2863. - DeserializeRowBatchTime: 88.002ms
  2864. - TotalBatchesEnqueued: 3.61K (3609)
  2865. - TotalBatchesReceived: 3.61K (3609)
  2866. - TotalBytesReceived: 33.37 MB (34992608)
  2867. - TotalEarlySenders: 0 (0)
  2868. - TotalEosReceived: 6 (6)
  2869. - TotalHasDeferredRPCsTime: 40.023ms
  2870. - TotalRPCsDeferred: 7 (7)
  2871. HDFS_SCAN_NODE (id=2):(Total: 3s368ms, non-child: 3s368ms, % non-child: 100.00%)
  2872. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:64/3.86 GB
  2873. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 64 out of 64
  2874. Runtime filters: All filters arrived. Waited 0
  2875. Hdfs Read Thread Concurrency Bucket: 0:14.29% 1:85.71% 2:0% 3:0% 4:0% 5:0%
  2876. File Formats: PARQUET/SNAPPY:64
  2877. BytesRead(500.000ms): 0, 0, 20.86 MB, 82.89 MB, 119.84 MB, 173.33 MB, 200.04 MB, 374.89 MB, 591.73 MB, 797.26 MB, 1021.96 MB, 1.26 GB, 1.42 GB, 1.66 GB, 1.91 GB
  2878. - FooterProcessingTime: (Avg: 952.406ms ; Min: 16.000ms ; Max: 1s528ms ; Number of samples: 64)
  2879. - AverageHdfsReadThreadConcurrency: 0.86
  2880. - AverageScannerThreadConcurrency: 30.36
  2881. - BytesRead: 1.97 GB (2117825808)
  2882. - BytesReadDataNodeCache: 0
  2883. - BytesReadLocal: 1.97 GB (2117825808)
  2884. - BytesReadRemoteUnexpected: 0
  2885. - BytesReadShortCircuit: 1.97 GB (2117825808)
  2886. - CachedFileHandlesHitCount: 576 (576)
  2887. - CachedFileHandlesMissCount: 64 (64)
  2888. - CollectionItemsRead: 0 (0)
  2889. - DecompressionTime: 4s036ms
  2890. - MaxCompressedTextFileLength: 0
  2891. - NumColumns: 9 (9)
  2892. - NumDictFilteredRowGroups: 0 (0)
  2893. - NumDisksAccessed: 1 (1)
  2894. - NumRowGroups: 64 (64)
  2895. - NumScannerThreadsStarted: 39 (39)
  2896. - NumScannersWithNoReads: 0 (0)
  2897. - NumStatsFilteredRowGroups: 0 (0)
  2898. - PeakMemoryUsage: 444.74 MB (466347569)
  2899. - PerReadThreadRawHdfsThroughput: 497.45 MB/sec
  2900. - RemoteScanRanges: 0 (0)
  2901. - RowBatchQueueGetWaitTime: 3s332ms
  2902. - RowBatchQueuePutWaitTime: 1s464ms
  2903. - RowsRead: 52.85M (52849667)
  2904. - RowsReturned: 16.55M (16545313)
  2905. - RowsReturnedRate: 4.91 M/sec
  2906. - ScanRangesComplete: 64 (64)
  2907. - ScannerThreadsInvoluntaryContextSwitches: 12 (12)
  2908. - ScannerThreadsTotalWallClockTime: 3m30s
  2909. - MaterializeTupleTime(*): 6s852ms
  2910. - ScannerThreadsSysTime: 4s830ms
  2911. - ScannerThreadsUserTime: 6s513ms
  2912. - ScannerThreadsVoluntaryContextSwitches: 21.39K (21395)
  2913. - TotalRawHdfsOpenFileTime(*): 1s120ms
  2914. - TotalRawHdfsReadTime(*): 4s060ms
  2915. - TotalReadThroughput: 261.46 MB/sec
  2916. Filter 4 (2.00 MB):
  2917. - Files processed: 0 (0)
  2918. - Files rejected: 0 (0)
  2919. - Files total: 0 (0)
  2920. - RowGroups processed: 0 (0)
  2921. - RowGroups rejected: 0 (0)
  2922. - RowGroups total: 0 (0)
  2923. - Rows processed: 3.76M (3764990)
  2924. - Rows rejected: 252.53K (252534)
  2925. - Rows total: 52.85M (52849667)
  2926. - Splits processed: 0 (0)
  2927. - Splits rejected: 0 (0)
  2928. - Splits total: 0 (0)
  2929. Filter 5 (2.00 MB):
  2930. - Files processed: 0 (0)
  2931. - Files rejected: 0 (0)
  2932. - Files total: 0 (0)
  2933. - RowGroups processed: 0 (0)
  2934. - RowGroups rejected: 0 (0)
  2935. - RowGroups total: 0 (0)
  2936. - Rows processed: 3.46M (3459008)
  2937. - Rows rejected: 76.77K (76767)
  2938. - Rows total: 52.60M (52597133)
  2939. - Splits processed: 0 (0)
  2940. - Splits rejected: 0 (0)
  2941. - Splits total: 0 (0)
  2942. CodeGen:(Total: 292.009ms, non-child: 292.009ms, % non-child: 100.00%)
  2943. - CodegenTime: 4.000ms
  2944. - CompileTime: 76.002ms
  2945. - LoadTime: 0.000ns
  2946. - ModuleBitcodeSize: 1.95 MB (2040108)
  2947. - NumFunctions: 113 (113)
  2948. - NumInstructions: 3.40K (3401)
  2949. - OptimizationTime: 192.006ms
  2950. - PeakMemoryUsage: 1.66 MB (1741312)
  2951. - PrepareTime: 24.000ms
  2952. Instance 984ea1ea895ca2cf:a12d79aa0000000f (host=slave-cn04:22000):(Total: 7s436ms, non-child: 1s948ms, % non-child: 26.20%)
  2953. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:63/3.83 GB
  2954. Filter 4 arrival: 745ms
  2955. Filter 5 arrival: 745ms
  2956. Fragment Instance Lifecycle Event Timeline: 7s440ms
  2957. - Prepare Finished: 12.000ms (12.000ms)
  2958. - Open Finished: 1s360ms (1s348ms)
  2959. - First Batch Produced: 1s376ms (16.000ms)
  2960. - First Batch Sent: 1s376ms (0.000ns)
  2961. - ExecInternal Finished: 7s440ms (6s064ms)
  2962. MemoryUsage(500.000ms): 5.74 MB, 50.74 MB, 204.13 MB, 253.26 MB, 237.08 MB, 258.64 MB, 377.34 MB, 533.86 MB, 737.88 MB, 1010.34 MB, 1.16 GB, 1.22 GB, 1.44 GB, 1.27 GB, 1.07 GB
  2963. ThreadUsage(500.000ms): 1, 2, 40, 40, 40, 40, 40, 40, 40, 40, 40, 34, 30, 22, 18
  2964. - AverageThreadTokens: 31.13
  2965. - BloomFilterBytes: 4.00 MB (4194304)
  2966. - PeakMemoryUsage: 1.51 GB (1625858439)
  2967. - PeakReservation: 196.00 MB (205520896)
  2968. - PeakUsedReservation: 0
  2969. - PerHostPeakMemUsage: 1.79 GB (1925754349)
  2970. - RowsProduced: 460.03K (460032)
  2971. - TotalNetworkReceiveTime: 52.002ms
  2972. - TotalNetworkSendTime: 8.000ms
  2973. - TotalStorageWaitTime: 2m23s
  2974. - TotalThreadsInvoluntaryContextSwitches: 22 (22)
  2975. - TotalThreadsTotalWallClockTime: 3m48s
  2976. - TotalThreadsSysTime: 7s445ms
  2977. - TotalThreadsUserTime: 11s498ms
  2978. - TotalThreadsVoluntaryContextSwitches: 50.49K (50487)
  2979. Buffer pool:
  2980. - AllocTime: 0.000ns
  2981. - CumulativeAllocationBytes: 4.00 MB (4194304)
  2982. - CumulativeAllocations: 2 (2)
  2983. - PeakReservation: 4.00 MB (4194304)
  2984. - PeakUnpinnedBytes: 0
  2985. - PeakUsedReservation: 4.00 MB (4194304)
  2986. - ReadIoBytes: 0
  2987. - ReadIoOps: 0 (0)
  2988. - ReadIoWaitTime: 0.000ns
  2989. - ReservationLimit: 4.00 MB (4194304)
  2990. - WriteIoBytes: 0
  2991. - WriteIoOps: 0 (0)
  2992. - WriteIoWaitTime: 0.000ns
  2993. Fragment Instance Lifecycle Timings:
  2994. - ExecTime: 6s080ms
  2995. - ExecTreeExecTime: 3s828ms
  2996. - OpenTime: 1s348ms
  2997. - ExecTreeOpenTime: 1s044ms
  2998. - PrepareTime: 8.000ms
  2999. - ExecTreePrepareTime: 0.000ns
  3000. KrpcDataStreamSender (dst_id=7):(Total: 316.016ms, non-child: 308.016ms, % non-child: 97.47%)
  3001. BytesSent(500.000ms): 0, 0, 0, 420.38 KB, 1.27 MB, 1.78 MB, 1.83 MB, 4.16 MB, 7.05 MB, 10.39 MB, 13.48 MB, 16.58 MB, 19.54 MB, 22.52 MB, 25.72 MB
  3002. - EosSent: 6 (6)
  3003. - NetworkThroughput: 26.98 MB/sec
  3004. - PeakMemoryUsage: 189.00 KB (193536)
  3005. - RowsSent: 460.03K (460032)
  3006. - RpcFailure: 0 (0)
  3007. - RpcRetry: 0 (0)
  3008. - SerializeBatchTime: 136.007ms
  3009. - TotalBytesSent: 28.30 MB (29674417)
  3010. - UncompressedRowBatchSize: 39.05 MB (40942848)
  3011. HASH_JOIN_NODE (id=3):(Total: 4s872ms, non-child: 2s436ms, % non-child: 50.00%)
  3012. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  3013. - BuildRows: 3.68M (3679360)
  3014. - BuildTime: 588.030ms
  3015. - NumHashTableBuildsSkipped: 0 (0)
  3016. - PeakMemoryUsage: 192.40 MB (201744640)
  3017. - ProbeRows: 16.41M (16406443)
  3018. - ProbeRowsPartitioned: 0 (0)
  3019. - ProbeTime: 1s808ms
  3020. - RowsReturned: 460.03K (460032)
  3021. - RowsReturnedRate: 94.42 K/sec
  3022. Buffer pool:
  3023. - AllocTime: 24.001ms
  3024. - CumulativeAllocationBytes: 192.00 MB (201326592)
  3025. - CumulativeAllocations: 48 (48)
  3026. - PeakReservation: 192.00 MB (201326592)
  3027. - PeakUnpinnedBytes: 0
  3028. - PeakUsedReservation: 192.00 MB (201326592)
  3029. - ReadIoBytes: 0
  3030. - ReadIoOps: 0 (0)
  3031. - ReadIoWaitTime: 0.000ns
  3032. - WriteIoBytes: 0
  3033. - WriteIoOps: 0 (0)
  3034. - WriteIoWaitTime: 0.000ns
  3035. Hash Join Builder (join_node_id=3):
  3036. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  3037. Runtime filters: 2 of 2 Runtime Filters Published
  3038. - BuildRowsPartitionTime: 316.016ms
  3039. - BuildRowsPartitioned: 3.68M (3679360)
  3040. - HashBuckets: 8.39M (8388608)
  3041. - HashCollisions: 0 (0)
  3042. - HashTablesBuildTime: 264.013ms
  3043. - LargestPartitionPercent: 6 (6)
  3044. - MaxPartitionLevel: 0 (0)
  3045. - NumRepartitions: 0 (0)
  3046. - PartitionsCreated: 16 (16)
  3047. - PeakMemoryUsage: 22.12 KB (22656)
  3048. - RepartitionTime: 0.000ns
  3049. - SpilledPartitions: 0 (0)
  3050. EXCHANGE_NODE (id=5):(Total: 100.005ms, non-child: 60.003ms, % non-child: 60.00%)
  3051. - ConvertRowBatchTime: 44.002ms
  3052. - PeakMemoryUsage: 12.70 MB (13312129)
  3053. - RowsReturned: 3.68M (3679360)
  3054. - RowsReturnedRate: 36.79 M/sec
  3055. Buffer pool:
  3056. - AllocTime: 32.001ms
  3057. - CumulativeAllocationBytes: 84.43 MB (88530944)
  3058. - CumulativeAllocations: 7.22K (7218)
  3059. - PeakReservation: 12.65 MB (13262848)
  3060. - PeakUnpinnedBytes: 0
  3061. - PeakUsedReservation: 12.65 MB (13262848)
  3062. - ReadIoBytes: 0
  3063. - ReadIoOps: 0 (0)
  3064. - ReadIoWaitTime: 0.000ns
  3065. - WriteIoBytes: 0
  3066. - WriteIoOps: 0 (0)
  3067. - WriteIoWaitTime: 0.000ns
  3068. Dequeue:
  3069. BytesDequeued(500.000ms): 0, 41.86 MB
  3070. - FirstBatchWaitTime: 0.000ns
  3071. - TotalBytesDequeued: 66.67 MB (69907840)
  3072. - TotalGetBatchTime: 52.002ms
  3073. - DataWaitTime: 40.002ms
  3074. Enqueue:
  3075. BytesReceived(500.000ms): 0, 23.73 MB
  3076. DeferredQueueSize(500.000ms): 0, 0
  3077. - DispatchTime: (Avg: 33.711us ; Min: 12.223us ; Max: 1.081ms ; Number of samples: 3609)
  3078. - DeserializeRowBatchTime: 96.005ms
  3079. - TotalBatchesEnqueued: 3.61K (3609)
  3080. - TotalBatchesReceived: 3.61K (3609)
  3081. - TotalBytesReceived: 33.37 MB (34992608)
  3082. - TotalEarlySenders: 0 (0)
  3083. - TotalEosReceived: 6 (6)
  3084. - TotalHasDeferredRPCsTime: 60.156ms
  3085. - TotalRPCsDeferred: 7 (7)
  3086. HDFS_SCAN_NODE (id=2):(Total: 2s336ms, non-child: 2s336ms, % non-child: 100.00%)
  3087. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:63/3.83 GB
  3088. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 63 out of 63
  3089. Runtime filters: All filters arrived. Waited 0
  3090. Hdfs Read Thread Concurrency Bucket: 0:35.71% 1:64.29% 2:0% 3:0% 4:0% 5:0%
  3091. File Formats: PARQUET/SNAPPY:63
  3092. BytesRead(500.000ms): 0, 0, 6.79 MB, 66.74 MB, 126.97 MB, 173.85 MB, 254.15 MB, 490.95 MB, 787.36 MB, 1.03 GB, 1.30 GB, 1.56 GB, 1.81 GB, 1.96 GB, 1.96 GB
  3093. - FooterProcessingTime: (Avg: 735.086ms ; Min: 20.001ms ; Max: 1s292ms ; Number of samples: 63)
  3094. - AverageHdfsReadThreadConcurrency: 0.64
  3095. - AverageScannerThreadConcurrency: 32.21
  3096. - BytesRead: 1.96 GB (2102185110)
  3097. - BytesReadDataNodeCache: 0
  3098. - BytesReadLocal: 1.96 GB (2102185110)
  3099. - BytesReadRemoteUnexpected: 0
  3100. - BytesReadShortCircuit: 1.96 GB (2102185110)
  3101. - CachedFileHandlesHitCount: 567 (567)
  3102. - CachedFileHandlesMissCount: 63 (63)
  3103. - CollectionItemsRead: 0 (0)
  3104. - DecompressionTime: 5s664ms
  3105. - MaxCompressedTextFileLength: 0
  3106. - NumColumns: 9 (9)
  3107. - NumDictFilteredRowGroups: 0 (0)
  3108. - NumDisksAccessed: 1 (1)
  3109. - NumRowGroups: 63 (63)
  3110. - NumScannerThreadsStarted: 39 (39)
  3111. - NumScannersWithNoReads: 0 (0)
  3112. - NumStatsFilteredRowGroups: 0 (0)
  3113. - PeakMemoryUsage: 1.32 GB (1413123920)
  3114. - PerReadThreadRawHdfsThroughput: 624.90 MB/sec
  3115. - RemoteScanRanges: 0 (0)
  3116. - RowBatchQueueGetWaitTime: 2s212ms
  3117. - RowBatchQueuePutWaitTime: 32s137ms
  3118. - RowsRead: 52.46M (52459008)
  3119. - RowsReturned: 16.41M (16406443)
  3120. - RowsReturnedRate: 7.02 M/sec
  3121. - ScanRangesComplete: 63 (63)
  3122. - ScannerThreadsInvoluntaryContextSwitches: 17 (17)
  3123. - ScannerThreadsTotalWallClockTime: 3m39s
  3124. - MaterializeTupleTime(*): 21s449ms
  3125. - ScannerThreadsSysTime: 5s836ms
  3126. - ScannerThreadsUserTime: 8s445ms
  3127. - ScannerThreadsVoluntaryContextSwitches: 48.27K (48267)
  3128. - TotalRawHdfsOpenFileTime(*): 1s148ms
  3129. - TotalRawHdfsReadTime(*): 3s208ms
  3130. - TotalReadThroughput: 267.31 MB/sec
  3131. Filter 4 (2.00 MB):
  3132. - Files processed: 0 (0)
  3133. - Files rejected: 0 (0)
  3134. - Files total: 0 (0)
  3135. - RowGroups processed: 0 (0)
  3136. - RowGroups rejected: 0 (0)
  3137. - RowGroups total: 0 (0)
  3138. - Rows processed: 4.18M (4178485)
  3139. - Rows rejected: 298.98K (298975)
  3140. - Rows total: 52.46M (52459008)
  3141. - Splits processed: 0 (0)
  3142. - Splits rejected: 0 (0)
  3143. - Splits total: 0 (0)
  3144. Filter 5 (2.00 MB):
  3145. - Files processed: 0 (0)
  3146. - Files rejected: 0 (0)
  3147. - Files total: 0 (0)
  3148. - RowGroups processed: 0 (0)
  3149. - RowGroups rejected: 0 (0)
  3150. - RowGroups total: 0 (0)
  3151. - Rows processed: 3.41M (3407144)
  3152. - Rows rejected: 73.96K (73956)
  3153. - Rows total: 52.16M (52160033)
  3154. - Splits processed: 0 (0)
  3155. - Splits rejected: 0 (0)
  3156. - Splits total: 0 (0)
  3157. CodeGen:(Total: 300.015ms, non-child: 300.015ms, % non-child: 100.00%)
  3158. - CodegenTime: 4.000ms
  3159. - CompileTime: 84.004ms
  3160. - LoadTime: 0.000ns
  3161. - ModuleBitcodeSize: 1.95 MB (2040108)
  3162. - NumFunctions: 113 (113)
  3163. - NumInstructions: 3.40K (3401)
  3164. - OptimizationTime: 200.010ms
  3165. - PeakMemoryUsage: 1.66 MB (1741312)
  3166. - PrepareTime: 16.000ms
  3167. Instance 984ea1ea895ca2cf:a12d79aa00000010 (host=slave-cn03:22000):(Total: 7s420ms, non-child: 1s624ms, % non-child: 21.89%)
  3168. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:63/3.83 GB
  3169. Filter 4 arrival: 747ms
  3170. Filter 5 arrival: 746ms
  3171. Fragment Instance Lifecycle Event Timeline: 7s420ms
  3172. - Prepare Finished: 0.000ns (0.000ns)
  3173. - Open Finished: 1s440ms (1s440ms)
  3174. - First Batch Produced: 1s460ms (20.000ms)
  3175. - First Batch Sent: 1s460ms (0.000ns)
  3176. - ExecInternal Finished: 7s420ms (5s960ms)
  3177. MemoryUsage(500.000ms): 4.08 MB, 50.74 MB, 196.08 MB, 280.78 MB, 275.06 MB, 297.37 MB, 262.40 MB, 422.17 MB, 494.31 MB, 689.80 MB, 928.70 MB, 1.07 GB, 1.08 GB, 1.24 GB, 1.06 GB
  3178. ThreadUsage(500.000ms): 1, 2, 39, 40, 40, 40, 40, 40, 40, 40, 40, 38, 30, 22, 18
  3179. - AverageThreadTokens: 31.33
  3180. - BloomFilterBytes: 4.00 MB (4194304)
  3181. - PeakMemoryUsage: 1.28 GB (1371012744)
  3182. - PeakReservation: 196.00 MB (205520896)
  3183. - PeakUsedReservation: 0
  3184. - PerHostPeakMemUsage: 1.57 GB (1688006861)
  3185. - RowsProduced: 458.37K (458369)
  3186. - TotalNetworkReceiveTime: 80.003ms
  3187. - TotalNetworkSendTime: 4.000ms
  3188. - TotalStorageWaitTime: 2m38s
  3189. - TotalThreadsInvoluntaryContextSwitches: 25 (25)
  3190. - TotalThreadsTotalWallClockTime: 3m47s
  3191. - TotalThreadsSysTime: 7s806ms
  3192. - TotalThreadsUserTime: 10s015ms
  3193. - TotalThreadsVoluntaryContextSwitches: 45.85K (45854)
  3194. Buffer pool:
  3195. - AllocTime: 0.000ns
  3196. - CumulativeAllocationBytes: 4.00 MB (4194304)
  3197. - CumulativeAllocations: 2 (2)
  3198. - PeakReservation: 4.00 MB (4194304)
  3199. - PeakUnpinnedBytes: 0
  3200. - PeakUsedReservation: 4.00 MB (4194304)
  3201. - ReadIoBytes: 0
  3202. - ReadIoOps: 0 (0)
  3203. - ReadIoWaitTime: 0.000ns
  3204. - ReservationLimit: 4.00 MB (4194304)
  3205. - WriteIoBytes: 0
  3206. - WriteIoOps: 0 (0)
  3207. - WriteIoWaitTime: 0.000ns
  3208. Fragment Instance Lifecycle Timings:
  3209. - ExecTime: 5s980ms
  3210. - ExecTreeExecTime: 4s108ms
  3211. - OpenTime: 1s440ms
  3212. - ExecTreeOpenTime: 1s140ms
  3213. - PrepareTime: 0.000ns
  3214. - ExecTreePrepareTime: 0.000ns
  3215. KrpcDataStreamSender (dst_id=7):(Total: 256.011ms, non-child: 252.011ms, % non-child: 98.44%)
  3216. BytesSent(500.000ms): 0, 0, 0, 84.01 KB, 924.59 KB, 1.45 MB, 1.71 MB, 2.85 MB, 4.80 MB, 7.98 MB, 11.65 MB, 15.11 MB, 18.45 MB, 22.00 MB, 25.42 MB
  3217. - EosSent: 6 (6)
  3218. - NetworkThroughput: 26.15 MB/sec
  3219. - PeakMemoryUsage: 189.00 KB (193536)
  3220. - RowsSent: 458.37K (458369)
  3221. - RpcFailure: 0 (0)
  3222. - RpcRetry: 0 (0)
  3223. - SerializeBatchTime: 112.005ms
  3224. - TotalBytesSent: 28.19 MB (29556468)
  3225. - UncompressedRowBatchSize: 38.90 MB (40794841)
  3226. HASH_JOIN_NODE (id=3):(Total: 5s248ms, non-child: 2s432ms, % non-child: 46.34%)
  3227. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  3228. - BuildRows: 3.68M (3679360)
  3229. - BuildTime: 572.026ms
  3230. - NumHashTableBuildsSkipped: 0 (0)
  3231. - PeakMemoryUsage: 192.40 MB (201744640)
  3232. - ProbeRows: 16.41M (16409133)
  3233. - ProbeRowsPartitioned: 0 (0)
  3234. - ProbeTime: 1s820ms
  3235. - RowsReturned: 458.37K (458369)
  3236. - RowsReturnedRate: 87.34 K/sec
  3237. Buffer pool:
  3238. - AllocTime: 8.000ms
  3239. - CumulativeAllocationBytes: 192.00 MB (201326592)
  3240. - CumulativeAllocations: 48 (48)
  3241. - PeakReservation: 192.00 MB (201326592)
  3242. - PeakUnpinnedBytes: 0
  3243. - PeakUsedReservation: 192.00 MB (201326592)
  3244. - ReadIoBytes: 0
  3245. - ReadIoOps: 0 (0)
  3246. - ReadIoWaitTime: 0.000ns
  3247. - WriteIoBytes: 0
  3248. - WriteIoOps: 0 (0)
  3249. - WriteIoWaitTime: 0.000ns
  3250. Hash Join Builder (join_node_id=3):
  3251. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  3252. Runtime filters: 2 of 2 Runtime Filters Published
  3253. - BuildRowsPartitionTime: 300.013ms
  3254. - BuildRowsPartitioned: 3.68M (3679360)
  3255. - HashBuckets: 8.39M (8388608)
  3256. - HashCollisions: 0 (0)
  3257. - HashTablesBuildTime: 268.012ms
  3258. - LargestPartitionPercent: 6 (6)
  3259. - MaxPartitionLevel: 0 (0)
  3260. - NumRepartitions: 0 (0)
  3261. - PartitionsCreated: 16 (16)
  3262. - PeakMemoryUsage: 22.12 KB (22656)
  3263. - RepartitionTime: 0.000ns
  3264. - SpilledPartitions: 0 (0)
  3265. EXCHANGE_NODE (id=5):(Total: 140.006ms, non-child: 64.002ms, % non-child: 45.71%)
  3266. - ConvertRowBatchTime: 56.002ms
  3267. - PeakMemoryUsage: 12.70 MB (13312082)
  3268. - RowsReturned: 3.68M (3679360)
  3269. - RowsReturnedRate: 26.28 M/sec
  3270. Buffer pool:
  3271. - AllocTime: 28.001ms
  3272. - CumulativeAllocationBytes: 84.43 MB (88530944)
  3273. - CumulativeAllocations: 7.22K (7218)
  3274. - PeakReservation: 12.65 MB (13262848)
  3275. - PeakUnpinnedBytes: 0
  3276. - PeakUsedReservation: 12.65 MB (13262848)
  3277. - ReadIoBytes: 0
  3278. - ReadIoOps: 0 (0)
  3279. - ReadIoWaitTime: 0.000ns
  3280. - WriteIoBytes: 0
  3281. - WriteIoOps: 0 (0)
  3282. - WriteIoWaitTime: 0.000ns
  3283. Dequeue:
  3284. BytesDequeued(500.000ms): 0, 39.47 MB
  3285. - FirstBatchWaitTime: 0.000ns
  3286. - TotalBytesDequeued: 66.67 MB (69907840)
  3287. - TotalGetBatchTime: 80.003ms
  3288. - DataWaitTime: 76.003ms
  3289. Enqueue:
  3290. BytesReceived(500.000ms): 0, 19.76 MB
  3291. DeferredQueueSize(500.000ms): 0, 0
  3292. - DispatchTime: (Avg: 32.877us ; Min: 12.321us ; Max: 391.894us ; Number of samples: 3609)
  3293. - DeserializeRowBatchTime: 116.005ms
  3294. - TotalBatchesEnqueued: 3.61K (3609)
  3295. - TotalBatchesReceived: 3.61K (3609)
  3296. - TotalBytesReceived: 33.37 MB (34992608)
  3297. - TotalEarlySenders: 0 (0)
  3298. - TotalEosReceived: 6 (6)
  3299. - TotalHasDeferredRPCsTime: 40.559ms
  3300. - TotalRPCsDeferred: 6 (6)
  3301. HDFS_SCAN_NODE (id=2):(Total: 2s676ms, non-child: 2s676ms, % non-child: 100.00%)
  3302. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:63/3.83 GB
  3303. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 63 out of 63
  3304. Runtime filters: All filters arrived. Waited 0
  3305. Hdfs Read Thread Concurrency Bucket: 0:35.71% 1:64.29% 2:0% 3:0% 4:0% 5:0%
  3306. File Formats: PARQUET/SNAPPY:63
  3307. BytesRead(500.000ms): 0, 0, 0, 53.75 MB, 112.90 MB, 160.26 MB, 181.32 MB, 326.83 MB, 545.27 MB, 823.39 MB, 1.12 GB, 1.36 GB, 1.62 GB, 1.96 GB, 1.96 GB
  3308. - FooterProcessingTime: (Avg: 822.386ms ; Min: 16.000ms ; Max: 1s400ms ; Number of samples: 63)
  3309. - AverageHdfsReadThreadConcurrency: 0.64
  3310. - AverageScannerThreadConcurrency: 32.43
  3311. - BytesRead: 1.96 GB (2102302557)
  3312. - BytesReadDataNodeCache: 0
  3313. - BytesReadLocal: 1.96 GB (2102302557)
  3314. - BytesReadRemoteUnexpected: 0
  3315. - BytesReadShortCircuit: 1.96 GB (2102302557)
  3316. - CachedFileHandlesHitCount: 567 (567)
  3317. - CachedFileHandlesMissCount: 63 (63)
  3318. - CollectionItemsRead: 0 (0)
  3319. - DecompressionTime: 4s304ms
  3320. - MaxCompressedTextFileLength: 0
  3321. - NumColumns: 9 (9)
  3322. - NumDictFilteredRowGroups: 0 (0)
  3323. - NumDisksAccessed: 1 (1)
  3324. - NumRowGroups: 63 (63)
  3325. - NumScannerThreadsStarted: 39 (39)
  3326. - NumScannersWithNoReads: 0 (0)
  3327. - NumStatsFilteredRowGroups: 0 (0)
  3328. - PeakMemoryUsage: 1.08 GB (1158857825)
  3329. - PerReadThreadRawHdfsThroughput: 599.53 MB/sec
  3330. - RemoteScanRanges: 0 (0)
  3331. - RowBatchQueueGetWaitTime: 2s580ms
  3332. - RowBatchQueuePutWaitTime: 28s837ms
  3333. - RowsRead: 52.47M (52469198)
  3334. - RowsReturned: 16.41M (16409133)
  3335. - RowsReturnedRate: 6.13 M/sec
  3336. - ScanRangesComplete: 63 (63)
  3337. - ScannerThreadsInvoluntaryContextSwitches: 19 (19)
  3338. - ScannerThreadsTotalWallClockTime: 3m38s
  3339. - MaterializeTupleTime(*): 10s748ms
  3340. - ScannerThreadsSysTime: 6s113ms
  3341. - ScannerThreadsUserTime: 7s053ms
  3342. - ScannerThreadsVoluntaryContextSwitches: 43.19K (43190)
  3343. - TotalRawHdfsOpenFileTime(*): 1s016ms
  3344. - TotalRawHdfsReadTime(*): 3s344ms
  3345. - TotalReadThroughput: 267.32 MB/sec
  3346. Filter 4 (2.00 MB):
  3347. - Files processed: 0 (0)
  3348. - Files rejected: 0 (0)
  3349. - Files total: 0 (0)
  3350. - RowGroups processed: 0 (0)
  3351. - RowGroups rejected: 0 (0)
  3352. - RowGroups total: 0 (0)
  3353. - Rows processed: 4.08M (4077799)
  3354. - Rows rejected: 290.60K (290603)
  3355. - Rows total: 52.47M (52469198)
  3356. - Splits processed: 0 (0)
  3357. - Splits rejected: 0 (0)
  3358. - Splits total: 0 (0)
  3359. Filter 5 (2.00 MB):
  3360. - Files processed: 0 (0)
  3361. - Files rejected: 0 (0)
  3362. - Files total: 0 (0)
  3363. - RowGroups processed: 0 (0)
  3364. - RowGroups rejected: 0 (0)
  3365. - RowGroups total: 0 (0)
  3366. - Rows processed: 3.42M (3422275)
  3367. - Rows rejected: 84.35K (84352)
  3368. - Rows total: 52.18M (52178595)
  3369. - Splits processed: 0 (0)
  3370. - Splits rejected: 0 (0)
  3371. - Splits total: 0 (0)
  3372. CodeGen:(Total: 292.013ms, non-child: 292.013ms, % non-child: 100.00%)
  3373. - CodegenTime: 4.000ms
  3374. - CompileTime: 80.003ms
  3375. - LoadTime: 0.000ns
  3376. - ModuleBitcodeSize: 1.95 MB (2040108)
  3377. - NumFunctions: 113 (113)
  3378. - NumInstructions: 3.40K (3401)
  3379. - OptimizationTime: 192.008ms
  3380. - PeakMemoryUsage: 1.66 MB (1741312)
  3381. - PrepareTime: 20.000ms
  3382. Instance 984ea1ea895ca2cf:a12d79aa00000012 (host=slave-cn07:22000):(Total: 7s268ms, non-child: 1s768ms, % non-child: 24.33%)
  3383. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:63/3.86 GB
  3384. Filter 4 arrival: 746ms
  3385. Filter 5 arrival: 746ms
  3386. Fragment Instance Lifecycle Event Timeline: 7s268ms
  3387. - Prepare Finished: 4.000ms (4.000ms)
  3388. - Open Finished: 1s384ms (1s380ms)
  3389. - First Batch Produced: 1s404ms (20.000ms)
  3390. - First Batch Sent: 1s404ms (0.000ns)
  3391. - ExecInternal Finished: 7s268ms (5s864ms)
  3392. MemoryUsage(500.000ms): 4.08 MB, 50.74 MB, 200.75 MB, 269.85 MB, 235.09 MB, 257.45 MB, 314.20 MB, 453.60 MB, 733.71 MB, 917.13 MB, 1.26 GB, 1.49 GB, 1.74 GB, 1.37 GB, 939.02 MB
  3393. ThreadUsage(500.000ms): 1, 2, 2, 40, 40, 40, 40, 40, 40, 40, 40, 39, 34, 24, 15
  3394. - AverageThreadTokens: 29.13
  3395. - BloomFilterBytes: 4.00 MB (4194304)
  3396. - PeakMemoryUsage: 1.78 GB (1913335173)
  3397. - PeakReservation: 196.00 MB (205520896)
  3398. - PeakUsedReservation: 0
  3399. - PerHostPeakMemUsage: 2.05 GB (2206373452)
  3400. - RowsProduced: 463.27K (463270)
  3401. - TotalNetworkReceiveTime: 72.003ms
  3402. - TotalNetworkSendTime: 8.000ms
  3403. - TotalStorageWaitTime: 2m17s
  3404. - TotalThreadsInvoluntaryContextSwitches: 22 (22)
  3405. - TotalThreadsTotalWallClockTime: 3m45s
  3406. - TotalThreadsSysTime: 8s456ms
  3407. - TotalThreadsUserTime: 10s275ms
  3408. - TotalThreadsVoluntaryContextSwitches: 47.56K (47561)
  3409. Buffer pool:
  3410. - AllocTime: 0.000ns
  3411. - CumulativeAllocationBytes: 4.00 MB (4194304)
  3412. - CumulativeAllocations: 2 (2)
  3413. - PeakReservation: 4.00 MB (4194304)
  3414. - PeakUnpinnedBytes: 0
  3415. - PeakUsedReservation: 4.00 MB (4194304)
  3416. - ReadIoBytes: 0
  3417. - ReadIoOps: 0 (0)
  3418. - ReadIoWaitTime: 0.000ns
  3419. - ReservationLimit: 4.00 MB (4194304)
  3420. - WriteIoBytes: 0
  3421. - WriteIoOps: 0 (0)
  3422. - WriteIoWaitTime: 0.000ns
  3423. Fragment Instance Lifecycle Timings:
  3424. - ExecTime: 5s884ms
  3425. - ExecTreeExecTime: 3s852ms
  3426. - OpenTime: 1s380ms
  3427. - ExecTreeOpenTime: 1s060ms
  3428. - PrepareTime: 4.000ms
  3429. - ExecTreePrepareTime: 4.000ms
  3430. KrpcDataStreamSender (dst_id=7):(Total: 264.012ms, non-child: 256.012ms, % non-child: 96.97%)
  3431. BytesSent(500.000ms): 0, 0, 0, 224.22 KB, 840.91 KB, 1.27 MB, 1.78 MB, 3.96 MB, 6.61 MB, 10.20 MB, 13.52 MB, 16.82 MB, 20.10 MB, 23.46 MB, 26.96 MB
  3432. - EosSent: 6 (6)
  3433. - NetworkThroughput: 26.06 MB/sec
  3434. - PeakMemoryUsage: 189.00 KB (193536)
  3435. - RowsSent: 463.27K (463270)
  3436. - RpcFailure: 0 (0)
  3437. - RpcRetry: 0 (0)
  3438. - SerializeBatchTime: 104.004ms
  3439. - TotalBytesSent: 28.49 MB (29875337)
  3440. - UncompressedRowBatchSize: 39.32 MB (41231030)
  3441. HASH_JOIN_NODE (id=3):(Total: 4s920ms, non-child: 2s480ms, % non-child: 50.41%)
  3442. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  3443. - BuildRows: 3.68M (3679360)
  3444. - BuildTime: 580.027ms
  3445. - NumHashTableBuildsSkipped: 0 (0)
  3446. - PeakMemoryUsage: 192.40 MB (201744640)
  3447. - ProbeRows: 16.54M (16539200)
  3448. - ProbeRowsPartitioned: 0 (0)
  3449. - ProbeTime: 1s864ms
  3450. - RowsReturned: 463.27K (463270)
  3451. - RowsReturnedRate: 94.16 K/sec
  3452. Buffer pool:
  3453. - AllocTime: 0.000ns
  3454. - CumulativeAllocationBytes: 192.00 MB (201326592)
  3455. - CumulativeAllocations: 48 (48)
  3456. - PeakReservation: 192.00 MB (201326592)
  3457. - PeakUnpinnedBytes: 0
  3458. - PeakUsedReservation: 192.00 MB (201326592)
  3459. - ReadIoBytes: 0
  3460. - ReadIoOps: 0 (0)
  3461. - ReadIoWaitTime: 0.000ns
  3462. - WriteIoBytes: 0
  3463. - WriteIoOps: 0 (0)
  3464. - WriteIoWaitTime: 0.000ns
  3465. Hash Join Builder (join_node_id=3):
  3466. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  3467. Runtime filters: 2 of 2 Runtime Filters Published
  3468. - BuildRowsPartitionTime: 280.013ms
  3469. - BuildRowsPartitioned: 3.68M (3679360)
  3470. - HashBuckets: 8.39M (8388608)
  3471. - HashCollisions: 0 (0)
  3472. - HashTablesBuildTime: 284.013ms
  3473. - LargestPartitionPercent: 6 (6)
  3474. - MaxPartitionLevel: 0 (0)
  3475. - NumRepartitions: 0 (0)
  3476. - PartitionsCreated: 16 (16)
  3477. - PeakMemoryUsage: 22.12 KB (22656)
  3478. - RepartitionTime: 0.000ns
  3479. - SpilledPartitions: 0 (0)
  3480. EXCHANGE_NODE (id=5):(Total: 128.006ms, non-child: 56.002ms, % non-child: 43.75%)
  3481. - ConvertRowBatchTime: 52.002ms
  3482. - PeakMemoryUsage: 12.70 MB (13321951)
  3483. - RowsReturned: 3.68M (3679360)
  3484. - RowsReturnedRate: 28.74 M/sec
  3485. Buffer pool:
  3486. - AllocTime: 16.000ms
  3487. - CumulativeAllocationBytes: 84.43 MB (88530944)
  3488. - CumulativeAllocations: 7.22K (7218)
  3489. - PeakReservation: 12.65 MB (13262848)
  3490. - PeakUnpinnedBytes: 0
  3491. - PeakUsedReservation: 12.65 MB (13262848)
  3492. - ReadIoBytes: 0
  3493. - ReadIoOps: 0 (0)
  3494. - ReadIoWaitTime: 0.000ns
  3495. - WriteIoBytes: 0
  3496. - WriteIoOps: 0 (0)
  3497. - WriteIoWaitTime: 0.000ns
  3498. Dequeue:
  3499. BytesDequeued(500.000ms): 0, 34.85 MB, 66.67 MB
  3500. - FirstBatchWaitTime: 0.000ns
  3501. - TotalBytesDequeued: 66.67 MB (69907840)
  3502. - TotalGetBatchTime: 72.003ms
  3503. - DataWaitTime: 72.003ms
  3504. Enqueue:
  3505. BytesReceived(500.000ms): 0, 18.50 MB, 33.37 MB
  3506. DeferredQueueSize(500.000ms): 0, 0, 0
  3507. - DispatchTime: (Avg: 31.752us ; Min: 12.211us ; Max: 416.150us ; Number of samples: 3609)
  3508. - DeserializeRowBatchTime: 72.003ms
  3509. - TotalBatchesEnqueued: 3.61K (3609)
  3510. - TotalBatchesReceived: 3.61K (3609)
  3511. - TotalBytesReceived: 33.37 MB (34992608)
  3512. - TotalEarlySenders: 0 (0)
  3513. - TotalEosReceived: 6 (6)
  3514. - TotalHasDeferredRPCsTime: 64.954ms
  3515. - TotalRPCsDeferred: 8 (8)
  3516. HDFS_SCAN_NODE (id=2):(Total: 2s312ms, non-child: 2s312ms, % non-child: 100.00%)
  3517. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:63/3.86 GB
  3518. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 63 out of 63
  3519. Runtime filters: All filters arrived. Waited 0
  3520. Hdfs Read Thread Concurrency Bucket: 0:35.71% 1:64.29% 2:0% 3:0% 4:0% 5:0%
  3521. File Formats: PARQUET/SNAPPY:63
  3522. BytesRead(500.000ms): 0, 0, 0, 46.99 MB, 93.99 MB, 144.18 MB, 210.49 MB, 468.38 MB, 767.31 MB, 1.02 GB, 1.36 GB, 1.60 GB, 1.92 GB, 1.97 GB, 1.97 GB
  3523. - FooterProcessingTime: (Avg: 697.493ms ; Min: 20.000ms ; Max: 1s312ms ; Number of samples: 63)
  3524. - AverageHdfsReadThreadConcurrency: 0.64
  3525. - AverageScannerThreadConcurrency: 30.00
  3526. - BytesRead: 1.97 GB (2119572213)
  3527. - BytesReadDataNodeCache: 0
  3528. - BytesReadLocal: 1.97 GB (2119572213)
  3529. - BytesReadRemoteUnexpected: 0
  3530. - BytesReadShortCircuit: 1.97 GB (2119572213)
  3531. - CachedFileHandlesHitCount: 567 (567)
  3532. - CachedFileHandlesMissCount: 63 (63)
  3533. - CollectionItemsRead: 0 (0)
  3534. - DecompressionTime: 4s540ms
  3535. - MaxCompressedTextFileLength: 0
  3536. - NumColumns: 9 (9)
  3537. - NumDictFilteredRowGroups: 0 (0)
  3538. - NumDisksAccessed: 1 (1)
  3539. - NumRowGroups: 63 (63)
  3540. - NumScannerThreadsStarted: 39 (39)
  3541. - NumScannersWithNoReads: 0 (0)
  3542. - NumStatsFilteredRowGroups: 0 (0)
  3543. - PeakMemoryUsage: 1.58 GB (1700076382)
  3544. - PerReadThreadRawHdfsThroughput: 685.65 MB/sec
  3545. - RemoteScanRanges: 0 (0)
  3546. - RowBatchQueueGetWaitTime: 2s212ms
  3547. - RowBatchQueuePutWaitTime: 46s406ms
  3548. - RowsRead: 52.90M (52896164)
  3549. - RowsReturned: 16.54M (16539200)
  3550. - RowsReturnedRate: 7.15 M/sec
  3551. - ScanRangesComplete: 63 (63)
  3552. - ScannerThreadsInvoluntaryContextSwitches: 17 (17)
  3553. - ScannerThreadsTotalWallClockTime: 3m37s
  3554. - MaterializeTupleTime(*): 11s872ms
  3555. - ScannerThreadsSysTime: 6s653ms
  3556. - ScannerThreadsUserTime: 7s302ms
  3557. - ScannerThreadsVoluntaryContextSwitches: 45.14K (45137)
  3558. - TotalRawHdfsOpenFileTime(*): 1s168ms
  3559. - TotalRawHdfsReadTime(*): 2s948ms
  3560. - TotalReadThroughput: 269.52 MB/sec
  3561. Filter 4 (2.00 MB):
  3562. - Files processed: 0 (0)
  3563. - Files rejected: 0 (0)
  3564. - Files total: 0 (0)
  3565. - RowGroups processed: 0 (0)
  3566. - RowGroups rejected: 0 (0)
  3567. - RowGroups total: 0 (0)
  3568. - Rows processed: 4.14M (4139158)
  3569. - Rows rejected: 290.00K (290000)
  3570. - Rows total: 52.90M (52896164)
  3571. - Splits processed: 0 (0)
  3572. - Splits rejected: 0 (0)
  3573. - Splits total: 0 (0)
  3574. Filter 5 (2.00 MB):
  3575. - Files processed: 0 (0)
  3576. - Files rejected: 0 (0)
  3577. - Files total: 0 (0)
  3578. - RowGroups processed: 0 (0)
  3579. - RowGroups rejected: 0 (0)
  3580. - RowGroups total: 0 (0)
  3581. - Rows processed: 3.43M (3427940)
  3582. - Rows rejected: 84.82K (84817)
  3583. - Rows total: 52.61M (52606164)
  3584. - Splits processed: 0 (0)
  3585. - Splits rejected: 0 (0)
  3586. - Splits total: 0 (0)
  3587. CodeGen:(Total: 316.015ms, non-child: 316.015ms, % non-child: 100.00%)
  3588. - CodegenTime: 0.000ns
  3589. - CompileTime: 76.003ms
  3590. - LoadTime: 0.000ns
  3591. - ModuleBitcodeSize: 1.95 MB (2040108)
  3592. - NumFunctions: 113 (113)
  3593. - NumInstructions: 3.40K (3401)
  3594. - OptimizationTime: 216.010ms
  3595. - PeakMemoryUsage: 1.66 MB (1741312)
  3596. - PrepareTime: 24.001ms
  3597. Instance 984ea1ea895ca2cf:a12d79aa0000000e (host=slave-cn05:22000):(Total: 6s996ms, non-child: 1s656ms, % non-child: 23.67%)
  3598. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:61/3.77 GB
  3599. Filter 4 arrival: 746ms
  3600. Filter 5 arrival: 745ms
  3601. Fragment Instance Lifecycle Event Timeline: 6s996ms
  3602. - Prepare Finished: 0.000ns (0.000ns)
  3603. - Open Finished: 1s312ms (1s312ms)
  3604. - First Batch Produced: 1s332ms (20.001ms)
  3605. - First Batch Sent: 1s332ms (0.000ns)
  3606. - ExecInternal Finished: 6s996ms (5s664ms)
  3607. MemoryUsage(500.000ms): 5.74 MB, 50.74 MB, 212.47 MB, 268.04 MB, 245.10 MB, 258.02 MB, 414.93 MB, 574.60 MB, 897.32 MB, 1.08 GB, 1.30 GB, 1.64 GB, 1.60 GB, 1.09 GB
  3608. ThreadUsage(500.000ms): 1, 2, 40, 40, 40, 40, 40, 40, 40, 40, 38, 33, 29, 19
  3609. - AverageThreadTokens: 31.57
  3610. - BloomFilterBytes: 4.00 MB (4194304)
  3611. - PeakMemoryUsage: 1.75 GB (1875612084)
  3612. - PeakReservation: 196.00 MB (205520896)
  3613. - PeakUsedReservation: 0
  3614. - PerHostPeakMemUsage: 2.03 GB (2177414655)
  3615. - RowsProduced: 452.59K (452592)
  3616. - TotalNetworkReceiveTime: 84.004ms
  3617. - TotalNetworkSendTime: 4.000ms
  3618. - TotalStorageWaitTime: 2m13s
  3619. - TotalThreadsInvoluntaryContextSwitches: 24 (24)
  3620. - TotalThreadsTotalWallClockTime: 3m35s
  3621. - TotalThreadsSysTime: 7s818ms
  3622. - TotalThreadsUserTime: 9s946ms
  3623. - TotalThreadsVoluntaryContextSwitches: 44.07K (44071)
  3624. Buffer pool:
  3625. - AllocTime: 0.000ns
  3626. - CumulativeAllocationBytes: 4.00 MB (4194304)
  3627. - CumulativeAllocations: 2 (2)
  3628. - PeakReservation: 4.00 MB (4194304)
  3629. - PeakUnpinnedBytes: 0
  3630. - PeakUsedReservation: 4.00 MB (4194304)
  3631. - ReadIoBytes: 0
  3632. - ReadIoOps: 0 (0)
  3633. - ReadIoWaitTime: 0.000ns
  3634. - ReservationLimit: 4.00 MB (4194304)
  3635. - WriteIoBytes: 0
  3636. - WriteIoOps: 0 (0)
  3637. - WriteIoWaitTime: 0.000ns
  3638. Fragment Instance Lifecycle Timings:
  3639. - ExecTime: 5s684ms
  3640. - ExecTreeExecTime: 3s780ms
  3641. - OpenTime: 1s312ms
  3642. - ExecTreeOpenTime: 1s012ms
  3643. - PrepareTime: 0.000ns
  3644. - ExecTreePrepareTime: 0.000ns
  3645. KrpcDataStreamSender (dst_id=7):(Total: 248.013ms, non-child: 244.013ms, % non-child: 98.39%)
  3646. BytesSent(500.000ms): 0, 0, 0, 518.95 KB, 1.26 MB, 1.78 MB, 2.40 MB, 4.71 MB, 8.43 MB, 11.88 MB, 15.28 MB, 18.59 MB, 22.05 MB, 25.46 MB
  3647. - EosSent: 6 (6)
  3648. - NetworkThroughput: 26.97 MB/sec
  3649. - PeakMemoryUsage: 189.00 KB (193536)
  3650. - RowsSent: 452.59K (452592)
  3651. - RpcFailure: 0 (0)
  3652. - RpcRetry: 0 (0)
  3653. - SerializeBatchTime: 100.005ms
  3654. - TotalBytesSent: 27.84 MB (29193235)
  3655. - UncompressedRowBatchSize: 38.41 MB (40280688)
  3656. HASH_JOIN_NODE (id=3):(Total: 4s792ms, non-child: 2s348ms, % non-child: 49.00%)
  3657. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  3658. - BuildRows: 3.68M (3679360)
  3659. - BuildTime: 572.031ms
  3660. - NumHashTableBuildsSkipped: 0 (0)
  3661. - PeakMemoryUsage: 192.40 MB (201744640)
  3662. - ProbeRows: 16.17M (16172193)
  3663. - ProbeRowsPartitioned: 0 (0)
  3664. - ProbeTime: 1s748ms
  3665. - RowsReturned: 452.59K (452592)
  3666. - RowsReturnedRate: 94.44 K/sec
  3667. Buffer pool:
  3668. - AllocTime: 0.000ns
  3669. - CumulativeAllocationBytes: 192.00 MB (201326592)
  3670. - CumulativeAllocations: 48 (48)
  3671. - PeakReservation: 192.00 MB (201326592)
  3672. - PeakUnpinnedBytes: 0
  3673. - PeakUsedReservation: 192.00 MB (201326592)
  3674. - ReadIoBytes: 0
  3675. - ReadIoOps: 0 (0)
  3676. - ReadIoWaitTime: 0.000ns
  3677. - WriteIoBytes: 0
  3678. - WriteIoOps: 0 (0)
  3679. - WriteIoWaitTime: 0.000ns
  3680. Hash Join Builder (join_node_id=3):
  3681. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  3682. Runtime filters: 2 of 2 Runtime Filters Published
  3683. - BuildRowsPartitionTime: 304.016ms
  3684. - BuildRowsPartitioned: 3.68M (3679360)
  3685. - HashBuckets: 8.39M (8388608)
  3686. - HashCollisions: 0 (0)
  3687. - HashTablesBuildTime: 264.014ms
  3688. - LargestPartitionPercent: 6 (6)
  3689. - MaxPartitionLevel: 0 (0)
  3690. - NumRepartitions: 0 (0)
  3691. - PartitionsCreated: 16 (16)
  3692. - PeakMemoryUsage: 22.12 KB (22656)
  3693. - RepartitionTime: 0.000ns
  3694. - SpilledPartitions: 0 (0)
  3695. EXCHANGE_NODE (id=5):(Total: 132.007ms, non-child: 52.002ms, % non-child: 39.39%)
  3696. - ConvertRowBatchTime: 40.002ms
  3697. - PeakMemoryUsage: 12.70 MB (13321815)
  3698. - RowsReturned: 3.68M (3679360)
  3699. - RowsReturnedRate: 27.87 M/sec
  3700. Buffer pool:
  3701. - AllocTime: 8.000ms
  3702. - CumulativeAllocationBytes: 84.43 MB (88530944)
  3703. - CumulativeAllocations: 7.22K (7218)
  3704. - PeakReservation: 12.65 MB (13262848)
  3705. - PeakUnpinnedBytes: 0
  3706. - PeakUsedReservation: 12.65 MB (13262848)
  3707. - ReadIoBytes: 0
  3708. - ReadIoOps: 0 (0)
  3709. - ReadIoWaitTime: 0.000ns
  3710. - WriteIoBytes: 0
  3711. - WriteIoOps: 0 (0)
  3712. - WriteIoWaitTime: 0.000ns
  3713. Dequeue:
  3714. BytesDequeued(500.000ms): 0, 55.11 MB
  3715. - FirstBatchWaitTime: 0.000ns
  3716. - TotalBytesDequeued: 66.67 MB (69907840)
  3717. - TotalGetBatchTime: 84.004ms
  3718. - DataWaitTime: 80.004ms
  3719. Enqueue:
  3720. BytesReceived(500.000ms): 0, 27.59 MB
  3721. DeferredQueueSize(500.000ms): 0, 0
  3722. - DispatchTime: (Avg: 32.022us ; Min: 11.869us ; Max: 437.340us ; Number of samples: 3609)
  3723. - DeserializeRowBatchTime: 104.005ms
  3724. - TotalBatchesEnqueued: 3.61K (3609)
  3725. - TotalBatchesReceived: 3.61K (3609)
  3726. - TotalBytesReceived: 33.37 MB (34992608)
  3727. - TotalEarlySenders: 0 (0)
  3728. - TotalEosReceived: 6 (6)
  3729. - TotalHasDeferredRPCsTime: 41.020ms
  3730. - TotalRPCsDeferred: 7 (7)
  3731. HDFS_SCAN_NODE (id=2):(Total: 2s312ms, non-child: 2s312ms, % non-child: 100.00%)
  3732. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:61/3.77 GB
  3733. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 61 out of 61
  3734. Runtime filters: All filters arrived. Waited 0
  3735. Hdfs Read Thread Concurrency Bucket: 0:30.77% 1:69.23% 2:0% 3:0% 4:0% 5:0%
  3736. File Formats: PARQUET/SNAPPY:61
  3737. BytesRead(500.000ms): 0, 0, 7.18 MB, 79.73 MB, 134.03 MB, 181.13 MB, 313.44 MB, 564.61 MB, 952.65 MB, 1.20 GB, 1.50 GB, 1.83 GB, 1.93 GB, 1.93 GB
  3738. - FooterProcessingTime: (Avg: 711.580ms ; Min: 20.001ms ; Max: 1s244ms ; Number of samples: 61)
  3739. - AverageHdfsReadThreadConcurrency: 0.69
  3740. - AverageScannerThreadConcurrency: 32.85
  3741. - BytesRead: 1.93 GB (2069686796)
  3742. - BytesReadDataNodeCache: 0
  3743. - BytesReadLocal: 1.93 GB (2069686796)
  3744. - BytesReadRemoteUnexpected: 0
  3745. - BytesReadShortCircuit: 1.93 GB (2069686796)
  3746. - CachedFileHandlesHitCount: 549 (549)
  3747. - CachedFileHandlesMissCount: 61 (61)
  3748. - CollectionItemsRead: 0 (0)
  3749. - DecompressionTime: 4s272ms
  3750. - MaxCompressedTextFileLength: 0
  3751. - NumColumns: 9 (9)
  3752. - NumDictFilteredRowGroups: 0 (0)
  3753. - NumDisksAccessed: 1 (1)
  3754. - NumRowGroups: 61 (61)
  3755. - NumScannerThreadsStarted: 39 (39)
  3756. - NumScannersWithNoReads: 0 (0)
  3757. - NumStatsFilteredRowGroups: 0 (0)
  3758. - PeakMemoryUsage: 1.55 GB (1662031486)
  3759. - PerReadThreadRawHdfsThroughput: 695.94 MB/sec
  3760. - RemoteScanRanges: 0 (0)
  3761. - RowBatchQueueGetWaitTime: 2s200ms
  3762. - RowBatchQueuePutWaitTime: 44s902ms
  3763. - RowsRead: 51.66M (51657599)
  3764. - RowsReturned: 16.17M (16172193)
  3765. - RowsReturnedRate: 6.99 M/sec
  3766. - ScanRangesComplete: 61 (61)
  3767. - ScannerThreadsInvoluntaryContextSwitches: 19 (19)
  3768. - ScannerThreadsTotalWallClockTime: 3m27s
  3769. - MaterializeTupleTime(*): 10s624ms
  3770. - ScannerThreadsSysTime: 6s150ms
  3771. - ScannerThreadsUserTime: 7s045ms
  3772. - ScannerThreadsVoluntaryContextSwitches: 41.60K (41604)
  3773. - TotalRawHdfsOpenFileTime(*): 972.053ms
  3774. - TotalRawHdfsReadTime(*): 2s836ms
  3775. - TotalReadThroughput: 281.97 MB/sec
  3776. Filter 4 (2.00 MB):
  3777. - Files processed: 0 (0)
  3778. - Files rejected: 0 (0)
  3779. - Files total: 0 (0)
  3780. - RowGroups processed: 0 (0)
  3781. - RowGroups rejected: 0 (0)
  3782. - RowGroups total: 0 (0)
  3783. - Rows processed: 3.67M (3670174)
  3784. - Rows rejected: 255.62K (255616)
  3785. - Rows total: 51.66M (51657599)
  3786. - Splits processed: 0 (0)
  3787. - Splits rejected: 0 (0)
  3788. - Splits total: 0 (0)
  3789. Filter 5 (2.00 MB):
  3790. - Files processed: 0 (0)
  3791. - Files rejected: 0 (0)
  3792. - Files total: 0 (0)
  3793. - RowGroups processed: 0 (0)
  3794. - RowGroups rejected: 0 (0)
  3795. - RowGroups total: 0 (0)
  3796. - Rows processed: 3.31M (3310270)
  3797. - Rows rejected: 74.83K (74828)
  3798. - Rows total: 51.40M (51401983)
  3799. - Splits processed: 0 (0)
  3800. - Splits rejected: 0 (0)
  3801. - Splits total: 0 (0)
  3802. CodeGen:(Total: 300.016ms, non-child: 300.016ms, % non-child: 100.00%)
  3803. - CodegenTime: 0.000ns
  3804. - CompileTime: 84.004ms
  3805. - LoadTime: 0.000ns
  3806. - ModuleBitcodeSize: 1.95 MB (2040108)
  3807. - NumFunctions: 113 (113)
  3808. - NumInstructions: 3.40K (3401)
  3809. - OptimizationTime: 192.010ms
  3810. - PeakMemoryUsage: 1.66 MB (1741312)
  3811. - PrepareTime: 24.001ms
  3812. Instance 984ea1ea895ca2cf:a12d79aa00000011 (host=slave-cn02:22000):(Total: 6s068ms, non-child: 1s624ms, % non-child: 26.76%)
  3813. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:65/3.82 GB
  3814. Filter 4 arrival: 747ms
  3815. Filter 5 arrival: 747ms
  3816. Fragment Instance Lifecycle Event Timeline: 6s068ms
  3817. - Prepare Finished: 8.000ms (8.000ms)
  3818. - Open Finished: 1s252ms (1s244ms)
  3819. - First Batch Produced: 1s272ms (20.000ms)
  3820. - First Batch Sent: 1s272ms (0.000ns)
  3821. - ExecInternal Finished: 6s068ms (4s796ms)
  3822. MemoryUsage(500.000ms): 6.47 MB, 80.74 MB, 221.64 MB, 288.91 MB, 298.29 MB, 680.39 MB, 1.16 GB, 1.62 GB, 1.60 GB, 1.52 GB, 1.43 GB, 988.81 MB
  3823. ThreadUsage(500.000ms): 1, 2, 30, 30, 30, 30, 30, 30, 30, 30, 27, 16
  3824. - AverageThreadTokens: 23.83
  3825. - BloomFilterBytes: 4.00 MB (4194304)
  3826. - PeakMemoryUsage: 1.63 GB (1750284142)
  3827. - PeakReservation: 196.00 MB (205520896)
  3828. - PeakUsedReservation: 0
  3829. - PerHostPeakMemUsage: 1.90 GB (2039715865)
  3830. - RowsProduced: 460.07K (460068)
  3831. - TotalNetworkReceiveTime: 60.002ms
  3832. - TotalNetworkSendTime: 4.000ms
  3833. - TotalStorageWaitTime: 53s402ms
  3834. - TotalThreadsInvoluntaryContextSwitches: 30 (30)
  3835. - TotalThreadsTotalWallClockTime: 2m21s
  3836. - TotalThreadsSysTime: 7s836ms
  3837. - TotalThreadsUserTime: 10s535ms
  3838. - TotalThreadsVoluntaryContextSwitches: 48.46K (48458)
  3839. Buffer pool:
  3840. - AllocTime: 0.000ns
  3841. - CumulativeAllocationBytes: 4.00 MB (4194304)
  3842. - CumulativeAllocations: 2 (2)
  3843. - PeakReservation: 4.00 MB (4194304)
  3844. - PeakUnpinnedBytes: 0
  3845. - PeakUsedReservation: 4.00 MB (4194304)
  3846. - ReadIoBytes: 0
  3847. - ReadIoOps: 0 (0)
  3848. - ReadIoWaitTime: 0.000ns
  3849. - ReservationLimit: 4.00 MB (4194304)
  3850. - WriteIoBytes: 0
  3851. - WriteIoOps: 0 (0)
  3852. - WriteIoWaitTime: 0.000ns
  3853. Fragment Instance Lifecycle Timings:
  3854. - ExecTime: 4s816ms
  3855. - ExecTreeExecTime: 2s896ms
  3856. - OpenTime: 1s244ms
  3857. - ExecTreeOpenTime: 928.042ms
  3858. - PrepareTime: 8.000ms
  3859. - ExecTreePrepareTime: 0.000ns
  3860. KrpcDataStreamSender (dst_id=7):(Total: 308.014ms, non-child: 300.013ms, % non-child: 97.40%)
  3861. BytesSent(500.000ms): 0, 0, 0, 1.15 MB, 1.78 MB, 4.87 MB, 8.44 MB, 11.90 MB, 15.45 MB, 18.79 MB, 22.14 MB, 25.55 MB
  3862. - EosSent: 6 (6)
  3863. - NetworkThroughput: 26.20 MB/sec
  3864. - PeakMemoryUsage: 189.00 KB (193536)
  3865. - RowsSent: 460.07K (460068)
  3866. - RpcFailure: 0 (0)
  3867. - RpcRetry: 0 (0)
  3868. - SerializeBatchTime: 152.007ms
  3869. - TotalBytesSent: 28.32 MB (29697483)
  3870. - UncompressedRowBatchSize: 39.05 MB (40946052)
  3871. HASH_JOIN_NODE (id=3):(Total: 3s824ms, non-child: 2s460ms, % non-child: 64.33%)
  3872. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  3873. - BuildRows: 3.68M (3679360)
  3874. - BuildTime: 552.025ms
  3875. - NumHashTableBuildsSkipped: 0 (0)
  3876. - PeakMemoryUsage: 192.40 MB (201744640)
  3877. - ProbeRows: 16.40M (16399094)
  3878. - ProbeRowsPartitioned: 0 (0)
  3879. - ProbeTime: 1s868ms
  3880. - RowsReturned: 460.07K (460068)
  3881. - RowsReturnedRate: 120.31 K/sec
  3882. Buffer pool:
  3883. - AllocTime: 8.000ms
  3884. - CumulativeAllocationBytes: 192.00 MB (201326592)
  3885. - CumulativeAllocations: 48 (48)
  3886. - PeakReservation: 192.00 MB (201326592)
  3887. - PeakUnpinnedBytes: 0
  3888. - PeakUsedReservation: 192.00 MB (201326592)
  3889. - ReadIoBytes: 0
  3890. - ReadIoOps: 0 (0)
  3891. - ReadIoWaitTime: 0.000ns
  3892. - WriteIoBytes: 0
  3893. - WriteIoOps: 0 (0)
  3894. - WriteIoWaitTime: 0.000ns
  3895. Hash Join Builder (join_node_id=3):
  3896. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  3897. Runtime filters: 2 of 2 Runtime Filters Published
  3898. - BuildRowsPartitionTime: 288.013ms
  3899. - BuildRowsPartitioned: 3.68M (3679360)
  3900. - HashBuckets: 8.39M (8388608)
  3901. - HashCollisions: 0 (0)
  3902. - HashTablesBuildTime: 260.012ms
  3903. - LargestPartitionPercent: 6 (6)
  3904. - MaxPartitionLevel: 0 (0)
  3905. - NumRepartitions: 0 (0)
  3906. - PartitionsCreated: 16 (16)
  3907. - PeakMemoryUsage: 22.12 KB (22656)
  3908. - RepartitionTime: 0.000ns
  3909. - SpilledPartitions: 0 (0)
  3910. EXCHANGE_NODE (id=5):(Total: 124.005ms, non-child: 68.003ms, % non-child: 54.84%)
  3911. - ConvertRowBatchTime: 56.002ms
  3912. - PeakMemoryUsage: 12.70 MB (13321940)
  3913. - RowsReturned: 3.68M (3679360)
  3914. - RowsReturnedRate: 29.67 M/sec
  3915. Buffer pool:
  3916. - AllocTime: 16.000ms
  3917. - CumulativeAllocationBytes: 84.43 MB (88530944)
  3918. - CumulativeAllocations: 7.22K (7218)
  3919. - PeakReservation: 12.65 MB (13262848)
  3920. - PeakUnpinnedBytes: 0
  3921. - PeakUsedReservation: 12.65 MB (13262848)
  3922. - ReadIoBytes: 0
  3923. - ReadIoOps: 0 (0)
  3924. - ReadIoWaitTime: 0.000ns
  3925. - WriteIoBytes: 0
  3926. - WriteIoOps: 0 (0)
  3927. - WriteIoWaitTime: 0.000ns
  3928. Dequeue:
  3929. BytesDequeued(500.000ms): 0, 61.77 MB
  3930. - FirstBatchWaitTime: 0.000ns
  3931. - TotalBytesDequeued: 66.67 MB (69907840)
  3932. - TotalGetBatchTime: 60.002ms
  3933. - DataWaitTime: 56.002ms
  3934. Enqueue:
  3935. BytesReceived(500.000ms): 294.55 KB, 30.93 MB
  3936. DeferredQueueSize(500.000ms): 0, 0
  3937. - DispatchTime: (Avg: 34.523us ; Min: 13.207us ; Max: 549.015us ; Number of samples: 3609)
  3938. - DeserializeRowBatchTime: 100.004ms
  3939. - TotalBatchesEnqueued: 3.61K (3609)
  3940. - TotalBatchesReceived: 3.61K (3609)
  3941. - TotalBytesReceived: 33.37 MB (34992608)
  3942. - TotalEarlySenders: 0 (0)
  3943. - TotalEosReceived: 6 (6)
  3944. - TotalHasDeferredRPCsTime: 60.267ms
  3945. - TotalRPCsDeferred: 7 (7)
  3946. HDFS_SCAN_NODE (id=2):(Total: 1s240ms, non-child: 1s240ms, % non-child: 100.00%)
  3947. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:65/3.82 GB
  3948. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 65 out of 65
  3949. Runtime filters: All filters arrived. Waited 0
  3950. Hdfs Read Thread Concurrency Bucket: 0:63.64% 1:36.36% 2:0% 3:0% 4:0% 5:0%
  3951. File Formats: PARQUET/SNAPPY:65
  3952. BytesRead(500.000ms): 0, 0, 21.02 MB, 126.76 MB, 209.66 MB, 589.03 MB, 1010.43 MB, 1.34 GB, 1.53 GB, 1.63 GB, 1.96 GB, 1.96 GB
  3953. - FooterProcessingTime: (Avg: 261.612ms ; Min: 4.000ms ; Max: 724.033ms ; Number of samples: 65)
  3954. - AverageHdfsReadThreadConcurrency: 0.36
  3955. - AverageScannerThreadConcurrency: 24.82
  3956. - BytesRead: 1.96 GB (2100229187)
  3957. - BytesReadDataNodeCache: 0
  3958. - BytesReadLocal: 1.96 GB (2100229187)
  3959. - BytesReadRemoteUnexpected: 0
  3960. - BytesReadShortCircuit: 1.96 GB (2100229187)
  3961. - CachedFileHandlesHitCount: 585 (585)
  3962. - CachedFileHandlesMissCount: 65 (65)
  3963. - CollectionItemsRead: 0 (0)
  3964. - DecompressionTime: 4s468ms
  3965. - MaxCompressedTextFileLength: 0
  3966. - NumColumns: 9 (9)
  3967. - NumDictFilteredRowGroups: 0 (0)
  3968. - NumDisksAccessed: 1 (1)
  3969. - NumRowGroups: 65 (65)
  3970. - NumScannerThreadsStarted: 29 (29)
  3971. - NumScannersWithNoReads: 0 (0)
  3972. - NumStatsFilteredRowGroups: 0 (0)
  3973. - PeakMemoryUsage: 1.43 GB (1536668999)
  3974. - PerReadThreadRawHdfsThroughput: 1.04 GB/sec
  3975. - RemoteScanRanges: 0 (0)
  3976. - RowBatchQueueGetWaitTime: 1s148ms
  3977. - RowBatchQueuePutWaitTime: 57s950ms
  3978. - RowsRead: 52.41M (52407500)
  3979. - RowsReturned: 16.40M (16399094)
  3980. - RowsReturnedRate: 13.22 M/sec
  3981. - ScanRangesComplete: 65 (65)
  3982. - ScannerThreadsInvoluntaryContextSwitches: 22 (22)
  3983. - ScannerThreadsTotalWallClockTime: 2m14s
  3984. - MaterializeTupleTime(*): 11s628ms
  3985. - ScannerThreadsSysTime: 6s195ms
  3986. - ScannerThreadsUserTime: 7s456ms
  3987. - ScannerThreadsVoluntaryContextSwitches: 46.79K (46789)
  3988. - TotalRawHdfsOpenFileTime(*): 1s052ms
  3989. - TotalRawHdfsReadTime(*): 1s884ms
  3990. - TotalReadThroughput: 333.82 MB/sec
  3991. Filter 4 (2.00 MB):
  3992. - Files processed: 0 (0)
  3993. - Files rejected: 0 (0)
  3994. - Files total: 0 (0)
  3995. - RowGroups processed: 0 (0)
  3996. - RowGroups rejected: 0 (0)
  3997. - RowGroups total: 0 (0)
  3998. - Rows processed: 4.00M (3998678)
  3999. - Rows rejected: 281.64K (281638)
  4000. - Rows total: 52.41M (52407500)
  4001. - Splits processed: 0 (0)
  4002. - Splits rejected: 0 (0)
  4003. - Splits total: 0 (0)
  4004. Filter 5 (2.00 MB):
  4005. - Files processed: 0 (0)
  4006. - Files rejected: 0 (0)
  4007. - Files total: 0 (0)
  4008. - RowGroups processed: 0 (0)
  4009. - RowGroups rejected: 0 (0)
  4010. - RowGroups total: 0 (0)
  4011. - Rows processed: 3.51M (3506416)
  4012. - Rows rejected: 79.73K (79728)
  4013. - Rows total: 52.13M (52125862)
  4014. - Splits processed: 0 (0)
  4015. - Splits rejected: 0 (0)
  4016. - Splits total: 0 (0)
  4017. CodeGen:(Total: 312.014ms, non-child: 312.014ms, % non-child: 100.00%)
  4018. - CodegenTime: 4.000ms
  4019. - CompileTime: 80.003ms
  4020. - LoadTime: 0.000ns
  4021. - ModuleBitcodeSize: 1.95 MB (2040108)
  4022. - NumFunctions: 113 (113)
  4023. - NumInstructions: 3.40K (3401)
  4024. - OptimizationTime: 208.009ms
  4025. - PeakMemoryUsage: 1.66 MB (1741312)
  4026. - PrepareTime: 24.001ms
  4027. Averaged Fragment F02:(Total: 684.698ms, non-child: 4.000ms, % non-child: 0.58%)
  4028. split sizes: min: 280.30 MB, max: 336.11 MB, avg: 291.17 MB, stddev: 20.12 MB
  4029. completion times: min:636.029ms max:752.034ms mean: 688.698ms stddev:41.211ms
  4030. execution rates: min:386.97 MB/sec max:446.93 MB/sec mean:423.12 MB/sec stddev:20.74 MB/sec
  4031. num instances: 6
  4032. - AverageThreadTokens: 5.17
  4033. - BloomFilterBytes: 0
  4034. - PeakMemoryUsage: 19.01 MB (19931573)
  4035. - PeakReservation: 0
  4036. - PeakUsedReservation: 0
  4037. - PerHostPeakMemUsage: 101.82 MB (106761037)
  4038. - RowsProduced: 613.23K (613226)
  4039. - TotalNetworkReceiveTime: 0.000ns
  4040. - TotalNetworkSendTime: 364.016ms
  4041. - TotalStorageWaitTime: 629.363ms
  4042. - TotalThreadsInvoluntaryContextSwitches: 1 (1)
  4043. - TotalThreadsTotalWallClockTime: 3s736ms
  4044. - TotalThreadsSysTime: 69.148ms
  4045. - TotalThreadsUserTime: 741.474ms
  4046. - TotalThreadsVoluntaryContextSwitches: 1.75K (1751)
  4047. Buffer pool:
  4048. - AllocTime: 0.000ns
  4049. - CumulativeAllocationBytes: 0
  4050. - CumulativeAllocations: 0 (0)
  4051. - PeakReservation: 0
  4052. - PeakUnpinnedBytes: 0
  4053. - PeakUsedReservation: 0
  4054. - ReadIoBytes: 0
  4055. - ReadIoOps: 0 (0)
  4056. - ReadIoWaitTime: 0.000ns
  4057. - ReservationLimit: 0
  4058. - WriteIoBytes: 0
  4059. - WriteIoOps: 0 (0)
  4060. - WriteIoWaitTime: 0.000ns
  4061. Fragment Instance Lifecycle Timings:
  4062. - ExecTime: 624.029ms
  4063. - ExecTreeExecTime: 156.673ms
  4064. - OpenTime: 60.002ms
  4065. - ExecTreeOpenTime: 0.000ns
  4066. - PrepareTime: 666.698us
  4067. - ExecTreePrepareTime: 0.000ns
  4068. KrpcDataStreamSender (dst_id=5):(Total: 466.688ms, non-child: 466.688ms, % non-child: 100.00%)
  4069. - EosSent: 6 (6)
  4070. - NetworkThroughput: 19.76 MB/sec
  4071. - PeakMemoryUsage: 69.80 KB (71472)
  4072. - RowsSent: 613.23K (613226)
  4073. - RpcFailure: 0 (0)
  4074. - RpcRetry: 0 (0)
  4075. - SerializeBatchTime: 47.335ms
  4076. - TotalBytesSent: 33.37 MB (34992608)
  4077. - UncompressedRowBatchSize: 66.67 MB (69907840)
  4078. HDFS_SCAN_NODE (id=0):(Total: 156.673ms, non-child: 156.673ms, % non-child: 100.00%)
  4079. - AverageHdfsReadThreadConcurrency: 0.17
  4080. - AverageScannerThreadConcurrency: 5.08
  4081. - BytesRead: 7.83 MB (8207803)
  4082. - BytesReadDataNodeCache: 0
  4083. - BytesReadLocal: 7.83 MB (8207803)
  4084. - BytesReadRemoteUnexpected: 0
  4085. - BytesReadShortCircuit: 7.83 MB (8207803)
  4086. - CachedFileHandlesHitCount: 21 (21)
  4087. - CachedFileHandlesMissCount: 5 (5)
  4088. - CollectionItemsRead: 0 (0)
  4089. - DecompressionTime: 28.667ms
  4090. - MaxCompressedTextFileLength: 0
  4091. - NumColumns: 4 (4)
  4092. - NumDictFilteredRowGroups: 0 (0)
  4093. - NumDisksAccessed: 1 (1)
  4094. - NumRowGroups: 5 (5)
  4095. - NumScannerThreadsStarted: 5 (5)
  4096. - NumScannersWithNoReads: 0 (0)
  4097. - NumStatsFilteredRowGroups: 0 (0)
  4098. - PeakMemoryUsage: 18.91 MB (19823930)
  4099. - PerReadThreadRawHdfsThroughput: 162.19 MB/sec
  4100. - RemoteScanRanges: 0 (0)
  4101. - RowBatchQueueGetWaitTime: 148.006ms
  4102. - RowBatchQueuePutWaitTime: 1s612ms
  4103. - RowsRead: 19.53M (19534749)
  4104. - RowsReturned: 613.23K (613226)
  4105. - RowsReturnedRate: 4.07 M/sec
  4106. - ScanRangesComplete: 5 (5)
  4107. - ScannerThreadsInvoluntaryContextSwitches: 1 (1)
  4108. - ScannerThreadsTotalWallClockTime: 3s052ms
  4109. - MaterializeTupleTime(*): 572.026ms
  4110. - ScannerThreadsSysTime: 35.978ms
  4111. - ScannerThreadsUserTime: 597.684ms
  4112. - ScannerThreadsVoluntaryContextSwitches: 566 (566)
  4113. - TotalRawHdfsOpenFileTime(*): 90.004ms
  4114. - TotalRawHdfsReadTime(*): 66.003ms
  4115. - TotalReadThroughput: 10.35 MB/sec
  4116. CodeGen:(Total: 57.336ms, non-child: 57.336ms, % non-child: 100.00%)
  4117. - CodegenTime: 666.697us
  4118. - CompileTime: 10.000ms
  4119. - LoadTime: 0.000ns
  4120. - ModuleBitcodeSize: 1.95 MB (2040108)
  4121. - NumFunctions: 35 (35)
  4122. - NumInstructions: 576 (576)
  4123. - OptimizationTime: 28.668ms
  4124. - PeakMemoryUsage: 288.00 KB (294912)
  4125. - PrepareTime: 18.000ms
  4126. Fragment F02:
  4127. Instance 984ea1ea895ca2cf:a12d79aa00000007 (host=slave-cn03:22000):(Total: 748.034ms, non-child: 4.000ms, % non-child: 0.53%)
  4128. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:6/336.11 MB
  4129. Fragment Instance Lifecycle Event Timeline: 748.034ms
  4130. - Prepare Finished: 0.000ns (0.000ns)
  4131. - Open Finished: 56.002ms (56.002ms)
  4132. - First Batch Produced: 216.009ms (160.007ms)
  4133. - First Batch Sent: 216.009ms (0.000ns)
  4134. - ExecInternal Finished: 748.034ms (532.024ms)
  4135. MemoryUsage(500.000ms): 77.80 KB, 21.17 MB
  4136. ThreadUsage(500.000ms): 1, 7
  4137. - AverageThreadTokens: 4.00
  4138. - BloomFilterBytes: 0
  4139. - PeakMemoryUsage: 21.32 MB (22358299)
  4140. - PeakReservation: 0
  4141. - PeakUsedReservation: 0
  4142. - PerHostPeakMemUsage: 114.45 MB (120006599)
  4143. - RowsProduced: 708.66K (708656)
  4144. - TotalNetworkReceiveTime: 0.000ns
  4145. - TotalNetworkSendTime: 380.017ms
  4146. - TotalStorageWaitTime: 808.036ms
  4147. - TotalThreadsInvoluntaryContextSwitches: 2 (2)
  4148. - TotalThreadsTotalWallClockTime: 4s608ms
  4149. - TotalThreadsSysTime: 86.049ms
  4150. - TotalThreadsUserTime: 843.688ms
  4151. - TotalThreadsVoluntaryContextSwitches: 2.10K (2095)
  4152. Buffer pool:
  4153. - AllocTime: 0.000ns
  4154. - CumulativeAllocationBytes: 0
  4155. - CumulativeAllocations: 0 (0)
  4156. - PeakReservation: 0
  4157. - PeakUnpinnedBytes: 0
  4158. - PeakUsedReservation: 0
  4159. - ReadIoBytes: 0
  4160. - ReadIoOps: 0 (0)
  4161. - ReadIoWaitTime: 0.000ns
  4162. - ReservationLimit: 0
  4163. - WriteIoBytes: 0
  4164. - WriteIoOps: 0 (0)
  4165. - WriteIoWaitTime: 0.000ns
  4166. Fragment Instance Lifecycle Timings:
  4167. - ExecTime: 692.031ms
  4168. - ExecTreeExecTime: 180.008ms
  4169. - OpenTime: 56.002ms
  4170. - ExecTreeOpenTime: 0.000ns
  4171. - PrepareTime: 0.000ns
  4172. - ExecTreePrepareTime: 0.000ns
  4173. KrpcDataStreamSender (dst_id=5):(Total: 512.023ms, non-child: 132.006ms, % non-child: 25.78%)
  4174. BytesSent(500.000ms): 0, 18.78 MB
  4175. - EosSent: 6 (6)
  4176. - NetworkThroughput: 19.83 MB/sec
  4177. - PeakMemoryUsage: 69.80 KB (71472)
  4178. - RowsSent: 708.66K (708656)
  4179. - RpcFailure: 0 (0)
  4180. - RpcRetry: 0 (0)
  4181. - SerializeBatchTime: 60.002ms
  4182. - TotalBytesSent: 38.57 MB (40440834)
  4183. - UncompressedRowBatchSize: 77.04 MB (80786784)
  4184. HDFS_SCAN_NODE (id=0):(Total: 180.008ms, non-child: 180.008ms, % non-child: 100.00%)
  4185. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:6/336.11 MB
  4186. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6
  4187. Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0%
  4188. File Formats: PARQUET/SNAPPY:6
  4189. BytesRead(500.000ms): 0, 9.03 MB
  4190. - FooterProcessingTime: (Avg: 50.002ms ; Min: 24.001ms ; Max: 76.003ms ; Number of samples: 6)
  4191. - AverageHdfsReadThreadConcurrency: 0.00
  4192. - AverageScannerThreadConcurrency: 6.00
  4193. - BytesRead: 9.03 MB (9468625)
  4194. - BytesReadDataNodeCache: 0
  4195. - BytesReadLocal: 9.03 MB (9468625)
  4196. - BytesReadRemoteUnexpected: 0
  4197. - BytesReadShortCircuit: 9.03 MB (9468625)
  4198. - CachedFileHandlesHitCount: 24 (24)
  4199. - CachedFileHandlesMissCount: 6 (6)
  4200. - CollectionItemsRead: 0 (0)
  4201. - DecompressionTime: 36.001ms
  4202. - MaxCompressedTextFileLength: 0
  4203. - NumColumns: 4 (4)
  4204. - NumDictFilteredRowGroups: 0 (0)
  4205. - NumDisksAccessed: 1 (1)
  4206. - NumRowGroups: 6 (6)
  4207. - NumScannerThreadsStarted: 6 (6)
  4208. - NumScannersWithNoReads: 0 (0)
  4209. - NumStatsFilteredRowGroups: 0 (0)
  4210. - PeakMemoryUsage: 21.22 MB (22254410)
  4211. - PerReadThreadRawHdfsThroughput: 94.06 MB/sec
  4212. - RemoteScanRanges: 0 (0)
  4213. - RowBatchQueueGetWaitTime: 176.008ms
  4214. - RowBatchQueuePutWaitTime: 2s064ms
  4215. - RowsRead: 22.54M (22540248)
  4216. - RowsReturned: 708.66K (708656)
  4217. - RowsReturnedRate: 3.94 M/sec
  4218. - ScanRangesComplete: 6 (6)
  4219. - ScannerThreadsInvoluntaryContextSwitches: 2 (2)
  4220. - ScannerThreadsTotalWallClockTime: 3s860ms
  4221. - MaterializeTupleTime(*): 664.030ms
  4222. - ScannerThreadsSysTime: 39.517ms
  4223. - ScannerThreadsUserTime: 695.624ms
  4224. - ScannerThreadsVoluntaryContextSwitches: 657 (657)
  4225. - TotalRawHdfsOpenFileTime(*): 92.004ms
  4226. - TotalRawHdfsReadTime(*): 96.004ms
  4227. - TotalReadThroughput: 9.03 MB/sec
  4228. CodeGen:(Total: 52.002ms, non-child: 52.002ms, % non-child: 100.00%)
  4229. - CodegenTime: 4.000ms
  4230. - CompileTime: 8.000ms
  4231. - LoadTime: 0.000ns
  4232. - ModuleBitcodeSize: 1.95 MB (2040108)
  4233. - NumFunctions: 35 (35)
  4234. - NumInstructions: 576 (576)
  4235. - OptimizationTime: 28.001ms
  4236. - PeakMemoryUsage: 288.00 KB (294912)
  4237. - PrepareTime: 16.000ms
  4238. Instance 984ea1ea895ca2cf:a12d79aa0000000b (host=slave-cn05:22000):(Total: 728.040ms, non-child: 4.000ms, % non-child: 0.55%)
  4239. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:6/283.28 MB
  4240. Fragment Instance Lifecycle Event Timeline: 728.040ms
  4241. - Prepare Finished: 0.000ns (0.000ns)
  4242. - Open Finished: 76.004ms (76.004ms)
  4243. - First Batch Produced: 252.013ms (176.009ms)
  4244. - First Batch Sent: 252.013ms (0.000ns)
  4245. - ExecInternal Finished: 728.040ms (476.026ms)
  4246. MemoryUsage(500.000ms): 242.45 KB, 14.89 MB
  4247. ThreadUsage(500.000ms): 7, 5
  4248. - AverageThreadTokens: 6.00
  4249. - BloomFilterBytes: 0
  4250. - PeakMemoryUsage: 19.90 MB (20866455)
  4251. - PeakReservation: 0
  4252. - PeakUsedReservation: 0
  4253. - PerHostPeakMemUsage: 108.29 MB (113552096)
  4254. - RowsProduced: 596.45K (596448)
  4255. - TotalNetworkReceiveTime: 0.000ns
  4256. - TotalNetworkSendTime: 368.020ms
  4257. - TotalStorageWaitTime: 928.051ms
  4258. - TotalThreadsInvoluntaryContextSwitches: 2 (2)
  4259. - TotalThreadsTotalWallClockTime: 4s172ms
  4260. - TotalThreadsSysTime: 38.964ms
  4261. - TotalThreadsUserTime: 764.391ms
  4262. - TotalThreadsVoluntaryContextSwitches: 1.66K (1657)
  4263. Buffer pool:
  4264. - AllocTime: 0.000ns
  4265. - CumulativeAllocationBytes: 0
  4266. - CumulativeAllocations: 0 (0)
  4267. - PeakReservation: 0
  4268. - PeakUnpinnedBytes: 0
  4269. - PeakUsedReservation: 0
  4270. - ReadIoBytes: 0
  4271. - ReadIoOps: 0 (0)
  4272. - ReadIoWaitTime: 0.000ns
  4273. - ReservationLimit: 0
  4274. - WriteIoBytes: 0
  4275. - WriteIoOps: 0 (0)
  4276. - WriteIoWaitTime: 0.000ns
  4277. Fragment Instance Lifecycle Timings:
  4278. - ExecTime: 652.035ms
  4279. - ExecTreeExecTime: 188.010ms
  4280. - OpenTime: 76.004ms
  4281. - ExecTreeOpenTime: 0.000ns
  4282. - PrepareTime: 0.000ns
  4283. - ExecTreePrepareTime: 0.000ns
  4284. KrpcDataStreamSender (dst_id=5):(Total: 464.025ms, non-child: 96.005ms, % non-child: 20.69%)
  4285. BytesSent(500.000ms): 0, 22.49 MB
  4286. - EosSent: 6 (6)
  4287. - NetworkThroughput: 20.06 MB/sec
  4288. - PeakMemoryUsage: 69.80 KB (71472)
  4289. - RowsSent: 596.45K (596448)
  4290. - RpcFailure: 0 (0)
  4291. - RpcRetry: 0 (0)
  4292. - SerializeBatchTime: 48.002ms
  4293. - TotalBytesSent: 32.46 MB (34037406)
  4294. - UncompressedRowBatchSize: 64.85 MB (67995072)
  4295. HDFS_SCAN_NODE (id=0):(Total: 188.010ms, non-child: 188.010ms, % non-child: 100.00%)
  4296. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:6/283.28 MB
  4297. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6
  4298. Hdfs Read Thread Concurrency Bucket: 0:50% 1:50% 2:0% 3:0% 4:0% 5:0%
  4299. File Formats: PARQUET/SNAPPY:6
  4300. BytesRead(500.000ms): 200.00 KB, 7.68 MB
  4301. - FooterProcessingTime: (Avg: 62.670ms ; Min: 16.000ms ; Max: 112.006ms ; Number of samples: 6)
  4302. - AverageHdfsReadThreadConcurrency: 0.50
  4303. - AverageScannerThreadConcurrency: 5.00
  4304. - BytesRead: 7.68 MB (8057057)
  4305. - BytesReadDataNodeCache: 0
  4306. - BytesReadLocal: 7.68 MB (8057057)
  4307. - BytesReadRemoteUnexpected: 0
  4308. - BytesReadShortCircuit: 7.68 MB (8057057)
  4309. - CachedFileHandlesHitCount: 24 (24)
  4310. - CachedFileHandlesMissCount: 6 (6)
  4311. - CollectionItemsRead: 0 (0)
  4312. - DecompressionTime: 20.001ms
  4313. - MaxCompressedTextFileLength: 0
  4314. - NumColumns: 4 (4)
  4315. - NumDictFilteredRowGroups: 0 (0)
  4316. - NumDisksAccessed: 1 (1)
  4317. - NumRowGroups: 6 (6)
  4318. - NumScannerThreadsStarted: 6 (6)
  4319. - NumScannersWithNoReads: 0 (0)
  4320. - NumStatsFilteredRowGroups: 0 (0)
  4321. - PeakMemoryUsage: 19.79 MB (20751302)
  4322. - PerReadThreadRawHdfsThroughput: 71.14 MB/sec
  4323. - RemoteScanRanges: 0 (0)
  4324. - RowBatchQueueGetWaitTime: 176.009ms
  4325. - RowBatchQueuePutWaitTime: 1s716ms
  4326. - RowsRead: 19.01M (19006419)
  4327. - RowsReturned: 596.45K (596448)
  4328. - RowsReturnedRate: 3.17 M/sec
  4329. - ScanRangesComplete: 6 (6)
  4330. - ScannerThreadsInvoluntaryContextSwitches: 1 (1)
  4331. - ScannerThreadsTotalWallClockTime: 3s444ms
  4332. - MaterializeTupleTime(*): 600.032ms
  4333. - ScannerThreadsSysTime: 12.580ms
  4334. - ScannerThreadsUserTime: 607.832ms
  4335. - ScannerThreadsVoluntaryContextSwitches: 577 (577)
  4336. - TotalRawHdfsOpenFileTime(*): 80.004ms
  4337. - TotalRawHdfsReadTime(*): 108.005ms
  4338. - TotalReadThroughput: 7.68 MB/sec
  4339. CodeGen:(Total: 72.003ms, non-child: 72.003ms, % non-child: 100.00%)
  4340. - CodegenTime: 0.000ns
  4341. - CompileTime: 12.000ms
  4342. - LoadTime: 0.000ns
  4343. - ModuleBitcodeSize: 1.95 MB (2040108)
  4344. - NumFunctions: 35 (35)
  4345. - NumInstructions: 576 (576)
  4346. - OptimizationTime: 36.001ms
  4347. - PeakMemoryUsage: 288.00 KB (294912)
  4348. - PrepareTime: 24.001ms
  4349. Instance 984ea1ea895ca2cf:a12d79aa00000008 (host=slave-cn04:22000):(Total: 680.035ms, non-child: 8.000ms, % non-child: 1.18%)
  4350. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/282.48 MB
  4351. Fragment Instance Lifecycle Event Timeline: 684.036ms
  4352. - Prepare Finished: 4.000ms (4.000ms)
  4353. - Open Finished: 56.002ms (52.002ms)
  4354. - First Batch Produced: 200.010ms (144.007ms)
  4355. - First Batch Sent: 200.010ms (0.000ns)
  4356. - ExecInternal Finished: 684.036ms (484.025ms)
  4357. MemoryUsage(500.000ms): 218.45 KB, 14.65 MB
  4358. ThreadUsage(500.000ms): 6, 5
  4359. - AverageThreadTokens: 5.50
  4360. - BloomFilterBytes: 0
  4361. - PeakMemoryUsage: 18.20 MB (19080663)
  4362. - PeakReservation: 0
  4363. - PeakUsedReservation: 0
  4364. - PerHostPeakMemUsage: 94.96 MB (99576259)
  4365. - RowsProduced: 594.77K (594767)
  4366. - TotalNetworkReceiveTime: 0.000ns
  4367. - TotalNetworkSendTime: 328.017ms
  4368. - TotalStorageWaitTime: 628.033ms
  4369. - TotalThreadsInvoluntaryContextSwitches: 0 (0)
  4370. - TotalThreadsTotalWallClockTime: 3s508ms
  4371. - TotalThreadsSysTime: 87.360ms
  4372. - TotalThreadsUserTime: 717.139ms
  4373. - TotalThreadsVoluntaryContextSwitches: 1.68K (1682)
  4374. Buffer pool:
  4375. - AllocTime: 0.000ns
  4376. - CumulativeAllocationBytes: 0
  4377. - CumulativeAllocations: 0 (0)
  4378. - PeakReservation: 0
  4379. - PeakUnpinnedBytes: 0
  4380. - PeakUsedReservation: 0
  4381. - ReadIoBytes: 0
  4382. - ReadIoOps: 0 (0)
  4383. - ReadIoWaitTime: 0.000ns
  4384. - ReservationLimit: 0
  4385. - WriteIoBytes: 0
  4386. - WriteIoOps: 0 (0)
  4387. - WriteIoWaitTime: 0.000ns
  4388. Fragment Instance Lifecycle Timings:
  4389. - ExecTime: 628.033ms
  4390. - ExecTreeExecTime: 172.009ms
  4391. - OpenTime: 52.002ms
  4392. - ExecTreeOpenTime: 0.000ns
  4393. - PrepareTime: 0.000ns
  4394. - ExecTreePrepareTime: 0.000ns
  4395. KrpcDataStreamSender (dst_id=5):(Total: 448.023ms, non-child: 120.006ms, % non-child: 26.79%)
  4396. BytesSent(500.000ms): 0, 23.27 MB
  4397. - EosSent: 6 (6)
  4398. - NetworkThroughput: 19.19 MB/sec
  4399. - PeakMemoryUsage: 69.80 KB (71472)
  4400. - RowsSent: 594.77K (594767)
  4401. - RpcFailure: 0 (0)
  4402. - RpcRetry: 0 (0)
  4403. - SerializeBatchTime: 64.003ms
  4404. - TotalBytesSent: 32.36 MB (33936552)
  4405. - UncompressedRowBatchSize: 64.66 MB (67803438)
  4406. HDFS_SCAN_NODE (id=0):(Total: 172.009ms, non-child: 172.009ms, % non-child: 100.00%)
  4407. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/282.48 MB
  4408. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5
  4409. Hdfs Read Thread Concurrency Bucket: 0:50% 1:50% 2:0% 3:0% 4:0% 5:0%
  4410. File Formats: PARQUET/SNAPPY:5
  4411. BytesRead(500.000ms): 0, 7.59 MB
  4412. - FooterProcessingTime: (Avg: 43.202ms ; Min: 20.001ms ; Max: 64.003ms ; Number of samples: 5)
  4413. - AverageHdfsReadThreadConcurrency: 0.50
  4414. - AverageScannerThreadConcurrency: 4.50
  4415. - BytesRead: 7.59 MB (7954132)
  4416. - BytesReadDataNodeCache: 0
  4417. - BytesReadLocal: 7.59 MB (7954132)
  4418. - BytesReadRemoteUnexpected: 0
  4419. - BytesReadShortCircuit: 7.59 MB (7954132)
  4420. - CachedFileHandlesHitCount: 20 (20)
  4421. - CachedFileHandlesMissCount: 5 (5)
  4422. - CollectionItemsRead: 0 (0)
  4423. - DecompressionTime: 28.001ms
  4424. - MaxCompressedTextFileLength: 0
  4425. - NumColumns: 4 (4)
  4426. - NumDictFilteredRowGroups: 0 (0)
  4427. - NumDisksAccessed: 1 (1)
  4428. - NumRowGroups: 5 (5)
  4429. - NumScannerThreadsStarted: 5 (5)
  4430. - NumScannersWithNoReads: 0 (0)
  4431. - NumStatsFilteredRowGroups: 0 (0)
  4432. - PeakMemoryUsage: 18.10 MB (18976774)
  4433. - PerReadThreadRawHdfsThroughput: 94.82 MB/sec
  4434. - RemoteScanRanges: 0 (0)
  4435. - RowBatchQueueGetWaitTime: 156.008ms
  4436. - RowBatchQueuePutWaitTime: 1s324ms
  4437. - RowsRead: 18.96M (18955820)
  4438. - RowsReturned: 594.77K (594767)
  4439. - RowsReturnedRate: 3.46 M/sec
  4440. - ScanRangesComplete: 5 (5)
  4441. - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
  4442. - ScannerThreadsTotalWallClockTime: 2s828ms
  4443. - MaterializeTupleTime(*): 608.032ms
  4444. - ScannerThreadsSysTime: 34.249ms
  4445. - ScannerThreadsUserTime: 597.564ms
  4446. - ScannerThreadsVoluntaryContextSwitches: 530 (530)
  4447. - TotalRawHdfsOpenFileTime(*): 96.005ms
  4448. - TotalRawHdfsReadTime(*): 80.004ms
  4449. - TotalReadThroughput: 7.59 MB/sec
  4450. CodeGen:(Total: 52.002ms, non-child: 52.002ms, % non-child: 100.00%)
  4451. - CodegenTime: 0.000ns
  4452. - CompileTime: 8.000ms
  4453. - LoadTime: 0.000ns
  4454. - ModuleBitcodeSize: 1.95 MB (2040108)
  4455. - NumFunctions: 35 (35)
  4456. - NumInstructions: 576 (576)
  4457. - OptimizationTime: 24.001ms
  4458. - PeakMemoryUsage: 288.00 KB (294912)
  4459. - PrepareTime: 20.001ms
  4460. Instance 984ea1ea895ca2cf:a12d79aa0000000a (host=slave-cn06:22000):(Total: 672.021ms, non-child: 0.000ns, % non-child: 0.00%)
  4461. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/281.39 MB
  4462. Fragment Instance Lifecycle Event Timeline: 676.022ms
  4463. - Prepare Finished: 4.000ms (4.000ms)
  4464. - Open Finished: 60.001ms (56.001ms)
  4465. - First Batch Produced: 212.006ms (152.004ms)
  4466. - First Batch Sent: 212.006ms (0.000ns)
  4467. - ExecInternal Finished: 676.022ms (464.015ms)
  4468. MemoryUsage(500.000ms): 16.49 MB
  4469. ThreadUsage(500.000ms): 6
  4470. - AverageThreadTokens: 6.00
  4471. - BloomFilterBytes: 0
  4472. - PeakMemoryUsage: 18.21 MB (19094463)
  4473. - PeakReservation: 0
  4474. - PeakUsedReservation: 0
  4475. - PerHostPeakMemUsage: 104.65 MB (109730847)
  4476. - RowsProduced: 592.59K (592589)
  4477. - TotalNetworkReceiveTime: 0.000ns
  4478. - TotalNetworkSendTime: 356.011ms
  4479. - TotalStorageWaitTime: 620.020ms
  4480. - TotalThreadsInvoluntaryContextSwitches: 2 (2)
  4481. - TotalThreadsTotalWallClockTime: 3s532ms
  4482. - TotalThreadsSysTime: 45.429ms
  4483. - TotalThreadsUserTime: 702.740ms
  4484. - TotalThreadsVoluntaryContextSwitches: 1.72K (1719)
  4485. Buffer pool:
  4486. - AllocTime: 0.000ns
  4487. - CumulativeAllocationBytes: 0
  4488. - CumulativeAllocations: 0 (0)
  4489. - PeakReservation: 0
  4490. - PeakUnpinnedBytes: 0
  4491. - PeakUsedReservation: 0
  4492. - ReadIoBytes: 0
  4493. - ReadIoOps: 0 (0)
  4494. - ReadIoWaitTime: 0.000ns
  4495. - ReservationLimit: 0
  4496. - WriteIoBytes: 0
  4497. - WriteIoOps: 0 (0)
  4498. - WriteIoWaitTime: 0.000ns
  4499. Fragment Instance Lifecycle Timings:
  4500. - ExecTime: 616.020ms
  4501. - ExecTreeExecTime: 168.005ms
  4502. - OpenTime: 56.001ms
  4503. - ExecTreeOpenTime: 0.000ns
  4504. - PrepareTime: 0.000ns
  4505. - ExecTreePrepareTime: 0.000ns
  4506. KrpcDataStreamSender (dst_id=5):(Total: 448.014ms, non-child: 92.003ms, % non-child: 20.54%)
  4507. BytesSent(500.000ms): 1.17 MB
  4508. - EosSent: 6 (6)
  4509. - NetworkThroughput: 20.07 MB/sec
  4510. - PeakMemoryUsage: 69.80 KB (71472)
  4511. - RowsSent: 592.59K (592589)
  4512. - RpcFailure: 0 (0)
  4513. - RpcRetry: 0 (0)
  4514. - SerializeBatchTime: 36.001ms
  4515. - TotalBytesSent: 32.25 MB (33815136)
  4516. - UncompressedRowBatchSize: 64.43 MB (67555146)
  4517. HDFS_SCAN_NODE (id=0):(Total: 168.005ms, non-child: 168.005ms, % non-child: 100.00%)
  4518. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/281.39 MB
  4519. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5
  4520. Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0%
  4521. File Formats: PARQUET/SNAPPY:5
  4522. BytesRead(500.000ms): 7.55 MB
  4523. - FooterProcessingTime: (Avg: 45.601ms ; Min: 32.001ms ; Max: 60.001ms ; Number of samples: 5)
  4524. - AverageHdfsReadThreadConcurrency: 0.00
  4525. - AverageScannerThreadConcurrency: 5.00
  4526. - BytesRead: 7.55 MB (7917702)
  4527. - BytesReadDataNodeCache: 0
  4528. - BytesReadLocal: 7.55 MB (7917702)
  4529. - BytesReadRemoteUnexpected: 0
  4530. - BytesReadShortCircuit: 7.55 MB (7917702)
  4531. - CachedFileHandlesHitCount: 20 (20)
  4532. - CachedFileHandlesMissCount: 5 (5)
  4533. - CollectionItemsRead: 0 (0)
  4534. - DecompressionTime: 32.001ms
  4535. - MaxCompressedTextFileLength: 0
  4536. - NumColumns: 4 (4)
  4537. - NumDictFilteredRowGroups: 0 (0)
  4538. - NumDisksAccessed: 1 (1)
  4539. - NumRowGroups: 5 (5)
  4540. - NumScannerThreadsStarted: 5 (5)
  4541. - NumScannersWithNoReads: 0 (0)
  4542. - NumStatsFilteredRowGroups: 0 (0)
  4543. - PeakMemoryUsage: 18.10 MB (18979310)
  4544. - PerReadThreadRawHdfsThroughput: 145.21 MB/sec
  4545. - RemoteScanRanges: 0 (0)
  4546. - RowBatchQueueGetWaitTime: 160.005ms
  4547. - RowBatchQueuePutWaitTime: 1s540ms
  4548. - RowsRead: 18.88M (18877926)
  4549. - RowsReturned: 592.59K (592589)
  4550. - RowsReturnedRate: 3.53 M/sec
  4551. - ScanRangesComplete: 5 (5)
  4552. - ScannerThreadsInvoluntaryContextSwitches: 1 (1)
  4553. - ScannerThreadsTotalWallClockTime: 2s860ms
  4554. - MaterializeTupleTime(*): 464.015ms
  4555. - ScannerThreadsSysTime: 42.011ms
  4556. - ScannerThreadsUserTime: 541.162ms
  4557. - ScannerThreadsVoluntaryContextSwitches: 548 (548)
  4558. - TotalRawHdfsOpenFileTime(*): 108.003ms
  4559. - TotalRawHdfsReadTime(*): 52.001ms
  4560. - TotalReadThroughput: 15.10 MB/sec
  4561. CodeGen:(Total: 56.001ms, non-child: 56.001ms, % non-child: 100.00%)
  4562. - CodegenTime: 0.000ns
  4563. - CompileTime: 8.000ms
  4564. - LoadTime: 0.000ns
  4565. - ModuleBitcodeSize: 1.95 MB (2040108)
  4566. - NumFunctions: 35 (35)
  4567. - NumInstructions: 576 (576)
  4568. - OptimizationTime: 28.000ms
  4569. - PeakMemoryUsage: 288.00 KB (294912)
  4570. - PrepareTime: 16.000ms
  4571. Instance 984ea1ea895ca2cf:a12d79aa0000000c (host=slave-cn07:22000):(Total: 648.030ms, non-child: 4.000ms, % non-child: 0.62%)
  4572. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/280.30 MB
  4573. Fragment Instance Lifecycle Event Timeline: 648.030ms
  4574. - Prepare Finished: 4.000ms (4.000ms)
  4575. - Open Finished: 68.003ms (64.003ms)
  4576. - First Batch Produced: 184.008ms (116.005ms)
  4577. - First Batch Sent: 184.008ms (0.000ns)
  4578. - ExecInternal Finished: 648.030ms (464.022ms)
  4579. MemoryUsage(500.000ms): 77.80 KB, 17.91 MB
  4580. ThreadUsage(500.000ms): 1, 6
  4581. - AverageThreadTokens: 3.50
  4582. - BloomFilterBytes: 0
  4583. - PeakMemoryUsage: 18.15 MB (19030231)
  4584. - PeakReservation: 0
  4585. - PeakUsedReservation: 0
  4586. - PerHostPeakMemUsage: 95.07 MB (99692963)
  4587. - RowsProduced: 589.53K (589528)
  4588. - TotalNetworkReceiveTime: 0.000ns
  4589. - TotalNetworkSendTime: 380.018ms
  4590. - TotalStorageWaitTime: 468.022ms
  4591. - TotalThreadsInvoluntaryContextSwitches: 2 (2)
  4592. - TotalThreadsTotalWallClockTime: 3s328ms
  4593. - TotalThreadsSysTime: 86.092ms
  4594. - TotalThreadsUserTime: 694.188ms
  4595. - TotalThreadsVoluntaryContextSwitches: 1.66K (1663)
  4596. Buffer pool:
  4597. - AllocTime: 0.000ns
  4598. - CumulativeAllocationBytes: 0
  4599. - CumulativeAllocations: 0 (0)
  4600. - PeakReservation: 0
  4601. - PeakUnpinnedBytes: 0
  4602. - PeakUsedReservation: 0
  4603. - ReadIoBytes: 0
  4604. - ReadIoOps: 0 (0)
  4605. - ReadIoWaitTime: 0.000ns
  4606. - ReservationLimit: 0
  4607. - WriteIoBytes: 0
  4608. - WriteIoOps: 0 (0)
  4609. - WriteIoWaitTime: 0.000ns
  4610. Fragment Instance Lifecycle Timings:
  4611. - ExecTime: 580.027ms
  4612. - ExecTreeExecTime: 128.006ms
  4613. - OpenTime: 64.003ms
  4614. - ExecTreeOpenTime: 0.000ns
  4615. - PrepareTime: 4.000ms
  4616. - ExecTreePrepareTime: 0.000ns
  4617. KrpcDataStreamSender (dst_id=5):(Total: 456.021ms, non-child: 76.003ms, % non-child: 16.67%)
  4618. BytesSent(500.000ms): 0, 20.31 MB
  4619. - EosSent: 6 (6)
  4620. - NetworkThroughput: 20.26 MB/sec
  4621. - PeakMemoryUsage: 69.80 KB (71472)
  4622. - RowsSent: 589.53K (589528)
  4623. - RpcFailure: 0 (0)
  4624. - RpcRetry: 0 (0)
  4625. - SerializeBatchTime: 28.001ms
  4626. - TotalBytesSent: 32.08 MB (33638886)
  4627. - UncompressedRowBatchSize: 64.09 MB (67206192)
  4628. HDFS_SCAN_NODE (id=0):(Total: 128.006ms, non-child: 128.006ms, % non-child: 100.00%)
  4629. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/280.30 MB
  4630. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5
  4631. Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0%
  4632. File Formats: PARQUET/SNAPPY:5
  4633. BytesRead(500.000ms): 0, 7.51 MB
  4634. - FooterProcessingTime: (Avg: 38.401ms ; Min: 24.001ms ; Max: 52.002ms ; Number of samples: 5)
  4635. - AverageHdfsReadThreadConcurrency: 0.00
  4636. - AverageScannerThreadConcurrency: 5.00
  4637. - BytesRead: 7.51 MB (7876850)
  4638. - BytesReadDataNodeCache: 0
  4639. - BytesReadLocal: 7.51 MB (7876850)
  4640. - BytesReadRemoteUnexpected: 0
  4641. - BytesReadShortCircuit: 7.51 MB (7876850)
  4642. - CachedFileHandlesHitCount: 20 (20)
  4643. - CachedFileHandlesMissCount: 5 (5)
  4644. - CollectionItemsRead: 0 (0)
  4645. - DecompressionTime: 36.001ms
  4646. - MaxCompressedTextFileLength: 0
  4647. - NumColumns: 4 (4)
  4648. - NumDictFilteredRowGroups: 0 (0)
  4649. - NumDisksAccessed: 1 (1)
  4650. - NumRowGroups: 5 (5)
  4651. - NumScannerThreadsStarted: 5 (5)
  4652. - NumScannersWithNoReads: 0 (0)
  4653. - NumStatsFilteredRowGroups: 0 (0)
  4654. - PeakMemoryUsage: 18.05 MB (18926342)
  4655. - PerReadThreadRawHdfsThroughput: 187.79 MB/sec
  4656. - RemoteScanRanges: 0 (0)
  4657. - RowBatchQueueGetWaitTime: 124.005ms
  4658. - RowBatchQueuePutWaitTime: 1s468ms
  4659. - RowsRead: 18.81M (18813780)
  4660. - RowsReturned: 589.53K (589528)
  4661. - RowsReturnedRate: 4.61 M/sec
  4662. - ScanRangesComplete: 5 (5)
  4663. - ScannerThreadsInvoluntaryContextSwitches: 2 (2)
  4664. - ScannerThreadsTotalWallClockTime: 2s684ms
  4665. - MaterializeTupleTime(*): 536.025ms
  4666. - ScannerThreadsSysTime: 37.708ms
  4667. - ScannerThreadsUserTime: 564.146ms
  4668. - ScannerThreadsVoluntaryContextSwitches: 543 (543)
  4669. - TotalRawHdfsOpenFileTime(*): 88.004ms
  4670. - TotalRawHdfsReadTime(*): 40.001ms
  4671. - TotalReadThroughput: 7.51 MB/sec
  4672. CodeGen:(Total: 60.002ms, non-child: 60.002ms, % non-child: 100.00%)
  4673. - CodegenTime: 0.000ns
  4674. - CompileTime: 12.000ms
  4675. - LoadTime: 0.000ns
  4676. - ModuleBitcodeSize: 1.95 MB (2040108)
  4677. - NumFunctions: 35 (35)
  4678. - NumInstructions: 576 (576)
  4679. - OptimizationTime: 32.001ms
  4680. - PeakMemoryUsage: 288.00 KB (294912)
  4681. - PrepareTime: 16.000ms
  4682. Instance 984ea1ea895ca2cf:a12d79aa00000009 (host=slave-cn02:22000):(Total: 632.029ms, non-child: 4.000ms, % non-child: 0.63%)
  4683. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/283.50 MB
  4684. Fragment Instance Lifecycle Event Timeline: 636.029ms
  4685. - Prepare Finished: 4.000ms (4.000ms)
  4686. - Open Finished: 60.002ms (56.002ms)
  4687. - First Batch Produced: 152.007ms (92.004ms)
  4688. - First Batch Sent: 152.007ms (0.000ns)
  4689. - ExecInternal Finished: 636.029ms (484.022ms)
  4690. MemoryUsage(500.000ms): 17.34 MB
  4691. ThreadUsage(500.000ms): 6
  4692. - AverageThreadTokens: 6.00
  4693. - BloomFilterBytes: 0
  4694. - PeakMemoryUsage: 18.27 MB (19159331)
  4695. - PeakReservation: 0
  4696. - PeakUsedReservation: 0
  4697. - PerHostPeakMemUsage: 93.47 MB (98007459)
  4698. - RowsProduced: 597.37K (597372)
  4699. - TotalNetworkReceiveTime: 0.000ns
  4700. - TotalNetworkSendTime: 372.017ms
  4701. - TotalStorageWaitTime: 324.014ms
  4702. - TotalThreadsInvoluntaryContextSwitches: 1 (1)
  4703. - TotalThreadsTotalWallClockTime: 3s268ms
  4704. - TotalThreadsSysTime: 70.994ms
  4705. - TotalThreadsUserTime: 726.701ms
  4706. - TotalThreadsVoluntaryContextSwitches: 1.69K (1694)
  4707. Buffer pool:
  4708. - AllocTime: 0.000ns
  4709. - CumulativeAllocationBytes: 0
  4710. - CumulativeAllocations: 0 (0)
  4711. - PeakReservation: 0
  4712. - PeakUnpinnedBytes: 0
  4713. - PeakUsedReservation: 0
  4714. - ReadIoBytes: 0
  4715. - ReadIoOps: 0 (0)
  4716. - ReadIoWaitTime: 0.000ns
  4717. - ReservationLimit: 0
  4718. - WriteIoBytes: 0
  4719. - WriteIoOps: 0 (0)
  4720. - WriteIoWaitTime: 0.000ns
  4721. Fragment Instance Lifecycle Timings:
  4722. - ExecTime: 576.026ms
  4723. - ExecTreeExecTime: 104.004ms
  4724. - OpenTime: 56.002ms
  4725. - ExecTreeOpenTime: 0.000ns
  4726. - PrepareTime: 0.000ns
  4727. - ExecTreePrepareTime: 0.000ns
  4728. KrpcDataStreamSender (dst_id=5):(Total: 472.021ms, non-child: 100.004ms, % non-child: 21.19%)
  4729. BytesSent(500.000ms): 1.74 MB
  4730. - EosSent: 6 (6)
  4731. - NetworkThroughput: 19.17 MB/sec
  4732. - PeakMemoryUsage: 69.80 KB (71472)
  4733. - RowsSent: 597.37K (597372)
  4734. - RpcFailure: 0 (0)
  4735. - RpcRetry: 0 (0)
  4736. - SerializeBatchTime: 48.002ms
  4737. - TotalBytesSent: 32.51 MB (34086834)
  4738. - UncompressedRowBatchSize: 64.95 MB (68100408)
  4739. HDFS_SCAN_NODE (id=0):(Total: 104.004ms, non-child: 104.004ms, % non-child: 100.00%)
  4740. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/283.50 MB
  4741. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5
  4742. Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0%
  4743. File Formats: PARQUET/SNAPPY:5
  4744. BytesRead(500.000ms): 7.60 MB
  4745. - FooterProcessingTime: (Avg: 31.201ms ; Min: 24.001ms ; Max: 48.002ms ; Number of samples: 5)
  4746. - AverageHdfsReadThreadConcurrency: 0.00
  4747. - AverageScannerThreadConcurrency: 5.00
  4748. - BytesRead: 7.60 MB (7972456)
  4749. - BytesReadDataNodeCache: 0
  4750. - BytesReadLocal: 7.60 MB (7972456)
  4751. - BytesReadRemoteUnexpected: 0
  4752. - BytesReadShortCircuit: 7.60 MB (7972456)
  4753. - CachedFileHandlesHitCount: 20 (20)
  4754. - CachedFileHandlesMissCount: 5 (5)
  4755. - CollectionItemsRead: 0 (0)
  4756. - DecompressionTime: 20.000ms
  4757. - MaxCompressedTextFileLength: 0
  4758. - NumColumns: 4 (4)
  4759. - NumDictFilteredRowGroups: 0 (0)
  4760. - NumDisksAccessed: 1 (1)
  4761. - NumRowGroups: 5 (5)
  4762. - NumScannerThreadsStarted: 5 (5)
  4763. - NumScannersWithNoReads: 0 (0)
  4764. - NumStatsFilteredRowGroups: 0 (0)
  4765. - PeakMemoryUsage: 18.17 MB (19055442)
  4766. - PerReadThreadRawHdfsThroughput: 380.14 MB/sec
  4767. - RemoteScanRanges: 0 (0)
  4768. - RowBatchQueueGetWaitTime: 96.004ms
  4769. - RowBatchQueuePutWaitTime: 1s564ms
  4770. - RowsRead: 19.01M (19014303)
  4771. - RowsReturned: 597.37K (597372)
  4772. - RowsReturnedRate: 5.74 M/sec
  4773. - ScanRangesComplete: 5 (5)
  4774. - ScannerThreadsInvoluntaryContextSwitches: 1 (1)
  4775. - ScannerThreadsTotalWallClockTime: 2s636ms
  4776. - MaterializeTupleTime(*): 560.025ms
  4777. - ScannerThreadsSysTime: 49.804ms
  4778. - ScannerThreadsUserTime: 579.777ms
  4779. - ScannerThreadsVoluntaryContextSwitches: 541 (541)
  4780. - TotalRawHdfsOpenFileTime(*): 76.003ms
  4781. - TotalRawHdfsReadTime(*): 20.000ms
  4782. - TotalReadThroughput: 15.21 MB/sec
  4783. CodeGen:(Total: 52.002ms, non-child: 52.002ms, % non-child: 100.00%)
  4784. - CodegenTime: 0.000ns
  4785. - CompileTime: 12.000ms
  4786. - LoadTime: 0.000ns
  4787. - ModuleBitcodeSize: 1.95 MB (2040108)
  4788. - NumFunctions: 35 (35)
  4789. - NumInstructions: 576 (576)
  4790. - OptimizationTime: 24.001ms
  4791. - PeakMemoryUsage: 288.00 KB (294912)
  4792. - PrepareTime: 16.000ms
RAW Paste Data