Advertisement
Guest User

Untitled

a guest
Aug 15th, 2018
183
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 251.62 KB | None | 0 0
  1. Query (id=33406f6405038287:b47e1f8b00000000):
  2. Summary:
  3. Session ID: f94bdb457cbb38dc:b43c73a94e16a89
  4. Session Type: HIVESERVER2
  5. HiveServer2 Protocol Version: V6
  6. Start Time: 2018-08-15 10:45:21.166118000
  7. End Time:
  8. Query Type: QUERY
  9. Query State: EXCEPTION
  10. Query Status: Query 33406f6405038287:b47e1f8b00000000 expired due to client inactivity (timeout is 10m)
  11.  
  12. Impala Version: impalad version 2.12.0-cdh5.15.0 RELEASE (build 23f574543323301846b41fa5433690df32efe085)
  13. User: admin
  14. Connected User: admin
  15. Delegated User:
  16. Network Address: 10.0.9.2:46166
  17. Default Db: default
  18. Sql Statement: SELECT pp.event_id, ts.x, ts.y, ts.z, ts.tx, ts.ty, ts.qOverP, ts.covariance, pp.`track_track_id` AS track_id FROM protoparticles_32 AS pp, track_32 AS tr, track_state_32 AS ts WHERE pp.track_track_id IS NOT NULL AND tr.type = 3 AND pp.hasMuonPIDStatus = true AND pp.muonPID_IsMuon = true AND (tr.CloneDist IS NULL OR tr.CloneDist > 5000) AND ABS(ts.qOverP) > 1e-20 AND tr.chi2PerDoF * tr.nDoF > 0.0 AND pp.event_id = tr.event_id AND pp.track_track_id = tr.track_id AND ts.event_id = pp.event_id AND ts.track_id = pp.track_track_id AND ts.`location` = 1
  19. Coordinator: slave-cn02:22000
  20. Query Options (set by configuration): QUERY_TIMEOUT_S=600,IDLE_SESSION_TIMEOUT=1800
  21. Query Options (set by configuration and planner): QUERY_TIMEOUT_S=600,MT_DOP=0,IDLE_SESSION_TIMEOUT=1800
  22. Plan:
  23. ----------------
  24. Max Per-Host Resource Reservation: Memory=63.00MB
  25. Per-Host Resource Estimates: Memory=1.88GB
  26.  
  27. F04:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
  28. | Per-Host Resources: mem-estimate=0B mem-reservation=0B
  29. PLAN-ROOT SINK
  30. | mem-estimate=0B mem-reservation=0B
  31. |
  32. 08:EXCHANGE [UNPARTITIONED]
  33. | mem-estimate=0B mem-reservation=0B
  34. | tuple-ids=1,2,0 row-size=106B cardinality=38142
  35. |
  36. F03:PLAN FRAGMENT [HASH(tr.event_id,tr.track_id)] hosts=6 instances=6
  37. Per-Host Resources: mem-estimate=19.00MB mem-reservation=19.00MB runtime-filters-memory=2.00MB
  38. 04:HASH JOIN [INNER JOIN, PARTITIONED]
  39. | hash predicates: tr.event_id = pp.event_id, tr.track_id = pp.track_track_id
  40. | fk/pk conjuncts: tr.event_id = pp.event_id, tr.track_id = pp.track_track_id
  41. | runtime filters: RF000[bloom] <- pp.event_id, RF001[bloom] <- pp.track_track_id
  42. | mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB
  43. | tuple-ids=1,2,0 row-size=106B cardinality=38142
  44. |
  45. |--07:EXCHANGE [HASH(pp.event_id,pp.track_track_id)]
  46. | | mem-estimate=0B mem-reservation=0B
  47. | | tuple-ids=2,0 row-size=74B cardinality=934260
  48. | |
  49. | F01:PLAN FRAGMENT [RANDOM] hosts=6 instances=6
  50. | Per-Host Resources: mem-estimate=1.00GB mem-reservation=42.00MB runtime-filters-memory=8.00MB
  51. | 03:HASH JOIN [INNER JOIN, BROADCAST]
  52. | | hash predicates: ts.event_id = pp.event_id, ts.track_id = pp.track_track_id
  53. | | fk/pk conjuncts: ts.event_id = pp.event_id, ts.track_id = pp.track_track_id
  54. | | runtime filters: RF004[bloom] <- pp.event_id, RF005[bloom] <- pp.track_track_id
  55. | | mem-estimate=138.01MB mem-reservation=34.00MB spill-buffer=2.00MB
  56. | | tuple-ids=2,0 row-size=74B cardinality=934260
  57. | |
  58. | |--05:EXCHANGE [BROADCAST]
  59. | | | mem-estimate=0B mem-reservation=0B
  60. | | | tuple-ids=0 row-size=10B cardinality=13156209
  61. | | |
  62. | | F02:PLAN FRAGMENT [RANDOM] hosts=6 instances=6
  63. | | Per-Host Resources: mem-estimate=352.00MB mem-reservation=0B
  64. | | 00:SCAN HDFS [default.protoparticles_32 pp, RANDOM]
  65. | | partitions=1/1 files=9 size=3.86GB
  66. | | predicates: pp.track_track_id IS NOT NULL, pp.hasMuonPIDStatus = TRUE, pp.muonPID_IsMuon = TRUE
  67. | | stored statistics:
  68. | | table: rows=234416992 size=3.86GB
  69. | | columns: all
  70. | | extrapolated-rows=disabled
  71. | | parquet statistics predicates: pp.hasMuonPIDStatus = TRUE, pp.muonPID_IsMuon = TRUE
  72. | | parquet dictionary predicates: pp.track_track_id IS NOT NULL, pp.hasMuonPIDStatus = TRUE, pp.muonPID_IsMuon = TRUE
  73. | | mem-estimate=352.00MB mem-reservation=0B
  74. | | tuple-ids=0 row-size=10B cardinality=13156209
  75. | |
  76. | 02:SCAN HDFS [default.track_state_32 ts, RANDOM]
  77. | partitions=1/1 files=119 size=50.43GB
  78. | predicates: ts.`location` = 1, ts.track_id IS NOT NULL, abs(ts.qOverP) > 1E-20
  79. | runtime filters: RF004[bloom] -> ts.event_id, RF005[bloom] -> ts.track_id
  80. | stored statistics:
  81. | table: rows=629478272 size=50.43GB
  82. | columns: all
  83. | extrapolated-rows=disabled
  84. | parquet statistics predicates: ts.`location` = 1
  85. | parquet dictionary predicates: ts.`location` = 1, ts.track_id IS NOT NULL, abs(ts.qOverP) > 1E-20
  86. | mem-estimate=880.00MB mem-reservation=0B
  87. | tuple-ids=2 row-size=64B cardinality=31473914
  88. |
  89. 06:EXCHANGE [HASH(tr.event_id,tr.track_id)]
  90. | mem-estimate=0B mem-reservation=0B
  91. | tuple-ids=1 row-size=32B cardinality=13083633
  92. |
  93. F00:PLAN FRAGMENT [RANDOM] hosts=6 instances=6
  94. Per-Host Resources: mem-estimate=530.00MB mem-reservation=2.00MB runtime-filters-memory=2.00MB
  95. 01:SCAN HDFS [default.track_32 tr, RANDOM]
  96. partitions=1/1 files=17 size=7.69GB
  97. predicates: tr.type = 3, tr.track_id IS NOT NULL, (tr.CloneDist IS NULL OR tr.CloneDist > 5000), tr.chi2PerDoF * tr.nDoF > 0.0
  98. runtime filters: RF000[bloom] -> tr.event_id, RF001[bloom] -> tr.track_id
  99. stored statistics:
  100. table: rows=320482240 size=7.69GB
  101. columns: all
  102. extrapolated-rows=disabled
  103. parquet statistics predicates: tr.type = 3
  104. parquet dictionary predicates: tr.type = 3, tr.track_id IS NOT NULL
  105. mem-estimate=528.00MB mem-reservation=0B
  106. tuple-ids=1 row-size=32B cardinality=13083633
  107. ----------------
  108. Estimated Per-Host Mem: 2020620761
  109. Per Host Min Reservation: slave-cn02:22000(63.00 MB) slave-cn03:22000(63.00 MB) slave-cn04:22000(63.00 MB) slave-cn05:22000(63.00 MB) slave-cn06:22000(63.00 MB) slave-cn07:22000(63.00 MB)
  110. Request Pool: root.admin
  111. Admission result: Admitted immediately
  112. Query Compilation: 5s510ms
  113. - Metadata load started: 2.692ms (2.692ms)
  114. - Metadata load finished. loaded-tables=1/3 load-requests=1 catalog-updates=5: 5s480ms (5s478ms)
  115. - Analysis finished: 5s485ms (4.823ms)
  116. - Value transfer graph computed: 5s486ms (532.183us)
  117. - Single node plan created: 5s499ms (13.145ms)
  118. - Runtime filters computed: 5s500ms (1.430ms)
  119. - Distributed plan created: 5s500ms (165.669us)
  120. - Lineage info computed: 5s501ms (834.523us)
  121. - Planning finished: 5s510ms (8.708ms)
  122. Query Timeline: 27m10s
  123. - Query submitted: 0.000ns (0.000ns)
  124. - Planning finished: 5s512ms (5s512ms)
  125. - Submit for admission: 5s516ms (4.000ms)
  126. - Completed admission: 5s516ms (0.000ns)
  127. - Ready to start on 6 backends: 5s516ms (0.000ns)
  128. - All 6 execution backends (25 fragment instances) started: 5s520ms (4.000ms)
  129. - First dynamic filter received: 34s169ms (28s649ms)
  130. - Rows available: 34s237ms (68.003ms)
  131. - First row fetched: 35s217ms (980.045ms)
  132. - Cancelled: 10m35s (10m)
  133. - Released admission control resources: 10m35s (0.000ns)
  134. - ComputeScanRangeAssignmentTimer: 0.000ns
  135. ImpalaServer:
  136. - ClientFetchWaitTimer: 980.045ms
  137. - RowMaterializationTimer: 0.000ns
  138. Execution Profile 33406f6405038287:b47e1f8b00000000:(Total: 28s721ms, non-child: 0.000ns, % non-child: 0.00%)
  139. Number of filters: 4
  140. Filter routing table:
  141. ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled
  142. -------------------------------------------------------------------------------------------------------------------
  143. 5 3 2 LOCAL false 0 (6) N/A N/A true
  144. 4 3 2 LOCAL false 0 (6) N/A N/A true
  145. 1 4 1 REMOTE false 6 (6) N/A N/A true
  146. 0 4 1 REMOTE false 6 (6) N/A N/A true
  147. Backend startup latencies: Count: 6, min / max: 2ms / 4ms, 25th %-ile: 2ms, 50th %-ile: 3ms, 75th %-ile: 3ms, 90th %-ile: 3ms, 95th %-ile: 4ms, 99.9th %-ile: 4ms
  148. Final filter table:
  149. ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled
  150. -------------------------------------------------------------------------------------------------------------------
  151. 5 3 2 LOCAL false 0 (6) N/A N/A true
  152. 4 3 2 LOCAL false 0 (6) N/A N/A true
  153. 1 4 1 REMOTE false 0 (6) 34s169ms 34s193ms false
  154. 0 4 1 REMOTE false 0 (6) 34s169ms 34s193ms false
  155. Per Node Peak Memory Usage: slave-cn02:22000(4.26 GB) slave-cn03:22000(4.23 GB) slave-cn04:22000(3.83 GB) slave-cn05:22000(3.09 GB) slave-cn06:22000(4.27 GB) slave-cn07:22000(2.87 GB)
  156. - FiltersReceived: 12 (12)
  157. - FinalizationTimer: 0.000ns
  158. - NumBackends: 6 (6)
  159. - NumFragmentInstances: 25 (25)
  160. - NumFragments: 5 (5)
  161. Averaged Fragment F04:(Total: 28s717ms, non-child: 0.000ns, % non-child: 0.00%)
  162. split sizes: min: 0, max: 0, avg: 0, stddev: 0
  163. completion times: min:10m30s max:10m30s mean: 10m30s stddev:0.000ns
  164. execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
  165. num instances: 1
  166. - AverageThreadTokens: 0.00
  167. - BloomFilterBytes: 0
  168. - PeakMemoryUsage: 12.59 MB (13201074)
  169. - PeakReservation: 0
  170. - PeakUsedReservation: 0
  171. - PerHostPeakMemUsage: 4.26 GB (4572618824)
  172. - RowsProduced: 1.02K (1024)
  173. - TotalNetworkReceiveTime: 28s697ms
  174. - TotalNetworkSendTime: 0.000ns
  175. - TotalStorageWaitTime: 0.000ns
  176. - TotalThreadsInvoluntaryContextSwitches: 0 (0)
  177. - TotalThreadsTotalWallClockTime: 28s717ms
  178. - TotalThreadsSysTime: 3.097ms
  179. - TotalThreadsUserTime: 15.721ms
  180. - TotalThreadsVoluntaryContextSwitches: 42 (42)
  181. Buffer pool:
  182. - AllocTime: 0.000ns
  183. - CumulativeAllocationBytes: 0
  184. - CumulativeAllocations: 0 (0)
  185. - PeakReservation: 0
  186. - PeakUnpinnedBytes: 0
  187. - PeakUsedReservation: 0
  188. - ReadIoBytes: 0
  189. - ReadIoOps: 0 (0)
  190. - ReadIoWaitTime: 0.000ns
  191. - ReservationLimit: 0
  192. - WriteIoBytes: 0
  193. - WriteIoOps: 0 (0)
  194. - WriteIoWaitTime: 0.000ns
  195. Fragment Instance Lifecycle Timings:
  196. - ExecTime: 0.000ns
  197. - ExecTreeExecTime: 0.000ns
  198. - OpenTime: 28s717ms
  199. - ExecTreeOpenTime: 28s697ms
  200. - PrepareTime: 0.000ns
  201. - ExecTreePrepareTime: 0.000ns
  202. PLAN_ROOT_SINK:
  203. - PeakMemoryUsage: 0
  204. EXCHANGE_NODE (id=8):(Total: 28s697ms, non-child: 28s697ms, % non-child: 100.00%)
  205. - ConvertRowBatchTime: 0.000ns
  206. - PeakMemoryUsage: 12.57 MB (13176498)
  207. - RowsReturned: 1.02K (1024)
  208. - RowsReturnedRate: 35.00 /sec
  209. Buffer pool:
  210. - AllocTime: 4.000ms
  211. - CumulativeAllocationBytes: 12.03 MB (12615680)
  212. - CumulativeAllocations: 154 (154)
  213. - PeakReservation: 12.03 MB (12615680)
  214. - PeakUnpinnedBytes: 0
  215. - PeakUsedReservation: 12.03 MB (12615680)
  216. - ReadIoBytes: 0
  217. - ReadIoOps: 0 (0)
  218. - ReadIoWaitTime: 0.000ns
  219. - WriteIoBytes: 0
  220. - WriteIoOps: 0 (0)
  221. - WriteIoWaitTime: 0.000ns
  222. Dequeue:
  223. - FirstBatchWaitTime: 28s697ms
  224. - TotalBytesDequeued: 134.00 KB (137216)
  225. - TotalGetBatchTime: 28s697ms
  226. - DataWaitTime: 28s697ms
  227. Enqueue:
  228. - DeserializeRowBatchTime: 16.000ms
  229. - TotalBatchesEnqueued: 77 (77)
  230. - TotalBatchesReceived: 83 (83)
  231. - TotalBytesReceived: 7.39 MB (7745942)
  232. - TotalEarlySenders: 0 (0)
  233. - TotalEosReceived: 0 (0)
  234. - TotalHasDeferredRPCsTime: 0.000ns
  235. - TotalRPCsDeferred: 6 (6)
  236. CodeGen:(Total: 20.000ms, non-child: 20.000ms, % non-child: 100.00%)
  237. - CodegenTime: 0.000ns
  238. - CompileTime: 0.000ns
  239. - LoadTime: 0.000ns
  240. - ModuleBitcodeSize: 1.95 MB (2040108)
  241. - NumFunctions: 0 (0)
  242. - NumInstructions: 0 (0)
  243. - OptimizationTime: 0.000ns
  244. - PeakMemoryUsage: 0
  245. - PrepareTime: 20.000ms
  246. Coordinator Fragment F04:
  247. Instance 33406f6405038287:b47e1f8b00000000 (host=slave-cn02:22000):(Total: 28s717ms, non-child: 0.000ns, % non-child: 0.00%)
  248. Fragment Instance Lifecycle Event Timeline: 28s717ms
  249. - Prepare Finished: 0.000ns (0.000ns)
  250. - Open Finished: 28s717ms (28s717ms)
  251. - First Batch Produced: 28s717ms (0.000ns)
  252. MemoryUsage(16s000ms): 24.00 KB, 2.54 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB
  253. - AverageThreadTokens: 0.00
  254. - BloomFilterBytes: 0
  255. - PeakMemoryUsage: 12.59 MB (13201074)
  256. - PeakReservation: 0
  257. - PeakUsedReservation: 0
  258. - PerHostPeakMemUsage: 4.26 GB (4572618824)
  259. - RowsProduced: 1.02K (1024)
  260. - TotalNetworkReceiveTime: 28s697ms
  261. - TotalNetworkSendTime: 0.000ns
  262. - TotalStorageWaitTime: 0.000ns
  263. - TotalThreadsInvoluntaryContextSwitches: 0 (0)
  264. - TotalThreadsTotalWallClockTime: 28s717ms
  265. - TotalThreadsSysTime: 3.097ms
  266. - TotalThreadsUserTime: 15.721ms
  267. - TotalThreadsVoluntaryContextSwitches: 42 (42)
  268. Buffer pool:
  269. - AllocTime: 0.000ns
  270. - CumulativeAllocationBytes: 0
  271. - CumulativeAllocations: 0 (0)
  272. - PeakReservation: 0
  273. - PeakUnpinnedBytes: 0
  274. - PeakUsedReservation: 0
  275. - ReadIoBytes: 0
  276. - ReadIoOps: 0 (0)
  277. - ReadIoWaitTime: 0.000ns
  278. - ReservationLimit: 0
  279. - WriteIoBytes: 0
  280. - WriteIoOps: 0 (0)
  281. - WriteIoWaitTime: 0.000ns
  282. Fragment Instance Lifecycle Timings:
  283. - ExecTime: 0.000ns
  284. - ExecTreeExecTime: 0.000ns
  285. - OpenTime: 28s717ms
  286. - ExecTreeOpenTime: 28s697ms
  287. - PrepareTime: 0.000ns
  288. - ExecTreePrepareTime: 0.000ns
  289. PLAN_ROOT_SINK:
  290. - PeakMemoryUsage: 0
  291. EXCHANGE_NODE (id=8):(Total: 28s697ms, non-child: 0.000ns, % non-child: 0.00%)
  292. - ConvertRowBatchTime: 0.000ns
  293. - PeakMemoryUsage: 12.57 MB (13176498)
  294. - RowsReturned: 1.02K (1024)
  295. - RowsReturnedRate: 35.00 /sec
  296. Buffer pool:
  297. - AllocTime: 4.000ms
  298. - CumulativeAllocationBytes: 12.03 MB (12615680)
  299. - CumulativeAllocations: 154 (154)
  300. - PeakReservation: 12.03 MB (12615680)
  301. - PeakUnpinnedBytes: 0
  302. - PeakUsedReservation: 12.03 MB (12615680)
  303. - ReadIoBytes: 0
  304. - ReadIoOps: 0 (0)
  305. - ReadIoWaitTime: 0.000ns
  306. - WriteIoBytes: 0
  307. - WriteIoOps: 0 (0)
  308. - WriteIoWaitTime: 0.000ns
  309. Dequeue:
  310. BytesDequeued(16s000ms): 0, 29.31 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB
  311. - FirstBatchWaitTime: 28s697ms
  312. - TotalBytesDequeued: 134.00 KB (137216)
  313. - TotalGetBatchTime: 28s697ms
  314. - DataWaitTime: 28s697ms
  315. Enqueue:
  316. BytesReceived(16s000ms): 0, 1.47 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB
  317. DeferredQueueSize(16s000ms): 0, 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6
  318. - DispatchTime: (Avg: 45.488us ; Min: 20.532us ; Max: 143.209us ; Number of samples: 83)
  319. - DeserializeRowBatchTime: 16.000ms
  320. - TotalBatchesEnqueued: 77 (77)
  321. - TotalBatchesReceived: 83 (83)
  322. - TotalBytesReceived: 7.39 MB (7745942)
  323. - TotalEarlySenders: 0 (0)
  324. - TotalEosReceived: 0 (0)
  325. - TotalHasDeferredRPCsTime: 0.000ns
  326. - TotalRPCsDeferred: 6 (6)
  327. CodeGen:(Total: 20.000ms, non-child: 20.000ms, % non-child: 100.00%)
  328. - CodegenTime: 0.000ns
  329. - CompileTime: 0.000ns
  330. - LoadTime: 0.000ns
  331. - ModuleBitcodeSize: 1.95 MB (2040108)
  332. - NumFunctions: 0 (0)
  333. - NumInstructions: 0 (0)
  334. - OptimizationTime: 0.000ns
  335. - PeakMemoryUsage: 0
  336. - PrepareTime: 20.000ms
  337. Averaged Fragment F03:(Total: 28s738ms, non-child: 0.000ns, % non-child: 0.00%)
  338. split sizes: min: 0, max: 0, avg: 0, stddev: 0
  339. completion times: min:10m30s max:10m30s mean: 10m30s stddev:1.490ms
  340. execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
  341. num instances: 6
  342. - AverageThreadTokens: 1.05
  343. - BloomFilterBytes: 2.00 MB (2097152)
  344. - PeakMemoryUsage: 126.53 MB (132673021)
  345. - PeakReservation: 114.00 MB (119537664)
  346. - PeakUsedReservation: 0
  347. - PerHostPeakMemUsage: 3.76 GB (4033533655)
  348. - RowsProduced: 15.19K (15189)
  349. - TotalNetworkReceiveTime: 28s750ms
  350. - TotalNetworkSendTime: 666.703us
  351. - TotalStorageWaitTime: 0.000ns
  352. - TotalThreadsInvoluntaryContextSwitches: 34 (34)
  353. - TotalThreadsTotalWallClockTime: 57s173ms
  354. - TotalThreadsSysTime: 247.007ms
  355. - TotalThreadsUserTime: 676.862ms
  356. - TotalThreadsVoluntaryContextSwitches: 4.66K (4656)
  357. Buffer pool:
  358. - AllocTime: 666.698us
  359. - CumulativeAllocationBytes: 2.00 MB (2097152)
  360. - CumulativeAllocations: 2 (2)
  361. - PeakReservation: 2.00 MB (2097152)
  362. - PeakUnpinnedBytes: 0
  363. - PeakUsedReservation: 2.00 MB (2097152)
  364. - ReadIoBytes: 0
  365. - ReadIoOps: 0 (0)
  366. - ReadIoWaitTime: 0.000ns
  367. - ReservationLimit: 2.00 MB (2097152)
  368. - WriteIoBytes: 0
  369. - WriteIoOps: 0 (0)
  370. - WriteIoWaitTime: 0.000ns
  371. Fragment Instance Lifecycle Timings:
  372. - ExecTime: 0.000ns
  373. - ExecTreeExecTime: 45.335ms
  374. - OpenTime: 28s737ms
  375. - ExecTreeOpenTime: 28s435ms
  376. - PrepareTime: 1.333ms
  377. - ExecTreePrepareTime: 0.000ns
  378. KrpcDataStreamSender (dst_id=8):(Total: 7.333ms, non-child: 7.333ms, % non-child: 100.00%)
  379. - EosSent: 0 (0)
  380. - NetworkThroughput: 106.97 MB/sec
  381. - PeakMemoryUsage: 3.47 KB (3552)
  382. - RowsSent: 14.16K (14165)
  383. - RpcFailure: 0 (0)
  384. - RpcRetry: 0 (0)
  385. - SerializeBatchTime: 7.333ms
  386. - TotalBytesSent: 1.14 MB (1197625)
  387. - UncompressedRowBatchSize: 1.94 MB (2035370)
  388. HASH_JOIN_NODE (id=4):(Total: 28s481ms, non-child: 496.689ms, % non-child: 1.74%)
  389. - BuildRows: 918.86K (918861)
  390. - BuildTime: 462.021ms
  391. - NumHashTableBuildsSkipped: 0 (0)
  392. - PeakMemoryUsage: 112.07 MB (117510400)
  393. - ProbeRows: 248.66K (248661)
  394. - ProbeRowsPartitioned: 0 (0)
  395. - ProbeTime: 28.667ms
  396. - RowsReturned: 15.19K (15189)
  397. - RowsReturnedRate: 533.00 /sec
  398. Buffer pool:
  399. - AllocTime: 53.335ms
  400. - CumulativeAllocationBytes: 112.00 MB (117440512)
  401. - CumulativeAllocations: 96 (96)
  402. - PeakReservation: 112.00 MB (117440512)
  403. - PeakUnpinnedBytes: 0
  404. - PeakUsedReservation: 112.00 MB (117440512)
  405. - ReadIoBytes: 0
  406. - ReadIoOps: 0 (0)
  407. - ReadIoWaitTime: 0.000ns
  408. - WriteIoBytes: 0
  409. - WriteIoOps: 0 (0)
  410. - WriteIoWaitTime: 0.000ns
  411. Hash Join Builder (join_node_id=4):
  412. - BuildRowsPartitionTime: 356.683ms
  413. - BuildRowsPartitioned: 918.86K (918861)
  414. - HashBuckets: 2.10M (2097152)
  415. - HashCollisions: 0 (0)
  416. - HashTablesBuildTime: 99.338ms
  417. - LargestPartitionPercent: 6 (6)
  418. - MaxPartitionLevel: 0 (0)
  419. - NumRepartitions: 0 (0)
  420. - PartitionsCreated: 16 (16)
  421. - PeakMemoryUsage: 30.12 KB (30848)
  422. - RepartitionTime: 0.000ns
  423. - SpilledPartitions: 0 (0)
  424. EXCHANGE_NODE (id=7):(Total: 27s968ms, non-child: 27s968ms, % non-child: 100.00%)
  425. - ConvertRowBatchTime: 19.334ms
  426. - PeakMemoryUsage: 217.33 KB (222549)
  427. - RowsReturned: 918.86K (918861)
  428. - RowsReturnedRate: 32.85 K/sec
  429. Buffer pool:
  430. - AllocTime: 79.337ms
  431. - CumulativeAllocationBytes: 101.63 MB (106566997)
  432. - CumulativeAllocations: 8.67K (8674)
  433. - PeakReservation: 217.33 KB (222549)
  434. - PeakUnpinnedBytes: 0
  435. - PeakUsedReservation: 217.33 KB (222549)
  436. - ReadIoBytes: 0
  437. - ReadIoOps: 0 (0)
  438. - ReadIoWaitTime: 0.000ns
  439. - WriteIoBytes: 0
  440. - WriteIoOps: 0 (0)
  441. - WriteIoWaitTime: 0.000ns
  442. Dequeue:
  443. - FirstBatchWaitTime: 3s253ms
  444. - TotalBytesDequeued: 81.50 MB (85454104)
  445. - TotalGetBatchTime: 27s941ms
  446. - DataWaitTime: 27s924ms
  447. Enqueue:
  448. - DeserializeRowBatchTime: 158.007ms
  449. - TotalBatchesEnqueued: 4.34K (4337)
  450. - TotalBatchesReceived: 4.34K (4337)
  451. - TotalBytesReceived: 58.86 MB (61717785)
  452. - TotalEarlySenders: 0 (0)
  453. - TotalEosReceived: 6 (6)
  454. - TotalHasDeferredRPCsTime: 0.000ns
  455. - TotalRPCsDeferred: 0 (0)
  456. EXCHANGE_NODE (id=6):(Total: 813.370ms, non-child: 813.370ms, % non-child: 100.00%)
  457. - ConvertRowBatchTime: 6.000ms
  458. - PeakMemoryUsage: 12.35 MB (12949070)
  459. - RowsReturned: 248.66K (248661)
  460. - RowsReturnedRate: 308.51 K/sec
  461. Buffer pool:
  462. - AllocTime: 9.333ms
  463. - CumulativeAllocationBytes: 18.51 MB (19410944)
  464. - CumulativeAllocations: 1.58K (1579)
  465. - PeakReservation: 12.33 MB (12924245)
  466. - PeakUnpinnedBytes: 0
  467. - PeakUsedReservation: 12.33 MB (12924245)
  468. - ReadIoBytes: 0
  469. - ReadIoOps: 0 (0)
  470. - ReadIoWaitTime: 0.000ns
  471. - WriteIoBytes: 0
  472. - WriteIoOps: 0 (0)
  473. - WriteIoWaitTime: 0.000ns
  474. Dequeue:
  475. - FirstBatchWaitTime: 797.370ms
  476. - TotalBytesDequeued: 9.73 MB (10205282)
  477. - TotalGetBatchTime: 806.037ms
  478. - DataWaitTime: 805.370ms
  479. Enqueue:
  480. - DeserializeRowBatchTime: 24.001ms
  481. - TotalBatchesEnqueued: 789 (789)
  482. - TotalBatchesReceived: 791 (791)
  483. - TotalBytesReceived: 8.25 MB (8648531)
  484. - TotalEarlySenders: 0 (0)
  485. - TotalEosReceived: 0 (0)
  486. - TotalHasDeferredRPCsTime: 27s101ms
  487. - TotalRPCsDeferred: 7 (7)
  488. CodeGen:(Total: 294.680ms, non-child: 294.680ms, % non-child: 100.00%)
  489. - CodegenTime: 0.000ns
  490. - CompileTime: 82.670ms
  491. - LoadTime: 0.000ns
  492. - ModuleBitcodeSize: 1.95 MB (2040108)
  493. - NumFunctions: 78 (78)
  494. - NumInstructions: 2.75K (2748)
  495. - OptimizationTime: 189.342ms
  496. - PeakMemoryUsage: 1.34 MB (1406976)
  497. - PrepareTime: 22.667ms
  498. Fragment F03:
  499. Instance 33406f6405038287:b47e1f8b00000018 (host=slave-cn02:22000):(Total: 28s765ms, non-child: 0.000ns, % non-child: 0.00%)
  500. Fragment Instance Lifecycle Event Timeline: 28s769ms
  501. - Prepare Finished: 4.000ms (4.000ms)
  502. - Open Finished: 28s765ms (28s761ms)
  503. - First Batch Produced: 28s769ms (4.000ms)
  504. - First Batch Sent: 28s769ms (0.000ns)
  505. MemoryUsage(16s000ms): 32.62 MB, 85.30 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB
  506. ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
  507. - AverageThreadTokens: 1.05
  508. - BloomFilterBytes: 2.00 MB (2097152)
  509. - PeakMemoryUsage: 126.73 MB (132888745)
  510. - PeakReservation: 114.00 MB (119537664)
  511. - PeakUsedReservation: 0
  512. - PerHostPeakMemUsage: 4.26 GB (4572618824)
  513. - RowsProduced: 8.19K (8192)
  514. - TotalNetworkReceiveTime: 28s757ms
  515. - TotalNetworkSendTime: 0.000ns
  516. - TotalStorageWaitTime: 0.000ns
  517. - TotalThreadsInvoluntaryContextSwitches: 74 (74)
  518. - TotalThreadsTotalWallClockTime: 57s250ms
  519. - TotalThreadsSysTime: 264.857ms
  520. - TotalThreadsUserTime: 662.892ms
  521. - TotalThreadsVoluntaryContextSwitches: 4.51K (4508)
  522. Buffer pool:
  523. - AllocTime: 0.000ns
  524. - CumulativeAllocationBytes: 2.00 MB (2097152)
  525. - CumulativeAllocations: 2 (2)
  526. - PeakReservation: 2.00 MB (2097152)
  527. - PeakUnpinnedBytes: 0
  528. - PeakUsedReservation: 2.00 MB (2097152)
  529. - ReadIoBytes: 0
  530. - ReadIoOps: 0 (0)
  531. - ReadIoWaitTime: 0.000ns
  532. - ReservationLimit: 2.00 MB (2097152)
  533. - WriteIoBytes: 0
  534. - WriteIoOps: 0 (0)
  535. - WriteIoWaitTime: 0.000ns
  536. Fragment Instance Lifecycle Timings:
  537. - ExecTime: 0.000ns
  538. - ExecTreeExecTime: 28.001ms
  539. - OpenTime: 28s761ms
  540. - ExecTreeOpenTime: 28s489ms
  541. - PrepareTime: 4.000ms
  542. - ExecTreePrepareTime: 0.000ns
  543. KrpcDataStreamSender (dst_id=8):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%)
  544. BytesSent(16s000ms): 0, 102.46 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB
  545. - EosSent: 0 (0)
  546. - NetworkThroughput: 372.98 MB/sec
  547. - PeakMemoryUsage: 3.47 KB (3552)
  548. - RowsSent: 7.17K (7168)
  549. - RpcFailure: 0 (0)
  550. - RpcRetry: 0 (0)
  551. - SerializeBatchTime: 0.000ns
  552. - TotalBytesSent: 546.45 KB (559561)
  553. - UncompressedRowBatchSize: 1.05 MB (1097728)
  554. HASH_JOIN_NODE (id=4):(Total: 28s517ms, non-child: 556.025ms, % non-child: 1.95%)
  555. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  556. - BuildRows: 918.53K (918526)
  557. - BuildTime: 520.024ms
  558. - NumHashTableBuildsSkipped: 0 (0)
  559. - PeakMemoryUsage: 112.07 MB (117510400)
  560. - ProbeRows: 133.12K (133120)
  561. - ProbeRowsPartitioned: 0 (0)
  562. - ProbeTime: 28.001ms
  563. - RowsReturned: 8.19K (8192)
  564. - RowsReturnedRate: 287.00 /sec
  565. Buffer pool:
  566. - AllocTime: 28.001ms
  567. - CumulativeAllocationBytes: 112.00 MB (117440512)
  568. - CumulativeAllocations: 96 (96)
  569. - PeakReservation: 112.00 MB (117440512)
  570. - PeakUnpinnedBytes: 0
  571. - PeakUsedReservation: 112.00 MB (117440512)
  572. - ReadIoBytes: 0
  573. - ReadIoOps: 0 (0)
  574. - ReadIoWaitTime: 0.000ns
  575. - WriteIoBytes: 0
  576. - WriteIoOps: 0 (0)
  577. - WriteIoWaitTime: 0.000ns
  578. Hash Join Builder (join_node_id=4):
  579. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  580. Runtime filters: 2 of 2 Runtime Filters Published
  581. - BuildRowsPartitionTime: 392.018ms
  582. - BuildRowsPartitioned: 918.53K (918526)
  583. - HashBuckets: 2.10M (2097152)
  584. - HashCollisions: 0 (0)
  585. - HashTablesBuildTime: 116.005ms
  586. - LargestPartitionPercent: 6 (6)
  587. - MaxPartitionLevel: 0 (0)
  588. - NumRepartitions: 0 (0)
  589. - PartitionsCreated: 16 (16)
  590. - PeakMemoryUsage: 30.12 KB (30848)
  591. - RepartitionTime: 0.000ns
  592. - SpilledPartitions: 0 (0)
  593. EXCHANGE_NODE (id=7):(Total: 27s961ms, non-child: 32.001ms, % non-child: 0.11%)
  594. - ConvertRowBatchTime: 24.001ms
  595. - PeakMemoryUsage: 152.00 KB (155648)
  596. - RowsReturned: 918.53K (918526)
  597. - RowsReturnedRate: 32.85 K/sec
  598. Buffer pool:
  599. - AllocTime: 32.001ms
  600. - CumulativeAllocationBytes: 101.59 MB (106528768)
  601. - CumulativeAllocations: 8.67K (8672)
  602. - PeakReservation: 152.00 KB (155648)
  603. - PeakUnpinnedBytes: 0
  604. - PeakUsedReservation: 152.00 KB (155648)
  605. - ReadIoBytes: 0
  606. - ReadIoOps: 0 (0)
  607. - ReadIoWaitTime: 0.000ns
  608. - WriteIoBytes: 0
  609. - WriteIoOps: 0 (0)
  610. - WriteIoWaitTime: 0.000ns
  611. Dequeue:
  612. BytesDequeued(500.000ms): 0, 0, 0, 0, 0, 0, 0, 385.08 KB, 2.29 MB, 4.68 MB, 6.79 MB, 8.35 MB, 10.19 MB, 11.77 MB, 13.29 MB, 14.67 MB, 16.28 MB, 17.71 MB, 19.03 MB, 20.70 MB, 22.32 MB, 23.28 MB, 24.65 MB, 25.80 MB, 27.00 MB, 28.67 MB, 30.05 MB, 31.33 MB, 32.75 MB, 34.11 MB, 35.07 MB, 35.91 MB, 36.95 MB, 39.17 MB, 41.54 MB, 42.83 MB, 44.22 MB, 46.09 MB, 47.63 MB, 48.98 MB, 51.05 MB, 53.72 MB, 56.38 MB, 59.61 MB, 62.81 MB, 65.46 MB, 67.72 MB, 69.63 MB, 71.57 MB, 73.30 MB, 74.90 MB, 76.72 MB, 78.28 MB, 79.32 MB, 80.00 MB, 80.64 MB, 81.18 MB, 81.47 MB
  613. - FirstBatchWaitTime: 3s280ms
  614. - TotalBytesDequeued: 81.47 MB (85422918)
  615. - TotalGetBatchTime: 27s933ms
  616. - DataWaitTime: 27s929ms
  617. Enqueue:
  618. BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 276.50 KB, 1.65 MB, 3.37 MB, 4.89 MB, 6.01 MB, 7.34 MB, 8.48 MB, 9.59 MB, 10.57 MB, 11.73 MB, 12.76 MB, 13.71 MB, 14.92 MB, 16.10 MB, 16.78 MB, 17.77 MB, 18.60 MB, 19.47 MB, 20.68 MB, 21.67 MB, 22.60 MB, 23.63 MB, 24.61 MB, 25.30 MB, 25.91 MB, 26.66 MB, 28.26 MB, 29.98 MB, 30.92 MB, 31.92 MB, 33.27 MB, 34.38 MB, 35.36 MB, 36.86 MB, 38.79 MB, 40.71 MB, 43.04 MB, 45.35 MB, 47.28 MB, 48.91 MB, 50.29 MB, 51.69 MB, 52.94 MB, 54.10 MB, 55.42 MB, 56.54 MB, 57.29 MB, 57.78 MB, 58.24 MB, 58.63 MB, 58.84 MB
  619. DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  620. - DispatchTime: (Avg: 59.255us ; Min: 26.257us ; Max: 3.828ms ; Number of samples: 4336)
  621. - DeserializeRowBatchTime: 128.005ms
  622. - TotalBatchesEnqueued: 4.34K (4336)
  623. - TotalBatchesReceived: 4.34K (4336)
  624. - TotalBytesReceived: 58.84 MB (61696748)
  625. - TotalEarlySenders: 0 (0)
  626. - TotalEosReceived: 6 (6)
  627. - TotalHasDeferredRPCsTime: 0.000ns
  628. - TotalRPCsDeferred: 0 (0)
  629. EXCHANGE_NODE (id=6):(Total: 824.038ms, non-child: 0.000ns, % non-child: 0.00%)
  630. - ConvertRowBatchTime: 0.000ns
  631. - PeakMemoryUsage: 12.66 MB (13277021)
  632. - RowsReturned: 133.12K (133120)
  633. - RowsReturnedRate: 161.54 K/sec
  634. Buffer pool:
  635. - AllocTime: 12.000ms
  636. - CumulativeAllocationBytes: 18.38 MB (19267584)
  637. - CumulativeAllocations: 1.57K (1568)
  638. - PeakReservation: 12.61 MB (13221888)
  639. - PeakUnpinnedBytes: 0
  640. - PeakUsedReservation: 12.61 MB (13221888)
  641. - ReadIoBytes: 0
  642. - ReadIoOps: 0 (0)
  643. - ReadIoWaitTime: 0.000ns
  644. - WriteIoBytes: 0
  645. - WriteIoOps: 0 (0)
  646. - WriteIoWaitTime: 0.000ns
  647. Dequeue:
  648. BytesDequeued(16s000ms): 18.62 KB, 1017.79 KB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB
  649. - FirstBatchWaitTime: 824.038ms
  650. - TotalBytesDequeued: 5.22 MB (5470384)
  651. - TotalGetBatchTime: 824.038ms
  652. - DataWaitTime: 824.038ms
  653. Enqueue:
  654. BytesReceived(16s000ms): 4.93 MB, 5.93 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB
  655. DeferredQueueSize(16s000ms): 2, 3, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5
  656. - DispatchTime: (Avg: 38.003us ; Min: 16.090us ; Max: 1.284ms ; Number of samples: 789)
  657. - DeserializeRowBatchTime: 36.001ms
  658. - TotalBatchesEnqueued: 784 (784)
  659. - TotalBatchesReceived: 789 (789)
  660. - TotalBytesReceived: 8.22 MB (8620791)
  661. - TotalEarlySenders: 0 (0)
  662. - TotalEosReceived: 0 (0)
  663. - TotalHasDeferredRPCsTime: 27s125ms
  664. - TotalRPCsDeferred: 12 (12)
  665. CodeGen:(Total: 268.012ms, non-child: 268.012ms, % non-child: 100.00%)
  666. - CodegenTime: 0.000ns
  667. - CompileTime: 76.003ms
  668. - LoadTime: 0.000ns
  669. - ModuleBitcodeSize: 1.95 MB (2040108)
  670. - NumFunctions: 78 (78)
  671. - NumInstructions: 2.75K (2748)
  672. - OptimizationTime: 168.007ms
  673. - PeakMemoryUsage: 1.34 MB (1406976)
  674. - PrepareTime: 24.001ms
  675. Instance 33406f6405038287:b47e1f8b00000017 (host=slave-cn03:22000):(Total: 28s753ms, non-child: 0.000ns, % non-child: 0.00%)
  676. Fragment Instance Lifecycle Event Timeline: 28s757ms
  677. - Prepare Finished: 4.000ms (4.000ms)
  678. - Open Finished: 28s753ms (28s749ms)
  679. - First Batch Produced: 28s757ms (4.000ms)
  680. - First Batch Sent: 28s757ms (0.000ns)
  681. MemoryUsage(16s000ms): 32.59 MB, 84.32 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB
  682. ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
  683. - AverageThreadTokens: 1.05
  684. - BloomFilterBytes: 2.00 MB (2097152)
  685. - PeakMemoryUsage: 126.77 MB (132932407)
  686. - PeakReservation: 114.00 MB (119537664)
  687. - PeakUsedReservation: 0
  688. - PerHostPeakMemUsage: 4.23 GB (4540696369)
  689. - RowsProduced: 8.19K (8192)
  690. - TotalNetworkReceiveTime: 28s661ms
  691. - TotalNetworkSendTime: 0.000ns
  692. - TotalStorageWaitTime: 0.000ns
  693. - TotalThreadsInvoluntaryContextSwitches: 40 (40)
  694. - TotalThreadsTotalWallClockTime: 57s226ms
  695. - TotalThreadsSysTime: 203.411ms
  696. - TotalThreadsUserTime: 714.701ms
  697. - TotalThreadsVoluntaryContextSwitches: 4.60K (4598)
  698. Buffer pool:
  699. - AllocTime: 0.000ns
  700. - CumulativeAllocationBytes: 2.00 MB (2097152)
  701. - CumulativeAllocations: 2 (2)
  702. - PeakReservation: 2.00 MB (2097152)
  703. - PeakUnpinnedBytes: 0
  704. - PeakUsedReservation: 2.00 MB (2097152)
  705. - ReadIoBytes: 0
  706. - ReadIoOps: 0 (0)
  707. - ReadIoWaitTime: 0.000ns
  708. - ReservationLimit: 2.00 MB (2097152)
  709. - WriteIoBytes: 0
  710. - WriteIoOps: 0 (0)
  711. - WriteIoWaitTime: 0.000ns
  712. Fragment Instance Lifecycle Timings:
  713. - ExecTime: 0.000ns
  714. - ExecTreeExecTime: 28.001ms
  715. - OpenTime: 28s749ms
  716. - ExecTreeOpenTime: 28s477ms
  717. - PrepareTime: 4.000ms
  718. - ExecTreePrepareTime: 0.000ns
  719. KrpcDataStreamSender (dst_id=8):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%)
  720. BytesSent(16s000ms): 0, 102.42 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB
  721. - EosSent: 0 (0)
  722. - NetworkThroughput: 25.00 MB/sec
  723. - PeakMemoryUsage: 3.47 KB (3552)
  724. - RowsSent: 7.17K (7168)
  725. - RpcFailure: 0 (0)
  726. - RpcRetry: 0 (0)
  727. - SerializeBatchTime: 4.000ms
  728. - TotalBytesSent: 546.22 KB (559327)
  729. - UncompressedRowBatchSize: 1.05 MB (1097728)
  730. HASH_JOIN_NODE (id=4):(Total: 28s505ms, non-child: 648.029ms, % non-child: 2.27%)
  731. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  732. - BuildRows: 919.04K (919043)
  733. - BuildTime: 620.028ms
  734. - NumHashTableBuildsSkipped: 0 (0)
  735. - PeakMemoryUsage: 112.07 MB (117510400)
  736. - ProbeRows: 133.12K (133120)
  737. - ProbeRowsPartitioned: 0 (0)
  738. - ProbeTime: 24.001ms
  739. - RowsReturned: 8.19K (8192)
  740. - RowsReturnedRate: 287.00 /sec
  741. Buffer pool:
  742. - AllocTime: 112.005ms
  743. - CumulativeAllocationBytes: 112.00 MB (117440512)
  744. - CumulativeAllocations: 96 (96)
  745. - PeakReservation: 112.00 MB (117440512)
  746. - PeakUnpinnedBytes: 0
  747. - PeakUsedReservation: 112.00 MB (117440512)
  748. - ReadIoBytes: 0
  749. - ReadIoOps: 0 (0)
  750. - ReadIoWaitTime: 0.000ns
  751. - WriteIoBytes: 0
  752. - WriteIoOps: 0 (0)
  753. - WriteIoWaitTime: 0.000ns
  754. Hash Join Builder (join_node_id=4):
  755. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  756. Runtime filters: 2 of 2 Runtime Filters Published
  757. - BuildRowsPartitionTime: 500.022ms
  758. - BuildRowsPartitioned: 919.04K (919043)
  759. - HashBuckets: 2.10M (2097152)
  760. - HashCollisions: 0 (0)
  761. - HashTablesBuildTime: 116.005ms
  762. - LargestPartitionPercent: 6 (6)
  763. - MaxPartitionLevel: 0 (0)
  764. - NumRepartitions: 0 (0)
  765. - PartitionsCreated: 16 (16)
  766. - PeakMemoryUsage: 30.12 KB (30848)
  767. - RepartitionTime: 0.000ns
  768. - SpilledPartitions: 0 (0)
  769. EXCHANGE_NODE (id=7):(Total: 27s853ms, non-child: 60.002ms, % non-child: 0.22%)
  770. - ConvertRowBatchTime: 12.000ms
  771. - PeakMemoryUsage: 464.00 KB (475136)
  772. - RowsReturned: 919.04K (919043)
  773. - RowsReturnedRate: 32.99 K/sec
  774. Buffer pool:
  775. - AllocTime: 76.003ms
  776. - CumulativeAllocationBytes: 101.64 MB (106577920)
  777. - CumulativeAllocations: 8.67K (8674)
  778. - PeakReservation: 464.00 KB (475136)
  779. - PeakUnpinnedBytes: 0
  780. - PeakUsedReservation: 464.00 KB (475136)
  781. - ReadIoBytes: 0
  782. - ReadIoOps: 0 (0)
  783. - ReadIoWaitTime: 0.000ns
  784. - WriteIoBytes: 0
  785. - WriteIoOps: 0 (0)
  786. - WriteIoWaitTime: 0.000ns
  787. Dequeue:
  788. BytesDequeued(500.000ms): 0, 0, 0, 0, 0, 0, 0, 77.02 KB, 1.79 MB, 4.06 MB, 6.11 MB, 7.93 MB, 9.76 MB, 11.30 MB, 12.80 MB, 14.33 MB, 15.94 MB, 17.34 MB, 18.65 MB, 20.33 MB, 22.06 MB, 23.09 MB, 24.46 MB, 25.59 MB, 26.83 MB, 28.49 MB, 29.80 MB, 31.16 MB, 32.53 MB, 33.92 MB, 34.95 MB, 35.78 MB, 36.74 MB, 38.60 MB, 40.93 MB, 42.66 MB, 43.94 MB, 45.63 MB, 47.35 MB, 48.62 MB, 50.35 MB, 52.84 MB, 55.56 MB, 58.66 MB, 61.99 MB, 64.85 MB, 67.24 MB, 69.17 MB, 71.20 MB, 72.87 MB, 74.45 MB, 76.20 MB, 77.95 MB, 79.16 MB, 79.90 MB, 80.52 MB, 81.09 MB, 81.50 MB
  789. - FirstBatchWaitTime: 3s280ms
  790. - TotalBytesDequeued: 81.51 MB (85470999)
  791. - TotalGetBatchTime: 27s829ms
  792. - DataWaitTime: 27s797ms
  793. Enqueue:
  794. BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 55.19 KB, 1.28 MB, 2.92 MB, 4.40 MB, 5.71 MB, 7.03 MB, 8.14 MB, 9.22 MB, 10.32 MB, 11.49 MB, 12.49 MB, 13.44 MB, 14.65 MB, 15.90 MB, 16.65 MB, 17.64 MB, 18.46 MB, 19.35 MB, 20.55 MB, 21.50 MB, 22.48 MB, 23.47 MB, 24.47 MB, 25.22 MB, 25.82 MB, 26.51 MB, 27.86 MB, 29.54 MB, 30.79 MB, 31.72 MB, 32.94 MB, 34.18 MB, 35.10 MB, 36.35 MB, 38.15 MB, 40.12 MB, 42.36 MB, 44.76 MB, 46.83 MB, 48.56 MB, 49.95 MB, 51.42 MB, 52.63 MB, 53.77 MB, 55.04 MB, 56.30 MB, 57.17 MB, 57.71 MB, 58.16 MB, 58.56 MB, 58.86 MB
  795. DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  796. - DispatchTime: (Avg: 60.236us ; Min: 25.453us ; Max: 13.216ms ; Number of samples: 4337)
  797. - DeserializeRowBatchTime: 152.006ms
  798. - TotalBatchesEnqueued: 4.34K (4337)
  799. - TotalBatchesReceived: 4.34K (4337)
  800. - TotalBytesReceived: 58.87 MB (61729506)
  801. - TotalEarlySenders: 0 (0)
  802. - TotalEosReceived: 6 (6)
  803. - TotalHasDeferredRPCsTime: 0.000ns
  804. - TotalRPCsDeferred: 0 (0)
  805. EXCHANGE_NODE (id=6):(Total: 828.037ms, non-child: 4.000ms, % non-child: 0.48%)
  806. - ConvertRowBatchTime: 0.000ns
  807. - PeakMemoryUsage: 12.70 MB (13320699)
  808. - RowsReturned: 133.12K (133120)
  809. - RowsReturnedRate: 160.76 K/sec
  810. Buffer pool:
  811. - AllocTime: 12.000ms
  812. - CumulativeAllocationBytes: 18.38 MB (19267584)
  813. - CumulativeAllocations: 1.57K (1568)
  814. - PeakReservation: 12.64 MB (13254656)
  815. - PeakUnpinnedBytes: 0
  816. - PeakUsedReservation: 12.64 MB (13254656)
  817. - ReadIoBytes: 0
  818. - ReadIoOps: 0 (0)
  819. - ReadIoWaitTime: 0.000ns
  820. - WriteIoBytes: 0
  821. - WriteIoOps: 0 (0)
  822. - WriteIoWaitTime: 0.000ns
  823. Dequeue:
  824. BytesDequeued(16s000ms): 18.62 KB, 1017.79 KB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB
  825. - FirstBatchWaitTime: 824.037ms
  826. - TotalBytesDequeued: 5.22 MB (5470384)
  827. - TotalGetBatchTime: 824.037ms
  828. - DataWaitTime: 824.037ms
  829. Enqueue:
  830. BytesReceived(16s000ms): 4.90 MB, 5.95 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB
  831. DeferredQueueSize(16s000ms): 4, 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6
  832. - DispatchTime: (Avg: 36.118us ; Min: 18.472us ; Max: 128.157us ; Number of samples: 790)
  833. - DeserializeRowBatchTime: 32.001ms
  834. - TotalBatchesEnqueued: 784 (784)
  835. - TotalBatchesReceived: 790 (790)
  836. - TotalBytesReceived: 8.23 MB (8630403)
  837. - TotalEarlySenders: 0 (0)
  838. - TotalEosReceived: 0 (0)
  839. - TotalHasDeferredRPCsTime: 27s119ms
  840. - TotalRPCsDeferred: 12 (12)
  841. CodeGen:(Total: 268.012ms, non-child: 268.012ms, % non-child: 100.00%)
  842. - CodegenTime: 0.000ns
  843. - CompileTime: 76.003ms
  844. - LoadTime: 0.000ns
  845. - ModuleBitcodeSize: 1.95 MB (2040108)
  846. - NumFunctions: 78 (78)
  847. - NumInstructions: 2.75K (2748)
  848. - OptimizationTime: 172.007ms
  849. - PeakMemoryUsage: 1.34 MB (1406976)
  850. - PrepareTime: 20.000ms
  851. Instance 33406f6405038287:b47e1f8b00000013 (host=slave-cn04:22000):(Total: 28s745ms, non-child: 0.000ns, % non-child: 0.00%)
  852. Fragment Instance Lifecycle Event Timeline: 28s749ms
  853. - Prepare Finished: 0.000ns (0.000ns)
  854. - Open Finished: 28s745ms (28s745ms)
  855. - First Batch Produced: 28s749ms (4.000ms)
  856. - First Batch Sent: 28s749ms (0.000ns)
  857. MemoryUsage(16s000ms): 32.62 MB, 84.13 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB
  858. ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
  859. - AverageThreadTokens: 1.05
  860. - BloomFilterBytes: 2.00 MB (2097152)
  861. - PeakMemoryUsage: 126.46 MB (132605024)
  862. - PeakReservation: 114.00 MB (119537664)
  863. - PeakUsedReservation: 0
  864. - PerHostPeakMemUsage: 3.83 GB (4109447221)
  865. - RowsProduced: 15.36K (15360)
  866. - TotalNetworkReceiveTime: 28s777ms
  867. - TotalNetworkSendTime: 0.000ns
  868. - TotalStorageWaitTime: 0.000ns
  869. - TotalThreadsInvoluntaryContextSwitches: 34 (34)
  870. - TotalThreadsTotalWallClockTime: 57s187ms
  871. - TotalThreadsSysTime: 277.892ms
  872. - TotalThreadsUserTime: 649.375ms
  873. - TotalThreadsVoluntaryContextSwitches: 4.75K (4753)
  874. Buffer pool:
  875. - AllocTime: 0.000ns
  876. - CumulativeAllocationBytes: 2.00 MB (2097152)
  877. - CumulativeAllocations: 2 (2)
  878. - PeakReservation: 2.00 MB (2097152)
  879. - PeakUnpinnedBytes: 0
  880. - PeakUsedReservation: 2.00 MB (2097152)
  881. - ReadIoBytes: 0
  882. - ReadIoOps: 0 (0)
  883. - ReadIoWaitTime: 0.000ns
  884. - ReservationLimit: 2.00 MB (2097152)
  885. - WriteIoBytes: 0
  886. - WriteIoOps: 0 (0)
  887. - WriteIoWaitTime: 0.000ns
  888. Fragment Instance Lifecycle Timings:
  889. - ExecTime: 0.000ns
  890. - ExecTreeExecTime: 40.002ms
  891. - OpenTime: 28s745ms
  892. - ExecTreeOpenTime: 28s441ms
  893. - PrepareTime: 0.000ns
  894. - ExecTreePrepareTime: 0.000ns
  895. KrpcDataStreamSender (dst_id=8):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%)
  896. BytesSent(16s000ms): 0, 222.12 KB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB
  897. - EosSent: 0 (0)
  898. - NetworkThroughput: 57.61 MB/sec
  899. - PeakMemoryUsage: 3.47 KB (3552)
  900. - RowsSent: 14.34K (14336)
  901. - RpcFailure: 0 (0)
  902. - RpcRetry: 0 (0)
  903. - SerializeBatchTime: 8.000ms
  904. - TotalBytesSent: 1.16 MB (1213103)
  905. - UncompressedRowBatchSize: 1.96 MB (2058240)
  906. HASH_JOIN_NODE (id=4):(Total: 28s481ms, non-child: 452.023ms, % non-child: 1.59%)
  907. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  908. - BuildRows: 918.03K (918029)
  909. - BuildTime: 424.022ms
  910. - NumHashTableBuildsSkipped: 0 (0)
  911. - PeakMemoryUsage: 112.07 MB (117510400)
  912. - ProbeRows: 253.95K (253952)
  913. - ProbeRowsPartitioned: 0 (0)
  914. - ProbeTime: 24.001ms
  915. - RowsReturned: 15.36K (15360)
  916. - RowsReturnedRate: 539.00 /sec
  917. Buffer pool:
  918. - AllocTime: 64.003ms
  919. - CumulativeAllocationBytes: 112.00 MB (117440512)
  920. - CumulativeAllocations: 96 (96)
  921. - PeakReservation: 112.00 MB (117440512)
  922. - PeakUnpinnedBytes: 0
  923. - PeakUsedReservation: 112.00 MB (117440512)
  924. - ReadIoBytes: 0
  925. - ReadIoOps: 0 (0)
  926. - ReadIoWaitTime: 0.000ns
  927. - WriteIoBytes: 0
  928. - WriteIoOps: 0 (0)
  929. - WriteIoWaitTime: 0.000ns
  930. Hash Join Builder (join_node_id=4):
  931. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  932. Runtime filters: 2 of 2 Runtime Filters Published
  933. - BuildRowsPartitionTime: 308.016ms
  934. - BuildRowsPartitioned: 918.03K (918029)
  935. - HashBuckets: 2.10M (2097152)
  936. - HashCollisions: 0 (0)
  937. - HashTablesBuildTime: 108.005ms
  938. - LargestPartitionPercent: 6 (6)
  939. - MaxPartitionLevel: 0 (0)
  940. - NumRepartitions: 0 (0)
  941. - PartitionsCreated: 16 (16)
  942. - PeakMemoryUsage: 30.12 KB (30848)
  943. - RepartitionTime: 0.000ns
  944. - SpilledPartitions: 0 (0)
  945. EXCHANGE_NODE (id=7):(Total: 28s013ms, non-child: 56.002ms, % non-child: 0.20%)
  946. - ConvertRowBatchTime: 24.001ms
  947. - PeakMemoryUsage: 208.00 KB (212992)
  948. - RowsReturned: 918.03K (918029)
  949. - RowsReturnedRate: 32.77 K/sec
  950. Buffer pool:
  951. - AllocTime: 132.006ms
  952. - CumulativeAllocationBytes: 101.55 MB (106479616)
  953. - CumulativeAllocations: 8.67K (8668)
  954. - PeakReservation: 208.00 KB (212992)
  955. - PeakUnpinnedBytes: 0
  956. - PeakUsedReservation: 208.00 KB (212992)
  957. - ReadIoBytes: 0
  958. - ReadIoOps: 0 (0)
  959. - ReadIoWaitTime: 0.000ns
  960. - WriteIoBytes: 0
  961. - WriteIoOps: 0 (0)
  962. - WriteIoWaitTime: 0.000ns
  963. Dequeue:
  964. BytesDequeued(500.000ms): 0, 0, 0, 0, 0, 0, 0, 134.78 KB, 1.86 MB, 4.12 MB, 6.17 MB, 8.01 MB, 9.81 MB, 11.36 MB, 12.90 MB, 14.35 MB, 15.98 MB, 17.37 MB, 18.67 MB, 20.34 MB, 22.00 MB, 23.11 MB, 24.46 MB, 25.55 MB, 26.83 MB, 28.41 MB, 29.76 MB, 31.14 MB, 32.49 MB, 33.83 MB, 34.88 MB, 35.73 MB, 36.68 MB, 38.62 MB, 40.93 MB, 42.53 MB, 43.89 MB, 45.58 MB, 47.27 MB, 48.64 MB, 50.35 MB, 52.93 MB, 55.60 MB, 58.74 MB, 62.03 MB, 64.86 MB, 67.26 MB, 69.11 MB, 71.08 MB, 72.81 MB, 74.37 MB, 76.14 MB, 77.85 MB, 79.07 MB, 79.84 MB, 80.44 MB, 81.02 MB, 81.42 MB
  965. - FirstBatchWaitTime: 3s248ms
  966. - TotalBytesDequeued: 81.42 MB (85376697)
  967. - TotalGetBatchTime: 27s977ms
  968. - DataWaitTime: 27s957ms
  969. Enqueue:
  970. BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 96.66 KB, 1.34 MB, 2.96 MB, 4.44 MB, 5.77 MB, 7.07 MB, 8.18 MB, 9.29 MB, 10.33 MB, 11.51 MB, 12.52 MB, 13.46 MB, 14.66 MB, 15.86 MB, 16.66 MB, 17.64 MB, 18.42 MB, 19.35 MB, 20.49 MB, 21.47 MB, 22.46 MB, 23.44 MB, 24.40 MB, 25.16 MB, 25.77 MB, 26.47 MB, 27.87 MB, 29.54 MB, 30.70 MB, 31.67 MB, 32.90 MB, 34.12 MB, 35.12 MB, 36.35 MB, 38.21 MB, 40.14 MB, 42.41 MB, 44.79 MB, 46.84 MB, 48.58 MB, 49.91 MB, 51.34 MB, 52.59 MB, 53.72 MB, 55.00 MB, 56.23 MB, 57.11 MB, 57.66 MB, 58.10 MB, 58.52 MB, 58.81 MB
  971. DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  972. - DispatchTime: (Avg: 69.893us ; Min: 26.205us ; Max: 36.229ms ; Number of samples: 4334)
  973. - DeserializeRowBatchTime: 200.010ms
  974. - TotalBatchesEnqueued: 4.33K (4334)
  975. - TotalBatchesReceived: 4.33K (4334)
  976. - TotalBytesReceived: 58.81 MB (61662725)
  977. - TotalEarlySenders: 0 (0)
  978. - TotalEosReceived: 6 (6)
  979. - TotalHasDeferredRPCsTime: 0.000ns
  980. - TotalRPCsDeferred: 0 (0)
  981. EXCHANGE_NODE (id=6):(Total: 812.042ms, non-child: 16.000ms, % non-child: 1.97%)
  982. - ConvertRowBatchTime: 16.000ms
  983. - PeakMemoryUsage: 12.20 MB (12790542)
  984. - RowsReturned: 253.95K (253952)
  985. - RowsReturnedRate: 312.73 K/sec
  986. Buffer pool:
  987. - AllocTime: 20.001ms
  988. - CumulativeAllocationBytes: 18.56 MB (19464192)
  989. - CumulativeAllocations: 1.58K (1584)
  990. - PeakReservation: 12.20 MB (12787712)
  991. - PeakUnpinnedBytes: 0
  992. - PeakUsedReservation: 12.20 MB (12787712)
  993. - ReadIoBytes: 0
  994. - ReadIoOps: 0 (0)
  995. - ReadIoWaitTime: 0.000ns
  996. - WriteIoBytes: 0
  997. - WriteIoOps: 0 (0)
  998. - WriteIoWaitTime: 0.000ns
  999. Dequeue:
  1000. BytesDequeued(16s000ms): 18.62 KB, 1.88 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB
  1001. - FirstBatchWaitTime: 796.042ms
  1002. - TotalBytesDequeued: 9.93 MB (10412032)
  1003. - TotalGetBatchTime: 796.042ms
  1004. - DataWaitTime: 796.042ms
  1005. Enqueue:
  1006. BytesReceived(16s000ms): 4.91 MB, 5.95 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB
  1007. DeferredQueueSize(16s000ms): 3, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  1008. - DispatchTime: (Avg: 35.148us ; Min: 15.187us ; Max: 135.753us ; Number of samples: 792)
  1009. - DeserializeRowBatchTime: 24.001ms
  1010. - TotalBatchesEnqueued: 792 (792)
  1011. - TotalBatchesReceived: 792 (792)
  1012. - TotalBytesReceived: 8.25 MB (8651549)
  1013. - TotalEarlySenders: 0 (0)
  1014. - TotalEosReceived: 0 (0)
  1015. - TotalHasDeferredRPCsTime: 27s106ms
  1016. - TotalRPCsDeferred: 6 (6)
  1017. CodeGen:(Total: 296.015ms, non-child: 296.015ms, % non-child: 100.00%)
  1018. - CodegenTime: 0.000ns
  1019. - CompileTime: 80.004ms
  1020. - LoadTime: 0.000ns
  1021. - ModuleBitcodeSize: 1.95 MB (2040108)
  1022. - NumFunctions: 78 (78)
  1023. - NumInstructions: 2.75K (2748)
  1024. - OptimizationTime: 188.009ms
  1025. - PeakMemoryUsage: 1.34 MB (1406976)
  1026. - PrepareTime: 28.001ms
  1027. Instance 33406f6405038287:b47e1f8b00000015 (host=slave-cn05:22000):(Total: 28s733ms, non-child: 0.000ns, % non-child: 0.00%)
  1028. Fragment Instance Lifecycle Event Timeline: 28s737ms
  1029. - Prepare Finished: 0.000ns (0.000ns)
  1030. - Open Finished: 28s733ms (28s733ms)
  1031. - First Batch Produced: 28s737ms (4.000ms)
  1032. - First Batch Sent: 28s737ms (0.000ns)
  1033. MemoryUsage(16s000ms): 33.28 MB, 85.89 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB
  1034. ThreadUsage(16s000ms): 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
  1035. - AverageThreadTokens: 1.05
  1036. - BloomFilterBytes: 2.00 MB (2097152)
  1037. - PeakMemoryUsage: 126.41 MB (132547451)
  1038. - PeakReservation: 114.00 MB (119537664)
  1039. - PeakUsedReservation: 0
  1040. - PerHostPeakMemUsage: 3.09 GB (3313067929)
  1041. - RowsProduced: 18.43K (18432)
  1042. - TotalNetworkReceiveTime: 28s565ms
  1043. - TotalNetworkSendTime: 4.000ms
  1044. - TotalStorageWaitTime: 0.000ns
  1045. - TotalThreadsInvoluntaryContextSwitches: 27 (27)
  1046. - TotalThreadsTotalWallClockTime: 57s039ms
  1047. - TotalThreadsSysTime: 246.024ms
  1048. - TotalThreadsUserTime: 798.251ms
  1049. - TotalThreadsVoluntaryContextSwitches: 4.66K (4664)
  1050. Buffer pool:
  1051. - AllocTime: 0.000ns
  1052. - CumulativeAllocationBytes: 2.00 MB (2097152)
  1053. - CumulativeAllocations: 2 (2)
  1054. - PeakReservation: 2.00 MB (2097152)
  1055. - PeakUnpinnedBytes: 0
  1056. - PeakUsedReservation: 2.00 MB (2097152)
  1057. - ReadIoBytes: 0
  1058. - ReadIoOps: 0 (0)
  1059. - ReadIoWaitTime: 0.000ns
  1060. - ReservationLimit: 2.00 MB (2097152)
  1061. - WriteIoBytes: 0
  1062. - WriteIoOps: 0 (0)
  1063. - WriteIoWaitTime: 0.000ns
  1064. Fragment Instance Lifecycle Timings:
  1065. - ExecTime: 0.000ns
  1066. - ExecTreeExecTime: 44.002ms
  1067. - OpenTime: 28s733ms
  1068. - ExecTreeOpenTime: 28s305ms
  1069. - PrepareTime: 0.000ns
  1070. - ExecTreePrepareTime: 0.000ns
  1071. KrpcDataStreamSender (dst_id=8):(Total: 8.000ms, non-child: 4.000ms, % non-child: 50.00%)
  1072. BytesSent(16s000ms): 0, 319.11 KB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB
  1073. - EosSent: 0 (0)
  1074. - NetworkThroughput: 54.32 MB/sec
  1075. - PeakMemoryUsage: 3.47 KB (3552)
  1076. - RowsSent: 17.41K (17408)
  1077. - RpcFailure: 0 (0)
  1078. - RpcRetry: 0 (0)
  1079. - SerializeBatchTime: 4.000ms
  1080. - TotalBytesSent: 1.42 MB (1493782)
  1081. - UncompressedRowBatchSize: 2.36 MB (2469888)
  1082. HASH_JOIN_NODE (id=4):(Total: 28s349ms, non-child: 420.023ms, % non-child: 1.48%)
  1083. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  1084. - BuildRows: 919.13K (919127)
  1085. - BuildTime: 380.020ms
  1086. - NumHashTableBuildsSkipped: 0 (0)
  1087. - PeakMemoryUsage: 112.07 MB (117510400)
  1088. - ProbeRows: 305.15K (305152)
  1089. - ProbeRowsPartitioned: 0 (0)
  1090. - ProbeTime: 32.001ms
  1091. - RowsReturned: 18.43K (18432)
  1092. - RowsReturnedRate: 650.00 /sec
  1093. Buffer pool:
  1094. - AllocTime: 40.002ms
  1095. - CumulativeAllocationBytes: 112.00 MB (117440512)
  1096. - CumulativeAllocations: 96 (96)
  1097. - PeakReservation: 112.00 MB (117440512)
  1098. - PeakUnpinnedBytes: 0
  1099. - PeakUsedReservation: 112.00 MB (117440512)
  1100. - ReadIoBytes: 0
  1101. - ReadIoOps: 0 (0)
  1102. - ReadIoWaitTime: 0.000ns
  1103. - WriteIoBytes: 0
  1104. - WriteIoOps: 0 (0)
  1105. - WriteIoWaitTime: 0.000ns
  1106. Hash Join Builder (join_node_id=4):
  1107. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  1108. Runtime filters: 2 of 2 Runtime Filters Published
  1109. - BuildRowsPartitionTime: 280.015ms
  1110. - BuildRowsPartitioned: 919.13K (919127)
  1111. - HashBuckets: 2.10M (2097152)
  1112. - HashCollisions: 0 (0)
  1113. - HashTablesBuildTime: 100.005ms
  1114. - LargestPartitionPercent: 6 (6)
  1115. - MaxPartitionLevel: 0 (0)
  1116. - NumRepartitions: 0 (0)
  1117. - PartitionsCreated: 16 (16)
  1118. - PeakMemoryUsage: 30.12 KB (30848)
  1119. - RepartitionTime: 0.000ns
  1120. - SpilledPartitions: 0 (0)
  1121. EXCHANGE_NODE (id=7):(Total: 27s917ms, non-child: 40.002ms, % non-child: 0.14%)
  1122. - ConvertRowBatchTime: 24.001ms
  1123. - PeakMemoryUsage: 152.00 KB (155648)
  1124. - RowsReturned: 919.13K (919127)
  1125. - RowsReturnedRate: 32.92 K/sec
  1126. Buffer pool:
  1127. - AllocTime: 136.007ms
  1128. - CumulativeAllocationBytes: 101.67 MB (106610688)
  1129. - CumulativeAllocations: 8.68K (8678)
  1130. - PeakReservation: 152.00 KB (155648)
  1131. - PeakUnpinnedBytes: 0
  1132. - PeakUsedReservation: 152.00 KB (155648)
  1133. - ReadIoBytes: 0
  1134. - ReadIoOps: 0 (0)
  1135. - ReadIoWaitTime: 0.000ns
  1136. - WriteIoBytes: 0
  1137. - WriteIoOps: 0 (0)
  1138. - WriteIoWaitTime: 0.000ns
  1139. Dequeue:
  1140. BytesDequeued(500.000ms): 0, 0, 0, 0, 0, 0, 0, 1.33 MB, 3.44 MB, 5.49 MB, 7.56 MB, 9.34 MB, 10.98 MB, 12.39 MB, 14.05 MB, 15.47 MB, 16.92 MB, 18.31 MB, 19.80 MB, 21.60 MB, 22.81 MB, 23.94 MB, 25.12 MB, 26.57 MB, 28.00 MB, 29.41 MB, 30.80 MB, 32.21 MB, 33.60 MB, 34.65 MB, 35.59 MB, 36.53 MB, 37.96 MB, 40.31 MB, 42.40 MB, 43.57 MB, 45.26 MB, 47.04 MB, 48.57 MB, 49.88 MB, 52.37 MB, 55.09 MB, 57.94 MB, 61.33 MB, 64.30 MB, 66.78 MB, 68.66 MB, 70.75 MB, 72.50 MB, 74.08 MB, 75.79 MB, 77.56 MB, 78.98 MB, 79.75 MB, 80.35 MB, 80.99 MB, 81.48 MB
  1141. - FirstBatchWaitTime: 3s136ms
  1142. - TotalBytesDequeued: 81.52 MB (85478811)
  1143. - TotalGetBatchTime: 27s893ms
  1144. - DataWaitTime: 27s877ms
  1145. Enqueue:
  1146. BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 981.74 KB, 2.47 MB, 3.95 MB, 5.44 MB, 6.73 MB, 7.91 MB, 8.92 MB, 10.12 MB, 11.15 MB, 12.19 MB, 13.20 MB, 14.27 MB, 15.57 MB, 16.44 MB, 17.26 MB, 18.11 MB, 19.16 MB, 20.19 MB, 21.21 MB, 22.21 MB, 23.23 MB, 24.24 MB, 25.00 MB, 25.68 MB, 26.36 MB, 27.39 MB, 29.09 MB, 30.60 MB, 31.44 MB, 32.67 MB, 33.96 MB, 35.06 MB, 36.01 MB, 37.80 MB, 39.77 MB, 41.83 MB, 44.28 MB, 46.43 MB, 48.23 MB, 49.59 MB, 51.10 MB, 52.36 MB, 53.51 MB, 54.74 MB, 56.03 MB, 57.05 MB, 57.60 MB, 58.03 MB, 58.50 MB, 58.85 MB
  1147. DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  1148. - DispatchTime: (Avg: 58.734us ; Min: 23.541us ; Max: 1.155ms ; Number of samples: 4339)
  1149. - DeserializeRowBatchTime: 216.011ms
  1150. - TotalBatchesEnqueued: 4.34K (4339)
  1151. - TotalBatchesReceived: 4.34K (4339)
  1152. - TotalBytesReceived: 58.88 MB (61735185)
  1153. - TotalEarlySenders: 0 (0)
  1154. - TotalEosReceived: 6 (6)
  1155. - TotalHasDeferredRPCsTime: 0.000ns
  1156. - TotalRPCsDeferred: 0 (0)
  1157. EXCHANGE_NODE (id=6):(Total: 684.037ms, non-child: 12.000ms, % non-child: 1.75%)
  1158. - ConvertRowBatchTime: 12.000ms
  1159. - PeakMemoryUsage: 12.22 MB (12812288)
  1160. - RowsReturned: 305.15K (305152)
  1161. - RowsReturnedRate: 446.10 K/sec
  1162. Buffer pool:
  1163. - AllocTime: 4.000ms
  1164. - CumulativeAllocationBytes: 18.61 MB (19513344)
  1165. - CumulativeAllocations: 1.59K (1588)
  1166. - PeakReservation: 12.22 MB (12812288)
  1167. - PeakUnpinnedBytes: 0
  1168. - PeakUsedReservation: 12.22 MB (12812288)
  1169. - ReadIoBytes: 0
  1170. - ReadIoOps: 0 (0)
  1171. - ReadIoWaitTime: 0.000ns
  1172. - WriteIoBytes: 0
  1173. - WriteIoOps: 0 (0)
  1174. - WriteIoWaitTime: 0.000ns
  1175. Dequeue:
  1176. BytesDequeued(16s000ms): 18.62 KB, 2.63 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB
  1177. - FirstBatchWaitTime: 672.036ms
  1178. - TotalBytesDequeued: 11.95 MB (12526976)
  1179. - TotalGetBatchTime: 672.036ms
  1180. - DataWaitTime: 672.036ms
  1181. Enqueue:
  1182. BytesReceived(16s000ms): 5.02 MB, 6.05 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB
  1183. DeferredQueueSize(16s000ms): 4, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  1184. - DispatchTime: (Avg: 35.678us ; Min: 16.717us ; Max: 143.976us ; Number of samples: 794)
  1185. - DeserializeRowBatchTime: 24.001ms
  1186. - TotalBatchesEnqueued: 794 (794)
  1187. - TotalBatchesReceived: 794 (794)
  1188. - TotalBytesReceived: 8.27 MB (8672484)
  1189. - TotalEarlySenders: 0 (0)
  1190. - TotalEosReceived: 0 (0)
  1191. - TotalHasDeferredRPCsTime: 27s098ms
  1192. - TotalRPCsDeferred: 6 (6)
  1193. CodeGen:(Total: 420.023ms, non-child: 420.023ms, % non-child: 100.00%)
  1194. - CodegenTime: 0.000ns
  1195. - CompileTime: 116.006ms
  1196. - LoadTime: 0.000ns
  1197. - ModuleBitcodeSize: 1.95 MB (2040108)
  1198. - NumFunctions: 78 (78)
  1199. - NumInstructions: 2.75K (2748)
  1200. - OptimizationTime: 280.015ms
  1201. - PeakMemoryUsage: 1.34 MB (1406976)
  1202. - PrepareTime: 24.001ms
  1203. Instance 33406f6405038287:b47e1f8b00000016 (host=slave-cn07:22000):(Total: 28s725ms, non-child: 0.000ns, % non-child: 0.00%)
  1204. Fragment Instance Lifecycle Event Timeline: 28s729ms
  1205. - Prepare Finished: 0.000ns (0.000ns)
  1206. - Open Finished: 28s725ms (28s725ms)
  1207. - First Batch Produced: 28s725ms (0.000ns)
  1208. - First Batch Sent: 28s729ms (4.000ms)
  1209. MemoryUsage(16s000ms): 32.63 MB, 84.98 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB
  1210. ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
  1211. - AverageThreadTokens: 1.05
  1212. - BloomFilterBytes: 2.00 MB (2097152)
  1213. - PeakMemoryUsage: 126.37 MB (132503375)
  1214. - PeakReservation: 114.00 MB (119537664)
  1215. - PeakUsedReservation: 0
  1216. - PerHostPeakMemUsage: 2.87 GB (3082904484)
  1217. - RowsProduced: 20.48K (20480)
  1218. - TotalNetworkReceiveTime: 28s869ms
  1219. - TotalNetworkSendTime: 0.000ns
  1220. - TotalStorageWaitTime: 0.000ns
  1221. - TotalThreadsInvoluntaryContextSwitches: 7 (7)
  1222. - TotalThreadsTotalWallClockTime: 57s178ms
  1223. - TotalThreadsSysTime: 266.567ms
  1224. - TotalThreadsUserTime: 604.533ms
  1225. - TotalThreadsVoluntaryContextSwitches: 4.75K (4746)
  1226. Buffer pool:
  1227. - AllocTime: 4.000ms
  1228. - CumulativeAllocationBytes: 2.00 MB (2097152)
  1229. - CumulativeAllocations: 2 (2)
  1230. - PeakReservation: 2.00 MB (2097152)
  1231. - PeakUnpinnedBytes: 0
  1232. - PeakUsedReservation: 2.00 MB (2097152)
  1233. - ReadIoBytes: 0
  1234. - ReadIoOps: 0 (0)
  1235. - ReadIoWaitTime: 0.000ns
  1236. - ReservationLimit: 2.00 MB (2097152)
  1237. - WriteIoBytes: 0
  1238. - WriteIoOps: 0 (0)
  1239. - WriteIoWaitTime: 0.000ns
  1240. Fragment Instance Lifecycle Timings:
  1241. - ExecTime: 0.000ns
  1242. - ExecTreeExecTime: 60.002ms
  1243. - OpenTime: 28s725ms
  1244. - ExecTreeOpenTime: 28s453ms
  1245. - PrepareTime: 0.000ns
  1246. - ExecTreePrepareTime: 0.000ns
  1247. KrpcDataStreamSender (dst_id=8):(Total: 12.000ms, non-child: 12.000ms, % non-child: 100.00%)
  1248. BytesSent(16s000ms): 0, 307.50 KB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB
  1249. - EosSent: 0 (0)
  1250. - NetworkThroughput: 68.86 MB/sec
  1251. - PeakMemoryUsage: 3.47 KB (3552)
  1252. - RowsSent: 19.46K (19456)
  1253. - RpcFailure: 0 (0)
  1254. - RpcRetry: 0 (0)
  1255. - SerializeBatchTime: 12.000ms
  1256. - TotalBytesSent: 1.60 MB (1679366)
  1257. - UncompressedRowBatchSize: 2.62 MB (2744320)
  1258. HASH_JOIN_NODE (id=4):(Total: 28s513ms, non-child: 452.021ms, % non-child: 1.59%)
  1259. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  1260. - BuildRows: 919.16K (919156)
  1261. - BuildTime: 416.019ms
  1262. - NumHashTableBuildsSkipped: 0 (0)
  1263. - PeakMemoryUsage: 112.07 MB (117510400)
  1264. - ProbeRows: 335.87K (335872)
  1265. - ProbeRowsPartitioned: 0 (0)
  1266. - ProbeTime: 32.001ms
  1267. - RowsReturned: 20.48K (20480)
  1268. - RowsReturnedRate: 718.00 /sec
  1269. Buffer pool:
  1270. - AllocTime: 20.000ms
  1271. - CumulativeAllocationBytes: 112.00 MB (117440512)
  1272. - CumulativeAllocations: 96 (96)
  1273. - PeakReservation: 112.00 MB (117440512)
  1274. - PeakUnpinnedBytes: 0
  1275. - PeakUsedReservation: 112.00 MB (117440512)
  1276. - ReadIoBytes: 0
  1277. - ReadIoOps: 0 (0)
  1278. - ReadIoWaitTime: 0.000ns
  1279. - WriteIoBytes: 0
  1280. - WriteIoOps: 0 (0)
  1281. - WriteIoWaitTime: 0.000ns
  1282. Hash Join Builder (join_node_id=4):
  1283. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  1284. Runtime filters: 2 of 2 Runtime Filters Published
  1285. - BuildRowsPartitionTime: 324.015ms
  1286. - BuildRowsPartitioned: 919.16K (919156)
  1287. - HashBuckets: 2.10M (2097152)
  1288. - HashCollisions: 0 (0)
  1289. - HashTablesBuildTime: 84.004ms
  1290. - LargestPartitionPercent: 6 (6)
  1291. - MaxPartitionLevel: 0 (0)
  1292. - NumRepartitions: 0 (0)
  1293. - PartitionsCreated: 16 (16)
  1294. - PeakMemoryUsage: 30.12 KB (30848)
  1295. - RepartitionTime: 0.000ns
  1296. - SpilledPartitions: 0 (0)
  1297. EXCHANGE_NODE (id=7):(Total: 28s033ms, non-child: 24.001ms, % non-child: 0.09%)
  1298. - ConvertRowBatchTime: 8.000ms
  1299. - PeakMemoryUsage: 152.00 KB (155648)
  1300. - RowsReturned: 919.16K (919156)
  1301. - RowsReturnedRate: 32.79 K/sec
  1302. Buffer pool:
  1303. - AllocTime: 64.003ms
  1304. - CumulativeAllocationBytes: 101.66 MB (106602496)
  1305. - CumulativeAllocations: 8.68K (8678)
  1306. - PeakReservation: 152.00 KB (155648)
  1307. - PeakUnpinnedBytes: 0
  1308. - PeakUsedReservation: 152.00 KB (155648)
  1309. - ReadIoBytes: 0
  1310. - ReadIoOps: 0 (0)
  1311. - ReadIoWaitTime: 0.000ns
  1312. - WriteIoBytes: 0
  1313. - WriteIoOps: 0 (0)
  1314. - WriteIoWaitTime: 0.000ns
  1315. Dequeue:
  1316. BytesDequeued(500.000ms): 0, 0, 0, 0, 0, 0, 0, 250.30 KB, 2.11 MB, 4.44 MB, 6.47 MB, 8.18 MB, 10.06 MB, 11.51 MB, 13.01 MB, 14.40 MB, 16.13 MB, 17.49 MB, 18.77 MB, 20.59 MB, 22.17 MB, 23.20 MB, 24.58 MB, 25.74 MB, 26.94 MB, 28.60 MB, 29.97 MB, 31.33 MB, 32.68 MB, 34.03 MB, 35.03 MB, 35.84 MB, 36.85 MB, 38.96 MB, 41.31 MB, 42.78 MB, 44.13 MB, 45.93 MB, 47.55 MB, 48.87 MB, 50.79 MB, 53.38 MB, 55.97 MB, 59.17 MB, 62.46 MB, 65.24 MB, 67.59 MB, 69.48 MB, 71.43 MB, 73.14 MB, 74.76 MB, 76.53 MB, 78.17 MB, 79.28 MB, 80.02 MB, 80.60 MB, 81.19 MB, 81.52 MB
  1317. - FirstBatchWaitTime: 3s280ms
  1318. - TotalBytesDequeued: 81.52 MB (85481508)
  1319. - TotalGetBatchTime: 28s013ms
  1320. - DataWaitTime: 28s009ms
  1321. Enqueue:
  1322. BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 179.67 KB, 1.51 MB, 3.19 MB, 4.66 MB, 5.89 MB, 7.24 MB, 8.29 MB, 9.37 MB, 10.37 MB, 11.62 MB, 12.60 MB, 13.52 MB, 14.84 MB, 15.98 MB, 16.73 MB, 17.72 MB, 18.56 MB, 19.43 MB, 20.62 MB, 21.62 MB, 22.59 MB, 23.57 MB, 24.55 MB, 25.27 MB, 25.86 MB, 26.59 MB, 28.11 MB, 29.81 MB, 30.87 MB, 31.85 MB, 33.16 MB, 34.33 MB, 35.28 MB, 36.66 MB, 38.54 MB, 40.41 MB, 42.72 MB, 45.10 MB, 47.11 MB, 48.81 MB, 50.17 MB, 51.59 MB, 52.83 MB, 54.00 MB, 55.27 MB, 56.46 MB, 57.26 MB, 57.79 MB, 58.21 MB, 58.64 MB, 58.88 MB
  1323. DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  1324. - DispatchTime: (Avg: 63.851us ; Min: 22.657us ; Max: 7.040ms ; Number of samples: 4339)
  1325. - DeserializeRowBatchTime: 160.007ms
  1326. - TotalBatchesEnqueued: 4.34K (4339)
  1327. - TotalBatchesReceived: 4.34K (4339)
  1328. - TotalBytesReceived: 58.88 MB (61736546)
  1329. - TotalEarlySenders: 0 (0)
  1330. - TotalEosReceived: 6 (6)
  1331. - TotalHasDeferredRPCsTime: 0.000ns
  1332. - TotalRPCsDeferred: 0 (0)
  1333. EXCHANGE_NODE (id=6):(Total: 856.040ms, non-child: 8.000ms, % non-child: 0.93%)
  1334. - ConvertRowBatchTime: 0.000ns
  1335. - PeakMemoryUsage: 12.14 MB (12725018)
  1336. - RowsReturned: 335.87K (335872)
  1337. - RowsReturnedRate: 392.36 K/sec
  1338. Buffer pool:
  1339. - AllocTime: 8.000ms
  1340. - CumulativeAllocationBytes: 18.54 MB (19439616)
  1341. - CumulativeAllocations: 1.58K (1582)
  1342. - PeakReservation: 12.12 MB (12713984)
  1343. - PeakUnpinnedBytes: 0
  1344. - PeakUsedReservation: 12.12 MB (12713984)
  1345. - ReadIoBytes: 0
  1346. - ReadIoOps: 0 (0)
  1347. - ReadIoWaitTime: 0.000ns
  1348. - WriteIoBytes: 0
  1349. - WriteIoOps: 0 (0)
  1350. - WriteIoWaitTime: 0.000ns
  1351. Dequeue:
  1352. BytesDequeued(16s000ms): 18.62 KB, 2.48 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB
  1353. - FirstBatchWaitTime: 828.039ms
  1354. - TotalBytesDequeued: 13.15 MB (13787808)
  1355. - TotalGetBatchTime: 852.040ms
  1356. - DataWaitTime: 848.040ms
  1357. Enqueue:
  1358. BytesReceived(16s000ms): 4.91 MB, 5.93 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB
  1359. DeferredQueueSize(16s000ms): 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  1360. - DispatchTime: (Avg: 33.863us ; Min: 19.833us ; Max: 167.108us ; Number of samples: 791)
  1361. - DeserializeRowBatchTime: 16.000ms
  1362. - TotalBatchesEnqueued: 791 (791)
  1363. - TotalBatchesReceived: 791 (791)
  1364. - TotalBytesReceived: 8.24 MB (8642242)
  1365. - TotalEarlySenders: 0 (0)
  1366. - TotalEosReceived: 0 (0)
  1367. - TotalHasDeferredRPCsTime: 27s083ms
  1368. - TotalRPCsDeferred: 2 (2)
  1369. CodeGen:(Total: 264.012ms, non-child: 264.012ms, % non-child: 100.00%)
  1370. - CodegenTime: 0.000ns
  1371. - CompileTime: 76.003ms
  1372. - LoadTime: 0.000ns
  1373. - ModuleBitcodeSize: 1.95 MB (2040108)
  1374. - NumFunctions: 78 (78)
  1375. - NumInstructions: 2.75K (2748)
  1376. - OptimizationTime: 168.008ms
  1377. - PeakMemoryUsage: 1.34 MB (1406976)
  1378. - PrepareTime: 20.000ms
  1379. Instance 33406f6405038287:b47e1f8b00000014 (host=slave-cn06:22000):(Total: 28s708ms, non-child: 0.000ns, % non-child: 0.00%)
  1380. Fragment Instance Lifecycle Event Timeline: 28s712ms
  1381. - Prepare Finished: 0.000ns (0.000ns)
  1382. - Open Finished: 28s708ms (28s708ms)
  1383. - First Batch Produced: 28s712ms (4.000ms)
  1384. - First Batch Sent: 28s712ms (0.000ns)
  1385. MemoryUsage(16s000ms): 32.55 MB, 83.81 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB
  1386. ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
  1387. - AverageThreadTokens: 1.05
  1388. - BloomFilterBytes: 2.00 MB (2097152)
  1389. - PeakMemoryUsage: 126.42 MB (132561126)
  1390. - PeakReservation: 114.00 MB (119537664)
  1391. - PeakUsedReservation: 0
  1392. - PerHostPeakMemUsage: 4.27 GB (4582467103)
  1393. - RowsProduced: 20.48K (20480)
  1394. - TotalNetworkReceiveTime: 28s868ms
  1395. - TotalNetworkSendTime: 0.000ns
  1396. - TotalStorageWaitTime: 0.000ns
  1397. - TotalThreadsInvoluntaryContextSwitches: 24 (24)
  1398. - TotalThreadsTotalWallClockTime: 57s157ms
  1399. - TotalThreadsSysTime: 223.296ms
  1400. - TotalThreadsUserTime: 631.425ms
  1401. - TotalThreadsVoluntaryContextSwitches: 4.67K (4667)
  1402. Buffer pool:
  1403. - AllocTime: 0.000ns
  1404. - CumulativeAllocationBytes: 2.00 MB (2097152)
  1405. - CumulativeAllocations: 2 (2)
  1406. - PeakReservation: 2.00 MB (2097152)
  1407. - PeakUnpinnedBytes: 0
  1408. - PeakUsedReservation: 2.00 MB (2097152)
  1409. - ReadIoBytes: 0
  1410. - ReadIoOps: 0 (0)
  1411. - ReadIoWaitTime: 0.000ns
  1412. - ReservationLimit: 2.00 MB (2097152)
  1413. - WriteIoBytes: 0
  1414. - WriteIoOps: 0 (0)
  1415. - WriteIoWaitTime: 0.000ns
  1416. Fragment Instance Lifecycle Timings:
  1417. - ExecTime: 0.000ns
  1418. - ExecTreeExecTime: 72.002ms
  1419. - OpenTime: 28s708ms
  1420. - ExecTreeOpenTime: 28s448ms
  1421. - PrepareTime: 0.000ns
  1422. - ExecTreePrepareTime: 0.000ns
  1423. KrpcDataStreamSender (dst_id=8):(Total: 12.000ms, non-child: 12.000ms, % non-child: 100.00%)
  1424. BytesSent(16s000ms): 0, 307.73 KB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB
  1425. - EosSent: 0 (0)
  1426. - NetworkThroughput: 63.03 MB/sec
  1427. - PeakMemoryUsage: 3.47 KB (3552)
  1428. - RowsSent: 19.46K (19456)
  1429. - RpcFailure: 0 (0)
  1430. - RpcRetry: 0 (0)
  1431. - SerializeBatchTime: 16.000ms
  1432. - TotalBytesSent: 1.60 MB (1680613)
  1433. - UncompressedRowBatchSize: 2.62 MB (2744320)
  1434. HASH_JOIN_NODE (id=4):(Total: 28s520ms, non-child: 452.014ms, % non-child: 1.58%)
  1435. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  1436. - BuildRows: 919.29K (919287)
  1437. - BuildTime: 412.013ms
  1438. - NumHashTableBuildsSkipped: 0 (0)
  1439. - PeakMemoryUsage: 112.07 MB (117510400)
  1440. - ProbeRows: 330.75K (330752)
  1441. - ProbeRowsPartitioned: 0 (0)
  1442. - ProbeTime: 32.001ms
  1443. - RowsReturned: 20.48K (20480)
  1444. - RowsReturnedRate: 718.00 /sec
  1445. Buffer pool:
  1446. - AllocTime: 56.001ms
  1447. - CumulativeAllocationBytes: 112.00 MB (117440512)
  1448. - CumulativeAllocations: 96 (96)
  1449. - PeakReservation: 112.00 MB (117440512)
  1450. - PeakUnpinnedBytes: 0
  1451. - PeakUsedReservation: 112.00 MB (117440512)
  1452. - ReadIoBytes: 0
  1453. - ReadIoOps: 0 (0)
  1454. - ReadIoWaitTime: 0.000ns
  1455. - WriteIoBytes: 0
  1456. - WriteIoOps: 0 (0)
  1457. - WriteIoWaitTime: 0.000ns
  1458. Hash Join Builder (join_node_id=4):
  1459. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  1460. Runtime filters: 2 of 2 Runtime Filters Published
  1461. - BuildRowsPartitionTime: 336.010ms
  1462. - BuildRowsPartitioned: 919.29K (919287)
  1463. - HashBuckets: 2.10M (2097152)
  1464. - HashCollisions: 0 (0)
  1465. - HashTablesBuildTime: 72.002ms
  1466. - LargestPartitionPercent: 6 (6)
  1467. - MaxPartitionLevel: 0 (0)
  1468. - NumRepartitions: 0 (0)
  1469. - PartitionsCreated: 16 (16)
  1470. - PeakMemoryUsage: 30.12 KB (30848)
  1471. - RepartitionTime: 0.000ns
  1472. - SpilledPartitions: 0 (0)
  1473. EXCHANGE_NODE (id=7):(Total: 28s032ms, non-child: 56.001ms, % non-child: 0.20%)
  1474. - ConvertRowBatchTime: 24.000ms
  1475. - PeakMemoryUsage: 176.00 KB (180224)
  1476. - RowsReturned: 919.29K (919287)
  1477. - RowsReturnedRate: 32.79 K/sec
  1478. Buffer pool:
  1479. - AllocTime: 36.001ms
  1480. - CumulativeAllocationBytes: 101.66 MB (106602496)
  1481. - CumulativeAllocations: 8.68K (8678)
  1482. - PeakReservation: 176.00 KB (180224)
  1483. - PeakUnpinnedBytes: 0
  1484. - PeakUsedReservation: 176.00 KB (180224)
  1485. - ReadIoBytes: 0
  1486. - ReadIoOps: 0 (0)
  1487. - ReadIoWaitTime: 0.000ns
  1488. - WriteIoBytes: 0
  1489. - WriteIoOps: 0 (0)
  1490. - WriteIoWaitTime: 0.000ns
  1491. Dequeue:
  1492. BytesDequeued(500.000ms): 0, 0, 0, 0, 0, 0, 0, 19.25 KB, 1.60 MB, 3.84 MB, 5.87 MB, 7.82 MB, 9.51 MB, 11.15 MB, 12.62 MB, 14.21 MB, 15.76 MB, 17.15 MB, 18.54 MB, 20.14 MB, 21.85 MB, 22.96 MB, 24.24 MB, 25.44 MB, 26.70 MB, 28.26 MB, 29.60 MB, 31.02 MB, 32.38 MB, 33.69 MB, 34.78 MB, 35.65 MB, 36.53 MB, 38.24 MB, 40.56 MB, 42.36 MB, 43.73 MB, 45.33 MB, 47.18 MB, 48.64 MB, 50.17 MB, 52.74 MB, 55.34 MB, 58.37 MB, 61.74 MB, 64.69 MB, 67.06 MB, 69.06 MB, 71.07 MB, 72.76 MB, 74.36 MB, 76.14 MB, 77.85 MB, 79.12 MB, 79.90 MB, 80.48 MB, 81.07 MB, 81.52 MB
  1493. - FirstBatchWaitTime: 3s296ms
  1494. - TotalBytesDequeued: 81.53 MB (85493691)
  1495. - TotalGetBatchTime: 28s000ms
  1496. - DataWaitTime: 27s976ms
  1497. Enqueue:
  1498. BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 13.82 KB, 1.15 MB, 2.76 MB, 4.22 MB, 5.63 MB, 6.85 MB, 8.03 MB, 9.09 MB, 10.24 MB, 11.35 MB, 12.36 MB, 13.36 MB, 14.52 MB, 15.75 MB, 16.55 MB, 17.48 MB, 18.34 MB, 19.26 MB, 20.38 MB, 21.35 MB, 22.38 MB, 23.36 MB, 24.31 MB, 25.10 MB, 25.72 MB, 26.36 MB, 27.60 MB, 29.27 MB, 30.57 MB, 31.57 MB, 32.72 MB, 34.05 MB, 35.11 MB, 36.22 MB, 38.08 MB, 39.96 MB, 42.15 MB, 44.58 MB, 46.72 MB, 48.43 MB, 49.87 MB, 51.32 MB, 52.55 MB, 53.70 MB, 55.00 MB, 56.23 MB, 57.15 MB, 57.71 MB, 58.13 MB, 58.55 MB, 58.87 MB
  1499. DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  1500. - DispatchTime: (Avg: 65.489us ; Min: 15.162us ; Max: 27.187ms ; Number of samples: 4339)
  1501. - DeserializeRowBatchTime: 92.002ms
  1502. - TotalBatchesEnqueued: 4.34K (4339)
  1503. - TotalBatchesReceived: 4.34K (4339)
  1504. - TotalBytesReceived: 58.89 MB (61746002)
  1505. - TotalEarlySenders: 0 (0)
  1506. - TotalEosReceived: 6 (6)
  1507. - TotalHasDeferredRPCsTime: 0.000ns
  1508. - TotalRPCsDeferred: 0 (0)
  1509. EXCHANGE_NODE (id=6):(Total: 876.028ms, non-child: 8.000ms, % non-child: 0.91%)
  1510. - ConvertRowBatchTime: 8.000ms
  1511. - PeakMemoryUsage: 12.18 MB (12768856)
  1512. - RowsReturned: 330.75K (330752)
  1513. - RowsReturnedRate: 377.56 K/sec
  1514. Buffer pool:
  1515. - AllocTime: 0.000ns
  1516. - CumulativeAllocationBytes: 18.61 MB (19513344)
  1517. - CumulativeAllocations: 1.59K (1588)
  1518. - PeakReservation: 12.16 MB (12754944)
  1519. - PeakUnpinnedBytes: 0
  1520. - PeakUsedReservation: 12.16 MB (12754944)
  1521. - ReadIoBytes: 0
  1522. - ReadIoOps: 0 (0)
  1523. - ReadIoWaitTime: 0.000ns
  1524. - WriteIoBytes: 0
  1525. - WriteIoOps: 0 (0)
  1526. - WriteIoWaitTime: 0.000ns
  1527. Dequeue:
  1528. BytesDequeued(16s000ms): 18.00 KB, 2.44 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB
  1529. - FirstBatchWaitTime: 840.027ms
  1530. - TotalBytesDequeued: 12.94 MB (13564112)
  1531. - TotalGetBatchTime: 868.028ms
  1532. - DataWaitTime: 868.028ms
  1533. Enqueue:
  1534. BytesReceived(16s000ms): 4.89 MB, 5.96 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB
  1535. DeferredQueueSize(16s000ms): 4, 4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
  1536. - DispatchTime: (Avg: 36.476us ; Min: 11.753us ; Max: 164.542us ; Number of samples: 794)
  1537. - DeserializeRowBatchTime: 12.000ms
  1538. - TotalBatchesEnqueued: 794 (794)
  1539. - TotalBatchesReceived: 794 (794)
  1540. - TotalBytesReceived: 8.27 MB (8673721)
  1541. - TotalEarlySenders: 0 (0)
  1542. - TotalEosReceived: 0 (0)
  1543. - TotalHasDeferredRPCsTime: 27s073ms
  1544. - TotalRPCsDeferred: 5 (5)
  1545. CodeGen:(Total: 252.008ms, non-child: 252.008ms, % non-child: 100.00%)
  1546. - CodegenTime: 0.000ns
  1547. - CompileTime: 72.002ms
  1548. - LoadTime: 0.000ns
  1549. - ModuleBitcodeSize: 1.95 MB (2040108)
  1550. - NumFunctions: 78 (78)
  1551. - NumInstructions: 2.75K (2748)
  1552. - OptimizationTime: 160.005ms
  1553. - PeakMemoryUsage: 1.34 MB (1406976)
  1554. - PrepareTime: 20.000ms
  1555. Averaged Fragment F00:(Total: 116.005ms, non-child: 0.000ns, % non-child: 0.00%)
  1556. split sizes: min: 1.13 GB, max: 1.36 GB, avg: 1.28 GB, stddev: 82.09 MB
  1557. completion times: min:10m30s max:10m30s mean: 10m30s stddev:0.000ns
  1558. execution rates: min:1.84 MB/sec max:2.20 MB/sec mean:2.08 MB/sec stddev:133.39 KB/sec
  1559. num instances: 6
  1560. - AverageThreadTokens: 3.66
  1561. - BloomFilterBytes: 2.00 MB (2097152)
  1562. - PeakMemoryUsage: 221.67 MB (232441613)
  1563. - PeakReservation: 2.00 MB (2097152)
  1564. - PeakUsedReservation: 0
  1565. - PerHostPeakMemUsage: 3.76 GB (4033533655)
  1566. - RowsProduced: 394.99K (394992)
  1567. - TotalNetworkReceiveTime: 0.000ns
  1568. - TotalNetworkSendTime: 27s481ms
  1569. - TotalStorageWaitTime: 960.042ms
  1570. - TotalThreadsInvoluntaryContextSwitches: 2 (2)
  1571. - TotalThreadsTotalWallClockTime: 341.349ms
  1572. - TotalThreadsSysTime: 14.892ms
  1573. - TotalThreadsUserTime: 109.408ms
  1574. - TotalThreadsVoluntaryContextSwitches: 74 (74)
  1575. Buffer pool:
  1576. - AllocTime: 0.000ns
  1577. - CumulativeAllocationBytes: 2.00 MB (2097152)
  1578. - CumulativeAllocations: 2 (2)
  1579. - PeakReservation: 2.00 MB (2097152)
  1580. - PeakUnpinnedBytes: 0
  1581. - PeakUsedReservation: 2.00 MB (2097152)
  1582. - ReadIoBytes: 0
  1583. - ReadIoOps: 0 (0)
  1584. - ReadIoWaitTime: 0.000ns
  1585. - ReservationLimit: 2.00 MB (2097152)
  1586. - WriteIoBytes: 0
  1587. - WriteIoOps: 0 (0)
  1588. - WriteIoWaitTime: 0.000ns
  1589. Fragment Instance Lifecycle Timings:
  1590. - ExecTime: 0.000ns
  1591. - ExecTreeExecTime: 1s120ms
  1592. - OpenTime: 113.338ms
  1593. - ExecTreeOpenTime: 0.000ns
  1594. - PrepareTime: 2.666ms
  1595. - ExecTreePrepareTime: 666.688us
  1596. KrpcDataStreamSender (dst_id=6):(Total: 27s569ms, non-child: 27s569ms, % non-child: 100.00%)
  1597. - EosSent: 0 (0)
  1598. - NetworkThroughput: 6.68 MB/sec
  1599. - PeakMemoryUsage: 191.25 KB (195840)
  1600. - RowsSent: 393.97K (393968)
  1601. - RpcFailure: 0 (0)
  1602. - RpcRetry: 0 (0)
  1603. - SerializeBatchTime: 41.335ms
  1604. - TotalBytesSent: 8.23 MB (8628523)
  1605. - UncompressedRowBatchSize: 15.37 MB (16119669)
  1606. HDFS_SCAN_NODE (id=1):(Total: 1s122ms, non-child: 1s122ms, % non-child: 100.00%)
  1607. - AverageHdfsReadThreadConcurrency: 0.00
  1608. - AverageScannerThreadConcurrency: 2.66
  1609. - BytesRead: 178.44 MB (187103354)
  1610. - BytesReadDataNodeCache: 0
  1611. - BytesReadLocal: 0
  1612. - BytesReadRemoteUnexpected: 0
  1613. - BytesReadShortCircuit: 0
  1614. - CachedFileHandlesHitCount: 0 (0)
  1615. - CachedFileHandlesMissCount: 0 (0)
  1616. - CollectionItemsRead: 0 (0)
  1617. - DecompressionTime: 84.003ms
  1618. - MaxCompressedTextFileLength: 0
  1619. - NumColumns: 6 (6)
  1620. - NumDictFilteredRowGroups: 0 (0)
  1621. - NumDisksAccessed: 0 (0)
  1622. - NumRowGroups: 2 (2)
  1623. - NumScannerThreadsStarted: 10 (10)
  1624. - NumScannersWithNoReads: 8 (8)
  1625. - NumStatsFilteredRowGroups: 0 (0)
  1626. - PeakMemoryUsage: 219.41 MB (230072451)
  1627. - PerReadThreadRawHdfsThroughput: 175.61 MB/sec
  1628. - RemoteScanRanges: 0 (0)
  1629. - RowBatchQueueGetWaitTime: 0.000ns
  1630. - RowBatchQueuePutWaitTime: 0.000ns
  1631. - RowsRead: 1.63M (1632959)
  1632. - RowsReturned: 394.99K (394992)
  1633. - RowsReturnedRate: 359.03 K/sec
  1634. - ScanRangesComplete: 8 (8)
  1635. - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
  1636. - ScannerThreadsTotalWallClockTime: 228.010ms
  1637. - MaterializeTupleTime(*): 6.666ms
  1638. - ScannerThreadsSysTime: 6.840ms
  1639. - ScannerThreadsUserTime: 5.282ms
  1640. - ScannerThreadsVoluntaryContextSwitches: 48 (48)
  1641. - TotalRawHdfsOpenFileTime(*): 268.012ms
  1642. - TotalRawHdfsReadTime(*): 1s468ms
  1643. - TotalReadThroughput: 290.89 KB/sec
  1644. Filter 0 (1.00 MB):
  1645. - Files processed: 0 (0)
  1646. - Files rejected: 0 (0)
  1647. - Files total: 0 (0)
  1648. - RowGroups processed: 0 (0)
  1649. - RowGroups rejected: 0 (0)
  1650. - RowGroups total: 0 (0)
  1651. - Rows processed: 0 (0)
  1652. - Rows rejected: 0 (0)
  1653. - Rows total: 86.04K (86036)
  1654. - Splits processed: 0 (0)
  1655. - Splits rejected: 0 (0)
  1656. - Splits total: 0 (0)
  1657. Filter 1 (1.00 MB):
  1658. - Files processed: 0 (0)
  1659. - Files rejected: 0 (0)
  1660. - Files total: 0 (0)
  1661. - RowGroups processed: 0 (0)
  1662. - RowGroups rejected: 0 (0)
  1663. - RowGroups total: 0 (0)
  1664. - Rows processed: 0 (0)
  1665. - Rows rejected: 0 (0)
  1666. - Rows total: 86.04K (86036)
  1667. - Splits processed: 0 (0)
  1668. - Splits rejected: 0 (0)
  1669. - Splits total: 0 (0)
  1670. CodeGen:(Total: 111.338ms, non-child: 111.338ms, % non-child: 100.00%)
  1671. - CodegenTime: 4.000ms
  1672. - CompileTime: 20.000ms
  1673. - LoadTime: 0.000ns
  1674. - ModuleBitcodeSize: 1.95 MB (2040108)
  1675. - NumFunctions: 64 (64)
  1676. - NumInstructions: 1.09K (1091)
  1677. - OptimizationTime: 71.336ms
  1678. - PeakMemoryUsage: 545.50 KB (558592)
  1679. - PrepareTime: 20.000ms
  1680. Fragment F00:
  1681. Instance 33406f6405038287:b47e1f8b00000006 (host=slave-cn02:22000):(Total: 120.005ms, non-child: 0.000ns, % non-child: 0.00%)
  1682. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.36 GB
  1683. Filter 1 arrival: 28s674ms
  1684. Filter 0 arrival: 28s676ms
  1685. Fragment Instance Lifecycle Event Timeline: 1s032ms
  1686. - Prepare Finished: 4.000ms (4.000ms)
  1687. - Open Finished: 120.005ms (116.005ms)
  1688. - First Batch Produced: 1s032ms (912.042ms)
  1689. - First Batch Sent: 1s032ms (0.000ns)
  1690. MemoryUsage(16s000ms): 304.17 MB, 325.17 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB
  1691. ThreadUsage(16s000ms): 4, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5
  1692. - AverageThreadTokens: 4.99
  1693. - BloomFilterBytes: 2.00 MB (2097152)
  1694. - PeakMemoryUsage: 325.54 MB (341357839)
  1695. - PeakReservation: 2.00 MB (2097152)
  1696. - PeakUsedReservation: 0
  1697. - PerHostPeakMemUsage: 4.26 GB (4572618824)
  1698. - RowsProduced: 563.20K (563200)
  1699. - TotalNetworkReceiveTime: 0.000ns
  1700. - TotalNetworkSendTime: 27s569ms
  1701. - TotalStorageWaitTime: 668.030ms
  1702. - TotalThreadsInvoluntaryContextSwitches: 6 (6)
  1703. - TotalThreadsTotalWallClockTime: 336.015ms
  1704. - TotalThreadsSysTime: 15.648ms
  1705. - TotalThreadsUserTime: 101.151ms
  1706. - TotalThreadsVoluntaryContextSwitches: 74 (74)
  1707. Buffer pool:
  1708. - AllocTime: 0.000ns
  1709. - CumulativeAllocationBytes: 2.00 MB (2097152)
  1710. - CumulativeAllocations: 2 (2)
  1711. - PeakReservation: 2.00 MB (2097152)
  1712. - PeakUnpinnedBytes: 0
  1713. - PeakUsedReservation: 2.00 MB (2097152)
  1714. - ReadIoBytes: 0
  1715. - ReadIoOps: 0 (0)
  1716. - ReadIoWaitTime: 0.000ns
  1717. - ReservationLimit: 2.00 MB (2097152)
  1718. - WriteIoBytes: 0
  1719. - WriteIoOps: 0 (0)
  1720. - WriteIoWaitTime: 0.000ns
  1721. Fragment Instance Lifecycle Timings:
  1722. - ExecTime: 0.000ns
  1723. - ExecTreeExecTime: 1s008ms
  1724. - OpenTime: 116.005ms
  1725. - ExecTreeOpenTime: 0.000ns
  1726. - PrepareTime: 4.000ms
  1727. - ExecTreePrepareTime: 0.000ns
  1728. KrpcDataStreamSender (dst_id=6):(Total: 27s689ms, non-child: 120.005ms, % non-child: 0.43%)
  1729. BytesSent(16s000ms): 7.81 MB, 9.13 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB
  1730. - EosSent: 0 (0)
  1731. - NetworkThroughput: 6.51 MB/sec
  1732. - PeakMemoryUsage: 191.25 KB (195840)
  1733. - RowsSent: 562.18K (562176)
  1734. - RpcFailure: 0 (0)
  1735. - RpcRetry: 0 (0)
  1736. - SerializeBatchTime: 52.002ms
  1737. - TotalBytesSent: 11.79 MB (12364972)
  1738. - UncompressedRowBatchSize: 21.93 MB (23000016)
  1739. HDFS_SCAN_NODE (id=1):(Total: 1s008ms, non-child: 1s008ms, % non-child: 100.00%)
  1740. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.36 GB
  1741. ExecOption: PARQUET Codegen Enabled
  1742. Runtime filters: Not all filters arrived (arrived: [], missing [0, 1]), waited for 903ms
  1743. BytesRead(16s000ms): 244.20 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB
  1744. - FooterProcessingTime: (Avg: 30.910ms ; Min: 8.000ms ; Max: 40.001ms ; Number of samples: 11)
  1745. - AverageHdfsReadThreadConcurrency: 0.00
  1746. - AverageScannerThreadConcurrency: 3.99
  1747. - BytesRead: 261.54 MB (274245997)
  1748. - BytesReadDataNodeCache: 0
  1749. - BytesReadLocal: 0
  1750. - BytesReadRemoteUnexpected: 0
  1751. - BytesReadShortCircuit: 0
  1752. - CachedFileHandlesHitCount: 0 (0)
  1753. - CachedFileHandlesMissCount: 0 (0)
  1754. - CollectionItemsRead: 0 (0)
  1755. - DecompressionTime: 136.006ms
  1756. - MaxCompressedTextFileLength: 0
  1757. - NumColumns: 6 (6)
  1758. - NumDictFilteredRowGroups: 0 (0)
  1759. - NumDisksAccessed: 0 (0)
  1760. - NumRowGroups: 4 (4)
  1761. - NumScannerThreadsStarted: 11 (11)
  1762. - NumScannersWithNoReads: 7 (7)
  1763. - NumStatsFilteredRowGroups: 0 (0)
  1764. - PeakMemoryUsage: 323.27 MB (338978096)
  1765. - PerReadThreadRawHdfsThroughput: 510.80 MB/sec
  1766. - RemoteScanRanges: 0 (0)
  1767. - RowBatchQueueGetWaitTime: 0.000ns
  1768. - RowBatchQueuePutWaitTime: 0.000ns
  1769. - RowsRead: 2.26M (2255872)
  1770. - RowsReturned: 563.20K (563200)
  1771. - RowsReturnedRate: 558.70 K/sec
  1772. - ScanRangesComplete: 7 (7)
  1773. - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
  1774. - ScannerThreadsTotalWallClockTime: 220.010ms
  1775. - MaterializeTupleTime(*): 0.000ns
  1776. - ScannerThreadsSysTime: 2.179ms
  1777. - ScannerThreadsUserTime: 0.000ns
  1778. - ScannerThreadsVoluntaryContextSwitches: 34 (34)
  1779. - TotalRawHdfsOpenFileTime(*): 356.016ms
  1780. - TotalRawHdfsReadTime(*): 512.023ms
  1781. - TotalReadThroughput: 425.78 KB/sec
  1782. Filter 0 (1.00 MB):
  1783. - Files processed: 0 (0)
  1784. - Files rejected: 0 (0)
  1785. - Files total: 0 (0)
  1786. - RowGroups processed: 0 (0)
  1787. - RowGroups rejected: 0 (0)
  1788. - RowGroups total: 0 (0)
  1789. - Rows processed: 0 (0)
  1790. - Rows rejected: 0 (0)
  1791. - Rows total: 0 (0)
  1792. - Splits processed: 0 (0)
  1793. - Splits rejected: 0 (0)
  1794. - Splits total: 0 (0)
  1795. Filter 1 (1.00 MB):
  1796. - Files processed: 0 (0)
  1797. - Files rejected: 0 (0)
  1798. - Files total: 0 (0)
  1799. - RowGroups processed: 0 (0)
  1800. - RowGroups rejected: 0 (0)
  1801. - RowGroups total: 0 (0)
  1802. - Rows processed: 0 (0)
  1803. - Rows rejected: 0 (0)
  1804. - Rows total: 0 (0)
  1805. - Splits processed: 0 (0)
  1806. - Splits rejected: 0 (0)
  1807. - Splits total: 0 (0)
  1808. CodeGen:(Total: 112.005ms, non-child: 112.005ms, % non-child: 100.00%)
  1809. - CodegenTime: 4.000ms
  1810. - CompileTime: 20.000ms
  1811. - LoadTime: 0.000ns
  1812. - ModuleBitcodeSize: 1.95 MB (2040108)
  1813. - NumFunctions: 64 (64)
  1814. - NumInstructions: 1.09K (1091)
  1815. - OptimizationTime: 72.003ms
  1816. - PeakMemoryUsage: 545.50 KB (558592)
  1817. - PrepareTime: 20.000ms
  1818. Instance 33406f6405038287:b47e1f8b00000001 (host=slave-cn04:22000):(Total: 116.006ms, non-child: 0.000ns, % non-child: 0.00%)
  1819. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.28 GB
  1820. Filter 1 arrival: 28s692ms
  1821. Filter 0 arrival: 28s695ms
  1822. Fragment Instance Lifecycle Event Timeline: 1s048ms
  1823. - Prepare Finished: 4.000ms (4.000ms)
  1824. - Open Finished: 116.006ms (112.005ms)
  1825. - First Batch Produced: 1s048ms (932.049ms)
  1826. - First Batch Sent: 1s048ms (0.000ns)
  1827. MemoryUsage(16s000ms): 151.15 MB, 165.49 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB
  1828. ThreadUsage(16s000ms): 2, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3
  1829. - AverageThreadTokens: 3.00
  1830. - BloomFilterBytes: 2.00 MB (2097152)
  1831. - PeakMemoryUsage: 165.73 MB (173783236)
  1832. - PeakReservation: 2.00 MB (2097152)
  1833. - PeakUsedReservation: 0
  1834. - PerHostPeakMemUsage: 3.83 GB (4109447221)
  1835. - RowsProduced: 357.38K (357376)
  1836. - TotalNetworkReceiveTime: 0.000ns
  1837. - TotalNetworkSendTime: 27s393ms
  1838. - TotalStorageWaitTime: 840.044ms
  1839. - TotalThreadsInvoluntaryContextSwitches: 2 (2)
  1840. - TotalThreadsTotalWallClockTime: 300.015ms
  1841. - TotalThreadsSysTime: 8.675ms
  1842. - TotalThreadsUserTime: 105.768ms
  1843. - TotalThreadsVoluntaryContextSwitches: 63 (63)
  1844. Buffer pool:
  1845. - AllocTime: 0.000ns
  1846. - CumulativeAllocationBytes: 2.00 MB (2097152)
  1847. - CumulativeAllocations: 2 (2)
  1848. - PeakReservation: 2.00 MB (2097152)
  1849. - PeakUnpinnedBytes: 0
  1850. - PeakUsedReservation: 2.00 MB (2097152)
  1851. - ReadIoBytes: 0
  1852. - ReadIoOps: 0 (0)
  1853. - ReadIoWaitTime: 0.000ns
  1854. - ReservationLimit: 2.00 MB (2097152)
  1855. - WriteIoBytes: 0
  1856. - WriteIoOps: 0 (0)
  1857. - WriteIoWaitTime: 0.000ns
  1858. Fragment Instance Lifecycle Timings:
  1859. - ExecTime: 0.000ns
  1860. - ExecTreeExecTime: 1s216ms
  1861. - OpenTime: 112.005ms
  1862. - ExecTreeOpenTime: 0.000ns
  1863. - PrepareTime: 4.000ms
  1864. - ExecTreePrepareTime: 0.000ns
  1865. KrpcDataStreamSender (dst_id=6):(Total: 27s477ms, non-child: 84.004ms, % non-child: 0.31%)
  1866. BytesSent(16s000ms): 3.92 MB, 4.92 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB
  1867. - EosSent: 0 (0)
  1868. - NetworkThroughput: 7.94 MB/sec
  1869. - PeakMemoryUsage: 191.25 KB (195840)
  1870. - RowsSent: 356.35K (356352)
  1871. - RpcFailure: 0 (0)
  1872. - RpcRetry: 0 (0)
  1873. - SerializeBatchTime: 32.001ms
  1874. - TotalBytesSent: 7.42 MB (7780682)
  1875. - UncompressedRowBatchSize: 13.89 MB (14560576)
  1876. HDFS_SCAN_NODE (id=1):(Total: 1s216ms, non-child: 1s216ms, % non-child: 100.00%)
  1877. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.28 GB
  1878. ExecOption: PARQUET Codegen Enabled
  1879. Runtime filters: Not all filters arrived (arrived: [], missing [0, 1]), waited for 924ms
  1880. BytesRead(16s000ms): 118.15 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB
  1881. - FooterProcessingTime: (Avg: 15.273ms ; Min: 4.000ms ; Max: 28.001ms ; Number of samples: 11)
  1882. - AverageHdfsReadThreadConcurrency: 0.00
  1883. - AverageScannerThreadConcurrency: 2.00
  1884. - BytesRead: 130.44 MB (136778416)
  1885. - BytesReadDataNodeCache: 0
  1886. - BytesReadLocal: 0
  1887. - BytesReadRemoteUnexpected: 0
  1888. - BytesReadShortCircuit: 0
  1889. - CachedFileHandlesHitCount: 0 (0)
  1890. - CachedFileHandlesMissCount: 0 (0)
  1891. - CollectionItemsRead: 0 (0)
  1892. - DecompressionTime: 84.004ms
  1893. - MaxCompressedTextFileLength: 0
  1894. - NumColumns: 6 (6)
  1895. - NumDictFilteredRowGroups: 0 (0)
  1896. - NumDisksAccessed: 0 (0)
  1897. - NumRowGroups: 2 (2)
  1898. - NumScannerThreadsStarted: 11 (11)
  1899. - NumScannersWithNoReads: 9 (9)
  1900. - NumStatsFilteredRowGroups: 0 (0)
  1901. - PeakMemoryUsage: 163.49 MB (171436261)
  1902. - PerReadThreadRawHdfsThroughput: 94.52 MB/sec
  1903. - RemoteScanRanges: 0 (0)
  1904. - RowBatchQueueGetWaitTime: 0.000ns
  1905. - RowBatchQueuePutWaitTime: 0.000ns
  1906. - RowsRead: 1.48M (1480704)
  1907. - RowsReturned: 357.38K (357376)
  1908. - RowsReturnedRate: 293.88 K/sec
  1909. - ScanRangesComplete: 9 (9)
  1910. - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
  1911. - ScannerThreadsTotalWallClockTime: 188.009ms
  1912. - MaterializeTupleTime(*): 0.000ns
  1913. - ScannerThreadsSysTime: 2.482ms
  1914. - ScannerThreadsUserTime: 0.000ns
  1915. - ScannerThreadsVoluntaryContextSwitches: 42 (42)
  1916. - TotalRawHdfsOpenFileTime(*): 216.011ms
  1917. - TotalRawHdfsReadTime(*): 1s380ms
  1918. - TotalReadThroughput: 212.36 KB/sec
  1919. Filter 0 (1.00 MB):
  1920. - Files processed: 0 (0)
  1921. - Files rejected: 0 (0)
  1922. - Files total: 0 (0)
  1923. - RowGroups processed: 0 (0)
  1924. - RowGroups rejected: 0 (0)
  1925. - RowGroups total: 0 (0)
  1926. - Rows processed: 0 (0)
  1927. - Rows rejected: 0 (0)
  1928. - Rows total: 0 (0)
  1929. - Splits processed: 0 (0)
  1930. - Splits rejected: 0 (0)
  1931. - Splits total: 0 (0)
  1932. Filter 1 (1.00 MB):
  1933. - Files processed: 0 (0)
  1934. - Files rejected: 0 (0)
  1935. - Files total: 0 (0)
  1936. - RowGroups processed: 0 (0)
  1937. - RowGroups rejected: 0 (0)
  1938. - RowGroups total: 0 (0)
  1939. - Rows processed: 0 (0)
  1940. - Rows rejected: 0 (0)
  1941. - Rows total: 0 (0)
  1942. - Splits processed: 0 (0)
  1943. - Splits rejected: 0 (0)
  1944. - Splits total: 0 (0)
  1945. CodeGen:(Total: 112.005ms, non-child: 112.005ms, % non-child: 100.00%)
  1946. - CodegenTime: 4.000ms
  1947. - CompileTime: 20.001ms
  1948. - LoadTime: 0.000ns
  1949. - ModuleBitcodeSize: 1.95 MB (2040108)
  1950. - NumFunctions: 64 (64)
  1951. - NumInstructions: 1.09K (1091)
  1952. - OptimizationTime: 72.003ms
  1953. - PeakMemoryUsage: 545.50 KB (558592)
  1954. - PrepareTime: 20.001ms
  1955. Instance 33406f6405038287:b47e1f8b00000004 (host=slave-cn07:22000):(Total: 116.005ms, non-child: 0.000ns, % non-child: 0.00%)
  1956. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/1.23 GB
  1957. Filter 1 arrival: 28s723ms
  1958. Filter 0 arrival: 28s726ms
  1959. Fragment Instance Lifecycle Event Timeline: 1s052ms
  1960. - Prepare Finished: 4.000ms (4.000ms)
  1961. - Open Finished: 116.005ms (112.005ms)
  1962. - First Batch Produced: 1s052ms (936.044ms)
  1963. - First Batch Sent: 1s052ms (0.000ns)
  1964. MemoryUsage(16s000ms): 78.91 MB, 85.56 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB
  1965. ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2
  1966. - AverageThreadTokens: 2.00
  1967. - BloomFilterBytes: 2.00 MB (2097152)
  1968. - PeakMemoryUsage: 85.69 MB (89853512)
  1969. - PeakReservation: 2.00 MB (2097152)
  1970. - PeakUsedReservation: 0
  1971. - PerHostPeakMemUsage: 2.87 GB (3082904484)
  1972. - RowsProduced: 381.95K (381952)
  1973. - TotalNetworkReceiveTime: 0.000ns
  1974. - TotalNetworkSendTime: 27s397ms
  1975. - TotalStorageWaitTime: 428.020ms
  1976. - TotalThreadsInvoluntaryContextSwitches: 2 (2)
  1977. - TotalThreadsTotalWallClockTime: 300.014ms
  1978. - TotalThreadsSysTime: 11.589ms
  1979. - TotalThreadsUserTime: 101.183ms
  1980. - TotalThreadsVoluntaryContextSwitches: 66 (66)
  1981. Buffer pool:
  1982. - AllocTime: 0.000ns
  1983. - CumulativeAllocationBytes: 2.00 MB (2097152)
  1984. - CumulativeAllocations: 2 (2)
  1985. - PeakReservation: 2.00 MB (2097152)
  1986. - PeakUnpinnedBytes: 0
  1987. - PeakUsedReservation: 2.00 MB (2097152)
  1988. - ReadIoBytes: 0
  1989. - ReadIoOps: 0 (0)
  1990. - ReadIoWaitTime: 0.000ns
  1991. - ReservationLimit: 2.00 MB (2097152)
  1992. - WriteIoBytes: 0
  1993. - WriteIoOps: 0 (0)
  1994. - WriteIoWaitTime: 0.000ns
  1995. Fragment Instance Lifecycle Timings:
  1996. - ExecTime: 0.000ns
  1997. - ExecTreeExecTime: 1s200ms
  1998. - OpenTime: 112.005ms
  1999. - ExecTreeOpenTime: 0.000ns
  2000. - PrepareTime: 4.000ms
  2001. - ExecTreePrepareTime: 0.000ns
  2002. KrpcDataStreamSender (dst_id=6):(Total: 27s485ms, non-child: 88.004ms, % non-child: 0.32%)
  2003. BytesSent(16s000ms): 4.72 MB, 5.72 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB
  2004. - EosSent: 0 (0)
  2005. - NetworkThroughput: 8.88 MB/sec
  2006. - PeakMemoryUsage: 191.25 KB (195840)
  2007. - RowsSent: 380.93K (380928)
  2008. - RpcFailure: 0 (0)
  2009. - RpcRetry: 0 (0)
  2010. - SerializeBatchTime: 40.001ms
  2011. - TotalBytesSent: 7.95 MB (8332124)
  2012. - UncompressedRowBatchSize: 14.88 MB (15597712)
  2013. HDFS_SCAN_NODE (id=1):(Total: 1s200ms, non-child: 1s200ms, % non-child: 100.00%)
  2014. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/1.23 GB
  2015. ExecOption: PARQUET Codegen Enabled
  2016. Runtime filters: Not all filters arrived (arrived: [], missing [0, 1]), waited for 923ms
  2017. BytesRead(16s000ms): 66.15 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB
  2018. - FooterProcessingTime: (Avg: 18.800ms ; Min: 8.000ms ; Max: 28.001ms ; Number of samples: 10)
  2019. - AverageHdfsReadThreadConcurrency: 0.00
  2020. - AverageScannerThreadConcurrency: 1.00
  2021. - BytesRead: 72.59 MB (76118323)
  2022. - BytesReadDataNodeCache: 0
  2023. - BytesReadLocal: 0
  2024. - BytesReadRemoteUnexpected: 0
  2025. - BytesReadShortCircuit: 0
  2026. - CachedFileHandlesHitCount: 0 (0)
  2027. - CachedFileHandlesMissCount: 0 (0)
  2028. - CollectionItemsRead: 0 (0)
  2029. - DecompressionTime: 48.002ms
  2030. - MaxCompressedTextFileLength: 0
  2031. - NumColumns: 6 (6)
  2032. - NumDictFilteredRowGroups: 0 (0)
  2033. - NumDisksAccessed: 0 (0)
  2034. - NumRowGroups: 1 (1)
  2035. - NumScannerThreadsStarted: 10 (10)
  2036. - NumScannersWithNoReads: 9 (9)
  2037. - NumStatsFilteredRowGroups: 0 (0)
  2038. - PeakMemoryUsage: 83.47 MB (87522921)
  2039. - PerReadThreadRawHdfsThroughput: 115.59 MB/sec
  2040. - RemoteScanRanges: 0 (0)
  2041. - RowBatchQueueGetWaitTime: 0.000ns
  2042. - RowBatchQueuePutWaitTime: 0.000ns
  2043. - RowsRead: 1.57M (1572864)
  2044. - RowsReturned: 381.95K (381952)
  2045. - RowsReturnedRate: 318.28 K/sec
  2046. - ScanRangesComplete: 9 (9)
  2047. - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
  2048. - ScannerThreadsTotalWallClockTime: 188.008ms
  2049. - MaterializeTupleTime(*): 0.000ns
  2050. - ScannerThreadsSysTime: 1.776ms
  2051. - ScannerThreadsUserTime: 221.000us
  2052. - ScannerThreadsVoluntaryContextSwitches: 41 (41)
  2053. - TotalRawHdfsOpenFileTime(*): 196.009ms
  2054. - TotalRawHdfsReadTime(*): 628.029ms
  2055. - TotalReadThroughput: 118.93 KB/sec
  2056. Filter 0 (1.00 MB):
  2057. - Files processed: 0 (0)
  2058. - Files rejected: 0 (0)
  2059. - Files total: 0 (0)
  2060. - RowGroups processed: 0 (0)
  2061. - RowGroups rejected: 0 (0)
  2062. - RowGroups total: 0 (0)
  2063. - Rows processed: 0 (0)
  2064. - Rows rejected: 0 (0)
  2065. - Rows total: 0 (0)
  2066. - Splits processed: 0 (0)
  2067. - Splits rejected: 0 (0)
  2068. - Splits total: 0 (0)
  2069. Filter 1 (1.00 MB):
  2070. - Files processed: 0 (0)
  2071. - Files rejected: 0 (0)
  2072. - Files total: 0 (0)
  2073. - RowGroups processed: 0 (0)
  2074. - RowGroups rejected: 0 (0)
  2075. - RowGroups total: 0 (0)
  2076. - Rows processed: 0 (0)
  2077. - Rows rejected: 0 (0)
  2078. - Rows total: 0 (0)
  2079. - Splits processed: 0 (0)
  2080. - Splits rejected: 0 (0)
  2081. - Splits total: 0 (0)
  2082. CodeGen:(Total: 108.005ms, non-child: 108.005ms, % non-child: 100.00%)
  2083. - CodegenTime: 4.000ms
  2084. - CompileTime: 20.000ms
  2085. - LoadTime: 0.000ns
  2086. - ModuleBitcodeSize: 1.95 MB (2040108)
  2087. - NumFunctions: 64 (64)
  2088. - NumInstructions: 1.09K (1091)
  2089. - OptimizationTime: 72.003ms
  2090. - PeakMemoryUsage: 545.50 KB (558592)
  2091. - PrepareTime: 16.000ms
  2092. Instance 33406f6405038287:b47e1f8b00000005 (host=slave-cn03:22000):(Total: 116.005ms, non-child: 0.000ns, % non-child: 0.00%)
  2093. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.13 GB
  2094. Filter 1 arrival: 28s683ms
  2095. Filter 0 arrival: 28s685ms
  2096. Fragment Instance Lifecycle Event Timeline: 1s036ms
  2097. - Prepare Finished: 4.000ms (4.000ms)
  2098. - Open Finished: 120.005ms (116.005ms)
  2099. - First Batch Produced: 1s036ms (916.041ms)
  2100. - First Batch Sent: 1s036ms (0.000ns)
  2101. MemoryUsage(16s000ms): 301.68 MB, 331.09 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB
  2102. ThreadUsage(16s000ms): 4, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5
  2103. - AverageThreadTokens: 4.99
  2104. - BloomFilterBytes: 2.00 MB (2097152)
  2105. - PeakMemoryUsage: 331.54 MB (347647974)
  2106. - PeakReservation: 2.00 MB (2097152)
  2107. - PeakUsedReservation: 0
  2108. - PerHostPeakMemUsage: 4.23 GB (4540696369)
  2109. - RowsProduced: 416.16K (416161)
  2110. - TotalNetworkReceiveTime: 0.000ns
  2111. - TotalNetworkSendTime: 27s613ms
  2112. - TotalStorageWaitTime: 1s904ms
  2113. - TotalThreadsInvoluntaryContextSwitches: 2 (2)
  2114. - TotalThreadsTotalWallClockTime: 552.025ms
  2115. - TotalThreadsSysTime: 39.007ms
  2116. - TotalThreadsUserTime: 134.341ms
  2117. - TotalThreadsVoluntaryContextSwitches: 86 (86)
  2118. Buffer pool:
  2119. - AllocTime: 0.000ns
  2120. - CumulativeAllocationBytes: 2.00 MB (2097152)
  2121. - CumulativeAllocations: 2 (2)
  2122. - PeakReservation: 2.00 MB (2097152)
  2123. - PeakUnpinnedBytes: 0
  2124. - PeakUsedReservation: 2.00 MB (2097152)
  2125. - ReadIoBytes: 0
  2126. - ReadIoOps: 0 (0)
  2127. - ReadIoWaitTime: 0.000ns
  2128. - ReservationLimit: 2.00 MB (2097152)
  2129. - WriteIoBytes: 0
  2130. - WriteIoOps: 0 (0)
  2131. - WriteIoWaitTime: 0.000ns
  2132. Fragment Instance Lifecycle Timings:
  2133. - ExecTime: 0.000ns
  2134. - ExecTreeExecTime: 976.044ms
  2135. - OpenTime: 116.005ms
  2136. - ExecTreeOpenTime: 0.000ns
  2137. - PrepareTime: 0.000ns
  2138. - ExecTreePrepareTime: 0.000ns
  2139. KrpcDataStreamSender (dst_id=6):(Total: 27s709ms, non-child: 96.004ms, % non-child: 0.35%)
  2140. BytesSent(16s000ms): 5.84 MB, 6.86 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB
  2141. - EosSent: 0 (0)
  2142. - NetworkThroughput: 4.32 MB/sec
  2143. - PeakMemoryUsage: 191.25 KB (195840)
  2144. - RowsSent: 415.14K (415137)
  2145. - RpcFailure: 0 (0)
  2146. - RpcRetry: 0 (0)
  2147. - SerializeBatchTime: 36.001ms
  2148. - TotalBytesSent: 8.68 MB (9101183)
  2149. - UncompressedRowBatchSize: 16.21 MB (17000896)
  2150. HDFS_SCAN_NODE (id=1):(Total: 976.044ms, non-child: 976.044ms, % non-child: 100.00%)
  2151. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.13 GB
  2152. ExecOption: PARQUET Codegen Enabled
  2153. Runtime filters: Not all filters arrived (arrived: [], missing [0, 1]), waited for 903ms
  2154. BytesRead(16s000ms): 242.40 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB
  2155. - FooterProcessingTime: (Avg: 26.910ms ; Min: 12.000ms ; Max: 44.002ms ; Number of samples: 11)
  2156. - AverageHdfsReadThreadConcurrency: 0.01
  2157. - AverageScannerThreadConcurrency: 4.00
  2158. - BytesRead: 268.32 MB (281349378)
  2159. - BytesReadDataNodeCache: 0
  2160. - BytesReadLocal: 0
  2161. - BytesReadRemoteUnexpected: 0
  2162. - BytesReadShortCircuit: 0
  2163. - CachedFileHandlesHitCount: 0 (0)
  2164. - CachedFileHandlesMissCount: 0 (0)
  2165. - CollectionItemsRead: 0 (0)
  2166. - DecompressionTime: 80.003ms
  2167. - MaxCompressedTextFileLength: 0
  2168. - NumColumns: 6 (6)
  2169. - NumDictFilteredRowGroups: 0 (0)
  2170. - NumDisksAccessed: 0 (0)
  2171. - NumRowGroups: 5 (5)
  2172. - NumScannerThreadsStarted: 11 (11)
  2173. - NumScannersWithNoReads: 6 (6)
  2174. - NumStatsFilteredRowGroups: 0 (0)
  2175. - PeakMemoryUsage: 329.25 MB (345242631)
  2176. - PerReadThreadRawHdfsThroughput: 86.33 MB/sec
  2177. - RemoteScanRanges: 0 (0)
  2178. - RowBatchQueueGetWaitTime: 0.000ns
  2179. - RowBatchQueuePutWaitTime: 0.000ns
  2180. - RowsRead: 1.72M (1721466)
  2181. - RowsReturned: 416.16K (416161)
  2182. - RowsReturnedRate: 426.38 K/sec
  2183. - ScanRangesComplete: 7 (7)
  2184. - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
  2185. - ScannerThreadsTotalWallClockTime: 436.019ms
  2186. - MaterializeTupleTime(*): 40.001ms
  2187. - ScannerThreadsSysTime: 29.060ms
  2188. - ScannerThreadsUserTime: 30.960ms
  2189. - ScannerThreadsVoluntaryContextSwitches: 72 (72)
  2190. - TotalRawHdfsOpenFileTime(*): 404.018ms
  2191. - TotalRawHdfsReadTime(*): 3s108ms
  2192. - TotalReadThroughput: 438.21 KB/sec
  2193. Filter 0 (1.00 MB):
  2194. - Files processed: 0 (0)
  2195. - Files rejected: 0 (0)
  2196. - Files total: 0 (0)
  2197. - RowGroups processed: 0 (0)
  2198. - RowGroups rejected: 0 (0)
  2199. - RowGroups total: 0 (0)
  2200. - Rows processed: 0 (0)
  2201. - Rows rejected: 0 (0)
  2202. - Rows total: 516.22K (516218)
  2203. - Splits processed: 0 (0)
  2204. - Splits rejected: 0 (0)
  2205. - Splits total: 0 (0)
  2206. Filter 1 (1.00 MB):
  2207. - Files processed: 0 (0)
  2208. - Files rejected: 0 (0)
  2209. - Files total: 0 (0)
  2210. - RowGroups processed: 0 (0)
  2211. - RowGroups rejected: 0 (0)
  2212. - RowGroups total: 0 (0)
  2213. - Rows processed: 0 (0)
  2214. - Rows rejected: 0 (0)
  2215. - Rows total: 516.22K (516218)
  2216. - Splits processed: 0 (0)
  2217. - Splits rejected: 0 (0)
  2218. - Splits total: 0 (0)
  2219. CodeGen:(Total: 116.005ms, non-child: 116.005ms, % non-child: 100.00%)
  2220. - CodegenTime: 4.000ms
  2221. - CompileTime: 20.000ms
  2222. - LoadTime: 0.000ns
  2223. - ModuleBitcodeSize: 1.95 MB (2040108)
  2224. - NumFunctions: 64 (64)
  2225. - NumInstructions: 1.09K (1091)
  2226. - OptimizationTime: 72.003ms
  2227. - PeakMemoryUsage: 545.50 KB (558592)
  2228. - PrepareTime: 24.001ms
  2229. Instance 33406f6405038287:b47e1f8b00000002 (host=slave-cn06:22000):(Total: 116.003ms, non-child: 0.000ns, % non-child: 0.00%)
  2230. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.35 GB
  2231. Filter 1 arrival: 28s713ms
  2232. Filter 0 arrival: 28s716ms
  2233. Fragment Instance Lifecycle Event Timeline: 1s048ms
  2234. - Prepare Finished: 4.000ms (4.000ms)
  2235. - Open Finished: 116.003ms (112.003ms)
  2236. - First Batch Produced: 1s048ms (932.030ms)
  2237. - First Batch Sent: 1s048ms (0.000ns)
  2238. MemoryUsage(16s000ms): 301.62 MB, 330.93 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB
  2239. ThreadUsage(16s000ms): 4, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5
  2240. - AverageThreadTokens: 4.99
  2241. - BloomFilterBytes: 2.00 MB (2097152)
  2242. - PeakMemoryUsage: 331.59 MB (347696049)
  2243. - PeakReservation: 2.00 MB (2097152)
  2244. - PeakUsedReservation: 0
  2245. - PerHostPeakMemUsage: 4.27 GB (4582467103)
  2246. - RowsProduced: 261.12K (261120)
  2247. - TotalNetworkReceiveTime: 0.000ns
  2248. - TotalNetworkSendTime: 27s504ms
  2249. - TotalStorageWaitTime: 1s544ms
  2250. - TotalThreadsInvoluntaryContextSwitches: 1 (1)
  2251. - TotalThreadsTotalWallClockTime: 208.006ms
  2252. - TotalThreadsSysTime: 8.499ms
  2253. - TotalThreadsUserTime: 104.556ms
  2254. - TotalThreadsVoluntaryContextSwitches: 62 (62)
  2255. Buffer pool:
  2256. - AllocTime: 0.000ns
  2257. - CumulativeAllocationBytes: 2.00 MB (2097152)
  2258. - CumulativeAllocations: 2 (2)
  2259. - PeakReservation: 2.00 MB (2097152)
  2260. - PeakUnpinnedBytes: 0
  2261. - PeakUsedReservation: 2.00 MB (2097152)
  2262. - ReadIoBytes: 0
  2263. - ReadIoOps: 0 (0)
  2264. - ReadIoWaitTime: 0.000ns
  2265. - ReservationLimit: 2.00 MB (2097152)
  2266. - WriteIoBytes: 0
  2267. - WriteIoOps: 0 (0)
  2268. - WriteIoWaitTime: 0.000ns
  2269. Fragment Instance Lifecycle Timings:
  2270. - ExecTime: 0.000ns
  2271. - ExecTreeExecTime: 1s136ms
  2272. - OpenTime: 112.003ms
  2273. - ExecTreeOpenTime: 0.000ns
  2274. - PrepareTime: 4.000ms
  2275. - ExecTreePrepareTime: 4.000ms
  2276. KrpcDataStreamSender (dst_id=6):(Total: 27s560ms, non-child: 56.001ms, % non-child: 0.20%)
  2277. BytesSent(16s000ms): 2.15 MB, 2.95 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB
  2278. - EosSent: 0 (0)
  2279. - NetworkThroughput: 4.77 MB/sec
  2280. - PeakMemoryUsage: 191.25 KB (195840)
  2281. - RowsSent: 260.10K (260096)
  2282. - RpcFailure: 0 (0)
  2283. - RpcRetry: 0 (0)
  2284. - SerializeBatchTime: 44.001ms
  2285. - TotalBytesSent: 5.43 MB (5693315)
  2286. - UncompressedRowBatchSize: 10.16 MB (10656064)
  2287. HDFS_SCAN_NODE (id=1):(Total: 1s148ms, non-child: 1s148ms, % non-child: 100.00%)
  2288. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.35 GB
  2289. ExecOption: PARQUET Codegen Enabled
  2290. Runtime filters: Not all filters arrived (arrived: [], missing [0, 1]), waited for 923ms
  2291. BytesRead(16s000ms): 238.17 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB
  2292. - FooterProcessingTime: (Avg: 10.909ms ; Min: 4.000ms ; Max: 24.000ms ; Number of samples: 11)
  2293. - AverageHdfsReadThreadConcurrency: 0.01
  2294. - AverageScannerThreadConcurrency: 4.00
  2295. - BytesRead: 263.05 MB (275825498)
  2296. - BytesReadDataNodeCache: 0
  2297. - BytesReadLocal: 0
  2298. - BytesReadRemoteUnexpected: 0
  2299. - BytesReadShortCircuit: 0
  2300. - CachedFileHandlesHitCount: 0 (0)
  2301. - CachedFileHandlesMissCount: 0 (0)
  2302. - CollectionItemsRead: 0 (0)
  2303. - DecompressionTime: 84.002ms
  2304. - MaxCompressedTextFileLength: 0
  2305. - NumColumns: 6 (6)
  2306. - NumDictFilteredRowGroups: 0 (0)
  2307. - NumDisksAccessed: 0 (0)
  2308. - NumRowGroups: 4 (4)
  2309. - NumScannerThreadsStarted: 11 (11)
  2310. - NumScannersWithNoReads: 7 (7)
  2311. - NumStatsFilteredRowGroups: 0 (0)
  2312. - PeakMemoryUsage: 329.33 MB (345331666)
  2313. - PerReadThreadRawHdfsThroughput: 98.30 MB/sec
  2314. - RemoteScanRanges: 0 (0)
  2315. - RowBatchQueueGetWaitTime: 0.000ns
  2316. - RowBatchQueuePutWaitTime: 0.000ns
  2317. - RowsRead: 1.17M (1169408)
  2318. - RowsReturned: 261.12K (261120)
  2319. - RowsReturnedRate: 227.45 K/sec
  2320. - ScanRangesComplete: 7 (7)
  2321. - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
  2322. - ScannerThreadsTotalWallClockTime: 96.003ms
  2323. - MaterializeTupleTime(*): 0.000ns
  2324. - ScannerThreadsSysTime: 2.291ms
  2325. - ScannerThreadsUserTime: 0.000ns
  2326. - ScannerThreadsVoluntaryContextSwitches: 36 (36)
  2327. - TotalRawHdfsOpenFileTime(*): 316.010ms
  2328. - TotalRawHdfsReadTime(*): 2s676ms
  2329. - TotalReadThroughput: 427.90 KB/sec
  2330. Filter 0 (1.00 MB):
  2331. - Files processed: 0 (0)
  2332. - Files rejected: 0 (0)
  2333. - Files total: 0 (0)
  2334. - RowGroups processed: 0 (0)
  2335. - RowGroups rejected: 0 (0)
  2336. - RowGroups total: 0 (0)
  2337. - Rows processed: 0 (0)
  2338. - Rows rejected: 0 (0)
  2339. - Rows total: 0 (0)
  2340. - Splits processed: 0 (0)
  2341. - Splits rejected: 0 (0)
  2342. - Splits total: 0 (0)
  2343. Filter 1 (1.00 MB):
  2344. - Files processed: 0 (0)
  2345. - Files rejected: 0 (0)
  2346. - Files total: 0 (0)
  2347. - RowGroups processed: 0 (0)
  2348. - RowGroups rejected: 0 (0)
  2349. - RowGroups total: 0 (0)
  2350. - Rows processed: 0 (0)
  2351. - Rows rejected: 0 (0)
  2352. - Rows total: 0 (0)
  2353. - Splits processed: 0 (0)
  2354. - Splits rejected: 0 (0)
  2355. - Splits total: 0 (0)
  2356. CodeGen:(Total: 108.003ms, non-child: 108.003ms, % non-child: 100.00%)
  2357. - CodegenTime: 4.000ms
  2358. - CompileTime: 20.000ms
  2359. - LoadTime: 0.000ns
  2360. - ModuleBitcodeSize: 1.95 MB (2040108)
  2361. - NumFunctions: 64 (64)
  2362. - NumInstructions: 1.09K (1091)
  2363. - OptimizationTime: 72.002ms
  2364. - PeakMemoryUsage: 545.50 KB (558592)
  2365. - PrepareTime: 16.000ms
  2366. Instance 33406f6405038287:b47e1f8b00000003 (host=slave-cn05:22000):(Total: 112.006ms, non-child: 0.000ns, % non-child: 0.00%)
  2367. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.35 GB
  2368. Filter 1 arrival: 28s703ms
  2369. Filter 0 arrival: 28s708ms
  2370. Fragment Instance Lifecycle Event Timeline: 1s048ms
  2371. - Prepare Finished: 0.000ns (0.000ns)
  2372. - Open Finished: 112.006ms (112.006ms)
  2373. - First Batch Produced: 1s048ms (936.051ms)
  2374. - First Batch Sent: 1s048ms (0.000ns)
  2375. MemoryUsage(16s000ms): 84.03 MB, 89.53 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB
  2376. ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2
  2377. - AverageThreadTokens: 2.00
  2378. - BloomFilterBytes: 2.00 MB (2097152)
  2379. - PeakMemoryUsage: 89.94 MB (94311071)
  2380. - PeakReservation: 2.00 MB (2097152)
  2381. - PeakUsedReservation: 0
  2382. - PerHostPeakMemUsage: 3.09 GB (3313067929)
  2383. - RowsProduced: 390.14K (390144)
  2384. - TotalNetworkReceiveTime: 0.000ns
  2385. - TotalNetworkSendTime: 27s409ms
  2386. - TotalStorageWaitTime: 376.020ms
  2387. - TotalThreadsInvoluntaryContextSwitches: 1 (1)
  2388. - TotalThreadsTotalWallClockTime: 352.019ms
  2389. - TotalThreadsSysTime: 5.936ms
  2390. - TotalThreadsUserTime: 109.450ms
  2391. - TotalThreadsVoluntaryContextSwitches: 93 (93)
  2392. Buffer pool:
  2393. - AllocTime: 0.000ns
  2394. - CumulativeAllocationBytes: 2.00 MB (2097152)
  2395. - CumulativeAllocations: 2 (2)
  2396. - PeakReservation: 2.00 MB (2097152)
  2397. - PeakUnpinnedBytes: 0
  2398. - PeakUsedReservation: 2.00 MB (2097152)
  2399. - ReadIoBytes: 0
  2400. - ReadIoOps: 0 (0)
  2401. - ReadIoWaitTime: 0.000ns
  2402. - ReservationLimit: 2.00 MB (2097152)
  2403. - WriteIoBytes: 0
  2404. - WriteIoOps: 0 (0)
  2405. - WriteIoWaitTime: 0.000ns
  2406. Fragment Instance Lifecycle Timings:
  2407. - ExecTime: 0.000ns
  2408. - ExecTreeExecTime: 1s184ms
  2409. - OpenTime: 112.006ms
  2410. - ExecTreeOpenTime: 0.000ns
  2411. - PrepareTime: 0.000ns
  2412. - ExecTreePrepareTime: 0.000ns
  2413. KrpcDataStreamSender (dst_id=6):(Total: 27s497ms, non-child: 88.004ms, % non-child: 0.32%)
  2414. BytesSent(16s000ms): 4.95 MB, 5.98 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB
  2415. - EosSent: 0 (0)
  2416. - NetworkThroughput: 7.65 MB/sec
  2417. - PeakMemoryUsage: 191.25 KB (195840)
  2418. - RowsSent: 389.12K (389120)
  2419. - RpcFailure: 0 (0)
  2420. - RpcRetry: 0 (0)
  2421. - SerializeBatchTime: 44.002ms
  2422. - TotalBytesSent: 8.11 MB (8498867)
  2423. - UncompressedRowBatchSize: 15.17 MB (15902752)
  2424. HDFS_SCAN_NODE (id=1):(Total: 1s184ms, non-child: 1s184ms, % non-child: 100.00%)
  2425. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.35 GB
  2426. ExecOption: PARQUET Codegen Enabled
  2427. Runtime filters: Not all filters arrived (arrived: [], missing [0, 1]), waited for 924ms
  2428. BytesRead(16s000ms): 69.76 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB
  2429. - FooterProcessingTime: (Avg: 14.182ms ; Min: 4.000ms ; Max: 32.001ms ; Number of samples: 11)
  2430. - AverageHdfsReadThreadConcurrency: 0.00
  2431. - AverageScannerThreadConcurrency: 1.00
  2432. - BytesRead: 74.68 MB (78302514)
  2433. - BytesReadDataNodeCache: 0
  2434. - BytesReadLocal: 0
  2435. - BytesReadRemoteUnexpected: 0
  2436. - BytesReadShortCircuit: 0
  2437. - CachedFileHandlesHitCount: 0 (0)
  2438. - CachedFileHandlesMissCount: 0 (0)
  2439. - CollectionItemsRead: 0 (0)
  2440. - DecompressionTime: 72.003ms
  2441. - MaxCompressedTextFileLength: 0
  2442. - NumColumns: 6 (6)
  2443. - NumDictFilteredRowGroups: 0 (0)
  2444. - NumDisksAccessed: 0 (0)
  2445. - NumRowGroups: 1 (1)
  2446. - NumScannerThreadsStarted: 11 (11)
  2447. - NumScannersWithNoReads: 10 (10)
  2448. - NumStatsFilteredRowGroups: 0 (0)
  2449. - PeakMemoryUsage: 87.66 MB (91923136)
  2450. - PerReadThreadRawHdfsThroughput: 148.16 MB/sec
  2451. - RemoteScanRanges: 0 (0)
  2452. - RowBatchQueueGetWaitTime: 0.000ns
  2453. - RowBatchQueuePutWaitTime: 0.000ns
  2454. - RowsRead: 1.60M (1597440)
  2455. - RowsReturned: 390.14K (390144)
  2456. - RowsReturnedRate: 329.50 K/sec
  2457. - ScanRangesComplete: 10 (10)
  2458. - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
  2459. - ScannerThreadsTotalWallClockTime: 240.013ms
  2460. - MaterializeTupleTime(*): 0.000ns
  2461. - ScannerThreadsSysTime: 3.257ms
  2462. - ScannerThreadsUserTime: 511.000us
  2463. - ScannerThreadsVoluntaryContextSwitches: 63 (63)
  2464. - TotalRawHdfsOpenFileTime(*): 120.006ms
  2465. - TotalRawHdfsReadTime(*): 504.027ms
  2466. - TotalReadThroughput: 122.15 KB/sec
  2467. Filter 0 (1.00 MB):
  2468. - Files processed: 0 (0)
  2469. - Files rejected: 0 (0)
  2470. - Files total: 0 (0)
  2471. - RowGroups processed: 0 (0)
  2472. - RowGroups rejected: 0 (0)
  2473. - RowGroups total: 0 (0)
  2474. - Rows processed: 0 (0)
  2475. - Rows rejected: 0 (0)
  2476. - Rows total: 0 (0)
  2477. - Splits processed: 0 (0)
  2478. - Splits rejected: 0 (0)
  2479. - Splits total: 0 (0)
  2480. Filter 1 (1.00 MB):
  2481. - Files processed: 0 (0)
  2482. - Files rejected: 0 (0)
  2483. - Files total: 0 (0)
  2484. - RowGroups processed: 0 (0)
  2485. - RowGroups rejected: 0 (0)
  2486. - RowGroups total: 0 (0)
  2487. - Rows processed: 0 (0)
  2488. - Rows rejected: 0 (0)
  2489. - Rows total: 0 (0)
  2490. - Splits processed: 0 (0)
  2491. - Splits rejected: 0 (0)
  2492. - Splits total: 0 (0)
  2493. CodeGen:(Total: 112.006ms, non-child: 112.006ms, % non-child: 100.00%)
  2494. - CodegenTime: 4.000ms
  2495. - CompileTime: 20.001ms
  2496. - LoadTime: 0.000ns
  2497. - ModuleBitcodeSize: 1.95 MB (2040108)
  2498. - NumFunctions: 64 (64)
  2499. - NumInstructions: 1.09K (1091)
  2500. - OptimizationTime: 68.003ms
  2501. - PeakMemoryUsage: 545.50 KB (558592)
  2502. - PrepareTime: 24.001ms
  2503. Averaged Fragment F01:(Total: 24s784ms, non-child: 4s119ms, % non-child: 16.62%)
  2504. split sizes: min: 8.25 GB, max: 8.49 GB, avg: 8.41 GB, stddev: 86.46 MB
  2505. completion times: min:21s036ms max:28s645ms mean: 24s789ms stddev:2s668ms
  2506. execution rates: min:295.04 MB/sec max:413.34 MB/sec mean:351.59 MB/sec stddev:41.01 MB/sec
  2507. num instances: 6
  2508. - AverageThreadTokens: 15.37
  2509. - BloomFilterBytes: 8.00 MB (8388608)
  2510. - PeakMemoryUsage: 3.49 GB (3748681192)
  2511. - PeakReservation: 360.00 MB (377487360)
  2512. - PeakUsedReservation: 0
  2513. - PerHostPeakMemUsage: 3.76 GB (4033533655)
  2514. - RowsProduced: 918.86K (918861)
  2515. - TotalNetworkReceiveTime: 1s498ms
  2516. - TotalNetworkSendTime: 9s413ms
  2517. - TotalStorageWaitTime: 1m50s
  2518. - TotalThreadsInvoluntaryContextSwitches: 2.56K (2562)
  2519. - TotalThreadsTotalWallClockTime: 6m30s
  2520. - TotalThreadsSysTime: 23s461ms
  2521. - TotalThreadsUserTime: 22s761ms
  2522. - TotalThreadsVoluntaryContextSwitches: 81.39K (81394)
  2523. Buffer pool:
  2524. - AllocTime: 0.000ns
  2525. - CumulativeAllocationBytes: 8.00 MB (8388608)
  2526. - CumulativeAllocations: 2 (2)
  2527. - PeakReservation: 8.00 MB (8388608)
  2528. - PeakUnpinnedBytes: 0
  2529. - PeakUsedReservation: 8.00 MB (8388608)
  2530. - ReadIoBytes: 0
  2531. - ReadIoOps: 0 (0)
  2532. - ReadIoWaitTime: 0.000ns
  2533. - ReservationLimit: 8.00 MB (8388608)
  2534. - WriteIoBytes: 0
  2535. - WriteIoOps: 0 (0)
  2536. - WriteIoWaitTime: 0.000ns
  2537. Fragment Instance Lifecycle Timings:
  2538. - ExecTime: 21s124ms
  2539. - ExecTreeExecTime: 6s894ms
  2540. - OpenTime: 3s655ms
  2541. - ExecTreeOpenTime: 3s317ms
  2542. - PrepareTime: 4.666ms
  2543. - ExecTreePrepareTime: 2.000ms
  2544. KrpcDataStreamSender (dst_id=7):(Total: 10s117ms, non-child: 10s117ms, % non-child: 100.00%)
  2545. - EosSent: 6 (6)
  2546. - NetworkThroughput: 1.56 MB/sec
  2547. - PeakMemoryUsage: 187.88 KB (192384)
  2548. - RowsSent: 918.86K (918861)
  2549. - RpcFailure: 0 (0)
  2550. - RpcRetry: 0 (0)
  2551. - SerializeBatchTime: 305.347ms
  2552. - TotalBytesSent: 58.86 MB (61717785)
  2553. - UncompressedRowBatchSize: 81.50 MB (85454104)
  2554. HASH_JOIN_NODE (id=3):(Total: 10s213ms, non-child: 6s120ms, % non-child: 59.92%)
  2555. - BuildRows: 7.36M (7358720)
  2556. - BuildTime: 1s242ms
  2557. - NumHashTableBuildsSkipped: 0 (0)
  2558. - PeakMemoryUsage: 352.37 MB (369485738)
  2559. - ProbeRows: 33.05M (33045621)
  2560. - ProbeRowsPartitioned: 0 (0)
  2561. - ProbeTime: 4s804ms
  2562. - RowsReturned: 918.86K (918861)
  2563. - RowsReturnedRate: 90.97 K/sec
  2564. Buffer pool:
  2565. - AllocTime: 2.666ms
  2566. - CumulativeAllocationBytes: 352.00 MB (369098752)
  2567. - CumulativeAllocations: 64 (64)
  2568. - PeakReservation: 352.00 MB (369098752)
  2569. - PeakUnpinnedBytes: 0
  2570. - PeakUsedReservation: 352.00 MB (369098752)
  2571. - ReadIoBytes: 0
  2572. - ReadIoOps: 0 (0)
  2573. - ReadIoWaitTime: 0.000ns
  2574. - WriteIoBytes: 0
  2575. - WriteIoOps: 0 (0)
  2576. - WriteIoWaitTime: 0.000ns
  2577. Hash Join Builder (join_node_id=3):
  2578. - BuildRowsPartitionTime: 672.698ms
  2579. - BuildRowsPartitioned: 7.36M (7358720)
  2580. - HashBuckets: 16.78M (16777216)
  2581. - HashCollisions: 0 (0)
  2582. - HashTablesBuildTime: 559.359ms
  2583. - LargestPartitionPercent: 6 (6)
  2584. - MaxPartitionLevel: 0 (0)
  2585. - NumRepartitions: 0 (0)
  2586. - PartitionsCreated: 16 (16)
  2587. - PeakMemoryUsage: 22.12 KB (22656)
  2588. - RepartitionTime: 0.000ns
  2589. - SpilledPartitions: 0 (0)
  2590. EXCHANGE_NODE (id=5):(Total: 1s610ms, non-child: 1s610ms, % non-child: 100.00%)
  2591. - ConvertRowBatchTime: 106.671ms
  2592. - PeakMemoryUsage: 12.69 MB (13302259)
  2593. - RowsReturned: 7.36M (7358720)
  2594. - RowsReturnedRate: 4.59 M/sec
  2595. Buffer pool:
  2596. - AllocTime: 29.334ms
  2597. - CumulativeAllocationBytes: 168.48 MB (176668672)
  2598. - CumulativeAllocations: 14.38K (14380)
  2599. - PeakReservation: 12.65 MB (13262848)
  2600. - PeakUnpinnedBytes: 0
  2601. - PeakUsedReservation: 12.65 MB (13262848)
  2602. - ReadIoBytes: 0
  2603. - ReadIoOps: 0 (0)
  2604. - ReadIoWaitTime: 0.000ns
  2605. - WriteIoBytes: 0
  2606. - WriteIoOps: 0 (0)
  2607. - WriteIoWaitTime: 0.000ns
  2608. Dequeue:
  2609. - FirstBatchWaitTime: 0.000ns
  2610. - TotalBytesDequeued: 133.34 MB (139815680)
  2611. - TotalGetBatchTime: 1s497ms
  2612. - DataWaitTime: 1s490ms
  2613. Enqueue:
  2614. - DeserializeRowBatchTime: 160.674ms
  2615. - TotalBatchesEnqueued: 7.19K (7190)
  2616. - TotalBatchesReceived: 7.19K (7190)
  2617. - TotalBytesReceived: 66.74 MB (69986621)
  2618. - TotalEarlySenders: 0 (0)
  2619. - TotalEosReceived: 6 (6)
  2620. - TotalHasDeferredRPCsTime: 52.460ms
  2621. - TotalRPCsDeferred: 5 (5)
  2622. HDFS_SCAN_NODE (id=2):(Total: 2s482ms, non-child: 2s482ms, % non-child: 100.00%)
  2623. - AverageHdfsReadThreadConcurrency: 3.37
  2624. - AverageScannerThreadConcurrency: 14.50
  2625. - BytesRead: 4.57 GB (4910925278)
  2626. - BytesReadDataNodeCache: 0
  2627. - BytesReadLocal: 3.17 GB (3402812333)
  2628. - BytesReadRemoteUnexpected: 0
  2629. - BytesReadShortCircuit: 3.17 GB (3402812333)
  2630. - CachedFileHandlesHitCount: 238 (238)
  2631. - CachedFileHandlesMissCount: 199 (199)
  2632. - CollectionItemsRead: 0 (0)
  2633. - DecompressionTime: 13s278ms
  2634. - MaxCompressedTextFileLength: 0
  2635. - NumColumns: 10 (10)
  2636. - NumDictFilteredRowGroups: 0 (0)
  2637. - NumDisksAccessed: 2 (2)
  2638. - NumRowGroups: 19 (19)
  2639. - NumScannerThreadsStarted: 37 (37)
  2640. - NumScannersWithNoReads: 50 (50)
  2641. - NumStatsFilteredRowGroups: 0 (0)
  2642. - PeakMemoryUsage: 3.13 GB (3362860441)
  2643. - PerReadThreadRawHdfsThroughput: 153.50 MB/sec
  2644. - RemoteScanRanges: 290 (290)
  2645. - RowBatchQueueGetWaitTime: 2s166ms
  2646. - RowBatchQueuePutWaitTime: 3m21s
  2647. - RowsRead: 104.88M (104882858)
  2648. - RowsReturned: 33.05M (33045621)
  2649. - RowsReturnedRate: 18.14 M/sec
  2650. - ScanRangesComplete: 69 (69)
  2651. - ScannerThreadsInvoluntaryContextSwitches: 2.52K (2518)
  2652. - ScannerThreadsTotalWallClockTime: 6m3s
  2653. - MaterializeTupleTime(*): 26s553ms
  2654. - ScannerThreadsSysTime: 18s808ms
  2655. - ScannerThreadsUserTime: 16s167ms
  2656. - ScannerThreadsVoluntaryContextSwitches: 74.64K (74645)
  2657. - TotalRawHdfsOpenFileTime(*): 5s272ms
  2658. - TotalRawHdfsReadTime(*): 1m25s
  2659. - TotalReadThroughput: 188.30 MB/sec
  2660. Filter 4 (4.00 MB):
  2661. - Files processed: 0 (0)
  2662. - Files rejected: 0 (0)
  2663. - Files total: 0 (0)
  2664. - RowGroups processed: 0 (0)
  2665. - RowGroups rejected: 0 (0)
  2666. - RowGroups total: 0 (0)
  2667. - Rows processed: 1.25M (1252891)
  2668. - Rows rejected: 87.93K (87927)
  2669. - Rows total: 104.90M (104904362)
  2670. - Splits processed: 0 (0)
  2671. - Splits rejected: 0 (0)
  2672. - Splits total: 0 (0)
  2673. Filter 5 (4.00 MB):
  2674. - Files processed: 0 (0)
  2675. - Files rejected: 0 (0)
  2676. - Files total: 0 (0)
  2677. - RowGroups processed: 0 (0)
  2678. - RowGroups rejected: 0 (0)
  2679. - RowGroups total: 0 (0)
  2680. - Rows processed: 1.08M (1077309)
  2681. - Rows rejected: 24.76K (24762)
  2682. - Rows total: 104.82M (104816434)
  2683. - Splits processed: 0 (0)
  2684. - Splits rejected: 0 (0)
  2685. - Splits total: 0 (0)
  2686. CodeGen:(Total: 333.349ms, non-child: 333.349ms, % non-child: 100.00%)
  2687. - CodegenTime: 3.333ms
  2688. - CompileTime: 85.337ms
  2689. - LoadTime: 0.000ns
  2690. - ModuleBitcodeSize: 1.95 MB (2040108)
  2691. - NumFunctions: 113 (113)
  2692. - NumInstructions: 3.40K (3401)
  2693. - OptimizationTime: 224.010ms
  2694. - PeakMemoryUsage: 1.66 MB (1741312)
  2695. - PrepareTime: 23.334ms
  2696. Fragment F01:
  2697. Instance 33406f6405038287:b47e1f8b00000011 (host=slave-cn02:22000):(Total: 28s641ms, non-child: 4s924ms, % non-child: 17.19%)
  2698. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:67/8.25 GB
  2699. Filter 4 arrival: 2s652ms
  2700. Filter 5 arrival: 2s652ms
  2701. Fragment Instance Lifecycle Event Timeline: 28s641ms
  2702. - Prepare Finished: 4.000ms (4.000ms)
  2703. - Open Finished: 3s880ms (3s876ms)
  2704. - First Batch Produced: 3s896ms (16.000ms)
  2705. - First Batch Sent: 3s900ms (4.000ms)
  2706. - ExecInternal Finished: 28s641ms (24s741ms)
  2707. MemoryUsage(500.000ms): 14.64 MB, 54.74 MB, 84.74 MB, 84.74 MB, 116.74 MB, 164.75 MB, 361.25 MB, 620.30 MB, 957.30 MB, 1.31 GB, 1.42 GB, 1.57 GB, 1.68 GB, 1.70 GB, 1.82 GB, 1.92 GB, 1.92 GB, 1.94 GB, 1.97 GB, 2.16 GB, 2.21 GB, 2.21 GB, 2.29 GB, 2.42 GB, 2.51 GB, 2.52 GB, 2.54 GB, 2.58 GB, 2.61 GB, 2.73 GB, 2.86 GB, 2.88 GB, 2.91 GB, 2.93 GB, 3.03 GB, 3.34 GB, 3.34 GB, 3.42 GB, 3.70 GB, 3.86 GB, 3.86 GB, 3.83 GB, 3.79 GB, 3.77 GB, 3.65 GB, 3.50 GB, 3.42 GB, 3.34 GB, 3.28 GB, 3.23 GB, 2.90 GB, 2.74 GB, 2.47 GB, 2.00 GB, 1.64 GB, 1.31 GB, 704.50 MB
  2708. ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 30, 30, 25, 24, 24, 23, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 19, 18, 17, 14, 12, 9, 5
  2709. - AverageThreadTokens: 17.91
  2710. - BloomFilterBytes: 8.00 MB (8388608)
  2711. - PeakMemoryUsage: 3.88 GB (4166322160)
  2712. - PeakReservation: 360.00 MB (377487360)
  2713. - PeakUsedReservation: 0
  2714. - PerHostPeakMemUsage: 4.26 GB (4572618824)
  2715. - RowsProduced: 1.03M (1034898)
  2716. - TotalNetworkReceiveTime: 1s512ms
  2717. - TotalNetworkSendTime: 9s780ms
  2718. - TotalStorageWaitTime: 3m11s
  2719. - TotalThreadsInvoluntaryContextSwitches: 3.96K (3965)
  2720. - TotalThreadsTotalWallClockTime: 8m23s
  2721. - TotalThreadsSysTime: 27s972ms
  2722. - TotalThreadsUserTime: 25s211ms
  2723. - TotalThreadsVoluntaryContextSwitches: 99.93K (99929)
  2724. Buffer pool:
  2725. - AllocTime: 0.000ns
  2726. - CumulativeAllocationBytes: 8.00 MB (8388608)
  2727. - CumulativeAllocations: 2 (2)
  2728. - PeakReservation: 8.00 MB (8388608)
  2729. - PeakUnpinnedBytes: 0
  2730. - PeakUsedReservation: 8.00 MB (8388608)
  2731. - ReadIoBytes: 0
  2732. - ReadIoOps: 0 (0)
  2733. - ReadIoWaitTime: 0.000ns
  2734. - ReservationLimit: 8.00 MB (8388608)
  2735. - WriteIoBytes: 0
  2736. - WriteIoOps: 0 (0)
  2737. - WriteIoWaitTime: 0.000ns
  2738. Fragment Instance Lifecycle Timings:
  2739. - ExecTime: 24s761ms
  2740. - ExecTreeExecTime: 9s188ms
  2741. - OpenTime: 3s876ms
  2742. - ExecTreeOpenTime: 3s552ms
  2743. - PrepareTime: 4.000ms
  2744. - ExecTreePrepareTime: 4.000ms
  2745. KrpcDataStreamSender (dst_id=7):(Total: 10s652ms, non-child: 872.040ms, % non-child: 8.19%)
  2746. BytesSent(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 579.32 KB, 1.78 MB, 2.83 MB, 3.67 MB, 4.76 MB, 5.55 MB, 6.09 MB, 6.68 MB, 7.91 MB, 8.06 MB, 8.33 MB, 9.13 MB, 9.83 MB, 10.20 MB, 10.93 MB, 11.65 MB, 12.18 MB, 12.71 MB, 13.25 MB, 14.07 MB, 14.62 MB, 15.32 MB, 15.83 MB, 16.02 MB, 16.19 MB, 16.76 MB, 18.04 MB, 18.92 MB, 20.01 MB, 21.15 MB, 22.13 MB, 23.45 MB, 25.01 MB, 27.46 MB, 29.11 MB, 32.19 MB, 35.12 MB, 38.23 MB, 40.29 MB, 42.29 MB, 45.08 MB, 46.99 MB, 49.20 MB, 51.48 MB, 54.52 MB, 57.28 MB, 59.94 MB, 62.65 MB, 65.08 MB
  2747. - EosSent: 6 (6)
  2748. - NetworkThroughput: 1.49 MB/sec
  2749. - PeakMemoryUsage: 187.88 KB (192384)
  2750. - RowsSent: 1.03M (1034898)
  2751. - RpcFailure: 0 (0)
  2752. - RpcRetry: 0 (0)
  2753. - SerializeBatchTime: 420.019ms
  2754. - TotalBytesSent: 66.29 MB (69512790)
  2755. - UncompressedRowBatchSize: 91.79 MB (96245514)
  2756. HASH_JOIN_NODE (id=3):(Total: 12s744ms, non-child: 6s760ms, % non-child: 53.04%)
  2757. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  2758. - BuildRows: 7.36M (7358720)
  2759. - BuildTime: 1s280ms
  2760. - NumHashTableBuildsSkipped: 0 (0)
  2761. - PeakMemoryUsage: 352.42 MB (369541376)
  2762. - ProbeRows: 36.96M (36961674)
  2763. - ProbeRowsPartitioned: 0 (0)
  2764. - ProbeTime: 5s408ms
  2765. - RowsReturned: 1.03M (1034898)
  2766. - RowsReturnedRate: 81.20 K/sec
  2767. Buffer pool:
  2768. - AllocTime: 4.000ms
  2769. - CumulativeAllocationBytes: 352.00 MB (369098752)
  2770. - CumulativeAllocations: 64 (64)
  2771. - PeakReservation: 352.00 MB (369098752)
  2772. - PeakUnpinnedBytes: 0
  2773. - PeakUsedReservation: 352.00 MB (369098752)
  2774. - ReadIoBytes: 0
  2775. - ReadIoOps: 0 (0)
  2776. - ReadIoWaitTime: 0.000ns
  2777. - WriteIoBytes: 0
  2778. - WriteIoOps: 0 (0)
  2779. - WriteIoWaitTime: 0.000ns
  2780. Hash Join Builder (join_node_id=3):
  2781. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  2782. Runtime filters: 2 of 2 Runtime Filters Published
  2783. - BuildRowsPartitionTime: 684.031ms
  2784. - BuildRowsPartitioned: 7.36M (7358720)
  2785. - HashBuckets: 16.78M (16777216)
  2786. - HashCollisions: 0 (0)
  2787. - HashTablesBuildTime: 588.027ms
  2788. - LargestPartitionPercent: 6 (6)
  2789. - MaxPartitionLevel: 0 (0)
  2790. - NumRepartitions: 0 (0)
  2791. - PartitionsCreated: 16 (16)
  2792. - PeakMemoryUsage: 22.12 KB (22656)
  2793. - RepartitionTime: 0.000ns
  2794. - SpilledPartitions: 0 (0)
  2795. EXCHANGE_NODE (id=5):(Total: 1s620ms, non-child: 112.005ms, % non-child: 6.91%)
  2796. - ConvertRowBatchTime: 100.004ms
  2797. - PeakMemoryUsage: 12.69 MB (13302259)
  2798. - RowsReturned: 7.36M (7358720)
  2799. - RowsReturnedRate: 4.54 M/sec
  2800. Buffer pool:
  2801. - AllocTime: 28.001ms
  2802. - CumulativeAllocationBytes: 168.48 MB (176668672)
  2803. - CumulativeAllocations: 14.38K (14380)
  2804. - PeakReservation: 12.65 MB (13262848)
  2805. - PeakUnpinnedBytes: 0
  2806. - PeakUsedReservation: 12.65 MB (13262848)
  2807. - ReadIoBytes: 0
  2808. - ReadIoOps: 0 (0)
  2809. - ReadIoWaitTime: 0.000ns
  2810. - WriteIoBytes: 0
  2811. - WriteIoOps: 0 (0)
  2812. - WriteIoWaitTime: 0.000ns
  2813. Dequeue:
  2814. BytesDequeued(500.000ms): 0, 39.69 MB, 74.89 MB, 87.34 MB, 119.27 MB, 133.34 MB
  2815. - FirstBatchWaitTime: 0.000ns
  2816. - TotalBytesDequeued: 133.34 MB (139815680)
  2817. - TotalGetBatchTime: 1s512ms
  2818. - DataWaitTime: 1s508ms
  2819. Enqueue:
  2820. BytesReceived(500.000ms): 2.60 MB, 19.87 MB, 37.49 MB, 43.73 MB, 59.70 MB, 66.74 MB
  2821. DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0
  2822. - DispatchTime: (Avg: 33.858us ; Min: 11.607us ; Max: 519.570us ; Number of samples: 7190)
  2823. - DeserializeRowBatchTime: 148.006ms
  2824. - TotalBatchesEnqueued: 7.19K (7190)
  2825. - TotalBatchesReceived: 7.19K (7190)
  2826. - TotalBytesReceived: 66.74 MB (69986621)
  2827. - TotalEarlySenders: 0 (0)
  2828. - TotalEosReceived: 6 (6)
  2829. - TotalHasDeferredRPCsTime: 35.412ms
  2830. - TotalRPCsDeferred: 5 (5)
  2831. HDFS_SCAN_NODE (id=2):(Total: 4s364ms, non-child: 4s364ms, % non-child: 100.00%)
  2832. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:67/8.25 GB
  2833. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 67 out of 67
  2834. Runtime filters: All filters arrived. Waited 0
  2835. Hdfs Read Thread Concurrency Bucket: 0:33.93% 1:7.143% 2:0% 3:0% 4:0% 5:58.93%
  2836. File Formats: PARQUET/NONE:47 PARQUET/SNAPPY:20
  2837. BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 175.15 MB, 483.71 MB, 890.14 MB, 1002.84 MB, 1.10 GB, 1.24 GB, 1.29 GB, 1.40 GB, 1.51 GB, 1.56 GB, 1.61 GB, 1.67 GB, 1.83 GB, 1.90 GB, 1.93 GB, 2.00 GB, 2.16 GB, 2.26 GB, 2.30 GB, 2.37 GB, 2.45 GB, 2.49 GB, 2.67 GB, 2.80 GB, 2.85 GB, 2.88 GB, 2.91 GB, 3.07 GB, 3.45 GB, 3.49 GB, 3.64 GB, 3.92 GB, 4.12 GB, 4.23 GB, 4.41 GB, 4.42 GB, 4.56 GB, 4.65 GB, 4.76 GB, 4.77 GB, 4.83 GB, 4.89 GB, 4.92 GB, 4.95 GB, 4.97 GB, 5.01 GB, 5.05 GB, 5.06 GB, 5.07 GB, 5.08 GB
  2838. - FooterProcessingTime: (Avg: 354.165ms ; Min: 4.000ms ; Max: 2s292ms ; Number of samples: 67)
  2839. - AverageHdfsReadThreadConcurrency: 4.61
  2840. - AverageScannerThreadConcurrency: 17.12
  2841. - BytesRead: 5.08 GB (5454835475)
  2842. - BytesReadDataNodeCache: 0
  2843. - BytesReadLocal: 3.14 GB (3369247854)
  2844. - BytesReadRemoteUnexpected: 0
  2845. - BytesReadShortCircuit: 3.14 GB (3369247854)
  2846. - CachedFileHandlesHitCount: 236 (236)
  2847. - CachedFileHandlesMissCount: 215 (215)
  2848. - CollectionItemsRead: 0 (0)
  2849. - DecompressionTime: 15s552ms
  2850. - MaxCompressedTextFileLength: 0
  2851. - NumColumns: 10 (10)
  2852. - NumDictFilteredRowGroups: 0 (0)
  2853. - NumDisksAccessed: 2 (2)
  2854. - NumRowGroups: 20 (20)
  2855. - NumScannerThreadsStarted: 29 (29)
  2856. - NumScannersWithNoReads: 47 (47)
  2857. - NumStatsFilteredRowGroups: 0 (0)
  2858. - PeakMemoryUsage: 3.52 GB (3780594261)
  2859. - PerReadThreadRawHdfsThroughput: 40.32 MB/sec
  2860. - RemoteScanRanges: 395 (395)
  2861. - RowBatchQueueGetWaitTime: 4s016ms
  2862. - RowBatchQueuePutWaitTime: 3m38s
  2863. - RowsRead: 117.35M (117346304)
  2864. - RowsReturned: 36.96M (36961674)
  2865. - RowsReturnedRate: 8.47 M/sec
  2866. - ScanRangesComplete: 67 (67)
  2867. - ScannerThreadsInvoluntaryContextSwitches: 3.91K (3913)
  2868. - ScannerThreadsTotalWallClockTime: 7m52s
  2869. - MaterializeTupleTime(*): 33s753ms
  2870. - ScannerThreadsSysTime: 22s383ms
  2871. - ScannerThreadsUserTime: 18s104ms
  2872. - ScannerThreadsVoluntaryContextSwitches: 91.89K (91895)
  2873. - TotalRawHdfsOpenFileTime(*): 9s864ms
  2874. - TotalRawHdfsReadTime(*): 2m9s
  2875. - TotalReadThroughput: 182.53 MB/sec
  2876. Filter 4 (4.00 MB):
  2877. - Files processed: 0 (0)
  2878. - Files rejected: 0 (0)
  2879. - Files total: 0 (0)
  2880. - RowGroups processed: 0 (0)
  2881. - RowGroups rejected: 0 (0)
  2882. - RowGroups total: 0 (0)
  2883. - Rows processed: 1.45M (1445235)
  2884. - Rows rejected: 107.27K (107272)
  2885. - Rows total: 117.37M (117372928)
  2886. - Splits processed: 0 (0)
  2887. - Splits rejected: 0 (0)
  2888. - Splits total: 0 (0)
  2889. Filter 5 (4.00 MB):
  2890. - Files processed: 0 (0)
  2891. - Files rejected: 0 (0)
  2892. - Files total: 0 (0)
  2893. - RowGroups processed: 0 (0)
  2894. - RowGroups rejected: 0 (0)
  2895. - RowGroups total: 0 (0)
  2896. - Rows processed: 1.08M (1076101)
  2897. - Rows rejected: 23.39K (23385)
  2898. - Rows total: 117.27M (117265656)
  2899. - Splits processed: 0 (0)
  2900. - Splits rejected: 0 (0)
  2901. - Splits total: 0 (0)
  2902. CodeGen:(Total: 320.014ms, non-child: 320.014ms, % non-child: 100.00%)
  2903. - CodegenTime: 4.000ms
  2904. - CompileTime: 84.003ms
  2905. - LoadTime: 0.000ns
  2906. - ModuleBitcodeSize: 1.95 MB (2040108)
  2907. - NumFunctions: 113 (113)
  2908. - NumInstructions: 3.40K (3401)
  2909. - OptimizationTime: 212.009ms
  2910. - PeakMemoryUsage: 1.66 MB (1741312)
  2911. - PrepareTime: 24.001ms
  2912. Instance 33406f6405038287:b47e1f8b0000000e (host=slave-cn06:22000):(Total: 26s900ms, non-child: 4s356ms, % non-child: 16.19%)
  2913. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:70/8.45 GB
  2914. Filter 4 arrival: 2s652ms
  2915. Filter 5 arrival: 2s651ms
  2916. Fragment Instance Lifecycle Event Timeline: 26s900ms
  2917. - Prepare Finished: 4.000ms (4.000ms)
  2918. - Open Finished: 3s884ms (3s880ms)
  2919. - First Batch Produced: 3s904ms (20.000ms)
  2920. - First Batch Sent: 3s904ms (0.000ns)
  2921. - ExecInternal Finished: 26s900ms (22s996ms)
  2922. MemoryUsage(500.000ms): 9.74 MB, 54.74 MB, 84.74 MB, 84.74 MB, 112.74 MB, 116.74 MB, 324.75 MB, 604.49 MB, 808.25 MB, 1.03 GB, 1.49 GB, 1.66 GB, 1.74 GB, 1.88 GB, 1.92 GB, 1.97 GB, 2.01 GB, 2.16 GB, 2.21 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.44 GB, 2.45 GB, 2.50 GB, 2.54 GB, 2.57 GB, 2.64 GB, 2.68 GB, 2.77 GB, 2.79 GB, 2.87 GB, 3.00 GB, 3.01 GB, 3.20 GB, 3.40 GB, 3.46 GB, 3.67 GB, 3.76 GB, 3.83 GB, 3.88 GB, 3.82 GB, 3.77 GB, 3.69 GB, 3.64 GB, 3.43 GB, 3.27 GB, 3.10 GB, 2.97 GB, 2.52 GB, 2.12 GB, 1.70 GB, 1.14 GB, 495.66 MB
  2923. ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 36, 27, 22, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 17, 15, 13, 8, 3
  2924. - AverageThreadTokens: 17.30
  2925. - BloomFilterBytes: 8.00 MB (8388608)
  2926. - PeakMemoryUsage: 3.88 GB (4170054024)
  2927. - PeakReservation: 360.00 MB (377487360)
  2928. - PeakUsedReservation: 0
  2929. - PerHostPeakMemUsage: 4.27 GB (4582467103)
  2930. - RowsProduced: 1.04M (1039227)
  2931. - TotalNetworkReceiveTime: 1s640ms
  2932. - TotalNetworkSendTime: 8s880ms
  2933. - TotalStorageWaitTime: 4m
  2934. - TotalThreadsInvoluntaryContextSwitches: 2.12K (2115)
  2935. - TotalThreadsTotalWallClockTime: 7m51s
  2936. - TotalThreadsSysTime: 23s169ms
  2937. - TotalThreadsUserTime: 25s409ms
  2938. - TotalThreadsVoluntaryContextSwitches: 93.28K (93277)
  2939. Buffer pool:
  2940. - AllocTime: 0.000ns
  2941. - CumulativeAllocationBytes: 8.00 MB (8388608)
  2942. - CumulativeAllocations: 2 (2)
  2943. - PeakReservation: 8.00 MB (8388608)
  2944. - PeakUnpinnedBytes: 0
  2945. - PeakUsedReservation: 8.00 MB (8388608)
  2946. - ReadIoBytes: 0
  2947. - ReadIoOps: 0 (0)
  2948. - ReadIoWaitTime: 0.000ns
  2949. - ReservationLimit: 8.00 MB (8388608)
  2950. - WriteIoBytes: 0
  2951. - WriteIoOps: 0 (0)
  2952. - WriteIoWaitTime: 0.000ns
  2953. Fragment Instance Lifecycle Timings:
  2954. - ExecTime: 23s016ms
  2955. - ExecTreeExecTime: 9s088ms
  2956. - OpenTime: 3s880ms
  2957. - ExecTreeOpenTime: 3s580ms
  2958. - PrepareTime: 4.000ms
  2959. - ExecTreePrepareTime: 0.000ns
  2960. KrpcDataStreamSender (dst_id=7):(Total: 9s584ms, non-child: 704.022ms, % non-child: 7.35%)
  2961. BytesSent(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 303.72 KB, 1.27 MB, 2.21 MB, 3.40 MB, 3.63 MB, 5.18 MB, 6.73 MB, 7.68 MB, 8.68 MB, 9.13 MB, 10.18 MB, 11.37 MB, 12.55 MB, 12.94 MB, 13.59 MB, 14.60 MB, 15.26 MB, 16.78 MB, 17.55 MB, 18.37 MB, 19.32 MB, 20.04 MB, 20.81 MB, 21.43 MB, 21.81 MB, 22.52 MB, 23.88 MB, 24.95 MB, 25.82 MB, 26.69 MB, 27.79 MB, 28.70 MB, 29.15 MB, 31.30 MB, 33.14 MB, 36.35 MB, 39.46 MB, 42.65 MB, 45.84 MB, 49.08 MB, 52.35 MB, 54.97 MB, 57.65 MB, 60.69 MB, 63.56 MB, 65.91 MB
  2962. - EosSent: 6 (6)
  2963. - NetworkThroughput: 1.74 MB/sec
  2964. - PeakMemoryUsage: 187.88 KB (192384)
  2965. - RowsSent: 1.04M (1039227)
  2966. - RpcFailure: 0 (0)
  2967. - RpcRetry: 0 (0)
  2968. - SerializeBatchTime: 296.009ms
  2969. - TotalBytesSent: 66.51 MB (69736581)
  2970. - UncompressedRowBatchSize: 92.17 MB (96648111)
  2971. HASH_JOIN_NODE (id=3):(Total: 12s668ms, non-child: 6s048ms, % non-child: 47.74%)
  2972. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  2973. - BuildRows: 7.36M (7358720)
  2974. - BuildTime: 1s128ms
  2975. - NumHashTableBuildsSkipped: 0 (0)
  2976. - PeakMemoryUsage: 352.36 MB (369477888)
  2977. - ProbeRows: 37.43M (37433843)
  2978. - ProbeRowsPartitioned: 0 (0)
  2979. - ProbeTime: 4s828ms
  2980. - RowsReturned: 1.04M (1039227)
  2981. - RowsReturnedRate: 82.03 K/sec
  2982. Buffer pool:
  2983. - AllocTime: 0.000ns
  2984. - CumulativeAllocationBytes: 352.00 MB (369098752)
  2985. - CumulativeAllocations: 64 (64)
  2986. - PeakReservation: 352.00 MB (369098752)
  2987. - PeakUnpinnedBytes: 0
  2988. - PeakUsedReservation: 352.00 MB (369098752)
  2989. - ReadIoBytes: 0
  2990. - ReadIoOps: 0 (0)
  2991. - ReadIoWaitTime: 0.000ns
  2992. - WriteIoBytes: 0
  2993. - WriteIoOps: 0 (0)
  2994. - WriteIoWaitTime: 0.000ns
  2995. Hash Join Builder (join_node_id=3):
  2996. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  2997. Runtime filters: 2 of 2 Runtime Filters Published
  2998. - BuildRowsPartitionTime: 564.018ms
  2999. - BuildRowsPartitioned: 7.36M (7358720)
  3000. - HashBuckets: 16.78M (16777216)
  3001. - HashCollisions: 0 (0)
  3002. - HashTablesBuildTime: 548.017ms
  3003. - LargestPartitionPercent: 6 (6)
  3004. - MaxPartitionLevel: 0 (0)
  3005. - NumRepartitions: 0 (0)
  3006. - PartitionsCreated: 16 (16)
  3007. - PeakMemoryUsage: 22.12 KB (22656)
  3008. - RepartitionTime: 0.000ns
  3009. - SpilledPartitions: 0 (0)
  3010. EXCHANGE_NODE (id=5):(Total: 1s752ms, non-child: 112.003ms, % non-child: 6.39%)
  3011. - ConvertRowBatchTime: 108.003ms
  3012. - PeakMemoryUsage: 12.69 MB (13302259)
  3013. - RowsReturned: 7.36M (7358720)
  3014. - RowsReturnedRate: 4.20 M/sec
  3015. Buffer pool:
  3016. - AllocTime: 20.000ms
  3017. - CumulativeAllocationBytes: 168.48 MB (176668672)
  3018. - CumulativeAllocations: 14.38K (14380)
  3019. - PeakReservation: 12.65 MB (13262848)
  3020. - PeakUnpinnedBytes: 0
  3021. - PeakUsedReservation: 12.65 MB (13262848)
  3022. - ReadIoBytes: 0
  3023. - ReadIoOps: 0 (0)
  3024. - ReadIoWaitTime: 0.000ns
  3025. - WriteIoBytes: 0
  3026. - WriteIoOps: 0 (0)
  3027. - WriteIoWaitTime: 0.000ns
  3028. Dequeue:
  3029. BytesDequeued(500.000ms): 0, 20.17 MB, 70.36 MB, 80.76 MB, 110.81 MB, 130.53 MB, 133.34 MB
  3030. - FirstBatchWaitTime: 0.000ns
  3031. - TotalBytesDequeued: 133.34 MB (139815680)
  3032. - TotalGetBatchTime: 1s640ms
  3033. - DataWaitTime: 1s640ms
  3034. Enqueue:
  3035. BytesReceived(500.000ms): 0, 10.11 MB, 35.22 MB, 40.42 MB, 55.48 MB, 65.34 MB, 66.74 MB
  3036. DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0
  3037. - DispatchTime: (Avg: 34.217us ; Min: 11.863us ; Max: 492.454us ; Number of samples: 7190)
  3038. - DeserializeRowBatchTime: 140.004ms
  3039. - TotalBatchesEnqueued: 7.19K (7190)
  3040. - TotalBatchesReceived: 7.19K (7190)
  3041. - TotalBytesReceived: 66.74 MB (69986621)
  3042. - TotalEarlySenders: 0 (0)
  3043. - TotalEosReceived: 6 (6)
  3044. - TotalHasDeferredRPCsTime: 12.443ms
  3045. - TotalRPCsDeferred: 5 (5)
  3046. HDFS_SCAN_NODE (id=2):(Total: 4s868ms, non-child: 4s868ms, % non-child: 100.00%)
  3047. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:70/8.45 GB
  3048. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 70 out of 70
  3049. Runtime filters: All filters arrived. Waited 0
  3050. Hdfs Read Thread Concurrency Bucket: 0:33.96% 1:0% 2:0% 3:1.887% 4:0% 5:64.15%
  3051. File Formats: PARQUET/NONE:49 PARQUET/SNAPPY:21
  3052. BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 167.74 MB, 353.14 MB, 565.89 MB, 1.04 GB, 1.25 GB, 1.30 GB, 1.43 GB, 1.57 GB, 1.63 GB, 1.68 GB, 1.79 GB, 1.84 GB, 2.00 GB, 2.10 GB, 2.14 GB, 2.22 GB, 2.29 GB, 2.39 GB, 2.48 GB, 2.56 GB, 2.67 GB, 2.75 GB, 2.87 GB, 2.92 GB, 3.07 GB, 3.27 GB, 3.33 GB, 3.56 GB, 3.81 GB, 3.92 GB, 4.16 GB, 4.27 GB, 4.34 GB, 4.40 GB, 4.59 GB, 4.65 GB, 4.74 GB, 4.87 GB, 4.91 GB, 4.97 GB, 5.06 GB, 5.07 GB, 5.09 GB, 5.10 GB, 5.14 GB, 5.14 GB, 5.15 GB
  3053. - FooterProcessingTime: (Avg: 162.348ms ; Min: 8.000ms ; Max: 884.028ms ; Number of samples: 70)
  3054. - AverageHdfsReadThreadConcurrency: 5.02
  3055. - AverageScannerThreadConcurrency: 16.49
  3056. - BytesRead: 5.15 GB (5526427855)
  3057. - BytesReadDataNodeCache: 0
  3058. - BytesReadLocal: 2.83 GB (3042418712)
  3059. - BytesReadRemoteUnexpected: 0
  3060. - BytesReadShortCircuit: 2.83 GB (3042418712)
  3061. - CachedFileHandlesHitCount: 255 (255)
  3062. - CachedFileHandlesMissCount: 215 (215)
  3063. - CollectionItemsRead: 0 (0)
  3064. - DecompressionTime: 13s680ms
  3065. - MaxCompressedTextFileLength: 0
  3066. - NumColumns: 10 (10)
  3067. - NumDictFilteredRowGroups: 0 (0)
  3068. - NumDisksAccessed: 2 (2)
  3069. - NumRowGroups: 21 (21)
  3070. - NumScannerThreadsStarted: 39 (39)
  3071. - NumScannersWithNoReads: 49 (49)
  3072. - NumStatsFilteredRowGroups: 0 (0)
  3073. - PeakMemoryUsage: 3.52 GB (3784031201)
  3074. - PerReadThreadRawHdfsThroughput: 39.78 MB/sec
  3075. - RemoteScanRanges: 452 (452)
  3076. - RowBatchQueueGetWaitTime: 4s604ms
  3077. - RowBatchQueuePutWaitTime: 2m22s
  3078. - RowsRead: 118.89M (118885376)
  3079. - RowsReturned: 37.43M (37433843)
  3080. - RowsReturnedRate: 7.69 M/sec
  3081. - ScanRangesComplete: 70 (70)
  3082. - ScannerThreadsInvoluntaryContextSwitches: 2.09K (2086)
  3083. - ScannerThreadsTotalWallClockTime: 7m21s
  3084. - MaterializeTupleTime(*): 31s217ms
  3085. - ScannerThreadsSysTime: 18s994ms
  3086. - ScannerThreadsUserTime: 18s343ms
  3087. - ScannerThreadsVoluntaryContextSwitches: 85.14K (85144)
  3088. - TotalRawHdfsOpenFileTime(*): 8s412ms
  3089. - TotalRawHdfsReadTime(*): 2m12s
  3090. - TotalReadThroughput: 195.20 MB/sec
  3091. Filter 4 (4.00 MB):
  3092. - Files processed: 0 (0)
  3093. - Files rejected: 0 (0)
  3094. - Files total: 0 (0)
  3095. - RowGroups processed: 0 (0)
  3096. - RowGroups rejected: 0 (0)
  3097. - RowGroups total: 0 (0)
  3098. - Rows processed: 1.36M (1363798)
  3099. - Rows rejected: 94.12K (94121)
  3100. - Rows total: 118.91M (118906880)
  3101. - Splits processed: 0 (0)
  3102. - Splits rejected: 0 (0)
  3103. - Splits total: 0 (0)
  3104. Filter 5 (4.00 MB):
  3105. - Files processed: 0 (0)
  3106. - Files rejected: 0 (0)
  3107. - Files total: 0 (0)
  3108. - RowGroups processed: 0 (0)
  3109. - RowGroups rejected: 0 (0)
  3110. - RowGroups total: 0 (0)
  3111. - Rows processed: 1.16M (1164328)
  3112. - Rows rejected: 31.86K (31861)
  3113. - Rows total: 118.81M (118812759)
  3114. - Splits processed: 0 (0)
  3115. - Splits rejected: 0 (0)
  3116. - Splits total: 0 (0)
  3117. CodeGen:(Total: 292.009ms, non-child: 292.009ms, % non-child: 100.00%)
  3118. - CodegenTime: 4.000ms
  3119. - CompileTime: 80.002ms
  3120. - LoadTime: 0.000ns
  3121. - ModuleBitcodeSize: 1.95 MB (2040108)
  3122. - NumFunctions: 113 (113)
  3123. - NumInstructions: 3.40K (3401)
  3124. - OptimizationTime: 192.006ms
  3125. - PeakMemoryUsage: 1.66 MB (1741312)
  3126. - PrepareTime: 20.000ms
  3127. Instance 33406f6405038287:b47e1f8b00000012 (host=slave-cn03:22000):(Total: 26s181ms, non-child: 4s740ms, % non-child: 18.11%)
  3128. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:69/8.34 GB
  3129. Filter 4 arrival: 2s651ms
  3130. Filter 5 arrival: 2s651ms
  3131. Fragment Instance Lifecycle Event Timeline: 26s185ms
  3132. - Prepare Finished: 12.000ms (12.000ms)
  3133. - Open Finished: 3s656ms (3s644ms)
  3134. - First Batch Produced: 3s676ms (20.000ms)
  3135. - First Batch Sent: 3s676ms (0.000ns)
  3136. - ExecInternal Finished: 26s185ms (22s509ms)
  3137. MemoryUsage(500.000ms): 9.76 MB, 54.74 MB, 84.74 MB, 84.74 MB, 116.74 MB, 116.74 MB, 340.75 MB, 744.47 MB, 1.12 GB, 1.44 GB, 1.90 GB, 2.27 GB, 2.31 GB, 2.40 GB, 2.48 GB, 2.57 GB, 2.52 GB, 2.67 GB, 2.79 GB, 2.75 GB, 2.78 GB, 2.87 GB, 2.88 GB, 3.01 GB, 3.26 GB, 3.28 GB, 3.38 GB, 3.39 GB, 3.68 GB, 3.70 GB, 3.64 GB, 3.72 GB, 3.85 GB, 3.84 GB, 3.82 GB, 3.76 GB, 3.76 GB, 3.74 GB, 3.73 GB, 3.73 GB, 3.69 GB, 3.63 GB, 3.35 GB, 3.20 GB, 3.11 GB, 3.02 GB, 2.80 GB, 2.46 GB, 2.29 GB, 2.15 GB, 1.43 GB, 1022.99 MB, 467.26 MB
  3138. ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 28, 23, 22, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 19, 19, 19, 19, 18, 17, 17, 16, 11, 7, 2
  3139. - AverageThreadTokens: 16.79
  3140. - BloomFilterBytes: 8.00 MB (8388608)
  3141. - PeakMemoryUsage: 3.85 GB (4137498994)
  3142. - PeakReservation: 360.00 MB (377487360)
  3143. - PeakUsedReservation: 0
  3144. - PerHostPeakMemUsage: 4.23 GB (4540696369)
  3145. - RowsProduced: 1.04M (1043018)
  3146. - TotalNetworkReceiveTime: 1s476ms
  3147. - TotalNetworkSendTime: 9s852ms
  3148. - TotalStorageWaitTime: 1m30s
  3149. - TotalThreadsInvoluntaryContextSwitches: 3.04K (3043)
  3150. - TotalThreadsTotalWallClockTime: 7m32s
  3151. - TotalThreadsSysTime: 27s385ms
  3152. - TotalThreadsUserTime: 25s596ms
  3153. - TotalThreadsVoluntaryContextSwitches: 97.06K (97065)
  3154. Buffer pool:
  3155. - AllocTime: 0.000ns
  3156. - CumulativeAllocationBytes: 8.00 MB (8388608)
  3157. - CumulativeAllocations: 2 (2)
  3158. - PeakReservation: 8.00 MB (8388608)
  3159. - PeakUnpinnedBytes: 0
  3160. - PeakUsedReservation: 8.00 MB (8388608)
  3161. - ReadIoBytes: 0
  3162. - ReadIoOps: 0 (0)
  3163. - ReadIoWaitTime: 0.000ns
  3164. - ReservationLimit: 8.00 MB (8388608)
  3165. - WriteIoBytes: 0
  3166. - WriteIoOps: 0 (0)
  3167. - WriteIoWaitTime: 0.000ns
  3168. Fragment Instance Lifecycle Timings:
  3169. - ExecTime: 22s529ms
  3170. - ExecTreeExecTime: 7s208ms
  3171. - OpenTime: 3s644ms
  3172. - ExecTreeOpenTime: 3s332ms
  3173. - PrepareTime: 8.000ms
  3174. - ExecTreePrepareTime: 0.000ns
  3175. KrpcDataStreamSender (dst_id=7):(Total: 10s592ms, non-child: 740.033ms, % non-child: 6.99%)
  3176. BytesSent(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 1.32 MB, 3.12 MB, 4.67 MB, 5.78 MB, 7.78 MB, 8.91 MB, 9.75 MB, 10.64 MB, 12.17 MB, 13.73 MB, 15.18 MB, 16.77 MB, 18.52 MB, 19.70 MB, 20.75 MB, 21.32 MB, 22.26 MB, 23.27 MB, 24.21 MB, 25.16 MB, 25.84 MB, 26.94 MB, 27.54 MB, 27.88 MB, 28.22 MB, 29.50 MB, 31.56 MB, 33.12 MB, 33.80 MB, 35.43 MB, 36.83 MB, 37.64 MB, 39.19 MB, 41.13 MB, 43.23 MB, 44.97 MB, 48.01 MB, 50.94 MB, 53.05 MB, 55.10 MB, 57.81 MB, 60.46 MB, 62.58 MB, 65.05 MB, 66.73 MB
  3177. - EosSent: 6 (6)
  3178. - NetworkThroughput: 1.83 MB/sec
  3179. - PeakMemoryUsage: 187.88 KB (192384)
  3180. - RowsSent: 1.04M (1043018)
  3181. - RpcFailure: 0 (0)
  3182. - RpcRetry: 0 (0)
  3183. - SerializeBatchTime: 360.016ms
  3184. - TotalBytesSent: 66.84 MB (70082541)
  3185. - UncompressedRowBatchSize: 92.51 MB (97000674)
  3186. HASH_JOIN_NODE (id=3):(Total: 10s540ms, non-child: 7s028ms, % non-child: 66.68%)
  3187. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  3188. - BuildRows: 7.36M (7358720)
  3189. - BuildTime: 1s252ms
  3190. - NumHashTableBuildsSkipped: 0 (0)
  3191. - PeakMemoryUsage: 352.36 MB (369473792)
  3192. - ProbeRows: 37.66M (37657452)
  3193. - ProbeRowsPartitioned: 0 (0)
  3194. - ProbeTime: 5s696ms
  3195. - RowsReturned: 1.04M (1043018)
  3196. - RowsReturnedRate: 98.95 K/sec
  3197. Buffer pool:
  3198. - AllocTime: 4.000ms
  3199. - CumulativeAllocationBytes: 352.00 MB (369098752)
  3200. - CumulativeAllocations: 64 (64)
  3201. - PeakReservation: 352.00 MB (369098752)
  3202. - PeakUnpinnedBytes: 0
  3203. - PeakUsedReservation: 352.00 MB (369098752)
  3204. - ReadIoBytes: 0
  3205. - ReadIoOps: 0 (0)
  3206. - ReadIoWaitTime: 0.000ns
  3207. - WriteIoBytes: 0
  3208. - WriteIoOps: 0 (0)
  3209. - WriteIoWaitTime: 0.000ns
  3210. Hash Join Builder (join_node_id=3):
  3211. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  3212. Runtime filters: 2 of 2 Runtime Filters Published
  3213. - BuildRowsPartitionTime: 704.032ms
  3214. - BuildRowsPartitioned: 7.36M (7358720)
  3215. - HashBuckets: 16.78M (16777216)
  3216. - HashCollisions: 0 (0)
  3217. - HashTablesBuildTime: 540.024ms
  3218. - LargestPartitionPercent: 6 (6)
  3219. - MaxPartitionLevel: 0 (0)
  3220. - NumRepartitions: 0 (0)
  3221. - PartitionsCreated: 16 (16)
  3222. - PeakMemoryUsage: 22.12 KB (22656)
  3223. - RepartitionTime: 0.000ns
  3224. - SpilledPartitions: 0 (0)
  3225. EXCHANGE_NODE (id=5):(Total: 1s600ms, non-child: 132.006ms, % non-child: 8.25%)
  3226. - ConvertRowBatchTime: 124.005ms
  3227. - PeakMemoryUsage: 12.69 MB (13302259)
  3228. - RowsReturned: 7.36M (7358720)
  3229. - RowsReturnedRate: 4.60 M/sec
  3230. Buffer pool:
  3231. - AllocTime: 20.000ms
  3232. - CumulativeAllocationBytes: 168.48 MB (176668672)
  3233. - CumulativeAllocations: 14.38K (14380)
  3234. - PeakReservation: 12.65 MB (13262848)
  3235. - PeakUnpinnedBytes: 0
  3236. - PeakUsedReservation: 12.65 MB (13262848)
  3237. - ReadIoBytes: 0
  3238. - ReadIoOps: 0 (0)
  3239. - ReadIoWaitTime: 0.000ns
  3240. - WriteIoBytes: 0
  3241. - WriteIoOps: 0 (0)
  3242. - WriteIoWaitTime: 0.000ns
  3243. Dequeue:
  3244. BytesDequeued(500.000ms): 0, 24.10 MB, 71.13 MB, 81.22 MB, 113.00 MB, 131.74 MB, 133.34 MB
  3245. - FirstBatchWaitTime: 0.000ns
  3246. - TotalBytesDequeued: 133.34 MB (139815680)
  3247. - TotalGetBatchTime: 1s472ms
  3248. - DataWaitTime: 1s468ms
  3249. Enqueue:
  3250. BytesReceived(500.000ms): 9.50 KB, 12.09 MB, 35.60 MB, 40.66 MB, 56.56 MB, 65.94 MB, 66.74 MB
  3251. DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0
  3252. - DispatchTime: (Avg: 34.552us ; Min: 10.755us ; Max: 601.426us ; Number of samples: 7190)
  3253. - DeserializeRowBatchTime: 172.007ms
  3254. - TotalBatchesEnqueued: 7.19K (7190)
  3255. - TotalBatchesReceived: 7.19K (7190)
  3256. - TotalBytesReceived: 66.74 MB (69986621)
  3257. - TotalEarlySenders: 0 (0)
  3258. - TotalEosReceived: 6 (6)
  3259. - TotalHasDeferredRPCsTime: 35.180ms
  3260. - TotalRPCsDeferred: 5 (5)
  3261. HDFS_SCAN_NODE (id=2):(Total: 1s912ms, non-child: 1s912ms, % non-child: 100.00%)
  3262. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:69/8.34 GB
  3263. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 69 out of 69
  3264. Runtime filters: All filters arrived. Waited 0
  3265. Hdfs Read Thread Concurrency Bucket: 0:30.77% 1:11.54% 2:5.769% 3:1.923% 4:0% 5:50%
  3266. File Formats: PARQUET/NONE:47 PARQUET/SNAPPY:22
  3267. BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 288.13 MB, 650.36 MB, 1.01 GB, 1.53 GB, 1.86 GB, 1.93 GB, 2.04 GB, 2.13 GB, 2.24 GB, 2.30 GB, 2.56 GB, 2.71 GB, 2.75 GB, 2.80 GB, 2.95 GB, 3.00 GB, 3.22 GB, 3.58 GB, 3.62 GB, 3.74 GB, 3.83 GB, 4.12 GB, 4.14 GB, 4.14 GB, 4.23 GB, 4.37 GB, 4.46 GB, 4.53 GB, 4.76 GB, 4.77 GB, 4.79 GB, 4.84 GB, 4.86 GB, 4.86 GB, 4.91 GB, 4.97 GB, 5.01 GB, 5.08 GB, 5.09 GB, 5.11 GB, 5.14 GB, 5.16 GB, 5.17 GB, 5.17 GB, 5.18 GB, 5.18 GB
  3268. - FooterProcessingTime: (Avg: 111.599ms ; Min: 8.000ms ; Max: 508.023ms ; Number of samples: 69)
  3269. - AverageHdfsReadThreadConcurrency: 4.25
  3270. - AverageScannerThreadConcurrency: 15.98
  3271. - BytesRead: 5.18 GB (5557793950)
  3272. - BytesReadDataNodeCache: 0
  3273. - BytesReadLocal: 3.44 GB (3696378210)
  3274. - BytesReadRemoteUnexpected: 0
  3275. - BytesReadShortCircuit: 3.44 GB (3696378210)
  3276. - CachedFileHandlesHitCount: 259 (259)
  3277. - CachedFileHandlesMissCount: 220 (220)
  3278. - CollectionItemsRead: 0 (0)
  3279. - DecompressionTime: 15s512ms
  3280. - MaxCompressedTextFileLength: 0
  3281. - NumColumns: 10 (10)
  3282. - NumDictFilteredRowGroups: 0 (0)
  3283. - NumDisksAccessed: 2 (2)
  3284. - NumRowGroups: 22 (22)
  3285. - NumScannerThreadsStarted: 39 (39)
  3286. - NumScannersWithNoReads: 47 (47)
  3287. - NumStatsFilteredRowGroups: 0 (0)
  3288. - PeakMemoryUsage: 3.49 GB (3751795659)
  3289. - PerReadThreadRawHdfsThroughput: 48.32 MB/sec
  3290. - RemoteScanRanges: 361 (361)
  3291. - RowBatchQueueGetWaitTime: 1s460ms
  3292. - RowBatchQueuePutWaitTime: 4m34s
  3293. - RowsRead: 119.44M (119441408)
  3294. - RowsReturned: 37.66M (37657452)
  3295. - RowsReturnedRate: 19.69 M/sec
  3296. - ScanRangesComplete: 69 (69)
  3297. - ScannerThreadsInvoluntaryContextSwitches: 3.00K (3004)
  3298. - ScannerThreadsTotalWallClockTime: 7m3s
  3299. - MaterializeTupleTime(*): 30s957ms
  3300. - ScannerThreadsSysTime: 21s938ms
  3301. - ScannerThreadsUserTime: 18s293ms
  3302. - ScannerThreadsVoluntaryContextSwitches: 90.29K (90286)
  3303. - TotalRawHdfsOpenFileTime(*): 4s016ms
  3304. - TotalRawHdfsReadTime(*): 1m49s
  3305. - TotalReadThroughput: 200.01 MB/sec
  3306. Filter 4 (4.00 MB):
  3307. - Files processed: 0 (0)
  3308. - Files rejected: 0 (0)
  3309. - Files total: 0 (0)
  3310. - RowGroups processed: 0 (0)
  3311. - RowGroups rejected: 0 (0)
  3312. - RowGroups total: 0 (0)
  3313. - Rows processed: 1.39M (1393219)
  3314. - Rows rejected: 99.22K (99216)
  3315. - Rows total: 119.46M (119462912)
  3316. - Splits processed: 0 (0)
  3317. - Splits rejected: 0 (0)
  3318. - Splits total: 0 (0)
  3319. Filter 5 (4.00 MB):
  3320. - Files processed: 0 (0)
  3321. - Files rejected: 0 (0)
  3322. - Files total: 0 (0)
  3323. - RowGroups processed: 0 (0)
  3324. - RowGroups rejected: 0 (0)
  3325. - RowGroups total: 0 (0)
  3326. - Rows processed: 1.19M (1187446)
  3327. - Rows rejected: 25.89K (25892)
  3328. - Rows total: 119.36M (119363696)
  3329. - Splits processed: 0 (0)
  3330. - Splits rejected: 0 (0)
  3331. - Splits total: 0 (0)
  3332. CodeGen:(Total: 308.014ms, non-child: 308.014ms, % non-child: 100.00%)
  3333. - CodegenTime: 4.000ms
  3334. - CompileTime: 84.003ms
  3335. - LoadTime: 0.000ns
  3336. - ModuleBitcodeSize: 1.95 MB (2040108)
  3337. - NumFunctions: 113 (113)
  3338. - NumInstructions: 3.40K (3401)
  3339. - OptimizationTime: 204.009ms
  3340. - PeakMemoryUsage: 1.66 MB (1741312)
  3341. - PrepareTime: 20.000ms
  3342. Instance 33406f6405038287:b47e1f8b0000000f (host=slave-cn05:22000):(Total: 23s597ms, non-child: 3s496ms, % non-child: 14.82%)
  3343. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:71/8.41 GB
  3344. Filter 4 arrival: 2s652ms
  3345. Filter 5 arrival: 2s652ms
  3346. Fragment Instance Lifecycle Event Timeline: 23s597ms
  3347. - Prepare Finished: 4.000ms (4.000ms)
  3348. - Open Finished: 3s524ms (3s520ms)
  3349. - First Batch Produced: 3s544ms (20.001ms)
  3350. - First Batch Sent: 3s544ms (0.000ns)
  3351. - ExecInternal Finished: 23s597ms (20s053ms)
  3352. MemoryUsage(500.000ms): 54.74 MB, 84.74 MB, 84.74 MB, 84.74 MB, 116.74 MB, 292.75 MB, 593.23 MB, 845.70 MB, 1.19 GB, 1.82 GB, 1.76 GB, 1.78 GB, 1.82 GB, 1.83 GB, 2.04 GB, 2.14 GB, 2.28 GB, 2.30 GB, 2.39 GB, 2.54 GB, 2.73 GB, 2.86 GB, 2.90 GB, 2.93 GB, 2.94 GB, 2.94 GB, 2.92 GB, 2.92 GB, 2.90 GB, 2.90 GB, 2.85 GB, 2.86 GB, 2.83 GB, 2.72 GB, 2.70 GB, 2.57 GB, 2.55 GB, 2.48 GB, 2.42 GB, 2.41 GB, 2.42 GB, 2.33 GB, 2.04 GB, 1.86 GB, 1.38 GB, 1008.04 MB, 460.02 MB
  3353. ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 37, 27, 19, 19, 18, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 14, 14, 14, 14, 14, 14, 14, 13, 13, 10, 7, 2
  3354. - AverageThreadTokens: 13.51
  3355. - BloomFilterBytes: 8.00 MB (8388608)
  3356. - PeakMemoryUsage: 2.95 GB (3170577591)
  3357. - PeakReservation: 360.00 MB (377487360)
  3358. - PeakUsedReservation: 0
  3359. - PerHostPeakMemUsage: 3.09 GB (3313067929)
  3360. - RowsProduced: 785.44K (785438)
  3361. - TotalNetworkReceiveTime: 1s324ms
  3362. - TotalNetworkSendTime: 10s316ms
  3363. - TotalStorageWaitTime: 59s903ms
  3364. - TotalThreadsInvoluntaryContextSwitches: 1.75K (1747)
  3365. - TotalThreadsTotalWallClockTime: 5m18s
  3366. - TotalThreadsSysTime: 20s011ms
  3367. - TotalThreadsUserTime: 19s948ms
  3368. - TotalThreadsVoluntaryContextSwitches: 62.79K (62791)
  3369. Buffer pool:
  3370. - AllocTime: 0.000ns
  3371. - CumulativeAllocationBytes: 8.00 MB (8388608)
  3372. - CumulativeAllocations: 2 (2)
  3373. - PeakReservation: 8.00 MB (8388608)
  3374. - PeakUnpinnedBytes: 0
  3375. - PeakUsedReservation: 8.00 MB (8388608)
  3376. - ReadIoBytes: 0
  3377. - ReadIoOps: 0 (0)
  3378. - ReadIoWaitTime: 0.000ns
  3379. - ReservationLimit: 8.00 MB (8388608)
  3380. - WriteIoBytes: 0
  3381. - WriteIoOps: 0 (0)
  3382. - WriteIoWaitTime: 0.000ns
  3383. Fragment Instance Lifecycle Timings:
  3384. - ExecTime: 20s073ms
  3385. - ExecTreeExecTime: 5s632ms
  3386. - OpenTime: 3s520ms
  3387. - ExecTreeOpenTime: 3s052ms
  3388. - PrepareTime: 4.000ms
  3389. - ExecTreePrepareTime: 4.000ms
  3390. KrpcDataStreamSender (dst_id=7):(Total: 10s940ms, non-child: 620.033ms, % non-child: 5.67%)
  3391. BytesSent(500.000ms): 0, 0, 0, 0, 0, 0, 0, 1.27 MB, 2.21 MB, 3.87 MB, 4.90 MB, 6.48 MB, 7.14 MB, 8.25 MB, 9.04 MB, 10.14 MB, 11.15 MB, 12.14 MB, 13.12 MB, 14.33 MB, 15.31 MB, 16.15 MB, 16.91 MB, 17.74 MB, 18.99 MB, 20.12 MB, 21.19 MB, 22.19 MB, 23.40 MB, 23.67 MB, 24.58 MB, 25.44 MB, 27.06 MB, 28.82 MB, 30.66 MB, 31.98 MB, 32.31 MB, 33.68 MB, 34.75 MB, 35.09 MB, 35.53 MB, 37.72 MB, 40.10 MB, 43.27 MB, 45.91 MB, 48.75 MB, 50.17 MB
  3392. - EosSent: 6 (6)
  3393. - NetworkThroughput: 1.23 MB/sec
  3394. - PeakMemoryUsage: 187.88 KB (192384)
  3395. - RowsSent: 785.44K (785438)
  3396. - RpcFailure: 0 (0)
  3397. - RpcRetry: 0 (0)
  3398. - SerializeBatchTime: 248.013ms
  3399. - TotalBytesSent: 50.33 MB (52772277)
  3400. - UncompressedRowBatchSize: 69.66 MB (73045734)
  3401. HASH_JOIN_NODE (id=3):(Total: 8s692ms, non-child: 5s760ms, % non-child: 66.27%)
  3402. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  3403. - BuildRows: 7.36M (7358720)
  3404. - BuildTime: 1s312ms
  3405. - NumHashTableBuildsSkipped: 0 (0)
  3406. - PeakMemoryUsage: 352.36 MB (369473792)
  3407. - ProbeRows: 28.18M (28178964)
  3408. - ProbeRowsPartitioned: 0 (0)
  3409. - ProbeTime: 4s360ms
  3410. - RowsReturned: 785.44K (785438)
  3411. - RowsReturnedRate: 90.36 K/sec
  3412. Buffer pool:
  3413. - AllocTime: 4.000ms
  3414. - CumulativeAllocationBytes: 352.00 MB (369098752)
  3415. - CumulativeAllocations: 64 (64)
  3416. - PeakReservation: 352.00 MB (369098752)
  3417. - PeakUnpinnedBytes: 0
  3418. - PeakUsedReservation: 352.00 MB (369098752)
  3419. - ReadIoBytes: 0
  3420. - ReadIoOps: 0 (0)
  3421. - ReadIoWaitTime: 0.000ns
  3422. - WriteIoBytes: 0
  3423. - WriteIoOps: 0 (0)
  3424. - WriteIoWaitTime: 0.000ns
  3425. Hash Join Builder (join_node_id=3):
  3426. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  3427. Runtime filters: 2 of 2 Runtime Filters Published
  3428. - BuildRowsPartitionTime: 748.040ms
  3429. - BuildRowsPartitioned: 7.36M (7358720)
  3430. - HashBuckets: 16.78M (16777216)
  3431. - HashCollisions: 0 (0)
  3432. - HashTablesBuildTime: 552.030ms
  3433. - LargestPartitionPercent: 6 (6)
  3434. - MaxPartitionLevel: 0 (0)
  3435. - NumRepartitions: 0 (0)
  3436. - PartitionsCreated: 16 (16)
  3437. - PeakMemoryUsage: 22.12 KB (22656)
  3438. - RepartitionTime: 0.000ns
  3439. - SpilledPartitions: 0 (0)
  3440. EXCHANGE_NODE (id=5):(Total: 1s400ms, non-child: 84.004ms, % non-child: 6.00%)
  3441. - ConvertRowBatchTime: 72.003ms
  3442. - PeakMemoryUsage: 12.69 MB (13302259)
  3443. - RowsReturned: 7.36M (7358720)
  3444. - RowsReturnedRate: 5.26 M/sec
  3445. Buffer pool:
  3446. - AllocTime: 56.003ms
  3447. - CumulativeAllocationBytes: 168.48 MB (176668672)
  3448. - CumulativeAllocations: 14.38K (14380)
  3449. - PeakReservation: 12.65 MB (13262848)
  3450. - PeakUnpinnedBytes: 0
  3451. - PeakUsedReservation: 12.65 MB (13262848)
  3452. - ReadIoBytes: 0
  3453. - ReadIoOps: 0 (0)
  3454. - ReadIoWaitTime: 0.000ns
  3455. - WriteIoBytes: 0
  3456. - WriteIoOps: 0 (0)
  3457. - WriteIoWaitTime: 0.000ns
  3458. Dequeue:
  3459. BytesDequeued(500.000ms): 2.21 MB, 64.87 MB, 78.96 MB, 105.89 MB, 128.03 MB, 133.34 MB
  3460. - FirstBatchWaitTime: 0.000ns
  3461. - TotalBytesDequeued: 133.34 MB (139815680)
  3462. - TotalGetBatchTime: 1s324ms
  3463. - DataWaitTime: 1s316ms
  3464. Enqueue:
  3465. BytesReceived(500.000ms): 5.70 MB, 32.47 MB, 39.52 MB, 53.01 MB, 64.09 MB, 66.74 MB
  3466. DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0
  3467. - DispatchTime: (Avg: 32.412us ; Min: 11.955us ; Max: 910.100us ; Number of samples: 7190)
  3468. - DeserializeRowBatchTime: 192.010ms
  3469. - TotalBatchesEnqueued: 7.19K (7190)
  3470. - TotalBatchesReceived: 7.19K (7190)
  3471. - TotalBytesReceived: 66.74 MB (69986621)
  3472. - TotalEarlySenders: 0 (0)
  3473. - TotalEosReceived: 6 (6)
  3474. - TotalHasDeferredRPCsTime: 184.543ms
  3475. - TotalRPCsDeferred: 5 (5)
  3476. HDFS_SCAN_NODE (id=2):(Total: 1s532ms, non-child: 1s532ms, % non-child: 100.00%)
  3477. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:71/8.41 GB
  3478. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 71 out of 71
  3479. Runtime filters: All filters arrived. Waited 0
  3480. Hdfs Read Thread Concurrency Bucket: 0:53.19% 1:4.255% 2:0% 3:4.255% 4:0% 5:38.3%
  3481. File Formats: PARQUET/NONE:52 PARQUET/SNAPPY:19
  3482. BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 151.61 MB, 405.61 MB, 751.67 MB, 1.29 GB, 1.40 GB, 1.54 GB, 1.62 GB, 1.67 GB, 1.92 GB, 2.09 GB, 2.22 GB, 2.29 GB, 2.43 GB, 2.56 GB, 2.81 GB, 3.00 GB, 3.08 GB, 3.24 GB, 3.29 GB, 3.32 GB, 3.40 GB, 3.43 GB, 3.46 GB, 3.53 GB, 3.55 GB, 3.59 GB, 3.67 GB, 3.68 GB, 3.72 GB, 3.78 GB, 3.80 GB, 3.85 GB, 3.86 GB, 3.86 GB, 3.86 GB, 3.88 GB, 3.91 GB, 3.94 GB, 3.94 GB, 3.95 GB, 3.95 GB
  3483. - FooterProcessingTime: (Avg: 180.066ms ; Min: 12.000ms ; Max: 812.044ms ; Number of samples: 71)
  3484. - AverageHdfsReadThreadConcurrency: 3.11
  3485. - AverageScannerThreadConcurrency: 12.38
  3486. - BytesRead: 3.95 GB (4244117332)
  3487. - BytesReadDataNodeCache: 0
  3488. - BytesReadLocal: 2.70 GB (2904282179)
  3489. - BytesReadRemoteUnexpected: 0
  3490. - BytesReadShortCircuit: 2.70 GB (2904282179)
  3491. - CachedFileHandlesHitCount: 229 (229)
  3492. - CachedFileHandlesMissCount: 180 (180)
  3493. - CollectionItemsRead: 0 (0)
  3494. - DecompressionTime: 11s448ms
  3495. - MaxCompressedTextFileLength: 0
  3496. - NumColumns: 10 (10)
  3497. - NumDictFilteredRowGroups: 0 (0)
  3498. - NumDisksAccessed: 2 (2)
  3499. - NumRowGroups: 19 (19)
  3500. - NumScannerThreadsStarted: 39 (39)
  3501. - NumScannersWithNoReads: 52 (52)
  3502. - NumStatsFilteredRowGroups: 0 (0)
  3503. - PeakMemoryUsage: 2.59 GB (2784698128)
  3504. - PerReadThreadRawHdfsThroughput: 56.18 MB/sec
  3505. - RemoteScanRanges: 277 (277)
  3506. - RowBatchQueueGetWaitTime: 1s292ms
  3507. - RowBatchQueuePutWaitTime: 3m10s
  3508. - RowsRead: 89.50M (89498624)
  3509. - RowsReturned: 28.18M (28178964)
  3510. - RowsReturnedRate: 18.39 M/sec
  3511. - ScanRangesComplete: 71 (71)
  3512. - ScannerThreadsInvoluntaryContextSwitches: 1.72K (1716)
  3513. - ScannerThreadsTotalWallClockTime: 4m51s
  3514. - MaterializeTupleTime(*): 20s117ms
  3515. - ScannerThreadsSysTime: 15s891ms
  3516. - ScannerThreadsUserTime: 13s791ms
  3517. - ScannerThreadsVoluntaryContextSwitches: 56.99K (56990)
  3518. - TotalRawHdfsOpenFileTime(*): 4s744ms
  3519. - TotalRawHdfsReadTime(*): 1m12s
  3520. - TotalReadThroughput: 172.23 MB/sec
  3521. Filter 4 (4.00 MB):
  3522. - Files processed: 0 (0)
  3523. - Files rejected: 0 (0)
  3524. - Files total: 0 (0)
  3525. - RowGroups processed: 0 (0)
  3526. - RowGroups rejected: 0 (0)
  3527. - RowGroups total: 0 (0)
  3528. - Rows processed: 1.10M (1104621)
  3529. - Rows rejected: 72.22K (72220)
  3530. - Rows total: 89.51M (89513984)
  3531. - Splits processed: 0 (0)
  3532. - Splits rejected: 0 (0)
  3533. - Splits total: 0 (0)
  3534. Filter 5 (4.00 MB):
  3535. - Files processed: 0 (0)
  3536. - Files rejected: 0 (0)
  3537. - Files total: 0 (0)
  3538. - RowGroups processed: 0 (0)
  3539. - RowGroups rejected: 0 (0)
  3540. - RowGroups total: 0 (0)
  3541. - Rows processed: 1.03M (1032401)
  3542. - Rows rejected: 23.21K (23213)
  3543. - Rows total: 89.44M (89441764)
  3544. - Splits processed: 0 (0)
  3545. - Splits rejected: 0 (0)
  3546. - Splits total: 0 (0)
  3547. CodeGen:(Total: 468.025ms, non-child: 468.025ms, % non-child: 100.00%)
  3548. - CodegenTime: 0.000ns
  3549. - CompileTime: 100.005ms
  3550. - LoadTime: 0.000ns
  3551. - ModuleBitcodeSize: 1.95 MB (2040108)
  3552. - NumFunctions: 113 (113)
  3553. - NumInstructions: 3.40K (3401)
  3554. - OptimizationTime: 332.018ms
  3555. - PeakMemoryUsage: 1.66 MB (1741312)
  3556. - PrepareTime: 32.001ms
  3557. Instance 33406f6405038287:b47e1f8b00000010 (host=slave-cn04:22000):(Total: 22s353ms, non-child: 4s452ms, % non-child: 19.92%)
  3558. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:71/8.48 GB
  3559. Filter 4 arrival: 2s652ms
  3560. Filter 5 arrival: 2s652ms
  3561. Fragment Instance Lifecycle Event Timeline: 22s353ms
  3562. - Prepare Finished: 4.000ms (4.000ms)
  3563. - Open Finished: 3s524ms (3s520ms)
  3564. - First Batch Produced: 3s544ms (20.001ms)
  3565. - First Batch Sent: 3s544ms (0.000ns)
  3566. - ExecInternal Finished: 22s353ms (18s808ms)
  3567. MemoryUsage(500.000ms): 10.09 MB, 54.74 MB, 84.74 MB, 84.74 MB, 116.74 MB, 116.74 MB, 340.75 MB, 2.49 GB, 2.98 GB, 3.27 GB, 3.62 GB, 3.63 GB, 3.57 GB, 3.57 GB, 3.39 GB, 3.40 GB, 3.41 GB, 3.42 GB, 3.41 GB, 3.40 GB, 3.37 GB, 3.39 GB, 3.37 GB, 3.35 GB, 3.33 GB, 3.32 GB, 3.30 GB, 3.30 GB, 3.28 GB, 3.26 GB, 3.25 GB, 3.23 GB, 3.19 GB, 3.11 GB, 3.01 GB, 2.98 GB, 2.81 GB, 2.68 GB, 2.59 GB, 2.58 GB, 2.46 GB, 2.25 GB, 1.94 GB, 1.50 GB, 827.15 MB
  3568. ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 35, 21, 21, 21, 21, 20, 20, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 15, 13, 7
  3569. - AverageThreadTokens: 15.18
  3570. - BloomFilterBytes: 8.00 MB (8388608)
  3571. - PeakMemoryUsage: 3.63 GB (3903038918)
  3572. - PeakReservation: 360.00 MB (377487360)
  3573. - PeakUsedReservation: 0
  3574. - PerHostPeakMemUsage: 3.83 GB (4109447221)
  3575. - RowsProduced: 881.77K (881771)
  3576. - TotalNetworkReceiveTime: 1s496ms
  3577. - TotalNetworkSendTime: 7s900ms
  3578. - TotalStorageWaitTime: 23s333ms
  3579. - TotalThreadsInvoluntaryContextSwitches: 4.00K (3999)
  3580. - TotalThreadsTotalWallClockTime: 5m47s
  3581. - TotalThreadsSysTime: 26s054ms
  3582. - TotalThreadsUserTime: 22s330ms
  3583. - TotalThreadsVoluntaryContextSwitches: 83.22K (83223)
  3584. Buffer pool:
  3585. - AllocTime: 0.000ns
  3586. - CumulativeAllocationBytes: 8.00 MB (8388608)
  3587. - CumulativeAllocations: 2 (2)
  3588. - PeakReservation: 8.00 MB (8388608)
  3589. - PeakUnpinnedBytes: 0
  3590. - PeakUsedReservation: 8.00 MB (8388608)
  3591. - ReadIoBytes: 0
  3592. - ReadIoOps: 0 (0)
  3593. - ReadIoWaitTime: 0.000ns
  3594. - ReservationLimit: 8.00 MB (8388608)
  3595. - WriteIoBytes: 0
  3596. - WriteIoOps: 0 (0)
  3597. - WriteIoWaitTime: 0.000ns
  3598. Fragment Instance Lifecycle Timings:
  3599. - ExecTime: 18s828ms
  3600. - ExecTreeExecTime: 5s720ms
  3601. - OpenTime: 3s520ms
  3602. - ExecTreeOpenTime: 3s212ms
  3603. - PrepareTime: 4.000ms
  3604. - ExecTreePrepareTime: 0.000ns
  3605. KrpcDataStreamSender (dst_id=7):(Total: 8s672ms, non-child: 772.040ms, % non-child: 8.90%)
  3606. BytesSent(500.000ms): 0, 0, 0, 0, 0, 0, 0, 165.50 KB, 2.99 MB, 5.14 MB, 6.54 MB, 8.65 MB, 9.86 MB, 10.59 MB, 12.50 MB, 14.18 MB, 15.13 MB, 16.76 MB, 18.26 MB, 20.01 MB, 21.84 MB, 22.64 MB, 23.98 MB, 25.13 MB, 26.19 MB, 27.25 MB, 28.38 MB, 29.52 MB, 30.73 MB, 31.94 MB, 33.01 MB, 33.84 MB, 34.94 MB, 36.79 MB, 38.57 MB, 39.02 MB, 40.28 MB, 41.89 MB, 43.16 MB, 44.46 MB, 46.03 MB, 48.53 MB, 51.24 MB, 53.72 MB, 56.15 MB
  3607. - EosSent: 6 (6)
  3608. - NetworkThroughput: 1.82 MB/sec
  3609. - PeakMemoryUsage: 187.88 KB (192384)
  3610. - RowsSent: 881.77K (881771)
  3611. - RpcFailure: 0 (0)
  3612. - RpcRetry: 0 (0)
  3613. - SerializeBatchTime: 284.014ms
  3614. - TotalBytesSent: 56.52 MB (59269855)
  3615. - UncompressedRowBatchSize: 78.21 MB (82004703)
  3616. HASH_JOIN_NODE (id=3):(Total: 8s928ms, non-child: 6s376ms, % non-child: 71.42%)
  3617. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  3618. - BuildRows: 7.36M (7358720)
  3619. - BuildTime: 1s252ms
  3620. - NumHashTableBuildsSkipped: 0 (0)
  3621. - PeakMemoryUsage: 352.36 MB (369473792)
  3622. - ProbeRows: 31.95M (31952459)
  3623. - ProbeRowsPartitioned: 0 (0)
  3624. - ProbeTime: 5s080ms
  3625. - RowsReturned: 881.77K (881771)
  3626. - RowsReturnedRate: 98.76 K/sec
  3627. Buffer pool:
  3628. - AllocTime: 4.000ms
  3629. - CumulativeAllocationBytes: 352.00 MB (369098752)
  3630. - CumulativeAllocations: 64 (64)
  3631. - PeakReservation: 352.00 MB (369098752)
  3632. - PeakUnpinnedBytes: 0
  3633. - PeakUsedReservation: 352.00 MB (369098752)
  3634. - ReadIoBytes: 0
  3635. - ReadIoOps: 0 (0)
  3636. - ReadIoWaitTime: 0.000ns
  3637. - WriteIoBytes: 0
  3638. - WriteIoOps: 0 (0)
  3639. - WriteIoWaitTime: 0.000ns
  3640. Hash Join Builder (join_node_id=3):
  3641. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  3642. Runtime filters: 2 of 2 Runtime Filters Published
  3643. - BuildRowsPartitionTime: 692.036ms
  3644. - BuildRowsPartitioned: 7.36M (7358720)
  3645. - HashBuckets: 16.78M (16777216)
  3646. - HashCollisions: 0 (0)
  3647. - HashTablesBuildTime: 552.029ms
  3648. - LargestPartitionPercent: 6 (6)
  3649. - MaxPartitionLevel: 0 (0)
  3650. - NumRepartitions: 0 (0)
  3651. - PartitionsCreated: 16 (16)
  3652. - PeakMemoryUsage: 22.12 KB (22656)
  3653. - RepartitionTime: 0.000ns
  3654. - SpilledPartitions: 0 (0)
  3655. EXCHANGE_NODE (id=5):(Total: 1s624ms, non-child: 136.007ms, % non-child: 8.37%)
  3656. - ConvertRowBatchTime: 124.006ms
  3657. - PeakMemoryUsage: 12.69 MB (13302259)
  3658. - RowsReturned: 7.36M (7358720)
  3659. - RowsReturnedRate: 4.53 M/sec
  3660. Buffer pool:
  3661. - AllocTime: 32.001ms
  3662. - CumulativeAllocationBytes: 168.48 MB (176668672)
  3663. - CumulativeAllocations: 14.38K (14380)
  3664. - PeakReservation: 12.65 MB (13262848)
  3665. - PeakUnpinnedBytes: 0
  3666. - PeakUsedReservation: 12.65 MB (13262848)
  3667. - ReadIoBytes: 0
  3668. - ReadIoOps: 0 (0)
  3669. - ReadIoWaitTime: 0.000ns
  3670. - WriteIoBytes: 0
  3671. - WriteIoOps: 0 (0)
  3672. - WriteIoWaitTime: 0.000ns
  3673. Dequeue:
  3674. BytesDequeued(500.000ms): 0, 26.61 MB, 71.68 MB, 82.22 MB, 114.28 MB, 132.46 MB, 133.34 MB
  3675. - FirstBatchWaitTime: 0.000ns
  3676. - TotalBytesDequeued: 133.34 MB (139815680)
  3677. - TotalGetBatchTime: 1s496ms
  3678. - DataWaitTime: 1s488ms
  3679. Enqueue:
  3680. BytesReceived(500.000ms): 142.42 KB, 13.32 MB, 35.88 MB, 41.17 MB, 57.20 MB, 66.31 MB, 66.74 MB
  3681. DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0
  3682. - DispatchTime: (Avg: 31.759us ; Min: 11.868us ; Max: 274.755us ; Number of samples: 7190)
  3683. - DeserializeRowBatchTime: 168.008ms
  3684. - TotalBatchesEnqueued: 7.19K (7190)
  3685. - TotalBatchesReceived: 7.19K (7190)
  3686. - TotalBytesReceived: 66.74 MB (69986621)
  3687. - TotalEarlySenders: 0 (0)
  3688. - TotalEosReceived: 6 (6)
  3689. - TotalHasDeferredRPCsTime: 19.949ms
  3690. - TotalRPCsDeferred: 5 (5)
  3691. HDFS_SCAN_NODE (id=2):(Total: 928.049ms, non-child: 928.049ms, % non-child: 100.00%)
  3692. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:71/8.48 GB
  3693. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 71 out of 71
  3694. Runtime filters: All filters arrived. Waited 0
  3695. Hdfs Read Thread Concurrency Bucket: 0:88.64% 1:11.36% 2:0% 3:0% 4:0% 5:0%
  3696. File Formats: PARQUET/NONE:51 PARQUET/SNAPPY:20
  3697. BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 2.01 GB, 2.35 GB, 2.66 GB, 2.96 GB, 3.04 GB, 3.07 GB, 3.10 GB, 3.24 GB, 3.40 GB, 3.50 GB, 3.57 GB, 3.60 GB, 3.67 GB, 3.77 GB, 3.85 GB, 3.96 GB, 3.96 GB, 3.99 GB, 4.03 GB, 4.08 GB, 4.14 GB, 4.19 GB, 4.27 GB, 4.33 GB, 4.33 GB, 4.34 GB, 4.35 GB, 4.36 GB, 4.36 GB, 4.37 GB, 4.39 GB, 4.41 GB, 4.44 GB, 4.46 GB, 4.46 GB, 4.46 GB, 4.46 GB, 4.46 GB
  3698. - FooterProcessingTime: (Avg: 132.063ms ; Min: 4.000ms ; Max: 472.024ms ; Number of samples: 71)
  3699. - AverageHdfsReadThreadConcurrency: 0.11
  3700. - AverageScannerThreadConcurrency: 14.36
  3701. - BytesRead: 4.46 GB (4787910018)
  3702. - BytesReadDataNodeCache: 0
  3703. - BytesReadLocal: 4.46 GB (4787602818)
  3704. - BytesReadRemoteUnexpected: 0
  3705. - BytesReadShortCircuit: 4.46 GB (4787602818)
  3706. - CachedFileHandlesHitCount: 241 (241)
  3707. - CachedFileHandlesMissCount: 198 (198)
  3708. - CollectionItemsRead: 0 (0)
  3709. - DecompressionTime: 14s256ms
  3710. - MaxCompressedTextFileLength: 0
  3711. - NumColumns: 10 (10)
  3712. - NumDictFilteredRowGroups: 0 (0)
  3713. - NumDisksAccessed: 2 (2)
  3714. - NumRowGroups: 20 (20)
  3715. - NumScannerThreadsStarted: 39 (39)
  3716. - NumScannersWithNoReads: 51 (51)
  3717. - NumStatsFilteredRowGroups: 0 (0)
  3718. - PeakMemoryUsage: 3.28 GB (3517581343)
  3719. - PerReadThreadRawHdfsThroughput: 679.85 MB/sec
  3720. - RemoteScanRanges: 9 (9)
  3721. - RowBatchQueueGetWaitTime: 536.028ms
  3722. - RowBatchQueuePutWaitTime: 4m7s
  3723. - RowsRead: 101.36M (101357568)
  3724. - RowsReturned: 31.95M (31952459)
  3725. - RowsReturnedRate: 34.43 M/sec
  3726. - ScanRangesComplete: 71 (71)
  3727. - ScannerThreadsInvoluntaryContextSwitches: 3.90K (3901)
  3728. - ScannerThreadsTotalWallClockTime: 5m22s
  3729. - MaterializeTupleTime(*): 26s757ms
  3730. - ScannerThreadsSysTime: 20s495ms
  3731. - ScannerThreadsUserTime: 15s906ms
  3732. - ScannerThreadsVoluntaryContextSwitches: 77.86K (77859)
  3733. - TotalRawHdfsOpenFileTime(*): 880.046ms
  3734. - TotalRawHdfsReadTime(*): 6s716ms
  3735. - TotalReadThroughput: 202.94 MB/sec
  3736. Filter 4 (4.00 MB):
  3737. - Files processed: 0 (0)
  3738. - Files rejected: 0 (0)
  3739. - Files total: 0 (0)
  3740. - RowGroups processed: 0 (0)
  3741. - RowGroups rejected: 0 (0)
  3742. - RowGroups total: 0 (0)
  3743. - Rows processed: 1.22M (1224753)
  3744. - Rows rejected: 87.80K (87801)
  3745. - Rows total: 101.39M (101386240)
  3746. - Splits processed: 0 (0)
  3747. - Splits rejected: 0 (0)
  3748. - Splits total: 0 (0)
  3749. Filter 5 (4.00 MB):
  3750. - Files processed: 0 (0)
  3751. - Files rejected: 0 (0)
  3752. - Files total: 0 (0)
  3753. - RowGroups processed: 0 (0)
  3754. - RowGroups rejected: 0 (0)
  3755. - RowGroups total: 0 (0)
  3756. - Rows processed: 1.08M (1084795)
  3757. - Rows rejected: 24.33K (24327)
  3758. - Rows total: 101.30M (101298439)
  3759. - Splits processed: 0 (0)
  3760. - Splits rejected: 0 (0)
  3761. - Splits total: 0 (0)
  3762. CodeGen:(Total: 300.015ms, non-child: 300.015ms, % non-child: 100.00%)
  3763. - CodegenTime: 4.000ms
  3764. - CompileTime: 80.004ms
  3765. - LoadTime: 0.000ns
  3766. - ModuleBitcodeSize: 1.95 MB (2040108)
  3767. - NumFunctions: 113 (113)
  3768. - NumInstructions: 3.40K (3401)
  3769. - OptimizationTime: 200.010ms
  3770. - PeakMemoryUsage: 1.66 MB (1741312)
  3771. - PrepareTime: 20.001ms
  3772. Instance 33406f6405038287:b47e1f8b0000000d (host=slave-cn07:22000):(Total: 21s033ms, non-child: 2s748ms, % non-child: 13.07%)
  3773. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:71/8.49 GB
  3774. Filter 4 arrival: 2s651ms
  3775. Filter 5 arrival: 2s651ms
  3776. Fragment Instance Lifecycle Event Timeline: 21s033ms
  3777. - Prepare Finished: 4.000ms (4.000ms)
  3778. - Open Finished: 3s496ms (3s492ms)
  3779. - First Batch Produced: 3s520ms (24.001ms)
  3780. - First Batch Sent: 3s520ms (0.000ns)
  3781. - ExecInternal Finished: 21s033ms (17s512ms)
  3782. MemoryUsage(500.000ms): 12.20 MB, 54.74 MB, 84.74 MB, 84.74 MB, 116.74 MB, 148.75 MB, 372.75 MB, 689.68 MB, 1.02 GB, 1.65 GB, 1.61 GB, 1.78 GB, 1.81 GB, 1.91 GB, 1.96 GB, 2.08 GB, 2.26 GB, 2.44 GB, 2.54 GB, 2.67 GB, 2.70 GB, 2.68 GB, 2.74 GB, 2.73 GB, 2.73 GB, 2.70 GB, 2.68 GB, 2.60 GB, 2.56 GB, 2.50 GB, 2.45 GB, 2.43 GB, 2.37 GB, 2.12 GB, 2.04 GB, 1.95 GB, 1.78 GB, 1.73 GB, 1.38 GB, 1.16 GB, 904.08 MB, 594.61 MB
  3783. ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 29, 17, 16, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 13, 13, 13, 12, 12, 9, 8, 5, 3
  3784. - AverageThreadTokens: 11.55
  3785. - BloomFilterBytes: 8.00 MB (8388608)
  3786. - PeakMemoryUsage: 2.74 GB (2944595469)
  3787. - PeakReservation: 360.00 MB (377487360)
  3788. - PeakUsedReservation: 0
  3789. - PerHostPeakMemUsage: 2.87 GB (3082904484)
  3790. - RowsProduced: 728.82K (728816)
  3791. - TotalNetworkReceiveTime: 1s544ms
  3792. - TotalNetworkSendTime: 9s752ms
  3793. - TotalStorageWaitTime: 55s138ms
  3794. - TotalThreadsInvoluntaryContextSwitches: 504 (504)
  3795. - TotalThreadsTotalWallClockTime: 4m11s
  3796. - TotalThreadsSysTime: 16s174ms
  3797. - TotalThreadsUserTime: 18s072ms
  3798. - TotalThreadsVoluntaryContextSwitches: 52.08K (52083)
  3799. Buffer pool:
  3800. - AllocTime: 0.000ns
  3801. - CumulativeAllocationBytes: 8.00 MB (8388608)
  3802. - CumulativeAllocations: 2 (2)
  3803. - PeakReservation: 8.00 MB (8388608)
  3804. - PeakUnpinnedBytes: 0
  3805. - PeakUsedReservation: 8.00 MB (8388608)
  3806. - ReadIoBytes: 0
  3807. - ReadIoOps: 0 (0)
  3808. - ReadIoWaitTime: 0.000ns
  3809. - ReservationLimit: 8.00 MB (8388608)
  3810. - WriteIoBytes: 0
  3811. - WriteIoOps: 0 (0)
  3812. - WriteIoWaitTime: 0.000ns
  3813. Fragment Instance Lifecycle Timings:
  3814. - ExecTime: 17s536ms
  3815. - ExecTreeExecTime: 4s528ms
  3816. - OpenTime: 3s492ms
  3817. - ExecTreeOpenTime: 3s176ms
  3818. - PrepareTime: 4.000ms
  3819. - ExecTreePrepareTime: 4.000ms
  3820. KrpcDataStreamSender (dst_id=7):(Total: 10s264ms, non-child: 512.024ms, % non-child: 4.99%)
  3821. BytesSent(500.000ms): 0, 0, 0, 0, 0, 0, 0, 248.15 KB, 1.70 MB, 4.11 MB, 6.13 MB, 8.07 MB, 9.90 MB, 11.38 MB, 12.18 MB, 13.67 MB, 14.79 MB, 15.78 MB, 16.43 MB, 17.38 MB, 17.64 MB, 18.82 MB, 20.06 MB, 20.92 MB, 22.18 MB, 23.73 MB, 25.17 MB, 26.38 MB, 27.70 MB, 28.91 MB, 30.02 MB, 30.85 MB, 32.17 MB, 34.33 MB, 36.17 MB, 37.39 MB, 38.45 MB, 40.09 MB, 41.36 MB, 42.28 MB, 43.86 MB, 45.79 MB
  3822. - EosSent: 6 (6)
  3823. - NetworkThroughput: 1.25 MB/sec
  3824. - PeakMemoryUsage: 187.88 KB (192384)
  3825. - RowsSent: 728.82K (728816)
  3826. - RpcFailure: 0 (0)
  3827. - RpcRetry: 0 (0)
  3828. - SerializeBatchTime: 224.010ms
  3829. - TotalBytesSent: 46.67 MB (48932668)
  3830. - UncompressedRowBatchSize: 64.64 MB (67779888)
  3831. HASH_JOIN_NODE (id=3):(Total: 7s708ms, non-child: 4s748ms, % non-child: 61.60%)
  3832. ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
  3833. - BuildRows: 7.36M (7358720)
  3834. - BuildTime: 1s228ms
  3835. - NumHashTableBuildsSkipped: 0 (0)
  3836. - PeakMemoryUsage: 352.36 MB (369473792)
  3837. - ProbeRows: 26.09M (26089338)
  3838. - ProbeRowsPartitioned: 0 (0)
  3839. - ProbeTime: 3s452ms
  3840. - RowsReturned: 728.82K (728816)
  3841. - RowsReturnedRate: 94.55 K/sec
  3842. Buffer pool:
  3843. - AllocTime: 0.000ns
  3844. - CumulativeAllocationBytes: 352.00 MB (369098752)
  3845. - CumulativeAllocations: 64 (64)
  3846. - PeakReservation: 352.00 MB (369098752)
  3847. - PeakUnpinnedBytes: 0
  3848. - PeakUsedReservation: 352.00 MB (369098752)
  3849. - ReadIoBytes: 0
  3850. - ReadIoOps: 0 (0)
  3851. - ReadIoWaitTime: 0.000ns
  3852. - WriteIoBytes: 0
  3853. - WriteIoOps: 0 (0)
  3854. - WriteIoWaitTime: 0.000ns
  3855. Hash Join Builder (join_node_id=3):
  3856. ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
  3857. Runtime filters: 2 of 2 Runtime Filters Published
  3858. - BuildRowsPartitionTime: 644.030ms
  3859. - BuildRowsPartitioned: 7.36M (7358720)
  3860. - HashBuckets: 16.78M (16777216)
  3861. - HashCollisions: 0 (0)
  3862. - HashTablesBuildTime: 576.027ms
  3863. - LargestPartitionPercent: 6 (6)
  3864. - MaxPartitionLevel: 0 (0)
  3865. - NumRepartitions: 0 (0)
  3866. - PartitionsCreated: 16 (16)
  3867. - PeakMemoryUsage: 22.12 KB (22656)
  3868. - RepartitionTime: 0.000ns
  3869. - SpilledPartitions: 0 (0)
  3870. EXCHANGE_NODE (id=5):(Total: 1s668ms, non-child: 144.006ms, % non-child: 8.63%)
  3871. - ConvertRowBatchTime: 112.005ms
  3872. - PeakMemoryUsage: 12.69 MB (13302259)
  3873. - RowsReturned: 7.36M (7358720)
  3874. - RowsReturnedRate: 4.41 M/sec
  3875. Buffer pool:
  3876. - AllocTime: 20.000ms
  3877. - CumulativeAllocationBytes: 168.48 MB (176668672)
  3878. - CumulativeAllocations: 14.38K (14380)
  3879. - PeakReservation: 12.65 MB (13262848)
  3880. - PeakUnpinnedBytes: 0
  3881. - PeakUsedReservation: 12.65 MB (13262848)
  3882. - ReadIoBytes: 0
  3883. - ReadIoOps: 0 (0)
  3884. - ReadIoWaitTime: 0.000ns
  3885. - WriteIoBytes: 0
  3886. - WriteIoOps: 0 (0)
  3887. - WriteIoWaitTime: 0.000ns
  3888. Dequeue:
  3889. BytesDequeued(500.000ms): 0, 34.20 MB, 73.22 MB, 84.11 MB, 117.36 MB, 133.34 MB, 133.34 MB
  3890. - FirstBatchWaitTime: 0.000ns
  3891. - TotalBytesDequeued: 133.34 MB (139815680)
  3892. - TotalGetBatchTime: 1s540ms
  3893. - DataWaitTime: 1s524ms
  3894. Enqueue:
  3895. BytesReceived(500.000ms): 998.89 KB, 17.14 MB, 36.65 MB, 42.10 MB, 58.74 MB, 66.74 MB, 66.74 MB
  3896. DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0
  3897. - DispatchTime: (Avg: 32.964us ; Min: 11.807us ; Max: 732.090us ; Number of samples: 7190)
  3898. - DeserializeRowBatchTime: 144.006ms
  3899. - TotalBatchesEnqueued: 7.19K (7190)
  3900. - TotalBatchesReceived: 7.19K (7190)
  3901. - TotalBytesReceived: 66.74 MB (69986621)
  3902. - TotalEarlySenders: 0 (0)
  3903. - TotalEosReceived: 6 (6)
  3904. - TotalHasDeferredRPCsTime: 27.233ms
  3905. - TotalRPCsDeferred: 5 (5)
  3906. HDFS_SCAN_NODE (id=2):(Total: 1s292ms, non-child: 1s292ms, % non-child: 100.00%)
  3907. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:71/8.49 GB
  3908. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 71 out of 71
  3909. Runtime filters: All filters arrived. Waited 0
  3910. Hdfs Read Thread Concurrency Bucket: 0:39.02% 1:19.51% 2:2.439% 3:0% 4:2.439% 5:36.59%
  3911. File Formats: PARQUET/NONE:54 PARQUET/SNAPPY:17
  3912. BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 259.44 MB, 582.53 MB, 1.18 GB, 1.31 GB, 1.55 GB, 1.64 GB, 1.85 GB, 1.92 GB, 2.13 GB, 2.37 GB, 2.55 GB, 2.73 GB, 2.89 GB, 2.92 GB, 3.02 GB, 3.13 GB, 3.16 GB, 3.22 GB, 3.30 GB, 3.33 GB, 3.36 GB, 3.39 GB, 3.41 GB, 3.43 GB, 3.45 GB, 3.50 GB, 3.51 GB, 3.55 GB, 3.55 GB, 3.58 GB, 3.58 GB, 3.61 GB, 3.61 GB, 3.61 GB, 3.63 GB
  3913. - FooterProcessingTime: (Avg: 150.035ms ; Min: 8.000ms ; Max: 660.031ms ; Number of samples: 71)
  3914. - AverageHdfsReadThreadConcurrency: 3.12
  3915. - AverageScannerThreadConcurrency: 10.66
  3916. - BytesRead: 3.63 GB (3894467043)
  3917. - BytesReadDataNodeCache: 0
  3918. - BytesReadLocal: 2.44 GB (2616944225)
  3919. - BytesReadRemoteUnexpected: 0
  3920. - BytesReadShortCircuit: 2.44 GB (2616944225)
  3921. - CachedFileHandlesHitCount: 208 (208)
  3922. - CachedFileHandlesMissCount: 167 (167)
  3923. - CollectionItemsRead: 0 (0)
  3924. - DecompressionTime: 9s220ms
  3925. - MaxCompressedTextFileLength: 0
  3926. - NumColumns: 10 (10)
  3927. - NumDictFilteredRowGroups: 0 (0)
  3928. - NumDisksAccessed: 2 (2)
  3929. - NumRowGroups: 17 (17)
  3930. - NumScannerThreadsStarted: 39 (39)
  3931. - NumScannersWithNoReads: 54 (54)
  3932. - NumStatsFilteredRowGroups: 0 (0)
  3933. - PeakMemoryUsage: 2.38 GB (2558462054)
  3934. - PerReadThreadRawHdfsThroughput: 56.57 MB/sec
  3935. - RemoteScanRanges: 247 (247)
  3936. - RowBatchQueueGetWaitTime: 1s092ms
  3937. - RowBatchQueuePutWaitTime: 2m18s
  3938. - RowsRead: 82.77M (82767872)
  3939. - RowsReturned: 26.09M (26089338)
  3940. - RowsReturnedRate: 20.19 M/sec
  3941. - ScanRangesComplete: 71 (71)
  3942. - ScannerThreadsInvoluntaryContextSwitches: 488 (488)
  3943. - ScannerThreadsTotalWallClockTime: 3m47s
  3944. - MaterializeTupleTime(*): 16s520ms
  3945. - ScannerThreadsSysTime: 13s149ms
  3946. - ScannerThreadsUserTime: 12s566ms
  3947. - ScannerThreadsVoluntaryContextSwitches: 45.70K (45701)
  3948. - TotalRawHdfsOpenFileTime(*): 3s720ms
  3949. - TotalRawHdfsReadTime(*): 1m5s
  3950. - TotalReadThroughput: 176.86 MB/sec
  3951. Filter 4 (4.00 MB):
  3952. - Files processed: 0 (0)
  3953. - Files rejected: 0 (0)
  3954. - Files total: 0 (0)
  3955. - RowGroups processed: 0 (0)
  3956. - RowGroups rejected: 0 (0)
  3957. - RowGroups total: 0 (0)
  3958. - Rows processed: 985.72K (985720)
  3959. - Rows rejected: 66.94K (66937)
  3960. - Rows total: 82.78M (82783232)
  3961. - Splits processed: 0 (0)
  3962. - Splits rejected: 0 (0)
  3963. - Splits total: 0 (0)
  3964. Filter 5 (4.00 MB):
  3965. - Files processed: 0 (0)
  3966. - Files rejected: 0 (0)
  3967. - Files total: 0 (0)
  3968. - RowGroups processed: 0 (0)
  3969. - RowGroups rejected: 0 (0)
  3970. - RowGroups total: 0 (0)
  3971. - Rows processed: 918.78K (918783)
  3972. - Rows rejected: 19.90K (19896)
  3973. - Rows total: 82.72M (82716295)
  3974. - Splits processed: 0 (0)
  3975. - Splits rejected: 0 (0)
  3976. - Splits total: 0 (0)
  3977. CodeGen:(Total: 312.014ms, non-child: 312.014ms, % non-child: 100.00%)
  3978. - CodegenTime: 4.000ms
  3979. - CompileTime: 84.004ms
  3980. - LoadTime: 0.000ns
  3981. - ModuleBitcodeSize: 1.95 MB (2040108)
  3982. - NumFunctions: 113 (113)
  3983. - NumInstructions: 3.40K (3401)
  3984. - OptimizationTime: 204.009ms
  3985. - PeakMemoryUsage: 1.66 MB (1741312)
  3986. - PrepareTime: 24.001ms
  3987. Averaged Fragment F02:(Total: 1s462ms, non-child: 1.333ms, % non-child: 0.09%)
  3988. split sizes: min: 593.68 MB, max: 754.64 MB, avg: 659.58 MB, stddev: 53.46 MB
  3989. completion times: min:92.004ms max:2s656ms mean: 1s466ms stddev:1s002ms
  3990. execution rates: min:240.95 MB/sec max:7.16 GB/sec mean:2.51 GB/sec stddev:3.13 GB/sec
  3991. num instances: 6
  3992. - AverageThreadTokens: 3.00
  3993. - BloomFilterBytes: 0
  3994. - PeakMemoryUsage: 39.71 MB (41636197)
  3995. - PeakReservation: 0
  3996. - PeakUsedReservation: 0
  3997. - PerHostPeakMemUsage: 255.10 MB (267488391)
  3998. - RowsProduced: 1.23M (1226453)
  3999. - TotalNetworkReceiveTime: 0.000ns
  4000. - TotalNetworkSendTime: 1s118ms
  4001. - TotalStorageWaitTime: 218.010ms
  4002. - TotalThreadsInvoluntaryContextSwitches: 14 (14)
  4003. - TotalThreadsTotalWallClockTime: 4s375ms
  4004. - TotalThreadsSysTime: 342.301ms
  4005. - TotalThreadsUserTime: 1s419ms
  4006. - TotalThreadsVoluntaryContextSwitches: 2.91K (2911)
  4007. Buffer pool:
  4008. - AllocTime: 0.000ns
  4009. - CumulativeAllocationBytes: 0
  4010. - CumulativeAllocations: 0 (0)
  4011. - PeakReservation: 0
  4012. - PeakUnpinnedBytes: 0
  4013. - PeakUsedReservation: 0
  4014. - ReadIoBytes: 0
  4015. - ReadIoOps: 0 (0)
  4016. - ReadIoWaitTime: 0.000ns
  4017. - ReservationLimit: 0
  4018. - WriteIoBytes: 0
  4019. - WriteIoOps: 0 (0)
  4020. - WriteIoWaitTime: 0.000ns
  4021. Fragment Instance Lifecycle Timings:
  4022. - ExecTime: 1s400ms
  4023. - ExecTreeExecTime: 102.005ms
  4024. - OpenTime: 60.002ms
  4025. - ExecTreeOpenTime: 0.000ns
  4026. - PrepareTime: 2.000ms
  4027. - ExecTreePrepareTime: 2.000ms
  4028. KrpcDataStreamSender (dst_id=5):(Total: 1s297ms, non-child: 1s297ms, % non-child: 100.00%)
  4029. - EosSent: 6 (6)
  4030. - NetworkThroughput: 10.31 MB/sec
  4031. - PeakMemoryUsage: 69.80 KB (71472)
  4032. - RowsSent: 1.23M (1226453)
  4033. - RpcFailure: 0 (0)
  4034. - RpcRetry: 0 (0)
  4035. - SerializeBatchTime: 76.003ms
  4036. - TotalBytesSent: 66.74 MB (69986621)
  4037. - UncompressedRowBatchSize: 133.34 MB (139815680)
  4038. HDFS_SCAN_NODE (id=0):(Total: 106.005ms, non-child: 106.005ms, % non-child: 100.00%)
  4039. - AverageHdfsReadThreadConcurrency: 0.17
  4040. - AverageScannerThreadConcurrency: 2.17
  4041. - BytesRead: 25.21 MB (26437262)
  4042. - BytesReadDataNodeCache: 0
  4043. - BytesReadLocal: 14.67 MB (15378490)
  4044. - BytesReadRemoteUnexpected: 0
  4045. - BytesReadShortCircuit: 14.67 MB (15378490)
  4046. - CachedFileHandlesHitCount: 0 (0)
  4047. - CachedFileHandlesMissCount: 10 (10)
  4048. - CollectionItemsRead: 0 (0)
  4049. - DecompressionTime: 304.682ms
  4050. - MaxCompressedTextFileLength: 0
  4051. - NumColumns: 4 (4)
  4052. - NumDictFilteredRowGroups: 0 (0)
  4053. - NumDisksAccessed: 1 (1)
  4054. - NumRowGroups: 1 (1)
  4055. - NumScannerThreadsStarted: 5 (5)
  4056. - NumScannersWithNoReads: 3 (3)
  4057. - NumStatsFilteredRowGroups: 0 (0)
  4058. - PeakMemoryUsage: 39.62 MB (41540158)
  4059. - PerReadThreadRawHdfsThroughput: 252.68 MB/sec
  4060. - RemoteScanRanges: 12 (12)
  4061. - RowBatchQueueGetWaitTime: 92.671ms
  4062. - RowBatchQueuePutWaitTime: 1s224ms
  4063. - RowsRead: 39.07M (39069498)
  4064. - RowsReturned: 1.23M (1226453)
  4065. - RowsReturnedRate: 8.72 M/sec
  4066. - ScanRangesComplete: 5 (5)
  4067. - ScannerThreadsInvoluntaryContextSwitches: 13 (13)
  4068. - ScannerThreadsTotalWallClockTime: 2s914ms
  4069. - MaterializeTupleTime(*): 1s082ms
  4070. - ScannerThreadsSysTime: 268.705ms
  4071. - ScannerThreadsUserTime: 1s207ms
  4072. - ScannerThreadsVoluntaryContextSwitches: 663 (663)
  4073. - TotalRawHdfsOpenFileTime(*): 100.004ms
  4074. - TotalRawHdfsReadTime(*): 180.676ms
  4075. - TotalReadThroughput: 11.56 MB/sec
  4076. CodeGen:(Total: 58.002ms, non-child: 58.002ms, % non-child: 100.00%)
  4077. - CodegenTime: 2.666ms
  4078. - CompileTime: 10.667ms
  4079. - LoadTime: 0.000ns
  4080. - ModuleBitcodeSize: 1.95 MB (2040108)
  4081. - NumFunctions: 35 (35)
  4082. - NumInstructions: 576 (576)
  4083. - OptimizationTime: 27.334ms
  4084. - PeakMemoryUsage: 288.00 KB (294912)
  4085. - PrepareTime: 20.000ms
  4086. Fragment F02:
  4087. Instance 33406f6405038287:b47e1f8b0000000a (host=slave-cn05:22000):(Total: 2s648ms, non-child: 4.000ms, % non-child: 0.15%)
  4088. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/640.00 MB
  4089. Fragment Instance Lifecycle Event Timeline: 2s648ms
  4090. - Prepare Finished: 4.000ms (4.000ms)
  4091. - Open Finished: 56.003ms (52.002ms)
  4092. - First Batch Produced: 76.004ms (20.001ms)
  4093. - First Batch Sent: 76.004ms (0.000ns)
  4094. - ExecInternal Finished: 2s648ms (2s572ms)
  4095. MemoryUsage(500.000ms): 86.02 MB, 86.15 MB, 86.12 MB, 86.08 MB, 84.19 MB
  4096. ThreadUsage(500.000ms): 4, 4, 4, 4, 4
  4097. - AverageThreadTokens: 4.00
  4098. - BloomFilterBytes: 0
  4099. - PeakMemoryUsage: 86.32 MB (90517070)
  4100. - PeakReservation: 0
  4101. - PeakUsedReservation: 0
  4102. - PerHostPeakMemUsage: 323.74 MB (339460825)
  4103. - RowsProduced: 2.81M (2811244)
  4104. - TotalNetworkReceiveTime: 0.000ns
  4105. - TotalNetworkSendTime: 2s048ms
  4106. - TotalStorageWaitTime: 540.029ms
  4107. - TotalThreadsInvoluntaryContextSwitches: 10 (10)
  4108. - TotalThreadsTotalWallClockTime: 10s316ms
  4109. - TotalThreadsSysTime: 790.685ms
  4110. - TotalThreadsUserTime: 3s167ms
  4111. - TotalThreadsVoluntaryContextSwitches: 7.48K (7476)
  4112. Buffer pool:
  4113. - AllocTime: 0.000ns
  4114. - CumulativeAllocationBytes: 0
  4115. - CumulativeAllocations: 0 (0)
  4116. - PeakReservation: 0
  4117. - PeakUnpinnedBytes: 0
  4118. - PeakUsedReservation: 0
  4119. - ReadIoBytes: 0
  4120. - ReadIoOps: 0 (0)
  4121. - ReadIoWaitTime: 0.000ns
  4122. - ReservationLimit: 0
  4123. - WriteIoBytes: 0
  4124. - WriteIoOps: 0 (0)
  4125. - WriteIoWaitTime: 0.000ns
  4126. Fragment Instance Lifecycle Timings:
  4127. - ExecTime: 2s592ms
  4128. - ExecTreeExecTime: 128.007ms
  4129. - OpenTime: 52.002ms
  4130. - ExecTreeOpenTime: 0.000ns
  4131. - PrepareTime: 4.000ms
  4132. - ExecTreePrepareTime: 4.000ms
  4133. KrpcDataStreamSender (dst_id=5):(Total: 2s460ms, non-child: 412.022ms, % non-child: 16.75%)
  4134. BytesSent(500.000ms): 7.65 MB, 49.38 MB, 60.14 MB, 85.23 MB, 136.99 MB
  4135. - EosSent: 6 (6)
  4136. - NetworkThroughput: 17.96 MB/sec
  4137. - PeakMemoryUsage: 69.80 KB (71472)
  4138. - RowsSent: 2.81M (2811244)
  4139. - RpcFailure: 0 (0)
  4140. - RpcRetry: 0 (0)
  4141. - SerializeBatchTime: 152.008ms
  4142. - TotalBytesSent: 152.99 MB (160426014)
  4143. - UncompressedRowBatchSize: 305.64 MB (320481816)
  4144. HDFS_SCAN_NODE (id=0):(Total: 136.007ms, non-child: 136.007ms, % non-child: 100.00%)
  4145. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/640.00 MB
  4146. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5
  4147. Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0%
  4148. File Formats: PARQUET/NONE:2 PARQUET/SNAPPY:3
  4149. BytesRead(500.000ms): 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB
  4150. - FooterProcessingTime: (Avg: 23.201ms ; Min: 16.000ms ; Max: 32.001ms ; Number of samples: 5)
  4151. - AverageHdfsReadThreadConcurrency: 0.00
  4152. - AverageScannerThreadConcurrency: 3.00
  4153. - BytesRead: 57.23 MB (60006353)
  4154. - BytesReadDataNodeCache: 0
  4155. - BytesReadLocal: 15.28 MB (16018623)
  4156. - BytesReadRemoteUnexpected: 0
  4157. - BytesReadShortCircuit: 15.28 MB (16018623)
  4158. - CachedFileHandlesHitCount: 0 (0)
  4159. - CachedFileHandlesMissCount: 17 (17)
  4160. - CollectionItemsRead: 0 (0)
  4161. - DecompressionTime: 760.041ms
  4162. - MaxCompressedTextFileLength: 0
  4163. - NumColumns: 4 (4)
  4164. - NumDictFilteredRowGroups: 0 (0)
  4165. - NumDisksAccessed: 1 (1)
  4166. - NumRowGroups: 3 (3)
  4167. - NumScannerThreadsStarted: 5 (5)
  4168. - NumScannersWithNoReads: 2 (2)
  4169. - NumStatsFilteredRowGroups: 0 (0)
  4170. - PeakMemoryUsage: 86.22 MB (90413181)
  4171. - PerReadThreadRawHdfsThroughput: 79.92 MB/sec
  4172. - RemoteScanRanges: 36 (36)
  4173. - RowBatchQueueGetWaitTime: 108.005ms
  4174. - RowBatchQueuePutWaitTime: 3s796ms
  4175. - RowsRead: 89.80M (89801307)
  4176. - RowsReturned: 2.81M (2811244)
  4177. - RowsReturnedRate: 20.67 M/sec
  4178. - ScanRangesComplete: 5 (5)
  4179. - ScannerThreadsInvoluntaryContextSwitches: 10 (10)
  4180. - ScannerThreadsTotalWallClockTime: 7s672ms
  4181. - MaterializeTupleTime(*): 2s408ms
  4182. - ScannerThreadsSysTime: 666.730ms
  4183. - ScannerThreadsUserTime: 2s724ms
  4184. - ScannerThreadsVoluntaryContextSwitches: 2.18K (2181)
  4185. - TotalRawHdfsOpenFileTime(*): 148.008ms
  4186. - TotalRawHdfsReadTime(*): 716.039ms
  4187. - TotalReadThroughput: 22.89 MB/sec
  4188. CodeGen:(Total: 48.002ms, non-child: 48.002ms, % non-child: 100.00%)
  4189. - CodegenTime: 4.000ms
  4190. - CompileTime: 8.000ms
  4191. - LoadTime: 0.000ns
  4192. - ModuleBitcodeSize: 1.95 MB (2040108)
  4193. - NumFunctions: 35 (35)
  4194. - NumInstructions: 576 (576)
  4195. - OptimizationTime: 24.001ms
  4196. - PeakMemoryUsage: 288.00 KB (294912)
  4197. - PrepareTime: 16.000ms
  4198. Instance 33406f6405038287:b47e1f8b00000007 (host=slave-cn07:22000):(Total: 2s152ms, non-child: 0.000ns, % non-child: 0.00%)
  4199. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/632.75 MB
  4200. Fragment Instance Lifecycle Event Timeline: 2s152ms
  4201. - Prepare Finished: 4.000ms (4.000ms)
  4202. - Open Finished: 60.002ms (56.002ms)
  4203. - First Batch Produced: 80.003ms (20.000ms)
  4204. - First Batch Sent: 80.003ms (0.000ns)
  4205. - ExecInternal Finished: 2s152ms (2s072ms)
  4206. MemoryUsage(500.000ms): 54.84 MB, 58.11 MB, 58.02 MB, 57.93 MB
  4207. ThreadUsage(500.000ms): 3, 3, 3, 3
  4208. - AverageThreadTokens: 3.00
  4209. - BloomFilterBytes: 0
  4210. - PeakMemoryUsage: 58.20 MB (61029923)
  4211. - PeakReservation: 0
  4212. - PeakUsedReservation: 0
  4213. - PerHostPeakMemUsage: 289.55 MB (303611372)
  4214. - RowsProduced: 1.88M (1876845)
  4215. - TotalNetworkReceiveTime: 0.000ns
  4216. - TotalNetworkSendTime: 1s692ms
  4217. - TotalStorageWaitTime: 260.012ms
  4218. - TotalThreadsInvoluntaryContextSwitches: 13 (13)
  4219. - TotalThreadsTotalWallClockTime: 6s320ms
  4220. - TotalThreadsSysTime: 569.640ms
  4221. - TotalThreadsUserTime: 2s048ms
  4222. - TotalThreadsVoluntaryContextSwitches: 4.25K (4248)
  4223. Buffer pool:
  4224. - AllocTime: 0.000ns
  4225. - CumulativeAllocationBytes: 0
  4226. - CumulativeAllocations: 0 (0)
  4227. - PeakReservation: 0
  4228. - PeakUnpinnedBytes: 0
  4229. - PeakUsedReservation: 0
  4230. - ReadIoBytes: 0
  4231. - ReadIoOps: 0 (0)
  4232. - ReadIoWaitTime: 0.000ns
  4233. - ReservationLimit: 0
  4234. - WriteIoBytes: 0
  4235. - WriteIoOps: 0 (0)
  4236. - WriteIoWaitTime: 0.000ns
  4237. Fragment Instance Lifecycle Timings:
  4238. - ExecTime: 2s092ms
  4239. - ExecTreeExecTime: 124.005ms
  4240. - OpenTime: 56.002ms
  4241. - ExecTreeOpenTime: 0.000ns
  4242. - PrepareTime: 4.000ms
  4243. - ExecTreePrepareTime: 4.000ms
  4244. KrpcDataStreamSender (dst_id=5):(Total: 1s964ms, non-child: 272.012ms, % non-child: 13.85%)
  4245. BytesSent(500.000ms): 856.88 KB, 24.97 MB, 57.46 MB, 67.02 MB
  4246. - EosSent: 6 (6)
  4247. - NetworkThroughput: 16.22 MB/sec
  4248. - PeakMemoryUsage: 69.80 KB (71472)
  4249. - RowsSent: 1.88M (1876845)
  4250. - RpcFailure: 0 (0)
  4251. - RpcRetry: 0 (0)
  4252. - SerializeBatchTime: 112.005ms
  4253. - TotalBytesSent: 102.13 MB (107094174)
  4254. - UncompressedRowBatchSize: 204.05 MB (213960330)
  4255. HDFS_SCAN_NODE (id=0):(Total: 132.006ms, non-child: 132.006ms, % non-child: 100.00%)
  4256. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/632.75 MB
  4257. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5
  4258. Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0%
  4259. File Formats: PARQUET/NONE:3 PARQUET/SNAPPY:2
  4260. BytesRead(500.000ms): 38.31 MB, 38.31 MB, 38.31 MB, 38.31 MB
  4261. - FooterProcessingTime: (Avg: 18.400ms ; Min: 16.000ms ; Max: 24.001ms ; Number of samples: 5)
  4262. - AverageHdfsReadThreadConcurrency: 0.00
  4263. - AverageScannerThreadConcurrency: 2.00
  4264. - BytesRead: 38.31 MB (40166643)
  4265. - BytesReadDataNodeCache: 0
  4266. - BytesReadLocal: 19.21 MB (20141508)
  4267. - BytesReadRemoteUnexpected: 0
  4268. - BytesReadShortCircuit: 19.21 MB (20141508)
  4269. - CachedFileHandlesHitCount: 0 (0)
  4270. - CachedFileHandlesMissCount: 13 (13)
  4271. - CollectionItemsRead: 0 (0)
  4272. - DecompressionTime: 460.021ms
  4273. - MaxCompressedTextFileLength: 0
  4274. - NumColumns: 4 (4)
  4275. - NumDictFilteredRowGroups: 0 (0)
  4276. - NumDisksAccessed: 2 (2)
  4277. - NumRowGroups: 2 (2)
  4278. - NumScannerThreadsStarted: 5 (5)
  4279. - NumScannersWithNoReads: 3 (3)
  4280. - NumStatsFilteredRowGroups: 0 (0)
  4281. - PeakMemoryUsage: 58.10 MB (60926034)
  4282. - PerReadThreadRawHdfsThroughput: 168.00 MB/sec
  4283. - RemoteScanRanges: 18 (18)
  4284. - RowBatchQueueGetWaitTime: 96.004ms
  4285. - RowBatchQueuePutWaitTime: 1s704ms
  4286. - RowsRead: 59.84M (59844265)
  4287. - RowsReturned: 1.88M (1876845)
  4288. - RowsReturnedRate: 14.22 M/sec
  4289. - ScanRangesComplete: 5 (5)
  4290. - ScannerThreadsInvoluntaryContextSwitches: 11 (11)
  4291. - ScannerThreadsTotalWallClockTime: 4s172ms
  4292. - MaterializeTupleTime(*): 1s592ms
  4293. - ScannerThreadsSysTime: 423.373ms
  4294. - ScannerThreadsUserTime: 1s799ms
  4295. - ScannerThreadsVoluntaryContextSwitches: 844 (844)
  4296. - TotalRawHdfsOpenFileTime(*): 112.005ms
  4297. - TotalRawHdfsReadTime(*): 228.010ms
  4298. - TotalReadThroughput: 19.15 MB/sec
  4299. CodeGen:(Total: 56.002ms, non-child: 56.002ms, % non-child: 100.00%)
  4300. - CodegenTime: 4.000ms
  4301. - CompileTime: 8.000ms
  4302. - LoadTime: 0.000ns
  4303. - ModuleBitcodeSize: 1.95 MB (2040108)
  4304. - NumFunctions: 35 (35)
  4305. - NumInstructions: 576 (576)
  4306. - OptimizationTime: 28.001ms
  4307. - PeakMemoryUsage: 288.00 KB (294912)
  4308. - PrepareTime: 20.000ms
  4309. Instance 33406f6405038287:b47e1f8b00000008 (host=slave-cn02:22000):(Total: 1s920ms, non-child: 0.000ns, % non-child: 0.00%)
  4310. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:6/754.64 MB
  4311. Fragment Instance Lifecycle Event Timeline: 1s920ms
  4312. - Prepare Finished: 4.000ms (4.000ms)
  4313. - Open Finished: 64.002ms (60.002ms)
  4314. - First Batch Produced: 76.003ms (12.000ms)
  4315. - First Batch Sent: 76.003ms (0.000ns)
  4316. - ExecInternal Finished: 1s920ms (1s844ms)
  4317. MemoryUsage(500.000ms): 45.88 MB, 45.46 MB, 30.13 MB, 29.94 MB
  4318. ThreadUsage(500.000ms): 3, 3, 2, 2
  4319. - AverageThreadTokens: 2.50
  4320. - BloomFilterBytes: 0
  4321. - PeakMemoryUsage: 46.26 MB (48507432)
  4322. - PeakReservation: 0
  4323. - PeakUsedReservation: 0
  4324. - PerHostPeakMemUsage: 471.08 MB (493961207)
  4325. - RowsProduced: 1.34M (1342523)
  4326. - TotalNetworkReceiveTime: 0.000ns
  4327. - TotalNetworkSendTime: 1s504ms
  4328. - TotalStorageWaitTime: 152.007ms
  4329. - TotalThreadsInvoluntaryContextSwitches: 47 (47)
  4330. - TotalThreadsTotalWallClockTime: 4s644ms
  4331. - TotalThreadsSysTime: 387.746ms
  4332. - TotalThreadsUserTime: 1s573ms
  4333. - TotalThreadsVoluntaryContextSwitches: 2.87K (2868)
  4334. Buffer pool:
  4335. - AllocTime: 0.000ns
  4336. - CumulativeAllocationBytes: 0
  4337. - CumulativeAllocations: 0 (0)
  4338. - PeakReservation: 0
  4339. - PeakUnpinnedBytes: 0
  4340. - PeakUsedReservation: 0
  4341. - ReadIoBytes: 0
  4342. - ReadIoOps: 0 (0)
  4343. - ReadIoWaitTime: 0.000ns
  4344. - ReservationLimit: 0
  4345. - WriteIoBytes: 0
  4346. - WriteIoOps: 0 (0)
  4347. - WriteIoWaitTime: 0.000ns
  4348. Fragment Instance Lifecycle Timings:
  4349. - ExecTime: 1s856ms
  4350. - ExecTreeExecTime: 136.006ms
  4351. - OpenTime: 60.002ms
  4352. - ExecTreeOpenTime: 0.000ns
  4353. - PrepareTime: 4.000ms
  4354. - ExecTreePrepareTime: 4.000ms
  4355. KrpcDataStreamSender (dst_id=5):(Total: 1s720ms, non-child: 216.009ms, % non-child: 12.56%)
  4356. BytesSent(500.000ms): 4.88 MB, 30.62 MB, 54.43 MB, 62.09 MB
  4357. - EosSent: 6 (6)
  4358. - NetworkThroughput: 13.49 MB/sec
  4359. - PeakMemoryUsage: 69.80 KB (71472)
  4360. - RowsSent: 1.34M (1342523)
  4361. - RpcFailure: 0 (0)
  4362. - RpcRetry: 0 (0)
  4363. - SerializeBatchTime: 104.004ms
  4364. - TotalBytesSent: 73.06 MB (76604592)
  4365. - UncompressedRowBatchSize: 145.96 MB (153047622)
  4366. HDFS_SCAN_NODE (id=0):(Total: 144.006ms, non-child: 144.006ms, % non-child: 100.00%)
  4367. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:6/754.64 MB
  4368. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6
  4369. Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0%
  4370. File Formats: PARQUET/NONE:4 PARQUET/SNAPPY:2
  4371. BytesRead(500.000ms): 27.57 MB, 27.57 MB, 27.57 MB, 27.57 MB
  4372. - FooterProcessingTime: (Avg: 17.334ms ; Min: 12.000ms ; Max: 28.001ms ; Number of samples: 6)
  4373. - AverageHdfsReadThreadConcurrency: 0.00
  4374. - AverageScannerThreadConcurrency: 1.50
  4375. - BytesRead: 27.57 MB (28912212)
  4376. - BytesReadDataNodeCache: 0
  4377. - BytesReadLocal: 25.83 MB (27084442)
  4378. - BytesReadRemoteUnexpected: 0
  4379. - BytesReadShortCircuit: 25.83 MB (27084442)
  4380. - CachedFileHandlesHitCount: 2 (2)
  4381. - CachedFileHandlesMissCount: 12 (12)
  4382. - CollectionItemsRead: 0 (0)
  4383. - DecompressionTime: 312.014ms
  4384. - MaxCompressedTextFileLength: 0
  4385. - NumColumns: 4 (4)
  4386. - NumDictFilteredRowGroups: 0 (0)
  4387. - NumDisksAccessed: 2 (2)
  4388. - NumRowGroups: 2 (2)
  4389. - NumScannerThreadsStarted: 6 (6)
  4390. - NumScannersWithNoReads: 4 (4)
  4391. - NumStatsFilteredRowGroups: 0 (0)
  4392. - PeakMemoryUsage: 46.16 MB (48403543)
  4393. - PerReadThreadRawHdfsThroughput: 344.64 MB/sec
  4394. - RemoteScanRanges: 6 (6)
  4395. - RowBatchQueueGetWaitTime: 132.006ms
  4396. - RowBatchQueuePutWaitTime: 928.042ms
  4397. - RowsRead: 42.69M (42694271)
  4398. - RowsReturned: 1.34M (1342523)
  4399. - RowsReturnedRate: 9.32 M/sec
  4400. - ScanRangesComplete: 6 (6)
  4401. - ScannerThreadsInvoluntaryContextSwitches: 46 (46)
  4402. - ScannerThreadsTotalWallClockTime: 2s728ms
  4403. - MaterializeTupleTime(*): 1s268ms
  4404. - ScannerThreadsSysTime: 280.073ms
  4405. - ScannerThreadsUserTime: 1s369ms
  4406. - ScannerThreadsVoluntaryContextSwitches: 456 (456)
  4407. - TotalRawHdfsOpenFileTime(*): 80.003ms
  4408. - TotalRawHdfsReadTime(*): 80.003ms
  4409. - TotalReadThroughput: 13.79 MB/sec
  4410. CodeGen:(Total: 60.002ms, non-child: 60.002ms, % non-child: 100.00%)
  4411. - CodegenTime: 0.000ns
  4412. - CompileTime: 12.000ms
  4413. - LoadTime: 0.000ns
  4414. - ModuleBitcodeSize: 1.95 MB (2040108)
  4415. - NumFunctions: 35 (35)
  4416. - NumInstructions: 576 (576)
  4417. - OptimizationTime: 24.001ms
  4418. - PeakMemoryUsage: 288.00 KB (294912)
  4419. - PrepareTime: 24.001ms
  4420. Instance 33406f6405038287:b47e1f8b0000000b (host=slave-cn04:22000):(Total: 1s876ms, non-child: 4.000ms, % non-child: 0.21%)
  4421. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/593.68 MB
  4422. Fragment Instance Lifecycle Event Timeline: 1s880ms
  4423. - Prepare Finished: 4.000ms (4.000ms)
  4424. - Open Finished: 84.004ms (80.004ms)
  4425. - First Batch Produced: 100.005ms (16.000ms)
  4426. - First Batch Sent: 100.005ms (0.000ns)
  4427. - ExecInternal Finished: 1s880ms (1s780ms)
  4428. MemoryUsage(500.000ms): 44.16 MB, 45.65 MB, 29.11 MB, 29.83 MB
  4429. ThreadUsage(500.000ms): 3, 3, 2, 2
  4430. - AverageThreadTokens: 2.50
  4431. - BloomFilterBytes: 0
  4432. - PeakMemoryUsage: 46.26 MB (48508451)
  4433. - PeakReservation: 0
  4434. - PeakUsedReservation: 0
  4435. - PerHostPeakMemUsage: 311.58 MB (326716942)
  4436. - RowsProduced: 1.33M (1328108)
  4437. - TotalNetworkReceiveTime: 0.000ns
  4438. - TotalNetworkSendTime: 1s456ms
  4439. - TotalStorageWaitTime: 136.007ms
  4440. - TotalThreadsInvoluntaryContextSwitches: 17 (17)
  4441. - TotalThreadsTotalWallClockTime: 4s508ms
  4442. - TotalThreadsSysTime: 301.206ms
  4443. - TotalThreadsUserTime: 1s616ms
  4444. - TotalThreadsVoluntaryContextSwitches: 2.74K (2743)
  4445. Buffer pool:
  4446. - AllocTime: 0.000ns
  4447. - CumulativeAllocationBytes: 0
  4448. - CumulativeAllocations: 0 (0)
  4449. - PeakReservation: 0
  4450. - PeakUnpinnedBytes: 0
  4451. - PeakUsedReservation: 0
  4452. - ReadIoBytes: 0
  4453. - ReadIoOps: 0 (0)
  4454. - ReadIoWaitTime: 0.000ns
  4455. - ReservationLimit: 0
  4456. - WriteIoBytes: 0
  4457. - WriteIoOps: 0 (0)
  4458. - WriteIoWaitTime: 0.000ns
  4459. Fragment Instance Lifecycle Timings:
  4460. - ExecTime: 1s796ms
  4461. - ExecTreeExecTime: 164.008ms
  4462. - OpenTime: 80.004ms
  4463. - ExecTreeOpenTime: 0.000ns
  4464. - PrepareTime: 0.000ns
  4465. - ExecTreePrepareTime: 0.000ns
  4466. KrpcDataStreamSender (dst_id=5):(Total: 1s632ms, non-child: 176.009ms, % non-child: 10.78%)
  4467. BytesSent(500.000ms): 9.50 KB, 20.84 MB, 52.15 MB, 59.38 MB
  4468. - EosSent: 6 (6)
  4469. - NetworkThroughput: 14.18 MB/sec
  4470. - PeakMemoryUsage: 69.80 KB (71472)
  4471. - RowsSent: 1.33M (1328108)
  4472. - RpcFailure: 0 (0)
  4473. - RpcRetry: 0 (0)
  4474. - SerializeBatchTime: 88.004ms
  4475. - TotalBytesSent: 72.28 MB (75794946)
  4476. - UncompressedRowBatchSize: 144.39 MB (151404312)
  4477. HDFS_SCAN_NODE (id=0):(Total: 164.008ms, non-child: 164.008ms, % non-child: 100.00%)
  4478. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/593.68 MB
  4479. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5
  4480. Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0%
  4481. File Formats: PARQUET/NONE:3 PARQUET/SNAPPY:2
  4482. BytesRead(500.000ms): 27.10 MB, 27.10 MB, 27.10 MB, 27.10 MB
  4483. - FooterProcessingTime: (Avg: 18.400ms ; Min: 16.000ms ; Max: 24.001ms ; Number of samples: 5)
  4484. - AverageHdfsReadThreadConcurrency: 0.00
  4485. - AverageScannerThreadConcurrency: 1.50
  4486. - BytesRead: 27.10 MB (28411968)
  4487. - BytesReadDataNodeCache: 0
  4488. - BytesReadLocal: 27.00 MB (28309568)
  4489. - BytesReadRemoteUnexpected: 0
  4490. - BytesReadShortCircuit: 27.00 MB (28309568)
  4491. - CachedFileHandlesHitCount: 2 (2)
  4492. - CachedFileHandlesMissCount: 11 (11)
  4493. - CollectionItemsRead: 0 (0)
  4494. - DecompressionTime: 296.015ms
  4495. - MaxCompressedTextFileLength: 0
  4496. - NumColumns: 4 (4)
  4497. - NumDictFilteredRowGroups: 0 (0)
  4498. - NumDisksAccessed: 2 (2)
  4499. - NumRowGroups: 2 (2)
  4500. - NumScannerThreadsStarted: 5 (5)
  4501. - NumScannersWithNoReads: 3 (3)
  4502. - NumStatsFilteredRowGroups: 0 (0)
  4503. - PeakMemoryUsage: 46.16 MB (48404562)
  4504. - PerReadThreadRawHdfsThroughput: 752.62 MB/sec
  4505. - RemoteScanRanges: 3 (3)
  4506. - RowBatchQueueGetWaitTime: 160.008ms
  4507. - RowBatchQueuePutWaitTime: 916.048ms
  4508. - RowsRead: 42.08M (42077149)
  4509. - RowsReturned: 1.33M (1328108)
  4510. - RowsReturnedRate: 8.10 M/sec
  4511. - ScanRangesComplete: 5 (5)
  4512. - ScannerThreadsInvoluntaryContextSwitches: 16 (16)
  4513. - ScannerThreadsTotalWallClockTime: 2s632ms
  4514. - MaterializeTupleTime(*): 1s224ms
  4515. - ScannerThreadsSysTime: 238.662ms
  4516. - ScannerThreadsUserTime: 1s351ms
  4517. - ScannerThreadsVoluntaryContextSwitches: 450 (450)
  4518. - TotalRawHdfsOpenFileTime(*): 96.005ms
  4519. - TotalRawHdfsReadTime(*): 36.001ms
  4520. - TotalReadThroughput: 13.55 MB/sec
  4521. CodeGen:(Total: 76.004ms, non-child: 76.004ms, % non-child: 100.00%)
  4522. - CodegenTime: 0.000ns
  4523. - CompileTime: 16.000ms
  4524. - LoadTime: 0.000ns
  4525. - ModuleBitcodeSize: 1.95 MB (2040108)
  4526. - NumFunctions: 35 (35)
  4527. - NumInstructions: 576 (576)
  4528. - OptimizationTime: 36.001ms
  4529. - PeakMemoryUsage: 288.00 KB (294912)
  4530. - PrepareTime: 24.001ms
  4531. Instance 33406f6405038287:b47e1f8b0000000c (host=slave-cn03:22000):(Total: 92.004ms, non-child: 4.000ms, % non-child: 4.35%)
  4532. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:6/703.67 MB
  4533. Fragment Instance Lifecycle Event Timeline: 96.004ms
  4534. - Prepare Finished: 4.000ms (4.000ms)
  4535. - Open Finished: 60.002ms (56.002ms)
  4536. - First Batch Produced: 84.003ms (24.001ms)
  4537. - First Batch Sent: 84.003ms (0.000ns)
  4538. - ExecInternal Finished: 96.004ms (12.000ms)
  4539. - AverageThreadTokens: 0.00
  4540. - BloomFilterBytes: 0
  4541. - PeakMemoryUsage: 482.45 KB (494033)
  4542. - PeakReservation: 0
  4543. - PeakUsedReservation: 0
  4544. - PerHostPeakMemUsage: 67.19 MB (70456881)
  4545. - RowsProduced: 0 (0)
  4546. - TotalNetworkReceiveTime: 0.000ns
  4547. - TotalNetworkSendTime: 4.000ms
  4548. - TotalStorageWaitTime: 108.004ms
  4549. - TotalThreadsInvoluntaryContextSwitches: 0 (0)
  4550. - TotalThreadsTotalWallClockTime: 264.012ms
  4551. - TotalThreadsSysTime: 4.336ms
  4552. - TotalThreadsUserTime: 52.566ms
  4553. - TotalThreadsVoluntaryContextSwitches: 65 (65)
  4554. Buffer pool:
  4555. - AllocTime: 0.000ns
  4556. - CumulativeAllocationBytes: 0
  4557. - CumulativeAllocations: 0 (0)
  4558. - PeakReservation: 0
  4559. - PeakUnpinnedBytes: 0
  4560. - PeakUsedReservation: 0
  4561. - ReadIoBytes: 0
  4562. - ReadIoOps: 0 (0)
  4563. - ReadIoWaitTime: 0.000ns
  4564. - ReservationLimit: 0
  4565. - WriteIoBytes: 0
  4566. - WriteIoOps: 0 (0)
  4567. - WriteIoWaitTime: 0.000ns
  4568. Fragment Instance Lifecycle Timings:
  4569. - ExecTime: 36.001ms
  4570. - ExecTreeExecTime: 32.001ms
  4571. - OpenTime: 56.002ms
  4572. - ExecTreeOpenTime: 0.000ns
  4573. - PrepareTime: 0.000ns
  4574. - ExecTreePrepareTime: 0.000ns
  4575. KrpcDataStreamSender (dst_id=5):(Total: 4.000ms, non-child: 0.000ns, % non-child: 0.00%)
  4576. - EosSent: 6 (6)
  4577. - NetworkThroughput: 0.00 /sec
  4578. - PeakMemoryUsage: 69.80 KB (71472)
  4579. - RowsSent: 0 (0)
  4580. - RpcFailure: 0 (0)
  4581. - RpcRetry: 0 (0)
  4582. - SerializeBatchTime: 0.000ns
  4583. - TotalBytesSent: 0
  4584. - UncompressedRowBatchSize: 0
  4585. HDFS_SCAN_NODE (id=0):(Total: 32.001ms, non-child: 32.001ms, % non-child: 100.00%)
  4586. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:6/703.67 MB
  4587. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6
  4588. Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0%
  4589. File Formats: PARQUET/NONE:6
  4590. - FooterProcessingTime: (Avg: 18.000ms ; Min: 4.000ms ; Max: 28.001ms ; Number of samples: 6)
  4591. - AverageHdfsReadThreadConcurrency: 0.00
  4592. - AverageScannerThreadConcurrency: 0.00
  4593. - BytesRead: 600.00 KB (614400)
  4594. - BytesReadDataNodeCache: 0
  4595. - BytesReadLocal: 600.00 KB (614400)
  4596. - BytesReadRemoteUnexpected: 0
  4597. - BytesReadShortCircuit: 600.00 KB (614400)
  4598. - CachedFileHandlesHitCount: 1 (1)
  4599. - CachedFileHandlesMissCount: 5 (5)
  4600. - CollectionItemsRead: 0 (0)
  4601. - DecompressionTime: 0.000ns
  4602. - MaxCompressedTextFileLength: 0
  4603. - NumColumns: 4 (4)
  4604. - NumDictFilteredRowGroups: 0 (0)
  4605. - NumDisksAccessed: 2 (2)
  4606. - NumRowGroups: 0 (0)
  4607. - NumScannerThreadsStarted: 6 (6)
  4608. - NumScannersWithNoReads: 6 (6)
  4609. - NumStatsFilteredRowGroups: 0 (0)
  4610. - PeakMemoryUsage: 404.00 KB (413696)
  4611. - PerReadThreadRawHdfsThroughput: 146.48 MB/sec
  4612. - RemoteScanRanges: 0 (0)
  4613. - RowBatchQueueGetWaitTime: 32.001ms
  4614. - RowBatchQueuePutWaitTime: 0.000ns
  4615. - RowsRead: 0 (0)
  4616. - RowsReturned: 0 (0)
  4617. - RowsReturnedRate: 0
  4618. - ScanRangesComplete: 6 (6)
  4619. - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
  4620. - ScannerThreadsTotalWallClockTime: 172.007ms
  4621. - MaterializeTupleTime(*): 0.000ns
  4622. - ScannerThreadsSysTime: 1.911ms
  4623. - ScannerThreadsUserTime: 0.000ns
  4624. - ScannerThreadsVoluntaryContextSwitches: 24 (24)
  4625. - TotalRawHdfsOpenFileTime(*): 72.003ms
  4626. - TotalRawHdfsReadTime(*): 4.000ms
  4627. - TotalReadThroughput: 0.00 /sec
  4628. CodeGen:(Total: 52.002ms, non-child: 52.002ms, % non-child: 100.00%)
  4629. - CodegenTime: 4.000ms
  4630. - CompileTime: 12.000ms
  4631. - LoadTime: 0.000ns
  4632. - ModuleBitcodeSize: 1.95 MB (2040108)
  4633. - NumFunctions: 35 (35)
  4634. - NumInstructions: 576 (576)
  4635. - OptimizationTime: 24.001ms
  4636. - PeakMemoryUsage: 288.00 KB (294912)
  4637. - PrepareTime: 16.000ms
  4638. Instance 33406f6405038287:b47e1f8b00000009 (host=slave-cn06:22000):(Total: 88.002ms, non-child: 0.000ns, % non-child: 0.00%)
  4639. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/632.76 MB
  4640. Fragment Instance Lifecycle Event Timeline: 92.002ms
  4641. - Prepare Finished: 4.000ms (4.000ms)
  4642. - Open Finished: 60.001ms (56.001ms)
  4643. - First Batch Produced: 80.002ms (20.000ms)
  4644. - First Batch Sent: 80.002ms (0.000ns)
  4645. - ExecInternal Finished: 92.002ms (12.000ms)
  4646. MemoryUsage(500.000ms): 742.45 KB
  4647. ThreadUsage(500.000ms): 6
  4648. - AverageThreadTokens: 6.00
  4649. - BloomFilterBytes: 0
  4650. - PeakMemoryUsage: 742.45 KB (760273)
  4651. - PeakReservation: 0
  4652. - PeakUsedReservation: 0
  4653. - PerHostPeakMemUsage: 67.45 MB (70723121)
  4654. - RowsProduced: 0 (0)
  4655. - TotalNetworkReceiveTime: 0.000ns
  4656. - TotalNetworkSendTime: 4.000ms
  4657. - TotalStorageWaitTime: 112.003ms
  4658. - TotalThreadsInvoluntaryContextSwitches: 0 (0)
  4659. - TotalThreadsTotalWallClockTime: 200.006ms
  4660. - TotalThreadsSysTime: 196.000us
  4661. - TotalThreadsUserTime: 57.779ms
  4662. - TotalThreadsVoluntaryContextSwitches: 70 (70)
  4663. Buffer pool:
  4664. - AllocTime: 0.000ns
  4665. - CumulativeAllocationBytes: 0
  4666. - CumulativeAllocations: 0 (0)
  4667. - PeakReservation: 0
  4668. - PeakUnpinnedBytes: 0
  4669. - PeakUsedReservation: 0
  4670. - ReadIoBytes: 0
  4671. - ReadIoOps: 0 (0)
  4672. - ReadIoWaitTime: 0.000ns
  4673. - ReservationLimit: 0
  4674. - WriteIoBytes: 0
  4675. - WriteIoOps: 0 (0)
  4676. - WriteIoWaitTime: 0.000ns
  4677. Fragment Instance Lifecycle Timings:
  4678. - ExecTime: 32.001ms
  4679. - ExecTreeExecTime: 28.000ms
  4680. - OpenTime: 56.001ms
  4681. - ExecTreeOpenTime: 0.000ns
  4682. - PrepareTime: 0.000ns
  4683. - ExecTreePrepareTime: 0.000ns
  4684. KrpcDataStreamSender (dst_id=5):(Total: 4.000ms, non-child: 0.000ns, % non-child: 0.00%)
  4685. BytesSent(500.000ms): 0
  4686. - EosSent: 6 (6)
  4687. - NetworkThroughput: 0.00 /sec
  4688. - PeakMemoryUsage: 69.80 KB (71472)
  4689. - RowsSent: 0 (0)
  4690. - RpcFailure: 0 (0)
  4691. - RpcRetry: 0 (0)
  4692. - SerializeBatchTime: 0.000ns
  4693. - TotalBytesSent: 0
  4694. - UncompressedRowBatchSize: 0
  4695. HDFS_SCAN_NODE (id=0):(Total: 28.000ms, non-child: 28.000ms, % non-child: 100.00%)
  4696. Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/632.76 MB
  4697. ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5
  4698. Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0%
  4699. File Formats: PARQUET/NONE:5
  4700. BytesRead(500.000ms): 0
  4701. - FooterProcessingTime: (Avg: 22.400ms ; Min: 20.000ms ; Max: 28.000ms ; Number of samples: 5)
  4702. - AverageHdfsReadThreadConcurrency: 1.00
  4703. - AverageScannerThreadConcurrency: 5.00
  4704. - BytesRead: 500.00 KB (512000)
  4705. - BytesReadDataNodeCache: 0
  4706. - BytesReadLocal: 100.00 KB (102400)
  4707. - BytesReadRemoteUnexpected: 0
  4708. - BytesReadShortCircuit: 100.00 KB (102400)
  4709. - CachedFileHandlesHitCount: 0 (0)
  4710. - CachedFileHandlesMissCount: 5 (5)
  4711. - CollectionItemsRead: 0 (0)
  4712. - DecompressionTime: 0.000ns
  4713. - MaxCompressedTextFileLength: 0
  4714. - NumColumns: 4 (4)
  4715. - NumDictFilteredRowGroups: 0 (0)
  4716. - NumDisksAccessed: 2 (2)
  4717. - NumRowGroups: 0 (0)
  4718. - NumScannerThreadsStarted: 5 (5)
  4719. - NumScannersWithNoReads: 5 (5)
  4720. - NumStatsFilteredRowGroups: 0 (0)
  4721. - PeakMemoryUsage: 664.00 KB (679936)
  4722. - PerReadThreadRawHdfsThroughput: 24.41 MB/sec
  4723. - RemoteScanRanges: 12 (12)
  4724. - RowBatchQueueGetWaitTime: 28.000ms
  4725. - RowBatchQueuePutWaitTime: 0.000ns
  4726. - RowsRead: 0 (0)
  4727. - RowsReturned: 0 (0)
  4728. - RowsReturnedRate: 0
  4729. - ScanRangesComplete: 5 (5)
  4730. - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
  4731. - ScannerThreadsTotalWallClockTime: 112.003ms
  4732. - MaterializeTupleTime(*): 0.000ns
  4733. - ScannerThreadsSysTime: 1.483ms
  4734. - ScannerThreadsUserTime: 0.000ns
  4735. - ScannerThreadsVoluntaryContextSwitches: 24 (24)
  4736. - TotalRawHdfsOpenFileTime(*): 92.003ms
  4737. - TotalRawHdfsReadTime(*): 20.000ms
  4738. - TotalReadThroughput: 0.00 /sec
  4739. CodeGen:(Total: 56.001ms, non-child: 56.001ms, % non-child: 100.00%)
  4740. - CodegenTime: 4.000ms
  4741. - CompileTime: 8.000ms
  4742. - LoadTime: 0.000ns
  4743. - ModuleBitcodeSize: 1.95 MB (2040108)
  4744. - NumFunctions: 35 (35)
  4745. - NumInstructions: 576 (576)
  4746. - OptimizationTime: 28.000ms
  4747. - PeakMemoryUsage: 288.00 KB (294912)
  4748. - PrepareTime: 20.000ms
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement