Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- Query (id=984ea1ea895ca2cf:a12d79aa00000000):
- Summary:
- Session ID: 6b47c6050e2bebca:644e2b83aa0ac4b0
- Session Type: BEESWAX
- Start Time: 2018-08-16 01:24:20.196188000
- End Time: 2018-08-16 01:33:46.044764000
- Query Type: QUERY
- Query State: FINISHED
- Query Status: OK
- Impala Version: impalad version 2.12.0-cdh5.15.0 RELEASE (build 23f574543323301846b41fa5433690df32efe085)
- User: root
- Connected User: root
- Delegated User:
- Network Address: 10.0.9.3:55616
- Default Db: default
- Sql Statement: SELECT pp.event_id, ts.x, ts.y, ts.z, ts.tx, ts.ty, ts.qOverP, pp.`track_track_id` AS track_id FROM protoparticles_16 AS pp, track_16 AS tr, track_state_16 AS ts WHERE pp.track_track_id IS NOT NULL AND tr.type = 3 AND pp.hasMuonPIDStatus = true AND pp.muonPID_IsMuon = true AND (tr.CloneDist IS NULL OR tr.CloneDist > 5000) AND ABS(ts.qOverP) > 1e-20 AND tr.chi2PerDoF * tr.nDoF > 0.0 AND pp.event_id = tr.event_id AND pp.track_track_id = tr.track_id AND ts.event_id = pp.event_id AND ts.track_id = pp.track_track_id AND ts.`location` = 1
- Coordinator: slave-cn02:22000
- Query Options (set by configuration):
- Query Options (set by configuration and planner): MT_DOP=0
- Plan:
- ----------------
- Max Per-Host Resource Reservation: Memory=50.50MB
- Per-Host Resource Estimates: Memory=1.34GB
- F04:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
- | Per-Host Resources: mem-estimate=0B mem-reservation=0B
- PLAN-ROOT SINK
- | mem-estimate=0B mem-reservation=0B
- |
- 08:EXCHANGE [UNPARTITIONED]
- | mem-estimate=0B mem-reservation=0B
- | tuple-ids=1,2,0 row-size=102B cardinality=19071
- |
- F03:PLAN FRAGMENT [HASH(tr.event_id,tr.track_id)] hosts=6 instances=6
- Per-Host Resources: mem-estimate=10.50MB mem-reservation=10.50MB runtime-filters-memory=2.00MB
- 04:HASH JOIN [INNER JOIN, PARTITIONED]
- | hash predicates: tr.event_id = pp.event_id, tr.track_id = pp.track_track_id
- | fk/pk conjuncts: tr.event_id = pp.event_id, tr.track_id = pp.track_track_id
- | runtime filters: RF000[bloom] <- pp.event_id, RF001[bloom] <- pp.track_track_id
- | mem-estimate=8.50MB mem-reservation=8.50MB spill-buffer=512.00KB
- | tuple-ids=1,2,0 row-size=102B cardinality=19071
- |
- |--07:EXCHANGE [HASH(pp.event_id,pp.track_track_id)]
- | | mem-estimate=0B mem-reservation=0B
- | | tuple-ids=2,0 row-size=70B cardinality=467130
- | |
- | F01:PLAN FRAGMENT [RANDOM] hosts=6 instances=6
- | Per-Host Resources: mem-estimate=721.01MB mem-reservation=38.00MB runtime-filters-memory=4.00MB
- | 03:HASH JOIN [INNER JOIN, BROADCAST]
- | | hash predicates: ts.event_id = pp.event_id, ts.track_id = pp.track_track_id
- | | fk/pk conjuncts: ts.event_id = pp.event_id, ts.track_id = pp.track_track_id
- | | runtime filters: RF004[bloom] <- pp.event_id, RF005[bloom] <- pp.track_track_id
- | | mem-estimate=69.01MB mem-reservation=34.00MB spill-buffer=2.00MB
- | | tuple-ids=2,0 row-size=70B cardinality=467130
- | |
- | |--05:EXCHANGE [BROADCAST]
- | | | mem-estimate=0B mem-reservation=0B
- | | | tuple-ids=0 row-size=10B cardinality=6578104
- | | |
- | | F02:PLAN FRAGMENT [RANDOM] hosts=6 instances=6
- | | Per-Host Resources: mem-estimate=256.00MB mem-reservation=0B
- | | 00:SCAN HDFS [default.protoparticles_16 pp, RANDOM]
- | | partitions=1/1 files=32 size=1.71GB
- | | predicates: pp.track_track_id IS NOT NULL, pp.hasMuonPIDStatus = TRUE, pp.muonPID_IsMuon = TRUE
- | | stored statistics:
- | | table: rows=117208496 size=1.71GB
- | | columns: all
- | | extrapolated-rows=disabled
- | | parquet statistics predicates: pp.hasMuonPIDStatus = TRUE, pp.muonPID_IsMuon = TRUE
- | | parquet dictionary predicates: pp.track_track_id IS NOT NULL, pp.hasMuonPIDStatus = TRUE, pp.muonPID_IsMuon = TRUE
- | | mem-estimate=256.00MB mem-reservation=0B
- | | tuple-ids=0 row-size=10B cardinality=6578104
- | |
- | 02:SCAN HDFS [default.track_state_16 ts, RANDOM]
- | partitions=1/1 files=379 size=22.98GB
- | predicates: ts.`location` = 1, ts.track_id IS NOT NULL, abs(ts.qOverP) > 1E-20
- | runtime filters: RF004[bloom] -> ts.event_id, RF005[bloom] -> ts.track_id
- | stored statistics:
- | table: rows=314739136 size=22.98GB
- | columns: all
- | extrapolated-rows=disabled
- | parquet statistics predicates: ts.`location` = 1
- | parquet dictionary predicates: ts.`location` = 1, ts.track_id IS NOT NULL, abs(ts.qOverP) > 1E-20
- | mem-estimate=648.00MB mem-reservation=0B
- | tuple-ids=2 row-size=60B cardinality=15736957
- |
- 06:EXCHANGE [HASH(tr.event_id,tr.track_id)]
- | mem-estimate=0B mem-reservation=0B
- | tuple-ids=1 row-size=32B cardinality=6541816
- |
- F00:PLAN FRAGMENT [RANDOM] hosts=6 instances=6
- Per-Host Resources: mem-estimate=386.00MB mem-reservation=2.00MB runtime-filters-memory=2.00MB
- 01:SCAN HDFS [default.track_16 tr, RANDOM]
- partitions=1/1 files=65 size=3.41GB
- predicates: tr.type = 3, tr.track_id IS NOT NULL, (tr.CloneDist IS NULL OR tr.CloneDist > 5000), tr.chi2PerDoF * tr.nDoF > 0.0
- runtime filters: RF000[bloom] -> tr.event_id, RF001[bloom] -> tr.track_id
- stored statistics:
- table: rows=160241120 size=3.41GB
- columns: all
- extrapolated-rows=disabled
- parquet statistics predicates: tr.type = 3
- parquet dictionary predicates: tr.type = 3, tr.track_id IS NOT NULL
- mem-estimate=384.00MB mem-reservation=0B
- tuple-ids=1 row-size=32B cardinality=6541816
- ----------------
- Estimated Per-Host Mem: 1440226536
- Per Host Min Reservation: slave-cn02:22000(50.50 MB) slave-cn03:22000(50.50 MB) slave-cn04:22000(50.50 MB) slave-cn05:22000(50.50 MB) slave-cn06:22000(50.50 MB) slave-cn07:22000(50.50 MB)
- Request Pool: root.root
- Admission result: Admitted immediately
- ExecSummary:
- Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail
- -------------------------------------------------------------------------------------------------------------------------------------
- 08:EXCHANGE 1 96.004ms 96.004ms 2.73M 19.07K 12.99 MB 0 UNPARTITIONED
- 04:HASH JOIN 6 1s220ms 1s572ms 2.73M 19.07K 53.07 MB 8.50 MB INNER JOIN, PARTITIONED
- |--07:EXCHANGE 6 16.000ms 28.001ms 2.76M 467.13K 272.00 KB 0 HASH(pp.event_id,pp.track_track_id)
- | 03:HASH JOIN 6 2s416ms 2s480ms 2.76M 467.13K 192.40 MB 69.01 MB INNER JOIN, BROADCAST
- | |--05:EXCHANGE 6 59.336ms 68.003ms 3.68M 6.58M 12.70 MB 0 BROADCAST
- | | 00:SCAN HDFS 6 156.673ms 188.010ms 3.68M 6.58M 21.22 MB 256.00 MB default.protoparticles_16 pp
- | 02:SCAN HDFS 6 2s374ms 3s368ms 98.47M 15.74M 1.58 GB 648.00 MB default.track_state_16 ts
- 06:EXCHANGE 6 139.339ms 188.006ms 44.21M 6.54M 12.79 MB 0 HASH(tr.event_id,tr.track_id)
- 01:SCAN HDFS 6 1s209ms 1s236ms 44.21M 6.54M 254.93 MB 384.00 MB default.track_16 tr
- Errors:
- Query Compilation: 4s908ms
- - Metadata load started: 2.868ms (2.868ms)
- - Metadata load finished. loaded-tables=3/3 load-requests=1 catalog-updates=5: 4s886ms (4s883ms)
- - Analysis finished: 4s890ms (3.811ms)
- - Value transfer graph computed: 4s890ms (538.464us)
- - Single node plan created: 4s901ms (10.708ms)
- - Runtime filters computed: 4s902ms (828.626us)
- - Distributed plan created: 4s902ms (102.096us)
- - Lineage info computed: 4s903ms (465.594us)
- - Planning finished: 4s908ms (5.437ms)
- Query Timeline: 9m25s
- - Query submitted: 0.000ns (0.000ns)
- - Planning finished: 4s916ms (4s916ms)
- - Submit for admission: 4s916ms (0.000ns)
- - Completed admission: 4s916ms (0.000ns)
- - Ready to start on 6 backends: 4s920ms (4.000ms)
- - All 6 execution backends (25 fragment instances) started: 4s920ms (0.000ns)
- - First dynamic filter received: 12s460ms (7s540ms)
- - Rows available: 12s504ms (44.002ms)
- - First row fetched: 12s564ms (60.002ms)
- - Last row fetched: 9m25s (9m13s)
- - Released admission control resources: 9m25s (4.000ms)
- - Unregister query: 9m25s (136.006ms)
- - ComputeScanRangeAssignmentTimer: 0.000ns
- ImpalaServer:
- - ClientFetchWaitTimer: 8m57s
- - RowMaterializationTimer: 15s412ms
- Execution Profile 984ea1ea895ca2cf:a12d79aa00000000:(Total: 22s953ms, non-child: 0.000ns, % non-child: 0.00%)
- Number of filters: 4
- Filter routing table:
- ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled
- -------------------------------------------------------------------------------------------------------------------
- 5 3 2 LOCAL false 0 (6) N/A N/A true
- 4 3 2 LOCAL false 0 (6) N/A N/A true
- 1 4 1 REMOTE false 6 (6) N/A N/A true
- 0 4 1 REMOTE false 6 (6) N/A N/A true
- Backend startup latencies: Count: 6, min / max: 1ms / 2ms, 25th %-ile: 2ms, 50th %-ile: 2ms, 75th %-ile: 2ms, 90th %-ile: 2ms, 95th %-ile: 2ms, 99.9th %-ile: 2ms
- Final filter table:
- ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled
- -------------------------------------------------------------------------------------------------------------------
- 5 3 2 LOCAL false 0 (6) N/A N/A true
- 4 3 2 LOCAL false 0 (6) N/A N/A true
- 1 4 1 REMOTE false 0 (6) 12s460ms 12s504ms false
- 0 4 1 REMOTE false 0 (6) 12s460ms 12s508ms false
- Per Node Peak Memory Usage: slave-cn02:22000(1.90 GB) slave-cn03:22000(1.57 GB) slave-cn04:22000(1.79 GB) slave-cn05:22000(2.03 GB) slave-cn06:22000(938.16 MB) slave-cn07:22000(2.05 GB)
- - FiltersReceived: 12 (12)
- - FinalizationTimer: 0.000ns
- - NumBackends: 6 (6)
- - NumFragmentInstances: 25 (25)
- - NumFragments: 5 (5)
- Averaged Fragment F04:(Total: 9m20s, non-child: 9m13s, % non-child: 98.63%)
- split sizes: min: 0, max: 0, avg: 0, stddev: 0
- completion times: min:9m20s max:9m20s mean: 9m20s stddev:0.000ns
- execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
- num instances: 1
- - AverageThreadTokens: 0.00
- - BloomFilterBytes: 0
- - PeakMemoryUsage: 13.01 MB (13647101)
- - PeakReservation: 0
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 1.90 GB (2039715865)
- - RowsProduced: 2.73M (2733728)
- - TotalNetworkReceiveTime: 7s600ms
- - TotalNetworkSendTime: 0.000ns
- - TotalStorageWaitTime: 0.000ns
- - TotalThreadsInvoluntaryContextSwitches: 23 (23)
- - TotalThreadsTotalWallClockTime: 9m20s
- - TotalThreadsSysTime: 836.531ms
- - TotalThreadsUserTime: 14s504ms
- - TotalThreadsVoluntaryContextSwitches: 2.69K (2687)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 0
- - CumulativeAllocations: 0 (0)
- - PeakReservation: 0
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 0
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 0
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 9m13s
- - ExecTreeExecTime: 100.004ms
- - OpenTime: 7s584ms
- - ExecTreeOpenTime: 7s564ms
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- PLAN_ROOT_SINK:
- - PeakMemoryUsage: 0
- EXCHANGE_NODE (id=8):(Total: 7s660ms, non-child: 7s660ms, % non-child: 100.00%)
- - ConvertRowBatchTime: 60.002ms
- - PeakMemoryUsage: 12.99 MB (13622525)
- - RowsReturned: 2.73M (2733728)
- - RowsReturnedRate: 356.87 K/sec
- Buffer pool:
- - AllocTime: 20.000ms
- - CumulativeAllocationBytes: 417.26 MB (437526528)
- - CumulativeAllocations: 5.35K (5348)
- - PeakReservation: 12.70 MB (13312000)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.70 MB (13312000)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- - FirstBatchWaitTime: 7s564ms
- - TotalBytesDequeued: 338.92 MB (355384640)
- - TotalGetBatchTime: 7s600ms
- - DataWaitTime: 7s564ms
- Enqueue:
- - DeserializeRowBatchTime: 380.017ms
- - TotalBatchesEnqueued: 2.67K (2674)
- - TotalBatchesReceived: 2.67K (2674)
- - TotalBytesReceived: 231.81 MB (243067985)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 8m56s
- - TotalRPCsDeferred: 2.59K (2594)
- CodeGen:(Total: 20.000ms, non-child: 20.000ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 0.000ns
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 0 (0)
- - NumInstructions: 0 (0)
- - OptimizationTime: 0.000ns
- - PeakMemoryUsage: 0
- - PrepareTime: 16.000ms
- Coordinator Fragment F04:
- Instance 984ea1ea895ca2cf:a12d79aa00000000 (host=slave-cn02:22000):(Total: 9m20s, non-child: 9m13s, % non-child: 98.63%)
- Fragment Instance Lifecycle Event Timeline: 9m20s
- - Prepare Finished: 0.000ns (0.000ns)
- - Open Finished: 7s584ms (7s584ms)
- - First Batch Produced: 7s584ms (0.000ns)
- - First Batch Sent: 7s652ms (68.003ms)
- - ExecInternal Finished: 9m20s (9m13s)
- MemoryUsage(16s000ms): 6.92 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 13.01 MB, 12.98 MB, 12.72 MB
- - AverageThreadTokens: 0.00
- - BloomFilterBytes: 0
- - PeakMemoryUsage: 13.01 MB (13647101)
- - PeakReservation: 0
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 1.90 GB (2039715865)
- - RowsProduced: 2.73M (2733728)
- - TotalNetworkReceiveTime: 7s600ms
- - TotalNetworkSendTime: 0.000ns
- - TotalStorageWaitTime: 0.000ns
- - TotalThreadsInvoluntaryContextSwitches: 23 (23)
- - TotalThreadsTotalWallClockTime: 9m20s
- - TotalThreadsSysTime: 836.531ms
- - TotalThreadsUserTime: 14s504ms
- - TotalThreadsVoluntaryContextSwitches: 2.69K (2687)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 0
- - CumulativeAllocations: 0 (0)
- - PeakReservation: 0
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 0
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 0
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 9m13s
- - ExecTreeExecTime: 100.004ms
- - OpenTime: 7s584ms
- - ExecTreeOpenTime: 7s564ms
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- PLAN_ROOT_SINK:
- - PeakMemoryUsage: 0
- EXCHANGE_NODE (id=8):(Total: 7s660ms, non-child: 96.004ms, % non-child: 1.25%)
- - ConvertRowBatchTime: 60.002ms
- - PeakMemoryUsage: 12.99 MB (13622525)
- - RowsReturned: 2.73M (2733728)
- - RowsReturnedRate: 356.87 K/sec
- Buffer pool:
- - AllocTime: 20.000ms
- - CumulativeAllocationBytes: 417.26 MB (437526528)
- - CumulativeAllocations: 5.35K (5348)
- - PeakReservation: 12.70 MB (13312000)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.70 MB (13312000)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(16s000ms): 1.41 MB, 10.14 MB, 19.99 MB, 29.57 MB, 39.12 MB, 48.67 MB, 58.50 MB, 68.10 MB, 77.86 MB, 87.59 MB, 97.35 MB, 106.88 MB, 116.60 MB, 126.38 MB, 136.15 MB, 145.85 MB, 155.68 MB, 165.48 MB, 175.34 MB, 184.95 MB, 194.75 MB, 204.78 MB, 214.75 MB, 224.71 MB, 234.71 MB, 244.76 MB, 254.58 MB, 264.46 MB, 274.51 MB, 284.51 MB, 294.41 MB, 304.19 MB, 314.02 MB, 323.89 MB, 333.65 MB
- - FirstBatchWaitTime: 7s564ms
- - TotalBytesDequeued: 338.92 MB (355384640)
- - TotalGetBatchTime: 7s600ms
- - DataWaitTime: 7s564ms
- Enqueue:
- BytesReceived(16s000ms): 4.80 MB, 14.16 MB, 20.90 MB, 27.46 MB, 33.99 MB, 40.52 MB, 47.25 MB, 53.81 MB, 60.49 MB, 67.15 MB, 73.83 MB, 80.35 MB, 87.00 MB, 93.69 MB, 100.37 MB, 107.01 MB, 113.74 MB, 120.45 MB, 127.19 MB, 133.76 MB, 140.46 MB, 147.32 MB, 154.14 MB, 160.96 MB, 167.79 MB, 174.67 MB, 181.39 MB, 188.15 MB, 195.03 MB, 201.87 MB, 208.65 MB, 215.34 MB, 222.07 MB, 228.78 MB, 231.81 MB
- DeferredQueueSize(16s000ms): 2, 5, 6, 6, 6, 5, 6, 5, 6, 6, 6, 6, 6, 5, 5, 6, 6, 6, 6, 6, 6, 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 6, 5, 0
- - DispatchTime: (Avg: 77.207us ; Min: 26.899us ; Max: 745.813us ; Number of samples: 2674)
- - DeserializeRowBatchTime: 380.017ms
- - TotalBatchesEnqueued: 2.67K (2674)
- - TotalBatchesReceived: 2.67K (2674)
- - TotalBytesReceived: 231.81 MB (243067985)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 8m56s
- - TotalRPCsDeferred: 2.59K (2594)
- CodeGen:(Total: 20.000ms, non-child: 20.000ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 0.000ns
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 0 (0)
- - NumInstructions: 0 (0)
- - OptimizationTime: 0.000ns
- - PeakMemoryUsage: 0
- - PrepareTime: 16.000ms
- Averaged Fragment F03:(Total: 9m3s, non-child: 18.000ms, % non-child: 0.00%)
- split sizes: min: 0, max: 0, avg: 0, stddev: 0
- completion times: min:9m2s max:9m4s mean: 9m3s stddev:645.181ms
- execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
- num instances: 6
- - AverageThreadTokens: 1.01
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 66.37 MB (69593836)
- - PeakReservation: 53.83 MB (56448341)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 1.71 GB (1836833523)
- - RowsProduced: 455.62K (455621)
- - TotalNetworkReceiveTime: 8s027ms
- - TotalNetworkSendTime: 8m54s
- - TotalStorageWaitTime: 0.000ns
- - TotalThreadsInvoluntaryContextSwitches: 4 (4)
- - TotalThreadsTotalWallClockTime: 9m10s
- - TotalThreadsSysTime: 375.320ms
- - TotalThreadsUserTime: 1s955ms
- - TotalThreadsVoluntaryContextSwitches: 13.10K (13103)
- Buffer pool:
- - AllocTime: 666.697us
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 8m55s
- - ExecTreeExecTime: 1s132ms
- - OpenTime: 7s577ms
- - ExecTreeOpenTime: 7s307ms
- - PrepareTime: 1.333ms
- - ExecTreePrepareTime: 666.697us
- KrpcDataStreamSender (dst_id=8):(Total: 8m54s, non-child: 8m54s, % non-child: 100.00%)
- - EosSent: 1 (1)
- - NetworkThroughput: 76.00 MB/sec
- - PeakMemoryUsage: 3.61 KB (3696)
- - RowsSent: 455.62K (455621)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 244.677ms
- - TotalBytesSent: 38.63 MB (40511330)
- - UncompressedRowBatchSize: 56.49 MB (59230773)
- HASH_JOIN_NODE (id=4):(Total: 8s438ms, non-child: 1s220ms, % non-child: 14.47%)
- - BuildRows: 459.47K (459466)
- - BuildTime: 224.677ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 51.90 MB (54421077)
- - ProbeRows: 7.37M (7368006)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 981.378ms
- - RowsReturned: 455.62K (455621)
- - RowsReturnedRate: 54.02 K/sec
- Buffer pool:
- - AllocTime: 32.001ms
- - CumulativeAllocationBytes: 51.83 MB (54351189)
- - CumulativeAllocations: 87 (87)
- - PeakReservation: 51.83 MB (54351189)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 51.83 MB (54351189)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=4):
- - BuildRowsPartitionTime: 179.341ms
- - BuildRowsPartitioned: 459.47K (459466)
- - HashBuckets: 1.05M (1048576)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 40.668ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 30.12 KB (30848)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=7):(Total: 7s078ms, non-child: 7s078ms, % non-child: 100.00%)
- - ConvertRowBatchTime: 8.667ms
- - PeakMemoryUsage: 206.67 KB (211626)
- - RowsReturned: 459.47K (459466)
- - RowsReturnedRate: 64.91 K/sec
- Buffer pool:
- - AllocTime: 57.336ms
- - CumulativeAllocationBytes: 48.12 MB (50454528)
- - CumulativeAllocations: 4.11K (4108)
- - PeakReservation: 206.67 KB (211626)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 206.67 KB (211626)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- - FirstBatchWaitTime: 1s029ms
- - TotalBytesDequeued: 39.00 MB (40892533)
- - TotalGetBatchTime: 7s068ms
- - DataWaitTime: 7s062ms
- Enqueue:
- - DeserializeRowBatchTime: 93.337ms
- - TotalBatchesEnqueued: 2.05K (2054)
- - TotalBatchesReceived: 2.05K (2054)
- - TotalBytesReceived: 28.25 MB (29623056)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 0.000ns
- - TotalRPCsDeferred: 0 (0)
- EXCHANGE_NODE (id=6):(Total: 1s064ms, non-child: 1s064ms, % non-child: 100.00%)
- - ConvertRowBatchTime: 97.337ms
- - PeakMemoryUsage: 12.36 MB (12958185)
- - RowsReturned: 7.37M (7368006)
- - RowsReturnedRate: 6.93 M/sec
- Buffer pool:
- - AllocTime: 216.677ms
- - CumulativeAllocationBytes: 348.20 MB (365118805)
- - CumulativeAllocations: 29.71K (29715)
- - PeakReservation: 12.34 MB (12939264)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.34 MB (12939264)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- - FirstBatchWaitTime: 925.376ms
- - TotalBytesDequeued: 288.09 MB (302088273)
- - TotalGetBatchTime: 957.377ms
- - DataWaitTime: 925.376ms
- Enqueue:
- - DeserializeRowBatchTime: 551.359ms
- - TotalBatchesEnqueued: 14.86K (14857)
- - TotalBatchesReceived: 14.86K (14857)
- - TotalBytesReceived: 155.12 MB (162656546)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 1m32s
- - TotalRPCsDeferred: 422 (422)
- CodeGen:(Total: 264.679ms, non-child: 264.679ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 76.670ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 78 (78)
- - NumInstructions: 2.75K (2748)
- - OptimizationTime: 168.674ms
- - PeakMemoryUsage: 1.34 MB (1406976)
- - PrepareTime: 18.667ms
- Fragment F03:
- Instance 984ea1ea895ca2cf:a12d79aa00000013 (host=slave-cn02:22000):(Total: 9m4s, non-child: 16.000ms, % non-child: 0.00%)
- Fragment Instance Lifecycle Event Timeline: 9m4s
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 7s592ms (7s588ms)
- - First Batch Produced: 7s596ms (4.000ms)
- - First Batch Sent: 7s596ms (0.000ns)
- - ExecInternal Finished: 9m4s (8m56s)
- MemoryUsage(16s000ms): 47.21 MB, 65.60 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB
- ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- - AverageThreadTokens: 1.01
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 65.63 MB (68821452)
- - PeakReservation: 53.00 MB (55574528)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 1.90 GB (2039715865)
- - RowsProduced: 455.80K (455797)
- - TotalNetworkReceiveTime: 8s044ms
- - TotalNetworkSendTime: 8m54s
- - TotalStorageWaitTime: 0.000ns
- - TotalThreadsInvoluntaryContextSwitches: 2 (2)
- - TotalThreadsTotalWallClockTime: 9m11s
- - TotalThreadsSysTime: 665.423ms
- - TotalThreadsUserTime: 1s844ms
- - TotalThreadsVoluntaryContextSwitches: 13.27K (13272)
- Buffer pool:
- - AllocTime: 4.000ms
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 8m56s
- - ExecTreeExecTime: 1s472ms
- - OpenTime: 7s588ms
- - ExecTreeOpenTime: 7s320ms
- - PrepareTime: 4.000ms
- - ExecTreePrepareTime: 4.000ms
- KrpcDataStreamSender (dst_id=8):(Total: 8m55s, non-child: 252.011ms, % non-child: 0.05%)
- BytesSent(16s000ms): 732.11 KB, 2.20 MB, 3.32 MB, 4.41 MB, 5.50 MB, 6.59 MB, 7.71 MB, 8.81 MB, 9.92 MB, 11.03 MB, 12.14 MB, 13.23 MB, 14.34 MB, 15.45 MB, 16.56 MB, 17.67 MB, 18.79 MB, 19.91 MB, 21.03 MB, 22.13 MB, 23.25 MB, 24.39 MB, 25.53 MB, 26.66 MB, 27.80 MB, 28.95 MB, 30.07 MB, 31.20 MB, 32.34 MB, 33.48 MB, 34.61 MB, 35.72 MB, 36.85 MB, 37.97 MB
- - EosSent: 1 (1)
- - NetworkThroughput: 231.23 MB/sec
- - PeakMemoryUsage: 3.61 KB (3696)
- - RowsSent: 455.80K (455797)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 236.010ms
- - TotalBytesSent: 38.65 MB (40530415)
- - UncompressedRowBatchSize: 56.51 MB (59253610)
- HASH_JOIN_NODE (id=4):(Total: 8s796ms, non-child: 1s572ms, % non-child: 17.87%)
- ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- - BuildRows: 459.64K (459644)
- - BuildTime: 224.010ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 51.07 MB (53547264)
- - ProbeRows: 7.37M (7368309)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 1s328ms
- - RowsReturned: 455.80K (455797)
- - RowsReturnedRate: 51.82 K/sec
- Buffer pool:
- - AllocTime: 44.002ms
- - CumulativeAllocationBytes: 51.00 MB (53477376)
- - CumulativeAllocations: 86 (86)
- - PeakReservation: 51.00 MB (53477376)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 51.00 MB (53477376)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=4):
- ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- Runtime filters: 2 of 2 Runtime Filters Published
- - BuildRowsPartitionTime: 164.007ms
- - BuildRowsPartitioned: 459.64K (459644)
- - HashBuckets: 1.05M (1048576)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 56.002ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 30.12 KB (30848)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=7):(Total: 7s088ms, non-child: 24.001ms, % non-child: 0.34%)
- - ConvertRowBatchTime: 12.000ms
- - PeakMemoryUsage: 272.00 KB (278528)
- - RowsReturned: 459.64K (459644)
- - RowsReturnedRate: 64.84 K/sec
- Buffer pool:
- - AllocTime: 72.003ms
- - CumulativeAllocationBytes: 48.14 MB (50479104)
- - CumulativeAllocations: 4.11K (4110)
- - PeakReservation: 272.00 KB (278528)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 272.00 KB (278528)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(500.000ms): 0, 0, 0, 895.56 KB, 1.81 MB, 3.06 MB, 4.45 MB, 7.47 MB, 11.50 MB, 16.07 MB, 20.80 MB, 25.55 MB, 29.97 MB, 33.58 MB, 37.41 MB
- - FirstBatchWaitTime: 1s032ms
- - TotalBytesDequeued: 39.01 MB (40908316)
- - TotalGetBatchTime: 7s076ms
- - DataWaitTime: 7s064ms
- Enqueue:
- BytesReceived(500.000ms): 0, 0, 0, 644.66 KB, 1.30 MB, 2.20 MB, 3.21 MB, 5.39 MB, 8.31 MB, 11.62 MB, 15.05 MB, 18.50 MB, 21.70 MB, 24.32 MB, 27.10 MB
- DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 50.298us ; Min: 23.835us ; Max: 201.541us ; Number of samples: 2055)
- - DeserializeRowBatchTime: 96.004ms
- - TotalBatchesEnqueued: 2.06K (2055)
- - TotalBatchesReceived: 2.06K (2055)
- - TotalBytesReceived: 28.26 MB (29634329)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 0.000ns
- - TotalRPCsDeferred: 0 (0)
- EXCHANGE_NODE (id=6):(Total: 1s064ms, non-child: 136.006ms, % non-child: 12.78%)
- - ConvertRowBatchTime: 96.004ms
- - PeakMemoryUsage: 12.56 MB (13172736)
- - RowsReturned: 7.37M (7368309)
- - RowsReturnedRate: 6.92 M/sec
- Buffer pool:
- - AllocTime: 144.006ms
- - CumulativeAllocationBytes: 348.20 MB (365109248)
- - CumulativeAllocations: 29.71K (29714)
- - PeakReservation: 12.56 MB (13172736)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.56 MB (13172736)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(16s000ms): 6.02 MB, 17.45 MB, 25.41 MB, 33.36 MB, 41.38 MB, 49.45 MB, 57.81 MB, 65.91 MB, 74.22 MB, 82.55 MB, 90.95 MB, 99.11 MB, 107.42 MB, 115.70 MB, 123.99 MB, 132.33 MB, 140.69 MB, 149.11 MB, 157.55 MB, 165.87 MB, 174.25 MB, 182.83 MB, 191.39 MB, 199.86 MB, 208.38 MB, 216.85 MB, 225.10 MB, 233.65 MB, 242.24 MB, 250.74 MB, 259.20 MB, 267.53 MB, 275.93 MB, 284.28 MB
- - FirstBatchWaitTime: 928.042ms
- - TotalBytesDequeued: 288.11 MB (302100669)
- - TotalGetBatchTime: 968.044ms
- - DataWaitTime: 928.042ms
- Enqueue:
- BytesReceived(16s000ms): 7.89 MB, 14.46 MB, 18.72 MB, 23.00 MB, 27.31 MB, 31.62 MB, 36.06 MB, 40.42 MB, 44.84 MB, 49.26 MB, 53.70 MB, 58.06 MB, 62.56 MB, 67.11 MB, 71.55 MB, 76.01 MB, 80.59 MB, 85.11 MB, 89.60 MB, 93.99 MB, 98.55 MB, 103.19 MB, 107.75 MB, 112.37 MB, 116.98 MB, 121.63 MB, 126.16 MB, 130.70 MB, 135.34 MB, 139.98 MB, 144.57 MB, 149.02 MB, 153.46 MB, 155.13 MB
- DeferredQueueSize(16s000ms): 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 42.205us ; Min: 10.476us ; Max: 976.886us ; Number of samples: 14857)
- - DeserializeRowBatchTime: 528.024ms
- - TotalBatchesEnqueued: 14.86K (14857)
- - TotalBatchesReceived: 14.86K (14857)
- - TotalBytesReceived: 155.13 MB (162669524)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 6s271ms
- - TotalRPCsDeferred: 7 (7)
- CodeGen:(Total: 268.012ms, non-child: 268.012ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 76.003ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 78 (78)
- - NumInstructions: 2.75K (2748)
- - OptimizationTime: 168.007ms
- - PeakMemoryUsage: 1.34 MB (1406976)
- - PrepareTime: 24.001ms
- Instance 984ea1ea895ca2cf:a12d79aa00000014 (host=slave-cn04:22000):(Total: 9m4s, non-child: 20.001ms, % non-child: 0.00%)
- Fragment Instance Lifecycle Event Timeline: 9m4s
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 7s584ms (7s580ms)
- - First Batch Produced: 7s588ms (4.000ms)
- - First Batch Sent: 7s588ms (0.000ns)
- - ExecInternal Finished: 9m4s (8m56s)
- MemoryUsage(16s000ms): 47.42 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.33 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.34 MB, 66.35 MB, 66.35 MB, 66.35 MB, 66.35 MB, 66.35 MB, 66.36 MB, 66.33 MB, 66.31 MB
- ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- - AverageThreadTokens: 1.01
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 66.36 MB (69581585)
- - PeakReservation: 53.50 MB (56098816)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 1.79 GB (1925754349)
- - RowsProduced: 455.28K (455282)
- - TotalNetworkReceiveTime: 8s056ms
- - TotalNetworkSendTime: 8m55s
- - TotalStorageWaitTime: 0.000ns
- - TotalThreadsInvoluntaryContextSwitches: 6 (6)
- - TotalThreadsTotalWallClockTime: 9m11s
- - TotalThreadsSysTime: 172.514ms
- - TotalThreadsUserTime: 2s120ms
- - TotalThreadsVoluntaryContextSwitches: 13.04K (13037)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 8m56s
- - ExecTreeExecTime: 996.052ms
- - OpenTime: 7s580ms
- - ExecTreeOpenTime: 7s320ms
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=8):(Total: 8m55s, non-child: 256.013ms, % non-child: 0.05%)
- BytesSent(16s000ms): 618.22 KB, 2.04 MB, 3.17 MB, 4.26 MB, 5.35 MB, 6.44 MB, 7.56 MB, 8.65 MB, 9.77 MB, 10.88 MB, 11.99 MB, 13.08 MB, 14.18 MB, 15.29 MB, 16.41 MB, 17.52 MB, 18.65 MB, 19.76 MB, 20.88 MB, 21.98 MB, 23.10 MB, 24.24 MB, 25.38 MB, 26.51 MB, 27.65 MB, 28.80 MB, 29.92 MB, 31.05 MB, 32.19 MB, 33.33 MB, 34.46 MB, 35.58 MB, 36.70 MB, 37.83 MB
- - EosSent: 1 (1)
- - NetworkThroughput: 44.11 MB/sec
- - PeakMemoryUsage: 3.61 KB (3696)
- - RowsSent: 455.28K (455282)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 236.012ms
- - TotalBytesSent: 38.61 MB (40486743)
- - UncompressedRowBatchSize: 56.44 MB (59186660)
- HASH_JOIN_NODE (id=4):(Total: 8s312ms, non-child: 1s076ms, % non-child: 12.95%)
- ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- - BuildRows: 459.11K (459110)
- - BuildTime: 240.012ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 51.57 MB (54071552)
- - ProbeRows: 7.37M (7369719)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 820.043ms
- - RowsReturned: 455.28K (455282)
- - RowsReturnedRate: 54.77 K/sec
- Buffer pool:
- - AllocTime: 56.002ms
- - CumulativeAllocationBytes: 51.50 MB (54001664)
- - CumulativeAllocations: 87 (87)
- - PeakReservation: 51.50 MB (54001664)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 51.50 MB (54001664)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=4):
- ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- Runtime filters: 2 of 2 Runtime Filters Published
- - BuildRowsPartitionTime: 188.009ms
- - BuildRowsPartitioned: 459.11K (459110)
- - HashBuckets: 1.05M (1048576)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 44.002ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 30.12 KB (30848)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=7):(Total: 7s072ms, non-child: 16.000ms, % non-child: 0.23%)
- - ConvertRowBatchTime: 4.000ms
- - PeakMemoryUsage: 248.00 KB (253952)
- - RowsReturned: 459.11K (459110)
- - RowsReturnedRate: 64.92 K/sec
- Buffer pool:
- - AllocTime: 84.004ms
- - CumulativeAllocationBytes: 48.07 MB (50405376)
- - CumulativeAllocations: 4.10K (4104)
- - PeakReservation: 248.00 KB (253952)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 248.00 KB (253952)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(500.000ms): 0, 0, 0, 603.53 KB, 1.69 MB, 2.79 MB, 3.99 MB, 6.83 MB, 10.70 MB, 15.27 MB, 19.96 MB, 24.70 MB, 29.33 MB, 32.79 MB, 36.75 MB, 38.97 MB
- - FirstBatchWaitTime: 1s040ms
- - TotalBytesDequeued: 38.97 MB (40860790)
- - TotalGetBatchTime: 7s064ms
- - DataWaitTime: 7s056ms
- Enqueue:
- BytesReceived(500.000ms): 0, 0, 0, 434.54 KB, 1.22 MB, 2.01 MB, 2.88 MB, 4.93 MB, 7.73 MB, 11.04 MB, 14.44 MB, 17.88 MB, 21.24 MB, 23.77 MB, 26.62 MB, 28.23 MB
- DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 49.691us ; Min: 25.790us ; Max: 179.419us ; Number of samples: 2052)
- - DeserializeRowBatchTime: 132.006ms
- - TotalBatchesEnqueued: 2.05K (2052)
- - TotalBatchesReceived: 2.05K (2052)
- - TotalBytesReceived: 28.23 MB (29599485)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 0.000ns
- - TotalRPCsDeferred: 0 (0)
- EXCHANGE_NODE (id=6):(Total: 1s100ms, non-child: 164.008ms, % non-child: 14.91%)
- - ConvertRowBatchTime: 92.004ms
- - PeakMemoryUsage: 12.79 MB (13408565)
- - RowsReturned: 7.37M (7369719)
- - RowsReturnedRate: 6.70 M/sec
- Buffer pool:
- - AllocTime: 460.024ms
- - CumulativeAllocationBytes: 348.29 MB (365207552)
- - CumulativeAllocations: 29.72K (29722)
- - PeakReservation: 12.73 MB (13352960)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.73 MB (13352960)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(16s000ms): 5.25 MB, 16.69 MB, 24.66 MB, 32.59 MB, 40.59 MB, 48.61 MB, 56.89 MB, 64.95 MB, 73.10 MB, 81.40 MB, 89.65 MB, 97.76 MB, 106.09 MB, 114.42 MB, 122.71 MB, 131.03 MB, 139.47 MB, 147.88 MB, 156.24 MB, 164.38 MB, 172.78 MB, 181.43 MB, 189.92 MB, 198.41 MB, 207.01 MB, 215.66 MB, 224.08 MB, 232.54 MB, 241.15 MB, 249.75 MB, 258.25 MB, 266.59 MB, 275.05 MB, 283.58 MB
- - FirstBatchWaitTime: 936.049ms
- - TotalBytesDequeued: 288.16 MB (302158479)
- - TotalGetBatchTime: 984.051ms
- - DataWaitTime: 936.049ms
- Enqueue:
- BytesReceived(16s000ms): 7.74 MB, 14.40 MB, 18.70 MB, 22.97 MB, 27.28 MB, 31.60 MB, 36.05 MB, 40.39 MB, 44.78 MB, 49.25 MB, 53.70 MB, 58.06 MB, 62.55 MB, 67.04 MB, 71.49 MB, 75.98 MB, 80.53 MB, 85.05 MB, 89.56 MB, 93.94 MB, 98.47 MB, 103.13 MB, 107.69 MB, 112.27 MB, 116.90 MB, 121.55 MB, 126.09 MB, 130.64 MB, 135.28 MB, 139.91 MB, 144.48 MB, 148.97 MB, 153.46 MB, 155.16 MB
- DeferredQueueSize(16s000ms): 5, 5, 6, 6, 6, 6, 6, 6, 6, 5, 6, 6, 6, 6, 5, 6, 6, 6, 6, 6, 6, 6, 5, 6, 6, 5, 6, 6, 6, 5, 5, 4, 2, 0
- - DispatchTime: (Avg: 43.567us ; Min: 12.349us ; Max: 753.314us ; Number of samples: 14861)
- - DeserializeRowBatchTime: 768.040ms
- - TotalBatchesEnqueued: 14.86K (14861)
- - TotalBatchesReceived: 14.86K (14861)
- - TotalBytesReceived: 155.16 MB (162694927)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 8m42s
- - TotalRPCsDeferred: 2.51K (2507)
- CodeGen:(Total: 252.013ms, non-child: 252.013ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 80.004ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 78 (78)
- - NumInstructions: 2.75K (2748)
- - OptimizationTime: 160.008ms
- - PeakMemoryUsage: 1.34 MB (1406976)
- - PrepareTime: 12.000ms
- Instance 984ea1ea895ca2cf:a12d79aa00000017 (host=slave-cn05:22000):(Total: 9m3s, non-child: 28.001ms, % non-child: 0.01%)
- Fragment Instance Lifecycle Event Timeline: 9m3s
- - Prepare Finished: 0.000ns (0.000ns)
- - Open Finished: 7s576ms (7s576ms)
- - First Batch Produced: 7s576ms (0.000ns)
- - First Batch Sent: 7s576ms (0.000ns)
- - ExecInternal Finished: 9m3s (8m56s)
- MemoryUsage(16s000ms): 47.65 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB, 66.26 MB
- ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- - AverageThreadTokens: 1.01
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 66.46 MB (69690188)
- - PeakReservation: 54.00 MB (56623104)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 2.03 GB (2177414655)
- - RowsProduced: 455.68K (455681)
- - TotalNetworkReceiveTime: 7s980ms
- - TotalNetworkSendTime: 8m54s
- - TotalStorageWaitTime: 0.000ns
- - TotalThreadsInvoluntaryContextSwitches: 7 (7)
- - TotalThreadsTotalWallClockTime: 9m11s
- - TotalThreadsSysTime: 371.292ms
- - TotalThreadsUserTime: 1s958ms
- - TotalThreadsVoluntaryContextSwitches: 13.16K (13163)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 8m56s
- - ExecTreeExecTime: 1s100ms
- - OpenTime: 7s576ms
- - ExecTreeOpenTime: 7s288ms
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=8):(Total: 8m55s, non-child: 276.015ms, % non-child: 0.05%)
- BytesSent(16s000ms): 769.23 KB, 2.26 MB, 3.39 MB, 4.48 MB, 5.57 MB, 6.65 MB, 7.78 MB, 8.87 MB, 9.98 MB, 11.09 MB, 12.20 MB, 13.29 MB, 14.40 MB, 15.52 MB, 16.63 MB, 17.74 MB, 18.85 MB, 19.97 MB, 21.10 MB, 22.19 MB, 23.31 MB, 24.46 MB, 25.59 MB, 26.73 MB, 27.87 MB, 29.02 MB, 30.13 MB, 31.26 MB, 32.41 MB, 33.54 MB, 34.68 MB, 35.79 MB, 36.92 MB, 38.04 MB
- - EosSent: 1 (1)
- - NetworkThroughput: 45.08 MB/sec
- - PeakMemoryUsage: 3.61 KB (3696)
- - RowsSent: 455.68K (455681)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 252.013ms
- - TotalBytesSent: 38.64 MB (40513410)
- - UncompressedRowBatchSize: 56.49 MB (59238530)
- HASH_JOIN_NODE (id=4):(Total: 8s388ms, non-child: 1s208ms, % non-child: 14.40%)
- ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- - BuildRows: 459.53K (459528)
- - BuildTime: 232.012ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 52.07 MB (54595840)
- - ProbeRows: 7.37M (7365206)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 960.052ms
- - RowsReturned: 455.68K (455681)
- - RowsReturnedRate: 54.32 K/sec
- Buffer pool:
- - AllocTime: 32.001ms
- - CumulativeAllocationBytes: 52.00 MB (54525952)
- - CumulativeAllocations: 88 (88)
- - PeakReservation: 52.00 MB (54525952)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 52.00 MB (54525952)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=4):
- ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- Runtime filters: 2 of 2 Runtime Filters Published
- - BuildRowsPartitionTime: 192.010ms
- - BuildRowsPartitioned: 459.53K (459528)
- - HashBuckets: 1.05M (1048576)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 36.001ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 30.12 KB (30848)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=7):(Total: 7s056ms, non-child: 8.000ms, % non-child: 0.11%)
- - ConvertRowBatchTime: 4.000ms
- - PeakMemoryUsage: 208.00 KB (212992)
- - RowsReturned: 459.53K (459528)
- - RowsReturnedRate: 65.12 K/sec
- Buffer pool:
- - AllocTime: 72.003ms
- - CumulativeAllocationBytes: 48.12 MB (50462720)
- - CumulativeAllocations: 4.11K (4110)
- - PeakReservation: 208.00 KB (212992)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 208.00 KB (212992)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(500.000ms): 0, 0, 0, 739.81 KB, 1.73 MB, 2.89 MB, 4.20 MB, 7.09 MB, 11.10 MB, 15.69 MB, 20.36 MB, 25.13 MB, 29.68 MB, 33.22 MB, 37.12 MB
- - FirstBatchWaitTime: 1s012ms
- - TotalBytesDequeued: 39.00 MB (40897992)
- - TotalGetBatchTime: 7s052ms
- - DataWaitTime: 7s048ms
- Enqueue:
- BytesReceived(500.000ms): 0, 0, 0, 546.64 KB, 1.25 MB, 2.08 MB, 3.03 MB, 5.12 MB, 8.02 MB, 11.34 MB, 14.74 MB, 18.20 MB, 21.50 MB, 24.09 MB, 26.89 MB
- DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 49.372us ; Min: 20.699us ; Max: 190.919us ; Number of samples: 2055)
- - DeserializeRowBatchTime: 112.006ms
- - TotalBatchesEnqueued: 2.06K (2055)
- - TotalBatchesReceived: 2.06K (2055)
- - TotalBytesReceived: 28.26 MB (29629084)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 0.000ns
- - TotalRPCsDeferred: 0 (0)
- EXCHANGE_NODE (id=6):(Total: 1s032ms, non-child: 124.006ms, % non-child: 12.02%)
- - ConvertRowBatchTime: 96.005ms
- - PeakMemoryUsage: 12.21 MB (12801469)
- - RowsReturned: 7.37M (7365206)
- - RowsReturnedRate: 7.14 M/sec
- Buffer pool:
- - AllocTime: 192.010ms
- - CumulativeAllocationBytes: 348.08 MB (364986368)
- - CumulativeAllocations: 29.71K (29706)
- - PeakReservation: 12.19 MB (12779520)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.19 MB (12779520)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(16s000ms): 6.34 MB, 18.01 MB, 26.00 MB, 33.97 MB, 42.04 MB, 50.03 MB, 58.23 MB, 66.32 MB, 74.57 MB, 82.91 MB, 91.11 MB, 99.27 MB, 107.56 MB, 115.91 MB, 124.15 MB, 132.54 MB, 140.86 MB, 149.34 MB, 157.70 MB, 165.86 MB, 174.33 MB, 182.89 MB, 191.37 MB, 199.71 MB, 208.27 MB, 216.93 MB, 225.37 MB, 233.81 MB, 242.36 MB, 250.82 MB, 259.34 MB, 267.76 MB, 276.31 MB, 284.72 MB
- - FirstBatchWaitTime: 908.049ms
- - TotalBytesDequeued: 287.98 MB (301973446)
- - TotalGetBatchTime: 928.051ms
- - DataWaitTime: 908.049ms
- Enqueue:
- BytesReceived(16s000ms): 7.80 MB, 14.45 MB, 18.75 MB, 23.03 MB, 27.33 MB, 31.66 MB, 36.08 MB, 40.42 MB, 44.82 MB, 49.28 MB, 53.71 MB, 58.08 MB, 62.56 MB, 67.06 MB, 71.54 MB, 75.96 MB, 80.53 MB, 85.03 MB, 89.54 MB, 93.89 MB, 98.46 MB, 103.09 MB, 107.66 MB, 112.26 MB, 116.87 MB, 121.53 MB, 126.07 MB, 130.61 MB, 135.23 MB, 139.86 MB, 144.46 MB, 148.94 MB, 153.37 MB, 155.06 MB
- DeferredQueueSize(16s000ms): 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 45.028us ; Min: 11.977us ; Max: 1.048ms ; Number of samples: 14853)
- - DeserializeRowBatchTime: 592.032ms
- - TotalBatchesEnqueued: 14.85K (14853)
- - TotalBatchesReceived: 14.85K (14853)
- - TotalBytesReceived: 155.06 MB (162589483)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 6s257ms
- - TotalRPCsDeferred: 6 (6)
- CodeGen:(Total: 280.015ms, non-child: 280.015ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 76.004ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 78 (78)
- - NumInstructions: 2.75K (2748)
- - OptimizationTime: 180.009ms
- - PeakMemoryUsage: 1.34 MB (1406976)
- - PrepareTime: 24.001ms
- Instance 984ea1ea895ca2cf:a12d79aa00000015 (host=slave-cn03:22000):(Total: 9m3s, non-child: 12.000ms, % non-child: 0.00%)
- Fragment Instance Lifecycle Event Timeline: 9m3s
- - Prepare Finished: 0.000ns (0.000ns)
- - Open Finished: 7s572ms (7s572ms)
- - First Batch Produced: 7s576ms (4.000ms)
- - First Batch Sent: 7s576ms (0.000ns)
- - ExecInternal Finished: 9m3s (8m55s)
- MemoryUsage(16s000ms): 47.23 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB, 67.26 MB
- ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- - AverageThreadTokens: 1.01
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 67.42 MB (70689909)
- - PeakReservation: 55.00 MB (57671680)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 1.57 GB (1688006861)
- - RowsProduced: 456.30K (456302)
- - TotalNetworkReceiveTime: 8s056ms
- - TotalNetworkSendTime: 8m54s
- - TotalStorageWaitTime: 0.000ns
- - TotalThreadsInvoluntaryContextSwitches: 2 (2)
- - TotalThreadsTotalWallClockTime: 9m10s
- - TotalThreadsSysTime: 243.519ms
- - TotalThreadsUserTime: 1s912ms
- - TotalThreadsVoluntaryContextSwitches: 13.01K (13014)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 8m55s
- - ExecTreeExecTime: 924.042ms
- - OpenTime: 7s572ms
- - ExecTreeOpenTime: 7s312ms
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=8):(Total: 8m54s, non-child: 316.014ms, % non-child: 0.06%)
- BytesSent(16s000ms): 785.81 KB, 2.37 MB, 3.50 MB, 4.59 MB, 5.68 MB, 6.77 MB, 7.89 MB, 8.98 MB, 10.09 MB, 11.21 MB, 12.32 MB, 13.41 MB, 14.51 MB, 15.62 MB, 16.74 MB, 17.85 MB, 18.97 MB, 20.09 MB, 21.21 MB, 22.30 MB, 23.42 MB, 24.56 MB, 25.70 MB, 26.83 MB, 27.98 MB, 29.12 MB, 30.24 MB, 31.37 MB, 32.52 MB, 33.66 MB, 34.78 MB, 35.90 MB, 37.02 MB
- - EosSent: 1 (1)
- - NetworkThroughput: 47.04 MB/sec
- - PeakMemoryUsage: 3.61 KB (3696)
- - RowsSent: 456.30K (456302)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 296.013ms
- - TotalBytesSent: 38.69 MB (40571812)
- - UncompressedRowBatchSize: 56.57 MB (59319260)
- HASH_JOIN_NODE (id=4):(Total: 8s236ms, non-child: 1s012ms, % non-child: 12.29%)
- ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- - BuildRows: 460.13K (460132)
- - BuildTime: 212.009ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 53.07 MB (55644416)
- - ProbeRows: 7.37M (7367140)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 800.036ms
- - RowsReturned: 456.30K (456302)
- - RowsReturnedRate: 55.40 K/sec
- Buffer pool:
- - AllocTime: 24.001ms
- - CumulativeAllocationBytes: 53.00 MB (55574528)
- - CumulativeAllocations: 90 (90)
- - PeakReservation: 53.00 MB (55574528)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 53.00 MB (55574528)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=4):
- ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- Runtime filters: 2 of 2 Runtime Filters Published
- - BuildRowsPartitionTime: 172.007ms
- - BuildRowsPartitioned: 460.13K (460132)
- - HashBuckets: 1.05M (1048576)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 36.001ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 30.12 KB (30848)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=7):(Total: 7s100ms, non-child: 8.000ms, % non-child: 0.11%)
- - ConvertRowBatchTime: 4.000ms
- - PeakMemoryUsage: 160.00 KB (163840)
- - RowsReturned: 460.13K (460132)
- - RowsReturnedRate: 64.80 K/sec
- Buffer pool:
- - AllocTime: 56.002ms
- - CumulativeAllocationBytes: 48.19 MB (50528256)
- - CumulativeAllocations: 4.11K (4114)
- - PeakReservation: 160.00 KB (163840)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 160.00 KB (163840)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(500.000ms): 0, 0, 0, 428.31 KB, 1.56 MB, 2.62 MB, 3.80 MB, 6.52 MB, 10.23 MB, 14.79 MB, 19.47 MB, 24.18 MB, 28.90 MB, 32.46 MB, 36.45 MB, 39.05 MB
- - FirstBatchWaitTime: 1s040ms
- - TotalBytesDequeued: 39.05 MB (40951748)
- - TotalGetBatchTime: 7s096ms
- - DataWaitTime: 7s092ms
- Enqueue:
- BytesReceived(500.000ms): 0, 0, 0, 308.61 KB, 1.12 MB, 1.89 MB, 2.74 MB, 4.71 MB, 7.39 MB, 10.69 MB, 14.11 MB, 17.51 MB, 20.93 MB, 23.51 MB, 26.40 MB, 28.28 MB
- DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 48.567us ; Min: 24.726us ; Max: 981.167us ; Number of samples: 2057)
- - DeserializeRowBatchTime: 100.004ms
- - TotalBatchesEnqueued: 2.06K (2057)
- - TotalBatchesReceived: 2.06K (2057)
- - TotalBytesReceived: 28.29 MB (29665538)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 0.000ns
- - TotalRPCsDeferred: 0 (0)
- EXCHANGE_NODE (id=6):(Total: 1s060ms, non-child: 124.005ms, % non-child: 11.70%)
- - ConvertRowBatchTime: 96.004ms
- - PeakMemoryUsage: 12.20 MB (12790564)
- - RowsReturned: 7.37M (7367140)
- - RowsReturnedRate: 6.95 M/sec
- Buffer pool:
- - AllocTime: 152.006ms
- - CumulativeAllocationBytes: 348.16 MB (365076480)
- - CumulativeAllocations: 29.71K (29712)
- - PeakReservation: 12.19 MB (12779520)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.19 MB (12779520)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(16s000ms): 6.42 MB, 18.72 MB, 26.81 MB, 34.80 MB, 42.88 MB, 50.95 MB, 59.22 MB, 67.33 MB, 75.58 MB, 83.74 MB, 91.93 MB, 100.12 MB, 108.34 MB, 116.66 MB, 125.01 MB, 133.27 MB, 141.69 MB, 150.05 MB, 158.41 MB, 166.63 MB, 174.96 MB, 183.47 MB, 191.99 MB, 200.48 MB, 209.05 MB, 217.61 MB, 226.05 MB, 234.56 MB, 243.18 MB, 251.67 MB, 260.11 MB, 268.50 MB, 276.92 MB
- - FirstBatchWaitTime: 936.042ms
- - TotalBytesDequeued: 288.06 MB (302052740)
- - TotalGetBatchTime: 960.043ms
- - DataWaitTime: 936.042ms
- Enqueue:
- BytesReceived(16s000ms): 7.77 MB, 14.43 MB, 18.72 MB, 22.98 MB, 27.30 MB, 31.58 MB, 36.07 MB, 40.42 MB, 44.80 MB, 49.27 MB, 53.70 MB, 58.07 MB, 62.54 MB, 67.05 MB, 71.49 MB, 75.97 MB, 80.48 MB, 85.05 MB, 89.56 MB, 93.91 MB, 98.45 MB, 103.10 MB, 107.67 MB, 112.27 MB, 116.88 MB, 121.54 MB, 126.11 MB, 130.65 MB, 135.28 MB, 139.88 MB, 144.47 MB, 148.92 MB, 153.41 MB
- DeferredQueueSize(16s000ms): 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 45.330us ; Min: 11.505us ; Max: 852.644us ; Number of samples: 14856)
- - DeserializeRowBatchTime: 428.019ms
- - TotalBatchesEnqueued: 14.86K (14856)
- - TotalBatchesReceived: 14.86K (14856)
- - TotalBytesReceived: 155.11 MB (162640691)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 6s255ms
- - TotalRPCsDeferred: 6 (6)
- CodeGen:(Total: 256.011ms, non-child: 256.011ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 76.003ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 78 (78)
- - NumInstructions: 2.75K (2748)
- - OptimizationTime: 160.007ms
- - PeakMemoryUsage: 1.34 MB (1406976)
- - PrepareTime: 20.000ms
- Instance 984ea1ea895ca2cf:a12d79aa00000016 (host=slave-cn06:22000):(Total: 9m2s, non-child: 16.000ms, % non-child: 0.00%)
- Fragment Instance Lifecycle Event Timeline: 9m2s
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 7s576ms (7s572ms)
- - First Batch Produced: 7s576ms (0.000ns)
- - First Batch Sent: 7s580ms (4.000ms)
- - ExecInternal Finished: 9m2s (8m55s)
- MemoryUsage(16s000ms): 47.37 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB
- ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- - AverageThreadTokens: 1.01
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 65.92 MB (69122315)
- - PeakReservation: 53.50 MB (56098816)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 938.16 MB (983735960)
- - RowsProduced: 454.79K (454788)
- - TotalNetworkReceiveTime: 8s056ms
- - TotalNetworkSendTime: 8m53s
- - TotalStorageWaitTime: 0.000ns
- - TotalThreadsInvoluntaryContextSwitches: 3 (3)
- - TotalThreadsTotalWallClockTime: 9m10s
- - TotalThreadsSysTime: 443.492ms
- - TotalThreadsUserTime: 2s006ms
- - TotalThreadsVoluntaryContextSwitches: 13.12K (13120)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 8m55s
- - ExecTreeExecTime: 1s212ms
- - OpenTime: 7s572ms
- - ExecTreeOpenTime: 7s300ms
- - PrepareTime: 4.000ms
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=8):(Total: 8m53s, non-child: 284.009ms, % non-child: 0.05%)
- BytesSent(16s000ms): 804.66 KB, 2.34 MB, 3.46 MB, 4.56 MB, 5.64 MB, 6.74 MB, 7.85 MB, 8.95 MB, 10.06 MB, 11.17 MB, 12.28 MB, 13.37 MB, 14.48 MB, 15.60 MB, 16.71 MB, 17.81 MB, 18.94 MB, 20.05 MB, 21.18 MB, 22.27 MB, 23.39 MB, 24.53 MB, 25.67 MB, 26.81 MB, 27.95 MB, 29.09 MB, 30.21 MB, 31.34 MB, 32.49 MB, 33.63 MB, 34.76 MB, 35.87 MB, 36.99 MB
- - EosSent: 1 (1)
- - NetworkThroughput: 44.92 MB/sec
- - PeakMemoryUsage: 3.61 KB (3696)
- - RowsSent: 454.79K (454788)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 268.008ms
- - TotalBytesSent: 38.56 MB (40435024)
- - UncompressedRowBatchSize: 56.38 MB (59122440)
- HASH_JOIN_NODE (id=4):(Total: 8s512ms, non-child: 1s224ms, % non-child: 14.38%)
- ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- - BuildRows: 458.72K (458721)
- - BuildTime: 196.006ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 51.57 MB (54071552)
- - ProbeRows: 7.37M (7367418)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 1s004ms
- - RowsReturned: 454.79K (454788)
- - RowsReturnedRate: 53.43 K/sec
- Buffer pool:
- - AllocTime: 8.000ms
- - CumulativeAllocationBytes: 51.50 MB (54001664)
- - CumulativeAllocations: 87 (87)
- - PeakReservation: 51.50 MB (54001664)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 51.50 MB (54001664)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=4):
- ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- Runtime filters: 2 of 2 Runtime Filters Published
- - BuildRowsPartitionTime: 156.005ms
- - BuildRowsPartitioned: 458.72K (458721)
- - HashBuckets: 1.05M (1048576)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 36.001ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 30.12 KB (30848)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=7):(Total: 7s100ms, non-child: 12.000ms, % non-child: 0.17%)
- - ConvertRowBatchTime: 12.000ms
- - PeakMemoryUsage: 176.00 KB (180224)
- - RowsReturned: 458.72K (458721)
- - RowsReturnedRate: 64.61 K/sec
- Buffer pool:
- - AllocTime: 12.000ms
- - CumulativeAllocationBytes: 48.04 MB (50372608)
- - CumulativeAllocations: 4.10K (4102)
- - PeakReservation: 176.00 KB (180224)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 176.00 KB (180224)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(500.000ms): 0, 0, 0, 1.05 MB, 1.79 MB, 3.14 MB, 4.72 MB, 7.78 MB, 12.00 MB, 16.64 MB, 21.31 MB, 26.07 MB, 30.32 MB, 34.05 MB, 37.65 MB
- - FirstBatchWaitTime: 1s028ms
- - TotalBytesDequeued: 38.93 MB (40826169)
- - TotalGetBatchTime: 7s088ms
- - DataWaitTime: 7s088ms
- Enqueue:
- BytesReceived(500.000ms): 0, 0, 0, 771.28 KB, 1.29 MB, 2.26 MB, 3.40 MB, 5.62 MB, 8.67 MB, 12.03 MB, 15.42 MB, 18.87 MB, 21.96 MB, 24.67 MB, 27.28 MB
- DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 51.528us ; Min: 23.228us ; Max: 183.720us ; Number of samples: 2051)
- - DeserializeRowBatchTime: 56.001ms
- - TotalBatchesEnqueued: 2.05K (2051)
- - TotalBatchesReceived: 2.05K (2051)
- - TotalBytesReceived: 28.20 MB (29574471)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 0.000ns
- - TotalRPCsDeferred: 0 (0)
- EXCHANGE_NODE (id=6):(Total: 1s112ms, non-child: 188.006ms, % non-child: 16.91%)
- - ConvertRowBatchTime: 132.004ms
- - PeakMemoryUsage: 12.18 MB (12774204)
- - RowsReturned: 7.37M (7367418)
- - RowsReturnedRate: 6.63 M/sec
- Buffer pool:
- - AllocTime: 104.003ms
- - CumulativeAllocationBytes: 348.18 MB (365092864)
- - CumulativeAllocations: 29.71K (29712)
- - PeakReservation: 12.17 MB (12763136)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.17 MB (12763136)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(16s000ms): 6.75 MB, 18.91 MB, 26.89 MB, 34.86 MB, 42.86 MB, 50.92 MB, 59.25 MB, 67.43 MB, 75.81 MB, 84.03 MB, 92.23 MB, 100.39 MB, 108.73 MB, 117.11 MB, 125.47 MB, 133.76 MB, 142.26 MB, 150.51 MB, 159.00 MB, 167.18 MB, 175.54 MB, 184.06 MB, 192.54 MB, 201.13 MB, 209.79 MB, 218.35 MB, 226.77 MB, 235.40 MB, 244.12 MB, 252.59 MB, 261.15 MB, 269.43 MB, 277.72 MB
- - FirstBatchWaitTime: 924.030ms
- - TotalBytesDequeued: 288.07 MB (302064138)
- - TotalGetBatchTime: 968.031ms
- - DataWaitTime: 924.030ms
- Enqueue:
- BytesReceived(16s000ms): 7.93 MB, 14.47 MB, 18.73 MB, 22.99 MB, 27.28 MB, 31.59 MB, 36.06 MB, 40.41 MB, 44.82 MB, 49.27 MB, 53.67 MB, 58.06 MB, 62.57 MB, 67.08 MB, 71.52 MB, 76.00 MB, 80.52 MB, 85.08 MB, 89.55 MB, 93.95 MB, 98.46 MB, 103.10 MB, 107.68 MB, 112.30 MB, 116.93 MB, 121.57 MB, 126.14 MB, 130.71 MB, 135.33 MB, 139.94 MB, 144.54 MB, 149.00 MB, 153.47 MB
- DeferredQueueSize(16s000ms): 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 45.963us ; Min: 11.945us ; Max: 951.535us ; Number of samples: 14856)
- - DeserializeRowBatchTime: 516.016ms
- - TotalBatchesEnqueued: 14.86K (14856)
- - TotalBatchesReceived: 14.86K (14856)
- - TotalBytesReceived: 155.11 MB (162647601)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 6s255ms
- - TotalRPCsDeferred: 5 (5)
- CodeGen:(Total: 264.008ms, non-child: 264.008ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 80.002ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 78 (78)
- - NumInstructions: 2.75K (2748)
- - OptimizationTime: 168.005ms
- - PeakMemoryUsage: 1.34 MB (1406976)
- - PrepareTime: 16.000ms
- Instance 984ea1ea895ca2cf:a12d79aa00000018 (host=slave-cn07:22000):(Total: 9m2s, non-child: 16.000ms, % non-child: 0.00%)
- Fragment Instance Lifecycle Event Timeline: 9m2s
- - Prepare Finished: 0.000ns (0.000ns)
- - Open Finished: 7s576ms (7s576ms)
- - First Batch Produced: 7s576ms (0.000ns)
- - First Batch Sent: 7s580ms (4.000ms)
- - ExecInternal Finished: 9m2s (8m55s)
- MemoryUsage(16s000ms): 46.60 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB, 66.27 MB
- ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- - AverageThreadTokens: 1.01
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 66.43 MB (69657570)
- - PeakReservation: 54.00 MB (56623104)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 2.05 GB (2206373452)
- - RowsProduced: 455.88K (455878)
- - TotalNetworkReceiveTime: 7s972ms
- - TotalNetworkSendTime: 8m53s
- - TotalStorageWaitTime: 0.000ns
- - TotalThreadsInvoluntaryContextSwitches: 5 (5)
- - TotalThreadsTotalWallClockTime: 9m10s
- - TotalThreadsSysTime: 355.681ms
- - TotalThreadsUserTime: 1s889ms
- - TotalThreadsVoluntaryContextSwitches: 13.01K (13013)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 8m55s
- - ExecTreeExecTime: 1s088ms
- - OpenTime: 7s576ms
- - ExecTreeOpenTime: 7s300ms
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=8):(Total: 8m54s, non-child: 192.009ms, % non-child: 0.04%)
- BytesSent(16s000ms): 802.85 KB, 2.40 MB, 3.53 MB, 4.61 MB, 5.70 MB, 6.79 MB, 7.91 MB, 9.01 MB, 10.12 MB, 11.23 MB, 12.34 MB, 13.43 MB, 14.54 MB, 15.66 MB, 16.77 MB, 17.88 MB, 18.99 MB, 20.11 MB, 21.23 MB, 22.33 MB, 23.45 MB, 24.59 MB, 25.73 MB, 26.86 MB, 28.00 MB, 29.15 MB, 30.27 MB, 31.39 MB, 32.54 MB, 33.68 MB, 34.81 MB, 35.93 MB, 37.05 MB
- - EosSent: 1 (1)
- - NetworkThroughput: 43.59 MB/sec
- - PeakMemoryUsage: 3.61 KB (3696)
- - RowsSent: 455.88K (455878)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 180.008ms
- - TotalBytesSent: 38.65 MB (40530581)
- - UncompressedRowBatchSize: 56.52 MB (59264140)
- HASH_JOIN_NODE (id=4):(Total: 8s384ms, non-child: 1s232ms, % non-child: 14.69%)
- ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- - BuildRows: 459.67K (459665)
- - BuildTime: 244.011ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 52.07 MB (54595840)
- - ProbeRows: 7.37M (7370248)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 976.046ms
- - RowsReturned: 455.88K (455878)
- - RowsReturnedRate: 54.37 K/sec
- Buffer pool:
- - AllocTime: 28.001ms
- - CumulativeAllocationBytes: 52.00 MB (54525952)
- - CumulativeAllocations: 88 (88)
- - PeakReservation: 52.00 MB (54525952)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 52.00 MB (54525952)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=4):
- ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- Runtime filters: 2 of 2 Runtime Filters Published
- - BuildRowsPartitionTime: 204.009ms
- - BuildRowsPartitioned: 459.67K (459665)
- - HashBuckets: 1.05M (1048576)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 36.001ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 30.12 KB (30848)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=7):(Total: 7s052ms, non-child: 28.001ms, % non-child: 0.40%)
- - ConvertRowBatchTime: 16.000ms
- - PeakMemoryUsage: 176.00 KB (180224)
- - RowsReturned: 459.67K (459665)
- - RowsReturnedRate: 65.18 K/sec
- Buffer pool:
- - AllocTime: 48.002ms
- - CumulativeAllocationBytes: 48.14 MB (50479104)
- - CumulativeAllocations: 4.11K (4110)
- - PeakReservation: 176.00 KB (180224)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 176.00 KB (180224)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(500.000ms): 0, 0, 0, 389.38 KB, 1.52 MB, 2.57 MB, 3.75 MB, 6.33 MB, 10.11 MB, 14.58 MB, 19.34 MB, 24.01 MB, 28.78 MB, 32.33 MB, 36.25 MB, 38.96 MB
- - FirstBatchWaitTime: 1s024ms
- - TotalBytesDequeued: 39.01 MB (40910185)
- - TotalGetBatchTime: 7s036ms
- - DataWaitTime: 7s024ms
- Enqueue:
- BytesReceived(500.000ms): 0, 0, 0, 280.34 KB, 1.09 MB, 1.85 MB, 2.70 MB, 4.57 MB, 7.30 MB, 10.54 MB, 13.99 MB, 17.38 MB, 20.85 MB, 23.42 MB, 26.26 MB, 28.22 MB
- DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 51.635us ; Min: 14.486us ; Max: 209.925us ; Number of samples: 2055)
- - DeserializeRowBatchTime: 64.003ms
- - TotalBatchesEnqueued: 2.06K (2055)
- - TotalBatchesReceived: 2.06K (2055)
- - TotalBytesReceived: 28.26 MB (29635433)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 0.000ns
- - TotalRPCsDeferred: 0 (0)
- EXCHANGE_NODE (id=6):(Total: 1s020ms, non-child: 100.004ms, % non-child: 9.80%)
- - ConvertRowBatchTime: 72.003ms
- - PeakMemoryUsage: 12.21 MB (12801575)
- - RowsReturned: 7.37M (7370248)
- - RowsReturnedRate: 7.23 M/sec
- Buffer pool:
- - AllocTime: 248.011ms
- - CumulativeAllocationBytes: 348.32 MB (365240320)
- - CumulativeAllocations: 29.73K (29726)
- - PeakReservation: 12.20 MB (12787712)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.20 MB (12787712)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(16s000ms): 6.60 MB, 19.15 MB, 27.16 MB, 35.04 MB, 42.94 MB, 50.87 MB, 59.15 MB, 67.31 MB, 75.57 MB, 83.78 MB, 92.14 MB, 100.32 MB, 108.53 MB, 116.88 MB, 125.02 MB, 133.36 MB, 141.72 MB, 150.18 MB, 158.74 MB, 167.14 MB, 175.61 MB, 184.19 MB, 192.65 MB, 201.16 MB, 209.68 MB, 218.21 MB, 226.60 MB, 234.98 MB, 243.61 MB, 252.15 MB, 260.64 MB, 269.01 MB, 277.45 MB
- - FirstBatchWaitTime: 920.043ms
- - TotalBytesDequeued: 288.18 MB (302180168)
- - TotalGetBatchTime: 936.044ms
- - DataWaitTime: 920.043ms
- Enqueue:
- BytesReceived(16s000ms): 7.77 MB, 14.44 MB, 18.74 MB, 22.99 MB, 27.31 MB, 31.60 MB, 36.08 MB, 40.42 MB, 44.80 MB, 49.27 MB, 53.70 MB, 58.10 MB, 62.57 MB, 67.06 MB, 71.51 MB, 76.00 MB, 80.49 MB, 85.07 MB, 89.55 MB, 93.94 MB, 98.46 MB, 103.11 MB, 107.67 MB, 112.28 MB, 116.88 MB, 121.57 MB, 126.13 MB, 130.65 MB, 135.30 MB, 139.92 MB, 144.52 MB, 148.98 MB, 153.46 MB
- DeferredQueueSize(16s000ms): 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 44.406us ; Min: 11.160us ; Max: 779.821us ; Number of samples: 14863)
- - DeserializeRowBatchTime: 476.022ms
- - TotalBatchesEnqueued: 14.86K (14863)
- - TotalBatchesReceived: 14.86K (14863)
- - TotalBytesReceived: 155.16 MB (162697052)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 6s256ms
- - TotalRPCsDeferred: 6 (6)
- CodeGen:(Total: 268.012ms, non-child: 268.012ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 72.003ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 78 (78)
- - NumInstructions: 2.75K (2748)
- - OptimizationTime: 176.008ms
- - PeakMemoryUsage: 1.34 MB (1406976)
- - PrepareTime: 16.000ms
- Averaged Fragment F00:(Total: 8m32s, non-child: 40.668ms, % non-child: 0.01%)
- split sizes: min: 556.85 MB, max: 612.99 MB, avg: 581.16 MB, stddev: 19.58 MB
- completion times: min:7m58s max:8m46s mean: 8m32s stddev:16s012ms
- execution rates: min:1.09 MB/sec max:1.17 MB/sec mean:1.13 MB/sec stddev:27.38 KB/sec
- num instances: 6
- - AverageThreadTokens: 10.95
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 247.98 MB (260028936)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 1.71 GB (1836833523)
- - RowsProduced: 7.37M (7368006)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 8m29s
- - TotalStorageWaitTime: 9s619ms
- - TotalThreadsInvoluntaryContextSwitches: 12 (12)
- - TotalThreadsTotalWallClockTime: 1h33m
- - TotalThreadsSysTime: 986.538ms
- - TotalThreadsUserTime: 3s929ms
- - TotalThreadsVoluntaryContextSwitches: 19.85K (19848)
- Buffer pool:
- - AllocTime: 666.698us
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 8m32s
- - ExecTreeExecTime: 1s212ms
- - OpenTime: 112.005ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 666.697us
- - ExecTreePrepareTime: 666.697us
- KrpcDataStreamSender (dst_id=6):(Total: 8m31s, non-child: 8m31s, % non-child: 100.00%)
- - EosSent: 6 (6)
- - NetworkThroughput: 18.54 MB/sec
- - PeakMemoryUsage: 191.25 KB (195840)
- - RowsSent: 7.37M (7368006)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 834.038ms
- - TotalBytesSent: 155.12 MB (162656546)
- - UncompressedRowBatchSize: 288.09 MB (302088273)
- HDFS_SCAN_NODE (id=1):(Total: 1s209ms, non-child: 1s209ms, % non-child: 100.00%)
- - AverageHdfsReadThreadConcurrency: 0.00
- - AverageScannerThreadConcurrency: 9.96
- - BytesRead: 214.18 MB (224586931)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 214.18 MB (224586931)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 214.18 MB (224586931)
- - CachedFileHandlesHitCount: 85 (85)
- - CachedFileHandlesMissCount: 10 (10)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 624.029ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 6 (6)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 1 (1)
- - NumRowGroups: 10 (10)
- - NumScannerThreadsStarted: 10 (10)
- - NumScannersWithNoReads: 0 (0)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 245.71 MB (257643049)
- - PerReadThreadRawHdfsThroughput: 398.89 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 214.009ms
- - RowBatchQueuePutWaitTime: 1h24m
- - RowsRead: 26.71M (26706853)
- - RowsReturned: 7.37M (7368006)
- - RowsReturnedRate: 6.09 M/sec
- - ScanRangesComplete: 10 (10)
- - ScannerThreadsInvoluntaryContextSwitches: 7 (7)
- - ScannerThreadsTotalWallClockTime: 1h25m
- - MaterializeTupleTime(*): 1s284ms
- - ScannerThreadsSysTime: 653.212ms
- - ScannerThreadsUserTime: 1s769ms
- - ScannerThreadsVoluntaryContextSwitches: 7.38K (7384)
- - TotalRawHdfsOpenFileTime(*): 211.342ms
- - TotalRawHdfsReadTime(*): 631.362ms
- - TotalReadThroughput: 428.26 KB/sec
- Filter 0 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 2.15M (2148457)
- - Rows rejected: 208.74K (208736)
- - Rows total: 26.71M (26706853)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 1 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 833.76K (833756)
- - Rows rejected: 75.31K (75313)
- - Rows total: 26.50M (26498116)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 109.338ms, non-child: 109.338ms, % non-child: 100.00%)
- - CodegenTime: 2.666ms
- - CompileTime: 20.000ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 64 (64)
- - NumInstructions: 1.09K (1091)
- - OptimizationTime: 71.336ms
- - PeakMemoryUsage: 545.50 KB (558592)
- - PrepareTime: 17.334ms
- Fragment F00:
- Instance 984ea1ea895ca2cf:a12d79aa00000005 (host=slave-cn05:22000):(Total: 8m46s, non-child: 32.001ms, % non-child: 0.01%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:12/590.25 MB
- Filter 1 arrival: 7s636ms
- Filter 0 arrival: 7s638ms
- Fragment Instance Lifecycle Event Timeline: 8m46s
- - Prepare Finished: 0.000ns (0.000ns)
- - Open Finished: 104.005ms (104.005ms)
- - First Batch Produced: 1s248ms (1s144ms)
- - First Batch Sent: 1s248ms (0.000ns)
- - ExecInternal Finished: 8m46s (8m44s)
- MemoryUsage(16s000ms): 213.16 MB, 249.66 MB, 249.14 MB, 245.64 MB, 245.65 MB, 245.65 MB, 245.63 MB, 245.65 MB, 245.67 MB, 245.68 MB, 245.65 MB, 245.61 MB, 245.66 MB, 243.38 MB, 222.96 MB, 191.00 MB, 169.94 MB, 161.45 MB, 161.36 MB, 161.30 MB, 160.95 MB, 153.91 MB, 153.41 MB, 153.40 MB, 153.42 MB, 153.45 MB, 153.48 MB, 153.45 MB, 151.23 MB, 142.76 MB, 114.07 MB, 89.45 MB
- ThreadUsage(16s000ms): 12, 13, 13, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 11, 11, 11, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10
- - AverageThreadTokens: 11.20
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 250.45 MB (262620415)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 2.03 GB (2177414655)
- - RowsProduced: 7.47M (7465322)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 8m42s
- - TotalStorageWaitTime: 11s552ms
- - TotalThreadsInvoluntaryContextSwitches: 13 (13)
- - TotalThreadsTotalWallClockTime: 1h38m
- - TotalThreadsSysTime: 1s184ms
- - TotalThreadsUserTime: 4s003ms
- - TotalThreadsVoluntaryContextSwitches: 20.02K (20017)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 8m45s
- - ExecTreeExecTime: 1s212ms
- - OpenTime: 104.005ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=6):(Total: 8m44s, non-child: 2s080ms, % non-child: 0.40%)
- BytesSent(16s000ms): 7.67 MB, 14.40 MB, 18.51 MB, 22.72 MB, 26.85 MB, 31.02 MB, 35.51 MB, 39.87 MB, 44.31 MB, 48.57 MB, 52.97 MB, 57.30 MB, 61.64 MB, 66.05 MB, 70.54 MB, 75.08 MB, 79.56 MB, 83.52 MB, 87.93 MB, 91.98 MB, 96.47 MB, 100.62 MB, 105.05 MB, 109.10 MB, 113.68 MB, 118.16 MB, 122.35 MB, 126.63 MB, 131.25 MB, 135.41 MB, 139.09 MB, 144.53 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 18.81 MB/sec
- - PeakMemoryUsage: 191.25 KB (195840)
- - RowsSent: 7.47M (7465322)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 968.053ms
- - TotalBytesSent: 157.18 MB (164817658)
- - UncompressedRowBatchSize: 291.90 MB (306078202)
- HDFS_SCAN_NODE (id=1):(Total: 1s212ms, non-child: 1s212ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:12/590.25 MB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12
- Runtime filters: Not all filters arrived (arrived: [], missing [0, 1]), waited for 924ms
- Hdfs Read Thread Concurrency Bucket: 0:99.9% 1:0.09506% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/SNAPPY:12
- BytesRead(16s000ms): 185.10 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB, 217.75 MB
- - FooterProcessingTime: (Avg: 161.342ms ; Min: 32.001ms ; Max: 356.019ms ; Number of samples: 12)
- - AverageHdfsReadThreadConcurrency: 0.00
- - AverageScannerThreadConcurrency: 10.20
- - BytesRead: 217.75 MB (228329065)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 217.75 MB (228329065)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 217.75 MB (228329065)
- - CachedFileHandlesHitCount: 93 (93)
- - CachedFileHandlesMissCount: 12 (12)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 604.033ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 6 (6)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 1 (1)
- - NumRowGroups: 12 (12)
- - NumScannerThreadsStarted: 12 (12)
- - NumScannersWithNoReads: 0 (0)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 248.17 MB (260223264)
- - PerReadThreadRawHdfsThroughput: 333.96 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 220.012ms
- - RowBatchQueuePutWaitTime: 1h29m
- - RowsRead: 27.11M (27113379)
- - RowsReturned: 7.47M (7465322)
- - RowsReturnedRate: 6.16 M/sec
- - ScanRangesComplete: 12 (12)
- - ScannerThreadsInvoluntaryContextSwitches: 7 (7)
- - ScannerThreadsTotalWallClockTime: 1h29m
- - MaterializeTupleTime(*): 1s436ms
- - ScannerThreadsSysTime: 700.085ms
- - ScannerThreadsUserTime: 1s763ms
- - ScannerThreadsVoluntaryContextSwitches: 7.44K (7436)
- - TotalRawHdfsOpenFileTime(*): 208.011ms
- - TotalRawHdfsReadTime(*): 652.035ms
- - TotalReadThroughput: 423.91 KB/sec
- Filter 0 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 2.83M (2827126)
- - Rows rejected: 275.38K (275384)
- - Rows total: 27.11M (27113379)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 1 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 766.02K (766020)
- - Rows rejected: 68.69K (68695)
- - Rows total: 26.84M (26837995)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 104.005ms, non-child: 104.005ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 20.001ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 64 (64)
- - NumInstructions: 1.09K (1091)
- - OptimizationTime: 64.003ms
- - PeakMemoryUsage: 545.50 KB (558592)
- - PrepareTime: 20.001ms
- Instance 984ea1ea895ca2cf:a12d79aa00000003 (host=slave-cn03:22000):(Total: 8m44s, non-child: 44.002ms, % non-child: 0.01%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/612.99 MB
- Filter 1 arrival: 7s606ms
- Filter 0 arrival: 7s608ms
- Fragment Instance Lifecycle Event Timeline: 8m44s
- - Prepare Finished: 0.000ns (0.000ns)
- - Open Finished: 108.004ms (108.004ms)
- - First Batch Produced: 1s240ms (1s132ms)
- - First Batch Sent: 1s240ms (0.000ns)
- - ExecInternal Finished: 8m44s (8m43s)
- MemoryUsage(16s000ms): 215.21 MB, 256.70 MB, 256.52 MB, 256.57 MB, 256.46 MB, 256.39 MB, 256.43 MB, 256.43 MB, 256.38 MB, 256.23 MB, 256.21 MB, 253.85 MB, 249.24 MB, 248.51 MB, 218.87 MB, 186.15 MB, 183.79 MB, 179.33 MB, 179.29 MB, 179.20 MB, 179.00 MB, 174.90 MB, 169.44 MB, 169.49 MB, 169.49 MB, 169.53 MB, 169.49 MB, 166.72 MB, 161.47 MB, 154.11 MB, 116.28 MB, 98.06 MB
- ThreadUsage(16s000ms): 11, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 10
- - AverageThreadTokens: 11.57
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 257.20 MB (269698512)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 1.57 GB (1688006861)
- - RowsProduced: 7.74M (7739854)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 8m41s
- - TotalStorageWaitTime: 11s664ms
- - TotalThreadsInvoluntaryContextSwitches: 14 (14)
- - TotalThreadsTotalWallClockTime: 1h41m
- - TotalThreadsSysTime: 902.758ms
- - TotalThreadsUserTime: 4s068ms
- - TotalThreadsVoluntaryContextSwitches: 20.53K (20531)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 8m44s
- - ExecTreeExecTime: 1s212ms
- - OpenTime: 108.004ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=6):(Total: 8m43s, non-child: 1s796ms, % non-child: 0.34%)
- BytesSent(16s000ms): 8.11 MB, 14.85 MB, 19.11 MB, 23.33 MB, 27.78 MB, 31.90 MB, 36.29 MB, 40.59 MB, 44.97 MB, 49.31 MB, 53.53 MB, 57.95 MB, 62.33 MB, 66.76 MB, 71.16 MB, 75.81 MB, 80.34 MB, 84.93 MB, 89.23 MB, 93.65 MB, 98.15 MB, 102.98 MB, 107.56 MB, 112.02 MB, 116.64 MB, 121.33 MB, 126.00 MB, 130.52 MB, 135.16 MB, 139.78 MB, 145.15 MB, 150.73 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 18.42 MB/sec
- - PeakMemoryUsage: 191.25 KB (195840)
- - RowsSent: 7.74M (7739854)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 900.040ms
- - TotalBytesSent: 162.95 MB (170862528)
- - UncompressedRowBatchSize: 302.63 MB (317334014)
- HDFS_SCAN_NODE (id=1):(Total: 1s212ms, non-child: 1s212ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/612.99 MB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11
- Runtime filters: Not all filters arrived (arrived: [], missing [0, 1]), waited for 924ms
- Hdfs Read Thread Concurrency Bucket: 0:99.9% 1:0.09533% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/SNAPPY:11
- BytesRead(16s000ms): 188.96 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB, 226.05 MB
- - FooterProcessingTime: (Avg: 204.009ms ; Min: 24.001ms ; Max: 488.022ms ; Number of samples: 11)
- - AverageHdfsReadThreadConcurrency: 0.00
- - AverageScannerThreadConcurrency: 10.58
- - BytesRead: 226.05 MB (237035044)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 226.05 MB (237035044)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 226.05 MB (237035044)
- - CachedFileHandlesHitCount: 88 (88)
- - CachedFileHandlesMissCount: 11 (11)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 612.027ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 6 (6)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 1 (1)
- - NumRowGroups: 11 (11)
- - NumScannerThreadsStarted: 11 (11)
- - NumScannersWithNoReads: 0 (0)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 254.93 MB (267310577)
- - PerReadThreadRawHdfsThroughput: 267.82 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 208.009ms
- - RowBatchQueuePutWaitTime: 1h32m
- - RowsRead: 28.16M (28158141)
- - RowsReturned: 7.74M (7739854)
- - RowsReturnedRate: 6.39 M/sec
- - ScanRangesComplete: 11 (11)
- - ScannerThreadsInvoluntaryContextSwitches: 9 (9)
- - ScannerThreadsTotalWallClockTime: 1h32m
- - MaterializeTupleTime(*): 1s300ms
- - ScannerThreadsSysTime: 634.173ms
- - ScannerThreadsUserTime: 1s844ms
- - ScannerThreadsVoluntaryContextSwitches: 7.64K (7639)
- - TotalRawHdfsOpenFileTime(*): 208.009ms
- - TotalRawHdfsReadTime(*): 844.038ms
- - TotalReadThroughput: 440.91 KB/sec
- Filter 0 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 3.36M (3363127)
- - Rows rejected: 329.58K (329581)
- - Rows total: 28.16M (28158141)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 1 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 1.32M (1324751)
- - Rows rejected: 121.76K (121756)
- - Rows total: 27.83M (27828560)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 104.004ms, non-child: 104.004ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 20.000ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 64 (64)
- - NumInstructions: 1.09K (1091)
- - OptimizationTime: 68.003ms
- - PeakMemoryUsage: 545.50 KB (558592)
- - PrepareTime: 16.000ms
- Instance 984ea1ea895ca2cf:a12d79aa00000004 (host=slave-cn06:22000):(Total: 8m41s, non-child: 40.001ms, % non-child: 0.01%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/584.82 MB
- Filter 1 arrival: 7s647ms
- Filter 0 arrival: 7s648ms
- Fragment Instance Lifecycle Event Timeline: 8m41s
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 116.003ms (112.003ms)
- - First Batch Produced: 1s256ms (1s140ms)
- - First Batch Sent: 1s256ms (0.000ns)
- - ExecInternal Finished: 8m41s (8m39s)
- MemoryUsage(16s000ms): 213.09 MB, 245.62 MB, 245.62 MB, 245.59 MB, 245.52 MB, 245.48 MB, 245.47 MB, 245.50 MB, 245.41 MB, 245.40 MB, 245.38 MB, 245.41 MB, 245.38 MB, 241.65 MB, 207.07 MB, 175.51 MB, 166.57 MB, 166.32 MB, 165.35 MB, 160.78 MB, 155.98 MB, 153.20 MB, 153.22 MB, 153.18 MB, 153.14 MB, 153.17 MB, 153.19 MB, 147.93 MB, 143.07 MB, 117.99 MB, 81.85 MB, 75.38 MB
- ThreadUsage(16s000ms): 11, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 11, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 9, 9
- - AverageThreadTokens: 11.10
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 252.25 MB (264506569)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 938.16 MB (983735960)
- - RowsProduced: 7.36M (7359961)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 8m37s
- - TotalStorageWaitTime: 10s864ms
- - TotalThreadsInvoluntaryContextSwitches: 6 (6)
- - TotalThreadsTotalWallClockTime: 1h36m
- - TotalThreadsSysTime: 960.845ms
- - TotalThreadsUserTime: 4s057ms
- - TotalThreadsVoluntaryContextSwitches: 20.02K (20015)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 8m40s
- - ExecTreeExecTime: 1s220ms
- - OpenTime: 112.003ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=6):(Total: 8m39s, non-child: 1s836ms, % non-child: 0.35%)
- BytesSent(16s000ms): 7.49 MB, 14.08 MB, 18.46 MB, 22.69 MB, 26.88 MB, 31.25 MB, 35.63 MB, 40.10 MB, 44.47 MB, 48.95 MB, 53.54 MB, 57.92 MB, 62.36 MB, 66.64 MB, 71.12 MB, 75.49 MB, 79.84 MB, 84.60 MB, 89.17 MB, 93.41 MB, 97.65 MB, 102.09 MB, 106.80 MB, 111.50 MB, 115.56 MB, 120.00 MB, 124.37 MB, 128.77 MB, 132.85 MB, 137.23 MB, 142.55 MB, 147.56 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 18.77 MB/sec
- - PeakMemoryUsage: 191.25 KB (195840)
- - RowsSent: 7.36M (7359961)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 824.026ms
- - TotalBytesSent: 154.92 MB (162446039)
- - UncompressedRowBatchSize: 287.78 MB (301758401)
- HDFS_SCAN_NODE (id=1):(Total: 1s212ms, non-child: 1s212ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/584.82 MB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11
- Runtime filters: Not all filters arrived (arrived: [], missing [0, 1]), waited for 924ms
- Hdfs Read Thread Concurrency Bucket: 0:99.9% 1:0.09597% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/SNAPPY:11
- BytesRead(16s000ms): 183.95 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB, 215.42 MB
- - FooterProcessingTime: (Avg: 176.369ms ; Min: 36.001ms ; Max: 424.013ms ; Number of samples: 11)
- - AverageHdfsReadThreadConcurrency: 0.00
- - AverageScannerThreadConcurrency: 10.10
- - BytesRead: 215.42 MB (225882544)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 215.42 MB (225882544)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 215.42 MB (225882544)
- - CachedFileHandlesHitCount: 87 (87)
- - CachedFileHandlesMissCount: 11 (11)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 588.019ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 6 (6)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 1 (1)
- - NumRowGroups: 11 (11)
- - NumScannerThreadsStarted: 11 (11)
- - NumScannersWithNoReads: 0 (0)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 249.97 MB (262109418)
- - PerReadThreadRawHdfsThroughput: 287.98 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 216.007ms
- - RowBatchQueuePutWaitTime: 1h27m
- - RowsRead: 26.88M (26883304)
- - RowsReturned: 7.36M (7359961)
- - RowsReturnedRate: 6.07 M/sec
- - ScanRangesComplete: 11 (11)
- - ScannerThreadsInvoluntaryContextSwitches: 2 (2)
- - ScannerThreadsTotalWallClockTime: 1h27m
- - MaterializeTupleTime(*): 1s292ms
- - ScannerThreadsSysTime: 628.239ms
- - ScannerThreadsUserTime: 1s789ms
- - ScannerThreadsVoluntaryContextSwitches: 7.44K (7442)
- - TotalRawHdfsOpenFileTime(*): 300.009ms
- - TotalRawHdfsReadTime(*): 748.024ms
- - TotalReadThroughput: 423.39 KB/sec
- Filter 0 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 4.13M (4130836)
- - Rows rejected: 412.24K (412236)
- - Rows total: 26.88M (26883304)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 1 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 669.20K (669204)
- - Rows rejected: 61.13K (61135)
- - Rows total: 26.47M (26471068)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 108.003ms, non-child: 108.003ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 20.000ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 64 (64)
- - NumInstructions: 1.09K (1091)
- - OptimizationTime: 72.002ms
- - PeakMemoryUsage: 545.50 KB (558592)
- - PrepareTime: 16.000ms
- Instance 984ea1ea895ca2cf:a12d79aa00000001 (host=slave-cn02:22000):(Total: 8m32s, non-child: 32.001ms, % non-child: 0.01%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/585.05 MB
- Filter 1 arrival: 7s587ms
- Filter 0 arrival: 7s592ms
- Fragment Instance Lifecycle Event Timeline: 8m32s
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 116.005ms (112.005ms)
- - First Batch Produced: 1s196ms (1s080ms)
- - First Batch Sent: 1s196ms (0.000ns)
- - ExecInternal Finished: 8m32s (8m31s)
- MemoryUsage(16s000ms): 217.48 MB, 245.94 MB, 245.91 MB, 245.87 MB, 245.55 MB, 238.72 MB, 238.68 MB, 238.54 MB, 233.87 MB, 232.36 MB, 232.33 MB, 232.36 MB, 232.32 MB, 232.32 MB, 205.80 MB, 169.72 MB, 162.42 MB, 162.40 MB, 162.38 MB, 162.00 MB, 152.79 MB, 152.66 MB, 152.68 MB, 152.67 MB, 152.73 MB, 152.78 MB, 152.75 MB, 152.77 MB, 130.21 MB, 91.08 MB, 88.66 MB, 57.60 MB
- ThreadUsage(16s000ms): 11, 12, 12, 12, 12, 12, 12, 12, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 6
- - AverageThreadTokens: 10.79
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 246.71 MB (258689027)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 1.90 GB (2039715865)
- - RowsProduced: 7.44M (7437400)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 8m29s
- - TotalStorageWaitTime: 6s956ms
- - TotalThreadsInvoluntaryContextSwitches: 29 (29)
- - TotalThreadsTotalWallClockTime: 1h32m
- - TotalThreadsSysTime: 1s060ms
- - TotalThreadsUserTime: 3s812ms
- - TotalThreadsVoluntaryContextSwitches: 19.91K (19905)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 8m32s
- - ExecTreeExecTime: 1s164ms
- - OpenTime: 112.005ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 4.000ms
- - ExecTreePrepareTime: 4.000ms
- KrpcDataStreamSender (dst_id=6):(Total: 8m31s, non-child: 1s908ms, % non-child: 0.37%)
- BytesSent(16s000ms): 10.44 MB, 16.94 MB, 21.26 MB, 25.34 MB, 29.52 MB, 33.90 MB, 38.28 MB, 42.43 MB, 46.73 MB, 51.10 MB, 55.45 MB, 59.56 MB, 63.84 MB, 68.20 MB, 72.45 MB, 76.83 MB, 81.27 MB, 85.75 MB, 90.26 MB, 94.68 MB, 99.24 MB, 104.10 MB, 108.45 MB, 113.01 MB, 117.72 MB, 122.31 MB, 127.01 MB, 131.79 MB, 136.86 MB, 141.78 MB, 147.68 MB, 153.63 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 18.23 MB/sec
- - PeakMemoryUsage: 191.25 KB (195840)
- - RowsSent: 7.44M (7437400)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 828.038ms
- - TotalBytesSent: 156.57 MB (164179434)
- - UncompressedRowBatchSize: 290.81 MB (304933400)
- HDFS_SCAN_NODE (id=1):(Total: 1s176ms, non-child: 1s176ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/585.05 MB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11
- Runtime filters: Not all filters arrived (arrived: [], missing [0, 1]), waited for 923ms
- Hdfs Read Thread Concurrency Bucket: 0:99.8% 1:0.1951% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/SNAPPY:11
- BytesRead(16s000ms): 190.02 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB, 215.59 MB
- - FooterProcessingTime: (Avg: 109.823ms ; Min: 20.000ms ; Max: 264.012ms ; Number of samples: 11)
- - AverageHdfsReadThreadConcurrency: 0.00
- - AverageScannerThreadConcurrency: 9.79
- - BytesRead: 215.59 MB (226067617)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 215.59 MB (226067617)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 215.59 MB (226067617)
- - CachedFileHandlesHitCount: 87 (87)
- - CachedFileHandlesMissCount: 11 (11)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 552.025ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 6 (6)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 1 (1)
- - NumRowGroups: 11 (11)
- - NumScannerThreadsStarted: 11 (11)
- - NumScannersWithNoReads: 0 (0)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 244.45 MB (256324644)
- - PerReadThreadRawHdfsThroughput: 869.29 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 176.008ms
- - RowBatchQueuePutWaitTime: 1h23m
- - RowsRead: 26.89M (26887271)
- - RowsReturned: 7.44M (7437400)
- - RowsReturnedRate: 6.32 M/sec
- - ScanRangesComplete: 11 (11)
- - ScannerThreadsInvoluntaryContextSwitches: 25 (25)
- - ScannerThreadsTotalWallClockTime: 1h23m
- - MaterializeTupleTime(*): 1s428ms
- - ScannerThreadsSysTime: 733.385ms
- - ScannerThreadsUserTime: 1s737ms
- - ScannerThreadsVoluntaryContextSwitches: 7.45K (7450)
- - TotalRawHdfsOpenFileTime(*): 164.007ms
- - TotalRawHdfsReadTime(*): 248.011ms
- - TotalReadThroughput: 430.77 KB/sec
- Filter 0 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 1.45M (1451225)
- - Rows rejected: 139.27K (139267)
- - Rows total: 26.89M (26887271)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 1 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 924.57K (924574)
- - Rows rejected: 83.70K (83705)
- - Rows total: 26.75M (26748004)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 108.004ms, non-child: 108.004ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 20.000ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 64 (64)
- - NumInstructions: 1.09K (1091)
- - OptimizationTime: 72.003ms
- - PeakMemoryUsage: 545.50 KB (558592)
- - PrepareTime: 16.000ms
- Instance 984ea1ea895ca2cf:a12d79aa00000006 (host=slave-cn07:22000):(Total: 8m31s, non-child: 28.001ms, % non-child: 0.01%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/556.99 MB
- Filter 0 arrival: 7s661ms
- Filter 1 arrival: 7s663ms
- Fragment Instance Lifecycle Event Timeline: 8m31s
- - Prepare Finished: 0.000ns (0.000ns)
- - Open Finished: 128.006ms (128.006ms)
- - First Batch Produced: 1s276ms (1s148ms)
- - First Batch Sent: 1s276ms (0.000ns)
- - ExecInternal Finished: 8m31s (8m29s)
- MemoryUsage(8s000ms): 170.97 MB, 240.70 MB, 240.37 MB, 240.27 MB, 240.20 MB, 240.18 MB, 237.09 MB, 233.15 MB, 233.09 MB, 233.09 MB, 233.08 MB, 233.06 MB, 233.14 MB, 233.08 MB, 233.12 MB, 233.13 MB, 233.02 MB, 233.11 MB, 233.06 MB, 233.13 MB, 233.10 MB, 233.05 MB, 233.09 MB, 233.09 MB, 233.08 MB, 226.44 MB, 201.67 MB, 181.29 MB, 169.38 MB, 169.39 MB, 169.40 MB, 169.34 MB, 169.33 MB, 169.42 MB, 169.39 MB, 169.32 MB, 169.39 MB, 168.91 MB, 161.38 MB, 161.33 MB, 161.33 MB, 161.25 MB, 161.30 MB, 161.24 MB, 160.91 MB, 158.48 MB, 153.23 MB, 153.34 MB, 153.32 MB, 153.33 MB, 153.33 MB, 153.35 MB, 153.35 MB, 153.37 MB, 148.42 MB, 130.25 MB, 105.62 MB, 93.87 MB, 86.57 MB, 86.21 MB, 85.38 MB, 80.43 MB, 60.04 MB
- ThreadUsage(8s000ms): 9, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 9, 8
- - AverageThreadTokens: 10.54
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 240.85 MB (252553327)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 2.05 GB (2206373452)
- - RowsProduced: 7.10M (7096514)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 8m28s
- - TotalStorageWaitTime: 8s444ms
- - TotalThreadsInvoluntaryContextSwitches: 3 (3)
- - TotalThreadsTotalWallClockTime: 1h29m
- - TotalThreadsSysTime: 1s039ms
- - TotalThreadsUserTime: 3s706ms
- - TotalThreadsVoluntaryContextSwitches: 19.55K (19548)
- Buffer pool:
- - AllocTime: 4.000ms
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 8m31s
- - ExecTreeExecTime: 1s236ms
- - OpenTime: 128.006ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=6):(Total: 8m29s, non-child: 1s736ms, % non-child: 0.34%)
- BytesSent(8s000ms): 2.63 MB, 9.39 MB, 11.70 MB, 13.86 MB, 16.03 MB, 18.27 MB, 20.24 MB, 22.39 MB, 24.48 MB, 26.58 MB, 28.68 MB, 30.88 MB, 33.15 MB, 35.24 MB, 37.34 MB, 39.52 MB, 41.71 MB, 43.87 MB, 46.08 MB, 48.33 MB, 50.37 MB, 52.52 MB, 54.62 MB, 56.76 MB, 59.04 MB, 61.41 MB, 63.72 MB, 66.00 MB, 68.24 MB, 70.55 MB, 72.84 MB, 75.03 MB, 77.41 MB, 79.72 MB, 81.99 MB, 84.19 MB, 86.29 MB, 88.49 MB, 90.63 MB, 92.93 MB, 95.28 MB, 97.59 MB, 100.11 MB, 102.37 MB, 104.64 MB, 106.93 MB, 109.38 MB, 111.76 MB, 114.05 MB, 116.38 MB, 118.63 MB, 120.96 MB, 123.12 MB, 125.17 MB, 127.18 MB, 129.48 MB, 131.57 MB, 133.83 MB, 136.21 MB, 138.64 MB, 141.60 MB, 144.14 MB, 146.55 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 18.40 MB/sec
- - PeakMemoryUsage: 191.25 KB (195840)
- - RowsSent: 7.10M (7096514)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 764.036ms
- - TotalBytesSent: 149.42 MB (156676693)
- - UncompressedRowBatchSize: 277.48 MB (290957074)
- HDFS_SCAN_NODE (id=1):(Total: 1s236ms, non-child: 1s236ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/556.99 MB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10
- Runtime filters: Not all filters arrived (arrived: [], missing [0, 1]), waited for 904ms
- Hdfs Read Thread Concurrency Bucket: 0:99.9% 1:0.09785% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/SNAPPY:10
- BytesRead(8s000ms): 144.03 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB, 205.15 MB
- - FooterProcessingTime: (Avg: 130.006ms ; Min: 16.000ms ; Max: 316.015ms ; Number of samples: 10)
- - AverageHdfsReadThreadConcurrency: 0.00
- - AverageScannerThreadConcurrency: 9.55
- - BytesRead: 205.15 MB (215120266)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 205.15 MB (215120266)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 205.15 MB (215120266)
- - CachedFileHandlesHitCount: 80 (80)
- - CachedFileHandlesMissCount: 10 (10)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 604.028ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 6 (6)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 1 (1)
- - NumRowGroups: 10 (10)
- - NumScannerThreadsStarted: 10 (10)
- - NumScannersWithNoReads: 0 (0)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 238.59 MB (250181776)
- - PerReadThreadRawHdfsThroughput: 303.47 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 244.011ms
- - RowBatchQueuePutWaitTime: 1h21m
- - RowsRead: 25.60M (25599571)
- - RowsReturned: 7.10M (7096514)
- - RowsReturnedRate: 5.74 M/sec
- - ScanRangesComplete: 10 (10)
- - ScannerThreadsInvoluntaryContextSwitches: 2 (2)
- - ScannerThreadsTotalWallClockTime: 1h21m
- - MaterializeTupleTime(*): 1s152ms
- - ScannerThreadsSysTime: 690.571ms
- - ScannerThreadsUserTime: 1s611ms
- - ScannerThreadsVoluntaryContextSwitches: 7.17K (7173)
- - TotalRawHdfsOpenFileTime(*): 208.009ms
- - TotalRawHdfsReadTime(*): 676.032ms
- - TotalReadThroughput: 410.71 KB/sec
- Filter 0 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 725.71K (725707)
- - Rows rejected: 65.01K (65012)
- - Rows total: 25.60M (25599571)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 1 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 819.49K (819493)
- - Rows rejected: 73.53K (73528)
- - Rows total: 25.53M (25534559)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 128.006ms, non-child: 128.006ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 20.000ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 64 (64)
- - NumInstructions: 1.09K (1091)
- - OptimizationTime: 84.004ms
- - PeakMemoryUsage: 545.50 KB (558592)
- - PrepareTime: 20.000ms
- Instance 984ea1ea895ca2cf:a12d79aa00000002 (host=slave-cn04:22000):(Total: 7m58s, non-child: 68.003ms, % non-child: 0.01%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/556.85 MB
- Filter 1 arrival: 7s626ms
- Filter 0 arrival: 7s629ms
- Fragment Instance Lifecycle Event Timeline: 7m58s
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 112.005ms (108.005ms)
- - First Batch Produced: 1s252ms (1s140ms)
- - First Batch Sent: 1s252ms (0.000ns)
- - ExecInternal Finished: 7m58s (7m57s)
- MemoryUsage(8s000ms): 173.32 MB, 232.67 MB, 232.63 MB, 232.66 MB, 232.65 MB, 232.63 MB, 232.65 MB, 232.61 MB, 232.66 MB, 232.69 MB, 232.61 MB, 232.68 MB, 232.67 MB, 232.63 MB, 232.61 MB, 232.72 MB, 232.63 MB, 232.65 MB, 232.63 MB, 232.69 MB, 232.59 MB, 232.70 MB, 232.74 MB, 232.75 MB, 220.75 MB, 190.67 MB, 170.70 MB, 169.04 MB, 169.03 MB, 169.01 MB, 168.48 MB, 160.97 MB, 160.97 MB, 161.04 MB, 160.91 MB, 160.94 MB, 160.91 MB, 160.55 MB, 159.63 MB, 152.97 MB, 153.01 MB, 152.98 MB, 152.94 MB, 152.89 MB, 152.97 MB, 152.94 MB, 152.97 MB, 152.94 MB, 152.92 MB, 152.97 MB, 152.95 MB, 138.06 MB, 116.66 MB, 92.94 MB, 91.65 MB, 91.09 MB, 90.64 MB, 89.08 MB, 69.69 MB
- ThreadUsage(8s000ms): 9, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 8
- - AverageThreadTokens: 10.50
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 240.43 MB (252105768)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 1.79 GB (1925754349)
- - RowsProduced: 7.11M (7108989)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 7m55s
- - TotalStorageWaitTime: 8s236ms
- - TotalThreadsInvoluntaryContextSwitches: 8 (8)
- - TotalThreadsTotalWallClockTime: 1h23m
- - TotalThreadsSysTime: 770.754ms
- - TotalThreadsUserTime: 3s927ms
- - TotalThreadsVoluntaryContextSwitches: 19.07K (19074)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 7m58s
- - ExecTreeExecTime: 1s228ms
- - OpenTime: 108.005ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=6):(Total: 7m57s, non-child: 1s628ms, % non-child: 0.34%)
- BytesSent(8s000ms): 3.76 MB, 10.21 MB, 12.52 MB, 14.53 MB, 16.68 MB, 18.95 MB, 21.32 MB, 23.64 MB, 26.03 MB, 28.32 MB, 30.63 MB, 32.82 MB, 35.26 MB, 37.59 MB, 39.86 MB, 42.13 MB, 44.39 MB, 46.69 MB, 49.11 MB, 51.65 MB, 53.99 MB, 56.37 MB, 58.76 MB, 61.15 MB, 63.66 MB, 66.08 MB, 68.56 MB, 71.06 MB, 73.36 MB, 75.38 MB, 77.56 MB, 79.86 MB, 82.22 MB, 84.74 MB, 87.24 MB, 89.65 MB, 92.04 MB, 94.59 MB, 96.92 MB, 99.21 MB, 101.66 MB, 104.02 MB, 106.44 MB, 108.81 MB, 111.16 MB, 113.71 MB, 116.19 MB, 118.81 MB, 121.31 MB, 123.82 MB, 126.45 MB, 129.01 MB, 131.55 MB, 133.97 MB, 136.47 MB, 139.26 MB, 141.70 MB, 144.08 MB, 146.63 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 18.59 MB/sec
- - PeakMemoryUsage: 191.25 KB (195840)
- - RowsSent: 7.11M (7108989)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 720.037ms
- - TotalBytesSent: 149.69 MB (156956926)
- - UncompressedRowBatchSize: 277.97 MB (291468549)
- HDFS_SCAN_NODE (id=1):(Total: 1s208ms, non-child: 1s208ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/556.85 MB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10
- Runtime filters: Not all filters arrived (arrived: [], missing [0, 1]), waited for 924ms
- Hdfs Read Thread Concurrency Bucket: 0:99.79% 1:0.2096% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/SNAPPY:10
- BytesRead(8s000ms): 146.40 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB, 205.12 MB
- - FooterProcessingTime: (Avg: 143.607ms ; Min: 44.002ms ; Max: 316.016ms ; Number of samples: 10)
- - AverageHdfsReadThreadConcurrency: 0.00
- - AverageScannerThreadConcurrency: 9.54
- - BytesRead: 205.12 MB (215087055)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 205.12 MB (215087055)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 205.12 MB (215087055)
- - CachedFileHandlesHitCount: 80 (80)
- - CachedFileHandlesMissCount: 10 (10)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 784.041ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 6 (6)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 1 (1)
- - NumRowGroups: 10 (10)
- - NumScannerThreadsStarted: 10 (10)
- - NumScannersWithNoReads: 0 (0)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 238.14 MB (249708617)
- - PerReadThreadRawHdfsThroughput: 330.83 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 220.011ms
- - RowBatchQueuePutWaitTime: 1h15m
- - RowsRead: 25.60M (25599454)
- - RowsReturned: 7.11M (7108989)
- - RowsReturnedRate: 5.88 M/sec
- - ScanRangesComplete: 10 (10)
- - ScannerThreadsInvoluntaryContextSwitches: 1 (1)
- - ScannerThreadsTotalWallClockTime: 1h15m
- - MaterializeTupleTime(*): 1s096ms
- - ScannerThreadsSysTime: 532.821ms
- - ScannerThreadsUserTime: 1s870ms
- - ScannerThreadsVoluntaryContextSwitches: 7.17K (7166)
- - TotalRawHdfsOpenFileTime(*): 180.009ms
- - TotalRawHdfsReadTime(*): 620.032ms
- - TotalReadThroughput: 439.89 KB/sec
- Filter 0 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 392.72K (392722)
- - Rows rejected: 30.94K (30939)
- - Rows total: 25.60M (25599454)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 1 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 498.49K (498494)
- - Rows rejected: 43.06K (43061)
- - Rows total: 25.57M (25568515)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 104.005ms, non-child: 104.005ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 20.001ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 64 (64)
- - NumInstructions: 1.09K (1091)
- - OptimizationTime: 68.003ms
- - PeakMemoryUsage: 545.50 KB (558592)
- - PrepareTime: 16.000ms
- Averaged Fragment F01:(Total: 7s120ms, non-child: 1s624ms, % non-child: 22.81%)
- split sizes: min: 3.77 GB, max: 3.86 GB, avg: 3.83 GB, stddev: 30.23 MB
- completion times: min:6s072ms max:7s544ms mean: 7s126ms stddev:501.560ms
- execution rates: min:523.66 MB/sec max:644.90 MB/sec mean:553.22 MB/sec stddev:42.17 MB/sec
- num instances: 6
- - AverageThreadTokens: 29.40
- - BloomFilterBytes: 4.00 MB (4194304)
- - PeakMemoryUsage: 1.43 GB (1535860372)
- - PeakReservation: 196.00 MB (205520896)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 1.71 GB (1836833523)
- - RowsProduced: 459.47K (459466)
- - TotalNetworkReceiveTime: 77.336ms
- - TotalNetworkSendTime: 6.000ms
- - TotalStorageWaitTime: 2m15s
- - TotalThreadsInvoluntaryContextSwitches: 23 (23)
- - TotalThreadsTotalWallClockTime: 3m29s
- - TotalThreadsSysTime: 7s574ms
- - TotalThreadsUserTime: 10s268ms
- - TotalThreadsVoluntaryContextSwitches: 43.65K (43650)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 4.00 MB (4194304)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 4.00 MB (4194304)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 4.00 MB (4194304)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 4.00 MB (4194304)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 5s759ms
- - ExecTreeExecTime: 3s868ms
- - OpenTime: 1s358ms
- - ExecTreeOpenTime: 1s052ms
- - PrepareTime: 3.333ms
- - ExecTreePrepareTime: 666.698us
- KrpcDataStreamSender (dst_id=7):(Total: 273.346ms, non-child: 273.346ms, % non-child: 100.00%)
- - EosSent: 6 (6)
- - NetworkThroughput: 26.55 MB/sec
- - PeakMemoryUsage: 189.00 KB (193536)
- - RowsSent: 459.47K (459466)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 121.338ms
- - TotalBytesSent: 28.25 MB (29623056)
- - UncompressedRowBatchSize: 39.00 MB (40892533)
- HASH_JOIN_NODE (id=3):(Total: 4s921ms, non-child: 2s416ms, % non-child: 49.11%)
- - BuildRows: 3.68M (3679360)
- - BuildTime: 570.693ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 192.39 MB (201734058)
- - ProbeRows: 16.41M (16411896)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 1s811ms
- - RowsReturned: 459.47K (459466)
- - RowsReturnedRate: 94.90 K/sec
- Buffer pool:
- - AllocTime: 6.666ms
- - CumulativeAllocationBytes: 192.00 MB (201326592)
- - CumulativeAllocations: 48 (48)
- - PeakReservation: 192.00 MB (201326592)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 192.00 MB (201326592)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=3):
- - BuildRowsPartitionTime: 294.680ms
- - BuildRowsPartitioned: 3.68M (3679360)
- - HashBuckets: 8.39M (8388608)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 269.345ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 22.12 KB (22656)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=5):(Total: 130.672ms, non-child: 130.672ms, % non-child: 100.00%)
- - ConvertRowBatchTime: 48.668ms
- - PeakMemoryUsage: 12.70 MB (13318628)
- - RowsReturned: 3.68M (3679360)
- - RowsReturnedRate: 28.73 M/sec
- Buffer pool:
- - AllocTime: 20.667ms
- - CumulativeAllocationBytes: 84.43 MB (88530944)
- - CumulativeAllocations: 7.22K (7218)
- - PeakReservation: 12.65 MB (13262848)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.65 MB (13262848)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- - FirstBatchWaitTime: 0.000ns
- - TotalBytesDequeued: 66.67 MB (69907840)
- - TotalGetBatchTime: 77.336ms
- - DataWaitTime: 72.003ms
- Enqueue:
- - DeserializeRowBatchTime: 96.004ms
- - TotalBatchesEnqueued: 3.61K (3609)
- - TotalBatchesReceived: 3.61K (3609)
- - TotalBytesReceived: 33.37 MB (34992608)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 51.163ms
- - TotalRPCsDeferred: 7 (7)
- HDFS_SCAN_NODE (id=2):(Total: 2s374ms, non-child: 2s374ms, % non-child: 100.00%)
- - AverageHdfsReadThreadConcurrency: 0.64
- - AverageScannerThreadConcurrency: 30.44
- - BytesRead: 1.96 GB (2101966945)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 1.96 GB (2101966945)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 1.96 GB (2101966945)
- - CachedFileHandlesHitCount: 568 (568)
- - CachedFileHandlesMissCount: 63 (63)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 4s547ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 9 (9)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 1 (1)
- - NumRowGroups: 63 (63)
- - NumScannerThreadsStarted: 37 (37)
- - NumScannersWithNoReads: 0 (0)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 1.23 GB (1322851030)
- - PerReadThreadRawHdfsThroughput: 694.43 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 2s280ms
- - RowBatchQueuePutWaitTime: 35s283ms
- - RowsRead: 52.46M (52456522)
- - RowsReturned: 16.41M (16411896)
- - RowsReturnedRate: 7.57 M/sec
- - ScanRangesComplete: 63 (63)
- - ScannerThreadsInvoluntaryContextSwitches: 17 (17)
- - ScannerThreadsTotalWallClockTime: 3m21s
- - MaterializeTupleTime(*): 12s195ms
- - ScannerThreadsSysTime: 5s963ms
- - ScannerThreadsUserTime: 7s302ms
- - ScannerThreadsVoluntaryContextSwitches: 41.06K (41063)
- - TotalRawHdfsOpenFileTime(*): 1s079ms
- - TotalRawHdfsReadTime(*): 3s046ms
- - TotalReadThroughput: 280.23 MB/sec
- Filter 4 (2.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 3.97M (3971547)
- - Rows rejected: 278.23K (278227)
- - Rows total: 52.46M (52456522)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 5 (2.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 3.42M (3422175)
- - Rows rejected: 79.07K (79074)
- - Rows total: 52.18M (52178295)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 302.014ms, non-child: 302.014ms, % non-child: 100.00%)
- - CodegenTime: 2.666ms
- - CompileTime: 80.003ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 113 (113)
- - NumInstructions: 3.40K (3401)
- - OptimizationTime: 200.009ms
- - PeakMemoryUsage: 1.66 MB (1741312)
- - PrepareTime: 22.001ms
- Fragment F01:
- Instance 984ea1ea895ca2cf:a12d79aa0000000d (host=slave-cn06:22000):(Total: 7s536ms, non-child: 1s124ms, % non-child: 14.92%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:64/3.86 GB
- Filter 4 arrival: 746ms
- Filter 5 arrival: 746ms
- Fragment Instance Lifecycle Event Timeline: 7s540ms
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 1s428ms (1s424ms)
- - First Batch Produced: 1s448ms (20.000ms)
- - First Batch Sent: 1s448ms (0.000ns)
- - ExecInternal Finished: 7s540ms (6s092ms)
- MemoryUsage(500.000ms): 10.09 MB, 80.74 MB, 221.76 MB, 273.35 MB, 235.18 MB, 253.55 MB, 294.91 MB, 444.34 MB, 563.90 MB, 595.20 MB, 536.74 MB, 579.72 MB, 342.47 MB, 474.36 MB, 500.05 MB
- ThreadUsage(500.000ms): 1, 2, 40, 40, 40, 40, 40, 40, 40, 40, 39, 31, 22, 17, 9
- - AverageThreadTokens: 29.40
- - BloomFilterBytes: 4.00 MB (4194304)
- - PeakMemoryUsage: 647.60 MB (679059652)
- - PeakReservation: 196.00 MB (205520896)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 938.16 MB (983735960)
- - RowsProduced: 462.47K (462469)
- - TotalNetworkReceiveTime: 116.003ms
- - TotalNetworkSendTime: 8.000ms
- - TotalStorageWaitTime: 3m4s
- - TotalThreadsInvoluntaryContextSwitches: 18 (18)
- - TotalThreadsTotalWallClockTime: 3m39s
- - TotalThreadsSysTime: 6s080ms
- - TotalThreadsUserTime: 9s343ms
- - TotalThreadsVoluntaryContextSwitches: 25.47K (25470)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 4.00 MB (4194304)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 4.00 MB (4194304)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 4.00 MB (4194304)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 4.00 MB (4194304)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 6s112ms
- - ExecTreeExecTime: 4s744ms
- - OpenTime: 1s424ms
- - ExecTreeOpenTime: 1s128ms
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=7):(Total: 248.008ms, non-child: 240.007ms, % non-child: 96.77%)
- BytesSent(500.000ms): 0, 0, 0, 532.40 KB, 1.29 MB, 1.72 MB, 1.72 MB, 2.89 MB, 4.92 MB, 7.86 MB, 11.75 MB, 15.97 MB, 18.93 MB, 21.62 MB, 25.86 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 26.97 MB/sec
- - PeakMemoryUsage: 189.00 KB (193536)
- - RowsSent: 462.47K (462469)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 124.004ms
- - TotalBytesSent: 28.36 MB (29741400)
- - UncompressedRowBatchSize: 39.25 MB (41159741)
- HASH_JOIN_NODE (id=3):(Total: 5s872ms, non-child: 2s344ms, % non-child: 39.92%)
- ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- - BuildRows: 3.68M (3679360)
- - BuildTime: 560.018ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 192.34 MB (201681152)
- - ProbeRows: 16.55M (16545313)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 1s760ms
- - RowsReturned: 462.47K (462469)
- - RowsReturnedRate: 78.75 K/sec
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 192.00 MB (201326592)
- - CumulativeAllocations: 48 (48)
- - PeakReservation: 192.00 MB (201326592)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 192.00 MB (201326592)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=3):
- ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- Runtime filters: 2 of 2 Runtime Filters Published
- - BuildRowsPartitionTime: 280.009ms
- - BuildRowsPartitioned: 3.68M (3679360)
- - HashBuckets: 8.39M (8388608)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 276.008ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 22.12 KB (22656)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=5):(Total: 160.005ms, non-child: 56.001ms, % non-child: 35.00%)
- - ConvertRowBatchTime: 44.001ms
- - PeakMemoryUsage: 12.70 MB (13321854)
- - RowsReturned: 3.68M (3679360)
- - RowsReturnedRate: 23.00 M/sec
- Buffer pool:
- - AllocTime: 24.000ms
- - CumulativeAllocationBytes: 84.43 MB (88530944)
- - CumulativeAllocations: 7.22K (7218)
- - PeakReservation: 12.65 MB (13262848)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.65 MB (13262848)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(500.000ms): 0, 65.97 MB
- - FirstBatchWaitTime: 0.000ns
- - TotalBytesDequeued: 66.67 MB (69907840)
- - TotalGetBatchTime: 116.003ms
- - DataWaitTime: 108.003ms
- Enqueue:
- BytesReceived(500.000ms): 2.38 MB, 33.02 MB
- DeferredQueueSize(500.000ms): 0, 0
- - DispatchTime: (Avg: 31.711us ; Min: 13.217us ; Max: 185.442us ; Number of samples: 3609)
- - DeserializeRowBatchTime: 88.002ms
- - TotalBatchesEnqueued: 3.61K (3609)
- - TotalBatchesReceived: 3.61K (3609)
- - TotalBytesReceived: 33.37 MB (34992608)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 40.023ms
- - TotalRPCsDeferred: 7 (7)
- HDFS_SCAN_NODE (id=2):(Total: 3s368ms, non-child: 3s368ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:64/3.86 GB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 64 out of 64
- Runtime filters: All filters arrived. Waited 0
- Hdfs Read Thread Concurrency Bucket: 0:14.29% 1:85.71% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/SNAPPY:64
- BytesRead(500.000ms): 0, 0, 20.86 MB, 82.89 MB, 119.84 MB, 173.33 MB, 200.04 MB, 374.89 MB, 591.73 MB, 797.26 MB, 1021.96 MB, 1.26 GB, 1.42 GB, 1.66 GB, 1.91 GB
- - FooterProcessingTime: (Avg: 952.406ms ; Min: 16.000ms ; Max: 1s528ms ; Number of samples: 64)
- - AverageHdfsReadThreadConcurrency: 0.86
- - AverageScannerThreadConcurrency: 30.36
- - BytesRead: 1.97 GB (2117825808)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 1.97 GB (2117825808)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 1.97 GB (2117825808)
- - CachedFileHandlesHitCount: 576 (576)
- - CachedFileHandlesMissCount: 64 (64)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 4s036ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 9 (9)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 1 (1)
- - NumRowGroups: 64 (64)
- - NumScannerThreadsStarted: 39 (39)
- - NumScannersWithNoReads: 0 (0)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 444.74 MB (466347569)
- - PerReadThreadRawHdfsThroughput: 497.45 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 3s332ms
- - RowBatchQueuePutWaitTime: 1s464ms
- - RowsRead: 52.85M (52849667)
- - RowsReturned: 16.55M (16545313)
- - RowsReturnedRate: 4.91 M/sec
- - ScanRangesComplete: 64 (64)
- - ScannerThreadsInvoluntaryContextSwitches: 12 (12)
- - ScannerThreadsTotalWallClockTime: 3m30s
- - MaterializeTupleTime(*): 6s852ms
- - ScannerThreadsSysTime: 4s830ms
- - ScannerThreadsUserTime: 6s513ms
- - ScannerThreadsVoluntaryContextSwitches: 21.39K (21395)
- - TotalRawHdfsOpenFileTime(*): 1s120ms
- - TotalRawHdfsReadTime(*): 4s060ms
- - TotalReadThroughput: 261.46 MB/sec
- Filter 4 (2.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 3.76M (3764990)
- - Rows rejected: 252.53K (252534)
- - Rows total: 52.85M (52849667)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 5 (2.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 3.46M (3459008)
- - Rows rejected: 76.77K (76767)
- - Rows total: 52.60M (52597133)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 292.009ms, non-child: 292.009ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 76.002ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 113 (113)
- - NumInstructions: 3.40K (3401)
- - OptimizationTime: 192.006ms
- - PeakMemoryUsage: 1.66 MB (1741312)
- - PrepareTime: 24.000ms
- Instance 984ea1ea895ca2cf:a12d79aa0000000f (host=slave-cn04:22000):(Total: 7s436ms, non-child: 1s948ms, % non-child: 26.20%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:63/3.83 GB
- Filter 4 arrival: 745ms
- Filter 5 arrival: 745ms
- Fragment Instance Lifecycle Event Timeline: 7s440ms
- - Prepare Finished: 12.000ms (12.000ms)
- - Open Finished: 1s360ms (1s348ms)
- - First Batch Produced: 1s376ms (16.000ms)
- - First Batch Sent: 1s376ms (0.000ns)
- - ExecInternal Finished: 7s440ms (6s064ms)
- MemoryUsage(500.000ms): 5.74 MB, 50.74 MB, 204.13 MB, 253.26 MB, 237.08 MB, 258.64 MB, 377.34 MB, 533.86 MB, 737.88 MB, 1010.34 MB, 1.16 GB, 1.22 GB, 1.44 GB, 1.27 GB, 1.07 GB
- ThreadUsage(500.000ms): 1, 2, 40, 40, 40, 40, 40, 40, 40, 40, 40, 34, 30, 22, 18
- - AverageThreadTokens: 31.13
- - BloomFilterBytes: 4.00 MB (4194304)
- - PeakMemoryUsage: 1.51 GB (1625858439)
- - PeakReservation: 196.00 MB (205520896)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 1.79 GB (1925754349)
- - RowsProduced: 460.03K (460032)
- - TotalNetworkReceiveTime: 52.002ms
- - TotalNetworkSendTime: 8.000ms
- - TotalStorageWaitTime: 2m23s
- - TotalThreadsInvoluntaryContextSwitches: 22 (22)
- - TotalThreadsTotalWallClockTime: 3m48s
- - TotalThreadsSysTime: 7s445ms
- - TotalThreadsUserTime: 11s498ms
- - TotalThreadsVoluntaryContextSwitches: 50.49K (50487)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 4.00 MB (4194304)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 4.00 MB (4194304)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 4.00 MB (4194304)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 4.00 MB (4194304)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 6s080ms
- - ExecTreeExecTime: 3s828ms
- - OpenTime: 1s348ms
- - ExecTreeOpenTime: 1s044ms
- - PrepareTime: 8.000ms
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=7):(Total: 316.016ms, non-child: 308.016ms, % non-child: 97.47%)
- BytesSent(500.000ms): 0, 0, 0, 420.38 KB, 1.27 MB, 1.78 MB, 1.83 MB, 4.16 MB, 7.05 MB, 10.39 MB, 13.48 MB, 16.58 MB, 19.54 MB, 22.52 MB, 25.72 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 26.98 MB/sec
- - PeakMemoryUsage: 189.00 KB (193536)
- - RowsSent: 460.03K (460032)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 136.007ms
- - TotalBytesSent: 28.30 MB (29674417)
- - UncompressedRowBatchSize: 39.05 MB (40942848)
- HASH_JOIN_NODE (id=3):(Total: 4s872ms, non-child: 2s436ms, % non-child: 50.00%)
- ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- - BuildRows: 3.68M (3679360)
- - BuildTime: 588.030ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 192.40 MB (201744640)
- - ProbeRows: 16.41M (16406443)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 1s808ms
- - RowsReturned: 460.03K (460032)
- - RowsReturnedRate: 94.42 K/sec
- Buffer pool:
- - AllocTime: 24.001ms
- - CumulativeAllocationBytes: 192.00 MB (201326592)
- - CumulativeAllocations: 48 (48)
- - PeakReservation: 192.00 MB (201326592)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 192.00 MB (201326592)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=3):
- ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- Runtime filters: 2 of 2 Runtime Filters Published
- - BuildRowsPartitionTime: 316.016ms
- - BuildRowsPartitioned: 3.68M (3679360)
- - HashBuckets: 8.39M (8388608)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 264.013ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 22.12 KB (22656)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=5):(Total: 100.005ms, non-child: 60.003ms, % non-child: 60.00%)
- - ConvertRowBatchTime: 44.002ms
- - PeakMemoryUsage: 12.70 MB (13312129)
- - RowsReturned: 3.68M (3679360)
- - RowsReturnedRate: 36.79 M/sec
- Buffer pool:
- - AllocTime: 32.001ms
- - CumulativeAllocationBytes: 84.43 MB (88530944)
- - CumulativeAllocations: 7.22K (7218)
- - PeakReservation: 12.65 MB (13262848)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.65 MB (13262848)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(500.000ms): 0, 41.86 MB
- - FirstBatchWaitTime: 0.000ns
- - TotalBytesDequeued: 66.67 MB (69907840)
- - TotalGetBatchTime: 52.002ms
- - DataWaitTime: 40.002ms
- Enqueue:
- BytesReceived(500.000ms): 0, 23.73 MB
- DeferredQueueSize(500.000ms): 0, 0
- - DispatchTime: (Avg: 33.711us ; Min: 12.223us ; Max: 1.081ms ; Number of samples: 3609)
- - DeserializeRowBatchTime: 96.005ms
- - TotalBatchesEnqueued: 3.61K (3609)
- - TotalBatchesReceived: 3.61K (3609)
- - TotalBytesReceived: 33.37 MB (34992608)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 60.156ms
- - TotalRPCsDeferred: 7 (7)
- HDFS_SCAN_NODE (id=2):(Total: 2s336ms, non-child: 2s336ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:63/3.83 GB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 63 out of 63
- Runtime filters: All filters arrived. Waited 0
- Hdfs Read Thread Concurrency Bucket: 0:35.71% 1:64.29% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/SNAPPY:63
- BytesRead(500.000ms): 0, 0, 6.79 MB, 66.74 MB, 126.97 MB, 173.85 MB, 254.15 MB, 490.95 MB, 787.36 MB, 1.03 GB, 1.30 GB, 1.56 GB, 1.81 GB, 1.96 GB, 1.96 GB
- - FooterProcessingTime: (Avg: 735.086ms ; Min: 20.001ms ; Max: 1s292ms ; Number of samples: 63)
- - AverageHdfsReadThreadConcurrency: 0.64
- - AverageScannerThreadConcurrency: 32.21
- - BytesRead: 1.96 GB (2102185110)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 1.96 GB (2102185110)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 1.96 GB (2102185110)
- - CachedFileHandlesHitCount: 567 (567)
- - CachedFileHandlesMissCount: 63 (63)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 5s664ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 9 (9)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 1 (1)
- - NumRowGroups: 63 (63)
- - NumScannerThreadsStarted: 39 (39)
- - NumScannersWithNoReads: 0 (0)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 1.32 GB (1413123920)
- - PerReadThreadRawHdfsThroughput: 624.90 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 2s212ms
- - RowBatchQueuePutWaitTime: 32s137ms
- - RowsRead: 52.46M (52459008)
- - RowsReturned: 16.41M (16406443)
- - RowsReturnedRate: 7.02 M/sec
- - ScanRangesComplete: 63 (63)
- - ScannerThreadsInvoluntaryContextSwitches: 17 (17)
- - ScannerThreadsTotalWallClockTime: 3m39s
- - MaterializeTupleTime(*): 21s449ms
- - ScannerThreadsSysTime: 5s836ms
- - ScannerThreadsUserTime: 8s445ms
- - ScannerThreadsVoluntaryContextSwitches: 48.27K (48267)
- - TotalRawHdfsOpenFileTime(*): 1s148ms
- - TotalRawHdfsReadTime(*): 3s208ms
- - TotalReadThroughput: 267.31 MB/sec
- Filter 4 (2.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 4.18M (4178485)
- - Rows rejected: 298.98K (298975)
- - Rows total: 52.46M (52459008)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 5 (2.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 3.41M (3407144)
- - Rows rejected: 73.96K (73956)
- - Rows total: 52.16M (52160033)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 300.015ms, non-child: 300.015ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 84.004ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 113 (113)
- - NumInstructions: 3.40K (3401)
- - OptimizationTime: 200.010ms
- - PeakMemoryUsage: 1.66 MB (1741312)
- - PrepareTime: 16.000ms
- Instance 984ea1ea895ca2cf:a12d79aa00000010 (host=slave-cn03:22000):(Total: 7s420ms, non-child: 1s624ms, % non-child: 21.89%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:63/3.83 GB
- Filter 4 arrival: 747ms
- Filter 5 arrival: 746ms
- Fragment Instance Lifecycle Event Timeline: 7s420ms
- - Prepare Finished: 0.000ns (0.000ns)
- - Open Finished: 1s440ms (1s440ms)
- - First Batch Produced: 1s460ms (20.000ms)
- - First Batch Sent: 1s460ms (0.000ns)
- - ExecInternal Finished: 7s420ms (5s960ms)
- MemoryUsage(500.000ms): 4.08 MB, 50.74 MB, 196.08 MB, 280.78 MB, 275.06 MB, 297.37 MB, 262.40 MB, 422.17 MB, 494.31 MB, 689.80 MB, 928.70 MB, 1.07 GB, 1.08 GB, 1.24 GB, 1.06 GB
- ThreadUsage(500.000ms): 1, 2, 39, 40, 40, 40, 40, 40, 40, 40, 40, 38, 30, 22, 18
- - AverageThreadTokens: 31.33
- - BloomFilterBytes: 4.00 MB (4194304)
- - PeakMemoryUsage: 1.28 GB (1371012744)
- - PeakReservation: 196.00 MB (205520896)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 1.57 GB (1688006861)
- - RowsProduced: 458.37K (458369)
- - TotalNetworkReceiveTime: 80.003ms
- - TotalNetworkSendTime: 4.000ms
- - TotalStorageWaitTime: 2m38s
- - TotalThreadsInvoluntaryContextSwitches: 25 (25)
- - TotalThreadsTotalWallClockTime: 3m47s
- - TotalThreadsSysTime: 7s806ms
- - TotalThreadsUserTime: 10s015ms
- - TotalThreadsVoluntaryContextSwitches: 45.85K (45854)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 4.00 MB (4194304)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 4.00 MB (4194304)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 4.00 MB (4194304)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 4.00 MB (4194304)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 5s980ms
- - ExecTreeExecTime: 4s108ms
- - OpenTime: 1s440ms
- - ExecTreeOpenTime: 1s140ms
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=7):(Total: 256.011ms, non-child: 252.011ms, % non-child: 98.44%)
- BytesSent(500.000ms): 0, 0, 0, 84.01 KB, 924.59 KB, 1.45 MB, 1.71 MB, 2.85 MB, 4.80 MB, 7.98 MB, 11.65 MB, 15.11 MB, 18.45 MB, 22.00 MB, 25.42 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 26.15 MB/sec
- - PeakMemoryUsage: 189.00 KB (193536)
- - RowsSent: 458.37K (458369)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 112.005ms
- - TotalBytesSent: 28.19 MB (29556468)
- - UncompressedRowBatchSize: 38.90 MB (40794841)
- HASH_JOIN_NODE (id=3):(Total: 5s248ms, non-child: 2s432ms, % non-child: 46.34%)
- ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- - BuildRows: 3.68M (3679360)
- - BuildTime: 572.026ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 192.40 MB (201744640)
- - ProbeRows: 16.41M (16409133)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 1s820ms
- - RowsReturned: 458.37K (458369)
- - RowsReturnedRate: 87.34 K/sec
- Buffer pool:
- - AllocTime: 8.000ms
- - CumulativeAllocationBytes: 192.00 MB (201326592)
- - CumulativeAllocations: 48 (48)
- - PeakReservation: 192.00 MB (201326592)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 192.00 MB (201326592)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=3):
- ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- Runtime filters: 2 of 2 Runtime Filters Published
- - BuildRowsPartitionTime: 300.013ms
- - BuildRowsPartitioned: 3.68M (3679360)
- - HashBuckets: 8.39M (8388608)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 268.012ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 22.12 KB (22656)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=5):(Total: 140.006ms, non-child: 64.002ms, % non-child: 45.71%)
- - ConvertRowBatchTime: 56.002ms
- - PeakMemoryUsage: 12.70 MB (13312082)
- - RowsReturned: 3.68M (3679360)
- - RowsReturnedRate: 26.28 M/sec
- Buffer pool:
- - AllocTime: 28.001ms
- - CumulativeAllocationBytes: 84.43 MB (88530944)
- - CumulativeAllocations: 7.22K (7218)
- - PeakReservation: 12.65 MB (13262848)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.65 MB (13262848)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(500.000ms): 0, 39.47 MB
- - FirstBatchWaitTime: 0.000ns
- - TotalBytesDequeued: 66.67 MB (69907840)
- - TotalGetBatchTime: 80.003ms
- - DataWaitTime: 76.003ms
- Enqueue:
- BytesReceived(500.000ms): 0, 19.76 MB
- DeferredQueueSize(500.000ms): 0, 0
- - DispatchTime: (Avg: 32.877us ; Min: 12.321us ; Max: 391.894us ; Number of samples: 3609)
- - DeserializeRowBatchTime: 116.005ms
- - TotalBatchesEnqueued: 3.61K (3609)
- - TotalBatchesReceived: 3.61K (3609)
- - TotalBytesReceived: 33.37 MB (34992608)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 40.559ms
- - TotalRPCsDeferred: 6 (6)
- HDFS_SCAN_NODE (id=2):(Total: 2s676ms, non-child: 2s676ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:63/3.83 GB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 63 out of 63
- Runtime filters: All filters arrived. Waited 0
- Hdfs Read Thread Concurrency Bucket: 0:35.71% 1:64.29% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/SNAPPY:63
- BytesRead(500.000ms): 0, 0, 0, 53.75 MB, 112.90 MB, 160.26 MB, 181.32 MB, 326.83 MB, 545.27 MB, 823.39 MB, 1.12 GB, 1.36 GB, 1.62 GB, 1.96 GB, 1.96 GB
- - FooterProcessingTime: (Avg: 822.386ms ; Min: 16.000ms ; Max: 1s400ms ; Number of samples: 63)
- - AverageHdfsReadThreadConcurrency: 0.64
- - AverageScannerThreadConcurrency: 32.43
- - BytesRead: 1.96 GB (2102302557)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 1.96 GB (2102302557)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 1.96 GB (2102302557)
- - CachedFileHandlesHitCount: 567 (567)
- - CachedFileHandlesMissCount: 63 (63)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 4s304ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 9 (9)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 1 (1)
- - NumRowGroups: 63 (63)
- - NumScannerThreadsStarted: 39 (39)
- - NumScannersWithNoReads: 0 (0)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 1.08 GB (1158857825)
- - PerReadThreadRawHdfsThroughput: 599.53 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 2s580ms
- - RowBatchQueuePutWaitTime: 28s837ms
- - RowsRead: 52.47M (52469198)
- - RowsReturned: 16.41M (16409133)
- - RowsReturnedRate: 6.13 M/sec
- - ScanRangesComplete: 63 (63)
- - ScannerThreadsInvoluntaryContextSwitches: 19 (19)
- - ScannerThreadsTotalWallClockTime: 3m38s
- - MaterializeTupleTime(*): 10s748ms
- - ScannerThreadsSysTime: 6s113ms
- - ScannerThreadsUserTime: 7s053ms
- - ScannerThreadsVoluntaryContextSwitches: 43.19K (43190)
- - TotalRawHdfsOpenFileTime(*): 1s016ms
- - TotalRawHdfsReadTime(*): 3s344ms
- - TotalReadThroughput: 267.32 MB/sec
- Filter 4 (2.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 4.08M (4077799)
- - Rows rejected: 290.60K (290603)
- - Rows total: 52.47M (52469198)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 5 (2.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 3.42M (3422275)
- - Rows rejected: 84.35K (84352)
- - Rows total: 52.18M (52178595)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 292.013ms, non-child: 292.013ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 80.003ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 113 (113)
- - NumInstructions: 3.40K (3401)
- - OptimizationTime: 192.008ms
- - PeakMemoryUsage: 1.66 MB (1741312)
- - PrepareTime: 20.000ms
- Instance 984ea1ea895ca2cf:a12d79aa00000012 (host=slave-cn07:22000):(Total: 7s268ms, non-child: 1s768ms, % non-child: 24.33%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:63/3.86 GB
- Filter 4 arrival: 746ms
- Filter 5 arrival: 746ms
- Fragment Instance Lifecycle Event Timeline: 7s268ms
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 1s384ms (1s380ms)
- - First Batch Produced: 1s404ms (20.000ms)
- - First Batch Sent: 1s404ms (0.000ns)
- - ExecInternal Finished: 7s268ms (5s864ms)
- MemoryUsage(500.000ms): 4.08 MB, 50.74 MB, 200.75 MB, 269.85 MB, 235.09 MB, 257.45 MB, 314.20 MB, 453.60 MB, 733.71 MB, 917.13 MB, 1.26 GB, 1.49 GB, 1.74 GB, 1.37 GB, 939.02 MB
- ThreadUsage(500.000ms): 1, 2, 2, 40, 40, 40, 40, 40, 40, 40, 40, 39, 34, 24, 15
- - AverageThreadTokens: 29.13
- - BloomFilterBytes: 4.00 MB (4194304)
- - PeakMemoryUsage: 1.78 GB (1913335173)
- - PeakReservation: 196.00 MB (205520896)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 2.05 GB (2206373452)
- - RowsProduced: 463.27K (463270)
- - TotalNetworkReceiveTime: 72.003ms
- - TotalNetworkSendTime: 8.000ms
- - TotalStorageWaitTime: 2m17s
- - TotalThreadsInvoluntaryContextSwitches: 22 (22)
- - TotalThreadsTotalWallClockTime: 3m45s
- - TotalThreadsSysTime: 8s456ms
- - TotalThreadsUserTime: 10s275ms
- - TotalThreadsVoluntaryContextSwitches: 47.56K (47561)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 4.00 MB (4194304)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 4.00 MB (4194304)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 4.00 MB (4194304)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 4.00 MB (4194304)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 5s884ms
- - ExecTreeExecTime: 3s852ms
- - OpenTime: 1s380ms
- - ExecTreeOpenTime: 1s060ms
- - PrepareTime: 4.000ms
- - ExecTreePrepareTime: 4.000ms
- KrpcDataStreamSender (dst_id=7):(Total: 264.012ms, non-child: 256.012ms, % non-child: 96.97%)
- BytesSent(500.000ms): 0, 0, 0, 224.22 KB, 840.91 KB, 1.27 MB, 1.78 MB, 3.96 MB, 6.61 MB, 10.20 MB, 13.52 MB, 16.82 MB, 20.10 MB, 23.46 MB, 26.96 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 26.06 MB/sec
- - PeakMemoryUsage: 189.00 KB (193536)
- - RowsSent: 463.27K (463270)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 104.004ms
- - TotalBytesSent: 28.49 MB (29875337)
- - UncompressedRowBatchSize: 39.32 MB (41231030)
- HASH_JOIN_NODE (id=3):(Total: 4s920ms, non-child: 2s480ms, % non-child: 50.41%)
- ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- - BuildRows: 3.68M (3679360)
- - BuildTime: 580.027ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 192.40 MB (201744640)
- - ProbeRows: 16.54M (16539200)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 1s864ms
- - RowsReturned: 463.27K (463270)
- - RowsReturnedRate: 94.16 K/sec
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 192.00 MB (201326592)
- - CumulativeAllocations: 48 (48)
- - PeakReservation: 192.00 MB (201326592)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 192.00 MB (201326592)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=3):
- ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- Runtime filters: 2 of 2 Runtime Filters Published
- - BuildRowsPartitionTime: 280.013ms
- - BuildRowsPartitioned: 3.68M (3679360)
- - HashBuckets: 8.39M (8388608)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 284.013ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 22.12 KB (22656)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=5):(Total: 128.006ms, non-child: 56.002ms, % non-child: 43.75%)
- - ConvertRowBatchTime: 52.002ms
- - PeakMemoryUsage: 12.70 MB (13321951)
- - RowsReturned: 3.68M (3679360)
- - RowsReturnedRate: 28.74 M/sec
- Buffer pool:
- - AllocTime: 16.000ms
- - CumulativeAllocationBytes: 84.43 MB (88530944)
- - CumulativeAllocations: 7.22K (7218)
- - PeakReservation: 12.65 MB (13262848)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.65 MB (13262848)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(500.000ms): 0, 34.85 MB, 66.67 MB
- - FirstBatchWaitTime: 0.000ns
- - TotalBytesDequeued: 66.67 MB (69907840)
- - TotalGetBatchTime: 72.003ms
- - DataWaitTime: 72.003ms
- Enqueue:
- BytesReceived(500.000ms): 0, 18.50 MB, 33.37 MB
- DeferredQueueSize(500.000ms): 0, 0, 0
- - DispatchTime: (Avg: 31.752us ; Min: 12.211us ; Max: 416.150us ; Number of samples: 3609)
- - DeserializeRowBatchTime: 72.003ms
- - TotalBatchesEnqueued: 3.61K (3609)
- - TotalBatchesReceived: 3.61K (3609)
- - TotalBytesReceived: 33.37 MB (34992608)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 64.954ms
- - TotalRPCsDeferred: 8 (8)
- HDFS_SCAN_NODE (id=2):(Total: 2s312ms, non-child: 2s312ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:63/3.86 GB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 63 out of 63
- Runtime filters: All filters arrived. Waited 0
- Hdfs Read Thread Concurrency Bucket: 0:35.71% 1:64.29% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/SNAPPY:63
- BytesRead(500.000ms): 0, 0, 0, 46.99 MB, 93.99 MB, 144.18 MB, 210.49 MB, 468.38 MB, 767.31 MB, 1.02 GB, 1.36 GB, 1.60 GB, 1.92 GB, 1.97 GB, 1.97 GB
- - FooterProcessingTime: (Avg: 697.493ms ; Min: 20.000ms ; Max: 1s312ms ; Number of samples: 63)
- - AverageHdfsReadThreadConcurrency: 0.64
- - AverageScannerThreadConcurrency: 30.00
- - BytesRead: 1.97 GB (2119572213)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 1.97 GB (2119572213)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 1.97 GB (2119572213)
- - CachedFileHandlesHitCount: 567 (567)
- - CachedFileHandlesMissCount: 63 (63)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 4s540ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 9 (9)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 1 (1)
- - NumRowGroups: 63 (63)
- - NumScannerThreadsStarted: 39 (39)
- - NumScannersWithNoReads: 0 (0)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 1.58 GB (1700076382)
- - PerReadThreadRawHdfsThroughput: 685.65 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 2s212ms
- - RowBatchQueuePutWaitTime: 46s406ms
- - RowsRead: 52.90M (52896164)
- - RowsReturned: 16.54M (16539200)
- - RowsReturnedRate: 7.15 M/sec
- - ScanRangesComplete: 63 (63)
- - ScannerThreadsInvoluntaryContextSwitches: 17 (17)
- - ScannerThreadsTotalWallClockTime: 3m37s
- - MaterializeTupleTime(*): 11s872ms
- - ScannerThreadsSysTime: 6s653ms
- - ScannerThreadsUserTime: 7s302ms
- - ScannerThreadsVoluntaryContextSwitches: 45.14K (45137)
- - TotalRawHdfsOpenFileTime(*): 1s168ms
- - TotalRawHdfsReadTime(*): 2s948ms
- - TotalReadThroughput: 269.52 MB/sec
- Filter 4 (2.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 4.14M (4139158)
- - Rows rejected: 290.00K (290000)
- - Rows total: 52.90M (52896164)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 5 (2.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 3.43M (3427940)
- - Rows rejected: 84.82K (84817)
- - Rows total: 52.61M (52606164)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 316.015ms, non-child: 316.015ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 76.003ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 113 (113)
- - NumInstructions: 3.40K (3401)
- - OptimizationTime: 216.010ms
- - PeakMemoryUsage: 1.66 MB (1741312)
- - PrepareTime: 24.001ms
- Instance 984ea1ea895ca2cf:a12d79aa0000000e (host=slave-cn05:22000):(Total: 6s996ms, non-child: 1s656ms, % non-child: 23.67%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:61/3.77 GB
- Filter 4 arrival: 746ms
- Filter 5 arrival: 745ms
- Fragment Instance Lifecycle Event Timeline: 6s996ms
- - Prepare Finished: 0.000ns (0.000ns)
- - Open Finished: 1s312ms (1s312ms)
- - First Batch Produced: 1s332ms (20.001ms)
- - First Batch Sent: 1s332ms (0.000ns)
- - ExecInternal Finished: 6s996ms (5s664ms)
- MemoryUsage(500.000ms): 5.74 MB, 50.74 MB, 212.47 MB, 268.04 MB, 245.10 MB, 258.02 MB, 414.93 MB, 574.60 MB, 897.32 MB, 1.08 GB, 1.30 GB, 1.64 GB, 1.60 GB, 1.09 GB
- ThreadUsage(500.000ms): 1, 2, 40, 40, 40, 40, 40, 40, 40, 40, 38, 33, 29, 19
- - AverageThreadTokens: 31.57
- - BloomFilterBytes: 4.00 MB (4194304)
- - PeakMemoryUsage: 1.75 GB (1875612084)
- - PeakReservation: 196.00 MB (205520896)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 2.03 GB (2177414655)
- - RowsProduced: 452.59K (452592)
- - TotalNetworkReceiveTime: 84.004ms
- - TotalNetworkSendTime: 4.000ms
- - TotalStorageWaitTime: 2m13s
- - TotalThreadsInvoluntaryContextSwitches: 24 (24)
- - TotalThreadsTotalWallClockTime: 3m35s
- - TotalThreadsSysTime: 7s818ms
- - TotalThreadsUserTime: 9s946ms
- - TotalThreadsVoluntaryContextSwitches: 44.07K (44071)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 4.00 MB (4194304)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 4.00 MB (4194304)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 4.00 MB (4194304)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 4.00 MB (4194304)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 5s684ms
- - ExecTreeExecTime: 3s780ms
- - OpenTime: 1s312ms
- - ExecTreeOpenTime: 1s012ms
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=7):(Total: 248.013ms, non-child: 244.013ms, % non-child: 98.39%)
- BytesSent(500.000ms): 0, 0, 0, 518.95 KB, 1.26 MB, 1.78 MB, 2.40 MB, 4.71 MB, 8.43 MB, 11.88 MB, 15.28 MB, 18.59 MB, 22.05 MB, 25.46 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 26.97 MB/sec
- - PeakMemoryUsage: 189.00 KB (193536)
- - RowsSent: 452.59K (452592)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 100.005ms
- - TotalBytesSent: 27.84 MB (29193235)
- - UncompressedRowBatchSize: 38.41 MB (40280688)
- HASH_JOIN_NODE (id=3):(Total: 4s792ms, non-child: 2s348ms, % non-child: 49.00%)
- ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- - BuildRows: 3.68M (3679360)
- - BuildTime: 572.031ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 192.40 MB (201744640)
- - ProbeRows: 16.17M (16172193)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 1s748ms
- - RowsReturned: 452.59K (452592)
- - RowsReturnedRate: 94.44 K/sec
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 192.00 MB (201326592)
- - CumulativeAllocations: 48 (48)
- - PeakReservation: 192.00 MB (201326592)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 192.00 MB (201326592)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=3):
- ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- Runtime filters: 2 of 2 Runtime Filters Published
- - BuildRowsPartitionTime: 304.016ms
- - BuildRowsPartitioned: 3.68M (3679360)
- - HashBuckets: 8.39M (8388608)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 264.014ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 22.12 KB (22656)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=5):(Total: 132.007ms, non-child: 52.002ms, % non-child: 39.39%)
- - ConvertRowBatchTime: 40.002ms
- - PeakMemoryUsage: 12.70 MB (13321815)
- - RowsReturned: 3.68M (3679360)
- - RowsReturnedRate: 27.87 M/sec
- Buffer pool:
- - AllocTime: 8.000ms
- - CumulativeAllocationBytes: 84.43 MB (88530944)
- - CumulativeAllocations: 7.22K (7218)
- - PeakReservation: 12.65 MB (13262848)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.65 MB (13262848)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(500.000ms): 0, 55.11 MB
- - FirstBatchWaitTime: 0.000ns
- - TotalBytesDequeued: 66.67 MB (69907840)
- - TotalGetBatchTime: 84.004ms
- - DataWaitTime: 80.004ms
- Enqueue:
- BytesReceived(500.000ms): 0, 27.59 MB
- DeferredQueueSize(500.000ms): 0, 0
- - DispatchTime: (Avg: 32.022us ; Min: 11.869us ; Max: 437.340us ; Number of samples: 3609)
- - DeserializeRowBatchTime: 104.005ms
- - TotalBatchesEnqueued: 3.61K (3609)
- - TotalBatchesReceived: 3.61K (3609)
- - TotalBytesReceived: 33.37 MB (34992608)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 41.020ms
- - TotalRPCsDeferred: 7 (7)
- HDFS_SCAN_NODE (id=2):(Total: 2s312ms, non-child: 2s312ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:61/3.77 GB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 61 out of 61
- Runtime filters: All filters arrived. Waited 0
- Hdfs Read Thread Concurrency Bucket: 0:30.77% 1:69.23% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/SNAPPY:61
- BytesRead(500.000ms): 0, 0, 7.18 MB, 79.73 MB, 134.03 MB, 181.13 MB, 313.44 MB, 564.61 MB, 952.65 MB, 1.20 GB, 1.50 GB, 1.83 GB, 1.93 GB, 1.93 GB
- - FooterProcessingTime: (Avg: 711.580ms ; Min: 20.001ms ; Max: 1s244ms ; Number of samples: 61)
- - AverageHdfsReadThreadConcurrency: 0.69
- - AverageScannerThreadConcurrency: 32.85
- - BytesRead: 1.93 GB (2069686796)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 1.93 GB (2069686796)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 1.93 GB (2069686796)
- - CachedFileHandlesHitCount: 549 (549)
- - CachedFileHandlesMissCount: 61 (61)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 4s272ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 9 (9)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 1 (1)
- - NumRowGroups: 61 (61)
- - NumScannerThreadsStarted: 39 (39)
- - NumScannersWithNoReads: 0 (0)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 1.55 GB (1662031486)
- - PerReadThreadRawHdfsThroughput: 695.94 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 2s200ms
- - RowBatchQueuePutWaitTime: 44s902ms
- - RowsRead: 51.66M (51657599)
- - RowsReturned: 16.17M (16172193)
- - RowsReturnedRate: 6.99 M/sec
- - ScanRangesComplete: 61 (61)
- - ScannerThreadsInvoluntaryContextSwitches: 19 (19)
- - ScannerThreadsTotalWallClockTime: 3m27s
- - MaterializeTupleTime(*): 10s624ms
- - ScannerThreadsSysTime: 6s150ms
- - ScannerThreadsUserTime: 7s045ms
- - ScannerThreadsVoluntaryContextSwitches: 41.60K (41604)
- - TotalRawHdfsOpenFileTime(*): 972.053ms
- - TotalRawHdfsReadTime(*): 2s836ms
- - TotalReadThroughput: 281.97 MB/sec
- Filter 4 (2.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 3.67M (3670174)
- - Rows rejected: 255.62K (255616)
- - Rows total: 51.66M (51657599)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 5 (2.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 3.31M (3310270)
- - Rows rejected: 74.83K (74828)
- - Rows total: 51.40M (51401983)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 300.016ms, non-child: 300.016ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 84.004ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 113 (113)
- - NumInstructions: 3.40K (3401)
- - OptimizationTime: 192.010ms
- - PeakMemoryUsage: 1.66 MB (1741312)
- - PrepareTime: 24.001ms
- Instance 984ea1ea895ca2cf:a12d79aa00000011 (host=slave-cn02:22000):(Total: 6s068ms, non-child: 1s624ms, % non-child: 26.76%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:65/3.82 GB
- Filter 4 arrival: 747ms
- Filter 5 arrival: 747ms
- Fragment Instance Lifecycle Event Timeline: 6s068ms
- - Prepare Finished: 8.000ms (8.000ms)
- - Open Finished: 1s252ms (1s244ms)
- - First Batch Produced: 1s272ms (20.000ms)
- - First Batch Sent: 1s272ms (0.000ns)
- - ExecInternal Finished: 6s068ms (4s796ms)
- MemoryUsage(500.000ms): 6.47 MB, 80.74 MB, 221.64 MB, 288.91 MB, 298.29 MB, 680.39 MB, 1.16 GB, 1.62 GB, 1.60 GB, 1.52 GB, 1.43 GB, 988.81 MB
- ThreadUsage(500.000ms): 1, 2, 30, 30, 30, 30, 30, 30, 30, 30, 27, 16
- - AverageThreadTokens: 23.83
- - BloomFilterBytes: 4.00 MB (4194304)
- - PeakMemoryUsage: 1.63 GB (1750284142)
- - PeakReservation: 196.00 MB (205520896)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 1.90 GB (2039715865)
- - RowsProduced: 460.07K (460068)
- - TotalNetworkReceiveTime: 60.002ms
- - TotalNetworkSendTime: 4.000ms
- - TotalStorageWaitTime: 53s402ms
- - TotalThreadsInvoluntaryContextSwitches: 30 (30)
- - TotalThreadsTotalWallClockTime: 2m21s
- - TotalThreadsSysTime: 7s836ms
- - TotalThreadsUserTime: 10s535ms
- - TotalThreadsVoluntaryContextSwitches: 48.46K (48458)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 4.00 MB (4194304)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 4.00 MB (4194304)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 4.00 MB (4194304)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 4.00 MB (4194304)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 4s816ms
- - ExecTreeExecTime: 2s896ms
- - OpenTime: 1s244ms
- - ExecTreeOpenTime: 928.042ms
- - PrepareTime: 8.000ms
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=7):(Total: 308.014ms, non-child: 300.013ms, % non-child: 97.40%)
- BytesSent(500.000ms): 0, 0, 0, 1.15 MB, 1.78 MB, 4.87 MB, 8.44 MB, 11.90 MB, 15.45 MB, 18.79 MB, 22.14 MB, 25.55 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 26.20 MB/sec
- - PeakMemoryUsage: 189.00 KB (193536)
- - RowsSent: 460.07K (460068)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 152.007ms
- - TotalBytesSent: 28.32 MB (29697483)
- - UncompressedRowBatchSize: 39.05 MB (40946052)
- HASH_JOIN_NODE (id=3):(Total: 3s824ms, non-child: 2s460ms, % non-child: 64.33%)
- ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- - BuildRows: 3.68M (3679360)
- - BuildTime: 552.025ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 192.40 MB (201744640)
- - ProbeRows: 16.40M (16399094)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 1s868ms
- - RowsReturned: 460.07K (460068)
- - RowsReturnedRate: 120.31 K/sec
- Buffer pool:
- - AllocTime: 8.000ms
- - CumulativeAllocationBytes: 192.00 MB (201326592)
- - CumulativeAllocations: 48 (48)
- - PeakReservation: 192.00 MB (201326592)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 192.00 MB (201326592)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=3):
- ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- Runtime filters: 2 of 2 Runtime Filters Published
- - BuildRowsPartitionTime: 288.013ms
- - BuildRowsPartitioned: 3.68M (3679360)
- - HashBuckets: 8.39M (8388608)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 260.012ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 22.12 KB (22656)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=5):(Total: 124.005ms, non-child: 68.003ms, % non-child: 54.84%)
- - ConvertRowBatchTime: 56.002ms
- - PeakMemoryUsage: 12.70 MB (13321940)
- - RowsReturned: 3.68M (3679360)
- - RowsReturnedRate: 29.67 M/sec
- Buffer pool:
- - AllocTime: 16.000ms
- - CumulativeAllocationBytes: 84.43 MB (88530944)
- - CumulativeAllocations: 7.22K (7218)
- - PeakReservation: 12.65 MB (13262848)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.65 MB (13262848)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(500.000ms): 0, 61.77 MB
- - FirstBatchWaitTime: 0.000ns
- - TotalBytesDequeued: 66.67 MB (69907840)
- - TotalGetBatchTime: 60.002ms
- - DataWaitTime: 56.002ms
- Enqueue:
- BytesReceived(500.000ms): 294.55 KB, 30.93 MB
- DeferredQueueSize(500.000ms): 0, 0
- - DispatchTime: (Avg: 34.523us ; Min: 13.207us ; Max: 549.015us ; Number of samples: 3609)
- - DeserializeRowBatchTime: 100.004ms
- - TotalBatchesEnqueued: 3.61K (3609)
- - TotalBatchesReceived: 3.61K (3609)
- - TotalBytesReceived: 33.37 MB (34992608)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 60.267ms
- - TotalRPCsDeferred: 7 (7)
- HDFS_SCAN_NODE (id=2):(Total: 1s240ms, non-child: 1s240ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:65/3.82 GB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 65 out of 65
- Runtime filters: All filters arrived. Waited 0
- Hdfs Read Thread Concurrency Bucket: 0:63.64% 1:36.36% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/SNAPPY:65
- BytesRead(500.000ms): 0, 0, 21.02 MB, 126.76 MB, 209.66 MB, 589.03 MB, 1010.43 MB, 1.34 GB, 1.53 GB, 1.63 GB, 1.96 GB, 1.96 GB
- - FooterProcessingTime: (Avg: 261.612ms ; Min: 4.000ms ; Max: 724.033ms ; Number of samples: 65)
- - AverageHdfsReadThreadConcurrency: 0.36
- - AverageScannerThreadConcurrency: 24.82
- - BytesRead: 1.96 GB (2100229187)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 1.96 GB (2100229187)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 1.96 GB (2100229187)
- - CachedFileHandlesHitCount: 585 (585)
- - CachedFileHandlesMissCount: 65 (65)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 4s468ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 9 (9)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 1 (1)
- - NumRowGroups: 65 (65)
- - NumScannerThreadsStarted: 29 (29)
- - NumScannersWithNoReads: 0 (0)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 1.43 GB (1536668999)
- - PerReadThreadRawHdfsThroughput: 1.04 GB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 1s148ms
- - RowBatchQueuePutWaitTime: 57s950ms
- - RowsRead: 52.41M (52407500)
- - RowsReturned: 16.40M (16399094)
- - RowsReturnedRate: 13.22 M/sec
- - ScanRangesComplete: 65 (65)
- - ScannerThreadsInvoluntaryContextSwitches: 22 (22)
- - ScannerThreadsTotalWallClockTime: 2m14s
- - MaterializeTupleTime(*): 11s628ms
- - ScannerThreadsSysTime: 6s195ms
- - ScannerThreadsUserTime: 7s456ms
- - ScannerThreadsVoluntaryContextSwitches: 46.79K (46789)
- - TotalRawHdfsOpenFileTime(*): 1s052ms
- - TotalRawHdfsReadTime(*): 1s884ms
- - TotalReadThroughput: 333.82 MB/sec
- Filter 4 (2.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 4.00M (3998678)
- - Rows rejected: 281.64K (281638)
- - Rows total: 52.41M (52407500)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 5 (2.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 3.51M (3506416)
- - Rows rejected: 79.73K (79728)
- - Rows total: 52.13M (52125862)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 312.014ms, non-child: 312.014ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 80.003ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 113 (113)
- - NumInstructions: 3.40K (3401)
- - OptimizationTime: 208.009ms
- - PeakMemoryUsage: 1.66 MB (1741312)
- - PrepareTime: 24.001ms
- Averaged Fragment F02:(Total: 684.698ms, non-child: 4.000ms, % non-child: 0.58%)
- split sizes: min: 280.30 MB, max: 336.11 MB, avg: 291.17 MB, stddev: 20.12 MB
- completion times: min:636.029ms max:752.034ms mean: 688.698ms stddev:41.211ms
- execution rates: min:386.97 MB/sec max:446.93 MB/sec mean:423.12 MB/sec stddev:20.74 MB/sec
- num instances: 6
- - AverageThreadTokens: 5.17
- - BloomFilterBytes: 0
- - PeakMemoryUsage: 19.01 MB (19931573)
- - PeakReservation: 0
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 101.82 MB (106761037)
- - RowsProduced: 613.23K (613226)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 364.016ms
- - TotalStorageWaitTime: 629.363ms
- - TotalThreadsInvoluntaryContextSwitches: 1 (1)
- - TotalThreadsTotalWallClockTime: 3s736ms
- - TotalThreadsSysTime: 69.148ms
- - TotalThreadsUserTime: 741.474ms
- - TotalThreadsVoluntaryContextSwitches: 1.75K (1751)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 0
- - CumulativeAllocations: 0 (0)
- - PeakReservation: 0
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 0
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 0
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 624.029ms
- - ExecTreeExecTime: 156.673ms
- - OpenTime: 60.002ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 666.698us
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=5):(Total: 466.688ms, non-child: 466.688ms, % non-child: 100.00%)
- - EosSent: 6 (6)
- - NetworkThroughput: 19.76 MB/sec
- - PeakMemoryUsage: 69.80 KB (71472)
- - RowsSent: 613.23K (613226)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 47.335ms
- - TotalBytesSent: 33.37 MB (34992608)
- - UncompressedRowBatchSize: 66.67 MB (69907840)
- HDFS_SCAN_NODE (id=0):(Total: 156.673ms, non-child: 156.673ms, % non-child: 100.00%)
- - AverageHdfsReadThreadConcurrency: 0.17
- - AverageScannerThreadConcurrency: 5.08
- - BytesRead: 7.83 MB (8207803)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 7.83 MB (8207803)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 7.83 MB (8207803)
- - CachedFileHandlesHitCount: 21 (21)
- - CachedFileHandlesMissCount: 5 (5)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 28.667ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 4 (4)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 1 (1)
- - NumRowGroups: 5 (5)
- - NumScannerThreadsStarted: 5 (5)
- - NumScannersWithNoReads: 0 (0)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 18.91 MB (19823930)
- - PerReadThreadRawHdfsThroughput: 162.19 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 148.006ms
- - RowBatchQueuePutWaitTime: 1s612ms
- - RowsRead: 19.53M (19534749)
- - RowsReturned: 613.23K (613226)
- - RowsReturnedRate: 4.07 M/sec
- - ScanRangesComplete: 5 (5)
- - ScannerThreadsInvoluntaryContextSwitches: 1 (1)
- - ScannerThreadsTotalWallClockTime: 3s052ms
- - MaterializeTupleTime(*): 572.026ms
- - ScannerThreadsSysTime: 35.978ms
- - ScannerThreadsUserTime: 597.684ms
- - ScannerThreadsVoluntaryContextSwitches: 566 (566)
- - TotalRawHdfsOpenFileTime(*): 90.004ms
- - TotalRawHdfsReadTime(*): 66.003ms
- - TotalReadThroughput: 10.35 MB/sec
- CodeGen:(Total: 57.336ms, non-child: 57.336ms, % non-child: 100.00%)
- - CodegenTime: 666.697us
- - CompileTime: 10.000ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 35 (35)
- - NumInstructions: 576 (576)
- - OptimizationTime: 28.668ms
- - PeakMemoryUsage: 288.00 KB (294912)
- - PrepareTime: 18.000ms
- Fragment F02:
- Instance 984ea1ea895ca2cf:a12d79aa00000007 (host=slave-cn03:22000):(Total: 748.034ms, non-child: 4.000ms, % non-child: 0.53%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:6/336.11 MB
- Fragment Instance Lifecycle Event Timeline: 748.034ms
- - Prepare Finished: 0.000ns (0.000ns)
- - Open Finished: 56.002ms (56.002ms)
- - First Batch Produced: 216.009ms (160.007ms)
- - First Batch Sent: 216.009ms (0.000ns)
- - ExecInternal Finished: 748.034ms (532.024ms)
- MemoryUsage(500.000ms): 77.80 KB, 21.17 MB
- ThreadUsage(500.000ms): 1, 7
- - AverageThreadTokens: 4.00
- - BloomFilterBytes: 0
- - PeakMemoryUsage: 21.32 MB (22358299)
- - PeakReservation: 0
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 114.45 MB (120006599)
- - RowsProduced: 708.66K (708656)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 380.017ms
- - TotalStorageWaitTime: 808.036ms
- - TotalThreadsInvoluntaryContextSwitches: 2 (2)
- - TotalThreadsTotalWallClockTime: 4s608ms
- - TotalThreadsSysTime: 86.049ms
- - TotalThreadsUserTime: 843.688ms
- - TotalThreadsVoluntaryContextSwitches: 2.10K (2095)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 0
- - CumulativeAllocations: 0 (0)
- - PeakReservation: 0
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 0
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 0
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 692.031ms
- - ExecTreeExecTime: 180.008ms
- - OpenTime: 56.002ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=5):(Total: 512.023ms, non-child: 132.006ms, % non-child: 25.78%)
- BytesSent(500.000ms): 0, 18.78 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 19.83 MB/sec
- - PeakMemoryUsage: 69.80 KB (71472)
- - RowsSent: 708.66K (708656)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 60.002ms
- - TotalBytesSent: 38.57 MB (40440834)
- - UncompressedRowBatchSize: 77.04 MB (80786784)
- HDFS_SCAN_NODE (id=0):(Total: 180.008ms, non-child: 180.008ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:6/336.11 MB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6
- Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/SNAPPY:6
- BytesRead(500.000ms): 0, 9.03 MB
- - FooterProcessingTime: (Avg: 50.002ms ; Min: 24.001ms ; Max: 76.003ms ; Number of samples: 6)
- - AverageHdfsReadThreadConcurrency: 0.00
- - AverageScannerThreadConcurrency: 6.00
- - BytesRead: 9.03 MB (9468625)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 9.03 MB (9468625)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 9.03 MB (9468625)
- - CachedFileHandlesHitCount: 24 (24)
- - CachedFileHandlesMissCount: 6 (6)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 36.001ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 4 (4)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 1 (1)
- - NumRowGroups: 6 (6)
- - NumScannerThreadsStarted: 6 (6)
- - NumScannersWithNoReads: 0 (0)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 21.22 MB (22254410)
- - PerReadThreadRawHdfsThroughput: 94.06 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 176.008ms
- - RowBatchQueuePutWaitTime: 2s064ms
- - RowsRead: 22.54M (22540248)
- - RowsReturned: 708.66K (708656)
- - RowsReturnedRate: 3.94 M/sec
- - ScanRangesComplete: 6 (6)
- - ScannerThreadsInvoluntaryContextSwitches: 2 (2)
- - ScannerThreadsTotalWallClockTime: 3s860ms
- - MaterializeTupleTime(*): 664.030ms
- - ScannerThreadsSysTime: 39.517ms
- - ScannerThreadsUserTime: 695.624ms
- - ScannerThreadsVoluntaryContextSwitches: 657 (657)
- - TotalRawHdfsOpenFileTime(*): 92.004ms
- - TotalRawHdfsReadTime(*): 96.004ms
- - TotalReadThroughput: 9.03 MB/sec
- CodeGen:(Total: 52.002ms, non-child: 52.002ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 8.000ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 35 (35)
- - NumInstructions: 576 (576)
- - OptimizationTime: 28.001ms
- - PeakMemoryUsage: 288.00 KB (294912)
- - PrepareTime: 16.000ms
- Instance 984ea1ea895ca2cf:a12d79aa0000000b (host=slave-cn05:22000):(Total: 728.040ms, non-child: 4.000ms, % non-child: 0.55%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:6/283.28 MB
- Fragment Instance Lifecycle Event Timeline: 728.040ms
- - Prepare Finished: 0.000ns (0.000ns)
- - Open Finished: 76.004ms (76.004ms)
- - First Batch Produced: 252.013ms (176.009ms)
- - First Batch Sent: 252.013ms (0.000ns)
- - ExecInternal Finished: 728.040ms (476.026ms)
- MemoryUsage(500.000ms): 242.45 KB, 14.89 MB
- ThreadUsage(500.000ms): 7, 5
- - AverageThreadTokens: 6.00
- - BloomFilterBytes: 0
- - PeakMemoryUsage: 19.90 MB (20866455)
- - PeakReservation: 0
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 108.29 MB (113552096)
- - RowsProduced: 596.45K (596448)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 368.020ms
- - TotalStorageWaitTime: 928.051ms
- - TotalThreadsInvoluntaryContextSwitches: 2 (2)
- - TotalThreadsTotalWallClockTime: 4s172ms
- - TotalThreadsSysTime: 38.964ms
- - TotalThreadsUserTime: 764.391ms
- - TotalThreadsVoluntaryContextSwitches: 1.66K (1657)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 0
- - CumulativeAllocations: 0 (0)
- - PeakReservation: 0
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 0
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 0
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 652.035ms
- - ExecTreeExecTime: 188.010ms
- - OpenTime: 76.004ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=5):(Total: 464.025ms, non-child: 96.005ms, % non-child: 20.69%)
- BytesSent(500.000ms): 0, 22.49 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 20.06 MB/sec
- - PeakMemoryUsage: 69.80 KB (71472)
- - RowsSent: 596.45K (596448)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 48.002ms
- - TotalBytesSent: 32.46 MB (34037406)
- - UncompressedRowBatchSize: 64.85 MB (67995072)
- HDFS_SCAN_NODE (id=0):(Total: 188.010ms, non-child: 188.010ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:6/283.28 MB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6
- Hdfs Read Thread Concurrency Bucket: 0:50% 1:50% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/SNAPPY:6
- BytesRead(500.000ms): 200.00 KB, 7.68 MB
- - FooterProcessingTime: (Avg: 62.670ms ; Min: 16.000ms ; Max: 112.006ms ; Number of samples: 6)
- - AverageHdfsReadThreadConcurrency: 0.50
- - AverageScannerThreadConcurrency: 5.00
- - BytesRead: 7.68 MB (8057057)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 7.68 MB (8057057)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 7.68 MB (8057057)
- - CachedFileHandlesHitCount: 24 (24)
- - CachedFileHandlesMissCount: 6 (6)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 20.001ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 4 (4)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 1 (1)
- - NumRowGroups: 6 (6)
- - NumScannerThreadsStarted: 6 (6)
- - NumScannersWithNoReads: 0 (0)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 19.79 MB (20751302)
- - PerReadThreadRawHdfsThroughput: 71.14 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 176.009ms
- - RowBatchQueuePutWaitTime: 1s716ms
- - RowsRead: 19.01M (19006419)
- - RowsReturned: 596.45K (596448)
- - RowsReturnedRate: 3.17 M/sec
- - ScanRangesComplete: 6 (6)
- - ScannerThreadsInvoluntaryContextSwitches: 1 (1)
- - ScannerThreadsTotalWallClockTime: 3s444ms
- - MaterializeTupleTime(*): 600.032ms
- - ScannerThreadsSysTime: 12.580ms
- - ScannerThreadsUserTime: 607.832ms
- - ScannerThreadsVoluntaryContextSwitches: 577 (577)
- - TotalRawHdfsOpenFileTime(*): 80.004ms
- - TotalRawHdfsReadTime(*): 108.005ms
- - TotalReadThroughput: 7.68 MB/sec
- CodeGen:(Total: 72.003ms, non-child: 72.003ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 12.000ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 35 (35)
- - NumInstructions: 576 (576)
- - OptimizationTime: 36.001ms
- - PeakMemoryUsage: 288.00 KB (294912)
- - PrepareTime: 24.001ms
- Instance 984ea1ea895ca2cf:a12d79aa00000008 (host=slave-cn04:22000):(Total: 680.035ms, non-child: 8.000ms, % non-child: 1.18%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/282.48 MB
- Fragment Instance Lifecycle Event Timeline: 684.036ms
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 56.002ms (52.002ms)
- - First Batch Produced: 200.010ms (144.007ms)
- - First Batch Sent: 200.010ms (0.000ns)
- - ExecInternal Finished: 684.036ms (484.025ms)
- MemoryUsage(500.000ms): 218.45 KB, 14.65 MB
- ThreadUsage(500.000ms): 6, 5
- - AverageThreadTokens: 5.50
- - BloomFilterBytes: 0
- - PeakMemoryUsage: 18.20 MB (19080663)
- - PeakReservation: 0
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 94.96 MB (99576259)
- - RowsProduced: 594.77K (594767)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 328.017ms
- - TotalStorageWaitTime: 628.033ms
- - TotalThreadsInvoluntaryContextSwitches: 0 (0)
- - TotalThreadsTotalWallClockTime: 3s508ms
- - TotalThreadsSysTime: 87.360ms
- - TotalThreadsUserTime: 717.139ms
- - TotalThreadsVoluntaryContextSwitches: 1.68K (1682)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 0
- - CumulativeAllocations: 0 (0)
- - PeakReservation: 0
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 0
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 0
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 628.033ms
- - ExecTreeExecTime: 172.009ms
- - OpenTime: 52.002ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=5):(Total: 448.023ms, non-child: 120.006ms, % non-child: 26.79%)
- BytesSent(500.000ms): 0, 23.27 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 19.19 MB/sec
- - PeakMemoryUsage: 69.80 KB (71472)
- - RowsSent: 594.77K (594767)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 64.003ms
- - TotalBytesSent: 32.36 MB (33936552)
- - UncompressedRowBatchSize: 64.66 MB (67803438)
- HDFS_SCAN_NODE (id=0):(Total: 172.009ms, non-child: 172.009ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/282.48 MB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5
- Hdfs Read Thread Concurrency Bucket: 0:50% 1:50% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/SNAPPY:5
- BytesRead(500.000ms): 0, 7.59 MB
- - FooterProcessingTime: (Avg: 43.202ms ; Min: 20.001ms ; Max: 64.003ms ; Number of samples: 5)
- - AverageHdfsReadThreadConcurrency: 0.50
- - AverageScannerThreadConcurrency: 4.50
- - BytesRead: 7.59 MB (7954132)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 7.59 MB (7954132)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 7.59 MB (7954132)
- - CachedFileHandlesHitCount: 20 (20)
- - CachedFileHandlesMissCount: 5 (5)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 28.001ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 4 (4)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 1 (1)
- - NumRowGroups: 5 (5)
- - NumScannerThreadsStarted: 5 (5)
- - NumScannersWithNoReads: 0 (0)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 18.10 MB (18976774)
- - PerReadThreadRawHdfsThroughput: 94.82 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 156.008ms
- - RowBatchQueuePutWaitTime: 1s324ms
- - RowsRead: 18.96M (18955820)
- - RowsReturned: 594.77K (594767)
- - RowsReturnedRate: 3.46 M/sec
- - ScanRangesComplete: 5 (5)
- - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
- - ScannerThreadsTotalWallClockTime: 2s828ms
- - MaterializeTupleTime(*): 608.032ms
- - ScannerThreadsSysTime: 34.249ms
- - ScannerThreadsUserTime: 597.564ms
- - ScannerThreadsVoluntaryContextSwitches: 530 (530)
- - TotalRawHdfsOpenFileTime(*): 96.005ms
- - TotalRawHdfsReadTime(*): 80.004ms
- - TotalReadThroughput: 7.59 MB/sec
- CodeGen:(Total: 52.002ms, non-child: 52.002ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 8.000ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 35 (35)
- - NumInstructions: 576 (576)
- - OptimizationTime: 24.001ms
- - PeakMemoryUsage: 288.00 KB (294912)
- - PrepareTime: 20.001ms
- Instance 984ea1ea895ca2cf:a12d79aa0000000a (host=slave-cn06:22000):(Total: 672.021ms, non-child: 0.000ns, % non-child: 0.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/281.39 MB
- Fragment Instance Lifecycle Event Timeline: 676.022ms
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 60.001ms (56.001ms)
- - First Batch Produced: 212.006ms (152.004ms)
- - First Batch Sent: 212.006ms (0.000ns)
- - ExecInternal Finished: 676.022ms (464.015ms)
- MemoryUsage(500.000ms): 16.49 MB
- ThreadUsage(500.000ms): 6
- - AverageThreadTokens: 6.00
- - BloomFilterBytes: 0
- - PeakMemoryUsage: 18.21 MB (19094463)
- - PeakReservation: 0
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 104.65 MB (109730847)
- - RowsProduced: 592.59K (592589)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 356.011ms
- - TotalStorageWaitTime: 620.020ms
- - TotalThreadsInvoluntaryContextSwitches: 2 (2)
- - TotalThreadsTotalWallClockTime: 3s532ms
- - TotalThreadsSysTime: 45.429ms
- - TotalThreadsUserTime: 702.740ms
- - TotalThreadsVoluntaryContextSwitches: 1.72K (1719)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 0
- - CumulativeAllocations: 0 (0)
- - PeakReservation: 0
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 0
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 0
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 616.020ms
- - ExecTreeExecTime: 168.005ms
- - OpenTime: 56.001ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=5):(Total: 448.014ms, non-child: 92.003ms, % non-child: 20.54%)
- BytesSent(500.000ms): 1.17 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 20.07 MB/sec
- - PeakMemoryUsage: 69.80 KB (71472)
- - RowsSent: 592.59K (592589)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 36.001ms
- - TotalBytesSent: 32.25 MB (33815136)
- - UncompressedRowBatchSize: 64.43 MB (67555146)
- HDFS_SCAN_NODE (id=0):(Total: 168.005ms, non-child: 168.005ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/281.39 MB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5
- Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/SNAPPY:5
- BytesRead(500.000ms): 7.55 MB
- - FooterProcessingTime: (Avg: 45.601ms ; Min: 32.001ms ; Max: 60.001ms ; Number of samples: 5)
- - AverageHdfsReadThreadConcurrency: 0.00
- - AverageScannerThreadConcurrency: 5.00
- - BytesRead: 7.55 MB (7917702)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 7.55 MB (7917702)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 7.55 MB (7917702)
- - CachedFileHandlesHitCount: 20 (20)
- - CachedFileHandlesMissCount: 5 (5)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 32.001ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 4 (4)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 1 (1)
- - NumRowGroups: 5 (5)
- - NumScannerThreadsStarted: 5 (5)
- - NumScannersWithNoReads: 0 (0)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 18.10 MB (18979310)
- - PerReadThreadRawHdfsThroughput: 145.21 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 160.005ms
- - RowBatchQueuePutWaitTime: 1s540ms
- - RowsRead: 18.88M (18877926)
- - RowsReturned: 592.59K (592589)
- - RowsReturnedRate: 3.53 M/sec
- - ScanRangesComplete: 5 (5)
- - ScannerThreadsInvoluntaryContextSwitches: 1 (1)
- - ScannerThreadsTotalWallClockTime: 2s860ms
- - MaterializeTupleTime(*): 464.015ms
- - ScannerThreadsSysTime: 42.011ms
- - ScannerThreadsUserTime: 541.162ms
- - ScannerThreadsVoluntaryContextSwitches: 548 (548)
- - TotalRawHdfsOpenFileTime(*): 108.003ms
- - TotalRawHdfsReadTime(*): 52.001ms
- - TotalReadThroughput: 15.10 MB/sec
- CodeGen:(Total: 56.001ms, non-child: 56.001ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 8.000ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 35 (35)
- - NumInstructions: 576 (576)
- - OptimizationTime: 28.000ms
- - PeakMemoryUsage: 288.00 KB (294912)
- - PrepareTime: 16.000ms
- Instance 984ea1ea895ca2cf:a12d79aa0000000c (host=slave-cn07:22000):(Total: 648.030ms, non-child: 4.000ms, % non-child: 0.62%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/280.30 MB
- Fragment Instance Lifecycle Event Timeline: 648.030ms
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 68.003ms (64.003ms)
- - First Batch Produced: 184.008ms (116.005ms)
- - First Batch Sent: 184.008ms (0.000ns)
- - ExecInternal Finished: 648.030ms (464.022ms)
- MemoryUsage(500.000ms): 77.80 KB, 17.91 MB
- ThreadUsage(500.000ms): 1, 6
- - AverageThreadTokens: 3.50
- - BloomFilterBytes: 0
- - PeakMemoryUsage: 18.15 MB (19030231)
- - PeakReservation: 0
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 95.07 MB (99692963)
- - RowsProduced: 589.53K (589528)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 380.018ms
- - TotalStorageWaitTime: 468.022ms
- - TotalThreadsInvoluntaryContextSwitches: 2 (2)
- - TotalThreadsTotalWallClockTime: 3s328ms
- - TotalThreadsSysTime: 86.092ms
- - TotalThreadsUserTime: 694.188ms
- - TotalThreadsVoluntaryContextSwitches: 1.66K (1663)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 0
- - CumulativeAllocations: 0 (0)
- - PeakReservation: 0
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 0
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 0
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 580.027ms
- - ExecTreeExecTime: 128.006ms
- - OpenTime: 64.003ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 4.000ms
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=5):(Total: 456.021ms, non-child: 76.003ms, % non-child: 16.67%)
- BytesSent(500.000ms): 0, 20.31 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 20.26 MB/sec
- - PeakMemoryUsage: 69.80 KB (71472)
- - RowsSent: 589.53K (589528)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 28.001ms
- - TotalBytesSent: 32.08 MB (33638886)
- - UncompressedRowBatchSize: 64.09 MB (67206192)
- HDFS_SCAN_NODE (id=0):(Total: 128.006ms, non-child: 128.006ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/280.30 MB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5
- Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/SNAPPY:5
- BytesRead(500.000ms): 0, 7.51 MB
- - FooterProcessingTime: (Avg: 38.401ms ; Min: 24.001ms ; Max: 52.002ms ; Number of samples: 5)
- - AverageHdfsReadThreadConcurrency: 0.00
- - AverageScannerThreadConcurrency: 5.00
- - BytesRead: 7.51 MB (7876850)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 7.51 MB (7876850)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 7.51 MB (7876850)
- - CachedFileHandlesHitCount: 20 (20)
- - CachedFileHandlesMissCount: 5 (5)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 36.001ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 4 (4)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 1 (1)
- - NumRowGroups: 5 (5)
- - NumScannerThreadsStarted: 5 (5)
- - NumScannersWithNoReads: 0 (0)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 18.05 MB (18926342)
- - PerReadThreadRawHdfsThroughput: 187.79 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 124.005ms
- - RowBatchQueuePutWaitTime: 1s468ms
- - RowsRead: 18.81M (18813780)
- - RowsReturned: 589.53K (589528)
- - RowsReturnedRate: 4.61 M/sec
- - ScanRangesComplete: 5 (5)
- - ScannerThreadsInvoluntaryContextSwitches: 2 (2)
- - ScannerThreadsTotalWallClockTime: 2s684ms
- - MaterializeTupleTime(*): 536.025ms
- - ScannerThreadsSysTime: 37.708ms
- - ScannerThreadsUserTime: 564.146ms
- - ScannerThreadsVoluntaryContextSwitches: 543 (543)
- - TotalRawHdfsOpenFileTime(*): 88.004ms
- - TotalRawHdfsReadTime(*): 40.001ms
- - TotalReadThroughput: 7.51 MB/sec
- CodeGen:(Total: 60.002ms, non-child: 60.002ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 12.000ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 35 (35)
- - NumInstructions: 576 (576)
- - OptimizationTime: 32.001ms
- - PeakMemoryUsage: 288.00 KB (294912)
- - PrepareTime: 16.000ms
- Instance 984ea1ea895ca2cf:a12d79aa00000009 (host=slave-cn02:22000):(Total: 632.029ms, non-child: 4.000ms, % non-child: 0.63%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/283.50 MB
- Fragment Instance Lifecycle Event Timeline: 636.029ms
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 60.002ms (56.002ms)
- - First Batch Produced: 152.007ms (92.004ms)
- - First Batch Sent: 152.007ms (0.000ns)
- - ExecInternal Finished: 636.029ms (484.022ms)
- MemoryUsage(500.000ms): 17.34 MB
- ThreadUsage(500.000ms): 6
- - AverageThreadTokens: 6.00
- - BloomFilterBytes: 0
- - PeakMemoryUsage: 18.27 MB (19159331)
- - PeakReservation: 0
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 93.47 MB (98007459)
- - RowsProduced: 597.37K (597372)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 372.017ms
- - TotalStorageWaitTime: 324.014ms
- - TotalThreadsInvoluntaryContextSwitches: 1 (1)
- - TotalThreadsTotalWallClockTime: 3s268ms
- - TotalThreadsSysTime: 70.994ms
- - TotalThreadsUserTime: 726.701ms
- - TotalThreadsVoluntaryContextSwitches: 1.69K (1694)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 0
- - CumulativeAllocations: 0 (0)
- - PeakReservation: 0
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 0
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 0
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 576.026ms
- - ExecTreeExecTime: 104.004ms
- - OpenTime: 56.002ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=5):(Total: 472.021ms, non-child: 100.004ms, % non-child: 21.19%)
- BytesSent(500.000ms): 1.74 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 19.17 MB/sec
- - PeakMemoryUsage: 69.80 KB (71472)
- - RowsSent: 597.37K (597372)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 48.002ms
- - TotalBytesSent: 32.51 MB (34086834)
- - UncompressedRowBatchSize: 64.95 MB (68100408)
- HDFS_SCAN_NODE (id=0):(Total: 104.004ms, non-child: 104.004ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/283.50 MB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5
- Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/SNAPPY:5
- BytesRead(500.000ms): 7.60 MB
- - FooterProcessingTime: (Avg: 31.201ms ; Min: 24.001ms ; Max: 48.002ms ; Number of samples: 5)
- - AverageHdfsReadThreadConcurrency: 0.00
- - AverageScannerThreadConcurrency: 5.00
- - BytesRead: 7.60 MB (7972456)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 7.60 MB (7972456)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 7.60 MB (7972456)
- - CachedFileHandlesHitCount: 20 (20)
- - CachedFileHandlesMissCount: 5 (5)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 20.000ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 4 (4)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 1 (1)
- - NumRowGroups: 5 (5)
- - NumScannerThreadsStarted: 5 (5)
- - NumScannersWithNoReads: 0 (0)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 18.17 MB (19055442)
- - PerReadThreadRawHdfsThroughput: 380.14 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 96.004ms
- - RowBatchQueuePutWaitTime: 1s564ms
- - RowsRead: 19.01M (19014303)
- - RowsReturned: 597.37K (597372)
- - RowsReturnedRate: 5.74 M/sec
- - ScanRangesComplete: 5 (5)
- - ScannerThreadsInvoluntaryContextSwitches: 1 (1)
- - ScannerThreadsTotalWallClockTime: 2s636ms
- - MaterializeTupleTime(*): 560.025ms
- - ScannerThreadsSysTime: 49.804ms
- - ScannerThreadsUserTime: 579.777ms
- - ScannerThreadsVoluntaryContextSwitches: 541 (541)
- - TotalRawHdfsOpenFileTime(*): 76.003ms
- - TotalRawHdfsReadTime(*): 20.000ms
- - TotalReadThroughput: 15.21 MB/sec
- CodeGen:(Total: 52.002ms, non-child: 52.002ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 12.000ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 35 (35)
- - NumInstructions: 576 (576)
- - OptimizationTime: 24.001ms
- - PeakMemoryUsage: 288.00 KB (294912)
- - PrepareTime: 16.000ms
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement