Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- Query (id=33406f6405038287:b47e1f8b00000000):
- Summary:
- Session ID: f94bdb457cbb38dc:b43c73a94e16a89
- Session Type: HIVESERVER2
- HiveServer2 Protocol Version: V6
- Start Time: 2018-08-15 10:45:21.166118000
- End Time:
- Query Type: QUERY
- Query State: EXCEPTION
- Query Status: Query 33406f6405038287:b47e1f8b00000000 expired due to client inactivity (timeout is 10m)
- Impala Version: impalad version 2.12.0-cdh5.15.0 RELEASE (build 23f574543323301846b41fa5433690df32efe085)
- User: admin
- Connected User: admin
- Delegated User:
- Network Address: 10.0.9.2:46166
- Default Db: default
- Sql Statement: SELECT pp.event_id, ts.x, ts.y, ts.z, ts.tx, ts.ty, ts.qOverP, ts.covariance, pp.`track_track_id` AS track_id FROM protoparticles_32 AS pp, track_32 AS tr, track_state_32 AS ts WHERE pp.track_track_id IS NOT NULL AND tr.type = 3 AND pp.hasMuonPIDStatus = true AND pp.muonPID_IsMuon = true AND (tr.CloneDist IS NULL OR tr.CloneDist > 5000) AND ABS(ts.qOverP) > 1e-20 AND tr.chi2PerDoF * tr.nDoF > 0.0 AND pp.event_id = tr.event_id AND pp.track_track_id = tr.track_id AND ts.event_id = pp.event_id AND ts.track_id = pp.track_track_id AND ts.`location` = 1
- Coordinator: slave-cn02:22000
- Query Options (set by configuration): QUERY_TIMEOUT_S=600,IDLE_SESSION_TIMEOUT=1800
- Query Options (set by configuration and planner): QUERY_TIMEOUT_S=600,MT_DOP=0,IDLE_SESSION_TIMEOUT=1800
- Plan:
- ----------------
- Max Per-Host Resource Reservation: Memory=63.00MB
- Per-Host Resource Estimates: Memory=1.88GB
- F04:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
- | Per-Host Resources: mem-estimate=0B mem-reservation=0B
- PLAN-ROOT SINK
- | mem-estimate=0B mem-reservation=0B
- |
- 08:EXCHANGE [UNPARTITIONED]
- | mem-estimate=0B mem-reservation=0B
- | tuple-ids=1,2,0 row-size=106B cardinality=38142
- |
- F03:PLAN FRAGMENT [HASH(tr.event_id,tr.track_id)] hosts=6 instances=6
- Per-Host Resources: mem-estimate=19.00MB mem-reservation=19.00MB runtime-filters-memory=2.00MB
- 04:HASH JOIN [INNER JOIN, PARTITIONED]
- | hash predicates: tr.event_id = pp.event_id, tr.track_id = pp.track_track_id
- | fk/pk conjuncts: tr.event_id = pp.event_id, tr.track_id = pp.track_track_id
- | runtime filters: RF000[bloom] <- pp.event_id, RF001[bloom] <- pp.track_track_id
- | mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB
- | tuple-ids=1,2,0 row-size=106B cardinality=38142
- |
- |--07:EXCHANGE [HASH(pp.event_id,pp.track_track_id)]
- | | mem-estimate=0B mem-reservation=0B
- | | tuple-ids=2,0 row-size=74B cardinality=934260
- | |
- | F01:PLAN FRAGMENT [RANDOM] hosts=6 instances=6
- | Per-Host Resources: mem-estimate=1.00GB mem-reservation=42.00MB runtime-filters-memory=8.00MB
- | 03:HASH JOIN [INNER JOIN, BROADCAST]
- | | hash predicates: ts.event_id = pp.event_id, ts.track_id = pp.track_track_id
- | | fk/pk conjuncts: ts.event_id = pp.event_id, ts.track_id = pp.track_track_id
- | | runtime filters: RF004[bloom] <- pp.event_id, RF005[bloom] <- pp.track_track_id
- | | mem-estimate=138.01MB mem-reservation=34.00MB spill-buffer=2.00MB
- | | tuple-ids=2,0 row-size=74B cardinality=934260
- | |
- | |--05:EXCHANGE [BROADCAST]
- | | | mem-estimate=0B mem-reservation=0B
- | | | tuple-ids=0 row-size=10B cardinality=13156209
- | | |
- | | F02:PLAN FRAGMENT [RANDOM] hosts=6 instances=6
- | | Per-Host Resources: mem-estimate=352.00MB mem-reservation=0B
- | | 00:SCAN HDFS [default.protoparticles_32 pp, RANDOM]
- | | partitions=1/1 files=9 size=3.86GB
- | | predicates: pp.track_track_id IS NOT NULL, pp.hasMuonPIDStatus = TRUE, pp.muonPID_IsMuon = TRUE
- | | stored statistics:
- | | table: rows=234416992 size=3.86GB
- | | columns: all
- | | extrapolated-rows=disabled
- | | parquet statistics predicates: pp.hasMuonPIDStatus = TRUE, pp.muonPID_IsMuon = TRUE
- | | parquet dictionary predicates: pp.track_track_id IS NOT NULL, pp.hasMuonPIDStatus = TRUE, pp.muonPID_IsMuon = TRUE
- | | mem-estimate=352.00MB mem-reservation=0B
- | | tuple-ids=0 row-size=10B cardinality=13156209
- | |
- | 02:SCAN HDFS [default.track_state_32 ts, RANDOM]
- | partitions=1/1 files=119 size=50.43GB
- | predicates: ts.`location` = 1, ts.track_id IS NOT NULL, abs(ts.qOverP) > 1E-20
- | runtime filters: RF004[bloom] -> ts.event_id, RF005[bloom] -> ts.track_id
- | stored statistics:
- | table: rows=629478272 size=50.43GB
- | columns: all
- | extrapolated-rows=disabled
- | parquet statistics predicates: ts.`location` = 1
- | parquet dictionary predicates: ts.`location` = 1, ts.track_id IS NOT NULL, abs(ts.qOverP) > 1E-20
- | mem-estimate=880.00MB mem-reservation=0B
- | tuple-ids=2 row-size=64B cardinality=31473914
- |
- 06:EXCHANGE [HASH(tr.event_id,tr.track_id)]
- | mem-estimate=0B mem-reservation=0B
- | tuple-ids=1 row-size=32B cardinality=13083633
- |
- F00:PLAN FRAGMENT [RANDOM] hosts=6 instances=6
- Per-Host Resources: mem-estimate=530.00MB mem-reservation=2.00MB runtime-filters-memory=2.00MB
- 01:SCAN HDFS [default.track_32 tr, RANDOM]
- partitions=1/1 files=17 size=7.69GB
- predicates: tr.type = 3, tr.track_id IS NOT NULL, (tr.CloneDist IS NULL OR tr.CloneDist > 5000), tr.chi2PerDoF * tr.nDoF > 0.0
- runtime filters: RF000[bloom] -> tr.event_id, RF001[bloom] -> tr.track_id
- stored statistics:
- table: rows=320482240 size=7.69GB
- columns: all
- extrapolated-rows=disabled
- parquet statistics predicates: tr.type = 3
- parquet dictionary predicates: tr.type = 3, tr.track_id IS NOT NULL
- mem-estimate=528.00MB mem-reservation=0B
- tuple-ids=1 row-size=32B cardinality=13083633
- ----------------
- Estimated Per-Host Mem: 2020620761
- Per Host Min Reservation: slave-cn02:22000(63.00 MB) slave-cn03:22000(63.00 MB) slave-cn04:22000(63.00 MB) slave-cn05:22000(63.00 MB) slave-cn06:22000(63.00 MB) slave-cn07:22000(63.00 MB)
- Request Pool: root.admin
- Admission result: Admitted immediately
- Query Compilation: 5s510ms
- - Metadata load started: 2.692ms (2.692ms)
- - Metadata load finished. loaded-tables=1/3 load-requests=1 catalog-updates=5: 5s480ms (5s478ms)
- - Analysis finished: 5s485ms (4.823ms)
- - Value transfer graph computed: 5s486ms (532.183us)
- - Single node plan created: 5s499ms (13.145ms)
- - Runtime filters computed: 5s500ms (1.430ms)
- - Distributed plan created: 5s500ms (165.669us)
- - Lineage info computed: 5s501ms (834.523us)
- - Planning finished: 5s510ms (8.708ms)
- Query Timeline: 27m10s
- - Query submitted: 0.000ns (0.000ns)
- - Planning finished: 5s512ms (5s512ms)
- - Submit for admission: 5s516ms (4.000ms)
- - Completed admission: 5s516ms (0.000ns)
- - Ready to start on 6 backends: 5s516ms (0.000ns)
- - All 6 execution backends (25 fragment instances) started: 5s520ms (4.000ms)
- - First dynamic filter received: 34s169ms (28s649ms)
- - Rows available: 34s237ms (68.003ms)
- - First row fetched: 35s217ms (980.045ms)
- - Cancelled: 10m35s (10m)
- - Released admission control resources: 10m35s (0.000ns)
- - ComputeScanRangeAssignmentTimer: 0.000ns
- ImpalaServer:
- - ClientFetchWaitTimer: 980.045ms
- - RowMaterializationTimer: 0.000ns
- Execution Profile 33406f6405038287:b47e1f8b00000000:(Total: 28s721ms, non-child: 0.000ns, % non-child: 0.00%)
- Number of filters: 4
- Filter routing table:
- ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled
- -------------------------------------------------------------------------------------------------------------------
- 5 3 2 LOCAL false 0 (6) N/A N/A true
- 4 3 2 LOCAL false 0 (6) N/A N/A true
- 1 4 1 REMOTE false 6 (6) N/A N/A true
- 0 4 1 REMOTE false 6 (6) N/A N/A true
- Backend startup latencies: Count: 6, min / max: 2ms / 4ms, 25th %-ile: 2ms, 50th %-ile: 3ms, 75th %-ile: 3ms, 90th %-ile: 3ms, 95th %-ile: 4ms, 99.9th %-ile: 4ms
- Final filter table:
- ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled
- -------------------------------------------------------------------------------------------------------------------
- 5 3 2 LOCAL false 0 (6) N/A N/A true
- 4 3 2 LOCAL false 0 (6) N/A N/A true
- 1 4 1 REMOTE false 0 (6) 34s169ms 34s193ms false
- 0 4 1 REMOTE false 0 (6) 34s169ms 34s193ms false
- Per Node Peak Memory Usage: slave-cn02:22000(4.26 GB) slave-cn03:22000(4.23 GB) slave-cn04:22000(3.83 GB) slave-cn05:22000(3.09 GB) slave-cn06:22000(4.27 GB) slave-cn07:22000(2.87 GB)
- - FiltersReceived: 12 (12)
- - FinalizationTimer: 0.000ns
- - NumBackends: 6 (6)
- - NumFragmentInstances: 25 (25)
- - NumFragments: 5 (5)
- Averaged Fragment F04:(Total: 28s717ms, non-child: 0.000ns, % non-child: 0.00%)
- split sizes: min: 0, max: 0, avg: 0, stddev: 0
- completion times: min:10m30s max:10m30s mean: 10m30s stddev:0.000ns
- execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
- num instances: 1
- - AverageThreadTokens: 0.00
- - BloomFilterBytes: 0
- - PeakMemoryUsage: 12.59 MB (13201074)
- - PeakReservation: 0
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 4.26 GB (4572618824)
- - RowsProduced: 1.02K (1024)
- - TotalNetworkReceiveTime: 28s697ms
- - TotalNetworkSendTime: 0.000ns
- - TotalStorageWaitTime: 0.000ns
- - TotalThreadsInvoluntaryContextSwitches: 0 (0)
- - TotalThreadsTotalWallClockTime: 28s717ms
- - TotalThreadsSysTime: 3.097ms
- - TotalThreadsUserTime: 15.721ms
- - TotalThreadsVoluntaryContextSwitches: 42 (42)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 0
- - CumulativeAllocations: 0 (0)
- - PeakReservation: 0
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 0
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 0
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 0.000ns
- - ExecTreeExecTime: 0.000ns
- - OpenTime: 28s717ms
- - ExecTreeOpenTime: 28s697ms
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- PLAN_ROOT_SINK:
- - PeakMemoryUsage: 0
- EXCHANGE_NODE (id=8):(Total: 28s697ms, non-child: 28s697ms, % non-child: 100.00%)
- - ConvertRowBatchTime: 0.000ns
- - PeakMemoryUsage: 12.57 MB (13176498)
- - RowsReturned: 1.02K (1024)
- - RowsReturnedRate: 35.00 /sec
- Buffer pool:
- - AllocTime: 4.000ms
- - CumulativeAllocationBytes: 12.03 MB (12615680)
- - CumulativeAllocations: 154 (154)
- - PeakReservation: 12.03 MB (12615680)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.03 MB (12615680)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- - FirstBatchWaitTime: 28s697ms
- - TotalBytesDequeued: 134.00 KB (137216)
- - TotalGetBatchTime: 28s697ms
- - DataWaitTime: 28s697ms
- Enqueue:
- - DeserializeRowBatchTime: 16.000ms
- - TotalBatchesEnqueued: 77 (77)
- - TotalBatchesReceived: 83 (83)
- - TotalBytesReceived: 7.39 MB (7745942)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 0 (0)
- - TotalHasDeferredRPCsTime: 0.000ns
- - TotalRPCsDeferred: 6 (6)
- CodeGen:(Total: 20.000ms, non-child: 20.000ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 0.000ns
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 0 (0)
- - NumInstructions: 0 (0)
- - OptimizationTime: 0.000ns
- - PeakMemoryUsage: 0
- - PrepareTime: 20.000ms
- Coordinator Fragment F04:
- Instance 33406f6405038287:b47e1f8b00000000 (host=slave-cn02:22000):(Total: 28s717ms, non-child: 0.000ns, % non-child: 0.00%)
- Fragment Instance Lifecycle Event Timeline: 28s717ms
- - Prepare Finished: 0.000ns (0.000ns)
- - Open Finished: 28s717ms (28s717ms)
- - First Batch Produced: 28s717ms (0.000ns)
- MemoryUsage(16s000ms): 24.00 KB, 2.54 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB, 12.59 MB
- - AverageThreadTokens: 0.00
- - BloomFilterBytes: 0
- - PeakMemoryUsage: 12.59 MB (13201074)
- - PeakReservation: 0
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 4.26 GB (4572618824)
- - RowsProduced: 1.02K (1024)
- - TotalNetworkReceiveTime: 28s697ms
- - TotalNetworkSendTime: 0.000ns
- - TotalStorageWaitTime: 0.000ns
- - TotalThreadsInvoluntaryContextSwitches: 0 (0)
- - TotalThreadsTotalWallClockTime: 28s717ms
- - TotalThreadsSysTime: 3.097ms
- - TotalThreadsUserTime: 15.721ms
- - TotalThreadsVoluntaryContextSwitches: 42 (42)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 0
- - CumulativeAllocations: 0 (0)
- - PeakReservation: 0
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 0
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 0
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 0.000ns
- - ExecTreeExecTime: 0.000ns
- - OpenTime: 28s717ms
- - ExecTreeOpenTime: 28s697ms
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- PLAN_ROOT_SINK:
- - PeakMemoryUsage: 0
- EXCHANGE_NODE (id=8):(Total: 28s697ms, non-child: 0.000ns, % non-child: 0.00%)
- - ConvertRowBatchTime: 0.000ns
- - PeakMemoryUsage: 12.57 MB (13176498)
- - RowsReturned: 1.02K (1024)
- - RowsReturnedRate: 35.00 /sec
- Buffer pool:
- - AllocTime: 4.000ms
- - CumulativeAllocationBytes: 12.03 MB (12615680)
- - CumulativeAllocations: 154 (154)
- - PeakReservation: 12.03 MB (12615680)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.03 MB (12615680)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(16s000ms): 0, 29.31 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB, 134.00 KB
- - FirstBatchWaitTime: 28s697ms
- - TotalBytesDequeued: 134.00 KB (137216)
- - TotalGetBatchTime: 28s697ms
- - DataWaitTime: 28s697ms
- Enqueue:
- BytesReceived(16s000ms): 0, 1.47 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB, 7.39 MB
- DeferredQueueSize(16s000ms): 0, 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6
- - DispatchTime: (Avg: 45.488us ; Min: 20.532us ; Max: 143.209us ; Number of samples: 83)
- - DeserializeRowBatchTime: 16.000ms
- - TotalBatchesEnqueued: 77 (77)
- - TotalBatchesReceived: 83 (83)
- - TotalBytesReceived: 7.39 MB (7745942)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 0 (0)
- - TotalHasDeferredRPCsTime: 0.000ns
- - TotalRPCsDeferred: 6 (6)
- CodeGen:(Total: 20.000ms, non-child: 20.000ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 0.000ns
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 0 (0)
- - NumInstructions: 0 (0)
- - OptimizationTime: 0.000ns
- - PeakMemoryUsage: 0
- - PrepareTime: 20.000ms
- Averaged Fragment F03:(Total: 28s738ms, non-child: 0.000ns, % non-child: 0.00%)
- split sizes: min: 0, max: 0, avg: 0, stddev: 0
- completion times: min:10m30s max:10m30s mean: 10m30s stddev:1.490ms
- execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
- num instances: 6
- - AverageThreadTokens: 1.05
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 126.53 MB (132673021)
- - PeakReservation: 114.00 MB (119537664)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 3.76 GB (4033533655)
- - RowsProduced: 15.19K (15189)
- - TotalNetworkReceiveTime: 28s750ms
- - TotalNetworkSendTime: 666.703us
- - TotalStorageWaitTime: 0.000ns
- - TotalThreadsInvoluntaryContextSwitches: 34 (34)
- - TotalThreadsTotalWallClockTime: 57s173ms
- - TotalThreadsSysTime: 247.007ms
- - TotalThreadsUserTime: 676.862ms
- - TotalThreadsVoluntaryContextSwitches: 4.66K (4656)
- Buffer pool:
- - AllocTime: 666.698us
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 0.000ns
- - ExecTreeExecTime: 45.335ms
- - OpenTime: 28s737ms
- - ExecTreeOpenTime: 28s435ms
- - PrepareTime: 1.333ms
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=8):(Total: 7.333ms, non-child: 7.333ms, % non-child: 100.00%)
- - EosSent: 0 (0)
- - NetworkThroughput: 106.97 MB/sec
- - PeakMemoryUsage: 3.47 KB (3552)
- - RowsSent: 14.16K (14165)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 7.333ms
- - TotalBytesSent: 1.14 MB (1197625)
- - UncompressedRowBatchSize: 1.94 MB (2035370)
- HASH_JOIN_NODE (id=4):(Total: 28s481ms, non-child: 496.689ms, % non-child: 1.74%)
- - BuildRows: 918.86K (918861)
- - BuildTime: 462.021ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 112.07 MB (117510400)
- - ProbeRows: 248.66K (248661)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 28.667ms
- - RowsReturned: 15.19K (15189)
- - RowsReturnedRate: 533.00 /sec
- Buffer pool:
- - AllocTime: 53.335ms
- - CumulativeAllocationBytes: 112.00 MB (117440512)
- - CumulativeAllocations: 96 (96)
- - PeakReservation: 112.00 MB (117440512)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 112.00 MB (117440512)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=4):
- - BuildRowsPartitionTime: 356.683ms
- - BuildRowsPartitioned: 918.86K (918861)
- - HashBuckets: 2.10M (2097152)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 99.338ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 30.12 KB (30848)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=7):(Total: 27s968ms, non-child: 27s968ms, % non-child: 100.00%)
- - ConvertRowBatchTime: 19.334ms
- - PeakMemoryUsage: 217.33 KB (222549)
- - RowsReturned: 918.86K (918861)
- - RowsReturnedRate: 32.85 K/sec
- Buffer pool:
- - AllocTime: 79.337ms
- - CumulativeAllocationBytes: 101.63 MB (106566997)
- - CumulativeAllocations: 8.67K (8674)
- - PeakReservation: 217.33 KB (222549)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 217.33 KB (222549)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- - FirstBatchWaitTime: 3s253ms
- - TotalBytesDequeued: 81.50 MB (85454104)
- - TotalGetBatchTime: 27s941ms
- - DataWaitTime: 27s924ms
- Enqueue:
- - DeserializeRowBatchTime: 158.007ms
- - TotalBatchesEnqueued: 4.34K (4337)
- - TotalBatchesReceived: 4.34K (4337)
- - TotalBytesReceived: 58.86 MB (61717785)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 0.000ns
- - TotalRPCsDeferred: 0 (0)
- EXCHANGE_NODE (id=6):(Total: 813.370ms, non-child: 813.370ms, % non-child: 100.00%)
- - ConvertRowBatchTime: 6.000ms
- - PeakMemoryUsage: 12.35 MB (12949070)
- - RowsReturned: 248.66K (248661)
- - RowsReturnedRate: 308.51 K/sec
- Buffer pool:
- - AllocTime: 9.333ms
- - CumulativeAllocationBytes: 18.51 MB (19410944)
- - CumulativeAllocations: 1.58K (1579)
- - PeakReservation: 12.33 MB (12924245)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.33 MB (12924245)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- - FirstBatchWaitTime: 797.370ms
- - TotalBytesDequeued: 9.73 MB (10205282)
- - TotalGetBatchTime: 806.037ms
- - DataWaitTime: 805.370ms
- Enqueue:
- - DeserializeRowBatchTime: 24.001ms
- - TotalBatchesEnqueued: 789 (789)
- - TotalBatchesReceived: 791 (791)
- - TotalBytesReceived: 8.25 MB (8648531)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 0 (0)
- - TotalHasDeferredRPCsTime: 27s101ms
- - TotalRPCsDeferred: 7 (7)
- CodeGen:(Total: 294.680ms, non-child: 294.680ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 82.670ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 78 (78)
- - NumInstructions: 2.75K (2748)
- - OptimizationTime: 189.342ms
- - PeakMemoryUsage: 1.34 MB (1406976)
- - PrepareTime: 22.667ms
- Fragment F03:
- Instance 33406f6405038287:b47e1f8b00000018 (host=slave-cn02:22000):(Total: 28s765ms, non-child: 0.000ns, % non-child: 0.00%)
- Fragment Instance Lifecycle Event Timeline: 28s769ms
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 28s765ms (28s761ms)
- - First Batch Produced: 28s769ms (4.000ms)
- - First Batch Sent: 28s769ms (0.000ns)
- MemoryUsage(16s000ms): 32.62 MB, 85.30 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB, 126.73 MB
- ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- - AverageThreadTokens: 1.05
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 126.73 MB (132888745)
- - PeakReservation: 114.00 MB (119537664)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 4.26 GB (4572618824)
- - RowsProduced: 8.19K (8192)
- - TotalNetworkReceiveTime: 28s757ms
- - TotalNetworkSendTime: 0.000ns
- - TotalStorageWaitTime: 0.000ns
- - TotalThreadsInvoluntaryContextSwitches: 74 (74)
- - TotalThreadsTotalWallClockTime: 57s250ms
- - TotalThreadsSysTime: 264.857ms
- - TotalThreadsUserTime: 662.892ms
- - TotalThreadsVoluntaryContextSwitches: 4.51K (4508)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 0.000ns
- - ExecTreeExecTime: 28.001ms
- - OpenTime: 28s761ms
- - ExecTreeOpenTime: 28s489ms
- - PrepareTime: 4.000ms
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=8):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%)
- BytesSent(16s000ms): 0, 102.46 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB, 546.45 KB
- - EosSent: 0 (0)
- - NetworkThroughput: 372.98 MB/sec
- - PeakMemoryUsage: 3.47 KB (3552)
- - RowsSent: 7.17K (7168)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 0.000ns
- - TotalBytesSent: 546.45 KB (559561)
- - UncompressedRowBatchSize: 1.05 MB (1097728)
- HASH_JOIN_NODE (id=4):(Total: 28s517ms, non-child: 556.025ms, % non-child: 1.95%)
- ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- - BuildRows: 918.53K (918526)
- - BuildTime: 520.024ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 112.07 MB (117510400)
- - ProbeRows: 133.12K (133120)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 28.001ms
- - RowsReturned: 8.19K (8192)
- - RowsReturnedRate: 287.00 /sec
- Buffer pool:
- - AllocTime: 28.001ms
- - CumulativeAllocationBytes: 112.00 MB (117440512)
- - CumulativeAllocations: 96 (96)
- - PeakReservation: 112.00 MB (117440512)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 112.00 MB (117440512)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=4):
- ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- Runtime filters: 2 of 2 Runtime Filters Published
- - BuildRowsPartitionTime: 392.018ms
- - BuildRowsPartitioned: 918.53K (918526)
- - HashBuckets: 2.10M (2097152)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 116.005ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 30.12 KB (30848)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=7):(Total: 27s961ms, non-child: 32.001ms, % non-child: 0.11%)
- - ConvertRowBatchTime: 24.001ms
- - PeakMemoryUsage: 152.00 KB (155648)
- - RowsReturned: 918.53K (918526)
- - RowsReturnedRate: 32.85 K/sec
- Buffer pool:
- - AllocTime: 32.001ms
- - CumulativeAllocationBytes: 101.59 MB (106528768)
- - CumulativeAllocations: 8.67K (8672)
- - PeakReservation: 152.00 KB (155648)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 152.00 KB (155648)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(500.000ms): 0, 0, 0, 0, 0, 0, 0, 385.08 KB, 2.29 MB, 4.68 MB, 6.79 MB, 8.35 MB, 10.19 MB, 11.77 MB, 13.29 MB, 14.67 MB, 16.28 MB, 17.71 MB, 19.03 MB, 20.70 MB, 22.32 MB, 23.28 MB, 24.65 MB, 25.80 MB, 27.00 MB, 28.67 MB, 30.05 MB, 31.33 MB, 32.75 MB, 34.11 MB, 35.07 MB, 35.91 MB, 36.95 MB, 39.17 MB, 41.54 MB, 42.83 MB, 44.22 MB, 46.09 MB, 47.63 MB, 48.98 MB, 51.05 MB, 53.72 MB, 56.38 MB, 59.61 MB, 62.81 MB, 65.46 MB, 67.72 MB, 69.63 MB, 71.57 MB, 73.30 MB, 74.90 MB, 76.72 MB, 78.28 MB, 79.32 MB, 80.00 MB, 80.64 MB, 81.18 MB, 81.47 MB
- - FirstBatchWaitTime: 3s280ms
- - TotalBytesDequeued: 81.47 MB (85422918)
- - TotalGetBatchTime: 27s933ms
- - DataWaitTime: 27s929ms
- Enqueue:
- BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 276.50 KB, 1.65 MB, 3.37 MB, 4.89 MB, 6.01 MB, 7.34 MB, 8.48 MB, 9.59 MB, 10.57 MB, 11.73 MB, 12.76 MB, 13.71 MB, 14.92 MB, 16.10 MB, 16.78 MB, 17.77 MB, 18.60 MB, 19.47 MB, 20.68 MB, 21.67 MB, 22.60 MB, 23.63 MB, 24.61 MB, 25.30 MB, 25.91 MB, 26.66 MB, 28.26 MB, 29.98 MB, 30.92 MB, 31.92 MB, 33.27 MB, 34.38 MB, 35.36 MB, 36.86 MB, 38.79 MB, 40.71 MB, 43.04 MB, 45.35 MB, 47.28 MB, 48.91 MB, 50.29 MB, 51.69 MB, 52.94 MB, 54.10 MB, 55.42 MB, 56.54 MB, 57.29 MB, 57.78 MB, 58.24 MB, 58.63 MB, 58.84 MB
- DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 59.255us ; Min: 26.257us ; Max: 3.828ms ; Number of samples: 4336)
- - DeserializeRowBatchTime: 128.005ms
- - TotalBatchesEnqueued: 4.34K (4336)
- - TotalBatchesReceived: 4.34K (4336)
- - TotalBytesReceived: 58.84 MB (61696748)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 0.000ns
- - TotalRPCsDeferred: 0 (0)
- EXCHANGE_NODE (id=6):(Total: 824.038ms, non-child: 0.000ns, % non-child: 0.00%)
- - ConvertRowBatchTime: 0.000ns
- - PeakMemoryUsage: 12.66 MB (13277021)
- - RowsReturned: 133.12K (133120)
- - RowsReturnedRate: 161.54 K/sec
- Buffer pool:
- - AllocTime: 12.000ms
- - CumulativeAllocationBytes: 18.38 MB (19267584)
- - CumulativeAllocations: 1.57K (1568)
- - PeakReservation: 12.61 MB (13221888)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.61 MB (13221888)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(16s000ms): 18.62 KB, 1017.79 KB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB
- - FirstBatchWaitTime: 824.038ms
- - TotalBytesDequeued: 5.22 MB (5470384)
- - TotalGetBatchTime: 824.038ms
- - DataWaitTime: 824.038ms
- Enqueue:
- BytesReceived(16s000ms): 4.93 MB, 5.93 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB, 8.22 MB
- DeferredQueueSize(16s000ms): 2, 3, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5
- - DispatchTime: (Avg: 38.003us ; Min: 16.090us ; Max: 1.284ms ; Number of samples: 789)
- - DeserializeRowBatchTime: 36.001ms
- - TotalBatchesEnqueued: 784 (784)
- - TotalBatchesReceived: 789 (789)
- - TotalBytesReceived: 8.22 MB (8620791)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 0 (0)
- - TotalHasDeferredRPCsTime: 27s125ms
- - TotalRPCsDeferred: 12 (12)
- CodeGen:(Total: 268.012ms, non-child: 268.012ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 76.003ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 78 (78)
- - NumInstructions: 2.75K (2748)
- - OptimizationTime: 168.007ms
- - PeakMemoryUsage: 1.34 MB (1406976)
- - PrepareTime: 24.001ms
- Instance 33406f6405038287:b47e1f8b00000017 (host=slave-cn03:22000):(Total: 28s753ms, non-child: 0.000ns, % non-child: 0.00%)
- Fragment Instance Lifecycle Event Timeline: 28s757ms
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 28s753ms (28s749ms)
- - First Batch Produced: 28s757ms (4.000ms)
- - First Batch Sent: 28s757ms (0.000ns)
- MemoryUsage(16s000ms): 32.59 MB, 84.32 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB, 126.77 MB
- ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- - AverageThreadTokens: 1.05
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 126.77 MB (132932407)
- - PeakReservation: 114.00 MB (119537664)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 4.23 GB (4540696369)
- - RowsProduced: 8.19K (8192)
- - TotalNetworkReceiveTime: 28s661ms
- - TotalNetworkSendTime: 0.000ns
- - TotalStorageWaitTime: 0.000ns
- - TotalThreadsInvoluntaryContextSwitches: 40 (40)
- - TotalThreadsTotalWallClockTime: 57s226ms
- - TotalThreadsSysTime: 203.411ms
- - TotalThreadsUserTime: 714.701ms
- - TotalThreadsVoluntaryContextSwitches: 4.60K (4598)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 0.000ns
- - ExecTreeExecTime: 28.001ms
- - OpenTime: 28s749ms
- - ExecTreeOpenTime: 28s477ms
- - PrepareTime: 4.000ms
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=8):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%)
- BytesSent(16s000ms): 0, 102.42 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB, 546.22 KB
- - EosSent: 0 (0)
- - NetworkThroughput: 25.00 MB/sec
- - PeakMemoryUsage: 3.47 KB (3552)
- - RowsSent: 7.17K (7168)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 4.000ms
- - TotalBytesSent: 546.22 KB (559327)
- - UncompressedRowBatchSize: 1.05 MB (1097728)
- HASH_JOIN_NODE (id=4):(Total: 28s505ms, non-child: 648.029ms, % non-child: 2.27%)
- ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- - BuildRows: 919.04K (919043)
- - BuildTime: 620.028ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 112.07 MB (117510400)
- - ProbeRows: 133.12K (133120)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 24.001ms
- - RowsReturned: 8.19K (8192)
- - RowsReturnedRate: 287.00 /sec
- Buffer pool:
- - AllocTime: 112.005ms
- - CumulativeAllocationBytes: 112.00 MB (117440512)
- - CumulativeAllocations: 96 (96)
- - PeakReservation: 112.00 MB (117440512)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 112.00 MB (117440512)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=4):
- ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- Runtime filters: 2 of 2 Runtime Filters Published
- - BuildRowsPartitionTime: 500.022ms
- - BuildRowsPartitioned: 919.04K (919043)
- - HashBuckets: 2.10M (2097152)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 116.005ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 30.12 KB (30848)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=7):(Total: 27s853ms, non-child: 60.002ms, % non-child: 0.22%)
- - ConvertRowBatchTime: 12.000ms
- - PeakMemoryUsage: 464.00 KB (475136)
- - RowsReturned: 919.04K (919043)
- - RowsReturnedRate: 32.99 K/sec
- Buffer pool:
- - AllocTime: 76.003ms
- - CumulativeAllocationBytes: 101.64 MB (106577920)
- - CumulativeAllocations: 8.67K (8674)
- - PeakReservation: 464.00 KB (475136)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 464.00 KB (475136)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(500.000ms): 0, 0, 0, 0, 0, 0, 0, 77.02 KB, 1.79 MB, 4.06 MB, 6.11 MB, 7.93 MB, 9.76 MB, 11.30 MB, 12.80 MB, 14.33 MB, 15.94 MB, 17.34 MB, 18.65 MB, 20.33 MB, 22.06 MB, 23.09 MB, 24.46 MB, 25.59 MB, 26.83 MB, 28.49 MB, 29.80 MB, 31.16 MB, 32.53 MB, 33.92 MB, 34.95 MB, 35.78 MB, 36.74 MB, 38.60 MB, 40.93 MB, 42.66 MB, 43.94 MB, 45.63 MB, 47.35 MB, 48.62 MB, 50.35 MB, 52.84 MB, 55.56 MB, 58.66 MB, 61.99 MB, 64.85 MB, 67.24 MB, 69.17 MB, 71.20 MB, 72.87 MB, 74.45 MB, 76.20 MB, 77.95 MB, 79.16 MB, 79.90 MB, 80.52 MB, 81.09 MB, 81.50 MB
- - FirstBatchWaitTime: 3s280ms
- - TotalBytesDequeued: 81.51 MB (85470999)
- - TotalGetBatchTime: 27s829ms
- - DataWaitTime: 27s797ms
- Enqueue:
- BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 55.19 KB, 1.28 MB, 2.92 MB, 4.40 MB, 5.71 MB, 7.03 MB, 8.14 MB, 9.22 MB, 10.32 MB, 11.49 MB, 12.49 MB, 13.44 MB, 14.65 MB, 15.90 MB, 16.65 MB, 17.64 MB, 18.46 MB, 19.35 MB, 20.55 MB, 21.50 MB, 22.48 MB, 23.47 MB, 24.47 MB, 25.22 MB, 25.82 MB, 26.51 MB, 27.86 MB, 29.54 MB, 30.79 MB, 31.72 MB, 32.94 MB, 34.18 MB, 35.10 MB, 36.35 MB, 38.15 MB, 40.12 MB, 42.36 MB, 44.76 MB, 46.83 MB, 48.56 MB, 49.95 MB, 51.42 MB, 52.63 MB, 53.77 MB, 55.04 MB, 56.30 MB, 57.17 MB, 57.71 MB, 58.16 MB, 58.56 MB, 58.86 MB
- DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 60.236us ; Min: 25.453us ; Max: 13.216ms ; Number of samples: 4337)
- - DeserializeRowBatchTime: 152.006ms
- - TotalBatchesEnqueued: 4.34K (4337)
- - TotalBatchesReceived: 4.34K (4337)
- - TotalBytesReceived: 58.87 MB (61729506)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 0.000ns
- - TotalRPCsDeferred: 0 (0)
- EXCHANGE_NODE (id=6):(Total: 828.037ms, non-child: 4.000ms, % non-child: 0.48%)
- - ConvertRowBatchTime: 0.000ns
- - PeakMemoryUsage: 12.70 MB (13320699)
- - RowsReturned: 133.12K (133120)
- - RowsReturnedRate: 160.76 K/sec
- Buffer pool:
- - AllocTime: 12.000ms
- - CumulativeAllocationBytes: 18.38 MB (19267584)
- - CumulativeAllocations: 1.57K (1568)
- - PeakReservation: 12.64 MB (13254656)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.64 MB (13254656)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(16s000ms): 18.62 KB, 1017.79 KB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB, 5.22 MB
- - FirstBatchWaitTime: 824.037ms
- - TotalBytesDequeued: 5.22 MB (5470384)
- - TotalGetBatchTime: 824.037ms
- - DataWaitTime: 824.037ms
- Enqueue:
- BytesReceived(16s000ms): 4.90 MB, 5.95 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB, 8.23 MB
- DeferredQueueSize(16s000ms): 4, 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6
- - DispatchTime: (Avg: 36.118us ; Min: 18.472us ; Max: 128.157us ; Number of samples: 790)
- - DeserializeRowBatchTime: 32.001ms
- - TotalBatchesEnqueued: 784 (784)
- - TotalBatchesReceived: 790 (790)
- - TotalBytesReceived: 8.23 MB (8630403)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 0 (0)
- - TotalHasDeferredRPCsTime: 27s119ms
- - TotalRPCsDeferred: 12 (12)
- CodeGen:(Total: 268.012ms, non-child: 268.012ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 76.003ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 78 (78)
- - NumInstructions: 2.75K (2748)
- - OptimizationTime: 172.007ms
- - PeakMemoryUsage: 1.34 MB (1406976)
- - PrepareTime: 20.000ms
- Instance 33406f6405038287:b47e1f8b00000013 (host=slave-cn04:22000):(Total: 28s745ms, non-child: 0.000ns, % non-child: 0.00%)
- Fragment Instance Lifecycle Event Timeline: 28s749ms
- - Prepare Finished: 0.000ns (0.000ns)
- - Open Finished: 28s745ms (28s745ms)
- - First Batch Produced: 28s749ms (4.000ms)
- - First Batch Sent: 28s749ms (0.000ns)
- MemoryUsage(16s000ms): 32.62 MB, 84.13 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB, 126.27 MB
- ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- - AverageThreadTokens: 1.05
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 126.46 MB (132605024)
- - PeakReservation: 114.00 MB (119537664)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 3.83 GB (4109447221)
- - RowsProduced: 15.36K (15360)
- - TotalNetworkReceiveTime: 28s777ms
- - TotalNetworkSendTime: 0.000ns
- - TotalStorageWaitTime: 0.000ns
- - TotalThreadsInvoluntaryContextSwitches: 34 (34)
- - TotalThreadsTotalWallClockTime: 57s187ms
- - TotalThreadsSysTime: 277.892ms
- - TotalThreadsUserTime: 649.375ms
- - TotalThreadsVoluntaryContextSwitches: 4.75K (4753)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 0.000ns
- - ExecTreeExecTime: 40.002ms
- - OpenTime: 28s745ms
- - ExecTreeOpenTime: 28s441ms
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=8):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%)
- BytesSent(16s000ms): 0, 222.12 KB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB
- - EosSent: 0 (0)
- - NetworkThroughput: 57.61 MB/sec
- - PeakMemoryUsage: 3.47 KB (3552)
- - RowsSent: 14.34K (14336)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 8.000ms
- - TotalBytesSent: 1.16 MB (1213103)
- - UncompressedRowBatchSize: 1.96 MB (2058240)
- HASH_JOIN_NODE (id=4):(Total: 28s481ms, non-child: 452.023ms, % non-child: 1.59%)
- ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- - BuildRows: 918.03K (918029)
- - BuildTime: 424.022ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 112.07 MB (117510400)
- - ProbeRows: 253.95K (253952)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 24.001ms
- - RowsReturned: 15.36K (15360)
- - RowsReturnedRate: 539.00 /sec
- Buffer pool:
- - AllocTime: 64.003ms
- - CumulativeAllocationBytes: 112.00 MB (117440512)
- - CumulativeAllocations: 96 (96)
- - PeakReservation: 112.00 MB (117440512)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 112.00 MB (117440512)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=4):
- ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- Runtime filters: 2 of 2 Runtime Filters Published
- - BuildRowsPartitionTime: 308.016ms
- - BuildRowsPartitioned: 918.03K (918029)
- - HashBuckets: 2.10M (2097152)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 108.005ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 30.12 KB (30848)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=7):(Total: 28s013ms, non-child: 56.002ms, % non-child: 0.20%)
- - ConvertRowBatchTime: 24.001ms
- - PeakMemoryUsage: 208.00 KB (212992)
- - RowsReturned: 918.03K (918029)
- - RowsReturnedRate: 32.77 K/sec
- Buffer pool:
- - AllocTime: 132.006ms
- - CumulativeAllocationBytes: 101.55 MB (106479616)
- - CumulativeAllocations: 8.67K (8668)
- - PeakReservation: 208.00 KB (212992)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 208.00 KB (212992)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(500.000ms): 0, 0, 0, 0, 0, 0, 0, 134.78 KB, 1.86 MB, 4.12 MB, 6.17 MB, 8.01 MB, 9.81 MB, 11.36 MB, 12.90 MB, 14.35 MB, 15.98 MB, 17.37 MB, 18.67 MB, 20.34 MB, 22.00 MB, 23.11 MB, 24.46 MB, 25.55 MB, 26.83 MB, 28.41 MB, 29.76 MB, 31.14 MB, 32.49 MB, 33.83 MB, 34.88 MB, 35.73 MB, 36.68 MB, 38.62 MB, 40.93 MB, 42.53 MB, 43.89 MB, 45.58 MB, 47.27 MB, 48.64 MB, 50.35 MB, 52.93 MB, 55.60 MB, 58.74 MB, 62.03 MB, 64.86 MB, 67.26 MB, 69.11 MB, 71.08 MB, 72.81 MB, 74.37 MB, 76.14 MB, 77.85 MB, 79.07 MB, 79.84 MB, 80.44 MB, 81.02 MB, 81.42 MB
- - FirstBatchWaitTime: 3s248ms
- - TotalBytesDequeued: 81.42 MB (85376697)
- - TotalGetBatchTime: 27s977ms
- - DataWaitTime: 27s957ms
- Enqueue:
- BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 96.66 KB, 1.34 MB, 2.96 MB, 4.44 MB, 5.77 MB, 7.07 MB, 8.18 MB, 9.29 MB, 10.33 MB, 11.51 MB, 12.52 MB, 13.46 MB, 14.66 MB, 15.86 MB, 16.66 MB, 17.64 MB, 18.42 MB, 19.35 MB, 20.49 MB, 21.47 MB, 22.46 MB, 23.44 MB, 24.40 MB, 25.16 MB, 25.77 MB, 26.47 MB, 27.87 MB, 29.54 MB, 30.70 MB, 31.67 MB, 32.90 MB, 34.12 MB, 35.12 MB, 36.35 MB, 38.21 MB, 40.14 MB, 42.41 MB, 44.79 MB, 46.84 MB, 48.58 MB, 49.91 MB, 51.34 MB, 52.59 MB, 53.72 MB, 55.00 MB, 56.23 MB, 57.11 MB, 57.66 MB, 58.10 MB, 58.52 MB, 58.81 MB
- DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 69.893us ; Min: 26.205us ; Max: 36.229ms ; Number of samples: 4334)
- - DeserializeRowBatchTime: 200.010ms
- - TotalBatchesEnqueued: 4.33K (4334)
- - TotalBatchesReceived: 4.33K (4334)
- - TotalBytesReceived: 58.81 MB (61662725)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 0.000ns
- - TotalRPCsDeferred: 0 (0)
- EXCHANGE_NODE (id=6):(Total: 812.042ms, non-child: 16.000ms, % non-child: 1.97%)
- - ConvertRowBatchTime: 16.000ms
- - PeakMemoryUsage: 12.20 MB (12790542)
- - RowsReturned: 253.95K (253952)
- - RowsReturnedRate: 312.73 K/sec
- Buffer pool:
- - AllocTime: 20.001ms
- - CumulativeAllocationBytes: 18.56 MB (19464192)
- - CumulativeAllocations: 1.58K (1584)
- - PeakReservation: 12.20 MB (12787712)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.20 MB (12787712)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(16s000ms): 18.62 KB, 1.88 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB
- - FirstBatchWaitTime: 796.042ms
- - TotalBytesDequeued: 9.93 MB (10412032)
- - TotalGetBatchTime: 796.042ms
- - DataWaitTime: 796.042ms
- Enqueue:
- BytesReceived(16s000ms): 4.91 MB, 5.95 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB, 8.25 MB
- DeferredQueueSize(16s000ms): 3, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 35.148us ; Min: 15.187us ; Max: 135.753us ; Number of samples: 792)
- - DeserializeRowBatchTime: 24.001ms
- - TotalBatchesEnqueued: 792 (792)
- - TotalBatchesReceived: 792 (792)
- - TotalBytesReceived: 8.25 MB (8651549)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 0 (0)
- - TotalHasDeferredRPCsTime: 27s106ms
- - TotalRPCsDeferred: 6 (6)
- CodeGen:(Total: 296.015ms, non-child: 296.015ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 80.004ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 78 (78)
- - NumInstructions: 2.75K (2748)
- - OptimizationTime: 188.009ms
- - PeakMemoryUsage: 1.34 MB (1406976)
- - PrepareTime: 28.001ms
- Instance 33406f6405038287:b47e1f8b00000015 (host=slave-cn05:22000):(Total: 28s733ms, non-child: 0.000ns, % non-child: 0.00%)
- Fragment Instance Lifecycle Event Timeline: 28s737ms
- - Prepare Finished: 0.000ns (0.000ns)
- - Open Finished: 28s733ms (28s733ms)
- - First Batch Produced: 28s737ms (4.000ms)
- - First Batch Sent: 28s737ms (0.000ns)
- MemoryUsage(16s000ms): 33.28 MB, 85.89 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB, 126.29 MB
- ThreadUsage(16s000ms): 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- - AverageThreadTokens: 1.05
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 126.41 MB (132547451)
- - PeakReservation: 114.00 MB (119537664)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 3.09 GB (3313067929)
- - RowsProduced: 18.43K (18432)
- - TotalNetworkReceiveTime: 28s565ms
- - TotalNetworkSendTime: 4.000ms
- - TotalStorageWaitTime: 0.000ns
- - TotalThreadsInvoluntaryContextSwitches: 27 (27)
- - TotalThreadsTotalWallClockTime: 57s039ms
- - TotalThreadsSysTime: 246.024ms
- - TotalThreadsUserTime: 798.251ms
- - TotalThreadsVoluntaryContextSwitches: 4.66K (4664)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 0.000ns
- - ExecTreeExecTime: 44.002ms
- - OpenTime: 28s733ms
- - ExecTreeOpenTime: 28s305ms
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=8):(Total: 8.000ms, non-child: 4.000ms, % non-child: 50.00%)
- BytesSent(16s000ms): 0, 319.11 KB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB, 1.42 MB
- - EosSent: 0 (0)
- - NetworkThroughput: 54.32 MB/sec
- - PeakMemoryUsage: 3.47 KB (3552)
- - RowsSent: 17.41K (17408)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 4.000ms
- - TotalBytesSent: 1.42 MB (1493782)
- - UncompressedRowBatchSize: 2.36 MB (2469888)
- HASH_JOIN_NODE (id=4):(Total: 28s349ms, non-child: 420.023ms, % non-child: 1.48%)
- ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- - BuildRows: 919.13K (919127)
- - BuildTime: 380.020ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 112.07 MB (117510400)
- - ProbeRows: 305.15K (305152)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 32.001ms
- - RowsReturned: 18.43K (18432)
- - RowsReturnedRate: 650.00 /sec
- Buffer pool:
- - AllocTime: 40.002ms
- - CumulativeAllocationBytes: 112.00 MB (117440512)
- - CumulativeAllocations: 96 (96)
- - PeakReservation: 112.00 MB (117440512)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 112.00 MB (117440512)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=4):
- ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- Runtime filters: 2 of 2 Runtime Filters Published
- - BuildRowsPartitionTime: 280.015ms
- - BuildRowsPartitioned: 919.13K (919127)
- - HashBuckets: 2.10M (2097152)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 100.005ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 30.12 KB (30848)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=7):(Total: 27s917ms, non-child: 40.002ms, % non-child: 0.14%)
- - ConvertRowBatchTime: 24.001ms
- - PeakMemoryUsage: 152.00 KB (155648)
- - RowsReturned: 919.13K (919127)
- - RowsReturnedRate: 32.92 K/sec
- Buffer pool:
- - AllocTime: 136.007ms
- - CumulativeAllocationBytes: 101.67 MB (106610688)
- - CumulativeAllocations: 8.68K (8678)
- - PeakReservation: 152.00 KB (155648)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 152.00 KB (155648)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(500.000ms): 0, 0, 0, 0, 0, 0, 0, 1.33 MB, 3.44 MB, 5.49 MB, 7.56 MB, 9.34 MB, 10.98 MB, 12.39 MB, 14.05 MB, 15.47 MB, 16.92 MB, 18.31 MB, 19.80 MB, 21.60 MB, 22.81 MB, 23.94 MB, 25.12 MB, 26.57 MB, 28.00 MB, 29.41 MB, 30.80 MB, 32.21 MB, 33.60 MB, 34.65 MB, 35.59 MB, 36.53 MB, 37.96 MB, 40.31 MB, 42.40 MB, 43.57 MB, 45.26 MB, 47.04 MB, 48.57 MB, 49.88 MB, 52.37 MB, 55.09 MB, 57.94 MB, 61.33 MB, 64.30 MB, 66.78 MB, 68.66 MB, 70.75 MB, 72.50 MB, 74.08 MB, 75.79 MB, 77.56 MB, 78.98 MB, 79.75 MB, 80.35 MB, 80.99 MB, 81.48 MB
- - FirstBatchWaitTime: 3s136ms
- - TotalBytesDequeued: 81.52 MB (85478811)
- - TotalGetBatchTime: 27s893ms
- - DataWaitTime: 27s877ms
- Enqueue:
- BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 981.74 KB, 2.47 MB, 3.95 MB, 5.44 MB, 6.73 MB, 7.91 MB, 8.92 MB, 10.12 MB, 11.15 MB, 12.19 MB, 13.20 MB, 14.27 MB, 15.57 MB, 16.44 MB, 17.26 MB, 18.11 MB, 19.16 MB, 20.19 MB, 21.21 MB, 22.21 MB, 23.23 MB, 24.24 MB, 25.00 MB, 25.68 MB, 26.36 MB, 27.39 MB, 29.09 MB, 30.60 MB, 31.44 MB, 32.67 MB, 33.96 MB, 35.06 MB, 36.01 MB, 37.80 MB, 39.77 MB, 41.83 MB, 44.28 MB, 46.43 MB, 48.23 MB, 49.59 MB, 51.10 MB, 52.36 MB, 53.51 MB, 54.74 MB, 56.03 MB, 57.05 MB, 57.60 MB, 58.03 MB, 58.50 MB, 58.85 MB
- DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 58.734us ; Min: 23.541us ; Max: 1.155ms ; Number of samples: 4339)
- - DeserializeRowBatchTime: 216.011ms
- - TotalBatchesEnqueued: 4.34K (4339)
- - TotalBatchesReceived: 4.34K (4339)
- - TotalBytesReceived: 58.88 MB (61735185)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 0.000ns
- - TotalRPCsDeferred: 0 (0)
- EXCHANGE_NODE (id=6):(Total: 684.037ms, non-child: 12.000ms, % non-child: 1.75%)
- - ConvertRowBatchTime: 12.000ms
- - PeakMemoryUsage: 12.22 MB (12812288)
- - RowsReturned: 305.15K (305152)
- - RowsReturnedRate: 446.10 K/sec
- Buffer pool:
- - AllocTime: 4.000ms
- - CumulativeAllocationBytes: 18.61 MB (19513344)
- - CumulativeAllocations: 1.59K (1588)
- - PeakReservation: 12.22 MB (12812288)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.22 MB (12812288)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(16s000ms): 18.62 KB, 2.63 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB, 11.95 MB
- - FirstBatchWaitTime: 672.036ms
- - TotalBytesDequeued: 11.95 MB (12526976)
- - TotalGetBatchTime: 672.036ms
- - DataWaitTime: 672.036ms
- Enqueue:
- BytesReceived(16s000ms): 5.02 MB, 6.05 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB
- DeferredQueueSize(16s000ms): 4, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 35.678us ; Min: 16.717us ; Max: 143.976us ; Number of samples: 794)
- - DeserializeRowBatchTime: 24.001ms
- - TotalBatchesEnqueued: 794 (794)
- - TotalBatchesReceived: 794 (794)
- - TotalBytesReceived: 8.27 MB (8672484)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 0 (0)
- - TotalHasDeferredRPCsTime: 27s098ms
- - TotalRPCsDeferred: 6 (6)
- CodeGen:(Total: 420.023ms, non-child: 420.023ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 116.006ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 78 (78)
- - NumInstructions: 2.75K (2748)
- - OptimizationTime: 280.015ms
- - PeakMemoryUsage: 1.34 MB (1406976)
- - PrepareTime: 24.001ms
- Instance 33406f6405038287:b47e1f8b00000016 (host=slave-cn07:22000):(Total: 28s725ms, non-child: 0.000ns, % non-child: 0.00%)
- Fragment Instance Lifecycle Event Timeline: 28s729ms
- - Prepare Finished: 0.000ns (0.000ns)
- - Open Finished: 28s725ms (28s725ms)
- - First Batch Produced: 28s725ms (0.000ns)
- - First Batch Sent: 28s729ms (4.000ms)
- MemoryUsage(16s000ms): 32.63 MB, 84.98 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB, 126.20 MB
- ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- - AverageThreadTokens: 1.05
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 126.37 MB (132503375)
- - PeakReservation: 114.00 MB (119537664)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 2.87 GB (3082904484)
- - RowsProduced: 20.48K (20480)
- - TotalNetworkReceiveTime: 28s869ms
- - TotalNetworkSendTime: 0.000ns
- - TotalStorageWaitTime: 0.000ns
- - TotalThreadsInvoluntaryContextSwitches: 7 (7)
- - TotalThreadsTotalWallClockTime: 57s178ms
- - TotalThreadsSysTime: 266.567ms
- - TotalThreadsUserTime: 604.533ms
- - TotalThreadsVoluntaryContextSwitches: 4.75K (4746)
- Buffer pool:
- - AllocTime: 4.000ms
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 0.000ns
- - ExecTreeExecTime: 60.002ms
- - OpenTime: 28s725ms
- - ExecTreeOpenTime: 28s453ms
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=8):(Total: 12.000ms, non-child: 12.000ms, % non-child: 100.00%)
- BytesSent(16s000ms): 0, 307.50 KB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB
- - EosSent: 0 (0)
- - NetworkThroughput: 68.86 MB/sec
- - PeakMemoryUsage: 3.47 KB (3552)
- - RowsSent: 19.46K (19456)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 12.000ms
- - TotalBytesSent: 1.60 MB (1679366)
- - UncompressedRowBatchSize: 2.62 MB (2744320)
- HASH_JOIN_NODE (id=4):(Total: 28s513ms, non-child: 452.021ms, % non-child: 1.59%)
- ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- - BuildRows: 919.16K (919156)
- - BuildTime: 416.019ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 112.07 MB (117510400)
- - ProbeRows: 335.87K (335872)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 32.001ms
- - RowsReturned: 20.48K (20480)
- - RowsReturnedRate: 718.00 /sec
- Buffer pool:
- - AllocTime: 20.000ms
- - CumulativeAllocationBytes: 112.00 MB (117440512)
- - CumulativeAllocations: 96 (96)
- - PeakReservation: 112.00 MB (117440512)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 112.00 MB (117440512)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=4):
- ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- Runtime filters: 2 of 2 Runtime Filters Published
- - BuildRowsPartitionTime: 324.015ms
- - BuildRowsPartitioned: 919.16K (919156)
- - HashBuckets: 2.10M (2097152)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 84.004ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 30.12 KB (30848)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=7):(Total: 28s033ms, non-child: 24.001ms, % non-child: 0.09%)
- - ConvertRowBatchTime: 8.000ms
- - PeakMemoryUsage: 152.00 KB (155648)
- - RowsReturned: 919.16K (919156)
- - RowsReturnedRate: 32.79 K/sec
- Buffer pool:
- - AllocTime: 64.003ms
- - CumulativeAllocationBytes: 101.66 MB (106602496)
- - CumulativeAllocations: 8.68K (8678)
- - PeakReservation: 152.00 KB (155648)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 152.00 KB (155648)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(500.000ms): 0, 0, 0, 0, 0, 0, 0, 250.30 KB, 2.11 MB, 4.44 MB, 6.47 MB, 8.18 MB, 10.06 MB, 11.51 MB, 13.01 MB, 14.40 MB, 16.13 MB, 17.49 MB, 18.77 MB, 20.59 MB, 22.17 MB, 23.20 MB, 24.58 MB, 25.74 MB, 26.94 MB, 28.60 MB, 29.97 MB, 31.33 MB, 32.68 MB, 34.03 MB, 35.03 MB, 35.84 MB, 36.85 MB, 38.96 MB, 41.31 MB, 42.78 MB, 44.13 MB, 45.93 MB, 47.55 MB, 48.87 MB, 50.79 MB, 53.38 MB, 55.97 MB, 59.17 MB, 62.46 MB, 65.24 MB, 67.59 MB, 69.48 MB, 71.43 MB, 73.14 MB, 74.76 MB, 76.53 MB, 78.17 MB, 79.28 MB, 80.02 MB, 80.60 MB, 81.19 MB, 81.52 MB
- - FirstBatchWaitTime: 3s280ms
- - TotalBytesDequeued: 81.52 MB (85481508)
- - TotalGetBatchTime: 28s013ms
- - DataWaitTime: 28s009ms
- Enqueue:
- BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 179.67 KB, 1.51 MB, 3.19 MB, 4.66 MB, 5.89 MB, 7.24 MB, 8.29 MB, 9.37 MB, 10.37 MB, 11.62 MB, 12.60 MB, 13.52 MB, 14.84 MB, 15.98 MB, 16.73 MB, 17.72 MB, 18.56 MB, 19.43 MB, 20.62 MB, 21.62 MB, 22.59 MB, 23.57 MB, 24.55 MB, 25.27 MB, 25.86 MB, 26.59 MB, 28.11 MB, 29.81 MB, 30.87 MB, 31.85 MB, 33.16 MB, 34.33 MB, 35.28 MB, 36.66 MB, 38.54 MB, 40.41 MB, 42.72 MB, 45.10 MB, 47.11 MB, 48.81 MB, 50.17 MB, 51.59 MB, 52.83 MB, 54.00 MB, 55.27 MB, 56.46 MB, 57.26 MB, 57.79 MB, 58.21 MB, 58.64 MB, 58.88 MB
- DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 63.851us ; Min: 22.657us ; Max: 7.040ms ; Number of samples: 4339)
- - DeserializeRowBatchTime: 160.007ms
- - TotalBatchesEnqueued: 4.34K (4339)
- - TotalBatchesReceived: 4.34K (4339)
- - TotalBytesReceived: 58.88 MB (61736546)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 0.000ns
- - TotalRPCsDeferred: 0 (0)
- EXCHANGE_NODE (id=6):(Total: 856.040ms, non-child: 8.000ms, % non-child: 0.93%)
- - ConvertRowBatchTime: 0.000ns
- - PeakMemoryUsage: 12.14 MB (12725018)
- - RowsReturned: 335.87K (335872)
- - RowsReturnedRate: 392.36 K/sec
- Buffer pool:
- - AllocTime: 8.000ms
- - CumulativeAllocationBytes: 18.54 MB (19439616)
- - CumulativeAllocations: 1.58K (1582)
- - PeakReservation: 12.12 MB (12713984)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.12 MB (12713984)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(16s000ms): 18.62 KB, 2.48 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB, 13.15 MB
- - FirstBatchWaitTime: 828.039ms
- - TotalBytesDequeued: 13.15 MB (13787808)
- - TotalGetBatchTime: 852.040ms
- - DataWaitTime: 848.040ms
- Enqueue:
- BytesReceived(16s000ms): 4.91 MB, 5.93 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB, 8.24 MB
- DeferredQueueSize(16s000ms): 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 33.863us ; Min: 19.833us ; Max: 167.108us ; Number of samples: 791)
- - DeserializeRowBatchTime: 16.000ms
- - TotalBatchesEnqueued: 791 (791)
- - TotalBatchesReceived: 791 (791)
- - TotalBytesReceived: 8.24 MB (8642242)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 0 (0)
- - TotalHasDeferredRPCsTime: 27s083ms
- - TotalRPCsDeferred: 2 (2)
- CodeGen:(Total: 264.012ms, non-child: 264.012ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 76.003ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 78 (78)
- - NumInstructions: 2.75K (2748)
- - OptimizationTime: 168.008ms
- - PeakMemoryUsage: 1.34 MB (1406976)
- - PrepareTime: 20.000ms
- Instance 33406f6405038287:b47e1f8b00000014 (host=slave-cn06:22000):(Total: 28s708ms, non-child: 0.000ns, % non-child: 0.00%)
- Fragment Instance Lifecycle Event Timeline: 28s712ms
- - Prepare Finished: 0.000ns (0.000ns)
- - Open Finished: 28s708ms (28s708ms)
- - First Batch Produced: 28s712ms (4.000ms)
- - First Batch Sent: 28s712ms (0.000ns)
- MemoryUsage(16s000ms): 32.55 MB, 83.81 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB, 126.23 MB
- ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- - AverageThreadTokens: 1.05
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 126.42 MB (132561126)
- - PeakReservation: 114.00 MB (119537664)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 4.27 GB (4582467103)
- - RowsProduced: 20.48K (20480)
- - TotalNetworkReceiveTime: 28s868ms
- - TotalNetworkSendTime: 0.000ns
- - TotalStorageWaitTime: 0.000ns
- - TotalThreadsInvoluntaryContextSwitches: 24 (24)
- - TotalThreadsTotalWallClockTime: 57s157ms
- - TotalThreadsSysTime: 223.296ms
- - TotalThreadsUserTime: 631.425ms
- - TotalThreadsVoluntaryContextSwitches: 4.67K (4667)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 0.000ns
- - ExecTreeExecTime: 72.002ms
- - OpenTime: 28s708ms
- - ExecTreeOpenTime: 28s448ms
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=8):(Total: 12.000ms, non-child: 12.000ms, % non-child: 100.00%)
- BytesSent(16s000ms): 0, 307.73 KB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB
- - EosSent: 0 (0)
- - NetworkThroughput: 63.03 MB/sec
- - PeakMemoryUsage: 3.47 KB (3552)
- - RowsSent: 19.46K (19456)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 16.000ms
- - TotalBytesSent: 1.60 MB (1680613)
- - UncompressedRowBatchSize: 2.62 MB (2744320)
- HASH_JOIN_NODE (id=4):(Total: 28s520ms, non-child: 452.014ms, % non-child: 1.58%)
- ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- - BuildRows: 919.29K (919287)
- - BuildTime: 412.013ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 112.07 MB (117510400)
- - ProbeRows: 330.75K (330752)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 32.001ms
- - RowsReturned: 20.48K (20480)
- - RowsReturnedRate: 718.00 /sec
- Buffer pool:
- - AllocTime: 56.001ms
- - CumulativeAllocationBytes: 112.00 MB (117440512)
- - CumulativeAllocations: 96 (96)
- - PeakReservation: 112.00 MB (117440512)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 112.00 MB (117440512)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=4):
- ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- Runtime filters: 2 of 2 Runtime Filters Published
- - BuildRowsPartitionTime: 336.010ms
- - BuildRowsPartitioned: 919.29K (919287)
- - HashBuckets: 2.10M (2097152)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 72.002ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 30.12 KB (30848)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=7):(Total: 28s032ms, non-child: 56.001ms, % non-child: 0.20%)
- - ConvertRowBatchTime: 24.000ms
- - PeakMemoryUsage: 176.00 KB (180224)
- - RowsReturned: 919.29K (919287)
- - RowsReturnedRate: 32.79 K/sec
- Buffer pool:
- - AllocTime: 36.001ms
- - CumulativeAllocationBytes: 101.66 MB (106602496)
- - CumulativeAllocations: 8.68K (8678)
- - PeakReservation: 176.00 KB (180224)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 176.00 KB (180224)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(500.000ms): 0, 0, 0, 0, 0, 0, 0, 19.25 KB, 1.60 MB, 3.84 MB, 5.87 MB, 7.82 MB, 9.51 MB, 11.15 MB, 12.62 MB, 14.21 MB, 15.76 MB, 17.15 MB, 18.54 MB, 20.14 MB, 21.85 MB, 22.96 MB, 24.24 MB, 25.44 MB, 26.70 MB, 28.26 MB, 29.60 MB, 31.02 MB, 32.38 MB, 33.69 MB, 34.78 MB, 35.65 MB, 36.53 MB, 38.24 MB, 40.56 MB, 42.36 MB, 43.73 MB, 45.33 MB, 47.18 MB, 48.64 MB, 50.17 MB, 52.74 MB, 55.34 MB, 58.37 MB, 61.74 MB, 64.69 MB, 67.06 MB, 69.06 MB, 71.07 MB, 72.76 MB, 74.36 MB, 76.14 MB, 77.85 MB, 79.12 MB, 79.90 MB, 80.48 MB, 81.07 MB, 81.52 MB
- - FirstBatchWaitTime: 3s296ms
- - TotalBytesDequeued: 81.53 MB (85493691)
- - TotalGetBatchTime: 28s000ms
- - DataWaitTime: 27s976ms
- Enqueue:
- BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 13.82 KB, 1.15 MB, 2.76 MB, 4.22 MB, 5.63 MB, 6.85 MB, 8.03 MB, 9.09 MB, 10.24 MB, 11.35 MB, 12.36 MB, 13.36 MB, 14.52 MB, 15.75 MB, 16.55 MB, 17.48 MB, 18.34 MB, 19.26 MB, 20.38 MB, 21.35 MB, 22.38 MB, 23.36 MB, 24.31 MB, 25.10 MB, 25.72 MB, 26.36 MB, 27.60 MB, 29.27 MB, 30.57 MB, 31.57 MB, 32.72 MB, 34.05 MB, 35.11 MB, 36.22 MB, 38.08 MB, 39.96 MB, 42.15 MB, 44.58 MB, 46.72 MB, 48.43 MB, 49.87 MB, 51.32 MB, 52.55 MB, 53.70 MB, 55.00 MB, 56.23 MB, 57.15 MB, 57.71 MB, 58.13 MB, 58.55 MB, 58.87 MB
- DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 65.489us ; Min: 15.162us ; Max: 27.187ms ; Number of samples: 4339)
- - DeserializeRowBatchTime: 92.002ms
- - TotalBatchesEnqueued: 4.34K (4339)
- - TotalBatchesReceived: 4.34K (4339)
- - TotalBytesReceived: 58.89 MB (61746002)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 0.000ns
- - TotalRPCsDeferred: 0 (0)
- EXCHANGE_NODE (id=6):(Total: 876.028ms, non-child: 8.000ms, % non-child: 0.91%)
- - ConvertRowBatchTime: 8.000ms
- - PeakMemoryUsage: 12.18 MB (12768856)
- - RowsReturned: 330.75K (330752)
- - RowsReturnedRate: 377.56 K/sec
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 18.61 MB (19513344)
- - CumulativeAllocations: 1.59K (1588)
- - PeakReservation: 12.16 MB (12754944)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.16 MB (12754944)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(16s000ms): 18.00 KB, 2.44 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB, 12.94 MB
- - FirstBatchWaitTime: 840.027ms
- - TotalBytesDequeued: 12.94 MB (13564112)
- - TotalGetBatchTime: 868.028ms
- - DataWaitTime: 868.028ms
- Enqueue:
- BytesReceived(16s000ms): 4.89 MB, 5.96 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.27 MB
- DeferredQueueSize(16s000ms): 4, 4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 36.476us ; Min: 11.753us ; Max: 164.542us ; Number of samples: 794)
- - DeserializeRowBatchTime: 12.000ms
- - TotalBatchesEnqueued: 794 (794)
- - TotalBatchesReceived: 794 (794)
- - TotalBytesReceived: 8.27 MB (8673721)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 0 (0)
- - TotalHasDeferredRPCsTime: 27s073ms
- - TotalRPCsDeferred: 5 (5)
- CodeGen:(Total: 252.008ms, non-child: 252.008ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 72.002ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 78 (78)
- - NumInstructions: 2.75K (2748)
- - OptimizationTime: 160.005ms
- - PeakMemoryUsage: 1.34 MB (1406976)
- - PrepareTime: 20.000ms
- Averaged Fragment F00:(Total: 116.005ms, non-child: 0.000ns, % non-child: 0.00%)
- split sizes: min: 1.13 GB, max: 1.36 GB, avg: 1.28 GB, stddev: 82.09 MB
- completion times: min:10m30s max:10m30s mean: 10m30s stddev:0.000ns
- execution rates: min:1.84 MB/sec max:2.20 MB/sec mean:2.08 MB/sec stddev:133.39 KB/sec
- num instances: 6
- - AverageThreadTokens: 3.66
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 221.67 MB (232441613)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 3.76 GB (4033533655)
- - RowsProduced: 394.99K (394992)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 27s481ms
- - TotalStorageWaitTime: 960.042ms
- - TotalThreadsInvoluntaryContextSwitches: 2 (2)
- - TotalThreadsTotalWallClockTime: 341.349ms
- - TotalThreadsSysTime: 14.892ms
- - TotalThreadsUserTime: 109.408ms
- - TotalThreadsVoluntaryContextSwitches: 74 (74)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 0.000ns
- - ExecTreeExecTime: 1s120ms
- - OpenTime: 113.338ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 2.666ms
- - ExecTreePrepareTime: 666.688us
- KrpcDataStreamSender (dst_id=6):(Total: 27s569ms, non-child: 27s569ms, % non-child: 100.00%)
- - EosSent: 0 (0)
- - NetworkThroughput: 6.68 MB/sec
- - PeakMemoryUsage: 191.25 KB (195840)
- - RowsSent: 393.97K (393968)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 41.335ms
- - TotalBytesSent: 8.23 MB (8628523)
- - UncompressedRowBatchSize: 15.37 MB (16119669)
- HDFS_SCAN_NODE (id=1):(Total: 1s122ms, non-child: 1s122ms, % non-child: 100.00%)
- - AverageHdfsReadThreadConcurrency: 0.00
- - AverageScannerThreadConcurrency: 2.66
- - BytesRead: 178.44 MB (187103354)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 0
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 0
- - CachedFileHandlesHitCount: 0 (0)
- - CachedFileHandlesMissCount: 0 (0)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 84.003ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 6 (6)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 0 (0)
- - NumRowGroups: 2 (2)
- - NumScannerThreadsStarted: 10 (10)
- - NumScannersWithNoReads: 8 (8)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 219.41 MB (230072451)
- - PerReadThreadRawHdfsThroughput: 175.61 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 0.000ns
- - RowBatchQueuePutWaitTime: 0.000ns
- - RowsRead: 1.63M (1632959)
- - RowsReturned: 394.99K (394992)
- - RowsReturnedRate: 359.03 K/sec
- - ScanRangesComplete: 8 (8)
- - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
- - ScannerThreadsTotalWallClockTime: 228.010ms
- - MaterializeTupleTime(*): 6.666ms
- - ScannerThreadsSysTime: 6.840ms
- - ScannerThreadsUserTime: 5.282ms
- - ScannerThreadsVoluntaryContextSwitches: 48 (48)
- - TotalRawHdfsOpenFileTime(*): 268.012ms
- - TotalRawHdfsReadTime(*): 1s468ms
- - TotalReadThroughput: 290.89 KB/sec
- Filter 0 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 0 (0)
- - Rows rejected: 0 (0)
- - Rows total: 86.04K (86036)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 1 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 0 (0)
- - Rows rejected: 0 (0)
- - Rows total: 86.04K (86036)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 111.338ms, non-child: 111.338ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 20.000ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 64 (64)
- - NumInstructions: 1.09K (1091)
- - OptimizationTime: 71.336ms
- - PeakMemoryUsage: 545.50 KB (558592)
- - PrepareTime: 20.000ms
- Fragment F00:
- Instance 33406f6405038287:b47e1f8b00000006 (host=slave-cn02:22000):(Total: 120.005ms, non-child: 0.000ns, % non-child: 0.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.36 GB
- Filter 1 arrival: 28s674ms
- Filter 0 arrival: 28s676ms
- Fragment Instance Lifecycle Event Timeline: 1s032ms
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 120.005ms (116.005ms)
- - First Batch Produced: 1s032ms (912.042ms)
- - First Batch Sent: 1s032ms (0.000ns)
- MemoryUsage(16s000ms): 304.17 MB, 325.17 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB, 325.44 MB
- ThreadUsage(16s000ms): 4, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5
- - AverageThreadTokens: 4.99
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 325.54 MB (341357839)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 4.26 GB (4572618824)
- - RowsProduced: 563.20K (563200)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 27s569ms
- - TotalStorageWaitTime: 668.030ms
- - TotalThreadsInvoluntaryContextSwitches: 6 (6)
- - TotalThreadsTotalWallClockTime: 336.015ms
- - TotalThreadsSysTime: 15.648ms
- - TotalThreadsUserTime: 101.151ms
- - TotalThreadsVoluntaryContextSwitches: 74 (74)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 0.000ns
- - ExecTreeExecTime: 1s008ms
- - OpenTime: 116.005ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 4.000ms
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=6):(Total: 27s689ms, non-child: 120.005ms, % non-child: 0.43%)
- BytesSent(16s000ms): 7.81 MB, 9.13 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB, 11.79 MB
- - EosSent: 0 (0)
- - NetworkThroughput: 6.51 MB/sec
- - PeakMemoryUsage: 191.25 KB (195840)
- - RowsSent: 562.18K (562176)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 52.002ms
- - TotalBytesSent: 11.79 MB (12364972)
- - UncompressedRowBatchSize: 21.93 MB (23000016)
- HDFS_SCAN_NODE (id=1):(Total: 1s008ms, non-child: 1s008ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.36 GB
- ExecOption: PARQUET Codegen Enabled
- Runtime filters: Not all filters arrived (arrived: [], missing [0, 1]), waited for 903ms
- BytesRead(16s000ms): 244.20 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB
- - FooterProcessingTime: (Avg: 30.910ms ; Min: 8.000ms ; Max: 40.001ms ; Number of samples: 11)
- - AverageHdfsReadThreadConcurrency: 0.00
- - AverageScannerThreadConcurrency: 3.99
- - BytesRead: 261.54 MB (274245997)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 0
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 0
- - CachedFileHandlesHitCount: 0 (0)
- - CachedFileHandlesMissCount: 0 (0)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 136.006ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 6 (6)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 0 (0)
- - NumRowGroups: 4 (4)
- - NumScannerThreadsStarted: 11 (11)
- - NumScannersWithNoReads: 7 (7)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 323.27 MB (338978096)
- - PerReadThreadRawHdfsThroughput: 510.80 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 0.000ns
- - RowBatchQueuePutWaitTime: 0.000ns
- - RowsRead: 2.26M (2255872)
- - RowsReturned: 563.20K (563200)
- - RowsReturnedRate: 558.70 K/sec
- - ScanRangesComplete: 7 (7)
- - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
- - ScannerThreadsTotalWallClockTime: 220.010ms
- - MaterializeTupleTime(*): 0.000ns
- - ScannerThreadsSysTime: 2.179ms
- - ScannerThreadsUserTime: 0.000ns
- - ScannerThreadsVoluntaryContextSwitches: 34 (34)
- - TotalRawHdfsOpenFileTime(*): 356.016ms
- - TotalRawHdfsReadTime(*): 512.023ms
- - TotalReadThroughput: 425.78 KB/sec
- Filter 0 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 0 (0)
- - Rows rejected: 0 (0)
- - Rows total: 0 (0)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 1 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 0 (0)
- - Rows rejected: 0 (0)
- - Rows total: 0 (0)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 112.005ms, non-child: 112.005ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 20.000ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 64 (64)
- - NumInstructions: 1.09K (1091)
- - OptimizationTime: 72.003ms
- - PeakMemoryUsage: 545.50 KB (558592)
- - PrepareTime: 20.000ms
- Instance 33406f6405038287:b47e1f8b00000001 (host=slave-cn04:22000):(Total: 116.006ms, non-child: 0.000ns, % non-child: 0.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.28 GB
- Filter 1 arrival: 28s692ms
- Filter 0 arrival: 28s695ms
- Fragment Instance Lifecycle Event Timeline: 1s048ms
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 116.006ms (112.005ms)
- - First Batch Produced: 1s048ms (932.049ms)
- - First Batch Sent: 1s048ms (0.000ns)
- MemoryUsage(16s000ms): 151.15 MB, 165.49 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB, 165.55 MB
- ThreadUsage(16s000ms): 2, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3
- - AverageThreadTokens: 3.00
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 165.73 MB (173783236)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 3.83 GB (4109447221)
- - RowsProduced: 357.38K (357376)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 27s393ms
- - TotalStorageWaitTime: 840.044ms
- - TotalThreadsInvoluntaryContextSwitches: 2 (2)
- - TotalThreadsTotalWallClockTime: 300.015ms
- - TotalThreadsSysTime: 8.675ms
- - TotalThreadsUserTime: 105.768ms
- - TotalThreadsVoluntaryContextSwitches: 63 (63)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 0.000ns
- - ExecTreeExecTime: 1s216ms
- - OpenTime: 112.005ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 4.000ms
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=6):(Total: 27s477ms, non-child: 84.004ms, % non-child: 0.31%)
- BytesSent(16s000ms): 3.92 MB, 4.92 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB
- - EosSent: 0 (0)
- - NetworkThroughput: 7.94 MB/sec
- - PeakMemoryUsage: 191.25 KB (195840)
- - RowsSent: 356.35K (356352)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 32.001ms
- - TotalBytesSent: 7.42 MB (7780682)
- - UncompressedRowBatchSize: 13.89 MB (14560576)
- HDFS_SCAN_NODE (id=1):(Total: 1s216ms, non-child: 1s216ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.28 GB
- ExecOption: PARQUET Codegen Enabled
- Runtime filters: Not all filters arrived (arrived: [], missing [0, 1]), waited for 924ms
- BytesRead(16s000ms): 118.15 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB, 130.44 MB
- - FooterProcessingTime: (Avg: 15.273ms ; Min: 4.000ms ; Max: 28.001ms ; Number of samples: 11)
- - AverageHdfsReadThreadConcurrency: 0.00
- - AverageScannerThreadConcurrency: 2.00
- - BytesRead: 130.44 MB (136778416)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 0
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 0
- - CachedFileHandlesHitCount: 0 (0)
- - CachedFileHandlesMissCount: 0 (0)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 84.004ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 6 (6)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 0 (0)
- - NumRowGroups: 2 (2)
- - NumScannerThreadsStarted: 11 (11)
- - NumScannersWithNoReads: 9 (9)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 163.49 MB (171436261)
- - PerReadThreadRawHdfsThroughput: 94.52 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 0.000ns
- - RowBatchQueuePutWaitTime: 0.000ns
- - RowsRead: 1.48M (1480704)
- - RowsReturned: 357.38K (357376)
- - RowsReturnedRate: 293.88 K/sec
- - ScanRangesComplete: 9 (9)
- - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
- - ScannerThreadsTotalWallClockTime: 188.009ms
- - MaterializeTupleTime(*): 0.000ns
- - ScannerThreadsSysTime: 2.482ms
- - ScannerThreadsUserTime: 0.000ns
- - ScannerThreadsVoluntaryContextSwitches: 42 (42)
- - TotalRawHdfsOpenFileTime(*): 216.011ms
- - TotalRawHdfsReadTime(*): 1s380ms
- - TotalReadThroughput: 212.36 KB/sec
- Filter 0 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 0 (0)
- - Rows rejected: 0 (0)
- - Rows total: 0 (0)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 1 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 0 (0)
- - Rows rejected: 0 (0)
- - Rows total: 0 (0)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 112.005ms, non-child: 112.005ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 20.001ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 64 (64)
- - NumInstructions: 1.09K (1091)
- - OptimizationTime: 72.003ms
- - PeakMemoryUsage: 545.50 KB (558592)
- - PrepareTime: 20.001ms
- Instance 33406f6405038287:b47e1f8b00000004 (host=slave-cn07:22000):(Total: 116.005ms, non-child: 0.000ns, % non-child: 0.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/1.23 GB
- Filter 1 arrival: 28s723ms
- Filter 0 arrival: 28s726ms
- Fragment Instance Lifecycle Event Timeline: 1s052ms
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 116.005ms (112.005ms)
- - First Batch Produced: 1s052ms (936.044ms)
- - First Batch Sent: 1s052ms (0.000ns)
- MemoryUsage(16s000ms): 78.91 MB, 85.56 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB, 85.59 MB
- ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2
- - AverageThreadTokens: 2.00
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 85.69 MB (89853512)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 2.87 GB (3082904484)
- - RowsProduced: 381.95K (381952)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 27s397ms
- - TotalStorageWaitTime: 428.020ms
- - TotalThreadsInvoluntaryContextSwitches: 2 (2)
- - TotalThreadsTotalWallClockTime: 300.014ms
- - TotalThreadsSysTime: 11.589ms
- - TotalThreadsUserTime: 101.183ms
- - TotalThreadsVoluntaryContextSwitches: 66 (66)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 0.000ns
- - ExecTreeExecTime: 1s200ms
- - OpenTime: 112.005ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 4.000ms
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=6):(Total: 27s485ms, non-child: 88.004ms, % non-child: 0.32%)
- BytesSent(16s000ms): 4.72 MB, 5.72 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB, 7.95 MB
- - EosSent: 0 (0)
- - NetworkThroughput: 8.88 MB/sec
- - PeakMemoryUsage: 191.25 KB (195840)
- - RowsSent: 380.93K (380928)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 40.001ms
- - TotalBytesSent: 7.95 MB (8332124)
- - UncompressedRowBatchSize: 14.88 MB (15597712)
- HDFS_SCAN_NODE (id=1):(Total: 1s200ms, non-child: 1s200ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/1.23 GB
- ExecOption: PARQUET Codegen Enabled
- Runtime filters: Not all filters arrived (arrived: [], missing [0, 1]), waited for 923ms
- BytesRead(16s000ms): 66.15 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB, 72.59 MB
- - FooterProcessingTime: (Avg: 18.800ms ; Min: 8.000ms ; Max: 28.001ms ; Number of samples: 10)
- - AverageHdfsReadThreadConcurrency: 0.00
- - AverageScannerThreadConcurrency: 1.00
- - BytesRead: 72.59 MB (76118323)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 0
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 0
- - CachedFileHandlesHitCount: 0 (0)
- - CachedFileHandlesMissCount: 0 (0)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 48.002ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 6 (6)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 0 (0)
- - NumRowGroups: 1 (1)
- - NumScannerThreadsStarted: 10 (10)
- - NumScannersWithNoReads: 9 (9)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 83.47 MB (87522921)
- - PerReadThreadRawHdfsThroughput: 115.59 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 0.000ns
- - RowBatchQueuePutWaitTime: 0.000ns
- - RowsRead: 1.57M (1572864)
- - RowsReturned: 381.95K (381952)
- - RowsReturnedRate: 318.28 K/sec
- - ScanRangesComplete: 9 (9)
- - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
- - ScannerThreadsTotalWallClockTime: 188.008ms
- - MaterializeTupleTime(*): 0.000ns
- - ScannerThreadsSysTime: 1.776ms
- - ScannerThreadsUserTime: 221.000us
- - ScannerThreadsVoluntaryContextSwitches: 41 (41)
- - TotalRawHdfsOpenFileTime(*): 196.009ms
- - TotalRawHdfsReadTime(*): 628.029ms
- - TotalReadThroughput: 118.93 KB/sec
- Filter 0 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 0 (0)
- - Rows rejected: 0 (0)
- - Rows total: 0 (0)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 1 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 0 (0)
- - Rows rejected: 0 (0)
- - Rows total: 0 (0)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 108.005ms, non-child: 108.005ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 20.000ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 64 (64)
- - NumInstructions: 1.09K (1091)
- - OptimizationTime: 72.003ms
- - PeakMemoryUsage: 545.50 KB (558592)
- - PrepareTime: 16.000ms
- Instance 33406f6405038287:b47e1f8b00000005 (host=slave-cn03:22000):(Total: 116.005ms, non-child: 0.000ns, % non-child: 0.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.13 GB
- Filter 1 arrival: 28s683ms
- Filter 0 arrival: 28s685ms
- Fragment Instance Lifecycle Event Timeline: 1s036ms
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 120.005ms (116.005ms)
- - First Batch Produced: 1s036ms (916.041ms)
- - First Batch Sent: 1s036ms (0.000ns)
- MemoryUsage(16s000ms): 301.68 MB, 331.09 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB, 331.38 MB
- ThreadUsage(16s000ms): 4, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5
- - AverageThreadTokens: 4.99
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 331.54 MB (347647974)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 4.23 GB (4540696369)
- - RowsProduced: 416.16K (416161)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 27s613ms
- - TotalStorageWaitTime: 1s904ms
- - TotalThreadsInvoluntaryContextSwitches: 2 (2)
- - TotalThreadsTotalWallClockTime: 552.025ms
- - TotalThreadsSysTime: 39.007ms
- - TotalThreadsUserTime: 134.341ms
- - TotalThreadsVoluntaryContextSwitches: 86 (86)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 0.000ns
- - ExecTreeExecTime: 976.044ms
- - OpenTime: 116.005ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=6):(Total: 27s709ms, non-child: 96.004ms, % non-child: 0.35%)
- BytesSent(16s000ms): 5.84 MB, 6.86 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB, 8.68 MB
- - EosSent: 0 (0)
- - NetworkThroughput: 4.32 MB/sec
- - PeakMemoryUsage: 191.25 KB (195840)
- - RowsSent: 415.14K (415137)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 36.001ms
- - TotalBytesSent: 8.68 MB (9101183)
- - UncompressedRowBatchSize: 16.21 MB (17000896)
- HDFS_SCAN_NODE (id=1):(Total: 976.044ms, non-child: 976.044ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.13 GB
- ExecOption: PARQUET Codegen Enabled
- Runtime filters: Not all filters arrived (arrived: [], missing [0, 1]), waited for 903ms
- BytesRead(16s000ms): 242.40 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB, 268.32 MB
- - FooterProcessingTime: (Avg: 26.910ms ; Min: 12.000ms ; Max: 44.002ms ; Number of samples: 11)
- - AverageHdfsReadThreadConcurrency: 0.01
- - AverageScannerThreadConcurrency: 4.00
- - BytesRead: 268.32 MB (281349378)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 0
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 0
- - CachedFileHandlesHitCount: 0 (0)
- - CachedFileHandlesMissCount: 0 (0)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 80.003ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 6 (6)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 0 (0)
- - NumRowGroups: 5 (5)
- - NumScannerThreadsStarted: 11 (11)
- - NumScannersWithNoReads: 6 (6)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 329.25 MB (345242631)
- - PerReadThreadRawHdfsThroughput: 86.33 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 0.000ns
- - RowBatchQueuePutWaitTime: 0.000ns
- - RowsRead: 1.72M (1721466)
- - RowsReturned: 416.16K (416161)
- - RowsReturnedRate: 426.38 K/sec
- - ScanRangesComplete: 7 (7)
- - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
- - ScannerThreadsTotalWallClockTime: 436.019ms
- - MaterializeTupleTime(*): 40.001ms
- - ScannerThreadsSysTime: 29.060ms
- - ScannerThreadsUserTime: 30.960ms
- - ScannerThreadsVoluntaryContextSwitches: 72 (72)
- - TotalRawHdfsOpenFileTime(*): 404.018ms
- - TotalRawHdfsReadTime(*): 3s108ms
- - TotalReadThroughput: 438.21 KB/sec
- Filter 0 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 0 (0)
- - Rows rejected: 0 (0)
- - Rows total: 516.22K (516218)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 1 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 0 (0)
- - Rows rejected: 0 (0)
- - Rows total: 516.22K (516218)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 116.005ms, non-child: 116.005ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 20.000ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 64 (64)
- - NumInstructions: 1.09K (1091)
- - OptimizationTime: 72.003ms
- - PeakMemoryUsage: 545.50 KB (558592)
- - PrepareTime: 24.001ms
- Instance 33406f6405038287:b47e1f8b00000002 (host=slave-cn06:22000):(Total: 116.003ms, non-child: 0.000ns, % non-child: 0.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.35 GB
- Filter 1 arrival: 28s713ms
- Filter 0 arrival: 28s716ms
- Fragment Instance Lifecycle Event Timeline: 1s048ms
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 116.003ms (112.003ms)
- - First Batch Produced: 1s048ms (932.030ms)
- - First Batch Sent: 1s048ms (0.000ns)
- MemoryUsage(16s000ms): 301.62 MB, 330.93 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB, 331.04 MB
- ThreadUsage(16s000ms): 4, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5
- - AverageThreadTokens: 4.99
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 331.59 MB (347696049)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 4.27 GB (4582467103)
- - RowsProduced: 261.12K (261120)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 27s504ms
- - TotalStorageWaitTime: 1s544ms
- - TotalThreadsInvoluntaryContextSwitches: 1 (1)
- - TotalThreadsTotalWallClockTime: 208.006ms
- - TotalThreadsSysTime: 8.499ms
- - TotalThreadsUserTime: 104.556ms
- - TotalThreadsVoluntaryContextSwitches: 62 (62)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 0.000ns
- - ExecTreeExecTime: 1s136ms
- - OpenTime: 112.003ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 4.000ms
- - ExecTreePrepareTime: 4.000ms
- KrpcDataStreamSender (dst_id=6):(Total: 27s560ms, non-child: 56.001ms, % non-child: 0.20%)
- BytesSent(16s000ms): 2.15 MB, 2.95 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB, 5.43 MB
- - EosSent: 0 (0)
- - NetworkThroughput: 4.77 MB/sec
- - PeakMemoryUsage: 191.25 KB (195840)
- - RowsSent: 260.10K (260096)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 44.001ms
- - TotalBytesSent: 5.43 MB (5693315)
- - UncompressedRowBatchSize: 10.16 MB (10656064)
- HDFS_SCAN_NODE (id=1):(Total: 1s148ms, non-child: 1s148ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.35 GB
- ExecOption: PARQUET Codegen Enabled
- Runtime filters: Not all filters arrived (arrived: [], missing [0, 1]), waited for 923ms
- BytesRead(16s000ms): 238.17 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB, 263.05 MB
- - FooterProcessingTime: (Avg: 10.909ms ; Min: 4.000ms ; Max: 24.000ms ; Number of samples: 11)
- - AverageHdfsReadThreadConcurrency: 0.01
- - AverageScannerThreadConcurrency: 4.00
- - BytesRead: 263.05 MB (275825498)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 0
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 0
- - CachedFileHandlesHitCount: 0 (0)
- - CachedFileHandlesMissCount: 0 (0)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 84.002ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 6 (6)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 0 (0)
- - NumRowGroups: 4 (4)
- - NumScannerThreadsStarted: 11 (11)
- - NumScannersWithNoReads: 7 (7)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 329.33 MB (345331666)
- - PerReadThreadRawHdfsThroughput: 98.30 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 0.000ns
- - RowBatchQueuePutWaitTime: 0.000ns
- - RowsRead: 1.17M (1169408)
- - RowsReturned: 261.12K (261120)
- - RowsReturnedRate: 227.45 K/sec
- - ScanRangesComplete: 7 (7)
- - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
- - ScannerThreadsTotalWallClockTime: 96.003ms
- - MaterializeTupleTime(*): 0.000ns
- - ScannerThreadsSysTime: 2.291ms
- - ScannerThreadsUserTime: 0.000ns
- - ScannerThreadsVoluntaryContextSwitches: 36 (36)
- - TotalRawHdfsOpenFileTime(*): 316.010ms
- - TotalRawHdfsReadTime(*): 2s676ms
- - TotalReadThroughput: 427.90 KB/sec
- Filter 0 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 0 (0)
- - Rows rejected: 0 (0)
- - Rows total: 0 (0)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 1 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 0 (0)
- - Rows rejected: 0 (0)
- - Rows total: 0 (0)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 108.003ms, non-child: 108.003ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 20.000ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 64 (64)
- - NumInstructions: 1.09K (1091)
- - OptimizationTime: 72.002ms
- - PeakMemoryUsage: 545.50 KB (558592)
- - PrepareTime: 16.000ms
- Instance 33406f6405038287:b47e1f8b00000003 (host=slave-cn05:22000):(Total: 112.006ms, non-child: 0.000ns, % non-child: 0.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.35 GB
- Filter 1 arrival: 28s703ms
- Filter 0 arrival: 28s708ms
- Fragment Instance Lifecycle Event Timeline: 1s048ms
- - Prepare Finished: 0.000ns (0.000ns)
- - Open Finished: 112.006ms (112.006ms)
- - First Batch Produced: 1s048ms (936.051ms)
- - First Batch Sent: 1s048ms (0.000ns)
- MemoryUsage(16s000ms): 84.03 MB, 89.53 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB, 89.54 MB
- ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2
- - AverageThreadTokens: 2.00
- - BloomFilterBytes: 2.00 MB (2097152)
- - PeakMemoryUsage: 89.94 MB (94311071)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 3.09 GB (3313067929)
- - RowsProduced: 390.14K (390144)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 27s409ms
- - TotalStorageWaitTime: 376.020ms
- - TotalThreadsInvoluntaryContextSwitches: 1 (1)
- - TotalThreadsTotalWallClockTime: 352.019ms
- - TotalThreadsSysTime: 5.936ms
- - TotalThreadsUserTime: 109.450ms
- - TotalThreadsVoluntaryContextSwitches: 93 (93)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 2.00 MB (2097152)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 2.00 MB (2097152)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 2.00 MB (2097152)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 2.00 MB (2097152)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 0.000ns
- - ExecTreeExecTime: 1s184ms
- - OpenTime: 112.006ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=6):(Total: 27s497ms, non-child: 88.004ms, % non-child: 0.32%)
- BytesSent(16s000ms): 4.95 MB, 5.98 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB, 8.11 MB
- - EosSent: 0 (0)
- - NetworkThroughput: 7.65 MB/sec
- - PeakMemoryUsage: 191.25 KB (195840)
- - RowsSent: 389.12K (389120)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 44.002ms
- - TotalBytesSent: 8.11 MB (8498867)
- - UncompressedRowBatchSize: 15.17 MB (15902752)
- HDFS_SCAN_NODE (id=1):(Total: 1s184ms, non-child: 1s184ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.35 GB
- ExecOption: PARQUET Codegen Enabled
- Runtime filters: Not all filters arrived (arrived: [], missing [0, 1]), waited for 924ms
- BytesRead(16s000ms): 69.76 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB, 74.68 MB
- - FooterProcessingTime: (Avg: 14.182ms ; Min: 4.000ms ; Max: 32.001ms ; Number of samples: 11)
- - AverageHdfsReadThreadConcurrency: 0.00
- - AverageScannerThreadConcurrency: 1.00
- - BytesRead: 74.68 MB (78302514)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 0
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 0
- - CachedFileHandlesHitCount: 0 (0)
- - CachedFileHandlesMissCount: 0 (0)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 72.003ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 6 (6)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 0 (0)
- - NumRowGroups: 1 (1)
- - NumScannerThreadsStarted: 11 (11)
- - NumScannersWithNoReads: 10 (10)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 87.66 MB (91923136)
- - PerReadThreadRawHdfsThroughput: 148.16 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 0.000ns
- - RowBatchQueuePutWaitTime: 0.000ns
- - RowsRead: 1.60M (1597440)
- - RowsReturned: 390.14K (390144)
- - RowsReturnedRate: 329.50 K/sec
- - ScanRangesComplete: 10 (10)
- - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
- - ScannerThreadsTotalWallClockTime: 240.013ms
- - MaterializeTupleTime(*): 0.000ns
- - ScannerThreadsSysTime: 3.257ms
- - ScannerThreadsUserTime: 511.000us
- - ScannerThreadsVoluntaryContextSwitches: 63 (63)
- - TotalRawHdfsOpenFileTime(*): 120.006ms
- - TotalRawHdfsReadTime(*): 504.027ms
- - TotalReadThroughput: 122.15 KB/sec
- Filter 0 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 0 (0)
- - Rows rejected: 0 (0)
- - Rows total: 0 (0)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 1 (1.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 0 (0)
- - Rows rejected: 0 (0)
- - Rows total: 0 (0)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 112.006ms, non-child: 112.006ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 20.001ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 64 (64)
- - NumInstructions: 1.09K (1091)
- - OptimizationTime: 68.003ms
- - PeakMemoryUsage: 545.50 KB (558592)
- - PrepareTime: 24.001ms
- Averaged Fragment F01:(Total: 24s784ms, non-child: 4s119ms, % non-child: 16.62%)
- split sizes: min: 8.25 GB, max: 8.49 GB, avg: 8.41 GB, stddev: 86.46 MB
- completion times: min:21s036ms max:28s645ms mean: 24s789ms stddev:2s668ms
- execution rates: min:295.04 MB/sec max:413.34 MB/sec mean:351.59 MB/sec stddev:41.01 MB/sec
- num instances: 6
- - AverageThreadTokens: 15.37
- - BloomFilterBytes: 8.00 MB (8388608)
- - PeakMemoryUsage: 3.49 GB (3748681192)
- - PeakReservation: 360.00 MB (377487360)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 3.76 GB (4033533655)
- - RowsProduced: 918.86K (918861)
- - TotalNetworkReceiveTime: 1s498ms
- - TotalNetworkSendTime: 9s413ms
- - TotalStorageWaitTime: 1m50s
- - TotalThreadsInvoluntaryContextSwitches: 2.56K (2562)
- - TotalThreadsTotalWallClockTime: 6m30s
- - TotalThreadsSysTime: 23s461ms
- - TotalThreadsUserTime: 22s761ms
- - TotalThreadsVoluntaryContextSwitches: 81.39K (81394)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 8.00 MB (8388608)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 8.00 MB (8388608)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 8.00 MB (8388608)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 8.00 MB (8388608)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 21s124ms
- - ExecTreeExecTime: 6s894ms
- - OpenTime: 3s655ms
- - ExecTreeOpenTime: 3s317ms
- - PrepareTime: 4.666ms
- - ExecTreePrepareTime: 2.000ms
- KrpcDataStreamSender (dst_id=7):(Total: 10s117ms, non-child: 10s117ms, % non-child: 100.00%)
- - EosSent: 6 (6)
- - NetworkThroughput: 1.56 MB/sec
- - PeakMemoryUsage: 187.88 KB (192384)
- - RowsSent: 918.86K (918861)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 305.347ms
- - TotalBytesSent: 58.86 MB (61717785)
- - UncompressedRowBatchSize: 81.50 MB (85454104)
- HASH_JOIN_NODE (id=3):(Total: 10s213ms, non-child: 6s120ms, % non-child: 59.92%)
- - BuildRows: 7.36M (7358720)
- - BuildTime: 1s242ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 352.37 MB (369485738)
- - ProbeRows: 33.05M (33045621)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 4s804ms
- - RowsReturned: 918.86K (918861)
- - RowsReturnedRate: 90.97 K/sec
- Buffer pool:
- - AllocTime: 2.666ms
- - CumulativeAllocationBytes: 352.00 MB (369098752)
- - CumulativeAllocations: 64 (64)
- - PeakReservation: 352.00 MB (369098752)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 352.00 MB (369098752)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=3):
- - BuildRowsPartitionTime: 672.698ms
- - BuildRowsPartitioned: 7.36M (7358720)
- - HashBuckets: 16.78M (16777216)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 559.359ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 22.12 KB (22656)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=5):(Total: 1s610ms, non-child: 1s610ms, % non-child: 100.00%)
- - ConvertRowBatchTime: 106.671ms
- - PeakMemoryUsage: 12.69 MB (13302259)
- - RowsReturned: 7.36M (7358720)
- - RowsReturnedRate: 4.59 M/sec
- Buffer pool:
- - AllocTime: 29.334ms
- - CumulativeAllocationBytes: 168.48 MB (176668672)
- - CumulativeAllocations: 14.38K (14380)
- - PeakReservation: 12.65 MB (13262848)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.65 MB (13262848)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- - FirstBatchWaitTime: 0.000ns
- - TotalBytesDequeued: 133.34 MB (139815680)
- - TotalGetBatchTime: 1s497ms
- - DataWaitTime: 1s490ms
- Enqueue:
- - DeserializeRowBatchTime: 160.674ms
- - TotalBatchesEnqueued: 7.19K (7190)
- - TotalBatchesReceived: 7.19K (7190)
- - TotalBytesReceived: 66.74 MB (69986621)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 52.460ms
- - TotalRPCsDeferred: 5 (5)
- HDFS_SCAN_NODE (id=2):(Total: 2s482ms, non-child: 2s482ms, % non-child: 100.00%)
- - AverageHdfsReadThreadConcurrency: 3.37
- - AverageScannerThreadConcurrency: 14.50
- - BytesRead: 4.57 GB (4910925278)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 3.17 GB (3402812333)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 3.17 GB (3402812333)
- - CachedFileHandlesHitCount: 238 (238)
- - CachedFileHandlesMissCount: 199 (199)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 13s278ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 10 (10)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 2 (2)
- - NumRowGroups: 19 (19)
- - NumScannerThreadsStarted: 37 (37)
- - NumScannersWithNoReads: 50 (50)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 3.13 GB (3362860441)
- - PerReadThreadRawHdfsThroughput: 153.50 MB/sec
- - RemoteScanRanges: 290 (290)
- - RowBatchQueueGetWaitTime: 2s166ms
- - RowBatchQueuePutWaitTime: 3m21s
- - RowsRead: 104.88M (104882858)
- - RowsReturned: 33.05M (33045621)
- - RowsReturnedRate: 18.14 M/sec
- - ScanRangesComplete: 69 (69)
- - ScannerThreadsInvoluntaryContextSwitches: 2.52K (2518)
- - ScannerThreadsTotalWallClockTime: 6m3s
- - MaterializeTupleTime(*): 26s553ms
- - ScannerThreadsSysTime: 18s808ms
- - ScannerThreadsUserTime: 16s167ms
- - ScannerThreadsVoluntaryContextSwitches: 74.64K (74645)
- - TotalRawHdfsOpenFileTime(*): 5s272ms
- - TotalRawHdfsReadTime(*): 1m25s
- - TotalReadThroughput: 188.30 MB/sec
- Filter 4 (4.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 1.25M (1252891)
- - Rows rejected: 87.93K (87927)
- - Rows total: 104.90M (104904362)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 5 (4.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 1.08M (1077309)
- - Rows rejected: 24.76K (24762)
- - Rows total: 104.82M (104816434)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 333.349ms, non-child: 333.349ms, % non-child: 100.00%)
- - CodegenTime: 3.333ms
- - CompileTime: 85.337ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 113 (113)
- - NumInstructions: 3.40K (3401)
- - OptimizationTime: 224.010ms
- - PeakMemoryUsage: 1.66 MB (1741312)
- - PrepareTime: 23.334ms
- Fragment F01:
- Instance 33406f6405038287:b47e1f8b00000011 (host=slave-cn02:22000):(Total: 28s641ms, non-child: 4s924ms, % non-child: 17.19%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:67/8.25 GB
- Filter 4 arrival: 2s652ms
- Filter 5 arrival: 2s652ms
- Fragment Instance Lifecycle Event Timeline: 28s641ms
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 3s880ms (3s876ms)
- - First Batch Produced: 3s896ms (16.000ms)
- - First Batch Sent: 3s900ms (4.000ms)
- - ExecInternal Finished: 28s641ms (24s741ms)
- MemoryUsage(500.000ms): 14.64 MB, 54.74 MB, 84.74 MB, 84.74 MB, 116.74 MB, 164.75 MB, 361.25 MB, 620.30 MB, 957.30 MB, 1.31 GB, 1.42 GB, 1.57 GB, 1.68 GB, 1.70 GB, 1.82 GB, 1.92 GB, 1.92 GB, 1.94 GB, 1.97 GB, 2.16 GB, 2.21 GB, 2.21 GB, 2.29 GB, 2.42 GB, 2.51 GB, 2.52 GB, 2.54 GB, 2.58 GB, 2.61 GB, 2.73 GB, 2.86 GB, 2.88 GB, 2.91 GB, 2.93 GB, 3.03 GB, 3.34 GB, 3.34 GB, 3.42 GB, 3.70 GB, 3.86 GB, 3.86 GB, 3.83 GB, 3.79 GB, 3.77 GB, 3.65 GB, 3.50 GB, 3.42 GB, 3.34 GB, 3.28 GB, 3.23 GB, 2.90 GB, 2.74 GB, 2.47 GB, 2.00 GB, 1.64 GB, 1.31 GB, 704.50 MB
- ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 30, 30, 25, 24, 24, 23, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 19, 18, 17, 14, 12, 9, 5
- - AverageThreadTokens: 17.91
- - BloomFilterBytes: 8.00 MB (8388608)
- - PeakMemoryUsage: 3.88 GB (4166322160)
- - PeakReservation: 360.00 MB (377487360)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 4.26 GB (4572618824)
- - RowsProduced: 1.03M (1034898)
- - TotalNetworkReceiveTime: 1s512ms
- - TotalNetworkSendTime: 9s780ms
- - TotalStorageWaitTime: 3m11s
- - TotalThreadsInvoluntaryContextSwitches: 3.96K (3965)
- - TotalThreadsTotalWallClockTime: 8m23s
- - TotalThreadsSysTime: 27s972ms
- - TotalThreadsUserTime: 25s211ms
- - TotalThreadsVoluntaryContextSwitches: 99.93K (99929)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 8.00 MB (8388608)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 8.00 MB (8388608)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 8.00 MB (8388608)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 8.00 MB (8388608)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 24s761ms
- - ExecTreeExecTime: 9s188ms
- - OpenTime: 3s876ms
- - ExecTreeOpenTime: 3s552ms
- - PrepareTime: 4.000ms
- - ExecTreePrepareTime: 4.000ms
- KrpcDataStreamSender (dst_id=7):(Total: 10s652ms, non-child: 872.040ms, % non-child: 8.19%)
- BytesSent(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 579.32 KB, 1.78 MB, 2.83 MB, 3.67 MB, 4.76 MB, 5.55 MB, 6.09 MB, 6.68 MB, 7.91 MB, 8.06 MB, 8.33 MB, 9.13 MB, 9.83 MB, 10.20 MB, 10.93 MB, 11.65 MB, 12.18 MB, 12.71 MB, 13.25 MB, 14.07 MB, 14.62 MB, 15.32 MB, 15.83 MB, 16.02 MB, 16.19 MB, 16.76 MB, 18.04 MB, 18.92 MB, 20.01 MB, 21.15 MB, 22.13 MB, 23.45 MB, 25.01 MB, 27.46 MB, 29.11 MB, 32.19 MB, 35.12 MB, 38.23 MB, 40.29 MB, 42.29 MB, 45.08 MB, 46.99 MB, 49.20 MB, 51.48 MB, 54.52 MB, 57.28 MB, 59.94 MB, 62.65 MB, 65.08 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 1.49 MB/sec
- - PeakMemoryUsage: 187.88 KB (192384)
- - RowsSent: 1.03M (1034898)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 420.019ms
- - TotalBytesSent: 66.29 MB (69512790)
- - UncompressedRowBatchSize: 91.79 MB (96245514)
- HASH_JOIN_NODE (id=3):(Total: 12s744ms, non-child: 6s760ms, % non-child: 53.04%)
- ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- - BuildRows: 7.36M (7358720)
- - BuildTime: 1s280ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 352.42 MB (369541376)
- - ProbeRows: 36.96M (36961674)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 5s408ms
- - RowsReturned: 1.03M (1034898)
- - RowsReturnedRate: 81.20 K/sec
- Buffer pool:
- - AllocTime: 4.000ms
- - CumulativeAllocationBytes: 352.00 MB (369098752)
- - CumulativeAllocations: 64 (64)
- - PeakReservation: 352.00 MB (369098752)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 352.00 MB (369098752)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=3):
- ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- Runtime filters: 2 of 2 Runtime Filters Published
- - BuildRowsPartitionTime: 684.031ms
- - BuildRowsPartitioned: 7.36M (7358720)
- - HashBuckets: 16.78M (16777216)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 588.027ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 22.12 KB (22656)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=5):(Total: 1s620ms, non-child: 112.005ms, % non-child: 6.91%)
- - ConvertRowBatchTime: 100.004ms
- - PeakMemoryUsage: 12.69 MB (13302259)
- - RowsReturned: 7.36M (7358720)
- - RowsReturnedRate: 4.54 M/sec
- Buffer pool:
- - AllocTime: 28.001ms
- - CumulativeAllocationBytes: 168.48 MB (176668672)
- - CumulativeAllocations: 14.38K (14380)
- - PeakReservation: 12.65 MB (13262848)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.65 MB (13262848)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(500.000ms): 0, 39.69 MB, 74.89 MB, 87.34 MB, 119.27 MB, 133.34 MB
- - FirstBatchWaitTime: 0.000ns
- - TotalBytesDequeued: 133.34 MB (139815680)
- - TotalGetBatchTime: 1s512ms
- - DataWaitTime: 1s508ms
- Enqueue:
- BytesReceived(500.000ms): 2.60 MB, 19.87 MB, 37.49 MB, 43.73 MB, 59.70 MB, 66.74 MB
- DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 33.858us ; Min: 11.607us ; Max: 519.570us ; Number of samples: 7190)
- - DeserializeRowBatchTime: 148.006ms
- - TotalBatchesEnqueued: 7.19K (7190)
- - TotalBatchesReceived: 7.19K (7190)
- - TotalBytesReceived: 66.74 MB (69986621)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 35.412ms
- - TotalRPCsDeferred: 5 (5)
- HDFS_SCAN_NODE (id=2):(Total: 4s364ms, non-child: 4s364ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:67/8.25 GB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 67 out of 67
- Runtime filters: All filters arrived. Waited 0
- Hdfs Read Thread Concurrency Bucket: 0:33.93% 1:7.143% 2:0% 3:0% 4:0% 5:58.93%
- File Formats: PARQUET/NONE:47 PARQUET/SNAPPY:20
- BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 175.15 MB, 483.71 MB, 890.14 MB, 1002.84 MB, 1.10 GB, 1.24 GB, 1.29 GB, 1.40 GB, 1.51 GB, 1.56 GB, 1.61 GB, 1.67 GB, 1.83 GB, 1.90 GB, 1.93 GB, 2.00 GB, 2.16 GB, 2.26 GB, 2.30 GB, 2.37 GB, 2.45 GB, 2.49 GB, 2.67 GB, 2.80 GB, 2.85 GB, 2.88 GB, 2.91 GB, 3.07 GB, 3.45 GB, 3.49 GB, 3.64 GB, 3.92 GB, 4.12 GB, 4.23 GB, 4.41 GB, 4.42 GB, 4.56 GB, 4.65 GB, 4.76 GB, 4.77 GB, 4.83 GB, 4.89 GB, 4.92 GB, 4.95 GB, 4.97 GB, 5.01 GB, 5.05 GB, 5.06 GB, 5.07 GB, 5.08 GB
- - FooterProcessingTime: (Avg: 354.165ms ; Min: 4.000ms ; Max: 2s292ms ; Number of samples: 67)
- - AverageHdfsReadThreadConcurrency: 4.61
- - AverageScannerThreadConcurrency: 17.12
- - BytesRead: 5.08 GB (5454835475)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 3.14 GB (3369247854)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 3.14 GB (3369247854)
- - CachedFileHandlesHitCount: 236 (236)
- - CachedFileHandlesMissCount: 215 (215)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 15s552ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 10 (10)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 2 (2)
- - NumRowGroups: 20 (20)
- - NumScannerThreadsStarted: 29 (29)
- - NumScannersWithNoReads: 47 (47)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 3.52 GB (3780594261)
- - PerReadThreadRawHdfsThroughput: 40.32 MB/sec
- - RemoteScanRanges: 395 (395)
- - RowBatchQueueGetWaitTime: 4s016ms
- - RowBatchQueuePutWaitTime: 3m38s
- - RowsRead: 117.35M (117346304)
- - RowsReturned: 36.96M (36961674)
- - RowsReturnedRate: 8.47 M/sec
- - ScanRangesComplete: 67 (67)
- - ScannerThreadsInvoluntaryContextSwitches: 3.91K (3913)
- - ScannerThreadsTotalWallClockTime: 7m52s
- - MaterializeTupleTime(*): 33s753ms
- - ScannerThreadsSysTime: 22s383ms
- - ScannerThreadsUserTime: 18s104ms
- - ScannerThreadsVoluntaryContextSwitches: 91.89K (91895)
- - TotalRawHdfsOpenFileTime(*): 9s864ms
- - TotalRawHdfsReadTime(*): 2m9s
- - TotalReadThroughput: 182.53 MB/sec
- Filter 4 (4.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 1.45M (1445235)
- - Rows rejected: 107.27K (107272)
- - Rows total: 117.37M (117372928)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 5 (4.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 1.08M (1076101)
- - Rows rejected: 23.39K (23385)
- - Rows total: 117.27M (117265656)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 320.014ms, non-child: 320.014ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 84.003ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 113 (113)
- - NumInstructions: 3.40K (3401)
- - OptimizationTime: 212.009ms
- - PeakMemoryUsage: 1.66 MB (1741312)
- - PrepareTime: 24.001ms
- Instance 33406f6405038287:b47e1f8b0000000e (host=slave-cn06:22000):(Total: 26s900ms, non-child: 4s356ms, % non-child: 16.19%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:70/8.45 GB
- Filter 4 arrival: 2s652ms
- Filter 5 arrival: 2s651ms
- Fragment Instance Lifecycle Event Timeline: 26s900ms
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 3s884ms (3s880ms)
- - First Batch Produced: 3s904ms (20.000ms)
- - First Batch Sent: 3s904ms (0.000ns)
- - ExecInternal Finished: 26s900ms (22s996ms)
- MemoryUsage(500.000ms): 9.74 MB, 54.74 MB, 84.74 MB, 84.74 MB, 112.74 MB, 116.74 MB, 324.75 MB, 604.49 MB, 808.25 MB, 1.03 GB, 1.49 GB, 1.66 GB, 1.74 GB, 1.88 GB, 1.92 GB, 1.97 GB, 2.01 GB, 2.16 GB, 2.21 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.44 GB, 2.45 GB, 2.50 GB, 2.54 GB, 2.57 GB, 2.64 GB, 2.68 GB, 2.77 GB, 2.79 GB, 2.87 GB, 3.00 GB, 3.01 GB, 3.20 GB, 3.40 GB, 3.46 GB, 3.67 GB, 3.76 GB, 3.83 GB, 3.88 GB, 3.82 GB, 3.77 GB, 3.69 GB, 3.64 GB, 3.43 GB, 3.27 GB, 3.10 GB, 2.97 GB, 2.52 GB, 2.12 GB, 1.70 GB, 1.14 GB, 495.66 MB
- ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 36, 27, 22, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 17, 15, 13, 8, 3
- - AverageThreadTokens: 17.30
- - BloomFilterBytes: 8.00 MB (8388608)
- - PeakMemoryUsage: 3.88 GB (4170054024)
- - PeakReservation: 360.00 MB (377487360)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 4.27 GB (4582467103)
- - RowsProduced: 1.04M (1039227)
- - TotalNetworkReceiveTime: 1s640ms
- - TotalNetworkSendTime: 8s880ms
- - TotalStorageWaitTime: 4m
- - TotalThreadsInvoluntaryContextSwitches: 2.12K (2115)
- - TotalThreadsTotalWallClockTime: 7m51s
- - TotalThreadsSysTime: 23s169ms
- - TotalThreadsUserTime: 25s409ms
- - TotalThreadsVoluntaryContextSwitches: 93.28K (93277)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 8.00 MB (8388608)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 8.00 MB (8388608)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 8.00 MB (8388608)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 8.00 MB (8388608)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 23s016ms
- - ExecTreeExecTime: 9s088ms
- - OpenTime: 3s880ms
- - ExecTreeOpenTime: 3s580ms
- - PrepareTime: 4.000ms
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=7):(Total: 9s584ms, non-child: 704.022ms, % non-child: 7.35%)
- BytesSent(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 303.72 KB, 1.27 MB, 2.21 MB, 3.40 MB, 3.63 MB, 5.18 MB, 6.73 MB, 7.68 MB, 8.68 MB, 9.13 MB, 10.18 MB, 11.37 MB, 12.55 MB, 12.94 MB, 13.59 MB, 14.60 MB, 15.26 MB, 16.78 MB, 17.55 MB, 18.37 MB, 19.32 MB, 20.04 MB, 20.81 MB, 21.43 MB, 21.81 MB, 22.52 MB, 23.88 MB, 24.95 MB, 25.82 MB, 26.69 MB, 27.79 MB, 28.70 MB, 29.15 MB, 31.30 MB, 33.14 MB, 36.35 MB, 39.46 MB, 42.65 MB, 45.84 MB, 49.08 MB, 52.35 MB, 54.97 MB, 57.65 MB, 60.69 MB, 63.56 MB, 65.91 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 1.74 MB/sec
- - PeakMemoryUsage: 187.88 KB (192384)
- - RowsSent: 1.04M (1039227)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 296.009ms
- - TotalBytesSent: 66.51 MB (69736581)
- - UncompressedRowBatchSize: 92.17 MB (96648111)
- HASH_JOIN_NODE (id=3):(Total: 12s668ms, non-child: 6s048ms, % non-child: 47.74%)
- ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- - BuildRows: 7.36M (7358720)
- - BuildTime: 1s128ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 352.36 MB (369477888)
- - ProbeRows: 37.43M (37433843)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 4s828ms
- - RowsReturned: 1.04M (1039227)
- - RowsReturnedRate: 82.03 K/sec
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 352.00 MB (369098752)
- - CumulativeAllocations: 64 (64)
- - PeakReservation: 352.00 MB (369098752)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 352.00 MB (369098752)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=3):
- ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- Runtime filters: 2 of 2 Runtime Filters Published
- - BuildRowsPartitionTime: 564.018ms
- - BuildRowsPartitioned: 7.36M (7358720)
- - HashBuckets: 16.78M (16777216)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 548.017ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 22.12 KB (22656)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=5):(Total: 1s752ms, non-child: 112.003ms, % non-child: 6.39%)
- - ConvertRowBatchTime: 108.003ms
- - PeakMemoryUsage: 12.69 MB (13302259)
- - RowsReturned: 7.36M (7358720)
- - RowsReturnedRate: 4.20 M/sec
- Buffer pool:
- - AllocTime: 20.000ms
- - CumulativeAllocationBytes: 168.48 MB (176668672)
- - CumulativeAllocations: 14.38K (14380)
- - PeakReservation: 12.65 MB (13262848)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.65 MB (13262848)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(500.000ms): 0, 20.17 MB, 70.36 MB, 80.76 MB, 110.81 MB, 130.53 MB, 133.34 MB
- - FirstBatchWaitTime: 0.000ns
- - TotalBytesDequeued: 133.34 MB (139815680)
- - TotalGetBatchTime: 1s640ms
- - DataWaitTime: 1s640ms
- Enqueue:
- BytesReceived(500.000ms): 0, 10.11 MB, 35.22 MB, 40.42 MB, 55.48 MB, 65.34 MB, 66.74 MB
- DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 34.217us ; Min: 11.863us ; Max: 492.454us ; Number of samples: 7190)
- - DeserializeRowBatchTime: 140.004ms
- - TotalBatchesEnqueued: 7.19K (7190)
- - TotalBatchesReceived: 7.19K (7190)
- - TotalBytesReceived: 66.74 MB (69986621)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 12.443ms
- - TotalRPCsDeferred: 5 (5)
- HDFS_SCAN_NODE (id=2):(Total: 4s868ms, non-child: 4s868ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:70/8.45 GB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 70 out of 70
- Runtime filters: All filters arrived. Waited 0
- Hdfs Read Thread Concurrency Bucket: 0:33.96% 1:0% 2:0% 3:1.887% 4:0% 5:64.15%
- File Formats: PARQUET/NONE:49 PARQUET/SNAPPY:21
- BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 167.74 MB, 353.14 MB, 565.89 MB, 1.04 GB, 1.25 GB, 1.30 GB, 1.43 GB, 1.57 GB, 1.63 GB, 1.68 GB, 1.79 GB, 1.84 GB, 2.00 GB, 2.10 GB, 2.14 GB, 2.22 GB, 2.29 GB, 2.39 GB, 2.48 GB, 2.56 GB, 2.67 GB, 2.75 GB, 2.87 GB, 2.92 GB, 3.07 GB, 3.27 GB, 3.33 GB, 3.56 GB, 3.81 GB, 3.92 GB, 4.16 GB, 4.27 GB, 4.34 GB, 4.40 GB, 4.59 GB, 4.65 GB, 4.74 GB, 4.87 GB, 4.91 GB, 4.97 GB, 5.06 GB, 5.07 GB, 5.09 GB, 5.10 GB, 5.14 GB, 5.14 GB, 5.15 GB
- - FooterProcessingTime: (Avg: 162.348ms ; Min: 8.000ms ; Max: 884.028ms ; Number of samples: 70)
- - AverageHdfsReadThreadConcurrency: 5.02
- - AverageScannerThreadConcurrency: 16.49
- - BytesRead: 5.15 GB (5526427855)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 2.83 GB (3042418712)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 2.83 GB (3042418712)
- - CachedFileHandlesHitCount: 255 (255)
- - CachedFileHandlesMissCount: 215 (215)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 13s680ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 10 (10)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 2 (2)
- - NumRowGroups: 21 (21)
- - NumScannerThreadsStarted: 39 (39)
- - NumScannersWithNoReads: 49 (49)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 3.52 GB (3784031201)
- - PerReadThreadRawHdfsThroughput: 39.78 MB/sec
- - RemoteScanRanges: 452 (452)
- - RowBatchQueueGetWaitTime: 4s604ms
- - RowBatchQueuePutWaitTime: 2m22s
- - RowsRead: 118.89M (118885376)
- - RowsReturned: 37.43M (37433843)
- - RowsReturnedRate: 7.69 M/sec
- - ScanRangesComplete: 70 (70)
- - ScannerThreadsInvoluntaryContextSwitches: 2.09K (2086)
- - ScannerThreadsTotalWallClockTime: 7m21s
- - MaterializeTupleTime(*): 31s217ms
- - ScannerThreadsSysTime: 18s994ms
- - ScannerThreadsUserTime: 18s343ms
- - ScannerThreadsVoluntaryContextSwitches: 85.14K (85144)
- - TotalRawHdfsOpenFileTime(*): 8s412ms
- - TotalRawHdfsReadTime(*): 2m12s
- - TotalReadThroughput: 195.20 MB/sec
- Filter 4 (4.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 1.36M (1363798)
- - Rows rejected: 94.12K (94121)
- - Rows total: 118.91M (118906880)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 5 (4.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 1.16M (1164328)
- - Rows rejected: 31.86K (31861)
- - Rows total: 118.81M (118812759)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 292.009ms, non-child: 292.009ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 80.002ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 113 (113)
- - NumInstructions: 3.40K (3401)
- - OptimizationTime: 192.006ms
- - PeakMemoryUsage: 1.66 MB (1741312)
- - PrepareTime: 20.000ms
- Instance 33406f6405038287:b47e1f8b00000012 (host=slave-cn03:22000):(Total: 26s181ms, non-child: 4s740ms, % non-child: 18.11%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:69/8.34 GB
- Filter 4 arrival: 2s651ms
- Filter 5 arrival: 2s651ms
- Fragment Instance Lifecycle Event Timeline: 26s185ms
- - Prepare Finished: 12.000ms (12.000ms)
- - Open Finished: 3s656ms (3s644ms)
- - First Batch Produced: 3s676ms (20.000ms)
- - First Batch Sent: 3s676ms (0.000ns)
- - ExecInternal Finished: 26s185ms (22s509ms)
- MemoryUsage(500.000ms): 9.76 MB, 54.74 MB, 84.74 MB, 84.74 MB, 116.74 MB, 116.74 MB, 340.75 MB, 744.47 MB, 1.12 GB, 1.44 GB, 1.90 GB, 2.27 GB, 2.31 GB, 2.40 GB, 2.48 GB, 2.57 GB, 2.52 GB, 2.67 GB, 2.79 GB, 2.75 GB, 2.78 GB, 2.87 GB, 2.88 GB, 3.01 GB, 3.26 GB, 3.28 GB, 3.38 GB, 3.39 GB, 3.68 GB, 3.70 GB, 3.64 GB, 3.72 GB, 3.85 GB, 3.84 GB, 3.82 GB, 3.76 GB, 3.76 GB, 3.74 GB, 3.73 GB, 3.73 GB, 3.69 GB, 3.63 GB, 3.35 GB, 3.20 GB, 3.11 GB, 3.02 GB, 2.80 GB, 2.46 GB, 2.29 GB, 2.15 GB, 1.43 GB, 1022.99 MB, 467.26 MB
- ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 28, 23, 22, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 20, 19, 19, 19, 19, 18, 17, 17, 16, 11, 7, 2
- - AverageThreadTokens: 16.79
- - BloomFilterBytes: 8.00 MB (8388608)
- - PeakMemoryUsage: 3.85 GB (4137498994)
- - PeakReservation: 360.00 MB (377487360)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 4.23 GB (4540696369)
- - RowsProduced: 1.04M (1043018)
- - TotalNetworkReceiveTime: 1s476ms
- - TotalNetworkSendTime: 9s852ms
- - TotalStorageWaitTime: 1m30s
- - TotalThreadsInvoluntaryContextSwitches: 3.04K (3043)
- - TotalThreadsTotalWallClockTime: 7m32s
- - TotalThreadsSysTime: 27s385ms
- - TotalThreadsUserTime: 25s596ms
- - TotalThreadsVoluntaryContextSwitches: 97.06K (97065)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 8.00 MB (8388608)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 8.00 MB (8388608)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 8.00 MB (8388608)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 8.00 MB (8388608)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 22s529ms
- - ExecTreeExecTime: 7s208ms
- - OpenTime: 3s644ms
- - ExecTreeOpenTime: 3s332ms
- - PrepareTime: 8.000ms
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=7):(Total: 10s592ms, non-child: 740.033ms, % non-child: 6.99%)
- BytesSent(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 1.32 MB, 3.12 MB, 4.67 MB, 5.78 MB, 7.78 MB, 8.91 MB, 9.75 MB, 10.64 MB, 12.17 MB, 13.73 MB, 15.18 MB, 16.77 MB, 18.52 MB, 19.70 MB, 20.75 MB, 21.32 MB, 22.26 MB, 23.27 MB, 24.21 MB, 25.16 MB, 25.84 MB, 26.94 MB, 27.54 MB, 27.88 MB, 28.22 MB, 29.50 MB, 31.56 MB, 33.12 MB, 33.80 MB, 35.43 MB, 36.83 MB, 37.64 MB, 39.19 MB, 41.13 MB, 43.23 MB, 44.97 MB, 48.01 MB, 50.94 MB, 53.05 MB, 55.10 MB, 57.81 MB, 60.46 MB, 62.58 MB, 65.05 MB, 66.73 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 1.83 MB/sec
- - PeakMemoryUsage: 187.88 KB (192384)
- - RowsSent: 1.04M (1043018)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 360.016ms
- - TotalBytesSent: 66.84 MB (70082541)
- - UncompressedRowBatchSize: 92.51 MB (97000674)
- HASH_JOIN_NODE (id=3):(Total: 10s540ms, non-child: 7s028ms, % non-child: 66.68%)
- ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- - BuildRows: 7.36M (7358720)
- - BuildTime: 1s252ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 352.36 MB (369473792)
- - ProbeRows: 37.66M (37657452)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 5s696ms
- - RowsReturned: 1.04M (1043018)
- - RowsReturnedRate: 98.95 K/sec
- Buffer pool:
- - AllocTime: 4.000ms
- - CumulativeAllocationBytes: 352.00 MB (369098752)
- - CumulativeAllocations: 64 (64)
- - PeakReservation: 352.00 MB (369098752)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 352.00 MB (369098752)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=3):
- ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- Runtime filters: 2 of 2 Runtime Filters Published
- - BuildRowsPartitionTime: 704.032ms
- - BuildRowsPartitioned: 7.36M (7358720)
- - HashBuckets: 16.78M (16777216)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 540.024ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 22.12 KB (22656)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=5):(Total: 1s600ms, non-child: 132.006ms, % non-child: 8.25%)
- - ConvertRowBatchTime: 124.005ms
- - PeakMemoryUsage: 12.69 MB (13302259)
- - RowsReturned: 7.36M (7358720)
- - RowsReturnedRate: 4.60 M/sec
- Buffer pool:
- - AllocTime: 20.000ms
- - CumulativeAllocationBytes: 168.48 MB (176668672)
- - CumulativeAllocations: 14.38K (14380)
- - PeakReservation: 12.65 MB (13262848)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.65 MB (13262848)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(500.000ms): 0, 24.10 MB, 71.13 MB, 81.22 MB, 113.00 MB, 131.74 MB, 133.34 MB
- - FirstBatchWaitTime: 0.000ns
- - TotalBytesDequeued: 133.34 MB (139815680)
- - TotalGetBatchTime: 1s472ms
- - DataWaitTime: 1s468ms
- Enqueue:
- BytesReceived(500.000ms): 9.50 KB, 12.09 MB, 35.60 MB, 40.66 MB, 56.56 MB, 65.94 MB, 66.74 MB
- DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 34.552us ; Min: 10.755us ; Max: 601.426us ; Number of samples: 7190)
- - DeserializeRowBatchTime: 172.007ms
- - TotalBatchesEnqueued: 7.19K (7190)
- - TotalBatchesReceived: 7.19K (7190)
- - TotalBytesReceived: 66.74 MB (69986621)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 35.180ms
- - TotalRPCsDeferred: 5 (5)
- HDFS_SCAN_NODE (id=2):(Total: 1s912ms, non-child: 1s912ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:69/8.34 GB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 69 out of 69
- Runtime filters: All filters arrived. Waited 0
- Hdfs Read Thread Concurrency Bucket: 0:30.77% 1:11.54% 2:5.769% 3:1.923% 4:0% 5:50%
- File Formats: PARQUET/NONE:47 PARQUET/SNAPPY:22
- BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 288.13 MB, 650.36 MB, 1.01 GB, 1.53 GB, 1.86 GB, 1.93 GB, 2.04 GB, 2.13 GB, 2.24 GB, 2.30 GB, 2.56 GB, 2.71 GB, 2.75 GB, 2.80 GB, 2.95 GB, 3.00 GB, 3.22 GB, 3.58 GB, 3.62 GB, 3.74 GB, 3.83 GB, 4.12 GB, 4.14 GB, 4.14 GB, 4.23 GB, 4.37 GB, 4.46 GB, 4.53 GB, 4.76 GB, 4.77 GB, 4.79 GB, 4.84 GB, 4.86 GB, 4.86 GB, 4.91 GB, 4.97 GB, 5.01 GB, 5.08 GB, 5.09 GB, 5.11 GB, 5.14 GB, 5.16 GB, 5.17 GB, 5.17 GB, 5.18 GB, 5.18 GB
- - FooterProcessingTime: (Avg: 111.599ms ; Min: 8.000ms ; Max: 508.023ms ; Number of samples: 69)
- - AverageHdfsReadThreadConcurrency: 4.25
- - AverageScannerThreadConcurrency: 15.98
- - BytesRead: 5.18 GB (5557793950)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 3.44 GB (3696378210)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 3.44 GB (3696378210)
- - CachedFileHandlesHitCount: 259 (259)
- - CachedFileHandlesMissCount: 220 (220)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 15s512ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 10 (10)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 2 (2)
- - NumRowGroups: 22 (22)
- - NumScannerThreadsStarted: 39 (39)
- - NumScannersWithNoReads: 47 (47)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 3.49 GB (3751795659)
- - PerReadThreadRawHdfsThroughput: 48.32 MB/sec
- - RemoteScanRanges: 361 (361)
- - RowBatchQueueGetWaitTime: 1s460ms
- - RowBatchQueuePutWaitTime: 4m34s
- - RowsRead: 119.44M (119441408)
- - RowsReturned: 37.66M (37657452)
- - RowsReturnedRate: 19.69 M/sec
- - ScanRangesComplete: 69 (69)
- - ScannerThreadsInvoluntaryContextSwitches: 3.00K (3004)
- - ScannerThreadsTotalWallClockTime: 7m3s
- - MaterializeTupleTime(*): 30s957ms
- - ScannerThreadsSysTime: 21s938ms
- - ScannerThreadsUserTime: 18s293ms
- - ScannerThreadsVoluntaryContextSwitches: 90.29K (90286)
- - TotalRawHdfsOpenFileTime(*): 4s016ms
- - TotalRawHdfsReadTime(*): 1m49s
- - TotalReadThroughput: 200.01 MB/sec
- Filter 4 (4.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 1.39M (1393219)
- - Rows rejected: 99.22K (99216)
- - Rows total: 119.46M (119462912)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 5 (4.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 1.19M (1187446)
- - Rows rejected: 25.89K (25892)
- - Rows total: 119.36M (119363696)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 308.014ms, non-child: 308.014ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 84.003ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 113 (113)
- - NumInstructions: 3.40K (3401)
- - OptimizationTime: 204.009ms
- - PeakMemoryUsage: 1.66 MB (1741312)
- - PrepareTime: 20.000ms
- Instance 33406f6405038287:b47e1f8b0000000f (host=slave-cn05:22000):(Total: 23s597ms, non-child: 3s496ms, % non-child: 14.82%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:71/8.41 GB
- Filter 4 arrival: 2s652ms
- Filter 5 arrival: 2s652ms
- Fragment Instance Lifecycle Event Timeline: 23s597ms
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 3s524ms (3s520ms)
- - First Batch Produced: 3s544ms (20.001ms)
- - First Batch Sent: 3s544ms (0.000ns)
- - ExecInternal Finished: 23s597ms (20s053ms)
- MemoryUsage(500.000ms): 54.74 MB, 84.74 MB, 84.74 MB, 84.74 MB, 116.74 MB, 292.75 MB, 593.23 MB, 845.70 MB, 1.19 GB, 1.82 GB, 1.76 GB, 1.78 GB, 1.82 GB, 1.83 GB, 2.04 GB, 2.14 GB, 2.28 GB, 2.30 GB, 2.39 GB, 2.54 GB, 2.73 GB, 2.86 GB, 2.90 GB, 2.93 GB, 2.94 GB, 2.94 GB, 2.92 GB, 2.92 GB, 2.90 GB, 2.90 GB, 2.85 GB, 2.86 GB, 2.83 GB, 2.72 GB, 2.70 GB, 2.57 GB, 2.55 GB, 2.48 GB, 2.42 GB, 2.41 GB, 2.42 GB, 2.33 GB, 2.04 GB, 1.86 GB, 1.38 GB, 1008.04 MB, 460.02 MB
- ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 37, 27, 19, 19, 18, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 14, 14, 14, 14, 14, 14, 14, 13, 13, 10, 7, 2
- - AverageThreadTokens: 13.51
- - BloomFilterBytes: 8.00 MB (8388608)
- - PeakMemoryUsage: 2.95 GB (3170577591)
- - PeakReservation: 360.00 MB (377487360)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 3.09 GB (3313067929)
- - RowsProduced: 785.44K (785438)
- - TotalNetworkReceiveTime: 1s324ms
- - TotalNetworkSendTime: 10s316ms
- - TotalStorageWaitTime: 59s903ms
- - TotalThreadsInvoluntaryContextSwitches: 1.75K (1747)
- - TotalThreadsTotalWallClockTime: 5m18s
- - TotalThreadsSysTime: 20s011ms
- - TotalThreadsUserTime: 19s948ms
- - TotalThreadsVoluntaryContextSwitches: 62.79K (62791)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 8.00 MB (8388608)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 8.00 MB (8388608)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 8.00 MB (8388608)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 8.00 MB (8388608)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 20s073ms
- - ExecTreeExecTime: 5s632ms
- - OpenTime: 3s520ms
- - ExecTreeOpenTime: 3s052ms
- - PrepareTime: 4.000ms
- - ExecTreePrepareTime: 4.000ms
- KrpcDataStreamSender (dst_id=7):(Total: 10s940ms, non-child: 620.033ms, % non-child: 5.67%)
- BytesSent(500.000ms): 0, 0, 0, 0, 0, 0, 0, 1.27 MB, 2.21 MB, 3.87 MB, 4.90 MB, 6.48 MB, 7.14 MB, 8.25 MB, 9.04 MB, 10.14 MB, 11.15 MB, 12.14 MB, 13.12 MB, 14.33 MB, 15.31 MB, 16.15 MB, 16.91 MB, 17.74 MB, 18.99 MB, 20.12 MB, 21.19 MB, 22.19 MB, 23.40 MB, 23.67 MB, 24.58 MB, 25.44 MB, 27.06 MB, 28.82 MB, 30.66 MB, 31.98 MB, 32.31 MB, 33.68 MB, 34.75 MB, 35.09 MB, 35.53 MB, 37.72 MB, 40.10 MB, 43.27 MB, 45.91 MB, 48.75 MB, 50.17 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 1.23 MB/sec
- - PeakMemoryUsage: 187.88 KB (192384)
- - RowsSent: 785.44K (785438)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 248.013ms
- - TotalBytesSent: 50.33 MB (52772277)
- - UncompressedRowBatchSize: 69.66 MB (73045734)
- HASH_JOIN_NODE (id=3):(Total: 8s692ms, non-child: 5s760ms, % non-child: 66.27%)
- ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- - BuildRows: 7.36M (7358720)
- - BuildTime: 1s312ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 352.36 MB (369473792)
- - ProbeRows: 28.18M (28178964)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 4s360ms
- - RowsReturned: 785.44K (785438)
- - RowsReturnedRate: 90.36 K/sec
- Buffer pool:
- - AllocTime: 4.000ms
- - CumulativeAllocationBytes: 352.00 MB (369098752)
- - CumulativeAllocations: 64 (64)
- - PeakReservation: 352.00 MB (369098752)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 352.00 MB (369098752)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=3):
- ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- Runtime filters: 2 of 2 Runtime Filters Published
- - BuildRowsPartitionTime: 748.040ms
- - BuildRowsPartitioned: 7.36M (7358720)
- - HashBuckets: 16.78M (16777216)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 552.030ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 22.12 KB (22656)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=5):(Total: 1s400ms, non-child: 84.004ms, % non-child: 6.00%)
- - ConvertRowBatchTime: 72.003ms
- - PeakMemoryUsage: 12.69 MB (13302259)
- - RowsReturned: 7.36M (7358720)
- - RowsReturnedRate: 5.26 M/sec
- Buffer pool:
- - AllocTime: 56.003ms
- - CumulativeAllocationBytes: 168.48 MB (176668672)
- - CumulativeAllocations: 14.38K (14380)
- - PeakReservation: 12.65 MB (13262848)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.65 MB (13262848)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(500.000ms): 2.21 MB, 64.87 MB, 78.96 MB, 105.89 MB, 128.03 MB, 133.34 MB
- - FirstBatchWaitTime: 0.000ns
- - TotalBytesDequeued: 133.34 MB (139815680)
- - TotalGetBatchTime: 1s324ms
- - DataWaitTime: 1s316ms
- Enqueue:
- BytesReceived(500.000ms): 5.70 MB, 32.47 MB, 39.52 MB, 53.01 MB, 64.09 MB, 66.74 MB
- DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 32.412us ; Min: 11.955us ; Max: 910.100us ; Number of samples: 7190)
- - DeserializeRowBatchTime: 192.010ms
- - TotalBatchesEnqueued: 7.19K (7190)
- - TotalBatchesReceived: 7.19K (7190)
- - TotalBytesReceived: 66.74 MB (69986621)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 184.543ms
- - TotalRPCsDeferred: 5 (5)
- HDFS_SCAN_NODE (id=2):(Total: 1s532ms, non-child: 1s532ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:71/8.41 GB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 71 out of 71
- Runtime filters: All filters arrived. Waited 0
- Hdfs Read Thread Concurrency Bucket: 0:53.19% 1:4.255% 2:0% 3:4.255% 4:0% 5:38.3%
- File Formats: PARQUET/NONE:52 PARQUET/SNAPPY:19
- BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 151.61 MB, 405.61 MB, 751.67 MB, 1.29 GB, 1.40 GB, 1.54 GB, 1.62 GB, 1.67 GB, 1.92 GB, 2.09 GB, 2.22 GB, 2.29 GB, 2.43 GB, 2.56 GB, 2.81 GB, 3.00 GB, 3.08 GB, 3.24 GB, 3.29 GB, 3.32 GB, 3.40 GB, 3.43 GB, 3.46 GB, 3.53 GB, 3.55 GB, 3.59 GB, 3.67 GB, 3.68 GB, 3.72 GB, 3.78 GB, 3.80 GB, 3.85 GB, 3.86 GB, 3.86 GB, 3.86 GB, 3.88 GB, 3.91 GB, 3.94 GB, 3.94 GB, 3.95 GB, 3.95 GB
- - FooterProcessingTime: (Avg: 180.066ms ; Min: 12.000ms ; Max: 812.044ms ; Number of samples: 71)
- - AverageHdfsReadThreadConcurrency: 3.11
- - AverageScannerThreadConcurrency: 12.38
- - BytesRead: 3.95 GB (4244117332)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 2.70 GB (2904282179)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 2.70 GB (2904282179)
- - CachedFileHandlesHitCount: 229 (229)
- - CachedFileHandlesMissCount: 180 (180)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 11s448ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 10 (10)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 2 (2)
- - NumRowGroups: 19 (19)
- - NumScannerThreadsStarted: 39 (39)
- - NumScannersWithNoReads: 52 (52)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 2.59 GB (2784698128)
- - PerReadThreadRawHdfsThroughput: 56.18 MB/sec
- - RemoteScanRanges: 277 (277)
- - RowBatchQueueGetWaitTime: 1s292ms
- - RowBatchQueuePutWaitTime: 3m10s
- - RowsRead: 89.50M (89498624)
- - RowsReturned: 28.18M (28178964)
- - RowsReturnedRate: 18.39 M/sec
- - ScanRangesComplete: 71 (71)
- - ScannerThreadsInvoluntaryContextSwitches: 1.72K (1716)
- - ScannerThreadsTotalWallClockTime: 4m51s
- - MaterializeTupleTime(*): 20s117ms
- - ScannerThreadsSysTime: 15s891ms
- - ScannerThreadsUserTime: 13s791ms
- - ScannerThreadsVoluntaryContextSwitches: 56.99K (56990)
- - TotalRawHdfsOpenFileTime(*): 4s744ms
- - TotalRawHdfsReadTime(*): 1m12s
- - TotalReadThroughput: 172.23 MB/sec
- Filter 4 (4.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 1.10M (1104621)
- - Rows rejected: 72.22K (72220)
- - Rows total: 89.51M (89513984)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 5 (4.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 1.03M (1032401)
- - Rows rejected: 23.21K (23213)
- - Rows total: 89.44M (89441764)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 468.025ms, non-child: 468.025ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 100.005ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 113 (113)
- - NumInstructions: 3.40K (3401)
- - OptimizationTime: 332.018ms
- - PeakMemoryUsage: 1.66 MB (1741312)
- - PrepareTime: 32.001ms
- Instance 33406f6405038287:b47e1f8b00000010 (host=slave-cn04:22000):(Total: 22s353ms, non-child: 4s452ms, % non-child: 19.92%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:71/8.48 GB
- Filter 4 arrival: 2s652ms
- Filter 5 arrival: 2s652ms
- Fragment Instance Lifecycle Event Timeline: 22s353ms
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 3s524ms (3s520ms)
- - First Batch Produced: 3s544ms (20.001ms)
- - First Batch Sent: 3s544ms (0.000ns)
- - ExecInternal Finished: 22s353ms (18s808ms)
- MemoryUsage(500.000ms): 10.09 MB, 54.74 MB, 84.74 MB, 84.74 MB, 116.74 MB, 116.74 MB, 340.75 MB, 2.49 GB, 2.98 GB, 3.27 GB, 3.62 GB, 3.63 GB, 3.57 GB, 3.57 GB, 3.39 GB, 3.40 GB, 3.41 GB, 3.42 GB, 3.41 GB, 3.40 GB, 3.37 GB, 3.39 GB, 3.37 GB, 3.35 GB, 3.33 GB, 3.32 GB, 3.30 GB, 3.30 GB, 3.28 GB, 3.26 GB, 3.25 GB, 3.23 GB, 3.19 GB, 3.11 GB, 3.01 GB, 2.98 GB, 2.81 GB, 2.68 GB, 2.59 GB, 2.58 GB, 2.46 GB, 2.25 GB, 1.94 GB, 1.50 GB, 827.15 MB
- ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 35, 21, 21, 21, 21, 20, 20, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 15, 13, 7
- - AverageThreadTokens: 15.18
- - BloomFilterBytes: 8.00 MB (8388608)
- - PeakMemoryUsage: 3.63 GB (3903038918)
- - PeakReservation: 360.00 MB (377487360)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 3.83 GB (4109447221)
- - RowsProduced: 881.77K (881771)
- - TotalNetworkReceiveTime: 1s496ms
- - TotalNetworkSendTime: 7s900ms
- - TotalStorageWaitTime: 23s333ms
- - TotalThreadsInvoluntaryContextSwitches: 4.00K (3999)
- - TotalThreadsTotalWallClockTime: 5m47s
- - TotalThreadsSysTime: 26s054ms
- - TotalThreadsUserTime: 22s330ms
- - TotalThreadsVoluntaryContextSwitches: 83.22K (83223)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 8.00 MB (8388608)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 8.00 MB (8388608)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 8.00 MB (8388608)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 8.00 MB (8388608)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 18s828ms
- - ExecTreeExecTime: 5s720ms
- - OpenTime: 3s520ms
- - ExecTreeOpenTime: 3s212ms
- - PrepareTime: 4.000ms
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=7):(Total: 8s672ms, non-child: 772.040ms, % non-child: 8.90%)
- BytesSent(500.000ms): 0, 0, 0, 0, 0, 0, 0, 165.50 KB, 2.99 MB, 5.14 MB, 6.54 MB, 8.65 MB, 9.86 MB, 10.59 MB, 12.50 MB, 14.18 MB, 15.13 MB, 16.76 MB, 18.26 MB, 20.01 MB, 21.84 MB, 22.64 MB, 23.98 MB, 25.13 MB, 26.19 MB, 27.25 MB, 28.38 MB, 29.52 MB, 30.73 MB, 31.94 MB, 33.01 MB, 33.84 MB, 34.94 MB, 36.79 MB, 38.57 MB, 39.02 MB, 40.28 MB, 41.89 MB, 43.16 MB, 44.46 MB, 46.03 MB, 48.53 MB, 51.24 MB, 53.72 MB, 56.15 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 1.82 MB/sec
- - PeakMemoryUsage: 187.88 KB (192384)
- - RowsSent: 881.77K (881771)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 284.014ms
- - TotalBytesSent: 56.52 MB (59269855)
- - UncompressedRowBatchSize: 78.21 MB (82004703)
- HASH_JOIN_NODE (id=3):(Total: 8s928ms, non-child: 6s376ms, % non-child: 71.42%)
- ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- - BuildRows: 7.36M (7358720)
- - BuildTime: 1s252ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 352.36 MB (369473792)
- - ProbeRows: 31.95M (31952459)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 5s080ms
- - RowsReturned: 881.77K (881771)
- - RowsReturnedRate: 98.76 K/sec
- Buffer pool:
- - AllocTime: 4.000ms
- - CumulativeAllocationBytes: 352.00 MB (369098752)
- - CumulativeAllocations: 64 (64)
- - PeakReservation: 352.00 MB (369098752)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 352.00 MB (369098752)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=3):
- ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- Runtime filters: 2 of 2 Runtime Filters Published
- - BuildRowsPartitionTime: 692.036ms
- - BuildRowsPartitioned: 7.36M (7358720)
- - HashBuckets: 16.78M (16777216)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 552.029ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 22.12 KB (22656)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=5):(Total: 1s624ms, non-child: 136.007ms, % non-child: 8.37%)
- - ConvertRowBatchTime: 124.006ms
- - PeakMemoryUsage: 12.69 MB (13302259)
- - RowsReturned: 7.36M (7358720)
- - RowsReturnedRate: 4.53 M/sec
- Buffer pool:
- - AllocTime: 32.001ms
- - CumulativeAllocationBytes: 168.48 MB (176668672)
- - CumulativeAllocations: 14.38K (14380)
- - PeakReservation: 12.65 MB (13262848)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.65 MB (13262848)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(500.000ms): 0, 26.61 MB, 71.68 MB, 82.22 MB, 114.28 MB, 132.46 MB, 133.34 MB
- - FirstBatchWaitTime: 0.000ns
- - TotalBytesDequeued: 133.34 MB (139815680)
- - TotalGetBatchTime: 1s496ms
- - DataWaitTime: 1s488ms
- Enqueue:
- BytesReceived(500.000ms): 142.42 KB, 13.32 MB, 35.88 MB, 41.17 MB, 57.20 MB, 66.31 MB, 66.74 MB
- DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 31.759us ; Min: 11.868us ; Max: 274.755us ; Number of samples: 7190)
- - DeserializeRowBatchTime: 168.008ms
- - TotalBatchesEnqueued: 7.19K (7190)
- - TotalBatchesReceived: 7.19K (7190)
- - TotalBytesReceived: 66.74 MB (69986621)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 19.949ms
- - TotalRPCsDeferred: 5 (5)
- HDFS_SCAN_NODE (id=2):(Total: 928.049ms, non-child: 928.049ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:71/8.48 GB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 71 out of 71
- Runtime filters: All filters arrived. Waited 0
- Hdfs Read Thread Concurrency Bucket: 0:88.64% 1:11.36% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/NONE:51 PARQUET/SNAPPY:20
- BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 2.01 GB, 2.35 GB, 2.66 GB, 2.96 GB, 3.04 GB, 3.07 GB, 3.10 GB, 3.24 GB, 3.40 GB, 3.50 GB, 3.57 GB, 3.60 GB, 3.67 GB, 3.77 GB, 3.85 GB, 3.96 GB, 3.96 GB, 3.99 GB, 4.03 GB, 4.08 GB, 4.14 GB, 4.19 GB, 4.27 GB, 4.33 GB, 4.33 GB, 4.34 GB, 4.35 GB, 4.36 GB, 4.36 GB, 4.37 GB, 4.39 GB, 4.41 GB, 4.44 GB, 4.46 GB, 4.46 GB, 4.46 GB, 4.46 GB, 4.46 GB
- - FooterProcessingTime: (Avg: 132.063ms ; Min: 4.000ms ; Max: 472.024ms ; Number of samples: 71)
- - AverageHdfsReadThreadConcurrency: 0.11
- - AverageScannerThreadConcurrency: 14.36
- - BytesRead: 4.46 GB (4787910018)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 4.46 GB (4787602818)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 4.46 GB (4787602818)
- - CachedFileHandlesHitCount: 241 (241)
- - CachedFileHandlesMissCount: 198 (198)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 14s256ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 10 (10)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 2 (2)
- - NumRowGroups: 20 (20)
- - NumScannerThreadsStarted: 39 (39)
- - NumScannersWithNoReads: 51 (51)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 3.28 GB (3517581343)
- - PerReadThreadRawHdfsThroughput: 679.85 MB/sec
- - RemoteScanRanges: 9 (9)
- - RowBatchQueueGetWaitTime: 536.028ms
- - RowBatchQueuePutWaitTime: 4m7s
- - RowsRead: 101.36M (101357568)
- - RowsReturned: 31.95M (31952459)
- - RowsReturnedRate: 34.43 M/sec
- - ScanRangesComplete: 71 (71)
- - ScannerThreadsInvoluntaryContextSwitches: 3.90K (3901)
- - ScannerThreadsTotalWallClockTime: 5m22s
- - MaterializeTupleTime(*): 26s757ms
- - ScannerThreadsSysTime: 20s495ms
- - ScannerThreadsUserTime: 15s906ms
- - ScannerThreadsVoluntaryContextSwitches: 77.86K (77859)
- - TotalRawHdfsOpenFileTime(*): 880.046ms
- - TotalRawHdfsReadTime(*): 6s716ms
- - TotalReadThroughput: 202.94 MB/sec
- Filter 4 (4.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 1.22M (1224753)
- - Rows rejected: 87.80K (87801)
- - Rows total: 101.39M (101386240)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 5 (4.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 1.08M (1084795)
- - Rows rejected: 24.33K (24327)
- - Rows total: 101.30M (101298439)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 300.015ms, non-child: 300.015ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 80.004ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 113 (113)
- - NumInstructions: 3.40K (3401)
- - OptimizationTime: 200.010ms
- - PeakMemoryUsage: 1.66 MB (1741312)
- - PrepareTime: 20.001ms
- Instance 33406f6405038287:b47e1f8b0000000d (host=slave-cn07:22000):(Total: 21s033ms, non-child: 2s748ms, % non-child: 13.07%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:71/8.49 GB
- Filter 4 arrival: 2s651ms
- Filter 5 arrival: 2s651ms
- Fragment Instance Lifecycle Event Timeline: 21s033ms
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 3s496ms (3s492ms)
- - First Batch Produced: 3s520ms (24.001ms)
- - First Batch Sent: 3s520ms (0.000ns)
- - ExecInternal Finished: 21s033ms (17s512ms)
- MemoryUsage(500.000ms): 12.20 MB, 54.74 MB, 84.74 MB, 84.74 MB, 116.74 MB, 148.75 MB, 372.75 MB, 689.68 MB, 1.02 GB, 1.65 GB, 1.61 GB, 1.78 GB, 1.81 GB, 1.91 GB, 1.96 GB, 2.08 GB, 2.26 GB, 2.44 GB, 2.54 GB, 2.67 GB, 2.70 GB, 2.68 GB, 2.74 GB, 2.73 GB, 2.73 GB, 2.70 GB, 2.68 GB, 2.60 GB, 2.56 GB, 2.50 GB, 2.45 GB, 2.43 GB, 2.37 GB, 2.12 GB, 2.04 GB, 1.95 GB, 1.78 GB, 1.73 GB, 1.38 GB, 1.16 GB, 904.08 MB, 594.61 MB
- ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 29, 17, 16, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 13, 13, 13, 12, 12, 9, 8, 5, 3
- - AverageThreadTokens: 11.55
- - BloomFilterBytes: 8.00 MB (8388608)
- - PeakMemoryUsage: 2.74 GB (2944595469)
- - PeakReservation: 360.00 MB (377487360)
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 2.87 GB (3082904484)
- - RowsProduced: 728.82K (728816)
- - TotalNetworkReceiveTime: 1s544ms
- - TotalNetworkSendTime: 9s752ms
- - TotalStorageWaitTime: 55s138ms
- - TotalThreadsInvoluntaryContextSwitches: 504 (504)
- - TotalThreadsTotalWallClockTime: 4m11s
- - TotalThreadsSysTime: 16s174ms
- - TotalThreadsUserTime: 18s072ms
- - TotalThreadsVoluntaryContextSwitches: 52.08K (52083)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 8.00 MB (8388608)
- - CumulativeAllocations: 2 (2)
- - PeakReservation: 8.00 MB (8388608)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 8.00 MB (8388608)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 8.00 MB (8388608)
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 17s536ms
- - ExecTreeExecTime: 4s528ms
- - OpenTime: 3s492ms
- - ExecTreeOpenTime: 3s176ms
- - PrepareTime: 4.000ms
- - ExecTreePrepareTime: 4.000ms
- KrpcDataStreamSender (dst_id=7):(Total: 10s264ms, non-child: 512.024ms, % non-child: 4.99%)
- BytesSent(500.000ms): 0, 0, 0, 0, 0, 0, 0, 248.15 KB, 1.70 MB, 4.11 MB, 6.13 MB, 8.07 MB, 9.90 MB, 11.38 MB, 12.18 MB, 13.67 MB, 14.79 MB, 15.78 MB, 16.43 MB, 17.38 MB, 17.64 MB, 18.82 MB, 20.06 MB, 20.92 MB, 22.18 MB, 23.73 MB, 25.17 MB, 26.38 MB, 27.70 MB, 28.91 MB, 30.02 MB, 30.85 MB, 32.17 MB, 34.33 MB, 36.17 MB, 37.39 MB, 38.45 MB, 40.09 MB, 41.36 MB, 42.28 MB, 43.86 MB, 45.79 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 1.25 MB/sec
- - PeakMemoryUsage: 187.88 KB (192384)
- - RowsSent: 728.82K (728816)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 224.010ms
- - TotalBytesSent: 46.67 MB (48932668)
- - UncompressedRowBatchSize: 64.64 MB (67779888)
- HASH_JOIN_NODE (id=3):(Total: 7s708ms, non-child: 4s748ms, % non-child: 61.60%)
- ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- - BuildRows: 7.36M (7358720)
- - BuildTime: 1s228ms
- - NumHashTableBuildsSkipped: 0 (0)
- - PeakMemoryUsage: 352.36 MB (369473792)
- - ProbeRows: 26.09M (26089338)
- - ProbeRowsPartitioned: 0 (0)
- - ProbeTime: 3s452ms
- - RowsReturned: 728.82K (728816)
- - RowsReturnedRate: 94.55 K/sec
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 352.00 MB (369098752)
- - CumulativeAllocations: 64 (64)
- - PeakReservation: 352.00 MB (369098752)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 352.00 MB (369098752)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Hash Join Builder (join_node_id=3):
- ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- Runtime filters: 2 of 2 Runtime Filters Published
- - BuildRowsPartitionTime: 644.030ms
- - BuildRowsPartitioned: 7.36M (7358720)
- - HashBuckets: 16.78M (16777216)
- - HashCollisions: 0 (0)
- - HashTablesBuildTime: 576.027ms
- - LargestPartitionPercent: 6 (6)
- - MaxPartitionLevel: 0 (0)
- - NumRepartitions: 0 (0)
- - PartitionsCreated: 16 (16)
- - PeakMemoryUsage: 22.12 KB (22656)
- - RepartitionTime: 0.000ns
- - SpilledPartitions: 0 (0)
- EXCHANGE_NODE (id=5):(Total: 1s668ms, non-child: 144.006ms, % non-child: 8.63%)
- - ConvertRowBatchTime: 112.005ms
- - PeakMemoryUsage: 12.69 MB (13302259)
- - RowsReturned: 7.36M (7358720)
- - RowsReturnedRate: 4.41 M/sec
- Buffer pool:
- - AllocTime: 20.000ms
- - CumulativeAllocationBytes: 168.48 MB (176668672)
- - CumulativeAllocations: 14.38K (14380)
- - PeakReservation: 12.65 MB (13262848)
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 12.65 MB (13262848)
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Dequeue:
- BytesDequeued(500.000ms): 0, 34.20 MB, 73.22 MB, 84.11 MB, 117.36 MB, 133.34 MB, 133.34 MB
- - FirstBatchWaitTime: 0.000ns
- - TotalBytesDequeued: 133.34 MB (139815680)
- - TotalGetBatchTime: 1s540ms
- - DataWaitTime: 1s524ms
- Enqueue:
- BytesReceived(500.000ms): 998.89 KB, 17.14 MB, 36.65 MB, 42.10 MB, 58.74 MB, 66.74 MB, 66.74 MB
- DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0
- - DispatchTime: (Avg: 32.964us ; Min: 11.807us ; Max: 732.090us ; Number of samples: 7190)
- - DeserializeRowBatchTime: 144.006ms
- - TotalBatchesEnqueued: 7.19K (7190)
- - TotalBatchesReceived: 7.19K (7190)
- - TotalBytesReceived: 66.74 MB (69986621)
- - TotalEarlySenders: 0 (0)
- - TotalEosReceived: 6 (6)
- - TotalHasDeferredRPCsTime: 27.233ms
- - TotalRPCsDeferred: 5 (5)
- HDFS_SCAN_NODE (id=2):(Total: 1s292ms, non-child: 1s292ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:71/8.49 GB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 71 out of 71
- Runtime filters: All filters arrived. Waited 0
- Hdfs Read Thread Concurrency Bucket: 0:39.02% 1:19.51% 2:2.439% 3:0% 4:2.439% 5:36.59%
- File Formats: PARQUET/NONE:54 PARQUET/SNAPPY:17
- BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 259.44 MB, 582.53 MB, 1.18 GB, 1.31 GB, 1.55 GB, 1.64 GB, 1.85 GB, 1.92 GB, 2.13 GB, 2.37 GB, 2.55 GB, 2.73 GB, 2.89 GB, 2.92 GB, 3.02 GB, 3.13 GB, 3.16 GB, 3.22 GB, 3.30 GB, 3.33 GB, 3.36 GB, 3.39 GB, 3.41 GB, 3.43 GB, 3.45 GB, 3.50 GB, 3.51 GB, 3.55 GB, 3.55 GB, 3.58 GB, 3.58 GB, 3.61 GB, 3.61 GB, 3.61 GB, 3.63 GB
- - FooterProcessingTime: (Avg: 150.035ms ; Min: 8.000ms ; Max: 660.031ms ; Number of samples: 71)
- - AverageHdfsReadThreadConcurrency: 3.12
- - AverageScannerThreadConcurrency: 10.66
- - BytesRead: 3.63 GB (3894467043)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 2.44 GB (2616944225)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 2.44 GB (2616944225)
- - CachedFileHandlesHitCount: 208 (208)
- - CachedFileHandlesMissCount: 167 (167)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 9s220ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 10 (10)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 2 (2)
- - NumRowGroups: 17 (17)
- - NumScannerThreadsStarted: 39 (39)
- - NumScannersWithNoReads: 54 (54)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 2.38 GB (2558462054)
- - PerReadThreadRawHdfsThroughput: 56.57 MB/sec
- - RemoteScanRanges: 247 (247)
- - RowBatchQueueGetWaitTime: 1s092ms
- - RowBatchQueuePutWaitTime: 2m18s
- - RowsRead: 82.77M (82767872)
- - RowsReturned: 26.09M (26089338)
- - RowsReturnedRate: 20.19 M/sec
- - ScanRangesComplete: 71 (71)
- - ScannerThreadsInvoluntaryContextSwitches: 488 (488)
- - ScannerThreadsTotalWallClockTime: 3m47s
- - MaterializeTupleTime(*): 16s520ms
- - ScannerThreadsSysTime: 13s149ms
- - ScannerThreadsUserTime: 12s566ms
- - ScannerThreadsVoluntaryContextSwitches: 45.70K (45701)
- - TotalRawHdfsOpenFileTime(*): 3s720ms
- - TotalRawHdfsReadTime(*): 1m5s
- - TotalReadThroughput: 176.86 MB/sec
- Filter 4 (4.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 985.72K (985720)
- - Rows rejected: 66.94K (66937)
- - Rows total: 82.78M (82783232)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- Filter 5 (4.00 MB):
- - Files processed: 0 (0)
- - Files rejected: 0 (0)
- - Files total: 0 (0)
- - RowGroups processed: 0 (0)
- - RowGroups rejected: 0 (0)
- - RowGroups total: 0 (0)
- - Rows processed: 918.78K (918783)
- - Rows rejected: 19.90K (19896)
- - Rows total: 82.72M (82716295)
- - Splits processed: 0 (0)
- - Splits rejected: 0 (0)
- - Splits total: 0 (0)
- CodeGen:(Total: 312.014ms, non-child: 312.014ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 84.004ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 113 (113)
- - NumInstructions: 3.40K (3401)
- - OptimizationTime: 204.009ms
- - PeakMemoryUsage: 1.66 MB (1741312)
- - PrepareTime: 24.001ms
- Averaged Fragment F02:(Total: 1s462ms, non-child: 1.333ms, % non-child: 0.09%)
- split sizes: min: 593.68 MB, max: 754.64 MB, avg: 659.58 MB, stddev: 53.46 MB
- completion times: min:92.004ms max:2s656ms mean: 1s466ms stddev:1s002ms
- execution rates: min:240.95 MB/sec max:7.16 GB/sec mean:2.51 GB/sec stddev:3.13 GB/sec
- num instances: 6
- - AverageThreadTokens: 3.00
- - BloomFilterBytes: 0
- - PeakMemoryUsage: 39.71 MB (41636197)
- - PeakReservation: 0
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 255.10 MB (267488391)
- - RowsProduced: 1.23M (1226453)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 1s118ms
- - TotalStorageWaitTime: 218.010ms
- - TotalThreadsInvoluntaryContextSwitches: 14 (14)
- - TotalThreadsTotalWallClockTime: 4s375ms
- - TotalThreadsSysTime: 342.301ms
- - TotalThreadsUserTime: 1s419ms
- - TotalThreadsVoluntaryContextSwitches: 2.91K (2911)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 0
- - CumulativeAllocations: 0 (0)
- - PeakReservation: 0
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 0
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 0
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 1s400ms
- - ExecTreeExecTime: 102.005ms
- - OpenTime: 60.002ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 2.000ms
- - ExecTreePrepareTime: 2.000ms
- KrpcDataStreamSender (dst_id=5):(Total: 1s297ms, non-child: 1s297ms, % non-child: 100.00%)
- - EosSent: 6 (6)
- - NetworkThroughput: 10.31 MB/sec
- - PeakMemoryUsage: 69.80 KB (71472)
- - RowsSent: 1.23M (1226453)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 76.003ms
- - TotalBytesSent: 66.74 MB (69986621)
- - UncompressedRowBatchSize: 133.34 MB (139815680)
- HDFS_SCAN_NODE (id=0):(Total: 106.005ms, non-child: 106.005ms, % non-child: 100.00%)
- - AverageHdfsReadThreadConcurrency: 0.17
- - AverageScannerThreadConcurrency: 2.17
- - BytesRead: 25.21 MB (26437262)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 14.67 MB (15378490)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 14.67 MB (15378490)
- - CachedFileHandlesHitCount: 0 (0)
- - CachedFileHandlesMissCount: 10 (10)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 304.682ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 4 (4)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 1 (1)
- - NumRowGroups: 1 (1)
- - NumScannerThreadsStarted: 5 (5)
- - NumScannersWithNoReads: 3 (3)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 39.62 MB (41540158)
- - PerReadThreadRawHdfsThroughput: 252.68 MB/sec
- - RemoteScanRanges: 12 (12)
- - RowBatchQueueGetWaitTime: 92.671ms
- - RowBatchQueuePutWaitTime: 1s224ms
- - RowsRead: 39.07M (39069498)
- - RowsReturned: 1.23M (1226453)
- - RowsReturnedRate: 8.72 M/sec
- - ScanRangesComplete: 5 (5)
- - ScannerThreadsInvoluntaryContextSwitches: 13 (13)
- - ScannerThreadsTotalWallClockTime: 2s914ms
- - MaterializeTupleTime(*): 1s082ms
- - ScannerThreadsSysTime: 268.705ms
- - ScannerThreadsUserTime: 1s207ms
- - ScannerThreadsVoluntaryContextSwitches: 663 (663)
- - TotalRawHdfsOpenFileTime(*): 100.004ms
- - TotalRawHdfsReadTime(*): 180.676ms
- - TotalReadThroughput: 11.56 MB/sec
- CodeGen:(Total: 58.002ms, non-child: 58.002ms, % non-child: 100.00%)
- - CodegenTime: 2.666ms
- - CompileTime: 10.667ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 35 (35)
- - NumInstructions: 576 (576)
- - OptimizationTime: 27.334ms
- - PeakMemoryUsage: 288.00 KB (294912)
- - PrepareTime: 20.000ms
- Fragment F02:
- Instance 33406f6405038287:b47e1f8b0000000a (host=slave-cn05:22000):(Total: 2s648ms, non-child: 4.000ms, % non-child: 0.15%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/640.00 MB
- Fragment Instance Lifecycle Event Timeline: 2s648ms
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 56.003ms (52.002ms)
- - First Batch Produced: 76.004ms (20.001ms)
- - First Batch Sent: 76.004ms (0.000ns)
- - ExecInternal Finished: 2s648ms (2s572ms)
- MemoryUsage(500.000ms): 86.02 MB, 86.15 MB, 86.12 MB, 86.08 MB, 84.19 MB
- ThreadUsage(500.000ms): 4, 4, 4, 4, 4
- - AverageThreadTokens: 4.00
- - BloomFilterBytes: 0
- - PeakMemoryUsage: 86.32 MB (90517070)
- - PeakReservation: 0
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 323.74 MB (339460825)
- - RowsProduced: 2.81M (2811244)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 2s048ms
- - TotalStorageWaitTime: 540.029ms
- - TotalThreadsInvoluntaryContextSwitches: 10 (10)
- - TotalThreadsTotalWallClockTime: 10s316ms
- - TotalThreadsSysTime: 790.685ms
- - TotalThreadsUserTime: 3s167ms
- - TotalThreadsVoluntaryContextSwitches: 7.48K (7476)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 0
- - CumulativeAllocations: 0 (0)
- - PeakReservation: 0
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 0
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 0
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 2s592ms
- - ExecTreeExecTime: 128.007ms
- - OpenTime: 52.002ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 4.000ms
- - ExecTreePrepareTime: 4.000ms
- KrpcDataStreamSender (dst_id=5):(Total: 2s460ms, non-child: 412.022ms, % non-child: 16.75%)
- BytesSent(500.000ms): 7.65 MB, 49.38 MB, 60.14 MB, 85.23 MB, 136.99 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 17.96 MB/sec
- - PeakMemoryUsage: 69.80 KB (71472)
- - RowsSent: 2.81M (2811244)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 152.008ms
- - TotalBytesSent: 152.99 MB (160426014)
- - UncompressedRowBatchSize: 305.64 MB (320481816)
- HDFS_SCAN_NODE (id=0):(Total: 136.007ms, non-child: 136.007ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/640.00 MB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5
- Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/NONE:2 PARQUET/SNAPPY:3
- BytesRead(500.000ms): 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB
- - FooterProcessingTime: (Avg: 23.201ms ; Min: 16.000ms ; Max: 32.001ms ; Number of samples: 5)
- - AverageHdfsReadThreadConcurrency: 0.00
- - AverageScannerThreadConcurrency: 3.00
- - BytesRead: 57.23 MB (60006353)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 15.28 MB (16018623)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 15.28 MB (16018623)
- - CachedFileHandlesHitCount: 0 (0)
- - CachedFileHandlesMissCount: 17 (17)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 760.041ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 4 (4)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 1 (1)
- - NumRowGroups: 3 (3)
- - NumScannerThreadsStarted: 5 (5)
- - NumScannersWithNoReads: 2 (2)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 86.22 MB (90413181)
- - PerReadThreadRawHdfsThroughput: 79.92 MB/sec
- - RemoteScanRanges: 36 (36)
- - RowBatchQueueGetWaitTime: 108.005ms
- - RowBatchQueuePutWaitTime: 3s796ms
- - RowsRead: 89.80M (89801307)
- - RowsReturned: 2.81M (2811244)
- - RowsReturnedRate: 20.67 M/sec
- - ScanRangesComplete: 5 (5)
- - ScannerThreadsInvoluntaryContextSwitches: 10 (10)
- - ScannerThreadsTotalWallClockTime: 7s672ms
- - MaterializeTupleTime(*): 2s408ms
- - ScannerThreadsSysTime: 666.730ms
- - ScannerThreadsUserTime: 2s724ms
- - ScannerThreadsVoluntaryContextSwitches: 2.18K (2181)
- - TotalRawHdfsOpenFileTime(*): 148.008ms
- - TotalRawHdfsReadTime(*): 716.039ms
- - TotalReadThroughput: 22.89 MB/sec
- CodeGen:(Total: 48.002ms, non-child: 48.002ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 8.000ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 35 (35)
- - NumInstructions: 576 (576)
- - OptimizationTime: 24.001ms
- - PeakMemoryUsage: 288.00 KB (294912)
- - PrepareTime: 16.000ms
- Instance 33406f6405038287:b47e1f8b00000007 (host=slave-cn07:22000):(Total: 2s152ms, non-child: 0.000ns, % non-child: 0.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/632.75 MB
- Fragment Instance Lifecycle Event Timeline: 2s152ms
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 60.002ms (56.002ms)
- - First Batch Produced: 80.003ms (20.000ms)
- - First Batch Sent: 80.003ms (0.000ns)
- - ExecInternal Finished: 2s152ms (2s072ms)
- MemoryUsage(500.000ms): 54.84 MB, 58.11 MB, 58.02 MB, 57.93 MB
- ThreadUsage(500.000ms): 3, 3, 3, 3
- - AverageThreadTokens: 3.00
- - BloomFilterBytes: 0
- - PeakMemoryUsage: 58.20 MB (61029923)
- - PeakReservation: 0
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 289.55 MB (303611372)
- - RowsProduced: 1.88M (1876845)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 1s692ms
- - TotalStorageWaitTime: 260.012ms
- - TotalThreadsInvoluntaryContextSwitches: 13 (13)
- - TotalThreadsTotalWallClockTime: 6s320ms
- - TotalThreadsSysTime: 569.640ms
- - TotalThreadsUserTime: 2s048ms
- - TotalThreadsVoluntaryContextSwitches: 4.25K (4248)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 0
- - CumulativeAllocations: 0 (0)
- - PeakReservation: 0
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 0
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 0
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 2s092ms
- - ExecTreeExecTime: 124.005ms
- - OpenTime: 56.002ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 4.000ms
- - ExecTreePrepareTime: 4.000ms
- KrpcDataStreamSender (dst_id=5):(Total: 1s964ms, non-child: 272.012ms, % non-child: 13.85%)
- BytesSent(500.000ms): 856.88 KB, 24.97 MB, 57.46 MB, 67.02 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 16.22 MB/sec
- - PeakMemoryUsage: 69.80 KB (71472)
- - RowsSent: 1.88M (1876845)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 112.005ms
- - TotalBytesSent: 102.13 MB (107094174)
- - UncompressedRowBatchSize: 204.05 MB (213960330)
- HDFS_SCAN_NODE (id=0):(Total: 132.006ms, non-child: 132.006ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/632.75 MB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5
- Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/NONE:3 PARQUET/SNAPPY:2
- BytesRead(500.000ms): 38.31 MB, 38.31 MB, 38.31 MB, 38.31 MB
- - FooterProcessingTime: (Avg: 18.400ms ; Min: 16.000ms ; Max: 24.001ms ; Number of samples: 5)
- - AverageHdfsReadThreadConcurrency: 0.00
- - AverageScannerThreadConcurrency: 2.00
- - BytesRead: 38.31 MB (40166643)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 19.21 MB (20141508)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 19.21 MB (20141508)
- - CachedFileHandlesHitCount: 0 (0)
- - CachedFileHandlesMissCount: 13 (13)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 460.021ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 4 (4)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 2 (2)
- - NumRowGroups: 2 (2)
- - NumScannerThreadsStarted: 5 (5)
- - NumScannersWithNoReads: 3 (3)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 58.10 MB (60926034)
- - PerReadThreadRawHdfsThroughput: 168.00 MB/sec
- - RemoteScanRanges: 18 (18)
- - RowBatchQueueGetWaitTime: 96.004ms
- - RowBatchQueuePutWaitTime: 1s704ms
- - RowsRead: 59.84M (59844265)
- - RowsReturned: 1.88M (1876845)
- - RowsReturnedRate: 14.22 M/sec
- - ScanRangesComplete: 5 (5)
- - ScannerThreadsInvoluntaryContextSwitches: 11 (11)
- - ScannerThreadsTotalWallClockTime: 4s172ms
- - MaterializeTupleTime(*): 1s592ms
- - ScannerThreadsSysTime: 423.373ms
- - ScannerThreadsUserTime: 1s799ms
- - ScannerThreadsVoluntaryContextSwitches: 844 (844)
- - TotalRawHdfsOpenFileTime(*): 112.005ms
- - TotalRawHdfsReadTime(*): 228.010ms
- - TotalReadThroughput: 19.15 MB/sec
- CodeGen:(Total: 56.002ms, non-child: 56.002ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 8.000ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 35 (35)
- - NumInstructions: 576 (576)
- - OptimizationTime: 28.001ms
- - PeakMemoryUsage: 288.00 KB (294912)
- - PrepareTime: 20.000ms
- Instance 33406f6405038287:b47e1f8b00000008 (host=slave-cn02:22000):(Total: 1s920ms, non-child: 0.000ns, % non-child: 0.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:6/754.64 MB
- Fragment Instance Lifecycle Event Timeline: 1s920ms
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 64.002ms (60.002ms)
- - First Batch Produced: 76.003ms (12.000ms)
- - First Batch Sent: 76.003ms (0.000ns)
- - ExecInternal Finished: 1s920ms (1s844ms)
- MemoryUsage(500.000ms): 45.88 MB, 45.46 MB, 30.13 MB, 29.94 MB
- ThreadUsage(500.000ms): 3, 3, 2, 2
- - AverageThreadTokens: 2.50
- - BloomFilterBytes: 0
- - PeakMemoryUsage: 46.26 MB (48507432)
- - PeakReservation: 0
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 471.08 MB (493961207)
- - RowsProduced: 1.34M (1342523)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 1s504ms
- - TotalStorageWaitTime: 152.007ms
- - TotalThreadsInvoluntaryContextSwitches: 47 (47)
- - TotalThreadsTotalWallClockTime: 4s644ms
- - TotalThreadsSysTime: 387.746ms
- - TotalThreadsUserTime: 1s573ms
- - TotalThreadsVoluntaryContextSwitches: 2.87K (2868)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 0
- - CumulativeAllocations: 0 (0)
- - PeakReservation: 0
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 0
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 0
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 1s856ms
- - ExecTreeExecTime: 136.006ms
- - OpenTime: 60.002ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 4.000ms
- - ExecTreePrepareTime: 4.000ms
- KrpcDataStreamSender (dst_id=5):(Total: 1s720ms, non-child: 216.009ms, % non-child: 12.56%)
- BytesSent(500.000ms): 4.88 MB, 30.62 MB, 54.43 MB, 62.09 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 13.49 MB/sec
- - PeakMemoryUsage: 69.80 KB (71472)
- - RowsSent: 1.34M (1342523)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 104.004ms
- - TotalBytesSent: 73.06 MB (76604592)
- - UncompressedRowBatchSize: 145.96 MB (153047622)
- HDFS_SCAN_NODE (id=0):(Total: 144.006ms, non-child: 144.006ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:6/754.64 MB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6
- Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/NONE:4 PARQUET/SNAPPY:2
- BytesRead(500.000ms): 27.57 MB, 27.57 MB, 27.57 MB, 27.57 MB
- - FooterProcessingTime: (Avg: 17.334ms ; Min: 12.000ms ; Max: 28.001ms ; Number of samples: 6)
- - AverageHdfsReadThreadConcurrency: 0.00
- - AverageScannerThreadConcurrency: 1.50
- - BytesRead: 27.57 MB (28912212)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 25.83 MB (27084442)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 25.83 MB (27084442)
- - CachedFileHandlesHitCount: 2 (2)
- - CachedFileHandlesMissCount: 12 (12)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 312.014ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 4 (4)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 2 (2)
- - NumRowGroups: 2 (2)
- - NumScannerThreadsStarted: 6 (6)
- - NumScannersWithNoReads: 4 (4)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 46.16 MB (48403543)
- - PerReadThreadRawHdfsThroughput: 344.64 MB/sec
- - RemoteScanRanges: 6 (6)
- - RowBatchQueueGetWaitTime: 132.006ms
- - RowBatchQueuePutWaitTime: 928.042ms
- - RowsRead: 42.69M (42694271)
- - RowsReturned: 1.34M (1342523)
- - RowsReturnedRate: 9.32 M/sec
- - ScanRangesComplete: 6 (6)
- - ScannerThreadsInvoluntaryContextSwitches: 46 (46)
- - ScannerThreadsTotalWallClockTime: 2s728ms
- - MaterializeTupleTime(*): 1s268ms
- - ScannerThreadsSysTime: 280.073ms
- - ScannerThreadsUserTime: 1s369ms
- - ScannerThreadsVoluntaryContextSwitches: 456 (456)
- - TotalRawHdfsOpenFileTime(*): 80.003ms
- - TotalRawHdfsReadTime(*): 80.003ms
- - TotalReadThroughput: 13.79 MB/sec
- CodeGen:(Total: 60.002ms, non-child: 60.002ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 12.000ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 35 (35)
- - NumInstructions: 576 (576)
- - OptimizationTime: 24.001ms
- - PeakMemoryUsage: 288.00 KB (294912)
- - PrepareTime: 24.001ms
- Instance 33406f6405038287:b47e1f8b0000000b (host=slave-cn04:22000):(Total: 1s876ms, non-child: 4.000ms, % non-child: 0.21%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/593.68 MB
- Fragment Instance Lifecycle Event Timeline: 1s880ms
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 84.004ms (80.004ms)
- - First Batch Produced: 100.005ms (16.000ms)
- - First Batch Sent: 100.005ms (0.000ns)
- - ExecInternal Finished: 1s880ms (1s780ms)
- MemoryUsage(500.000ms): 44.16 MB, 45.65 MB, 29.11 MB, 29.83 MB
- ThreadUsage(500.000ms): 3, 3, 2, 2
- - AverageThreadTokens: 2.50
- - BloomFilterBytes: 0
- - PeakMemoryUsage: 46.26 MB (48508451)
- - PeakReservation: 0
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 311.58 MB (326716942)
- - RowsProduced: 1.33M (1328108)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 1s456ms
- - TotalStorageWaitTime: 136.007ms
- - TotalThreadsInvoluntaryContextSwitches: 17 (17)
- - TotalThreadsTotalWallClockTime: 4s508ms
- - TotalThreadsSysTime: 301.206ms
- - TotalThreadsUserTime: 1s616ms
- - TotalThreadsVoluntaryContextSwitches: 2.74K (2743)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 0
- - CumulativeAllocations: 0 (0)
- - PeakReservation: 0
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 0
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 0
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 1s796ms
- - ExecTreeExecTime: 164.008ms
- - OpenTime: 80.004ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=5):(Total: 1s632ms, non-child: 176.009ms, % non-child: 10.78%)
- BytesSent(500.000ms): 9.50 KB, 20.84 MB, 52.15 MB, 59.38 MB
- - EosSent: 6 (6)
- - NetworkThroughput: 14.18 MB/sec
- - PeakMemoryUsage: 69.80 KB (71472)
- - RowsSent: 1.33M (1328108)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 88.004ms
- - TotalBytesSent: 72.28 MB (75794946)
- - UncompressedRowBatchSize: 144.39 MB (151404312)
- HDFS_SCAN_NODE (id=0):(Total: 164.008ms, non-child: 164.008ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/593.68 MB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5
- Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/NONE:3 PARQUET/SNAPPY:2
- BytesRead(500.000ms): 27.10 MB, 27.10 MB, 27.10 MB, 27.10 MB
- - FooterProcessingTime: (Avg: 18.400ms ; Min: 16.000ms ; Max: 24.001ms ; Number of samples: 5)
- - AverageHdfsReadThreadConcurrency: 0.00
- - AverageScannerThreadConcurrency: 1.50
- - BytesRead: 27.10 MB (28411968)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 27.00 MB (28309568)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 27.00 MB (28309568)
- - CachedFileHandlesHitCount: 2 (2)
- - CachedFileHandlesMissCount: 11 (11)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 296.015ms
- - MaxCompressedTextFileLength: 0
- - NumColumns: 4 (4)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 2 (2)
- - NumRowGroups: 2 (2)
- - NumScannerThreadsStarted: 5 (5)
- - NumScannersWithNoReads: 3 (3)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 46.16 MB (48404562)
- - PerReadThreadRawHdfsThroughput: 752.62 MB/sec
- - RemoteScanRanges: 3 (3)
- - RowBatchQueueGetWaitTime: 160.008ms
- - RowBatchQueuePutWaitTime: 916.048ms
- - RowsRead: 42.08M (42077149)
- - RowsReturned: 1.33M (1328108)
- - RowsReturnedRate: 8.10 M/sec
- - ScanRangesComplete: 5 (5)
- - ScannerThreadsInvoluntaryContextSwitches: 16 (16)
- - ScannerThreadsTotalWallClockTime: 2s632ms
- - MaterializeTupleTime(*): 1s224ms
- - ScannerThreadsSysTime: 238.662ms
- - ScannerThreadsUserTime: 1s351ms
- - ScannerThreadsVoluntaryContextSwitches: 450 (450)
- - TotalRawHdfsOpenFileTime(*): 96.005ms
- - TotalRawHdfsReadTime(*): 36.001ms
- - TotalReadThroughput: 13.55 MB/sec
- CodeGen:(Total: 76.004ms, non-child: 76.004ms, % non-child: 100.00%)
- - CodegenTime: 0.000ns
- - CompileTime: 16.000ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 35 (35)
- - NumInstructions: 576 (576)
- - OptimizationTime: 36.001ms
- - PeakMemoryUsage: 288.00 KB (294912)
- - PrepareTime: 24.001ms
- Instance 33406f6405038287:b47e1f8b0000000c (host=slave-cn03:22000):(Total: 92.004ms, non-child: 4.000ms, % non-child: 4.35%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:6/703.67 MB
- Fragment Instance Lifecycle Event Timeline: 96.004ms
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 60.002ms (56.002ms)
- - First Batch Produced: 84.003ms (24.001ms)
- - First Batch Sent: 84.003ms (0.000ns)
- - ExecInternal Finished: 96.004ms (12.000ms)
- - AverageThreadTokens: 0.00
- - BloomFilterBytes: 0
- - PeakMemoryUsage: 482.45 KB (494033)
- - PeakReservation: 0
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 67.19 MB (70456881)
- - RowsProduced: 0 (0)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 4.000ms
- - TotalStorageWaitTime: 108.004ms
- - TotalThreadsInvoluntaryContextSwitches: 0 (0)
- - TotalThreadsTotalWallClockTime: 264.012ms
- - TotalThreadsSysTime: 4.336ms
- - TotalThreadsUserTime: 52.566ms
- - TotalThreadsVoluntaryContextSwitches: 65 (65)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 0
- - CumulativeAllocations: 0 (0)
- - PeakReservation: 0
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 0
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 0
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 36.001ms
- - ExecTreeExecTime: 32.001ms
- - OpenTime: 56.002ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=5):(Total: 4.000ms, non-child: 0.000ns, % non-child: 0.00%)
- - EosSent: 6 (6)
- - NetworkThroughput: 0.00 /sec
- - PeakMemoryUsage: 69.80 KB (71472)
- - RowsSent: 0 (0)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 0.000ns
- - TotalBytesSent: 0
- - UncompressedRowBatchSize: 0
- HDFS_SCAN_NODE (id=0):(Total: 32.001ms, non-child: 32.001ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:6/703.67 MB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6
- Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/NONE:6
- - FooterProcessingTime: (Avg: 18.000ms ; Min: 4.000ms ; Max: 28.001ms ; Number of samples: 6)
- - AverageHdfsReadThreadConcurrency: 0.00
- - AverageScannerThreadConcurrency: 0.00
- - BytesRead: 600.00 KB (614400)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 600.00 KB (614400)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 600.00 KB (614400)
- - CachedFileHandlesHitCount: 1 (1)
- - CachedFileHandlesMissCount: 5 (5)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 0.000ns
- - MaxCompressedTextFileLength: 0
- - NumColumns: 4 (4)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 2 (2)
- - NumRowGroups: 0 (0)
- - NumScannerThreadsStarted: 6 (6)
- - NumScannersWithNoReads: 6 (6)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 404.00 KB (413696)
- - PerReadThreadRawHdfsThroughput: 146.48 MB/sec
- - RemoteScanRanges: 0 (0)
- - RowBatchQueueGetWaitTime: 32.001ms
- - RowBatchQueuePutWaitTime: 0.000ns
- - RowsRead: 0 (0)
- - RowsReturned: 0 (0)
- - RowsReturnedRate: 0
- - ScanRangesComplete: 6 (6)
- - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
- - ScannerThreadsTotalWallClockTime: 172.007ms
- - MaterializeTupleTime(*): 0.000ns
- - ScannerThreadsSysTime: 1.911ms
- - ScannerThreadsUserTime: 0.000ns
- - ScannerThreadsVoluntaryContextSwitches: 24 (24)
- - TotalRawHdfsOpenFileTime(*): 72.003ms
- - TotalRawHdfsReadTime(*): 4.000ms
- - TotalReadThroughput: 0.00 /sec
- CodeGen:(Total: 52.002ms, non-child: 52.002ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 12.000ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 35 (35)
- - NumInstructions: 576 (576)
- - OptimizationTime: 24.001ms
- - PeakMemoryUsage: 288.00 KB (294912)
- - PrepareTime: 16.000ms
- Instance 33406f6405038287:b47e1f8b00000009 (host=slave-cn06:22000):(Total: 88.002ms, non-child: 0.000ns, % non-child: 0.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/632.76 MB
- Fragment Instance Lifecycle Event Timeline: 92.002ms
- - Prepare Finished: 4.000ms (4.000ms)
- - Open Finished: 60.001ms (56.001ms)
- - First Batch Produced: 80.002ms (20.000ms)
- - First Batch Sent: 80.002ms (0.000ns)
- - ExecInternal Finished: 92.002ms (12.000ms)
- MemoryUsage(500.000ms): 742.45 KB
- ThreadUsage(500.000ms): 6
- - AverageThreadTokens: 6.00
- - BloomFilterBytes: 0
- - PeakMemoryUsage: 742.45 KB (760273)
- - PeakReservation: 0
- - PeakUsedReservation: 0
- - PerHostPeakMemUsage: 67.45 MB (70723121)
- - RowsProduced: 0 (0)
- - TotalNetworkReceiveTime: 0.000ns
- - TotalNetworkSendTime: 4.000ms
- - TotalStorageWaitTime: 112.003ms
- - TotalThreadsInvoluntaryContextSwitches: 0 (0)
- - TotalThreadsTotalWallClockTime: 200.006ms
- - TotalThreadsSysTime: 196.000us
- - TotalThreadsUserTime: 57.779ms
- - TotalThreadsVoluntaryContextSwitches: 70 (70)
- Buffer pool:
- - AllocTime: 0.000ns
- - CumulativeAllocationBytes: 0
- - CumulativeAllocations: 0 (0)
- - PeakReservation: 0
- - PeakUnpinnedBytes: 0
- - PeakUsedReservation: 0
- - ReadIoBytes: 0
- - ReadIoOps: 0 (0)
- - ReadIoWaitTime: 0.000ns
- - ReservationLimit: 0
- - WriteIoBytes: 0
- - WriteIoOps: 0 (0)
- - WriteIoWaitTime: 0.000ns
- Fragment Instance Lifecycle Timings:
- - ExecTime: 32.001ms
- - ExecTreeExecTime: 28.000ms
- - OpenTime: 56.001ms
- - ExecTreeOpenTime: 0.000ns
- - PrepareTime: 0.000ns
- - ExecTreePrepareTime: 0.000ns
- KrpcDataStreamSender (dst_id=5):(Total: 4.000ms, non-child: 0.000ns, % non-child: 0.00%)
- BytesSent(500.000ms): 0
- - EosSent: 6 (6)
- - NetworkThroughput: 0.00 /sec
- - PeakMemoryUsage: 69.80 KB (71472)
- - RowsSent: 0 (0)
- - RpcFailure: 0 (0)
- - RpcRetry: 0 (0)
- - SerializeBatchTime: 0.000ns
- - TotalBytesSent: 0
- - UncompressedRowBatchSize: 0
- HDFS_SCAN_NODE (id=0):(Total: 28.000ms, non-child: 28.000ms, % non-child: 100.00%)
- Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:5/632.76 MB
- ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5
- Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0%
- File Formats: PARQUET/NONE:5
- BytesRead(500.000ms): 0
- - FooterProcessingTime: (Avg: 22.400ms ; Min: 20.000ms ; Max: 28.000ms ; Number of samples: 5)
- - AverageHdfsReadThreadConcurrency: 1.00
- - AverageScannerThreadConcurrency: 5.00
- - BytesRead: 500.00 KB (512000)
- - BytesReadDataNodeCache: 0
- - BytesReadLocal: 100.00 KB (102400)
- - BytesReadRemoteUnexpected: 0
- - BytesReadShortCircuit: 100.00 KB (102400)
- - CachedFileHandlesHitCount: 0 (0)
- - CachedFileHandlesMissCount: 5 (5)
- - CollectionItemsRead: 0 (0)
- - DecompressionTime: 0.000ns
- - MaxCompressedTextFileLength: 0
- - NumColumns: 4 (4)
- - NumDictFilteredRowGroups: 0 (0)
- - NumDisksAccessed: 2 (2)
- - NumRowGroups: 0 (0)
- - NumScannerThreadsStarted: 5 (5)
- - NumScannersWithNoReads: 5 (5)
- - NumStatsFilteredRowGroups: 0 (0)
- - PeakMemoryUsage: 664.00 KB (679936)
- - PerReadThreadRawHdfsThroughput: 24.41 MB/sec
- - RemoteScanRanges: 12 (12)
- - RowBatchQueueGetWaitTime: 28.000ms
- - RowBatchQueuePutWaitTime: 0.000ns
- - RowsRead: 0 (0)
- - RowsReturned: 0 (0)
- - RowsReturnedRate: 0
- - ScanRangesComplete: 5 (5)
- - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
- - ScannerThreadsTotalWallClockTime: 112.003ms
- - MaterializeTupleTime(*): 0.000ns
- - ScannerThreadsSysTime: 1.483ms
- - ScannerThreadsUserTime: 0.000ns
- - ScannerThreadsVoluntaryContextSwitches: 24 (24)
- - TotalRawHdfsOpenFileTime(*): 92.003ms
- - TotalRawHdfsReadTime(*): 20.000ms
- - TotalReadThroughput: 0.00 /sec
- CodeGen:(Total: 56.001ms, non-child: 56.001ms, % non-child: 100.00%)
- - CodegenTime: 4.000ms
- - CompileTime: 8.000ms
- - LoadTime: 0.000ns
- - ModuleBitcodeSize: 1.95 MB (2040108)
- - NumFunctions: 35 (35)
- - NumInstructions: 576 (576)
- - OptimizationTime: 28.000ms
- - PeakMemoryUsage: 288.00 KB (294912)
- - PrepareTime: 20.000ms
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement