Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- 2018.01.18 22:09:45.992848 [ 69 ] <Debug> executeQuery: (from 10.247.129.132:49712, query_id: cc4f3652-61fb-483f-a4e8-157e41e606b2) insert into Distributed.TTStatBase (impression_id, impression_id_sequence, ts,request_uri,referer,ip, useragent,publisher_id,site_id,section_id,size,media_type,uuid,detected_domain,early_exit,rr_domain,subpartner_id,revenue_type,flash_version,is_secure,banner_position,frame_level,is_focused_tab,site_category,section_category,min_duration,max_duration,startdelay,api_frameworks,video_protocols,mimetypes,can_track_clicks,advertiser_id,campaign_type,bidder_id,seat_id,bidder_creative_id,bid_price_bucket,line_item_type,pricing_type,landing_page_domain,is_learning,campaign_id,line_item_id,demand_size,creative_id,agency_name,advertiser_name,os_version,zip,country,city,geo_id,country_region,region,bid_floor,language,os,is_cookie_accepted,device_maker,device_type,is_floor_optimized,browser_name,browser_version,device_model,deal_id,bid_currency,creative_attr,count_creatives,act_net,bid_currency_eur,service_fee,exp_net,bid,win_bidder,exp_pub,act_pub,net_payable,bid_currency_other,act_net_usd,act_net_eur,act_net_other,bid_currency_usd,mobile,blocked_attr,is_anonymized,allowed_deal_ids,is_lower_bidfloor,count_requests,count_impressions,count_clicks, click_referer, click_redirect_url,click_request_uri,count_video_events,video_event_name, count_bids, count_bidrequests_compressed, events_compression_ratio, count_response_ads, count_responses, video_placement,pub_payable, didsha1, didmd5, dpidsha1, dpidmd5, ifa, pxratio, cookie_ts, is_matched, is_high_load, nobid_reason, count_nobids_compressed, comment,traffic_type,bundle,section_floor_orig,rev_share_orig, auction_sequence, event_type) format TabSeparated
- 2018.01.18 22:09:46.081212 [ 13 ] <Debug> SrcViews..inner.TTViewAdv (Merger): Merge sorted 23604 rows, containing 69 columns (69 merged, 0 gathered) in 0.17 sec., 139015.20 rows/sec., 172.41 MB/sec.
- 2018.01.18 22:09:48.034084 [ 9 ] <Debug> SrcViews..inner.TTViewDailyAdv (Merger): Merge sorted 342 rows, containing 69 columns (69 merged, 0 gathered) in 0.02 sec., 14440.54 rows/sec., 49.22 MB/sec.
- 2018.01.18 22:09:48.711173 [ 4 ] <Debug> SrcViews..inner.TTViewAdv (Merger): Merge sorted 24197 rows, containing 69 columns (69 merged, 0 gathered) in 0.10 sec., 247494.37 rows/sec., 296.60 MB/sec.
- 2018.01.18 22:09:51.415041 [ 12 ] <Debug> SrcViews..inner.TTViewAdv (Merger): Merge sorted 27161 rows, containing 69 columns (69 merged, 0 gathered) in 0.16 sec., 164640.59 rows/sec., 192.47 MB/sec.
- 2018.01.18 22:09:51.723045 [ 16 ] <Debug> SrcViews..inner.TTViewDailyAdv (Merger): Merge sorted 2021 rows, containing 69 columns (69 merged, 0 gathered) in 0.04 sec., 48187.79 rows/sec., 81.91 MB/sec.
- 2018.01.18 22:09:54.356031 [ 3 ] <Debug> SrcViews..inner.TTViewAdv (Merger): Merge sorted 30522 rows, containing 69 columns (69 merged, 0 gathered) in 0.16 sec., 185068.67 rows/sec., 230.74 MB/sec.
- 2018.01.18 22:09:54.615135 [ 14 ] <Debug> SrcViews..inner.TTViewDailyAdv (Merger): Merge sorted 2653 rows, containing 69 columns (69 merged, 0 gathered) in 0.03 sec., 90976.14 rows/sec., 142.73 MB/sec.
- 2018.01.18 22:09:56.699817 [ 69 ] <Debug> SrcData.TTStatBase (Replicated OutputStream): Wrote block with ID '16840269432741930523_12796798484350911056', 391992 rows
- 2018.01.18 22:09:56.806056 [ 69 ] <Trace> SrcData.TTStatBase (Data): Renaming temporary part tmp_insert_201801_63407_63407_0 to 201801_30465_30465_0.
- 2018.01.18 22:09:56.968802 [ 69 ] <Trace> InterpreterSelectQuery: FetchColumns -> Complete
- 2018.01.18 22:09:56.969627 [ 69 ] <Trace> Aggregator: Aggregating
- 2018.01.18 22:09:56.984311 [ 69 ] <Trace> Aggregator: Aggregation method: concat
- 2018.01.18 22:09:57.118975 [ 69 ] <Trace> Aggregator: Aggregated. 391992 to 7239 rows (from 674.701 MiB) in 0.149 sec. (2625162.149 rows/sec., 4518.462 MiB/sec.)
- 2018.01.18 22:09:57.118990 [ 69 ] <Trace> Aggregator: Merging aggregated data
- 2018.01.18 22:09:57.128065 [ 69 ] <Debug> SrcViews..inner.TTUIViewDailySub (Replicated OutputStream): Wrote block with 7239 rows
- 2018.01.18 22:09:57.234275 [ 69 ] <Trace> SrcViews..inner.TTUIViewDailySub (Data): Renaming temporary part tmp_insert_20180118_20180118_8140_8140_0 to 20180118_20180118_7836_7836_0.
- 2018.01.18 22:09:57.394005 [ 69 ] <Trace> virtual DB::MergingAndConvertingBlockInputStream::~MergingAndConvertingBlockInputStream(): Waiting for threads to finish
- 2018.01.18 22:09:57.395153 [ 69 ] <Trace> InterpreterSelectQuery: FetchColumns -> Complete
- 2018.01.18 22:09:57.396693 [ 69 ] <Trace> Aggregator: Aggregating
- 2018.01.18 22:09:57.397394 [ 69 ] <Trace> Aggregator: Aggregation method: concat
- 2018.01.18 22:09:57.621834 [ 69 ] <Trace> Aggregator: Aggregated. 391992 to 39128 rows (from 674.007 MiB) in 0.225 sec. (1741488.044 rows/sec., 2994.383 MiB/sec.)
- 2018.01.18 22:09:57.621958 [ 69 ] <Trace> Aggregator: Merging aggregated data
- 2018.01.18 22:09:57.736229 [ 69 ] <Debug> SrcViews..inner.TTViewAdv (Replicated OutputStream): Wrote block with 39128 rows
- 2018.01.18 22:09:57.842334 [ 69 ] <Trace> SrcViews..inner.TTViewAdv (Data): Renaming temporary part tmp_insert_20180118_20180118_8140_8140_0 to 20180118_20180118_7836_7836_0.
- 2018.01.18 22:09:58.003174 [ 69 ] <Trace> virtual DB::MergingAndConvertingBlockInputStream::~MergingAndConvertingBlockInputStream(): Waiting for threads to finish
- 2018.01.18 22:09:58.004178 [ 69 ] <Trace> InterpreterSelectQuery: FetchColumns -> Complete
- 2018.01.18 22:09:58.005469 [ 69 ] <Trace> Aggregator: Aggregating
- 2018.01.18 22:09:58.006252 [ 69 ] <Trace> Aggregator: Aggregation method: concat
- 2018.01.18 22:09:58.214873 [ 69 ] <Trace> Aggregator: Aggregated. 391992 to 37501 rows (from 674.007 MiB) in 0.209 sec. (1872375.829 rows/sec., 3219.437 MiB/sec.)
- 2018.01.18 22:09:58.214889 [ 69 ] <Trace> Aggregator: Merging aggregated data
- 2018.01.18 22:09:58.317517 [ 69 ] <Debug> SrcViews..inner.TTViewDailyAdv (Replicated OutputStream): Wrote block with 37501 rows
- 2018.01.18 22:09:58.423753 [ 69 ] <Trace> SrcViews..inner.TTViewDailyAdv (Data): Renaming temporary part tmp_insert_20180118_20180118_8140_8140_0 to 20180118_20180118_7836_7836_0.
- 2018.01.18 22:09:58.583891 [ 69 ] <Trace> virtual DB::MergingAndConvertingBlockInputStream::~MergingAndConvertingBlockInputStream(): Waiting for threads to finish
- 2018.01.18 22:09:58.584845 [ 69 ] <Trace> InterpreterSelectQuery: FetchColumns -> Complete
- 2018.01.18 22:09:58.585996 [ 69 ] <Trace> Aggregator: Aggregating
- 2018.01.18 22:09:58.586672 [ 69 ] <Trace> Aggregator: Aggregation method: concat
- 2018.01.18 22:09:58.750985 [ 69 ] <Trace> Aggregator: Aggregated. 391992 to 11091 rows (from 674.007 MiB) in 0.165 sec. (2376599.725 rows/sec., 4086.420 MiB/sec.)
- 2018.01.18 22:09:58.751004 [ 69 ] <Trace> Aggregator: Merging aggregated data
- 2018.01.18 22:09:58.785635 [ 69 ] <Debug> SrcViews..inner.TTViewDailyBidders (Replicated OutputStream): Wrote block with 11091 rows
- 2018.01.18 22:09:58.891864 [ 69 ] <Trace> SrcViews..inner.TTViewDailyBidders (Data): Renaming temporary part tmp_insert_20180118_20180118_8140_8140_0 to 20180118_20180118_7836_7836_0.
- 2018.01.18 22:09:59.052100 [ 69 ] <Trace> virtual DB::MergingAndConvertingBlockInputStream::~MergingAndConvertingBlockInputStream(): Waiting for threads to finish
- 2018.01.18 22:09:59.053258 [ 69 ] <Trace> InterpreterSelectQuery: FetchColumns -> Complete
- 2018.01.18 22:09:59.054576 [ 69 ] <Trace> Aggregator: Aggregating
- 2018.01.18 22:09:59.055281 [ 69 ] <Trace> Aggregator: Aggregation method: concat
- 2018.01.18 22:09:59.341419 [ 69 ] <Trace> Aggregator: Converting aggregation data to two-level.
- 2018.01.18 22:09:59.366971 [ 69 ] <Debug> Aggregator: Writing part of aggregation data into temporary file /home/clickhouse/tmp/tmp2136yhdaaa.
- 2018.01.18 22:09:59.542129 [ 69 ] <Trace> Aggregator: Max size of temporary block: 393 rows, 6144.222 MiB.
- 2018.01.18 22:09:59.542907 [ 69 ] <Trace> Aggregator: Written part in 0.197 sec., 86930 rows, 40.017 MiB uncompressed, 4.227 MiB compressed, 482.702 uncompressed bytes per row, 50.983 compressed bytes per row, compression rate: 9.468 (442313.124 rows/sec., 203.615 MiB/sec. uncompressed, 21.506 MiB/sec. compressed)
- 2018.01.18 22:09:59.542987 [ 69 ] <Trace> Aggregator: Aggregated. 391992 to 0 rows (from 674.007 MiB) in 0.488 sec. (802603.093 rows/sec., 1380.028 MiB/sec.)
- 2018.01.18 22:09:59.543061 [ 69 ] <Trace> AggregatingBlockInputStream: Will merge 1 temporary files of size 4.22661 MiB compressed, 40.0174 MiB uncompressed.
- 2018.01.18 22:09:59.544834 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 0).
- 2018.01.18 22:09:59.545896 [ 69 ] <Trace> Aggregator: Merged partially aggregated blocks. 346 rows, 24.008 MiB. in 0.001 sec. (332066.171 rows/sec., 23041.274 MiB/sec.)
- 2018.01.18 22:09:59.551299 [ 69 ] <Debug> SrcViews..inner.TTViewDailyOther (Replicated OutputStream): Wrote block with 346 rows
- 2018.01.18 22:09:59.661073 [ 69 ] <Trace> SrcViews..inner.TTViewDailyOther (Data): Renaming temporary part tmp_insert_20180118_20180118_577699_577699_0 to 20180118_20180118_1611346_1611346_0.
- 2018.01.18 22:09:59.822528 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 1).
- 2018.01.18 22:09:59.823264 [ 69 ] <Trace> Aggregator: Merged partially aggregated blocks. 351 rows, 24.011 MiB. in 0.001 sec. (487794.031 rows/sec., 33368.460 MiB/sec.)
- 2018.01.18 22:09:59.828530 [ 69 ] <Debug> SrcViews..inner.TTViewDailyOther (Replicated OutputStream): Wrote block with 351 rows
- 2018.01.18 22:09:59.943897 [ 69 ] <Trace> SrcViews..inner.TTViewDailyOther (Data): Renaming temporary part tmp_insert_20180118_20180118_577700_577700_0 to 20180118_20180118_1611347_1611347_0.
- 2018.01.18 22:10:00.114726 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 2).
- 2018.01.18 22:10:00.115564 [ 69 ] <Trace> Aggregator: Merged partially aggregated blocks. 324 rows, 23.996 MiB. in 0.001 sec. (396954.720 rows/sec., 29398.812 MiB/sec.)
- 2018.01.18 22:10:00.121092 [ 69 ] <Debug> SrcViews..inner.TTViewDailyOther (Replicated OutputStream): Wrote block with 324 rows
- 2018.01.18 22:10:00.293921 [ 69 ] <Trace> SrcViews..inner.TTViewDailyOther (Data): Renaming temporary part tmp_insert_20180118_20180118_577701_577701_0 to 20180118_20180118_1611348_1611348_0.
- 2018.01.18 22:10:00.455155 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 3).
- 2018.01.18 22:10:00.456099 [ 69 ] <Trace> Aggregator: Merged partially aggregated blocks. 362 rows, 24.017 MiB. in 0.001 sec. (400959.201 rows/sec., 26601.967 MiB/sec.)
- 2018.01.18 22:10:00.465109 [ 69 ] <Debug> SrcViews..inner.TTViewDailyOther (Replicated OutputStream): Wrote block with 362 rows
- 2018.01.18 22:10:00.571216 [ 69 ] <Trace> SrcViews..inner.TTViewDailyOther (Data): Renaming temporary part tmp_insert_20180118_20180118_577702_577702_0 to 20180118_20180118_1611349_1611349_0.
- 2018.01.18 22:10:00.738365 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 4).
- 2018.01.18 22:10:00.739447 [ 69 ] <Trace> Aggregator: Merged partially aggregated blocks. 336 rows, 24.002 MiB. in 0.001 sec. (360951.882 rows/sec., 25784.848 MiB/sec.)
- 2018.01.18 22:10:00.744862 [ 69 ] <Debug> SrcViews..inner.TTViewDailyOther (Replicated OutputStream): Wrote block with 336 rows
- 2018.01.18 22:10:00.851434 [ 69 ] <Trace> SrcViews..inner.TTViewDailyOther (Data): Renaming temporary part tmp_insert_20180118_20180118_577703_577703_0 to 20180118_20180118_1611350_1611350_0.
- 2018.01.18 22:10:01.013553 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 5).
- 2018.01.18 22:10:01.014473 [ 69 ] <Trace> Aggregator: Merged partially aggregated blocks. 301 rows, 23.983 MiB. in 0.001 sec. (373198.172 rows/sec., 29735.135 MiB/sec.)
- 2018.01.18 22:10:01.020544 [ 69 ] <Debug> SrcViews..inner.TTViewDailyOther (Replicated OutputStream): Wrote block with 301 rows
- 2018.01.18 22:10:01.128013 [ 69 ] <Trace> SrcViews..inner.TTViewDailyOther (Data): Renaming temporary part tmp_insert_20180118_20180118_577704_577704_0 to 20180118_20180118_1611351_1611351_0.
- 2018.01.18 22:10:01.291751 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 6).
- 2018.01.18 22:10:01.292828 [ 69 ] <Trace> Aggregator: Merged partially aggregated blocks. 353 rows, 24.012 MiB. in 0.001 sec. (344976.536 rows/sec., 23466.170 MiB/sec.)
- 2018.01.18 22:10:01.297993 [ 69 ] <Debug> SrcViews..inner.TTViewDailyOther (Replicated OutputStream): Wrote block with 353 rows
- 2018.01.18 22:10:01.405270 [ 69 ] <Trace> SrcViews..inner.TTViewDailyOther (Data): Renaming temporary part tmp_insert_20180118_20180118_577705_577705_0 to 20180118_20180118_1611352_1611352_0.
- 2018.01.18 22:10:01.566307 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 7).
- 2018.01.18 22:10:01.567305 [ 69 ] <Trace> Aggregator: Merged partially aggregated blocks. 325 rows, 23.996 MiB. in 0.001 sec. (360913.411 rows/sec., 26647.913 MiB/sec.)
- 2018.01.18 22:10:01.572764 [ 69 ] <Debug> SrcViews..inner.TTViewDailyOther (Replicated OutputStream): Wrote block with 325 rows
- 2018.01.18 22:10:01.679314 [ 69 ] <Trace> SrcViews..inner.TTViewDailyOther (Data): Renaming temporary part tmp_insert_20180118_20180118_577706_577706_0 to 20180118_20180118_1611353_1611353_0.
- 2018.01.18 22:10:01.842866 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 8).
- 2018.01.18 22:10:01.843996 [ 69 ] <Trace> Aggregator: Merged partially aggregated blocks. 341 rows, 24.005 MiB. in 0.001 sec. (316946.311 rows/sec., 22311.856 MiB/sec.)
- 2018.01.18 22:10:01.865601 [ 69 ] <Debug> SrcViews..inner.TTViewDailyOther (Replicated OutputStream): Wrote block with 341 rows
- 2018.01.18 22:10:01.972031 [ 69 ] <Trace> SrcViews..inner.TTViewDailyOther (Data): Renaming temporary part tmp_insert_20180118_20180118_577707_577707_0 to 20180118_20180118_1611354_1611354_0.
- 2018.01.18 22:10:02.130743 [ 13 ] <Debug> SrcViews..inner.TTViewAdv (Merger): Merge sorted 34849 rows, containing 69 columns (69 merged, 0 gathered) in 0.15 sec., 233365.97 rows/sec., 288.58 MB/sec.
- 2018.01.18 22:10:02.132983 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 9).
- 2018.01.18 22:10:02.133999 [ 69 ] <Trace> Aggregator: Merged partially aggregated blocks. 364 rows, 24.018 MiB. in 0.001 sec. (386409.428 rows/sec., 25496.905 MiB/sec.)
- 2018.01.18 22:10:02.139685 [ 69 ] <Debug> SrcViews..inner.TTViewDailyOther (Replicated OutputStream): Wrote block with 364 rows
- 2018.01.18 22:10:02.245969 [ 69 ] <Trace> SrcViews..inner.TTViewDailyOther (Data): Renaming temporary part tmp_insert_20180118_20180118_577708_577708_0 to 20180118_20180118_1611355_1611355_0.
- 2018.01.18 22:10:02.406918 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 10).
- ...
- 2018.01.18 22:11:13.234988 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 253).
- 2018.01.18 22:11:13.236247 [ 69 ] <Trace> Aggregator: Merged partially aggregated blocks. 373 rows, 24.023 MiB. in 0.001 sec. (327034.629 rows/sec., 21062.872 MiB/sec.)
- 2018.01.18 22:11:13.242506 [ 69 ] <Debug> SrcViews..inner.TTViewDailyOther (Replicated OutputStream): Wrote block with 373 rows
- 2018.01.18 22:11:13.349194 [ 69 ] <Trace> SrcViews..inner.TTViewDailyOther (Data): Renaming temporary part tmp_insert_20180118_20180118_577952_577952_0 to 20180118_20180118_1611599_1611599_0.
- 2018.01.18 22:11:13.509967 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 254).
- 2018.01.18 22:11:13.511095 [ 69 ] <Trace> Aggregator: Merged partially aggregated blocks. 349 rows, 24.010 MiB. in 0.001 sec. (329748.305 rows/sec., 22685.321 MiB/sec.)
- 2018.01.18 22:11:13.516887 [ 69 ] <Debug> SrcViews..inner.TTViewDailyOther (Replicated OutputStream): Wrote block with 349 rows
- 2018.01.18 22:11:13.625702 [ 69 ] <Trace> SrcViews..inner.TTViewDailyOther (Data): Renaming temporary part tmp_insert_20180118_20180118_577953_577953_0 to 20180118_20180118_1611600_1611600_0.
- 2018.01.18 22:11:13.786448 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 255).
- 2018.01.18 22:11:13.787402 [ 69 ] <Trace> Aggregator: Merged partially aggregated blocks. 327 rows, 23.997 MiB. in 0.001 sec. (361912.225 rows/sec., 26559.328 MiB/sec.)
- 2018.01.18 22:11:13.792839 [ 69 ] <Debug> SrcViews..inner.TTViewDailyOther (Replicated OutputStream): Wrote block with 327 rows
- 2018.01.18 22:11:13.899372 [ 69 ] <Trace> SrcViews..inner.TTViewDailyOther (Data): Renaming temporary part tmp_insert_20180118_20180118_577954_577954_0 to 20180118_20180118_1611601_1611601_0.
- 2018.01.18 22:11:14.059364 [ 69 ] <Trace> MergingAggregatedMemoryEfficientBlockInputStream: Waiting for threads to finish
- 2018.01.18 22:11:14.059401 [ 69 ] <Trace> MergingAggregatedMemoryEfficientBlockInputStream: Waited for threads to finish
- 2018.01.18 22:11:14.705793 [ 3 ] <Debug> SrcViews..inner.TTViewDailyAdv (Merger): Merge sorted 4718 rows, containing 69 columns (69 merged, 0 gathered) in 0.04 sec., 126801.29 rows/sec., 173.18 MB/sec.
- 2018.01.18 22:11:16.124539 [ 14 ] <Debug> SrcViews..inner.TTViewAdv (Merger): Merge sorted 16061 rows, containing 69 columns (69 merged, 0 gathered) in 0.15 sec., 108454.05 rows/sec., 135.93 MB/sec.
- 2018.01.18 22:11:19.448931 [ 17 ] <Debug> SrcViews..inner.TTViewDailyAdv (Merger): Merge sorted 6033 rows, containing 69 columns (69 merged, 0 gathered) in 0.07 sec., 86362.14 rows/sec., 113.49 MB/sec.
- 2018.01.18 22:11:20.500077 [ 16 ] <Debug> SrcViews..inner.TTViewAdv (Merger): Merge sorted 20567 rows, containing 69 columns (69 merged, 0 gathered) in 0.09 sec., 222635.31 rows/sec., 265.04 MB/sec.
- 2018.01.18 22:11:21.512395 [ 69 ] <Debug> SrcData.TTStatBase (Replicated OutputStream): Wrote block with ID '10221897272571230914_11925816610393778059', 387641 rows
- 2018.01.18 22:11:21.618696 [ 69 ] <Trace> SrcData.TTStatBase (Data): Renaming temporary part tmp_insert_201801_63503_63503_0 to 201801_30467_30467_0.
- 2018.01.18 22:11:21.779835 [ 69 ] <Trace> InterpreterSelectQuery: FetchColumns -> Complete
- 2018.01.18 22:11:21.780345 [ 69 ] <Trace> Aggregator: Aggregating
- 2018.01.18 22:11:21.793595 [ 69 ] <Trace> Aggregator: Aggregation method: concat
- 2018.01.18 22:11:21.839390 [ 69 ] <Trace> Aggregator: Aggregated. 387641 to 7222 rows (from 667.237 MiB) in 0.059 sec. (6567374.714 rows/sec., 11304.260 MiB/sec.)
- 2018.01.18 22:11:21.839405 [ 69 ] <Trace> Aggregator: Merging aggregated data
- 2018.01.18 22:11:21.847452 [ 69 ] <Debug> SrcViews..inner.TTUIViewDailySub (Replicated OutputStream): Wrote block with 7222 rows
- 2018.01.18 22:11:21.953560 [ 69 ] <Trace> SrcViews..inner.TTUIViewDailySub (Data): Renaming temporary part tmp_insert_20180118_20180118_8141_8141_0 to 20180118_20180118_7837_7837_0.
- 2018.01.18 22:11:22.113532 [ 69 ] <Trace> virtual DB::MergingAndConvertingBlockInputStream::~MergingAndConvertingBlockInputStream(): Waiting for threads to finish
- 2018.01.18 22:11:22.114488 [ 69 ] <Trace> InterpreterSelectQuery: FetchColumns -> Complete
- 2018.01.18 22:11:22.115703 [ 69 ] <Trace> Aggregator: Aggregating
- 2018.01.18 22:11:22.116179 [ 69 ] <Trace> Aggregator: Aggregation method: concat
- 2018.01.18 22:11:22.323058 [ 69 ] <Trace> Aggregator: Aggregated. 387641 to 37170 rows (from 666.550 MiB) in 0.207 sec. (1870005.597 rows/sec., 3215.483 MiB/sec.)
- 2018.01.18 22:11:22.323218 [ 69 ] <Trace> Aggregator: Merging aggregated data
- 2018.01.18 22:11:22.440242 [ 69 ] <Debug> SrcViews..inner.TTViewAdv (Replicated OutputStream): Wrote block with 37170 rows
- 2018.01.18 22:11:22.551520 [ 69 ] <Trace> SrcViews..inner.TTViewAdv (Data): Renaming temporary part tmp_insert_20180118_20180118_8141_8141_0 to 20180118_20180118_7837_7837_0.
- 2018.01.18 22:11:22.718774 [ 69 ] <Trace> virtual DB::MergingAndConvertingBlockInputStream::~MergingAndConvertingBlockInputStream(): Waiting for threads to finish
- 2018.01.18 22:11:22.719878 [ 69 ] <Trace> InterpreterSelectQuery: FetchColumns -> Complete
- 2018.01.18 22:11:22.721342 [ 69 ] <Trace> Aggregator: Aggregating
- 2018.01.18 22:11:22.722312 [ 69 ] <Trace> Aggregator: Aggregation method: concat
- 2018.01.18 22:11:22.942923 [ 69 ] <Trace> Aggregator: Aggregated. 387641 to 37170 rows (from 666.550 MiB) in 0.222 sec. (1749874.858 rows/sec., 3008.917 MiB/sec.)
- 2018.01.18 22:11:22.943023 [ 69 ] <Trace> Aggregator: Merging aggregated data
- 2018.01.18 22:11:23.053607 [ 69 ] <Debug> SrcViews..inner.TTViewDailyAdv (Replicated OutputStream): Wrote block with 37170 rows
- 2018.01.18 22:11:23.161146 [ 69 ] <Trace> SrcViews..inner.TTViewDailyAdv (Data): Renaming temporary part tmp_insert_20180118_20180118_8141_8141_0 to 20180118_20180118_7837_7837_0.
- 2018.01.18 22:11:23.321712 [ 69 ] <Trace> virtual DB::MergingAndConvertingBlockInputStream::~MergingAndConvertingBlockInputStream(): Waiting for threads to finish
- 2018.01.18 22:11:23.322677 [ 69 ] <Trace> InterpreterSelectQuery: FetchColumns -> Complete
- 2018.01.18 22:11:23.323800 [ 69 ] <Trace> Aggregator: Aggregating
- 2018.01.18 22:11:23.324423 [ 69 ] <Trace> Aggregator: Aggregation method: concat
- 2018.01.18 22:11:23.485765 [ 69 ] <Trace> Aggregator: Aggregated. 387641 to 10766 rows (from 666.550 MiB) in 0.162 sec. (2394017.698 rows/sec., 4116.524 MiB/sec.)
- 2018.01.18 22:11:23.485900 [ 69 ] <Trace> Aggregator: Merging aggregated data
- 2018.01.18 22:11:23.518602 [ 69 ] <Debug> SrcViews..inner.TTViewDailyBidders (Replicated OutputStream): Wrote block with 10766 rows
- 2018.01.18 22:11:23.624742 [ 69 ] <Trace> SrcViews..inner.TTViewDailyBidders (Data): Renaming temporary part tmp_insert_20180118_20180118_8141_8141_0 to 20180118_20180118_7837_7837_0.
- 2018.01.18 22:11:23.788232 [ 69 ] <Trace> virtual DB::MergingAndConvertingBlockInputStream::~MergingAndConvertingBlockInputStream(): Waiting for threads to finish
- 2018.01.18 22:11:23.789286 [ 69 ] <Trace> InterpreterSelectQuery: FetchColumns -> Complete
- 2018.01.18 22:11:23.790540 [ 69 ] <Trace> Aggregator: Aggregating
- 2018.01.18 22:11:23.791248 [ 69 ] <Trace> Aggregator: Aggregation method: concat
- 2018.01.18 22:11:24.047260 [ 69 ] <Trace> Aggregator: Converting aggregation data to two-level.
- 2018.01.18 22:11:24.066780 [ 69 ] <Debug> Aggregator: Writing part of aggregation data into temporary file /home/clickhouse/tmp/tmp2136zhdaaa.
- 2018.01.18 22:11:24.225397 [ 69 ] <Trace> Aggregator: Max size of temporary block: 393 rows, 6144.222 MiB.
- 2018.01.18 22:11:24.226488 [ 69 ] <Trace> Aggregator: Written part in 0.175 sec., 86365 rows, 39.763 MiB uncompressed, 4.197 MiB compressed, 482.770 uncompressed bytes per row, 50.957 compressed bytes per row, compression rate: 9.474 (493846.198 rows/sec., 227.370 MiB/sec. uncompressed, 23.999 MiB/sec. compressed)
- 2018.01.18 22:11:24.226554 [ 69 ] <Trace> Aggregator: Aggregated. 387641 to 0 rows (from 666.550 MiB) in 0.436 sec. (889076.508 rows/sec., 1528.771 MiB/sec.)
- 2018.01.18 22:11:24.226688 [ 69 ] <Trace> AggregatingBlockInputStream: Will merge 1 temporary files of size 4.19703 MiB compressed, 39.7629 MiB uncompressed.
- 2018.01.18 22:11:24.228183 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 0).
- 2018.01.18 22:11:24.228870 [ 69 ] <Trace> Aggregator: Merged partially aggregated blocks. 297 rows, 11.980 MiB. in 0.001 sec. (440240.665 rows/sec., 17758.459 MiB/sec.)
- 2018.01.18 22:11:24.233522 [ 69 ] <Debug> SrcViews..inner.TTViewDailyOther (Replicated OutputStream): Wrote block with 297 rows
- 2018.01.18 22:11:24.339680 [ 69 ] <Trace> SrcViews..inner.TTViewDailyOther (Data): Renaming temporary part tmp_insert_20180118_20180118_577955_577955_0 to 20180118_20180118_1611602_1611602_0.
- 2018.01.18 22:11:24.500153 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 1).
- 2018.01.18 22:11:24.500786 [ 69 ] <Trace> Aggregator: Merged partially aggregated blocks. 300 rows, 23.982 MiB. in 0.001 sec. (484625.264 rows/sec., 38741.109 MiB/sec.)
- 2018.01.18 22:11:24.505255 [ 69 ] <Debug> SrcViews..inner.TTViewDailyOther (Replicated OutputStream): Wrote block with 300 rows
- 2018.01.18 22:11:24.611223 [ 69 ] <Trace> SrcViews..inner.TTViewDailyOther (Data): Renaming temporary part tmp_insert_20180118_20180118_577956_577956_0 to 20180118_20180118_1611603_1611603_0.
- 2018.01.18 22:11:24.771621 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 2).
- 2018.01.18 22:11:24.772275 [ 69 ] <Trace> Aggregator: Merged partially aggregated blocks. 291 rows, 11.977 MiB. in 0.001 sec. (456846.098 rows/sec., 18802.984 MiB/sec.)
- 2018.01.18 22:11:24.776258 [ 69 ] <Debug> SrcViews..inner.TTViewDailyOther (Replicated OutputStream): Wrote block with 291 rows
- 2018.01.18 22:11:24.882650 [ 69 ] <Trace> SrcViews..inner.TTViewDailyOther (Data): Renaming temporary part tmp_insert_20180118_20180118_577957_577957_0 to 20180118_20180118_1611604_1611604_0.
- 2018.01.18 22:11:25.044464 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 3).
- 2018.01.18 22:11:25.045390 [ 69 ] <Trace> Aggregator: Merged partially aggregated blocks. 322 rows, 23.995 MiB. in 0.001 sec. (392805.559 rows/sec., 29270.776 MiB/sec.)
- 2018.01.18 22:11:25.050274 [ 69 ] <Debug> SrcViews..inner.TTViewDailyOther (Replicated OutputStream): Wrote block with 322 rows
- 2018.01.18 22:11:25.156494 [ 16 ] <Debug> SrcViews..inner.TTViewDailyAdv (Merger): Merge sorted 6004 rows, containing 69 columns (69 merged, 0 gathered) in 0.04 sec., 147523.91 rows/sec., 184.88 MB/sec.
- 2018.01.18 22:11:25.156801 [ 69 ] <Trace> SrcViews..inner.TTViewDailyOther (Data): Renaming temporary part tmp_insert_20180118_20180118_577958_577958_0 to 20180118_20180118_1611605_1611605_0.
- 2018.01.18 22:11:25.318175 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 4).
- 2018.01.18 22:11:25.319125 [ 69 ] <Trace> Aggregator: Merged partially aggregated blocks. 326 rows, 23.997 MiB. in 0.001 sec. (383708.626 rows/sec., 28244.573 MiB/sec.)
- 2018.01.18 22:11:25.324127 [ 69 ] <Debug> SrcViews..inner.TTViewDailyOther (Replicated OutputStream): Wrote block with 326 rows
- 2018.01.18 22:11:25.399004 [ 7 ] <Debug> SrcViews..inner.TTViewAdv (Merger): Merge sorted 23715 rows, containing 69 columns (69 merged, 0 gathered) in 0.10 sec., 231448.47 rows/sec., 278.46 MB/sec.
- 2018.01.18 22:11:25.430760 [ 69 ] <Trace> SrcViews..inner.TTViewDailyOther (Data): Renaming temporary part tmp_insert_20180118_20180118_577959_577959_0 to 20180118_20180118_1611606_1611606_0.
- 2018.01.18 22:11:25.481147 [ 12 ] <Debug> SrcViews..inner.TTViewAdv (Merger): Merge sorted 213000 rows, containing 69 columns (69 merged, 0 gathered) in 1.09 sec., 195555.30 rows/sec., 247.20 MB/sec.
- 2018.01.18 22:11:25.591793 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 5).
- ...
- 2018.01.18 22:49:18.712872 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 250).
- 2018.01.18 22:49:18.713795 [ 69 ] <Trace> Aggregator: Merged partially aggregated blocks. 359 rows, 24.016 MiB. in 0.001 sec. (399918.457 rows/sec., 26752.999 MiB/sec.)
- 2018.01.18 22:49:18.719035 [ 69 ] <Debug> SrcViews..inner.TTViewDailyOther (Replicated OutputStream): Wrote block with 359 rows
- 2018.01.18 22:49:18.825356 [ 69 ] <Trace> SrcViews..inner.TTViewDailyOther (Data): Renaming temporary part tmp_insert_20180118_20180118_584605_584605_0 to 20180118_20180118_1618252_1618252_0.
- 2018.01.18 22:49:18.986424 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 251).
- 2018.01.18 22:49:18.987434 [ 69 ] <Trace> Aggregator: Merged partially aggregated blocks. 363 rows, 24.018 MiB. in 0.001 sec. (379238.618 rows/sec., 25092.453 MiB/sec.)
- 2018.01.18 22:49:18.992725 [ 69 ] <Debug> SrcViews..inner.TTViewDailyOther (Replicated OutputStream): Wrote block with 363 rows
- 2018.01.18 22:49:19.104604 [ 69 ] <Trace> SrcViews..inner.TTViewDailyOther (Data): Renaming temporary part tmp_insert_20180118_20180118_584606_584606_0 to 20180118_20180118_1618253_1618253_0.
- 2018.01.18 22:49:19.265441 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 252).
- 2018.01.18 22:49:19.266490 [ 69 ] <Trace> Aggregator: Merged partially aggregated blocks. 361 rows, 24.017 MiB. in 0.001 sec. (368039.867 rows/sec., 24485.336 MiB/sec.)
- 2018.01.18 22:49:19.272673 [ 69 ] <Debug> SrcViews..inner.TTViewDailyOther (Replicated OutputStream): Wrote block with 361 rows
- 2018.01.18 22:49:19.378906 [ 69 ] <Trace> SrcViews..inner.TTViewDailyOther (Data): Renaming temporary part tmp_insert_20180118_20180118_584607_584607_0 to 20180118_20180118_1618254_1618254_0.
- 2018.01.18 22:49:19.539667 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 253).
- 2018.01.18 22:49:19.540641 [ 69 ] <Trace> Aggregator: Merged partially aggregated blocks. 348 rows, 24.009 MiB. in 0.001 sec. (373836.193 rows/sec., 25791.898 MiB/sec.)
- 2018.01.18 22:49:19.546636 [ 69 ] <Debug> SrcViews..inner.TTViewDailyOther (Replicated OutputStream): Wrote block with 348 rows
- 2018.01.18 22:49:19.652966 [ 69 ] <Trace> SrcViews..inner.TTViewDailyOther (Data): Renaming temporary part tmp_insert_20180118_20180118_584608_584608_0 to 20180118_20180118_1618255_1618255_0.
- 2018.01.18 22:49:19.813695 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 254).
- 2018.01.18 22:49:19.814713 [ 69 ] <Trace> Aggregator: Merged partially aggregated blocks. 376 rows, 24.025 MiB. in 0.001 sec. (387606.089 rows/sec., 24766.960 MiB/sec.)
- 2018.01.18 22:49:19.821089 [ 69 ] <Debug> SrcViews..inner.TTViewDailyOther (Replicated OutputStream): Wrote block with 376 rows
- 2018.01.18 22:49:19.927417 [ 69 ] <Trace> SrcViews..inner.TTViewDailyOther (Data): Renaming temporary part tmp_insert_20180118_20180118_584609_584609_0 to 20180118_20180118_1618256_1618256_0.
- 2018.01.18 22:49:20.088219 [ 69 ] <Trace> Aggregator: Merging partially aggregated blocks (bucket = 255).
- 2018.01.18 22:49:20.089314 [ 69 ] <Trace> Aggregator: Merged partially aggregated blocks. 353 rows, 24.012 MiB. in 0.001 sec. (340092.470 rows/sec., 23134.235 MiB/sec.)
- 2018.01.18 22:49:20.124690 [ 69 ] <Debug> SrcViews..inner.TTViewDailyOther (Replicated OutputStream): Wrote block with 353 rows
- 2018.01.18 22:49:20.231079 [ 69 ] <Trace> SrcViews..inner.TTViewDailyOther (Data): Renaming temporary part tmp_insert_20180118_20180118_584610_584610_0 to 20180118_20180118_1618257_1618257_0.
- 2018.01.18 22:49:20.314970 [ 6 ] <Debug> SrcViews..inner.TTViewDailyAdv (Merger): Merge sorted 1311 rows, containing 69 columns (69 merged, 0 gathered) in 0.02 sec., 60982.11 rows/sec., 78.42 MB/sec.
- 2018.01.18 22:49:20.391036 [ 69 ] <Trace> MergingAggregatedMemoryEfficientBlockInputStream: Waiting for threads to finish
- 2018.01.18 22:49:20.391094 [ 69 ] <Trace> MergingAggregatedMemoryEfficientBlockInputStream: Waited for threads to finish
- 2018.01.18 22:49:22.646901 [ 69 ] <Debug> MemoryTracker: Peak memory usage (for query): 12.20 GiB.
- 2018.01.18 22:49:22.646946 [ 69 ] <Debug> MemoryTracker: Peak memory usage (for user): 12.63 GiB.
- 2018.01.18 22:49:22.646949 [ 69 ] <Debug> MemoryTracker: Peak memory usage (total): 12.63 GiB.
- 2018.01.18 22:49:22.647036 [ 69 ] <Information> TCPHandler: Processed in 2376.655 sec.
- 2018.01.18 22:49:22.748518 [ 69 ] <Information> TCPHandler: Done processing connection.
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement