tha-dude

duid_index_task_log

Apr 8th, 2016
59
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 111.95 KB | None | 0 0
  1. 2016-04-08T14:25:49,509 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
  2. 2016-04-08T14:25:49,517 INFO [main] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
  3. Apr 08, 2016 2:25:49 PM org.hibernate.validator.internal.util.Version <clinit>
  4. INFO: HV000001: Hibernate Validator 5.1.3.Final
  5. 2016-04-08T14:25:50,423 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, coordinates=[io.druid.extensions:druid-datasketches, io.druid.extensions:druid-examples, io.druid.extensions:druid-kafka-eight], defaultVersion='0.8.3', localRepository='extensions-repo', remoteRepositories=[https://repo1.maven.org/maven2/, https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local]}]
  6. 2016-04-08T14:25:50,640 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-datasketches] for class[io.druid.cli.CliCommandCreator]
  7. 2016-04-08T14:25:50,800 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/io/druid/extensions/druid-datasketches/0.8.3/druid-datasketches-0.8.3.jar]
  8. 2016-04-08T14:25:50,800 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/com/yahoo/datasketches/sketches-core/0.2.2/sketches-core-0.2.2.jar]
  9. 2016-04-08T14:25:50,801 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-examples] for class[io.druid.cli.CliCommandCreator]
  10. 2016-04-08T14:25:52,003 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/io/druid/extensions/druid-examples/0.8.3/druid-examples-0.8.3.jar]
  11. 2016-04-08T14:25:52,003 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/org/twitter4j/twitter4j-core/3.0.3/twitter4j-core-3.0.3.jar]
  12. 2016-04-08T14:25:52,003 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/org/twitter4j/twitter4j-async/3.0.3/twitter4j-async-3.0.3.jar]
  13. 2016-04-08T14:25:52,003 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/org/twitter4j/twitter4j-stream/3.0.3/twitter4j-stream-3.0.3.jar]
  14. 2016-04-08T14:25:52,003 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/commons-validator/commons-validator/1.4.0/commons-validator-1.4.0.jar]
  15. 2016-04-08T14:25:52,003 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/commons-beanutils/commons-beanutils/1.8.3/commons-beanutils-1.8.3.jar]
  16. 2016-04-08T14:25:52,004 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/commons-digester/commons-digester/1.8/commons-digester-1.8.jar]
  17. 2016-04-08T14:25:52,004 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar]
  18. 2016-04-08T14:25:52,007 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-kafka-eight] for class[io.druid.cli.CliCommandCreator]
  19. 2016-04-08T14:25:52,117 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/io/druid/extensions/druid-kafka-eight/0.8.3/druid-kafka-eight-0.8.3.jar]
  20. 2016-04-08T14:25:52,118 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/org/apache/kafka/kafka_2.10/0.8.2.1/kafka_2.10-0.8.2.1.jar]
  21. 2016-04-08T14:25:52,118 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/com/yammer/metrics/metrics-core/2.2.0/metrics-core-2.2.0.jar]
  22. 2016-04-08T14:25:52,118 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar]
  23. 2016-04-08T14:25:52,118 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/org/apache/kafka/kafka-clients/0.8.2.1/kafka-clients-0.8.2.1.jar]
  24. 2016-04-08T14:25:52,118 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/net/jpountz/lz4/lz4/1.3.0/lz4-1.3.0.jar]
  25. 2016-04-08T14:25:52,118 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/org/xerial/snappy/snappy-java/1.1.1.6/snappy-java-1.1.1.6.jar]
  26. 2016-04-08T14:25:52,118 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar]
  27. 2016-04-08T14:25:52,118 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar]
  28. 2016-04-08T14:25:52,118 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/log4j/log4j/1.2.16/log4j-1.2.16.jar]
  29. 2016-04-08T14:25:52,119 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/jline/jline/0.9.94/jline-0.9.94.jar]
  30. 2016-04-08T14:25:52,119 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/io/netty/netty/3.7.0.Final/netty-3.7.0.Final.jar]
  31. 2016-04-08T14:25:52,119 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/net/sf/jopt-simple/jopt-simple/3.2/jopt-simple-3.2.jar]
  32. 2016-04-08T14:25:52,119 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/com/101tec/zkclient/0.3/zkclient-0.3.jar]
  33. 2016-04-08T14:25:52,418 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-datasketches] for class[io.druid.initialization.DruidModule]
  34. 2016-04-08T14:25:52,424 INFO [main] io.druid.initialization.Initialization - Adding remote extension module[io.druid.query.aggregation.datasketches.theta.SketchModule] for class[io.druid.initialization.DruidModule]
  35. 2016-04-08T14:25:52,425 INFO [main] io.druid.initialization.Initialization - Adding remote extension module[io.druid.query.aggregation.datasketches.theta.oldapi.OldApiSketchModule] for class[io.druid.initialization.DruidModule]
  36. 2016-04-08T14:25:52,425 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-examples] for class[io.druid.initialization.DruidModule]
  37. 2016-04-08T14:25:52,428 INFO [main] io.druid.initialization.Initialization - Adding remote extension module[io.druid.examples.ExamplesDruidModule] for class[io.druid.initialization.DruidModule]
  38. 2016-04-08T14:25:52,428 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-kafka-eight] for class[io.druid.initialization.DruidModule]
  39. 2016-04-08T14:25:52,431 INFO [main] io.druid.initialization.Initialization - Adding remote extension module[io.druid.firehose.kafka.KafkaEightDruidModule] for class[io.druid.initialization.DruidModule]
  40. 2016-04-08T14:25:53,448 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@797084b1]
  41. 2016-04-08T14:25:53,463 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[]}]
  42. 2016-04-08T14:25:53,488 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.DruidNode] from props[druid.] as [DruidNode{serviceName='overlord', host='__HOSTNAME_REPLACED__', port=8100}]
  43. 2016-04-08T14:25:53,528 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ServerConfig] from props[druid.server.http.] as [ServerConfig{numThreads=40, maxIdleTime=PT5M}]
  44. 2016-04-08T14:25:53,562 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.config.TaskConfig] from props[druid.indexer.task.] as [io.druid.indexing.common.config.TaskConfig@47ccf71d]
  45. 2016-04-08T14:25:53,571 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.http.DruidHttpClientConfig] from props[druid.global.http.] as [io.druid.guice.http.DruidHttpClientConfig@30b5d38b]
  46. 2016-04-08T14:25:53,719 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.indexing.IndexingServiceSelectorConfig] from props[druid.selectors.indexing.] as [io.druid.client.indexing.IndexingServiceSelectorConfig@a2c31a1]
  47. 2016-04-08T14:25:53,725 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.curator.CuratorConfig] from props[druid.zk.service.] as [io.druid.curator.CuratorConfig@662d167e]
  48. 2016-04-08T14:25:53,732 WARN [main] org.apache.curator.retry.ExponentialBackoffRetry - maxRetries too large (30). Pinning to 29
  49. 2016-04-08T14:25:53,769 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.CuratorDiscoveryConfig] from props[druid.discovery.curator.] as [io.druid.server.initialization.CuratorDiscoveryConfig@281a9bc8]
  50. 2016-04-08T14:25:53,961 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.RetryPolicyConfig] from props[druid.peon.taskActionClient.retry.] as [io.druid.indexing.common.RetryPolicyConfig@80b4d4d]
  51. 2016-04-08T14:25:53,966 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.loading.LocalDataSegmentPusherConfig] from props[druid.storage.] as [io.druid.segment.loading.LocalDataSegmentPusherConfig@4802c1ef]
  52. 2016-04-08T14:25:53,966 INFO [main] io.druid.segment.loading.LocalDataSegmentPusher - Configured local filesystem as deep storage
  53. 2016-04-08T14:25:53,990 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.DruidServerConfig] from props[druid.server.] as [io.druid.client.DruidServerConfig@28229f01]
  54. 2016-04-08T14:25:53,995 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.BatchDataSegmentAnnouncerConfig] from props[druid.announcer.] as [io.druid.server.initialization.BatchDataSegmentAnnouncerConfig@197287ed]
  55. 2016-04-08T14:25:54,011 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ZkPathsConfig] from props[druid.zk.paths.] as [io.druid.server.initialization.ZkPathsConfig@58d3f4be]
  56. 2016-04-08T14:25:54,017 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.coordination.DataSegmentAnnouncerProvider] from props[druid.announcer.] as [io.druid.server.coordination.BatchDataSegmentAnnouncerProvider@45087c17]
  57. 2016-04-08T14:25:54,020 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.coordinator.CoordinatorSelectorConfig] from props[druid.selectors.coordinator.] as [io.druid.client.coordinator.CoordinatorSelectorConfig@77a91579]
  58. 2016-04-08T14:25:54,025 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig] from props[druid.segment.handoff.] as [io.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig@3fabb75b]
  59. 2016-04-08T14:25:54,029 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [100000000] for [druid.computation.buffer.size] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()]
  60. 2016-04-08T14:25:54,031 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [1] for [druid.processing.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreads()]
  61. 2016-04-08T14:25:54,032 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]
  62. 2016-04-08T14:25:54,034 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [com.metamx.common.concurrent.ExecutorServiceConfig#getFormatString()]
  63. 2016-04-08T14:25:54,133 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.search.search.SearchQueryConfig] from props[druid.query.search.] as [io.druid.query.search.search.SearchQueryConfig@6d637c5c]
  64. 2016-04-08T14:25:54,138 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.metadata.SegmentMetadataQueryConfig] from props[druid.query.segmentMetadata.] as [io.druid.query.metadata.SegmentMetadataQueryConfig@515c2a53]
  65. 2016-04-08T14:25:54,143 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.groupby.GroupByQueryConfig] from props[druid.query.groupBy.] as [io.druid.query.groupby.GroupByQueryConfig@54ce26c3]
  66. 2016-04-08T14:25:54,149 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.topn.TopNQueryConfig] from props[druid.query.topN.] as [io.druid.query.topn.TopNQueryConfig@8741946]
  67. 2016-04-08T14:25:54,155 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.client.cache.CacheProvider] from props[druid.cache.] as [io.druid.client.cache.LocalCacheProvider@280633af]
  68. 2016-04-08T14:25:54,163 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.cache.CacheConfig] from props[druid.realtime.cache.] as [io.druid.client.cache.CacheConfig@32a52751]
  69. 2016-04-08T14:25:54,168 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.log.RequestLoggerProvider] from props[druid.request.logging.] as [io.druid.server.log.NoopRequestLoggerProvider@65c2547b]
  70. 2016-04-08T14:25:54,180 INFO [main] org.eclipse.jetty.util.log - Logging initialized @5749ms
  71. 2016-04-08T14:25:54,277 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.start()] on object[io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@21b81941].
  72. 2016-04-08T14:25:54,277 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.service.ServiceEmitter.start()] on object[com.metamx.emitter.service.ServiceEmitter@3d820bb2].
  73. 2016-04-08T14:25:54,278 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.metrics.MonitorScheduler.start()] on object[com.metamx.metrics.MonitorScheduler@24cdf2aa].
  74. 2016-04-08T14:25:54,280 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.http.client.NettyHttpClient.start()] on object[com.metamx.http.client.NettyHttpClient@502c500d].
  75. 2016-04-08T14:25:54,280 INFO [main] io.druid.curator.CuratorModule - Starting Curator
  76. 2016-04-08T14:25:54,280 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Starting
  77. 2016-04-08T14:25:54,290 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
  78. 2016-04-08T14:25:54,290 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:host.name=__HOSTNAME_REPLACED__
  79. 2016-04-08T14:25:54,290 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.7.0_80
  80. 2016-04-08T14:25:54,290 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation
  81. 2016-04-08T14:25:54,290 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jvm/java-7-oracle/jre
  82. 2016-04-08T14:25:54,290 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=config/_common:config/overlord:lib/commons-cli-1.2.jar:lib/aether-connector-file-0.9.0.M2.jar:lib/log4j-1.2-api-2.4.1.jar:lib/plexus-utils-3.0.15.jar:lib/jetty-client-9.2.5.v20141112.jar:lib/druid-indexing-service-0.8.3.jar:lib/druid-server-0.8.3.jar:lib/derby-10.11.1.1.jar:lib/RoaringBitmap-0.5.16.jar:lib/java-xmlbuilder-1.1.jar:lib/aws-java-sdk-sns-1.10.21.jar:lib/aws-java-sdk-codecommit-1.10.21.jar:lib/commons-lang-2.6.jar:lib/jetty-servlets-9.2.5.v20141112.jar:lib/aws-java-sdk-directconnect-1.10.21.jar:lib/javax.servlet-api-3.1.0.jar:lib/jackson-jaxrs-json-provider-2.4.6.jar:lib/compress-lzf-1.0.3.jar:lib/java-util-0.27.4.jar:lib/plexus-interpolation-1.19.jar:lib/wagon-provider-api-2.4.jar:lib/log4j-slf4j-impl-2.4.1.jar:lib/jackson-module-jaxb-annotations-2.4.6.jar:lib/joda-time-2.8.2.jar:lib/derbynet-10.11.1.1.jar:lib/aws-java-sdk-logs-1.10.21.jar:lib/netty-3.10.4.Final.jar:lib/javax.el-api-3.0.0.jar:lib/rhino-1.7R5.jar:lib/log4j-core-2.4.1.jar:lib/commons-io-2.0.1.jar:lib/aopalliance-1.0.jar:lib/druid-common-0.8.3.jar:lib/aws-java-sdk-iam-1.10.21.jar:lib/aws-java-sdk-machinelearning-1.10.21.jar:lib/jsr311-api-1.1.1.jar:lib/druid-api-0.3.13.jar:lib/irc-api-1.0-0014.jar:lib/jackson-core-2.4.6.jar:lib/activation-1.1.1.jar:lib/log4j-jul-2.4.1.jar:lib/aws-java-sdk-storagegateway-1.10.21.jar:lib/aws-java-sdk-1.10.21.jar:lib/jetty-http-9.2.5.v20141112.jar:lib/opencsv-2.3.jar:lib/antlr4-runtime-4.0.jar:lib/base64-2.3.8.jar:lib/jetty-proxy-9.2.5.v20141112.jar:lib/aws-java-sdk-devicefarm-1.10.21.jar:lib/aether-util-0.9.0.M2.jar:lib/aws-java-sdk-cloudfront-1.10.21.jar:lib/aws-java-sdk-route53-1.10.21.jar:lib/icu4j-4.8.1.jar:lib/validation-api-1.1.0.Final.jar:lib/google-http-client-jackson2-1.15.0-rc.jar:lib/airline-0.7.jar:lib/aws-java-sdk-simpledb-1.10.21.jar:lib/annotations-2.0.3.jar:lib/zookeeper-3.4.6.jar:lib/javax.el-3.0.0.jar:lib/log4j-api-2.4.1.jar:lib/jetty-continuation-9.2.5.v20141112.jar:lib/aws-java-sdk-cloudformation-1.10.21.jar:lib/classmate-1.0.0.jar:lib/aws-java-sdk-config-1.10.21.jar:lib/aws-java-sdk-swf-libraries-1.10.21.jar:lib/bcprov-jdk15on-1.52.jar:lib/aws-java-sdk-ssm-1.10.21.jar:lib/aether-impl-0.9.0.M2.jar:lib/geoip2-0.4.0.jar:lib/spymemcached-2.11.7.jar:lib/org.abego.treelayout.core-1.0.1.jar:lib/slf4j-api-1.6.4.jar:lib/aws-java-sdk-ec2-1.10.21.jar:lib/jline-0.9.94.jar:lib/jackson-datatype-joda-2.4.6.jar:lib/aws-java-sdk-cloudwatchmetrics-1.10.21.jar:lib/druid-indexing-hadoop-0.8.3.jar:lib/curator-framework-2.9.1.jar:lib/druid-console-0.0.2.jar:lib/jets3t-0.9.4.jar:lib/curator-x-discovery-2.9.1.jar:lib/emitter-0.3.6.jar:lib/hibernate-validator-5.1.3.Final.jar:lib/aws-java-sdk-cognitosync-1.10.21.jar:lib/aws-java-sdk-emr-1.10.21.jar:lib/xpp3-1.1.4c.jar:lib/aws-java-sdk-cloudhsm-1.10.21.jar:lib/aws-java-sdk-cloudtrail-1.10.21.jar:lib/bytebuffer-collections-0.2.4.jar:lib/jackson-dataformat-smile-2.4.6.jar:lib/aws-java-sdk-ses-1.10.21.jar:lib/jetty-io-9.2.5.v20141112.jar:lib/aws-java-sdk-elastictranscoder-1.10.21.jar:lib/aws-java-sdk-efs-1.10.21.jar:lib/jetty-security-9.2.5.v20141112.jar:lib/commons-codec-1.7.jar:lib/jetty-server-9.2.5.v20141112.jar:lib/guava-16.0.1.jar:lib/javax.inject-1.jar:lib/server-metrics-0.2.8.jar:lib/jackson-annotations-2.4.6.jar:lib/jersey-guice-1.19.jar:lib/aws-java-sdk-support-1.10.21.jar:lib/jersey-core-1.19.jar:lib/jersey-server-1.19.jar:lib/jackson-mapper-asl-1.9.13.jar:lib/aws-java-sdk-sts-1.10.21.jar:lib/lz4-1.3.0.jar:lib/derbyclient-10.11.1.1.jar:lib/aws-java-sdk-redshift-1.10.21.jar:lib/aws-java-sdk-lambda-1.10.21.jar:lib/maven-repository-metadata-3.1.1.jar:lib/aws-java-sdk-dynamodb-1.10.21.jar:lib/aether-connector-okhttp-0.0.9.jar:lib/guice-multibindings-4.0-beta.jar:lib/mapdb-1.0.8.jar:lib/aws-java-sdk-kinesis-1.10.21.jar:lib/httpcore-4.4.3.jar:lib/jackson-jaxrs-smile-provider-2.4.6.jar:lib/aws-java-sdk-importexport-1.10.21.jar:lib/extendedset-1.3.9.jar:lib/guice-4.0-beta.jar:lib/commons-pool2-2.2.jar:lib/protobuf-java-2.5.0.jar:lib/aws-java-sdk-core-1.10.21.jar:lib/maven-aether-provider-3.1.1.jar:lib/google-http-client-1.15.0-rc.jar:lib/aws-java-sdk-codedeploy-1.10.21.jar:lib/aws-java-sdk-cognitoidentity-1.10.21.jar:lib/commons-dbcp2-2.0.1.jar:lib/aether-spi-0.9.0.M2.jar:lib/okhttp-1.0.2.jar:lib/aws-java-sdk-ecs-1.10.21.jar:lib/aws-java-sdk-directory-1.10.21.jar:lib/guice-servlet-4.0-beta.jar:lib/config-magic-0.9.jar:lib/aws-java-sdk-rds-1.10.21.jar:lib/aws-java-sdk-elasticache-1.10.21.jar:lib/tesla-aether-0.0.5.jar:lib/jcl-over-slf4j-1.7.12.jar:lib/aws-java-sdk-datapipeline-1.10.21.jar:lib/aws-java-sdk-workspaces-1.10.21.jar:lib/commons-pool-1.6.jar:lib/aws-java-sdk-cloudsearch-1.10.21.jar:lib/druid-aws-common-0.8.3.jar:lib/maven-model-3.1.1.jar:lib/druid-services-0.8.3.jar:lib/jackson-jaxrs-base-2.4.6.jar:lib/jsr305-2.0.1.jar:lib/maven-settings-builder-3.1.1.jar:lib/druid-processing-0.8.3.jar:lib/aether-api-0.9.0.M2.jar:lib/maven-model-builder-3.1.1.jar:lib/disruptor-3.3.0.jar:lib/aws-java-sdk-s3-1.10.21.jar:lib/jackson-datatype-guava-2.4.6.jar:lib/aws-java-sdk-codepipeline-1.10.21.jar:lib/aws-java-sdk-elasticbeanstalk-1.10.21.jar:lib/jetty-servlet-9.2.5.v20141112.jar:lib/aws-java-sdk-kms-1.10.21.jar:lib/jdbi-2.63.1.jar:lib/aws-java-sdk-simpleworkflow-1.10.21.jar:lib/commons-logging-1.1.1.jar:lib/jackson-databind-2.4.6.jar:lib/maven-settings-3.1.1.jar:lib/aws-java-sdk-cloudwatch-1.10.21.jar:lib/aws-java-sdk-sqs-1.10.21.jar:lib/aws-java-sdk-glacier-1.10.21.jar:lib/aws-java-sdk-autoscaling-1.10.21.jar:lib/aws-java-sdk-opsworks-1.10.21.jar:lib/curator-client-2.9.1.jar:lib/aws-java-sdk-elasticloadbalancing-1.10.21.jar:lib/httpclient-4.5.1.jar:lib/jboss-logging-3.1.3.GA.jar:lib/jackson-core-asl-1.9.13.jar:lib/curator-recipes-2.9.1.jar:lib/jetty-util-9.2.5.v20141112.jar:lib/jersey-servlet-1.19.jar:lib/http-client-1.0.4.jar:lib/maxminddb-0.2.0.jar
  83. 2016-04-08T14:25:54,290 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
  84. 2016-04-08T14:25:54,290 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/data/tmp
  85. 2016-04-08T14:25:54,290 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
  86. 2016-04-08T14:25:54,290 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux
  87. 2016-04-08T14:25:54,290 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
  88. 2016-04-08T14:25:54,290 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.version=3.16.0-0.bpo.4-amd64
  89. 2016-04-08T14:25:54,290 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.name=root
  90. 2016-04-08T14:25:54,290 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.home=/root
  91. 2016-04-08T14:25:54,290 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/opt/druid-0.8.3
  92. 2016-04-08T14:25:54,291 INFO [main] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=30000 watcher=org.apache.curator.ConnectionState@5c4bae93
  93. 2016-04-08T14:25:54,309 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@6c8ab1c4].
  94. 2016-04-08T14:25:54,314 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
  95. 2016-04-08T14:25:54,329 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
  96. 2016-04-08T14:25:54,361 WARN [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxnSocket - Connected to an old server; r-o mode will be unavailable
  97. 2016-04-08T14:25:54,362 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x153f1d0314e000b, negotiated timeout = 30000
  98. 2016-04-08T14:25:54,366 INFO [main-EventThread] org.apache.curator.framework.state.ConnectionStateManager - State change: CONNECTED
  99. 2016-04-08T14:25:54,478 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.announcement.Announcer.start()] on object[io.druid.curator.announcement.Announcer@456d8f9f].
  100. 2016-04-08T14:25:54,478 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@1bf03355].
  101. 2016-04-08T14:25:54,488 INFO [main] org.eclipse.jetty.server.Server - jetty-9.2.5.v20141112
  102. Apr 08, 2016 2:25:54 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
  103. INFO: Registering com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider as a provider class
  104. Apr 08, 2016 2:25:54 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
  105. INFO: Registering io.druid.server.StatusResource as a root resource class
  106. Apr 08, 2016 2:25:54 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
  107. INFO: Initiating Jersey application, version 'Jersey: 1.19 02/11/2015 03:25 AM'
  108. Apr 08, 2016 2:25:54 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
  109. INFO: Binding com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider to GuiceManagedComponentProvider with the scope "Singleton"
  110. Apr 08, 2016 2:25:55 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
  111. INFO: Binding io.druid.server.QueryResource to GuiceInstantiatedComponentProvider
  112. Apr 08, 2016 2:25:55 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
  113. INFO: Binding io.druid.segment.realtime.firehose.ChatHandlerResource to GuiceInstantiatedComponentProvider
  114. Apr 08, 2016 2:25:55 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
  115. INFO: Binding io.druid.server.StatusResource to GuiceManagedComponentProvider with the scope "Undefined"
  116. 2016-04-08T14:25:55,264 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.s.ServletContextHandler@2e19678c{/,null,AVAILABLE}
  117. 2016-04-08T14:25:55,275 INFO [main] org.eclipse.jetty.server.ServerConnector - Started ServerConnector@6b7fb4f{HTTP/1.1}{0.0.0.0:8100}
  118. 2016-04-08T14:25:55,276 INFO [main] org.eclipse.jetty.server.Server - Started @6850ms
  119. 2016-04-08T14:25:55,277 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.start()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@7e9bc1e8].
  120. 2016-04-08T14:25:55,277 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Announcing self[DruidServerMetadata{name='__HOSTNAME_REPLACED__:8100', host='__HOSTNAME_REPLACED__:8100', maxSize=0, tier='_default_tier', type='indexer-executor', priority='0'}] at [/druid/announcements/__HOSTNAME_REPLACED__:8100]
  121. 2016-04-08T14:25:55,326 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.start() throws java.lang.InterruptedException] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@6bb871b0].
  122. 2016-04-08T14:25:55,519 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
  123. 2016-04-08T14:25:55,520 INFO [main] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
  124. 2016-04-08T14:25:55,530 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [100000000] for [druid.computation.buffer.size] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()]
  125. 2016-04-08T14:25:55,530 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [1] for [druid.processing.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreads()]
  126. 2016-04-08T14:25:55,530 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]
  127. 2016-04-08T14:25:55,531 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [com.metamx.common.concurrent.ExecutorServiceConfig#getFormatString()]
  128. 2016-04-08T14:25:55,538 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.segment.data.BitmapSerdeFactory] from props[druid.processing.bitmap.] as [ConciseBitmapSerdeFactory{}]
  129. 2016-04-08T14:25:55,577 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Running with task: {
  130. "type" : "index",
  131. "id" : "index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z",
  132. "resource" : {
  133. "availabilityGroup" : "index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z",
  134. "requiredCapacity" : 1
  135. },
  136. "spec" : {
  137. "dataSchema" : {
  138. "dataSource" : "__REPLACED___clean_hits",
  139. "parser" : {
  140. "type" : "string",
  141. "parseSpec" : {
  142. "format" : "json",
  143. "timestampSpec" : {
  144. "column" : "tmst",
  145. "format" : "auto"
  146. },
  147. "dimensionsSpec" : {
  148. "dimensions" : [ "bid", "wid", "crm_provider", "crm_id", "cookie_ok", "c_id", "ad_id", "segs", "type" ],
  149. "dimensionExclusions" : [ ],
  150. "spatialDimensions" : [ ]
  151. }
  152. }
  153. },
  154. "metricsSpec" : [ {
  155. "type" : "count",
  156. "name" : "count"
  157. }, {
  158. "type" : "hyperUnique",
  159. "name" : "unique_bid",
  160. "fieldName" : "bid"
  161. }, {
  162. "type" : "hyperUnique",
  163. "name" : "unique_crm_id",
  164. "fieldName" : "crm_id"
  165. }, {
  166. "type" : "thetaSketch",
  167. "name" : "unique_bid_custom",
  168. "fieldName" : "bid",
  169. "size" : 16384,
  170. "shouldFinalize" : true,
  171. "isInputThetaSketch" : false
  172. } ],
  173. "granularitySpec" : {
  174. "type" : "uniform",
  175. "segmentGranularity" : "DAY",
  176. "queryGranularity" : {
  177. "type" : "none"
  178. },
  179. "intervals" : [ "2016-02-01T00:00:00.000Z/2016-02-02T00:00:00.000Z" ]
  180. }
  181. },
  182. "ioConfig" : {
  183. "type" : "index",
  184. "firehose" : {
  185. "type" : "local",
  186. "baseDir" : "/data/CleanHitSorter_1459936404597",
  187. "filter" : "part-r-00000",
  188. "parser" : null
  189. }
  190. },
  191. "tuningConfig" : {
  192. "type" : "index",
  193. "targetPartitionSize" : 5000000,
  194. "rowFlushBoundary" : 500000,
  195. "numShards" : -1,
  196. "indexSpec" : {
  197. "bitmap" : {
  198. "type" : "concise"
  199. },
  200. "dimensionCompression" : null,
  201. "metricCompression" : null
  202. }
  203. }
  204. },
  205. "context" : null,
  206. "groupId" : "index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z",
  207. "dataSource" : "__REPLACED___clean_hits",
  208. "interval" : "2016-02-01T00:00:00.000Z/2016-02-02T00:00:00.000Z"
  209. }
  210. 2016-04-08T14:25:55,579 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Attempting to lock file[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/lock].
  211. 2016-04-08T14:25:55,580 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Acquired lock file[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/lock] in 1ms.
  212. 2016-04-08T14:25:55,583 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z]: LockTryAcquireAction{interval=2016-02-01T00:00:00.000Z/2016-02-02T00:00:00.000Z}
  213. 2016-04-08T14:25:55,593 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z] to overlord[http://__HOSTNAME_REPLACED__:8090/druid/indexer/v1/action]: LockTryAcquireAction{interval=2016-02-01T00:00:00.000Z/2016-02-02T00:00:00.000Z}
  214. 2016-04-08T14:25:55,608 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  215. 2016-04-08T14:25:55,644 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  216. 2016-04-08T14:25:55,644 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  217. 2016-04-08T14:25:55,645 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  218. 2016-04-08T14:25:55,646 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  219. 2016-04-08T14:25:55,647 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  220. 2016-04-08T14:25:55,647 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  221. 2016-04-08T14:25:55,648 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  222. 2016-04-08T14:25:55,649 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  223. 2016-04-08T14:25:55,649 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  224. 2016-04-08T14:25:55,649 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  225. 2016-04-08T14:25:55,650 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  226. 2016-04-08T14:25:55,651 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  227. 2016-04-08T14:25:55,652 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  228. 2016-04-08T14:25:55,653 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  229. 2016-04-08T14:25:55,654 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  230. 2016-04-08T14:25:55,655 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  231. 2016-04-08T14:25:55,655 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  232. 2016-04-08T14:25:55,656 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  233. 2016-04-08T14:25:55,656 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  234. 2016-04-08T14:25:55,740 INFO [task-runner-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Running task: index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z
  235. 2016-04-08T14:25:55,740 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z]: LockListAction{}
  236. 2016-04-08T14:25:55,746 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z] to overlord[http://__HOSTNAME_REPLACED__:8090/druid/indexer/v1/action]: LockListAction{}
  237. 2016-04-08T14:25:55,799 INFO [task-runner-0] io.druid.segment.realtime.firehose.LocalFirehoseFactory - Searching for all [part-r-00000] in and beneath [/data/CleanHitSorter_1459936404597]
  238. 2016-04-08T14:25:55,815 INFO [task-runner-0] io.druid.segment.realtime.firehose.LocalFirehoseFactory - Found files: [/data/CleanHitSorter_1459936404597/part-r-00000]
  239. 2016-04-08T14:26:11,207 INFO [task-runner-0] io.druid.indexing.common.task.IndexTask - Determining partitions for interval[2016-02-01T00:00:00.000Z/2016-02-02T00:00:00.000Z] with targetPartitionSize[5000000]
  240. 2016-04-08T14:26:11,229 INFO [task-runner-0] io.druid.segment.realtime.firehose.LocalFirehoseFactory - Searching for all [part-r-00000] in and beneath [/data/CleanHitSorter_1459936404597]
  241. 2016-04-08T14:26:11,230 INFO [task-runner-0] io.druid.segment.realtime.firehose.LocalFirehoseFactory - Found files: [/data/CleanHitSorter_1459936404597/part-r-00000]
  242. 2016-04-08T14:26:39,827 INFO [task-runner-0] io.druid.indexing.common.task.IndexTask - Estimated approximately [2,874,674.090564] rows of data.
  243. 2016-04-08T14:26:39,828 INFO [task-runner-0] io.druid.indexing.common.task.IndexTask - Will require [1] shard(s).
  244. 2016-04-08T14:26:39,832 INFO [task-runner-0] io.druid.segment.realtime.firehose.LocalFirehoseFactory - Searching for all [part-r-00000] in and beneath [/data/CleanHitSorter_1459936404597]
  245. 2016-04-08T14:26:39,833 INFO [task-runner-0] io.druid.segment.realtime.firehose.LocalFirehoseFactory - Found files: [/data/CleanHitSorter_1459936404597/part-r-00000]
  246. 2016-04-08T14:26:57,334 INFO [task-runner-0] io.druid.indexing.common.index.YeOldePlumberSchool - Spilling index[0] with rows[500000] to: /tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill0
  247. 2016-04-08T14:26:57,340 INFO [task-runner-0] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
  248. 2016-04-08T14:26:57,340 INFO [task-runner-0] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
  249. 2016-04-08T14:26:57,349 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting persist for interval[2016-02-01T00:00:00.000Z/2016-02-01T08:46:32.793Z], rows[500,000]
  250. 2016-04-08T14:26:58,539 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill0/v8-tmp] completed index.drd in 6 millis.
  251. 2016-04-08T14:26:59,138 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill0/v8-tmp] completed dim conversions in 599 millis.
  252. 2016-04-08T14:27:10,243 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill0/v8-tmp] walked 500,000/500,000 rows in 11,078 millis.
  253. 2016-04-08T14:27:10,670 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill0/v8-tmp] completed walk through of 500,000 rows in 11,531 millis.
  254. 2016-04-08T14:27:10,672 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[ad_id] with cardinality[173]
  255. 2016-04-08T14:27:10,957 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[ad_id] in 286 millis.
  256. 2016-04-08T14:27:10,957 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[bid] with cardinality[184,468]
  257. 2016-04-08T14:27:11,713 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[bid] in 756 millis.
  258. 2016-04-08T14:27:11,713 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[c_id] with cardinality[58]
  259. 2016-04-08T14:27:11,868 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[c_id] in 155 millis.
  260. 2016-04-08T14:27:11,869 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[cookie_ok] with cardinality[0]
  261. 2016-04-08T14:27:11,870 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[cookie_ok] in 2 millis.
  262. 2016-04-08T14:27:11,871 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[crm_id] with cardinality[0]
  263. 2016-04-08T14:27:11,872 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[crm_id] in 2 millis.
  264. 2016-04-08T14:27:11,872 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[crm_provider] with cardinality[0]
  265. 2016-04-08T14:27:11,873 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[crm_provider] in 1 millis.
  266. 2016-04-08T14:27:11,874 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[segs] with cardinality[493]
  267. 2016-04-08T14:27:12,430 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[segs] in 557 millis.
  268. 2016-04-08T14:27:12,431 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[type] with cardinality[2]
  269. 2016-04-08T14:27:12,493 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[type] in 63 millis.
  270. 2016-04-08T14:27:12,494 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[wid] with cardinality[17]
  271. 2016-04-08T14:27:12,542 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[wid] in 49 millis.
  272. 2016-04-08T14:27:12,542 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill0/v8-tmp] completed inverted.drd in 1,872 millis.
  273. 2016-04-08T14:27:12,654 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Converting v8[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill0/v8-tmp] to v9[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill0]
  274. 2016-04-08T14:27:12,656 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_ad_id.drd]
  275. 2016-04-08T14:27:12,705 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] is single value, converting...
  276. 2016-04-08T14:27:12,705 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] has null rows.
  277. 2016-04-08T14:27:12,989 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_bid.drd]
  278. 2016-04-08T14:27:13,063 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[bid] is single value, converting...
  279. 2016-04-08T14:27:13,178 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_c_id.drd]
  280. 2016-04-08T14:27:13,194 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[c_id] is single value, converting...
  281. 2016-04-08T14:27:13,317 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_cookie_ok.drd]
  282. 2016-04-08T14:27:13,318 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[cookie_ok] had cardinality 0, equivalent to no column, so skipping.
  283. 2016-04-08T14:27:13,318 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_crm_id.drd]
  284. 2016-04-08T14:27:13,318 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[crm_id] had cardinality 0, equivalent to no column, so skipping.
  285. 2016-04-08T14:27:13,318 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_crm_provider.drd]
  286. 2016-04-08T14:27:13,318 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[crm_provider] had cardinality 0, equivalent to no column, so skipping.
  287. 2016-04-08T14:27:13,319 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_segs.drd]
  288. 2016-04-08T14:27:14,095 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_type.drd]
  289. 2016-04-08T14:27:14,169 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[type] is single value, converting...
  290. 2016-04-08T14:27:14,295 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_wid.drd]
  291. 2016-04-08T14:27:14,312 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[wid] is single value, converting...
  292. 2016-04-08T14:27:14,482 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[index.drd]
  293. 2016-04-08T14:27:14,483 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[inverted.drd]
  294. 2016-04-08T14:27:14,483 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_count_LITTLE_ENDIAN.drd]
  295. 2016-04-08T14:27:14,488 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_LITTLE_ENDIAN.drd]
  296. 2016-04-08T14:27:14,496 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_custom_LITTLE_ENDIAN.drd]
  297. 2016-04-08T14:27:14,510 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_crm_id_LITTLE_ENDIAN.drd]
  298. 2016-04-08T14:27:14,516 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[spatial.drd]
  299. 2016-04-08T14:27:14,516 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[time_LITTLE_ENDIAN.drd]
  300. 2016-04-08T14:27:14,521 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Skipped files[[index.drd, inverted.drd, spatial.drd]]
  301. 2016-04-08T14:27:14,522 INFO [task-runner-0] io.druid.segment.ReferenceCountingSegment - Closing __REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z
  302. 2016-04-08T14:27:14,522 INFO [task-runner-0] io.druid.segment.ReferenceCountingSegment - Closing __REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z, numReferences: 0
  303. 2016-04-08T14:27:27,028 INFO [task-runner-0] io.druid.indexing.common.index.YeOldePlumberSchool - Spilling index[1] with rows[500000] to: /tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill1
  304. 2016-04-08T14:27:27,028 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting persist for interval[2016-02-01T00:00:00.000Z/2016-02-01T11:30:52.331Z], rows[500,000]
  305. 2016-04-08T14:27:27,848 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill1/v8-tmp] completed index.drd in 1 millis.
  306. 2016-04-08T14:27:31,119 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill1/v8-tmp] completed dim conversions in 3,270 millis.
  307. 2016-04-08T14:27:40,785 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill1/v8-tmp] walked 500,000/500,000 rows in 9,662 millis.
  308. 2016-04-08T14:27:41,170 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill1/v8-tmp] completed walk through of 500,000 rows in 10,050 millis.
  309. 2016-04-08T14:27:41,171 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[ad_id] with cardinality[137]
  310. 2016-04-08T14:27:41,364 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[ad_id] in 194 millis.
  311. 2016-04-08T14:27:41,364 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[bid] with cardinality[230,853]
  312. 2016-04-08T14:27:42,555 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[bid] in 1,191 millis.
  313. 2016-04-08T14:27:42,555 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[c_id] with cardinality[44]
  314. 2016-04-08T14:27:42,723 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[c_id] in 168 millis.
  315. 2016-04-08T14:27:42,724 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[cookie_ok] with cardinality[0]
  316. 2016-04-08T14:27:42,725 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[cookie_ok] in 2 millis.
  317. 2016-04-08T14:27:42,726 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[crm_id] with cardinality[0]
  318. 2016-04-08T14:27:42,727 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[crm_id] in 2 millis.
  319. 2016-04-08T14:27:42,727 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[crm_provider] with cardinality[0]
  320. 2016-04-08T14:27:42,729 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[crm_provider] in 2 millis.
  321. 2016-04-08T14:27:42,729 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[segs] with cardinality[456]
  322. 2016-04-08T14:27:43,572 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[segs] in 842 millis.
  323. 2016-04-08T14:27:43,572 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[type] with cardinality[2]
  324. 2016-04-08T14:27:43,618 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[type] in 46 millis.
  325. 2016-04-08T14:27:43,618 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[wid] with cardinality[11]
  326. 2016-04-08T14:27:43,670 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[wid] in 51 millis.
  327. 2016-04-08T14:27:43,670 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill1/v8-tmp] completed inverted.drd in 2,500 millis.
  328. 2016-04-08T14:27:43,750 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Converting v8[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill1/v8-tmp] to v9[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill1]
  329. 2016-04-08T14:27:43,751 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_ad_id.drd]
  330. 2016-04-08T14:27:43,829 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] is single value, converting...
  331. 2016-04-08T14:27:43,829 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] has null rows.
  332. 2016-04-08T14:27:43,943 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_bid.drd]
  333. 2016-04-08T14:27:44,023 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[bid] is single value, converting...
  334. 2016-04-08T14:27:44,132 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_c_id.drd]
  335. 2016-04-08T14:27:44,148 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[c_id] is single value, converting...
  336. 2016-04-08T14:27:44,220 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_cookie_ok.drd]
  337. 2016-04-08T14:27:44,220 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[cookie_ok] had cardinality 0, equivalent to no column, so skipping.
  338. 2016-04-08T14:27:44,220 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_crm_id.drd]
  339. 2016-04-08T14:27:44,220 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[crm_id] had cardinality 0, equivalent to no column, so skipping.
  340. 2016-04-08T14:27:44,220 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_crm_provider.drd]
  341. 2016-04-08T14:27:44,220 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[crm_provider] had cardinality 0, equivalent to no column, so skipping.
  342. 2016-04-08T14:27:44,221 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_segs.drd]
  343. 2016-04-08T14:27:44,952 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_type.drd]
  344. 2016-04-08T14:27:44,968 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[type] is single value, converting...
  345. 2016-04-08T14:27:45,094 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_wid.drd]
  346. 2016-04-08T14:27:45,110 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[wid] is single value, converting...
  347. 2016-04-08T14:27:45,315 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[index.drd]
  348. 2016-04-08T14:27:45,316 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[inverted.drd]
  349. 2016-04-08T14:27:45,316 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_count_LITTLE_ENDIAN.drd]
  350. 2016-04-08T14:27:45,316 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_LITTLE_ENDIAN.drd]
  351. 2016-04-08T14:27:45,323 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_custom_LITTLE_ENDIAN.drd]
  352. 2016-04-08T14:27:45,336 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_crm_id_LITTLE_ENDIAN.drd]
  353. 2016-04-08T14:27:45,342 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[spatial.drd]
  354. 2016-04-08T14:27:45,343 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[time_LITTLE_ENDIAN.drd]
  355. 2016-04-08T14:27:45,346 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Skipped files[[index.drd, inverted.drd, spatial.drd]]
  356. 2016-04-08T14:27:45,347 INFO [task-runner-0] io.druid.segment.ReferenceCountingSegment - Closing __REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z
  357. 2016-04-08T14:27:45,347 INFO [task-runner-0] io.druid.segment.ReferenceCountingSegment - Closing __REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z, numReferences: 0
  358. 2016-04-08T14:27:57,429 INFO [task-runner-0] io.druid.indexing.common.index.YeOldePlumberSchool - Spilling index[2] with rows[500000] to: /tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill2
  359. 2016-04-08T14:27:57,430 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting persist for interval[2016-02-01T00:00:00.000Z/2016-02-01T14:28:11.657Z], rows[500,000]
  360. 2016-04-08T14:28:00,290 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill2/v8-tmp] completed index.drd in 1 millis.
  361. 2016-04-08T14:28:00,821 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill2/v8-tmp] completed dim conversions in 531 millis.
  362. 2016-04-08T14:28:09,182 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill2/v8-tmp] walked 500,000/500,000 rows in 8,356 millis.
  363. 2016-04-08T14:28:09,566 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill2/v8-tmp] completed walk through of 500,000 rows in 8,745 millis.
  364. 2016-04-08T14:28:09,567 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[ad_id] with cardinality[142]
  365. 2016-04-08T14:28:09,654 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[ad_id] in 87 millis.
  366. 2016-04-08T14:28:09,654 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[bid] with cardinality[230,794]
  367. 2016-04-08T14:28:10,222 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[bid] in 567 millis.
  368. 2016-04-08T14:28:10,222 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[c_id] with cardinality[47]
  369. 2016-04-08T14:28:10,293 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[c_id] in 71 millis.
  370. 2016-04-08T14:28:10,294 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[cookie_ok] with cardinality[0]
  371. 2016-04-08T14:28:10,295 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[cookie_ok] in 2 millis.
  372. 2016-04-08T14:28:10,295 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[crm_id] with cardinality[0]
  373. 2016-04-08T14:28:10,297 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[crm_id] in 2 millis.
  374. 2016-04-08T14:28:10,297 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[crm_provider] with cardinality[0]
  375. 2016-04-08T14:28:10,299 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[crm_provider] in 1 millis.
  376. 2016-04-08T14:28:10,299 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[segs] with cardinality[488]
  377. 2016-04-08T14:28:10,685 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[segs] in 385 millis.
  378. 2016-04-08T14:28:10,685 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[type] with cardinality[2]
  379. 2016-04-08T14:28:10,727 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[type] in 42 millis.
  380. 2016-04-08T14:28:10,728 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[wid] with cardinality[12]
  381. 2016-04-08T14:28:10,780 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[wid] in 52 millis.
  382. 2016-04-08T14:28:10,780 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill2/v8-tmp] completed inverted.drd in 1,214 millis.
  383. 2016-04-08T14:28:10,845 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Converting v8[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill2/v8-tmp] to v9[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill2]
  384. 2016-04-08T14:28:10,846 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_ad_id.drd]
  385. 2016-04-08T14:28:10,862 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] is single value, converting...
  386. 2016-04-08T14:28:10,862 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] has null rows.
  387. 2016-04-08T14:28:10,938 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_bid.drd]
  388. 2016-04-08T14:28:10,953 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[bid] is single value, converting...
  389. 2016-04-08T14:28:11,056 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_c_id.drd]
  390. 2016-04-08T14:28:11,071 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[c_id] is single value, converting...
  391. 2016-04-08T14:28:11,140 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_cookie_ok.drd]
  392. 2016-04-08T14:28:11,140 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[cookie_ok] had cardinality 0, equivalent to no column, so skipping.
  393. 2016-04-08T14:28:11,140 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_crm_id.drd]
  394. 2016-04-08T14:28:11,140 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[crm_id] had cardinality 0, equivalent to no column, so skipping.
  395. 2016-04-08T14:28:11,140 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_crm_provider.drd]
  396. 2016-04-08T14:28:11,141 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[crm_provider] had cardinality 0, equivalent to no column, so skipping.
  397. 2016-04-08T14:28:11,141 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_segs.drd]
  398. 2016-04-08T14:28:11,836 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_type.drd]
  399. 2016-04-08T14:28:11,851 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[type] is single value, converting...
  400. 2016-04-08T14:28:11,937 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_wid.drd]
  401. 2016-04-08T14:28:11,951 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[wid] is single value, converting...
  402. 2016-04-08T14:28:12,165 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[index.drd]
  403. 2016-04-08T14:28:12,165 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[inverted.drd]
  404. 2016-04-08T14:28:12,165 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_count_LITTLE_ENDIAN.drd]
  405. 2016-04-08T14:28:12,166 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_LITTLE_ENDIAN.drd]
  406. 2016-04-08T14:28:12,177 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_custom_LITTLE_ENDIAN.drd]
  407. 2016-04-08T14:28:12,194 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_crm_id_LITTLE_ENDIAN.drd]
  408. 2016-04-08T14:28:12,203 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[spatial.drd]
  409. 2016-04-08T14:28:12,204 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[time_LITTLE_ENDIAN.drd]
  410. 2016-04-08T14:28:12,207 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Skipped files[[index.drd, inverted.drd, spatial.drd]]
  411. 2016-04-08T14:28:12,207 INFO [task-runner-0] io.druid.segment.ReferenceCountingSegment - Closing __REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z
  412. 2016-04-08T14:28:12,207 INFO [task-runner-0] io.druid.segment.ReferenceCountingSegment - Closing __REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z, numReferences: 0
  413. 2016-04-08T14:28:24,054 INFO [task-runner-0] io.druid.indexing.common.index.YeOldePlumberSchool - Spilling index[3] with rows[500000] to: /tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill3
  414. 2016-04-08T14:28:24,055 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting persist for interval[2016-02-01T00:00:00.000Z/2016-02-01T17:29:10.258Z], rows[500,000]
  415. 2016-04-08T14:28:24,699 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill3/v8-tmp] completed index.drd in 0 millis.
  416. 2016-04-08T14:28:25,207 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill3/v8-tmp] completed dim conversions in 507 millis.
  417. 2016-04-08T14:28:33,527 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill3/v8-tmp] walked 500,000/500,000 rows in 8,315 millis.
  418. 2016-04-08T14:28:33,908 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill3/v8-tmp] completed walk through of 500,000 rows in 8,701 millis.
  419. 2016-04-08T14:28:33,908 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[ad_id] with cardinality[155]
  420. 2016-04-08T14:28:33,991 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[ad_id] in 83 millis.
  421. 2016-04-08T14:28:33,991 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[bid] with cardinality[233,531]
  422. 2016-04-08T14:28:34,509 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[bid] in 517 millis.
  423. 2016-04-08T14:28:34,509 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[c_id] with cardinality[53]
  424. 2016-04-08T14:28:34,593 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[c_id] in 84 millis.
  425. 2016-04-08T14:28:34,594 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[cookie_ok] with cardinality[0]
  426. 2016-04-08T14:28:34,595 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[cookie_ok] in 2 millis.
  427. 2016-04-08T14:28:34,595 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[crm_id] with cardinality[0]
  428. 2016-04-08T14:28:34,596 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[crm_id] in 1 millis.
  429. 2016-04-08T14:28:34,597 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[crm_provider] with cardinality[0]
  430. 2016-04-08T14:28:34,598 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[crm_provider] in 1 millis.
  431. 2016-04-08T14:28:34,598 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[segs] with cardinality[477]
  432. 2016-04-08T14:28:34,967 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[segs] in 368 millis.
  433. 2016-04-08T14:28:34,967 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[type] with cardinality[2]
  434. 2016-04-08T14:28:35,011 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[type] in 44 millis.
  435. 2016-04-08T14:28:35,012 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[wid] with cardinality[12]
  436. 2016-04-08T14:28:35,067 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[wid] in 56 millis.
  437. 2016-04-08T14:28:35,067 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill3/v8-tmp] completed inverted.drd in 1,159 millis.
  438. 2016-04-08T14:28:35,171 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Converting v8[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill3/v8-tmp] to v9[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill3]
  439. 2016-04-08T14:28:35,172 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_ad_id.drd]
  440. 2016-04-08T14:28:35,187 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] is single value, converting...
  441. 2016-04-08T14:28:35,187 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] has null rows.
  442. 2016-04-08T14:28:35,274 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_bid.drd]
  443. 2016-04-08T14:28:35,297 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[bid] is single value, converting...
  444. 2016-04-08T14:28:35,484 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_c_id.drd]
  445. 2016-04-08T14:28:35,499 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[c_id] is single value, converting...
  446. 2016-04-08T14:28:35,591 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_cookie_ok.drd]
  447. 2016-04-08T14:28:35,591 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[cookie_ok] had cardinality 0, equivalent to no column, so skipping.
  448. 2016-04-08T14:28:35,591 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_crm_id.drd]
  449. 2016-04-08T14:28:35,591 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[crm_id] had cardinality 0, equivalent to no column, so skipping.
  450. 2016-04-08T14:28:35,591 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_crm_provider.drd]
  451. 2016-04-08T14:28:35,591 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[crm_provider] had cardinality 0, equivalent to no column, so skipping.
  452. 2016-04-08T14:28:35,592 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_segs.drd]
  453. 2016-04-08T14:28:36,225 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_type.drd]
  454. 2016-04-08T14:28:36,244 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[type] is single value, converting...
  455. 2016-04-08T14:28:36,333 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_wid.drd]
  456. 2016-04-08T14:28:36,349 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[wid] is single value, converting...
  457. 2016-04-08T14:28:36,534 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[index.drd]
  458. 2016-04-08T14:28:36,534 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[inverted.drd]
  459. 2016-04-08T14:28:36,534 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_count_LITTLE_ENDIAN.drd]
  460. 2016-04-08T14:28:36,535 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_LITTLE_ENDIAN.drd]
  461. 2016-04-08T14:28:36,542 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_custom_LITTLE_ENDIAN.drd]
  462. 2016-04-08T14:28:36,553 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_crm_id_LITTLE_ENDIAN.drd]
  463. 2016-04-08T14:28:36,559 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[spatial.drd]
  464. 2016-04-08T14:28:36,559 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[time_LITTLE_ENDIAN.drd]
  465. 2016-04-08T14:28:36,562 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Skipped files[[index.drd, inverted.drd, spatial.drd]]
  466. 2016-04-08T14:28:36,562 INFO [task-runner-0] io.druid.segment.ReferenceCountingSegment - Closing __REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z
  467. 2016-04-08T14:28:36,562 INFO [task-runner-0] io.druid.segment.ReferenceCountingSegment - Closing __REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z, numReferences: 0
  468. 2016-04-08T14:28:46,896 INFO [task-runner-0] io.druid.indexing.common.index.YeOldePlumberSchool - Spilling index[4] with rows[500000] to: /tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill4
  469. 2016-04-08T14:28:46,896 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting persist for interval[2016-02-01T00:00:00.000Z/2016-02-01T19:42:14.391Z], rows[500,000]
  470. 2016-04-08T14:28:47,577 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill4/v8-tmp] completed index.drd in 0 millis.
  471. 2016-04-08T14:28:48,162 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill4/v8-tmp] completed dim conversions in 585 millis.
  472. 2016-04-08T14:28:58,391 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill4/v8-tmp] walked 500,000/500,000 rows in 10,225 millis.
  473. 2016-04-08T14:28:58,765 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill4/v8-tmp] completed walk through of 500,000 rows in 10,603 millis.
  474. 2016-04-08T14:28:58,766 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[ad_id] with cardinality[148]
  475. 2016-04-08T14:28:58,851 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[ad_id] in 86 millis.
  476. 2016-04-08T14:28:58,851 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[bid] with cardinality[259,046]
  477. 2016-04-08T14:28:59,432 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[bid] in 581 millis.
  478. 2016-04-08T14:28:59,432 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[c_id] with cardinality[51]
  479. 2016-04-08T14:28:59,504 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[c_id] in 72 millis.
  480. 2016-04-08T14:28:59,505 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[cookie_ok] with cardinality[0]
  481. 2016-04-08T14:28:59,506 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[cookie_ok] in 1 millis.
  482. 2016-04-08T14:28:59,507 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[crm_id] with cardinality[0]
  483. 2016-04-08T14:28:59,508 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[crm_id] in 2 millis.
  484. 2016-04-08T14:28:59,508 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[crm_provider] with cardinality[0]
  485. 2016-04-08T14:28:59,510 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[crm_provider] in 2 millis.
  486. 2016-04-08T14:28:59,510 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[segs] with cardinality[331]
  487. 2016-04-08T14:28:59,845 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[segs] in 334 millis.
  488. 2016-04-08T14:28:59,845 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[type] with cardinality[2]
  489. 2016-04-08T14:28:59,892 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[type] in 46 millis.
  490. 2016-04-08T14:28:59,892 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[wid] with cardinality[13]
  491. 2016-04-08T14:28:59,946 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[wid] in 54 millis.
  492. 2016-04-08T14:28:59,947 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill4/v8-tmp] completed inverted.drd in 1,181 millis.
  493. 2016-04-08T14:29:00,009 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Converting v8[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill4/v8-tmp] to v9[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill4]
  494. 2016-04-08T14:29:00,010 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_ad_id.drd]
  495. 2016-04-08T14:29:00,028 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] is single value, converting...
  496. 2016-04-08T14:29:00,028 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] has null rows.
  497. 2016-04-08T14:29:00,111 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_bid.drd]
  498. 2016-04-08T14:29:00,126 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[bid] is single value, converting...
  499. 2016-04-08T14:29:00,231 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_c_id.drd]
  500. 2016-04-08T14:29:00,247 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[c_id] is single value, converting...
  501. 2016-04-08T14:29:00,328 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_cookie_ok.drd]
  502. 2016-04-08T14:29:00,328 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[cookie_ok] had cardinality 0, equivalent to no column, so skipping.
  503. 2016-04-08T14:29:00,328 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_crm_id.drd]
  504. 2016-04-08T14:29:00,329 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[crm_id] had cardinality 0, equivalent to no column, so skipping.
  505. 2016-04-08T14:29:00,329 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_crm_provider.drd]
  506. 2016-04-08T14:29:00,329 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[crm_provider] had cardinality 0, equivalent to no column, so skipping.
  507. 2016-04-08T14:29:00,329 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_segs.drd]
  508. 2016-04-08T14:29:00,886 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_type.drd]
  509. 2016-04-08T14:29:00,902 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[type] is single value, converting...
  510. 2016-04-08T14:29:01,002 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_wid.drd]
  511. 2016-04-08T14:29:01,017 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[wid] is single value, converting...
  512. 2016-04-08T14:29:01,245 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[index.drd]
  513. 2016-04-08T14:29:01,245 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[inverted.drd]
  514. 2016-04-08T14:29:01,245 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_count_LITTLE_ENDIAN.drd]
  515. 2016-04-08T14:29:01,246 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_LITTLE_ENDIAN.drd]
  516. 2016-04-08T14:29:01,252 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_custom_LITTLE_ENDIAN.drd]
  517. 2016-04-08T14:29:01,266 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_crm_id_LITTLE_ENDIAN.drd]
  518. 2016-04-08T14:29:01,273 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[spatial.drd]
  519. 2016-04-08T14:29:01,273 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[time_LITTLE_ENDIAN.drd]
  520. 2016-04-08T14:29:01,276 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Skipped files[[index.drd, inverted.drd, spatial.drd]]
  521. 2016-04-08T14:29:01,277 INFO [task-runner-0] io.druid.segment.ReferenceCountingSegment - Closing __REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z
  522. 2016-04-08T14:29:01,277 INFO [task-runner-0] io.druid.segment.ReferenceCountingSegment - Closing __REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z, numReferences: 0
  523. 2016-04-08T14:29:12,916 INFO [task-runner-0] io.druid.indexing.common.index.YeOldePlumberSchool - Spilling index[5] with rows[492289] to: /tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill5
  524. 2016-04-08T14:29:12,916 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting persist for interval[2016-02-01T00:00:00.000Z/2016-02-01T21:44:59.948Z], rows[492,289]
  525. 2016-04-08T14:29:13,561 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill5/v8-tmp] completed index.drd in 1 millis.
  526. 2016-04-08T14:29:14,136 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill5/v8-tmp] completed dim conversions in 575 millis.
  527. 2016-04-08T14:29:22,800 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill5/v8-tmp] completed walk through of 492,289 rows in 8,663 millis.
  528. 2016-04-08T14:29:22,801 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[ad_id] with cardinality[139]
  529. 2016-04-08T14:29:22,891 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[ad_id] in 90 millis.
  530. 2016-04-08T14:29:22,891 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[bid] with cardinality[253,498]
  531. 2016-04-08T14:29:23,512 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[bid] in 621 millis.
  532. 2016-04-08T14:29:23,512 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[c_id] with cardinality[48]
  533. 2016-04-08T14:29:23,581 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[c_id] in 69 millis.
  534. 2016-04-08T14:29:23,581 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[cookie_ok] with cardinality[0]
  535. 2016-04-08T14:29:23,582 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[cookie_ok] in 1 millis.
  536. 2016-04-08T14:29:23,583 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[crm_id] with cardinality[0]
  537. 2016-04-08T14:29:23,584 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[crm_id] in 2 millis.
  538. 2016-04-08T14:29:23,584 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[crm_provider] with cardinality[0]
  539. 2016-04-08T14:29:23,586 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[crm_provider] in 1 millis.
  540. 2016-04-08T14:29:23,586 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[segs] with cardinality[359]
  541. 2016-04-08T14:29:23,918 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[segs] in 332 millis.
  542. 2016-04-08T14:29:23,919 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[type] with cardinality[2]
  543. 2016-04-08T14:29:23,962 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[type] in 43 millis.
  544. 2016-04-08T14:29:23,963 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[wid] with cardinality[10]
  545. 2016-04-08T14:29:24,012 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[wid] in 49 millis.
  546. 2016-04-08T14:29:24,012 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill5/v8-tmp] completed inverted.drd in 1,211 millis.
  547. 2016-04-08T14:29:24,108 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Converting v8[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill5/v8-tmp] to v9[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z/spill5]
  548. 2016-04-08T14:29:24,109 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_ad_id.drd]
  549. 2016-04-08T14:29:24,125 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] is single value, converting...
  550. 2016-04-08T14:29:24,125 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] has null rows.
  551. 2016-04-08T14:29:24,209 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_bid.drd]
  552. 2016-04-08T14:29:24,228 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[bid] is single value, converting...
  553. 2016-04-08T14:29:24,353 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_c_id.drd]
  554. 2016-04-08T14:29:24,371 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[c_id] is single value, converting...
  555. 2016-04-08T14:29:24,459 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_cookie_ok.drd]
  556. 2016-04-08T14:29:24,459 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[cookie_ok] had cardinality 0, equivalent to no column, so skipping.
  557. 2016-04-08T14:29:24,459 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_crm_id.drd]
  558. 2016-04-08T14:29:24,460 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[crm_id] had cardinality 0, equivalent to no column, so skipping.
  559. 2016-04-08T14:29:24,460 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_crm_provider.drd]
  560. 2016-04-08T14:29:24,460 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[crm_provider] had cardinality 0, equivalent to no column, so skipping.
  561. 2016-04-08T14:29:24,460 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_segs.drd]
  562. 2016-04-08T14:29:25,004 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_type.drd]
  563. 2016-04-08T14:29:25,020 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[type] is single value, converting...
  564. 2016-04-08T14:29:25,104 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_wid.drd]
  565. 2016-04-08T14:29:25,118 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[wid] is single value, converting...
  566. 2016-04-08T14:29:25,339 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[index.drd]
  567. 2016-04-08T14:29:25,339 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[inverted.drd]
  568. 2016-04-08T14:29:25,339 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_count_LITTLE_ENDIAN.drd]
  569. 2016-04-08T14:29:25,339 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_LITTLE_ENDIAN.drd]
  570. 2016-04-08T14:29:25,349 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_custom_LITTLE_ENDIAN.drd]
  571. 2016-04-08T14:29:25,364 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_crm_id_LITTLE_ENDIAN.drd]
  572. 2016-04-08T14:29:25,371 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[spatial.drd]
  573. 2016-04-08T14:29:25,372 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[time_LITTLE_ENDIAN.drd]
  574. 2016-04-08T14:29:25,375 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Skipped files[[index.drd, inverted.drd, spatial.drd]]
  575. 2016-04-08T14:29:25,375 INFO [task-runner-0] io.druid.segment.ReferenceCountingSegment - Closing __REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z
  576. 2016-04-08T14:29:25,375 INFO [task-runner-0] io.druid.segment.ReferenceCountingSegment - Closing __REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z, numReferences: 0
  577. 2016-04-08T14:29:25,435 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/merged/v8-tmp] completed index.drd in 0 millis.
  578. 2016-04-08T14:29:27,602 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/merged/v8-tmp] completed dim conversions in 2,167 millis.
  579. 2016-04-08T14:29:27,618 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[1]
  580. 2016-04-08T14:29:27,620 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[2]
  581. 2016-04-08T14:29:27,620 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[3]
  582. 2016-04-08T14:29:27,620 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[4]
  583. 2016-04-08T14:29:27,621 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[5]
  584. 2016-04-08T14:29:27,622 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[6]
  585. 2016-04-08T14:29:27,622 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[7]
  586. 2016-04-08T14:29:27,623 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[8]
  587. 2016-04-08T14:29:27,625 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[9]
  588. 2016-04-08T14:29:27,625 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[10]
  589. 2016-04-08T14:29:27,625 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[11]
  590. 2016-04-08T14:29:27,626 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[12]
  591. 2016-04-08T14:29:27,626 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[13]
  592. 2016-04-08T14:29:27,626 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[14]
  593. 2016-04-08T14:29:27,627 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[15]
  594. 2016-04-08T14:29:27,627 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[16]
  595. 2016-04-08T14:29:27,627 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[17]
  596. 2016-04-08T14:29:27,627 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[18]
  597. 2016-04-08T14:29:27,628 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[19]
  598. 2016-04-08T14:29:27,628 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[20]
  599. 2016-04-08T14:29:27,628 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[21]
  600. 2016-04-08T14:29:27,628 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[22]
  601. 2016-04-08T14:29:27,629 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[23]
  602. 2016-04-08T14:29:27,629 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[24]
  603. 2016-04-08T14:29:27,629 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[25]
  604. 2016-04-08T14:29:27,629 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[26]
  605. 2016-04-08T14:29:27,630 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[27]
  606. 2016-04-08T14:29:27,630 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[28]
  607. 2016-04-08T14:29:27,630 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[29]
  608. 2016-04-08T14:29:27,630 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[30]
  609. 2016-04-08T14:29:27,631 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[31]
  610. 2016-04-08T14:29:27,631 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[32]
  611. 2016-04-08T14:29:27,631 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[33]
  612. 2016-04-08T14:29:27,631 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[34]
  613. 2016-04-08T14:29:27,632 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[35]
  614. 2016-04-08T14:29:27,632 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[36]
  615. 2016-04-08T14:29:27,632 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[37]
  616. 2016-04-08T14:29:27,632 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[38]
  617. 2016-04-08T14:29:27,633 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[39]
  618. 2016-04-08T14:29:27,633 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[40]
  619. 2016-04-08T14:29:27,633 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[41]
  620. 2016-04-08T14:29:27,633 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[42]
  621. 2016-04-08T14:29:27,634 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[43]
  622. 2016-04-08T14:29:27,634 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[44]
  623. 2016-04-08T14:29:27,634 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[45]
  624. 2016-04-08T14:29:27,634 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[46]
  625. 2016-04-08T14:29:27,635 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[47]
  626. 2016-04-08T14:29:27,635 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[48]
  627. 2016-04-08T14:29:27,635 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[49]
  628. 2016-04-08T14:29:27,635 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[50]
  629. 2016-04-08T14:29:27,636 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[51]
  630. 2016-04-08T14:29:27,636 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[52]
  631. 2016-04-08T14:29:27,636 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[53]
  632. 2016-04-08T14:29:31,868 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/merged/v8-tmp] walked 500,000/500,000 rows in 4,261 millis.
  633. 2016-04-08T14:29:34,674 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/merged/v8-tmp] walked 500,000/1,000,000 rows in 2,805 millis.
  634. 2016-04-08T14:29:36,936 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/merged/v8-tmp] walked 500,000/1,500,000 rows in 2,261 millis.
  635. 2016-04-08T14:29:39,096 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/merged/v8-tmp] walked 500,000/2,000,000 rows in 2,160 millis.
  636. 2016-04-08T14:29:41,144 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/merged/v8-tmp] walked 500,000/2,500,000 rows in 2,046 millis.
  637. 2016-04-08T14:29:45,611 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/merged/v8-tmp] completed walk through of 2,992,289 rows in 18,009 millis.
  638. 2016-04-08T14:29:45,612 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[ad_id] with cardinality[209]
  639. 2016-04-08T14:29:46,962 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[ad_id] in 1,349 millis.
  640. 2016-04-08T14:29:46,962 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[bid] with cardinality[1,265,942]
  641. 2016-04-08T14:29:50,555 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[bid] in 3,592 millis.
  642. 2016-04-08T14:29:50,555 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[c_id] with cardinality[75]
  643. 2016-04-08T14:29:51,133 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[c_id] in 577 millis.
  644. 2016-04-08T14:29:51,133 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[segs] with cardinality[710]
  645. 2016-04-08T14:29:54,607 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[segs] in 3,474 millis.
  646. 2016-04-08T14:29:54,608 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[type] with cardinality[2]
  647. 2016-04-08T14:29:55,043 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[type] in 436 millis.
  648. 2016-04-08T14:29:55,043 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[wid] with cardinality[24]
  649. 2016-04-08T14:29:55,515 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[wid] in 471 millis.
  650. 2016-04-08T14:29:55,515 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/merged/v8-tmp] completed inverted.drd in 9,903 millis.
  651. 2016-04-08T14:29:56,067 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Converting v8[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/merged/v8-tmp] to v9[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/merged]
  652. 2016-04-08T14:29:56,068 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_ad_id.drd]
  653. 2016-04-08T14:29:56,168 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] is single value, converting...
  654. 2016-04-08T14:29:56,656 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_bid.drd]
  655. 2016-04-08T14:29:56,749 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[bid] is single value, converting...
  656. 2016-04-08T14:29:57,400 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_c_id.drd]
  657. 2016-04-08T14:29:57,514 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[c_id] is single value, converting...
  658. 2016-04-08T14:29:58,030 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_segs.drd]
  659. 2016-04-08T14:30:02,628 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_type.drd]
  660. 2016-04-08T14:30:02,724 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[type] is single value, converting...
  661. 2016-04-08T14:30:03,365 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_wid.drd]
  662. 2016-04-08T14:30:03,459 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[wid] is single value, converting...
  663. 2016-04-08T14:30:04,683 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[index.drd]
  664. 2016-04-08T14:30:04,684 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[inverted.drd]
  665. 2016-04-08T14:30:04,684 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_count_LITTLE_ENDIAN.drd]
  666. 2016-04-08T14:30:04,684 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_LITTLE_ENDIAN.drd]
  667. 2016-04-08T14:30:04,734 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_custom_LITTLE_ENDIAN.drd]
  668. 2016-04-08T14:30:04,824 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_crm_id_LITTLE_ENDIAN.drd]
  669. 2016-04-08T14:30:04,864 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[spatial.drd]
  670. 2016-04-08T14:30:04,865 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[time_LITTLE_ENDIAN.drd]
  671. 2016-04-08T14:30:04,877 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Skipped files[[index.drd, inverted.drd, spatial.drd]]
  672. 2016-04-08T14:30:04,884 INFO [task-runner-0] io.druid.segment.loading.LocalDataSegmentPusher - Copying segment[__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z] to local filesystem at location[/data/druid/localStorage/__REPLACED___clean_hits/2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z/2016-04-08T14:25:48.265Z/0]
  673. 2016-04-08T14:30:04,885 INFO [task-runner-0] io.druid.segment.loading.LocalDataSegmentPusher - Compressing files from[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/merged] to [/data/druid/localStorage/__REPLACED___clean_hits/2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z/2016-04-08T14:25:48.265Z/0/index.zip]
  674. 2016-04-08T14:30:04,889 INFO [task-runner-0] com.metamx.common.CompressionUtils - Adding file[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/merged/meta.smoosh] with size[365]. Total size so far[0]
  675. 2016-04-08T14:30:04,890 INFO [task-runner-0] com.metamx.common.CompressionUtils - Adding file[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/merged/00000.smoosh] with size[358,423,312]. Total size so far[365]
  676. 2016-04-08T14:30:36,730 INFO [task-runner-0] com.metamx.common.CompressionUtils - Adding file[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/merged/version.bin] with size[4]. Total size so far[358,423,677]
  677. 2016-04-08T14:30:36,733 INFO [task-runner-0] io.druid.segment.loading.LocalDataSegmentPusher - Creating descriptor file at[/data/druid/localStorage/__REPLACED___clean_hits/2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z/2016-04-08T14:25:48.265Z/0/descriptor.json]
  678. 2016-04-08T14:30:36,750 INFO [task-runner-0] io.druid.indexing.common.index.YeOldePlumberSchool - Uploaded segment[__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z]
  679. 2016-04-08T14:30:36,751 INFO [task-runner-0] io.druid.indexing.common.index.YeOldePlumberSchool - Deleting Index File[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-08T14:25:48.265Z_0/merged]
  680. 2016-04-08T14:30:36,751 INFO [task-runner-0] io.druid.indexing.common.task.IndexTask - Task[index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z] interval[2016-02-01T00:00:00.000Z/2016-02-02T00:00:00.000Z] partition[0] took in 2,993,869 rows (2,993,869 processed, 0 unparseable, 0 thrown away) and output 2,992,289 rows
  681. 2016-04-08T14:30:36,760 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z]: SegmentInsertAction{segments=[DataSegment{size=358423681, shardSpec=NoneShardSpec, metrics=[count, unique_bid, unique_crm_id, unique_bid_custom], dimensions=[ad_id, bid, c_id, segs, type, wid], version='2016-04-08T14:25:48.265Z', loadSpec={type=local, path=/data/druid/localStorage/__REPLACED___clean_hits/2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z/2016-04-08T14:25:48.265Z/0/index.zip}, interval=2016-02-01T00:00:00.000Z/2016-02-02T00:00:00.000Z, dataSource='__REPLACED___clean_hits', binaryVersion='9'}]}
  682. 2016-04-08T14:30:36,764 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z] to overlord[http://__HOSTNAME_REPLACED__:8090/druid/indexer/v1/action]: SegmentInsertAction{segments=[DataSegment{size=358423681, shardSpec=NoneShardSpec, metrics=[count, unique_bid, unique_crm_id, unique_bid_custom], dimensions=[ad_id, bid, c_id, segs, type, wid], version='2016-04-08T14:25:48.265Z', loadSpec={type=local, path=/data/druid/localStorage/__REPLACED___clean_hits/2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z/2016-04-08T14:25:48.265Z/0/index.zip}, interval=2016-02-01T00:00:00.000Z/2016-02-02T00:00:00.000Z, dataSource='__REPLACED___clean_hits', binaryVersion='9'}]}
  683. 2016-04-08T14:30:36,912 INFO [task-runner-0] io.druid.indexing.worker.executor.ExecutorLifecycle - Task completed with status: {
  684. "id" : "index___REPLACED___clean_hits_2016-04-08T14:25:48.256Z",
  685. "status" : "SUCCESS",
  686. "duration" : 281168
  687. }
  688. 2016-04-08T14:30:36,917 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.stop()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@7e9bc1e8].
  689. 2016-04-08T14:30:36,917 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Stopping class io.druid.server.coordination.BatchDataSegmentAnnouncer with config[io.druid.server.initialization.ZkPathsConfig@58d3f4be]
  690. 2016-04-08T14:30:36,917 INFO [main] io.druid.curator.announcement.Announcer - unannouncing [/druid/announcements/__HOSTNAME_REPLACED__:8100]
Add Comment
Please, Sign In to add comment