API tools faq
paste
tha-dude

druid_index_task_success_log

tha-dude
Apr 11th, 2016
41
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 123.51 KB | None | 0 0
raw download clone embed print report
  1. 2016-04-11T15:02:32,652 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
  2. 2016-04-11T15:02:32,657 INFO [main] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
  3. Apr 11, 2016 3:02:32 PM org.hibernate.validator.internal.util.Version <clinit>
  4. INFO: HV000001: Hibernate Validator 5.1.3.Final
  5. 2016-04-11T15:02:33,501 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, coordinates=[io.druid.extensions:druid-datasketches, io.druid.extensions:druid-examples, io.druid.extensions:druid-kafka-eight], defaultVersion='0.8.3', localRepository='extensions-repo', remoteRepositories=[https://repo1.maven.org/maven2/, https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local]}]
  6. 2016-04-11T15:02:33,718 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-datasketches] for class[io.druid.cli.CliCommandCreator]
  7. 2016-04-11T15:02:33,875 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/io/druid/extensions/druid-datasketches/0.8.3/druid-datasketches-0.8.3.jar]
  8. 2016-04-11T15:02:33,875 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/com/yahoo/datasketches/sketches-core/0.2.2/sketches-core-0.2.2.jar]
  9. 2016-04-11T15:02:33,876 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-examples] for class[io.druid.cli.CliCommandCreator]
  10. 2016-04-11T15:02:35,180 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/io/druid/extensions/druid-examples/0.8.3/druid-examples-0.8.3.jar]
  11. 2016-04-11T15:02:35,180 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/org/twitter4j/twitter4j-core/3.0.3/twitter4j-core-3.0.3.jar]
  12. 2016-04-11T15:02:35,180 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/org/twitter4j/twitter4j-async/3.0.3/twitter4j-async-3.0.3.jar]
  13. 2016-04-11T15:02:35,180 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/org/twitter4j/twitter4j-stream/3.0.3/twitter4j-stream-3.0.3.jar]
  14. 2016-04-11T15:02:35,181 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/commons-validator/commons-validator/1.4.0/commons-validator-1.4.0.jar]
  15. 2016-04-11T15:02:35,181 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/commons-beanutils/commons-beanutils/1.8.3/commons-beanutils-1.8.3.jar]
  16. 2016-04-11T15:02:35,181 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/commons-digester/commons-digester/1.8/commons-digester-1.8.jar]
  17. 2016-04-11T15:02:35,181 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar]
  18. 2016-04-11T15:02:35,184 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-kafka-eight] for class[io.druid.cli.CliCommandCreator]
  19. 2016-04-11T15:02:35,305 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/io/druid/extensions/druid-kafka-eight/0.8.3/druid-kafka-eight-0.8.3.jar]
  20. 2016-04-11T15:02:35,305 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/org/apache/kafka/kafka_2.10/0.8.2.1/kafka_2.10-0.8.2.1.jar]
  21. 2016-04-11T15:02:35,305 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/com/yammer/metrics/metrics-core/2.2.0/metrics-core-2.2.0.jar]
  22. 2016-04-11T15:02:35,305 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar]
  23. 2016-04-11T15:02:35,305 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/org/apache/kafka/kafka-clients/0.8.2.1/kafka-clients-0.8.2.1.jar]
  24. 2016-04-11T15:02:35,305 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/net/jpountz/lz4/lz4/1.3.0/lz4-1.3.0.jar]
  25. 2016-04-11T15:02:35,306 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/org/xerial/snappy/snappy-java/1.1.1.6/snappy-java-1.1.1.6.jar]
  26. 2016-04-11T15:02:35,306 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar]
  27. 2016-04-11T15:02:35,306 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar]
  28. 2016-04-11T15:02:35,306 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/log4j/log4j/1.2.16/log4j-1.2.16.jar]
  29. 2016-04-11T15:02:35,306 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/jline/jline/0.9.94/jline-0.9.94.jar]
  30. 2016-04-11T15:02:35,306 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/io/netty/netty/3.7.0.Final/netty-3.7.0.Final.jar]
  31. 2016-04-11T15:02:35,306 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/net/sf/jopt-simple/jopt-simple/3.2/jopt-simple-3.2.jar]
  32. 2016-04-11T15:02:35,307 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid-0.8.3/extensions-repo/com/101tec/zkclient/0.3/zkclient-0.3.jar]
  33. 2016-04-11T15:02:35,586 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-datasketches] for class[io.druid.initialization.DruidModule]
  34. 2016-04-11T15:02:35,593 INFO [main] io.druid.initialization.Initialization - Adding remote extension module[io.druid.query.aggregation.datasketches.theta.SketchModule] for class[io.druid.initialization.DruidModule]
  35. 2016-04-11T15:02:35,594 INFO [main] io.druid.initialization.Initialization - Adding remote extension module[io.druid.query.aggregation.datasketches.theta.oldapi.OldApiSketchModule] for class[io.druid.initialization.DruidModule]
  36. 2016-04-11T15:02:35,594 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-examples] for class[io.druid.initialization.DruidModule]
  37. 2016-04-11T15:02:35,596 INFO [main] io.druid.initialization.Initialization - Adding remote extension module[io.druid.examples.ExamplesDruidModule] for class[io.druid.initialization.DruidModule]
  38. 2016-04-11T15:02:35,596 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-kafka-eight] for class[io.druid.initialization.DruidModule]
  39. 2016-04-11T15:02:35,598 INFO [main] io.druid.initialization.Initialization - Adding remote extension module[io.druid.firehose.kafka.KafkaEightDruidModule] for class[io.druid.initialization.DruidModule]
  40. 2016-04-11T15:02:36,633 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@23b5af7b]
  41. 2016-04-11T15:02:36,651 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[]}]
  42. 2016-04-11T15:02:36,678 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.DruidNode] from props[druid.] as [DruidNode{serviceName='overlord', host='__HOSTNAME_REPLACED__', port=8100}]
  43. 2016-04-11T15:02:36,716 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ServerConfig] from props[druid.server.http.] as [ServerConfig{numThreads=40, maxIdleTime=PT5M}]
  44. 2016-04-11T15:02:36,747 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.config.TaskConfig] from props[druid.indexer.task.] as [io.druid.indexing.common.config.TaskConfig@4af4502f]
  45. 2016-04-11T15:02:36,757 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.http.DruidHttpClientConfig] from props[druid.global.http.] as [io.druid.guice.http.DruidHttpClientConfig@5ac33aa8]
  46. 2016-04-11T15:02:36,897 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.indexing.IndexingServiceSelectorConfig] from props[druid.selectors.indexing.] as [io.druid.client.indexing.IndexingServiceSelectorConfig@5770b13f]
  47. 2016-04-11T15:02:36,903 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.curator.CuratorConfig] from props[druid.zk.service.] as [io.druid.curator.CuratorConfig@21c96b27]
  48. 2016-04-11T15:02:36,912 WARN [main] org.apache.curator.retry.ExponentialBackoffRetry - maxRetries too large (30). Pinning to 29
  49. 2016-04-11T15:02:36,950 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.CuratorDiscoveryConfig] from props[druid.discovery.curator.] as [io.druid.server.initialization.CuratorDiscoveryConfig@55a75dd8]
  50. 2016-04-11T15:02:37,143 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.RetryPolicyConfig] from props[druid.peon.taskActionClient.retry.] as [io.druid.indexing.common.RetryPolicyConfig@5f4bd002]
  51. 2016-04-11T15:02:37,148 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.loading.LocalDataSegmentPusherConfig] from props[druid.storage.] as [io.druid.segment.loading.LocalDataSegmentPusherConfig@30f47537]
  52. 2016-04-11T15:02:37,149 INFO [main] io.druid.segment.loading.LocalDataSegmentPusher - Configured local filesystem as deep storage
  53. 2016-04-11T15:02:37,170 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.DruidServerConfig] from props[druid.server.] as [io.druid.client.DruidServerConfig@34511470]
  54. 2016-04-11T15:02:37,176 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.BatchDataSegmentAnnouncerConfig] from props[druid.announcer.] as [io.druid.server.initialization.BatchDataSegmentAnnouncerConfig@36db9f36]
  55. 2016-04-11T15:02:37,193 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ZkPathsConfig] from props[druid.zk.paths.] as [io.druid.server.initialization.ZkPathsConfig@58d3f4be]
  56. 2016-04-11T15:02:37,201 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.coordination.DataSegmentAnnouncerProvider] from props[druid.announcer.] as [io.druid.server.coordination.BatchDataSegmentAnnouncerProvider@6dafda97]
  57. 2016-04-11T15:02:37,204 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.coordinator.CoordinatorSelectorConfig] from props[druid.selectors.coordinator.] as [io.druid.client.coordinator.CoordinatorSelectorConfig@7915b3e]
  58. 2016-04-11T15:02:37,211 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig] from props[druid.segment.handoff.] as [io.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig@325cff23]
  59. 2016-04-11T15:02:37,216 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [100000000] for [druid.computation.buffer.size] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()]
  60. 2016-04-11T15:02:37,220 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [1] for [druid.processing.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreads()]
  61. 2016-04-11T15:02:37,220 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]
  62. 2016-04-11T15:02:37,223 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [com.metamx.common.concurrent.ExecutorServiceConfig#getFormatString()]
  63. 2016-04-11T15:02:37,340 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.search.search.SearchQueryConfig] from props[druid.query.search.] as [io.druid.query.search.search.SearchQueryConfig@15dd5f6a]
  64. 2016-04-11T15:02:37,345 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.metadata.SegmentMetadataQueryConfig] from props[druid.query.segmentMetadata.] as [io.druid.query.metadata.SegmentMetadataQueryConfig@eb09a69]
  65. 2016-04-11T15:02:37,351 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.groupby.GroupByQueryConfig] from props[druid.query.groupBy.] as [io.druid.query.groupby.GroupByQueryConfig@3f3d370a]
  66. 2016-04-11T15:02:37,357 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.topn.TopNQueryConfig] from props[druid.query.topN.] as [io.druid.query.topn.TopNQueryConfig@2abdf637]
  67. 2016-04-11T15:02:37,364 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.client.cache.CacheProvider] from props[druid.cache.] as [io.druid.client.cache.LocalCacheProvider@5433b4fc]
  68. 2016-04-11T15:02:37,373 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.cache.CacheConfig] from props[druid.realtime.cache.] as [io.druid.client.cache.CacheConfig@41f0b28]
  69. 2016-04-11T15:02:37,378 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.log.RequestLoggerProvider] from props[druid.request.logging.] as [io.druid.server.log.NoopRequestLoggerProvider@340408e4]
  70. 2016-04-11T15:02:37,388 INFO [main] org.eclipse.jetty.util.log - Logging initialized @5834ms
  71. 2016-04-11T15:02:37,489 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.start()] on object[io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@173274d9].
  72. 2016-04-11T15:02:37,489 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.service.ServiceEmitter.start()] on object[com.metamx.emitter.service.ServiceEmitter@71955e74].
  73. 2016-04-11T15:02:37,490 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.metrics.MonitorScheduler.start()] on object[com.metamx.metrics.MonitorScheduler@56c4bee].
  74. 2016-04-11T15:02:37,492 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.http.client.NettyHttpClient.start()] on object[com.metamx.http.client.NettyHttpClient@7725310f].
  75. 2016-04-11T15:02:37,492 INFO [main] io.druid.curator.CuratorModule - Starting Curator
  76. 2016-04-11T15:02:37,492 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Starting
  77. 2016-04-11T15:02:37,504 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
  78. 2016-04-11T15:02:37,505 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:host.name=__HOSTNAME_REPLACED__
  79. 2016-04-11T15:02:37,505 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.7.0_80
  80. 2016-04-11T15:02:37,505 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation
  81. 2016-04-11T15:02:37,505 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jvm/java-7-oracle/jre
  82. 2016-04-11T15:02:37,505 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=config/_common:config/overlord:lib/commons-cli-1.2.jar:lib/aether-connector-file-0.9.0.M2.jar:lib/log4j-1.2-api-2.4.1.jar:lib/plexus-utils-3.0.15.jar:lib/jetty-client-9.2.5.v20141112.jar:lib/druid-indexing-service-0.8.3.jar:lib/druid-server-0.8.3.jar:lib/derby-10.11.1.1.jar:lib/RoaringBitmap-0.5.16.jar:lib/java-xmlbuilder-1.1.jar:lib/aws-java-sdk-sns-1.10.21.jar:lib/aws-java-sdk-codecommit-1.10.21.jar:lib/commons-lang-2.6.jar:lib/jetty-servlets-9.2.5.v20141112.jar:lib/aws-java-sdk-directconnect-1.10.21.jar:lib/javax.servlet-api-3.1.0.jar:lib/jackson-jaxrs-json-provider-2.4.6.jar:lib/compress-lzf-1.0.3.jar:lib/java-util-0.27.4.jar:lib/plexus-interpolation-1.19.jar:lib/wagon-provider-api-2.4.jar:lib/log4j-slf4j-impl-2.4.1.jar:lib/jackson-module-jaxb-annotations-2.4.6.jar:lib/joda-time-2.8.2.jar:lib/derbynet-10.11.1.1.jar:lib/aws-java-sdk-logs-1.10.21.jar:lib/netty-3.10.4.Final.jar:lib/javax.el-api-3.0.0.jar:lib/rhino-1.7R5.jar:lib/log4j-core-2.4.1.jar:lib/commons-io-2.0.1.jar:lib/aopalliance-1.0.jar:lib/druid-common-0.8.3.jar:lib/aws-java-sdk-iam-1.10.21.jar:lib/aws-java-sdk-machinelearning-1.10.21.jar:lib/jsr311-api-1.1.1.jar:lib/druid-api-0.3.13.jar:lib/irc-api-1.0-0014.jar:lib/jackson-core-2.4.6.jar:lib/activation-1.1.1.jar:lib/log4j-jul-2.4.1.jar:lib/aws-java-sdk-storagegateway-1.10.21.jar:lib/aws-java-sdk-1.10.21.jar:lib/jetty-http-9.2.5.v20141112.jar:lib/opencsv-2.3.jar:lib/antlr4-runtime-4.0.jar:lib/base64-2.3.8.jar:lib/jetty-proxy-9.2.5.v20141112.jar:lib/aws-java-sdk-devicefarm-1.10.21.jar:lib/aether-util-0.9.0.M2.jar:lib/aws-java-sdk-cloudfront-1.10.21.jar:lib/aws-java-sdk-route53-1.10.21.jar:lib/icu4j-4.8.1.jar:lib/validation-api-1.1.0.Final.jar:lib/google-http-client-jackson2-1.15.0-rc.jar:lib/airline-0.7.jar:lib/aws-java-sdk-simpledb-1.10.21.jar:lib/annotations-2.0.3.jar:lib/zookeeper-3.4.6.jar:lib/javax.el-3.0.0.jar:lib/log4j-api-2.4.1.jar:lib/jetty-continuation-9.2.5.v20141112.jar:lib/aws-java-sdk-cloudformation-1.10.21.jar:lib/classmate-1.0.0.jar:lib/aws-java-sdk-config-1.10.21.jar:lib/aws-java-sdk-swf-libraries-1.10.21.jar:lib/bcprov-jdk15on-1.52.jar:lib/aws-java-sdk-ssm-1.10.21.jar:lib/aether-impl-0.9.0.M2.jar:lib/geoip2-0.4.0.jar:lib/spymemcached-2.11.7.jar:lib/org.abego.treelayout.core-1.0.1.jar:lib/slf4j-api-1.6.4.jar:lib/aws-java-sdk-ec2-1.10.21.jar:lib/jline-0.9.94.jar:lib/jackson-datatype-joda-2.4.6.jar:lib/aws-java-sdk-cloudwatchmetrics-1.10.21.jar:lib/druid-indexing-hadoop-0.8.3.jar:lib/curator-framework-2.9.1.jar:lib/druid-console-0.0.2.jar:lib/jets3t-0.9.4.jar:lib/curator-x-discovery-2.9.1.jar:lib/emitter-0.3.6.jar:lib/hibernate-validator-5.1.3.Final.jar:lib/aws-java-sdk-cognitosync-1.10.21.jar:lib/aws-java-sdk-emr-1.10.21.jar:lib/xpp3-1.1.4c.jar:lib/aws-java-sdk-cloudhsm-1.10.21.jar:lib/aws-java-sdk-cloudtrail-1.10.21.jar:lib/bytebuffer-collections-0.2.4.jar:lib/jackson-dataformat-smile-2.4.6.jar:lib/aws-java-sdk-ses-1.10.21.jar:lib/jetty-io-9.2.5.v20141112.jar:lib/aws-java-sdk-elastictranscoder-1.10.21.jar:lib/aws-java-sdk-efs-1.10.21.jar:lib/jetty-security-9.2.5.v20141112.jar:lib/commons-codec-1.7.jar:lib/jetty-server-9.2.5.v20141112.jar:lib/guava-16.0.1.jar:lib/javax.inject-1.jar:lib/server-metrics-0.2.8.jar:lib/jackson-annotations-2.4.6.jar:lib/jersey-guice-1.19.jar:lib/aws-java-sdk-support-1.10.21.jar:lib/jersey-core-1.19.jar:lib/jersey-server-1.19.jar:lib/jackson-mapper-asl-1.9.13.jar:lib/aws-java-sdk-sts-1.10.21.jar:lib/lz4-1.3.0.jar:lib/derbyclient-10.11.1.1.jar:lib/aws-java-sdk-redshift-1.10.21.jar:lib/aws-java-sdk-lambda-1.10.21.jar:lib/maven-repository-metadata-3.1.1.jar:lib/aws-java-sdk-dynamodb-1.10.21.jar:lib/aether-connector-okhttp-0.0.9.jar:lib/guice-multibindings-4.0-beta.jar:lib/mapdb-1.0.8.jar:lib/aws-java-sdk-kinesis-1.10.21.jar:lib/httpcore-4.4.3.jar:lib/jackson-jaxrs-smile-provider-2.4.6.jar:lib/aws-java-sdk-importexport-1.10.21.jar:lib/extendedset-1.3.9.jar:lib/guice-4.0-beta.jar:lib/commons-pool2-2.2.jar:lib/protobuf-java-2.5.0.jar:lib/aws-java-sdk-core-1.10.21.jar:lib/maven-aether-provider-3.1.1.jar:lib/google-http-client-1.15.0-rc.jar:lib/aws-java-sdk-codedeploy-1.10.21.jar:lib/aws-java-sdk-cognitoidentity-1.10.21.jar:lib/commons-dbcp2-2.0.1.jar:lib/aether-spi-0.9.0.M2.jar:lib/okhttp-1.0.2.jar:lib/aws-java-sdk-ecs-1.10.21.jar:lib/aws-java-sdk-directory-1.10.21.jar:lib/guice-servlet-4.0-beta.jar:lib/config-magic-0.9.jar:lib/aws-java-sdk-rds-1.10.21.jar:lib/aws-java-sdk-elasticache-1.10.21.jar:lib/tesla-aether-0.0.5.jar:lib/jcl-over-slf4j-1.7.12.jar:lib/aws-java-sdk-datapipeline-1.10.21.jar:lib/aws-java-sdk-workspaces-1.10.21.jar:lib/commons-pool-1.6.jar:lib/aws-java-sdk-cloudsearch-1.10.21.jar:lib/druid-aws-common-0.8.3.jar:lib/maven-model-3.1.1.jar:lib/druid-services-0.8.3.jar:lib/jackson-jaxrs-base-2.4.6.jar:lib/jsr305-2.0.1.jar:lib/maven-settings-builder-3.1.1.jar:lib/druid-processing-0.8.3.jar:lib/aether-api-0.9.0.M2.jar:lib/maven-model-builder-3.1.1.jar:lib/disruptor-3.3.0.jar:lib/aws-java-sdk-s3-1.10.21.jar:lib/jackson-datatype-guava-2.4.6.jar:lib/aws-java-sdk-codepipeline-1.10.21.jar:lib/aws-java-sdk-elasticbeanstalk-1.10.21.jar:lib/jetty-servlet-9.2.5.v20141112.jar:lib/aws-java-sdk-kms-1.10.21.jar:lib/jdbi-2.63.1.jar:lib/aws-java-sdk-simpleworkflow-1.10.21.jar:lib/commons-logging-1.1.1.jar:lib/jackson-databind-2.4.6.jar:lib/maven-settings-3.1.1.jar:lib/aws-java-sdk-cloudwatch-1.10.21.jar:lib/aws-java-sdk-sqs-1.10.21.jar:lib/aws-java-sdk-glacier-1.10.21.jar:lib/aws-java-sdk-autoscaling-1.10.21.jar:lib/aws-java-sdk-opsworks-1.10.21.jar:lib/curator-client-2.9.1.jar:lib/aws-java-sdk-elasticloadbalancing-1.10.21.jar:lib/httpclient-4.5.1.jar:lib/jboss-logging-3.1.3.GA.jar:lib/jackson-core-asl-1.9.13.jar:lib/curator-recipes-2.9.1.jar:lib/jetty-util-9.2.5.v20141112.jar:lib/jersey-servlet-1.19.jar:lib/http-client-1.0.4.jar:lib/maxminddb-0.2.0.jar
  83. 2016-04-11T15:02:37,505 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
  84. 2016-04-11T15:02:37,505 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/data/tmp
  85. 2016-04-11T15:02:37,505 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
  86. 2016-04-11T15:02:37,505 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux
  87. 2016-04-11T15:02:37,505 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
  88. 2016-04-11T15:02:37,505 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.version=3.16.0-0.bpo.4-amd64
  89. 2016-04-11T15:02:37,505 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.name=root
  90. 2016-04-11T15:02:37,505 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.home=/root
  91. 2016-04-11T15:02:37,505 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/opt/druid-0.8.3
  92. 2016-04-11T15:02:37,506 INFO [main] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=30000 watcher=org.apache.curator.ConnectionState@39e7642b
  93. 2016-04-11T15:02:37,524 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@198fec41].
  94. 2016-04-11T15:02:37,528 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
  95. 2016-04-11T15:02:37,534 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
  96. 2016-04-11T15:02:37,562 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x15405c16a6e0005, negotiated timeout = 30000
  97. 2016-04-11T15:02:37,566 INFO [main-EventThread] org.apache.curator.framework.state.ConnectionStateManager - State change: CONNECTED
  98. 2016-04-11T15:02:37,680 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.announcement.Announcer.start()] on object[io.druid.curator.announcement.Announcer@279de0fc].
  99. 2016-04-11T15:02:37,681 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@6e1dd4b5].
  100. 2016-04-11T15:02:37,692 INFO [main] org.eclipse.jetty.server.Server - jetty-9.2.5.v20141112
  101. Apr 11, 2016 3:02:37 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
  102. INFO: Registering com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider as a provider class
  103. Apr 11, 2016 3:02:37 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
  104. INFO: Registering io.druid.server.StatusResource as a root resource class
  105. Apr 11, 2016 3:02:37 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
  106. INFO: Initiating Jersey application, version 'Jersey: 1.19 02/11/2015 03:25 AM'
  107. Apr 11, 2016 3:02:37 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
  108. INFO: Binding com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider to GuiceManagedComponentProvider with the scope "Singleton"
  109. Apr 11, 2016 3:02:38 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
  110. INFO: Binding io.druid.server.QueryResource to GuiceInstantiatedComponentProvider
  111. Apr 11, 2016 3:02:38 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
  112. INFO: Binding io.druid.segment.realtime.firehose.ChatHandlerResource to GuiceInstantiatedComponentProvider
  113. Apr 11, 2016 3:02:38 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
  114. INFO: Binding io.druid.server.StatusResource to GuiceManagedComponentProvider with the scope "Undefined"
  115. 2016-04-11T15:02:38,450 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.s.ServletContextHandler@38467816{/,null,AVAILABLE}
  116. 2016-04-11T15:02:38,460 INFO [main] org.eclipse.jetty.server.ServerConnector - Started ServerConnector@75be5835{HTTP/1.1}{0.0.0.0:8100}
  117. 2016-04-11T15:02:38,461 INFO [main] org.eclipse.jetty.server.Server - Started @6911ms
  118. 2016-04-11T15:02:38,462 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.start()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@6a1adbaf].
  119. 2016-04-11T15:02:38,462 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Announcing self[DruidServerMetadata{name='__HOSTNAME_REPLACED__:8100', host='__HOSTNAME_REPLACED__:8100', maxSize=0, tier='_default_tier', type='indexer-executor', priority='0'}] at [/druid/announcements/__HOSTNAME_REPLACED__:8100]
  120. 2016-04-11T15:02:38,511 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.start() throws java.lang.InterruptedException] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@1773a024].
  121. 2016-04-11T15:02:38,705 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
  122. 2016-04-11T15:02:38,705 INFO [main] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
  123. 2016-04-11T15:02:38,713 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [100000000] for [druid.computation.buffer.size] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()]
  124. 2016-04-11T15:02:38,713 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [1] for [druid.processing.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreads()]
  125. 2016-04-11T15:02:38,713 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]
  126. 2016-04-11T15:02:38,714 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [com.metamx.common.concurrent.ExecutorServiceConfig#getFormatString()]
  127. 2016-04-11T15:02:38,721 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.segment.data.BitmapSerdeFactory] from props[druid.processing.bitmap.] as [ConciseBitmapSerdeFactory{}]
  128. 2016-04-11T15:02:38,761 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Running with task: {
  129. "type" : "index",
  130. "id" : "index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z",
  131. "resource" : {
  132. "availabilityGroup" : "index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z",
  133. "requiredCapacity" : 1
  134. },
  135. "spec" : {
  136. "dataSchema" : {
  137. "dataSource" : "__REPLACED___clean_hits",
  138. "parser" : {
  139. "type" : "string",
  140. "parseSpec" : {
  141. "format" : "json",
  142. "timestampSpec" : {
  143. "column" : "tmst",
  144. "format" : "auto"
  145. },
  146. "dimensionsSpec" : {
  147. "dimensions" : [ "bid", "wid", "crm_provider", "crm_id", "cookie_ok", "c_id", "ad_id", "segs", "type" ],
  148. "dimensionExclusions" : [ ],
  149. "spatialDimensions" : [ ]
  150. }
  151. }
  152. },
  153. "metricsSpec" : [ {
  154. "type" : "count",
  155. "name" : "count"
  156. }, {
  157. "type" : "hyperUnique",
  158. "name" : "unique_bid",
  159. "fieldName" : "bid"
  160. }, {
  161. "type" : "hyperUnique",
  162. "name" : "unique_crm_id",
  163. "fieldName" : "crm_id"
  164. }, {
  165. "type" : "thetaSketch",
  166. "name" : "unique_bid_custom",
  167. "fieldName" : "bid",
  168. "size" : 16384,
  169. "shouldFinalize" : true,
  170. "isInputThetaSketch" : false
  171. } ],
  172. "granularitySpec" : {
  173. "type" : "uniform",
  174. "segmentGranularity" : "DAY",
  175. "queryGranularity" : {
  176. "type" : "none"
  177. },
  178. "intervals" : [ "2016-02-01T00:00:00.000Z/2016-02-02T00:00:00.000Z" ]
  179. }
  180. },
  181. "ioConfig" : {
  182. "type" : "index",
  183. "firehose" : {
  184. "type" : "local",
  185. "baseDir" : "/data/CleanHitSorter_1459936404597",
  186. "filter" : "part-r-00000",
  187. "parser" : null
  188. }
  189. },
  190. "tuningConfig" : {
  191. "type" : "index",
  192. "targetPartitionSize" : 5000000,
  193. "rowFlushBoundary" : 500000,
  194. "numShards" : -1,
  195. "indexSpec" : {
  196. "bitmap" : {
  197. "type" : "concise"
  198. },
  199. "dimensionCompression" : null,
  200. "metricCompression" : null
  201. }
  202. }
  203. },
  204. "context" : null,
  205. "groupId" : "index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z",
  206. "dataSource" : "__REPLACED___clean_hits",
  207. "interval" : "2016-02-01T00:00:00.000Z/2016-02-02T00:00:00.000Z"
  208. }
  209. 2016-04-11T15:02:38,763 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Attempting to lock file[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/lock].
  210. 2016-04-11T15:02:38,765 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Acquired lock file[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/lock] in 2ms.
  211. 2016-04-11T15:02:38,769 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z]: LockTryAcquireAction{interval=2016-02-01T00:00:00.000Z/2016-02-02T00:00:00.000Z}
  212. 2016-04-11T15:02:38,779 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z] to overlord[http://__HOSTNAME_REPLACED__:8090/druid/indexer/v1/action]: LockTryAcquireAction{interval=2016-02-01T00:00:00.000Z/2016-02-02T00:00:00.000Z}
  213. 2016-04-11T15:02:38,795 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  214. 2016-04-11T15:02:38,832 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  215. 2016-04-11T15:02:38,833 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  216. 2016-04-11T15:02:38,834 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  217. 2016-04-11T15:02:38,834 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  218. 2016-04-11T15:02:38,835 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  219. 2016-04-11T15:02:38,836 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  220. 2016-04-11T15:02:38,836 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  221. 2016-04-11T15:02:38,837 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  222. 2016-04-11T15:02:38,838 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  223. 2016-04-11T15:02:38,839 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  224. 2016-04-11T15:02:38,841 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  225. 2016-04-11T15:02:38,841 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  226. 2016-04-11T15:02:38,842 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  227. 2016-04-11T15:02:38,843 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  228. 2016-04-11T15:02:38,843 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  229. 2016-04-11T15:02:38,844 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  230. 2016-04-11T15:02:38,844 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  231. 2016-04-11T15:02:38,845 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  232. 2016-04-11T15:02:38,845 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://__HOSTNAME_REPLACED__:8090
  233. 2016-04-11T15:02:38,932 INFO [task-runner-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Running task: index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z
  234. 2016-04-11T15:02:38,933 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z]: LockListAction{}
  235. 2016-04-11T15:02:38,938 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z] to overlord[http://__HOSTNAME_REPLACED__:8090/druid/indexer/v1/action]: LockListAction{}
  236. 2016-04-11T15:02:38,994 INFO [task-runner-0] io.druid.segment.realtime.firehose.LocalFirehoseFactory - Searching for all [part-r-00000] in and beneath [/data/CleanHitSorter_1459936404597]
  237. 2016-04-11T15:02:39,007 INFO [task-runner-0] io.druid.segment.realtime.firehose.LocalFirehoseFactory - Found files: [/data/CleanHitSorter_1459936404597/part-r-00000]
  238. 2016-04-11T15:02:54,219 INFO [task-runner-0] io.druid.indexing.common.task.IndexTask - Determining partitions for interval[2016-02-01T00:00:00.000Z/2016-02-02T00:00:00.000Z] with targetPartitionSize[5000000]
  239. 2016-04-11T15:02:54,246 INFO [task-runner-0] io.druid.segment.realtime.firehose.LocalFirehoseFactory - Searching for all [part-r-00000] in and beneath [/data/CleanHitSorter_1459936404597]
  240. 2016-04-11T15:02:54,248 INFO [task-runner-0] io.druid.segment.realtime.firehose.LocalFirehoseFactory - Found files: [/data/CleanHitSorter_1459936404597/part-r-00000]
  241. 2016-04-11T15:03:23,316 INFO [task-runner-0] io.druid.indexing.common.task.IndexTask - Estimated approximately [2,874,674.090564] rows of data.
  242. 2016-04-11T15:03:23,316 INFO [task-runner-0] io.druid.indexing.common.task.IndexTask - Will require [1] shard(s).
  243. 2016-04-11T15:03:23,321 INFO [task-runner-0] io.druid.segment.realtime.firehose.LocalFirehoseFactory - Searching for all [part-r-00000] in and beneath [/data/CleanHitSorter_1459936404597]
  244. 2016-04-11T15:03:23,323 INFO [task-runner-0] io.druid.segment.realtime.firehose.LocalFirehoseFactory - Found files: [/data/CleanHitSorter_1459936404597/part-r-00000]
  245. 2016-04-11T15:03:41,735 INFO [task-runner-0] io.druid.indexing.common.index.YeOldePlumberSchool - Spilling index[0] with rows[500000] to: /tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill0
  246. 2016-04-11T15:03:41,742 INFO [task-runner-0] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
  247. 2016-04-11T15:03:41,742 INFO [task-runner-0] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
  248. 2016-04-11T15:03:41,750 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting persist for interval[2016-02-01T00:00:00.000Z/2016-02-01T08:46:32.793Z], rows[500,000]
  249. 2016-04-11T15:03:42,960 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill0/v8-tmp] completed index.drd in 6 millis.
  250. 2016-04-11T15:03:43,590 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill0/v8-tmp] completed dim conversions in 629 millis.
  251. 2016-04-11T15:03:55,314 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill0/v8-tmp] walked 500,000/500,000 rows in 11,685 millis.
  252. 2016-04-11T15:03:55,708 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill0/v8-tmp] completed walk through of 500,000 rows in 12,118 millis.
  253. 2016-04-11T15:03:55,711 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[ad_id] with cardinality[173]
  254. 2016-04-11T15:03:56,011 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[ad_id] in 302 millis.
  255. 2016-04-11T15:03:56,012 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[bid] with cardinality[184,468]
  256. 2016-04-11T15:03:56,939 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[bid] in 928 millis.
  257. 2016-04-11T15:03:56,940 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[c_id] with cardinality[58]
  258. 2016-04-11T15:03:57,010 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[c_id] in 70 millis.
  259. 2016-04-11T15:03:57,010 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[cookie_ok] with cardinality[0]
  260. 2016-04-11T15:03:57,011 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[cookie_ok] in 1 millis.
  261. 2016-04-11T15:03:57,012 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[crm_id] with cardinality[0]
  262. 2016-04-11T15:03:57,013 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[crm_id] in 2 millis.
  263. 2016-04-11T15:03:57,013 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[crm_provider] with cardinality[0]
  264. 2016-04-11T15:03:57,015 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[crm_provider] in 2 millis.
  265. 2016-04-11T15:03:57,015 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[segs] with cardinality[493]
  266. 2016-04-11T15:03:57,519 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[segs] in 504 millis.
  267. 2016-04-11T15:03:57,520 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[type] with cardinality[2]
  268. 2016-04-11T15:03:57,585 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[type] in 65 millis.
  269. 2016-04-11T15:03:57,585 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[wid] with cardinality[17]
  270. 2016-04-11T15:03:57,657 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[wid] in 71 millis.
  271. 2016-04-11T15:03:57,657 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill0/v8-tmp] completed inverted.drd in 1,948 millis.
  272. 2016-04-11T15:03:57,766 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Converting v8[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill0/v8-tmp] to v9[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill0]
  273. 2016-04-11T15:03:57,769 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_ad_id.drd]
  274. 2016-04-11T15:03:57,827 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] is single value, converting...
  275. 2016-04-11T15:03:57,827 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] has null rows.
  276. 2016-04-11T15:03:58,116 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_bid.drd]
  277. 2016-04-11T15:03:58,197 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[bid] is single value, converting...
  278. 2016-04-11T15:03:58,311 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_c_id.drd]
  279. 2016-04-11T15:03:58,328 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[c_id] is single value, converting...
  280. 2016-04-11T15:03:58,449 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_cookie_ok.drd]
  281. 2016-04-11T15:03:58,449 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[cookie_ok] had cardinality 0, equivalent to no column, so skipping.
  282. 2016-04-11T15:03:58,449 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_crm_id.drd]
  283. 2016-04-11T15:03:58,450 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[crm_id] had cardinality 0, equivalent to no column, so skipping.
  284. 2016-04-11T15:03:58,450 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_crm_provider.drd]
  285. 2016-04-11T15:03:58,450 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[crm_provider] had cardinality 0, equivalent to no column, so skipping.
  286. 2016-04-11T15:03:58,450 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_segs.drd]
  287. 2016-04-11T15:03:59,255 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_type.drd]
  288. 2016-04-11T15:03:59,329 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[type] is single value, converting...
  289. 2016-04-11T15:03:59,453 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_wid.drd]
  290. 2016-04-11T15:03:59,469 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[wid] is single value, converting...
  291. 2016-04-11T15:03:59,640 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[index.drd]
  292. 2016-04-11T15:03:59,640 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[inverted.drd]
  293. 2016-04-11T15:03:59,640 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_count_LITTLE_ENDIAN.drd]
  294. 2016-04-11T15:03:59,645 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_LITTLE_ENDIAN.drd]
  295. 2016-04-11T15:03:59,652 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_custom_LITTLE_ENDIAN.drd]
  296. 2016-04-11T15:03:59,664 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_crm_id_LITTLE_ENDIAN.drd]
  297. 2016-04-11T15:03:59,670 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[spatial.drd]
  298. 2016-04-11T15:03:59,670 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[time_LITTLE_ENDIAN.drd]
  299. 2016-04-11T15:03:59,675 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Skipped files[[index.drd, inverted.drd, spatial.drd]]
  300. 2016-04-11T15:03:59,675 INFO [task-runner-0] io.druid.segment.ReferenceCountingSegment - Closing __REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z
  301. 2016-04-11T15:03:59,676 INFO [task-runner-0] io.druid.segment.ReferenceCountingSegment - Closing __REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z, numReferences: 0
  302. 2016-04-11T15:04:13,771 INFO [task-runner-0] io.druid.indexing.common.index.YeOldePlumberSchool - Spilling index[1] with rows[500000] to: /tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill1
  303. 2016-04-11T15:04:13,771 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting persist for interval[2016-02-01T00:00:00.000Z/2016-02-01T11:30:52.331Z], rows[500,000]
  304. 2016-04-11T15:04:14,666 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill1/v8-tmp] completed index.drd in 1 millis.
  305. 2016-04-11T15:04:15,649 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill1/v8-tmp] completed dim conversions in 983 millis.
  306. 2016-04-11T15:04:24,713 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill1/v8-tmp] walked 500,000/500,000 rows in 9,059 millis.
  307. 2016-04-11T15:04:25,097 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill1/v8-tmp] completed walk through of 500,000 rows in 9,448 millis.
  308. 2016-04-11T15:04:25,098 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[ad_id] with cardinality[137]
  309. 2016-04-11T15:04:25,289 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[ad_id] in 191 millis.
  310. 2016-04-11T15:04:25,290 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[bid] with cardinality[230,853]
  311. 2016-04-11T15:04:26,413 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[bid] in 1,124 millis.
  312. 2016-04-11T15:04:26,414 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[c_id] with cardinality[44]
  313. 2016-04-11T15:04:26,590 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[c_id] in 177 millis.
  314. 2016-04-11T15:04:26,590 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[cookie_ok] with cardinality[0]
  315. 2016-04-11T15:04:26,592 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[cookie_ok] in 2 millis.
  316. 2016-04-11T15:04:26,592 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[crm_id] with cardinality[0]
  317. 2016-04-11T15:04:26,594 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[crm_id] in 2 millis.
  318. 2016-04-11T15:04:26,594 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[crm_provider] with cardinality[0]
  319. 2016-04-11T15:04:26,596 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[crm_provider] in 2 millis.
  320. 2016-04-11T15:04:26,596 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[segs] with cardinality[456]
  321. 2016-04-11T15:04:27,437 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[segs] in 841 millis.
  322. 2016-04-11T15:04:27,438 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[type] with cardinality[2]
  323. 2016-04-11T15:04:27,485 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[type] in 48 millis.
  324. 2016-04-11T15:04:27,486 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[wid] with cardinality[11]
  325. 2016-04-11T15:04:27,543 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[wid] in 58 millis.
  326. 2016-04-11T15:04:27,544 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill1/v8-tmp] completed inverted.drd in 2,446 millis.
  327. 2016-04-11T15:04:27,613 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Converting v8[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill1/v8-tmp] to v9[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill1]
  328. 2016-04-11T15:04:27,614 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_ad_id.drd]
  329. 2016-04-11T15:04:27,693 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] is single value, converting...
  330. 2016-04-11T15:04:27,693 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] has null rows.
  331. 2016-04-11T15:04:27,806 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_bid.drd]
  332. 2016-04-11T15:04:27,882 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[bid] is single value, converting...
  333. 2016-04-11T15:04:27,984 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_c_id.drd]
  334. 2016-04-11T15:04:28,000 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[c_id] is single value, converting...
  335. 2016-04-11T15:04:28,072 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_cookie_ok.drd]
  336. 2016-04-11T15:04:28,072 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[cookie_ok] had cardinality 0, equivalent to no column, so skipping.
  337. 2016-04-11T15:04:28,072 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_crm_id.drd]
  338. 2016-04-11T15:04:28,072 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[crm_id] had cardinality 0, equivalent to no column, so skipping.
  339. 2016-04-11T15:04:28,073 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_crm_provider.drd]
  340. 2016-04-11T15:04:28,073 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[crm_provider] had cardinality 0, equivalent to no column, so skipping.
  341. 2016-04-11T15:04:28,073 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_segs.drd]
  342. 2016-04-11T15:04:28,810 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_type.drd]
  343. 2016-04-11T15:04:28,826 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[type] is single value, converting...
  344. 2016-04-11T15:04:28,948 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_wid.drd]
  345. 2016-04-11T15:04:28,963 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[wid] is single value, converting...
  346. 2016-04-11T15:04:29,162 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[index.drd]
  347. 2016-04-11T15:04:29,162 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[inverted.drd]
  348. 2016-04-11T15:04:29,162 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_count_LITTLE_ENDIAN.drd]
  349. 2016-04-11T15:04:29,163 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_LITTLE_ENDIAN.drd]
  350. 2016-04-11T15:04:29,170 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_custom_LITTLE_ENDIAN.drd]
  351. 2016-04-11T15:04:29,182 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_crm_id_LITTLE_ENDIAN.drd]
  352. 2016-04-11T15:04:29,187 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[spatial.drd]
  353. 2016-04-11T15:04:29,188 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[time_LITTLE_ENDIAN.drd]
  354. 2016-04-11T15:04:29,191 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Skipped files[[index.drd, inverted.drd, spatial.drd]]
  355. 2016-04-11T15:04:29,191 INFO [task-runner-0] io.druid.segment.ReferenceCountingSegment - Closing __REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z
  356. 2016-04-11T15:04:29,192 INFO [task-runner-0] io.druid.segment.ReferenceCountingSegment - Closing __REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z, numReferences: 0
  357. 2016-04-11T15:04:41,306 INFO [task-runner-0] io.druid.indexing.common.index.YeOldePlumberSchool - Spilling index[2] with rows[500000] to: /tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill2
  358. 2016-04-11T15:04:41,306 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting persist for interval[2016-02-01T00:00:00.000Z/2016-02-01T14:28:11.657Z], rows[500,000]
  359. 2016-04-11T15:04:42,048 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill2/v8-tmp] completed index.drd in 1 millis.
  360. 2016-04-11T15:04:42,638 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill2/v8-tmp] completed dim conversions in 590 millis.
  361. 2016-04-11T15:04:53,360 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill2/v8-tmp] walked 500,000/500,000 rows in 10,718 millis.
  362. 2016-04-11T15:04:53,743 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill2/v8-tmp] completed walk through of 500,000 rows in 11,104 millis.
  363. 2016-04-11T15:04:53,744 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[ad_id] with cardinality[142]
  364. 2016-04-11T15:04:53,841 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[ad_id] in 97 millis.
  365. 2016-04-11T15:04:53,841 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[bid] with cardinality[230,794]
  366. 2016-04-11T15:04:54,441 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[bid] in 599 millis.
  367. 2016-04-11T15:04:54,441 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[c_id] with cardinality[47]
  368. 2016-04-11T15:04:54,523 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[c_id] in 82 millis.
  369. 2016-04-11T15:04:54,524 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[cookie_ok] with cardinality[0]
  370. 2016-04-11T15:04:54,525 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[cookie_ok] in 2 millis.
  371. 2016-04-11T15:04:54,525 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[crm_id] with cardinality[0]
  372. 2016-04-11T15:04:54,527 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[crm_id] in 2 millis.
  373. 2016-04-11T15:04:54,527 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[crm_provider] with cardinality[0]
  374. 2016-04-11T15:04:54,529 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[crm_provider] in 1 millis.
  375. 2016-04-11T15:04:54,529 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[segs] with cardinality[488]
  376. 2016-04-11T15:04:54,941 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[segs] in 411 millis.
  377. 2016-04-11T15:04:54,941 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[type] with cardinality[2]
  378. 2016-04-11T15:04:54,991 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[type] in 50 millis.
  379. 2016-04-11T15:04:54,992 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[wid] with cardinality[12]
  380. 2016-04-11T15:04:55,050 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[wid] in 58 millis.
  381. 2016-04-11T15:04:55,050 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill2/v8-tmp] completed inverted.drd in 1,307 millis.
  382. 2016-04-11T15:04:55,115 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Converting v8[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill2/v8-tmp] to v9[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill2]
  383. 2016-04-11T15:04:55,116 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_ad_id.drd]
  384. 2016-04-11T15:04:55,147 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] is single value, converting...
  385. 2016-04-11T15:04:55,148 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] has null rows.
  386. 2016-04-11T15:04:55,231 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_bid.drd]
  387. 2016-04-11T15:04:55,247 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[bid] is single value, converting...
  388. 2016-04-11T15:04:55,352 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_c_id.drd]
  389. 2016-04-11T15:04:55,368 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[c_id] is single value, converting...
  390. 2016-04-11T15:04:55,440 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_cookie_ok.drd]
  391. 2016-04-11T15:04:55,440 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[cookie_ok] had cardinality 0, equivalent to no column, so skipping.
  392. 2016-04-11T15:04:55,440 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_crm_id.drd]
  393. 2016-04-11T15:04:55,441 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[crm_id] had cardinality 0, equivalent to no column, so skipping.
  394. 2016-04-11T15:04:55,441 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_crm_provider.drd]
  395. 2016-04-11T15:04:55,441 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[crm_provider] had cardinality 0, equivalent to no column, so skipping.
  396. 2016-04-11T15:04:55,441 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_segs.drd]
  397. 2016-04-11T15:04:56,172 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_type.drd]
  398. 2016-04-11T15:04:56,188 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[type] is single value, converting...
  399. 2016-04-11T15:04:56,278 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_wid.drd]
  400. 2016-04-11T15:04:56,293 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[wid] is single value, converting...
  401. 2016-04-11T15:04:56,495 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[index.drd]
  402. 2016-04-11T15:04:56,495 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[inverted.drd]
  403. 2016-04-11T15:04:56,495 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_count_LITTLE_ENDIAN.drd]
  404. 2016-04-11T15:04:56,496 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_LITTLE_ENDIAN.drd]
  405. 2016-04-11T15:04:56,504 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_custom_LITTLE_ENDIAN.drd]
  406. 2016-04-11T15:04:56,517 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_crm_id_LITTLE_ENDIAN.drd]
  407. 2016-04-11T15:04:56,523 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[spatial.drd]
  408. 2016-04-11T15:04:56,524 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[time_LITTLE_ENDIAN.drd]
  409. 2016-04-11T15:04:56,527 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Skipped files[[index.drd, inverted.drd, spatial.drd]]
  410. 2016-04-11T15:04:56,528 INFO [task-runner-0] io.druid.segment.ReferenceCountingSegment - Closing __REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z
  411. 2016-04-11T15:04:56,528 INFO [task-runner-0] io.druid.segment.ReferenceCountingSegment - Closing __REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z, numReferences: 0
  412. 2016-04-11T15:05:08,923 INFO [task-runner-0] io.druid.indexing.common.index.YeOldePlumberSchool - Spilling index[3] with rows[500000] to: /tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill3
  413. 2016-04-11T15:05:08,924 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting persist for interval[2016-02-01T00:00:00.000Z/2016-02-01T17:29:10.258Z], rows[500,000]
  414. 2016-04-11T15:05:09,643 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill3/v8-tmp] completed index.drd in 1 millis.
  415. 2016-04-11T15:05:10,251 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill3/v8-tmp] completed dim conversions in 608 millis.
  416. 2016-04-11T15:05:19,228 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill3/v8-tmp] walked 500,000/500,000 rows in 8,972 millis.
  417. 2016-04-11T15:05:19,659 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill3/v8-tmp] completed walk through of 500,000 rows in 9,407 millis.
  418. 2016-04-11T15:05:19,660 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[ad_id] with cardinality[155]
  419. 2016-04-11T15:05:19,766 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[ad_id] in 107 millis.
  420. 2016-04-11T15:05:19,767 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[bid] with cardinality[233,531]
  421. 2016-04-11T15:05:20,382 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[bid] in 616 millis.
  422. 2016-04-11T15:05:20,383 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[c_id] with cardinality[53]
  423. 2016-04-11T15:05:20,462 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[c_id] in 79 millis.
  424. 2016-04-11T15:05:20,462 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[cookie_ok] with cardinality[0]
  425. 2016-04-11T15:05:20,464 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[cookie_ok] in 1 millis.
  426. 2016-04-11T15:05:20,464 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[crm_id] with cardinality[0]
  427. 2016-04-11T15:05:20,465 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[crm_id] in 1 millis.
  428. 2016-04-11T15:05:20,466 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[crm_provider] with cardinality[0]
  429. 2016-04-11T15:05:20,467 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[crm_provider] in 2 millis.
  430. 2016-04-11T15:05:20,467 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[segs] with cardinality[477]
  431. 2016-04-11T15:05:20,893 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[segs] in 426 millis.
  432. 2016-04-11T15:05:20,894 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[type] with cardinality[2]
  433. 2016-04-11T15:05:20,941 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[type] in 47 millis.
  434. 2016-04-11T15:05:20,941 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[wid] with cardinality[12]
  435. 2016-04-11T15:05:20,996 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[wid] in 55 millis.
  436. 2016-04-11T15:05:20,996 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill3/v8-tmp] completed inverted.drd in 1,337 millis.
  437. 2016-04-11T15:05:21,095 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Converting v8[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill3/v8-tmp] to v9[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill3]
  438. 2016-04-11T15:05:21,096 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_ad_id.drd]
  439. 2016-04-11T15:05:21,114 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] is single value, converting...
  440. 2016-04-11T15:05:21,114 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] has null rows.
  441. 2016-04-11T15:05:21,198 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_bid.drd]
  442. 2016-04-11T15:05:21,214 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[bid] is single value, converting...
  443. 2016-04-11T15:05:21,337 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_c_id.drd]
  444. 2016-04-11T15:05:21,354 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[c_id] is single value, converting...
  445. 2016-04-11T15:05:21,429 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_cookie_ok.drd]
  446. 2016-04-11T15:05:21,430 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[cookie_ok] had cardinality 0, equivalent to no column, so skipping.
  447. 2016-04-11T15:05:21,430 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_crm_id.drd]
  448. 2016-04-11T15:05:21,430 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[crm_id] had cardinality 0, equivalent to no column, so skipping.
  449. 2016-04-11T15:05:21,430 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_crm_provider.drd]
  450. 2016-04-11T15:05:21,430 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[crm_provider] had cardinality 0, equivalent to no column, so skipping.
  451. 2016-04-11T15:05:21,430 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_segs.drd]
  452. 2016-04-11T15:05:22,075 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_type.drd]
  453. 2016-04-11T15:05:22,093 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[type] is single value, converting...
  454. 2016-04-11T15:05:22,184 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_wid.drd]
  455. 2016-04-11T15:05:22,216 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[wid] is single value, converting...
  456. 2016-04-11T15:05:22,396 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[index.drd]
  457. 2016-04-11T15:05:22,397 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[inverted.drd]
  458. 2016-04-11T15:05:22,397 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_count_LITTLE_ENDIAN.drd]
  459. 2016-04-11T15:05:22,397 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_LITTLE_ENDIAN.drd]
  460. 2016-04-11T15:05:22,404 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_custom_LITTLE_ENDIAN.drd]
  461. 2016-04-11T15:05:22,416 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_crm_id_LITTLE_ENDIAN.drd]
  462. 2016-04-11T15:05:22,423 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[spatial.drd]
  463. 2016-04-11T15:05:22,423 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[time_LITTLE_ENDIAN.drd]
  464. 2016-04-11T15:05:22,426 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Skipped files[[index.drd, inverted.drd, spatial.drd]]
  465. 2016-04-11T15:05:22,426 INFO [task-runner-0] io.druid.segment.ReferenceCountingSegment - Closing __REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z
  466. 2016-04-11T15:05:22,427 INFO [task-runner-0] io.druid.segment.ReferenceCountingSegment - Closing __REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z, numReferences: 0
  467. 2016-04-11T15:05:36,167 INFO [task-runner-0] io.druid.indexing.common.index.YeOldePlumberSchool - Spilling index[4] with rows[500000] to: /tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill4
  468. 2016-04-11T15:05:36,168 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting persist for interval[2016-02-01T00:00:00.000Z/2016-02-01T19:42:14.391Z], rows[500,000]
  469. 2016-04-11T15:05:36,916 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill4/v8-tmp] completed index.drd in 1 millis.
  470. 2016-04-11T15:05:37,578 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill4/v8-tmp] completed dim conversions in 661 millis.
  471. 2016-04-11T15:05:46,378 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill4/v8-tmp] walked 500,000/500,000 rows in 8,795 millis.
  472. 2016-04-11T15:05:46,752 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill4/v8-tmp] completed walk through of 500,000 rows in 9,173 millis.
  473. 2016-04-11T15:05:46,752 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[ad_id] with cardinality[148]
  474. 2016-04-11T15:05:46,837 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[ad_id] in 85 millis.
  475. 2016-04-11T15:05:46,838 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[bid] with cardinality[259,046]
  476. 2016-04-11T15:05:47,459 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[bid] in 622 millis.
  477. 2016-04-11T15:05:47,460 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[c_id] with cardinality[51]
  478. 2016-04-11T15:05:47,533 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[c_id] in 74 millis.
  479. 2016-04-11T15:05:47,534 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[cookie_ok] with cardinality[0]
  480. 2016-04-11T15:05:47,535 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[cookie_ok] in 2 millis.
  481. 2016-04-11T15:05:47,535 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[crm_id] with cardinality[0]
  482. 2016-04-11T15:05:47,537 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[crm_id] in 1 millis.
  483. 2016-04-11T15:05:47,537 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[crm_provider] with cardinality[0]
  484. 2016-04-11T15:05:47,538 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[crm_provider] in 1 millis.
  485. 2016-04-11T15:05:47,539 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[segs] with cardinality[331]
  486. 2016-04-11T15:05:48,051 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[segs] in 512 millis.
  487. 2016-04-11T15:05:48,051 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[type] with cardinality[2]
  488. 2016-04-11T15:05:48,131 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[type] in 79 millis.
  489. 2016-04-11T15:05:48,131 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[wid] with cardinality[13]
  490. 2016-04-11T15:05:48,222 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[wid] in 91 millis.
  491. 2016-04-11T15:05:48,222 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill4/v8-tmp] completed inverted.drd in 1,470 millis.
  492. 2016-04-11T15:05:48,305 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Converting v8[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill4/v8-tmp] to v9[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill4]
  493. 2016-04-11T15:05:48,306 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_ad_id.drd]
  494. 2016-04-11T15:05:48,322 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] is single value, converting...
  495. 2016-04-11T15:05:48,323 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] has null rows.
  496. 2016-04-11T15:05:48,403 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_bid.drd]
  497. 2016-04-11T15:05:48,418 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[bid] is single value, converting...
  498. 2016-04-11T15:05:48,536 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_c_id.drd]
  499. 2016-04-11T15:05:48,552 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[c_id] is single value, converting...
  500. 2016-04-11T15:05:48,632 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_cookie_ok.drd]
  501. 2016-04-11T15:05:48,632 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[cookie_ok] had cardinality 0, equivalent to no column, so skipping.
  502. 2016-04-11T15:05:48,632 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_crm_id.drd]
  503. 2016-04-11T15:05:48,632 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[crm_id] had cardinality 0, equivalent to no column, so skipping.
  504. 2016-04-11T15:05:48,632 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_crm_provider.drd]
  505. 2016-04-11T15:05:48,632 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[crm_provider] had cardinality 0, equivalent to no column, so skipping.
  506. 2016-04-11T15:05:48,632 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_segs.drd]
  507. 2016-04-11T15:05:49,199 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_type.drd]
  508. 2016-04-11T15:05:49,215 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[type] is single value, converting...
  509. 2016-04-11T15:05:49,310 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_wid.drd]
  510. 2016-04-11T15:05:49,326 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[wid] is single value, converting...
  511. 2016-04-11T15:05:49,540 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[index.drd]
  512. 2016-04-11T15:05:49,540 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[inverted.drd]
  513. 2016-04-11T15:05:49,541 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_count_LITTLE_ENDIAN.drd]
  514. 2016-04-11T15:05:49,541 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_LITTLE_ENDIAN.drd]
  515. 2016-04-11T15:05:49,547 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_custom_LITTLE_ENDIAN.drd]
  516. 2016-04-11T15:05:49,560 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_crm_id_LITTLE_ENDIAN.drd]
  517. 2016-04-11T15:05:49,566 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[spatial.drd]
  518. 2016-04-11T15:05:49,567 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[time_LITTLE_ENDIAN.drd]
  519. 2016-04-11T15:05:49,569 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Skipped files[[index.drd, inverted.drd, spatial.drd]]
  520. 2016-04-11T15:05:49,570 INFO [task-runner-0] io.druid.segment.ReferenceCountingSegment - Closing __REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z
  521. 2016-04-11T15:05:49,570 INFO [task-runner-0] io.druid.segment.ReferenceCountingSegment - Closing __REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z, numReferences: 0
  522. 2016-04-11T15:06:02,182 INFO [task-runner-0] io.druid.indexing.common.index.YeOldePlumberSchool - Spilling index[5] with rows[492289] to: /tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill5
  523. 2016-04-11T15:06:02,182 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting persist for interval[2016-02-01T00:00:00.000Z/2016-02-01T21:44:59.948Z], rows[492,289]
  524. 2016-04-11T15:06:02,902 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill5/v8-tmp] completed index.drd in 1 millis.
  525. 2016-04-11T15:06:03,594 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill5/v8-tmp] completed dim conversions in 692 millis.
  526. 2016-04-11T15:06:12,564 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill5/v8-tmp] completed walk through of 492,289 rows in 8,969 millis.
  527. 2016-04-11T15:06:12,565 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[ad_id] with cardinality[139]
  528. 2016-04-11T15:06:12,644 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[ad_id] in 80 millis.
  529. 2016-04-11T15:06:12,644 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[bid] with cardinality[253,498]
  530. 2016-04-11T15:06:13,251 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[bid] in 607 millis.
  531. 2016-04-11T15:06:13,252 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[c_id] with cardinality[48]
  532. 2016-04-11T15:06:13,329 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[c_id] in 76 millis.
  533. 2016-04-11T15:06:13,329 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[cookie_ok] with cardinality[0]
  534. 2016-04-11T15:06:13,331 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[cookie_ok] in 1 millis.
  535. 2016-04-11T15:06:13,331 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[crm_id] with cardinality[0]
  536. 2016-04-11T15:06:13,332 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[crm_id] in 1 millis.
  537. 2016-04-11T15:06:13,333 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[crm_provider] with cardinality[0]
  538. 2016-04-11T15:06:13,334 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[crm_provider] in 2 millis.
  539. 2016-04-11T15:06:13,334 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[segs] with cardinality[359]
  540. 2016-04-11T15:06:13,691 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[segs] in 357 millis.
  541. 2016-04-11T15:06:13,692 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[type] with cardinality[2]
  542. 2016-04-11T15:06:13,742 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[type] in 51 millis.
  543. 2016-04-11T15:06:13,743 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[wid] with cardinality[10]
  544. 2016-04-11T15:06:13,804 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[wid] in 62 millis.
  545. 2016-04-11T15:06:13,804 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill5/v8-tmp] completed inverted.drd in 1,240 millis.
  546. 2016-04-11T15:06:13,904 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Converting v8[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill5/v8-tmp] to v9[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z/spill5]
  547. 2016-04-11T15:06:13,905 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_ad_id.drd]
  548. 2016-04-11T15:06:13,921 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] is single value, converting...
  549. 2016-04-11T15:06:13,921 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] has null rows.
  550. 2016-04-11T15:06:14,020 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_bid.drd]
  551. 2016-04-11T15:06:14,038 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[bid] is single value, converting...
  552. 2016-04-11T15:06:14,148 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_c_id.drd]
  553. 2016-04-11T15:06:14,162 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[c_id] is single value, converting...
  554. 2016-04-11T15:06:14,252 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_cookie_ok.drd]
  555. 2016-04-11T15:06:14,252 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[cookie_ok] had cardinality 0, equivalent to no column, so skipping.
  556. 2016-04-11T15:06:14,253 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_crm_id.drd]
  557. 2016-04-11T15:06:14,253 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[crm_id] had cardinality 0, equivalent to no column, so skipping.
  558. 2016-04-11T15:06:14,253 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_crm_provider.drd]
  559. 2016-04-11T15:06:14,253 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[crm_provider] had cardinality 0, equivalent to no column, so skipping.
  560. 2016-04-11T15:06:14,253 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_segs.drd]
  561. 2016-04-11T15:06:14,826 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_type.drd]
  562. 2016-04-11T15:06:14,842 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[type] is single value, converting...
  563. 2016-04-11T15:06:14,937 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_wid.drd]
  564. 2016-04-11T15:06:14,952 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[wid] is single value, converting...
  565. 2016-04-11T15:06:15,170 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[index.drd]
  566. 2016-04-11T15:06:15,170 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[inverted.drd]
  567. 2016-04-11T15:06:15,170 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_count_LITTLE_ENDIAN.drd]
  568. 2016-04-11T15:06:15,170 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_LITTLE_ENDIAN.drd]
  569. 2016-04-11T15:06:15,177 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_custom_LITTLE_ENDIAN.drd]
  570. 2016-04-11T15:06:15,189 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_crm_id_LITTLE_ENDIAN.drd]
  571. 2016-04-11T15:06:15,194 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[spatial.drd]
  572. 2016-04-11T15:06:15,194 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[time_LITTLE_ENDIAN.drd]
  573. 2016-04-11T15:06:15,197 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Skipped files[[index.drd, inverted.drd, spatial.drd]]
  574. 2016-04-11T15:06:15,197 INFO [task-runner-0] io.druid.segment.ReferenceCountingSegment - Closing __REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z
  575. 2016-04-11T15:06:15,197 INFO [task-runner-0] io.druid.segment.ReferenceCountingSegment - Closing __REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z, numReferences: 0
  576. 2016-04-11T15:06:15,254 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/merged/v8-tmp] completed index.drd in 1 millis.
  577. 2016-04-11T15:06:17,424 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/merged/v8-tmp] completed dim conversions in 2,170 millis.
  578. 2016-04-11T15:06:17,438 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[1]
  579. 2016-04-11T15:06:17,440 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[2]
  580. 2016-04-11T15:06:17,440 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[3]
  581. 2016-04-11T15:06:17,441 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[4]
  582. 2016-04-11T15:06:17,442 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[5]
  583. 2016-04-11T15:06:17,443 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[6]
  584. 2016-04-11T15:06:17,443 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[7]
  585. 2016-04-11T15:06:17,443 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[8]
  586. 2016-04-11T15:06:17,445 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[9]
  587. 2016-04-11T15:06:17,445 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[10]
  588. 2016-04-11T15:06:17,446 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[11]
  589. 2016-04-11T15:06:17,446 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[12]
  590. 2016-04-11T15:06:17,446 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[13]
  591. 2016-04-11T15:06:17,447 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[14]
  592. 2016-04-11T15:06:17,447 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[15]
  593. 2016-04-11T15:06:17,447 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[16]
  594. 2016-04-11T15:06:17,447 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[17]
  595. 2016-04-11T15:06:17,448 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[18]
  596. 2016-04-11T15:06:17,449 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[19]
  597. 2016-04-11T15:06:17,449 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[20]
  598. 2016-04-11T15:06:17,449 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[21]
  599. 2016-04-11T15:06:17,449 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[22]
  600. 2016-04-11T15:06:17,450 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[23]
  601. 2016-04-11T15:06:17,450 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[24]
  602. 2016-04-11T15:06:17,450 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[25]
  603. 2016-04-11T15:06:17,450 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[26]
  604. 2016-04-11T15:06:17,451 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[27]
  605. 2016-04-11T15:06:17,451 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[28]
  606. 2016-04-11T15:06:17,451 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[29]
  607. 2016-04-11T15:06:17,451 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[30]
  608. 2016-04-11T15:06:17,452 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[31]
  609. 2016-04-11T15:06:17,452 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[32]
  610. 2016-04-11T15:06:17,452 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[33]
  611. 2016-04-11T15:06:17,452 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[34]
  612. 2016-04-11T15:06:17,453 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[35]
  613. 2016-04-11T15:06:17,453 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[36]
  614. 2016-04-11T15:06:17,453 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[37]
  615. 2016-04-11T15:06:17,453 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[38]
  616. 2016-04-11T15:06:17,454 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[39]
  617. 2016-04-11T15:06:17,454 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[40]
  618. 2016-04-11T15:06:17,454 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[41]
  619. 2016-04-11T15:06:17,454 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[42]
  620. 2016-04-11T15:06:17,454 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[43]
  621. 2016-04-11T15:06:17,455 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[44]
  622. 2016-04-11T15:06:17,455 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[45]
  623. 2016-04-11T15:06:17,455 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[46]
  624. 2016-04-11T15:06:17,455 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[47]
  625. 2016-04-11T15:06:17,456 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[48]
  626. 2016-04-11T15:06:17,456 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[49]
  627. 2016-04-11T15:06:17,456 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[50]
  628. 2016-04-11T15:06:17,456 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[51]
  629. 2016-04-11T15:06:17,457 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[52]
  630. 2016-04-11T15:06:17,457 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[53]
  631. 2016-04-11T15:06:22,032 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/merged/v8-tmp] walked 500,000/500,000 rows in 4,603 millis.
  632. 2016-04-11T15:06:24,918 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/merged/v8-tmp] walked 500,000/1,000,000 rows in 2,885 millis.
  633. 2016-04-11T15:06:27,240 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/merged/v8-tmp] walked 500,000/1,500,000 rows in 2,321 millis.
  634. 2016-04-11T15:06:29,443 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/merged/v8-tmp] walked 500,000/2,000,000 rows in 2,202 millis.
  635. 2016-04-11T15:06:31,529 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/merged/v8-tmp] walked 500,000/2,500,000 rows in 2,085 millis.
  636. 2016-04-11T15:06:35,983 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/merged/v8-tmp] completed walk through of 2,992,289 rows in 18,558 millis.
  637. 2016-04-11T15:06:35,984 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[ad_id] with cardinality[209]
  638. 2016-04-11T15:06:37,370 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[ad_id] in 1,385 millis.
  639. 2016-04-11T15:06:37,370 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[bid] with cardinality[1,265,942]
  640. 2016-04-11T15:06:41,121 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[bid] in 3,750 millis.
  641. 2016-04-11T15:06:41,121 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[c_id] with cardinality[75]
  642. 2016-04-11T15:06:41,735 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[c_id] in 613 millis.
  643. 2016-04-11T15:06:41,735 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[segs] with cardinality[710]
  644. 2016-04-11T15:06:45,232 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[segs] in 3,497 millis.
  645. 2016-04-11T15:06:45,232 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[type] with cardinality[2]
  646. 2016-04-11T15:06:45,655 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[type] in 422 millis.
  647. 2016-04-11T15:06:45,655 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[wid] with cardinality[24]
  648. 2016-04-11T15:06:46,133 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[wid] in 478 millis.
  649. 2016-04-11T15:06:46,133 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/merged/v8-tmp] completed inverted.drd in 10,150 millis.
  650. 2016-04-11T15:06:46,587 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Converting v8[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/merged/v8-tmp] to v9[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/merged]
  651. 2016-04-11T15:06:46,588 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_ad_id.drd]
  652. 2016-04-11T15:06:46,680 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[ad_id] is single value, converting...
  653. 2016-04-11T15:06:47,149 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_bid.drd]
  654. 2016-04-11T15:06:47,239 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[bid] is single value, converting...
  655. 2016-04-11T15:06:47,869 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_c_id.drd]
  656. 2016-04-11T15:06:47,957 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[c_id] is single value, converting...
  657. 2016-04-11T15:06:48,455 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_segs.drd]
  658. 2016-04-11T15:06:52,606 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_type.drd]
  659. 2016-04-11T15:06:52,881 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[type] is single value, converting...
  660. 2016-04-11T15:06:53,496 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_wid.drd]
  661. 2016-04-11T15:06:53,597 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[wid] is single value, converting...
  662. 2016-04-11T15:06:54,969 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[index.drd]
  663. 2016-04-11T15:06:54,970 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[inverted.drd]
  664. 2016-04-11T15:06:54,970 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_count_LITTLE_ENDIAN.drd]
  665. 2016-04-11T15:06:54,970 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_LITTLE_ENDIAN.drd]
  666. 2016-04-11T15:06:55,011 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_bid_custom_LITTLE_ENDIAN.drd]
  667. 2016-04-11T15:06:55,086 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_unique_crm_id_LITTLE_ENDIAN.drd]
  668. 2016-04-11T15:06:55,118 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[spatial.drd]
  669. 2016-04-11T15:06:55,118 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[time_LITTLE_ENDIAN.drd]
  670. 2016-04-11T15:06:55,128 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Skipped files[[index.drd, inverted.drd, spatial.drd]]
  671. 2016-04-11T15:06:55,135 INFO [task-runner-0] io.druid.segment.loading.LocalDataSegmentPusher - Copying segment[__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z] to local filesystem at location[/data/druid/localStorage/__REPLACED___clean_hits/2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z/2016-04-11T15:02:31.416Z/0]
  672. 2016-04-11T15:06:55,136 INFO [task-runner-0] io.druid.segment.loading.LocalDataSegmentPusher - Compressing files from[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/merged] to [/data/druid/localStorage/__REPLACED___clean_hits/2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z/2016-04-11T15:02:31.416Z/0/index.zip]
  673. 2016-04-11T15:06:55,142 INFO [task-runner-0] com.metamx.common.CompressionUtils - Adding file[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/merged/meta.smoosh] with size[365]. Total size so far[0]
  674. 2016-04-11T15:06:55,143 INFO [task-runner-0] com.metamx.common.CompressionUtils - Adding file[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/merged/00000.smoosh] with size[358,423,312]. Total size so far[365]
  675. 2016-04-11T15:07:27,098 INFO [task-runner-0] com.metamx.common.CompressionUtils - Adding file[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/merged/version.bin] with size[4]. Total size so far[358,423,677]
  676. 2016-04-11T15:07:27,105 INFO [task-runner-0] io.druid.segment.loading.LocalDataSegmentPusher - Creating descriptor file at[/data/druid/localStorage/__REPLACED___clean_hits/2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z/2016-04-11T15:02:31.416Z/0/descriptor.json]
  677. 2016-04-11T15:07:27,137 INFO [task-runner-0] io.druid.indexing.common.index.YeOldePlumberSchool - Uploaded segment[__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z]
  678. 2016-04-11T15:07:27,137 INFO [task-runner-0] io.druid.indexing.common.index.YeOldePlumberSchool - Deleting Index File[/tmp/persistent/task/index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z/work/__REPLACED___clean_hits_2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z_2016-04-11T15:02:31.416Z_0/merged]
  679. 2016-04-11T15:07:27,138 INFO [task-runner-0] io.druid.indexing.common.task.IndexTask - Task[index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z] interval[2016-02-01T00:00:00.000Z/2016-02-02T00:00:00.000Z] partition[0] took in 2,993,869 rows (2,993,869 processed, 0 unparseable, 0 thrown away) and output 2,992,289 rows
  680. 2016-04-11T15:07:27,149 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z]: SegmentInsertAction{segments=[DataSegment{size=358423681, shardSpec=NoneShardSpec, metrics=[count, unique_bid, unique_crm_id, unique_bid_custom], dimensions=[ad_id, bid, c_id, segs, type, wid], version='2016-04-11T15:02:31.416Z', loadSpec={type=local, path=/data/druid/localStorage/__REPLACED___clean_hits/2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z/2016-04-11T15:02:31.416Z/0/index.zip}, interval=2016-02-01T00:00:00.000Z/2016-02-02T00:00:00.000Z, dataSource='__REPLACED___clean_hits', binaryVersion='9'}]}
  681. 2016-04-11T15:07:27,156 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z] to overlord[http://__HOSTNAME_REPLACED__:8090/druid/indexer/v1/action]: SegmentInsertAction{segments=[DataSegment{size=358423681, shardSpec=NoneShardSpec, metrics=[count, unique_bid, unique_crm_id, unique_bid_custom], dimensions=[ad_id, bid, c_id, segs, type, wid], version='2016-04-11T15:02:31.416Z', loadSpec={type=local, path=/data/druid/localStorage/__REPLACED___clean_hits/2016-02-01T00:00:00.000Z_2016-02-02T00:00:00.000Z/2016-04-11T15:02:31.416Z/0/index.zip}, interval=2016-02-01T00:00:00.000Z/2016-02-02T00:00:00.000Z, dataSource='__REPLACED___clean_hits', binaryVersion='9'}]}
  682. 2016-04-11T15:07:27,352 INFO [task-runner-0] io.druid.indexing.worker.executor.ExecutorLifecycle - Task completed with status: {
  683. "id" : "index___REPLACED___clean_hits_2016-04-11T15:02:31.409Z",
  684. "status" : "SUCCESS",
  685. "duration" : 288415
  686. }
  687. 2016-04-11T15:07:27,358 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.stop()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@6a1adbaf].
  688. 2016-04-11T15:07:27,358 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Stopping class io.druid.server.coordination.BatchDataSegmentAnnouncer with config[io.druid.server.initialization.ZkPathsConfig@58d3f4be]
  689. 2016-04-11T15:07:27,358 INFO [main] io.druid.curator.announcement.Announcer - unannouncing [/druid/announcements/__HOSTNAME_REPLACED__:8100]
  690. 2016-04-11T15:07:27,429 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.stop() throws java.lang.Exception] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@1773a024].
  691. 2016-04-11T15:07:27,435 INFO [main] org.eclipse.jetty.server.ServerConnector - Stopped ServerConnector@75be5835{HTTP/1.1}{0.0.0.0:8100}
  692. 2016-04-11T15:07:27,438 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.s.ServletContextHandler@38467816{/,null,UNAVAILABLE}
  693. 2016-04-11T15:07:27,446 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.overlord.ThreadPoolTaskRunner.stop()] on object[io.druid.indexing.overlord.ThreadPoolTaskRunner@5e8c1f43].
  694. 2016-04-11T15:07:27,446 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@6e1dd4b5].
  695. 2016-04-11T15:07:27,451 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.announcement.Announcer.stop()] on object[io.druid.curator.announcement.Announcer@279de0fc].
  696. 2016-04-11T15:07:27,451 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@198fec41].
  697. 2016-04-11T15:07:27,451 INFO [main] io.druid.curator.CuratorModule - Stopping Curator
  698. 2016-04-11T15:07:27,458 INFO [main] org.apache.zookeeper.ZooKeeper - Session: 0x15405c16a6e0005 closed
  699. 2016-04-11T15:07:27,459 INFO [main-EventThread] org.apache.zookeeper.ClientCnxn - EventThread shut down
  700. 2016-04-11T15:07:27,459 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.http.client.NettyHttpClient.stop()] on object[com.metamx.http.client.NettyHttpClient@7725310f].
  701. 2016-04-11T15:07:27,511 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.metrics.MonitorScheduler.stop()] on object[com.metamx.metrics.MonitorScheduler@56c4bee].
  702. 2016-04-11T15:07:27,512 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.emitter.service.ServiceEmitter.close() throws java.io.IOException] on object[com.metamx.emitter.service.ServiceEmitter@71955e74].
  703. 2016-04-11T15:07:27,512 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.stop()] on object[io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@173274d9].
  704. 2016-04-11T15:07:27,512 INFO [main] io.druid.cli.CliPeon - Finished peon task
  705. 2016-04-11T15:07:27,513 INFO [Thread-42] io.druid.cli.CliPeon - Running shutdown hook
  706. 2016-04-11T15:07:27,513 INFO [Thread-42] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.stop()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@6a1adbaf].
  707. 2016-04-11T15:07:27,514 INFO [Thread-42] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.stop() throws java.lang.Exception] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@1773a024].
  708. 2016-04-11T15:07:27,514 ERROR [Thread-42] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Exception when stopping method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.stop() throws java.lang.Exception] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@1773a024]
  709. java.lang.reflect.InvocationTargetException
  710. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.7.0_80]
  711. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) ~[?:1.7.0_80]
  712. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.7.0_80]
  713. at java.lang.reflect.Method.invoke(Method.java:606) ~[?:1.7.0_80]
  714. at com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.stop(Lifecycle.java:337) [java-util-0.27.4.jar:?]
  715. at com.metamx.common.lifecycle.Lifecycle.stop(Lifecycle.java:261) [java-util-0.27.4.jar:?]
  716. at io.druid.cli.CliPeon$2.run(CliPeon.java:241) [druid-services-0.8.3.jar:0.8.3]
  717. at java.lang.Thread.run(Thread.java:745) [?:1.7.0_80]
  718. Caused by: java.nio.channels.ClosedChannelException
  719. at sun.nio.ch.FileLockImpl.release(FileLockImpl.java:58) ~[?:1.7.0_80]
  720. at io.druid.indexing.worker.executor.ExecutorLifecycle.stop(ExecutorLifecycle.java:220) ~[druid-indexing-service-0.8.3.jar:0.8.3]
  721. ... 8 more
  722. 2016-04-11T15:07:27,524 INFO [Thread-42] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.overlord.ThreadPoolTaskRunner.stop()] on object[io.druid.indexing.overlord.ThreadPoolTaskRunner@5e8c1f43].
  723. 2016-04-11T15:07:27,524 INFO [Thread-42] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@6e1dd4b5].
  724. 2016-04-11T15:07:27,524 ERROR [Thread-42] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Exception when stopping method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@6e1dd4b5]
  725. java.lang.reflect.InvocationTargetException
  726. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.7.0_80]
  727. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) ~[?:1.7.0_80]
  728. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.7.0_80]
  729. at java.lang.reflect.Method.invoke(Method.java:606) ~[?:1.7.0_80]
  730. at com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.stop(Lifecycle.java:337) [java-util-0.27.4.jar:?]
  731. at com.metamx.common.lifecycle.Lifecycle.stop(Lifecycle.java:261) [java-util-0.27.4.jar:?]
  732. at io.druid.cli.CliPeon$2.run(CliPeon.java:241) [druid-services-0.8.3.jar:0.8.3]
  733. at java.lang.Thread.run(Thread.java:745) [?:1.7.0_80]
  734. Caused by: java.lang.IllegalStateException: Already closed or has not been started
  735. at com.google.common.base.Preconditions.checkState(Preconditions.java:176) ~[guava-16.0.1.jar:?]
  736. at org.apache.curator.x.discovery.details.ServiceCacheImpl.close(ServiceCacheImpl.java:104) ~[curator-x-discovery-2.9.1.jar:?]
  737. at org.apache.curator.x.discovery.details.ServiceProviderImpl.close(ServiceProviderImpl.java:78) ~[curator-x-discovery-2.9.1.jar:?]
  738. at io.druid.curator.discovery.ServerDiscoverySelector.stop(ServerDiscoverySelector.java:122) ~[druid-server-0.8.3.jar:0.8.3]
  739. ... 8 more
  740. 2016-04-11T15:07:27,525 INFO [Thread-42] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.announcement.Announcer.stop()] on object[io.druid.curator.announcement.Announcer@279de0fc].
  741. 2016-04-11T15:07:27,525 INFO [Thread-42] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@198fec41].
  742. 2016-04-11T15:07:27,525 ERROR [Thread-42] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Exception when stopping method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@198fec41]
  743. java.lang.reflect.InvocationTargetException
  744. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.7.0_80]
  745. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) ~[?:1.7.0_80]
  746. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.7.0_80]
  747. at java.lang.reflect.Method.invoke(Method.java:606) ~[?:1.7.0_80]
  748. at com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.stop(Lifecycle.java:337) [java-util-0.27.4.jar:?]
  749. at com.metamx.common.lifecycle.Lifecycle.stop(Lifecycle.java:261) [java-util-0.27.4.jar:?]
  750. at io.druid.cli.CliPeon$2.run(CliPeon.java:241) [druid-services-0.8.3.jar:0.8.3]
  751. at java.lang.Thread.run(Thread.java:745) [?:1.7.0_80]
  752. Caused by: java.lang.IllegalStateException: Already closed or has not been started
  753. at com.google.common.base.Preconditions.checkState(Preconditions.java:176) ~[guava-16.0.1.jar:?]
  754. at org.apache.curator.x.discovery.details.ServiceCacheImpl.close(ServiceCacheImpl.java:104) ~[curator-x-discovery-2.9.1.jar:?]
  755. at org.apache.curator.x.discovery.details.ServiceProviderImpl.close(ServiceProviderImpl.java:78) ~[curator-x-discovery-2.9.1.jar:?]
  756. at io.druid.curator.discovery.ServerDiscoverySelector.stop(ServerDiscoverySelector.java:122) ~[druid-server-0.8.3.jar:0.8.3]
  757. ... 8 more
  758. 2016-04-11T15:07:27,526 INFO [Thread-42] io.druid.curator.CuratorModule - Stopping Curator
  759. 2016-04-11T15:07:27,526 INFO [Thread-42] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.http.client.NettyHttpClient.stop()] on object[com.metamx.http.client.NettyHttpClient@7725310f].
  760. 2016-04-11T15:07:27,527 INFO [Thread-42] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.metrics.MonitorScheduler.stop()] on object[com.metamx.metrics.MonitorScheduler@56c4bee].
  761. 2016-04-11T15:07:27,527 INFO [Thread-42] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.emitter.service.ServiceEmitter.close() throws java.io.IOException] on object[com.metamx.emitter.service.ServiceEmitter@71955e74].
  762. 2016-04-11T15:07:27,527 INFO [Thread-42] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.stop()] on object[io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@173274d9].
  763. 2016-04-11T15:07:27,527 ERROR [Thread-42] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Exception when stopping method[public void io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.stop()] on object[io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@173274d9]
  764. java.lang.reflect.InvocationTargetException
  765. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.7.0_80]
  766. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) ~[?:1.7.0_80]
  767. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.7.0_80]
  768. at java.lang.reflect.Method.invoke(Method.java:606) ~[?:1.7.0_80]
  769. at com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.stop(Lifecycle.java:337) [java-util-0.27.4.jar:?]
  770. at com.metamx.common.lifecycle.Lifecycle.stop(Lifecycle.java:261) [java-util-0.27.4.jar:?]
  771. at io.druid.cli.CliPeon$2.run(CliPeon.java:241) [druid-services-0.8.3.jar:0.8.3]
  772. at java.lang.Thread.run(Thread.java:745) [?:1.7.0_80]
  773. Caused by: java.lang.IllegalStateException: Expected state [STARTED] found [STOPPED]
  774. at io.druid.common.config.Log4jShutdown.stop(Log4jShutdown.java:102) ~[druid-common-0.8.3.jar:0.8.3]
  775. at io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.stop(Log4jShutterDownerModule.java:109) ~[druid-server-0.8.3.jar:0.8.3]
  776. ... 8 more
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!