API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Jun 14th, 2017
101
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 58.99 KB | None | 0 0
raw download clone embed print report
  1. 17:46:03.482 [main] DEBUG org.springframework.core.env.StandardEnvironment - Adding [systemProperties] PropertySource with lowest search precedence
  2. 17:46:03.491 [main] DEBUG org.springframework.core.env.StandardEnvironment - Adding [systemEnvironment] PropertySource with lowest search precedence
  3. 17:46:03.492 [main] DEBUG org.springframework.core.env.StandardEnvironment - Initialized StandardEnvironment with PropertySources [systemProperties,systemEnvironment]
  4. 17:46:03.548 [main] DEBUG org.springframework.context.annotation.ClassPathBeanDefinitionScanner - JSR-250 'javax.annotation.ManagedBean' found and supported for component scanning
  5. 17:46:03.549 [main] DEBUG org.springframework.context.annotation.ClassPathBeanDefinitionScanner - JSR-330 'javax.inject.Named' annotation found and supported for component scanning
  6. 17:46:03.604 [main] INFO org.springframework.context.annotation.AnnotationConfigApplicationContext - Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@5ae63ade: startup date [Wed Jun 14 17:46:03 CEST 2017]; root of context hierarchy
  7. 17:46:03.605 [main] DEBUG org.springframework.context.annotation.AnnotationConfigApplicationContext - Bean factory for org.springframework.context.annotation.AnnotationConfigApplicationContext@5ae63ade: org.springframework.beans.factory.support.DefaultListableBeanFactory@212bf671: defining beans [org.springframework.context.annotation.internalConfigurationAnnotationProcessor,org.springframework.context.annotation.internalAutowiredAnnotationProcessor,org.springframework.context.annotation.internalRequiredAnnotationProcessor,org.springframework.context.annotation.internalCommonAnnotationProcessor,org.springframework.context.event.internalEventListenerProcessor,org.springframework.context.event.internalEventListenerFactory,indexingConfigurationDe]; root of factory hierarchy
  8. 17:46:03.627 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating shared instance of singleton bean 'org.springframework.context.annotation.internalConfigurationAnnotationProcessor'
  9. 17:46:03.628 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating instance of bean 'org.springframework.context.annotation.internalConfigurationAnnotationProcessor'
  10. 17:46:03.656 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Eagerly caching bean 'org.springframework.context.annotation.internalConfigurationAnnotationProcessor' to allow for resolving potential circular references
  11. 17:46:03.659 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Finished creating instance of bean 'org.springframework.context.annotation.internalConfigurationAnnotationProcessor'
  12. 17:46:03.692 [main] DEBUG org.springframework.core.env.StandardEnvironment - Adding [class path resource [de-indexing/app.properties]] PropertySource with lowest search precedence
  13. 17:46:03.692 [main] DEBUG org.springframework.core.env.PropertySourcesPropertyResolver - Could not find key 'config.file' in any property source
  14. 17:46:03.785 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registered bean definition for imported class 'com.datalovers.processing.spark.supplier.company.SparkMongoCompanyConfig'
  15. 17:46:03.786 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registered bean definition for imported class 'com.datalovers.processing.spark.config.properties.LinguisticProps'
  16. 17:46:03.786 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registered bean definition for imported class 'com.datalovers.processing.spark.config.properties.NominatimProps'
  17. 17:46:03.787 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registered bean definition for imported class 'com.datalovers.processing.spark.config.properties.TaggerProps'
  18. 17:46:03.788 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registered bean definition for imported class 'com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp'
  19. 17:46:03.789 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registered bean definition for imported class 'com.datalovers.processing.spark.config.properties.IndexProps'
  20. 17:46:03.790 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registered bean definition for imported class 'com.datalovers.processing.spark.config.IndexingCommandConfigurationDe'
  21. 17:46:03.792 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registering bean definition for @Bean method com.datalovers.processing.spark.config.IndexingCommandConfigurationDe.solrDocumentCreatorPerCompanyCommand()
  22. 17:46:03.792 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registering bean definition for @Bean method com.datalovers.processing.spark.config.IndexingCommandConfigurationDe.indexerComponents()
  23. 17:46:03.793 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registering bean definition for @Bean method com.datalovers.processing.spark.config.IndexingCommandConfigurationDe.geoCoderCommand()
  24. 17:46:03.793 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registering bean definition for @Bean method com.datalovers.processing.spark.config.IndexingCommandConfigurationDe.duplicateDetectionCommand()
  25. 17:46:03.794 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registering bean definition for @Bean method com.datalovers.processing.spark.config.IndexingCommandConfigurationDe.pageValidatorCommand()
  26. 17:46:03.796 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registering bean definition for @Bean method com.datalovers.processing.spark.config.IndexingCommandConfigurationDe.companyLinguisticAnalysisCommand()
  27. 17:46:03.796 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registering bean definition for @Bean method com.datalovers.processing.spark.config.IndexingCommandConfigurationDe.companyTaggerCommand()
  28. 17:46:03.797 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registering bean definition for @Bean method com.datalovers.processing.spark.config.IndexingCommandConfigurationDe.isoCodeExtractionCommand()
  29. 17:46:03.797 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registering bean definition for @Bean method com.datalovers.processing.spark.config.IndexingCommandConfigurationDe.socialLinkExtractionCommand()
  30. 17:46:03.798 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registering bean definition for @Bean method com.datalovers.processing.spark.config.IndexingCommandConfigurationDe.appendCrawlStatsCommand()
  31. 17:46:03.800 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registering bean definition for @Bean method com.datalovers.processing.spark.config.IndexingConfigurationDe.processingChain()
  32. 17:46:03.801 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registering bean definition for @Bean method com.datalovers.processing.spark.config.IndexingConfigurationDe.diMongoDao()
  33. 17:46:03.801 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registering bean definition for @Bean method com.datalovers.processing.spark.config.IndexingConfigurationDe.hotCompanyTaggerCommand()
  34. 17:46:03.802 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registering bean definition for @Bean method com.datalovers.processing.spark.config.IndexingConfigurationDe.indexingSolr()
  35. 17:46:03.804 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registering bean definition for @Bean method com.datalovers.processing.spark.config.IndexingConfigurationDe.getCompanySupplier()
  36. 17:46:03.805 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registering bean definition for @Bean method com.datalovers.processing.spark.config.IndexingConfigurationDe.getSparkConf()
  37. 17:46:03.805 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registering bean definition for @Bean method com.datalovers.processing.spark.config.IndexingConfigurationDe.getMongoTemplate()
  38. 17:46:03.806 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registering bean definition for @Bean method com.datalovers.processing.spark.config.IndexingConfigurationDe.pageRepository()
  39. 17:46:03.807 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registering bean definition for @Bean method com.datalovers.processing.spark.config.IndexingConfigurationDe.getMongoRecovery()
  40. 17:46:03.807 [main] DEBUG org.springframework.context.annotation.ConfigurationClassBeanDefinitionReader - Registering bean definition for @Bean method com.datalovers.processing.spark.config.IndexingConfigurationDe.getRecovery()
  41. 17:46:03.942 [main] DEBUG org.springframework.context.annotation.ConfigurationClassEnhancer - Successfully enhanced com.datalovers.processing.spark.config.IndexingConfigurationDe; enhanced class name is: com.datalovers.processing.spark.config.IndexingConfigurationDe$$EnhancerBySpringCGLIB$$51bb9210
  42. 17:46:03.942 [main] DEBUG org.springframework.context.annotation.ConfigurationClassPostProcessor - Replacing bean definition 'indexingConfigurationDe' existing class 'com.datalovers.processing.spark.config.IndexingConfigurationDe' with enhanced class 'com.datalovers.processing.spark.config.IndexingConfigurationDe$$EnhancerBySpringCGLIB$$51bb9210'
  43. 17:46:03.945 [main] DEBUG org.springframework.context.annotation.ConfigurationClassEnhancer - Successfully enhanced com.datalovers.processing.spark.config.properties.LinguisticProps; enhanced class name is: com.datalovers.processing.spark.config.properties.LinguisticProps$$EnhancerBySpringCGLIB$$63dcc701
  44. 17:46:03.945 [main] DEBUG org.springframework.context.annotation.ConfigurationClassPostProcessor - Replacing bean definition 'com.datalovers.processing.spark.config.properties.LinguisticProps' existing class 'com.datalovers.processing.spark.config.properties.LinguisticProps' with enhanced class 'com.datalovers.processing.spark.config.properties.LinguisticProps$$EnhancerBySpringCGLIB$$63dcc701'
  45. 17:46:03.947 [main] DEBUG org.springframework.context.annotation.ConfigurationClassEnhancer - Successfully enhanced com.datalovers.processing.spark.config.properties.NominatimProps; enhanced class name is: com.datalovers.processing.spark.config.properties.NominatimProps$$EnhancerBySpringCGLIB$$dba7a0c
  46. 17:46:03.947 [main] DEBUG org.springframework.context.annotation.ConfigurationClassPostProcessor - Replacing bean definition 'com.datalovers.processing.spark.config.properties.NominatimProps' existing class 'com.datalovers.processing.spark.config.properties.NominatimProps' with enhanced class 'com.datalovers.processing.spark.config.properties.NominatimProps$$EnhancerBySpringCGLIB$$dba7a0c'
  47. 17:46:03.949 [main] DEBUG org.springframework.context.annotation.ConfigurationClassEnhancer - Successfully enhanced com.datalovers.processing.spark.config.properties.TaggerProps; enhanced class name is: com.datalovers.processing.spark.config.properties.TaggerProps$$EnhancerBySpringCGLIB$$393d04cc
  48. 17:46:03.949 [main] DEBUG org.springframework.context.annotation.ConfigurationClassPostProcessor - Replacing bean definition 'com.datalovers.processing.spark.config.properties.TaggerProps' existing class 'com.datalovers.processing.spark.config.properties.TaggerProps' with enhanced class 'com.datalovers.processing.spark.config.properties.TaggerProps$$EnhancerBySpringCGLIB$$393d04cc'
  49. 17:46:03.950 [main] DEBUG org.springframework.context.annotation.ConfigurationClassEnhancer - Successfully enhanced com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp; enhanced class name is: com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp$$EnhancerBySpringCGLIB$$17fc3edc
  50. 17:46:03.950 [main] DEBUG org.springframework.context.annotation.ConfigurationClassPostProcessor - Replacing bean definition 'com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp' existing class 'com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp' with enhanced class 'com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp$$EnhancerBySpringCGLIB$$17fc3edc'
  51. 17:46:03.957 [main] DEBUG org.springframework.context.annotation.ConfigurationClassEnhancer - Successfully enhanced com.datalovers.processing.spark.config.properties.IndexProps; enhanced class name is: com.datalovers.processing.spark.config.properties.IndexProps$$EnhancerBySpringCGLIB$$3ec920c2
  52. 17:46:03.958 [main] DEBUG org.springframework.context.annotation.ConfigurationClassPostProcessor - Replacing bean definition 'com.datalovers.processing.spark.config.properties.IndexProps' existing class 'com.datalovers.processing.spark.config.properties.IndexProps' with enhanced class 'com.datalovers.processing.spark.config.properties.IndexProps$$EnhancerBySpringCGLIB$$3ec920c2'
  53. 17:46:03.962 [main] DEBUG org.springframework.context.annotation.ConfigurationClassEnhancer - Successfully enhanced com.datalovers.processing.spark.config.IndexingCommandConfigurationDe; enhanced class name is: com.datalovers.processing.spark.config.IndexingCommandConfigurationDe$$EnhancerBySpringCGLIB$$5725af8d
  54. 17:46:03.962 [main] DEBUG org.springframework.context.annotation.ConfigurationClassPostProcessor - Replacing bean definition 'com.datalovers.processing.spark.config.IndexingCommandConfigurationDe' existing class 'com.datalovers.processing.spark.config.IndexingCommandConfigurationDe' with enhanced class 'com.datalovers.processing.spark.config.IndexingCommandConfigurationDe$$EnhancerBySpringCGLIB$$5725af8d'
  55. 17:46:03.967 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating shared instance of singleton bean 'org.springframework.context.annotation.internalAutowiredAnnotationProcessor'
  56. 17:46:03.968 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating instance of bean 'org.springframework.context.annotation.internalAutowiredAnnotationProcessor'
  57. 17:46:03.968 [main] INFO org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor - JSR-330 'javax.inject.Inject' annotation found and supported for autowiring
  58. 17:46:03.969 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Eagerly caching bean 'org.springframework.context.annotation.internalAutowiredAnnotationProcessor' to allow for resolving potential circular references
  59. 17:46:03.969 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Finished creating instance of bean 'org.springframework.context.annotation.internalAutowiredAnnotationProcessor'
  60. 17:46:03.969 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating shared instance of singleton bean 'org.springframework.context.annotation.internalRequiredAnnotationProcessor'
  61. 17:46:03.969 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating instance of bean 'org.springframework.context.annotation.internalRequiredAnnotationProcessor'
  62. 17:46:03.969 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Eagerly caching bean 'org.springframework.context.annotation.internalRequiredAnnotationProcessor' to allow for resolving potential circular references
  63. 17:46:03.969 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Finished creating instance of bean 'org.springframework.context.annotation.internalRequiredAnnotationProcessor'
  64. 17:46:03.969 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating shared instance of singleton bean 'org.springframework.context.annotation.internalCommonAnnotationProcessor'
  65. 17:46:03.969 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating instance of bean 'org.springframework.context.annotation.internalCommonAnnotationProcessor'
  66. 17:46:03.974 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Eagerly caching bean 'org.springframework.context.annotation.internalCommonAnnotationProcessor' to allow for resolving potential circular references
  67. 17:46:03.974 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Finished creating instance of bean 'org.springframework.context.annotation.internalCommonAnnotationProcessor'
  68. 17:46:03.974 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating shared instance of singleton bean 'org.springframework.context.annotation.ConfigurationClassPostProcessor.importAwareProcessor'
  69. 17:46:03.974 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating instance of bean 'org.springframework.context.annotation.ConfigurationClassPostProcessor.importAwareProcessor'
  70. 17:46:03.974 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Eagerly caching bean 'org.springframework.context.annotation.ConfigurationClassPostProcessor.importAwareProcessor' to allow for resolving potential circular references
  71. 17:46:03.974 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Finished creating instance of bean 'org.springframework.context.annotation.ConfigurationClassPostProcessor.importAwareProcessor'
  72. 17:46:03.974 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating shared instance of singleton bean 'org.springframework.context.annotation.ConfigurationClassPostProcessor.enhancedConfigurationProcessor'
  73. 17:46:03.975 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating instance of bean 'org.springframework.context.annotation.ConfigurationClassPostProcessor.enhancedConfigurationProcessor'
  74. 17:46:03.975 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Eagerly caching bean 'org.springframework.context.annotation.ConfigurationClassPostProcessor.enhancedConfigurationProcessor' to allow for resolving potential circular references
  75. 17:46:03.975 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Finished creating instance of bean 'org.springframework.context.annotation.ConfigurationClassPostProcessor.enhancedConfigurationProcessor'
  76. 17:46:03.978 [main] DEBUG org.springframework.context.annotation.AnnotationConfigApplicationContext - Unable to locate MessageSource with name 'messageSource': using default [org.springframework.context.support.DelegatingMessageSource@7c9d8e2]
  77. 17:46:03.982 [main] DEBUG org.springframework.context.annotation.AnnotationConfigApplicationContext - Unable to locate ApplicationEventMulticaster with name 'applicationEventMulticaster': using default [org.springframework.context.event.SimpleApplicationEventMulticaster@4009e306]
  78. 17:46:03.983 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@212bf671: defining beans [org.springframework.context.annotation.internalConfigurationAnnotationProcessor,org.springframework.context.annotation.internalAutowiredAnnotationProcessor,org.springframework.context.annotation.internalRequiredAnnotationProcessor,org.springframework.context.annotation.internalCommonAnnotationProcessor,org.springframework.context.event.internalEventListenerProcessor,org.springframework.context.event.internalEventListenerFactory,indexingConfigurationDe,org.springframework.context.annotation.ConfigurationClassPostProcessor.importAwareProcessor,org.springframework.context.annotation.ConfigurationClassPostProcessor.enhancedConfigurationProcessor,com.datalovers.processing.spark.supplier.company.SparkMongoCompanyConfig,com.datalovers.processing.spark.config.properties.LinguisticProps,com.datalovers.processing.spark.config.properties.NominatimProps,com.datalovers.processing.spark.config.properties.TaggerProps,com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp,com.datalovers.processing.spark.config.properties.IndexProps,com.datalovers.processing.spark.config.IndexingCommandConfigurationDe,solrDocumentCreatorPerCompanyCommand,indexerComponents,geoCoderCommand,duplicateDetectionCommand,pageValidatorCommand,companyLinguisticAnalysisCommand,companyTaggerCommand,isoCodeExtractionCommand,socialLinkExtractionCommand,appendCrawlStatsCommand,processingChain,diMongoDao,hotCompanyTaggerCommand,indexingSolr,getCompanySupplier,getSparkConf,getMongoTemplate,pageRepository,getMongoRecovery,getRecovery]; root of factory hierarchy
  79. 17:46:03.984 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Returning cached instance of singleton bean 'org.springframework.context.annotation.internalConfigurationAnnotationProcessor'
  80. 17:46:03.984 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Returning cached instance of singleton bean 'org.springframework.context.annotation.internalAutowiredAnnotationProcessor'
  81. 17:46:03.984 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Returning cached instance of singleton bean 'org.springframework.context.annotation.internalRequiredAnnotationProcessor'
  82. 17:46:03.984 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Returning cached instance of singleton bean 'org.springframework.context.annotation.internalCommonAnnotationProcessor'
  83. 17:46:03.984 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating shared instance of singleton bean 'org.springframework.context.event.internalEventListenerProcessor'
  84. 17:46:03.984 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating instance of bean 'org.springframework.context.event.internalEventListenerProcessor'
  85. 17:46:03.999 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Eagerly caching bean 'org.springframework.context.event.internalEventListenerProcessor' to allow for resolving potential circular references
  86. 17:46:04.038 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Finished creating instance of bean 'org.springframework.context.event.internalEventListenerProcessor'
  87. 17:46:04.038 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating shared instance of singleton bean 'org.springframework.context.event.internalEventListenerFactory'
  88. 17:46:04.038 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating instance of bean 'org.springframework.context.event.internalEventListenerFactory'
  89. 17:46:04.039 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Eagerly caching bean 'org.springframework.context.event.internalEventListenerFactory' to allow for resolving potential circular references
  90. 17:46:04.047 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Finished creating instance of bean 'org.springframework.context.event.internalEventListenerFactory'
  91. 17:46:04.048 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating shared instance of singleton bean 'indexingConfigurationDe'
  92. 17:46:04.048 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating instance of bean 'indexingConfigurationDe'
  93. 17:46:04.054 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Registered injected element on class [com.datalovers.processing.spark.config.IndexingConfigurationDe$$EnhancerBySpringCGLIB$$51bb9210]: AutowiredFieldElement for private org.springframework.core.env.Environment com.datalovers.processing.spark.config.IndexingConfiguration.env
  94. 17:46:04.055 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Registered injected element on class [com.datalovers.processing.spark.config.IndexingConfigurationDe$$EnhancerBySpringCGLIB$$51bb9210]: AutowiredFieldElement for private com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp com.datalovers.processing.spark.config.IndexingConfiguration.solrCloudIndexingProp
  95. 17:46:04.055 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Registered injected element on class [com.datalovers.processing.spark.config.IndexingConfigurationDe$$EnhancerBySpringCGLIB$$51bb9210]: AutowiredFieldElement for private org.springframework.core.env.Environment com.datalovers.processing.spark.config.IndexingConfigurationDe.env
  96. 17:46:04.055 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Eagerly caching bean 'indexingConfigurationDe' to allow for resolving potential circular references
  97. 17:46:04.066 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Processing injected element of bean 'indexingConfigurationDe': AutowiredFieldElement for private org.springframework.core.env.Environment com.datalovers.processing.spark.config.IndexingConfiguration.env
  98. 17:46:04.074 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Returning cached instance of singleton bean 'environment'
  99. 17:46:04.075 [main] DEBUG org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor - Autowiring by type from bean name 'indexingConfigurationDe' to bean named 'environment'
  100. 17:46:04.075 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Processing injected element of bean 'indexingConfigurationDe': AutowiredFieldElement for private com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp com.datalovers.processing.spark.config.IndexingConfiguration.solrCloudIndexingProp
  101. 17:46:04.076 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating shared instance of singleton bean 'com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp'
  102. 17:46:04.076 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating instance of bean 'com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp'
  103. 17:46:04.080 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Registered injected element on class [com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp$$EnhancerBySpringCGLIB$$17fc3edc]: AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp.schema
  104. 17:46:04.080 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Registered injected element on class [com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp$$EnhancerBySpringCGLIB$$17fc3edc]: AutowiredFieldElement for private java.util.List com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp.zkHosts
  105. 17:46:04.080 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Registered injected element on class [com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp$$EnhancerBySpringCGLIB$$17fc3edc]: AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp.collection
  106. 17:46:04.080 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Eagerly caching bean 'com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp' to allow for resolving potential circular references
  107. 17:46:04.090 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Processing injected element of bean 'com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp': AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp.schema
  108. 17:46:04.090 [main] DEBUG org.springframework.core.env.PropertySourcesPropertyResolver - Found key 'solr.indexing.schema' in [class path resource [de-indexing/app.properties]] with type [String]
  109. 17:46:04.100 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Processing injected element of bean 'com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp': AutowiredFieldElement for private java.util.List com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp.zkHosts
  110. 17:46:04.100 [main] DEBUG org.springframework.core.env.PropertySourcesPropertyResolver - Found key 'solr.indexing.zkHosts' in [class path resource [de-indexing/app.properties]] with type [String]
  111. 17:46:04.158 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Processing injected element of bean 'com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp': AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp.collection
  112. 17:46:04.159 [main] DEBUG org.springframework.core.env.PropertySourcesPropertyResolver - Found key 'solr.indexing.collection' in [class path resource [de-indexing/app.properties]] with type [String]
  113. 17:46:04.159 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Finished creating instance of bean 'com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp'
  114. 17:46:04.159 [main] DEBUG org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor - Autowiring by type from bean name 'indexingConfigurationDe' to bean named 'com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp'
  115. 17:46:04.159 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Processing injected element of bean 'indexingConfigurationDe': AutowiredFieldElement for private org.springframework.core.env.Environment com.datalovers.processing.spark.config.IndexingConfigurationDe.env
  116. 17:46:04.159 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Returning cached instance of singleton bean 'environment'
  117. 17:46:04.160 [main] DEBUG org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor - Autowiring by type from bean name 'indexingConfigurationDe' to bean named 'environment'
  118. 17:46:04.160 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Finished creating instance of bean 'indexingConfigurationDe'
  119. 17:46:04.160 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Returning cached instance of singleton bean 'org.springframework.context.annotation.ConfigurationClassPostProcessor.importAwareProcessor'
  120. 17:46:04.160 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Returning cached instance of singleton bean 'org.springframework.context.annotation.ConfigurationClassPostProcessor.enhancedConfigurationProcessor'
  121. 17:46:04.160 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating shared instance of singleton bean 'com.datalovers.processing.spark.supplier.company.SparkMongoCompanyConfig'
  122. 17:46:04.160 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating instance of bean 'com.datalovers.processing.spark.supplier.company.SparkMongoCompanyConfig'
  123. 17:46:04.160 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Eagerly caching bean 'com.datalovers.processing.spark.supplier.company.SparkMongoCompanyConfig' to allow for resolving potential circular references
  124. 17:46:04.165 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Finished creating instance of bean 'com.datalovers.processing.spark.supplier.company.SparkMongoCompanyConfig'
  125. 17:46:04.166 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating shared instance of singleton bean 'com.datalovers.processing.spark.config.properties.LinguisticProps'
  126. 17:46:04.166 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating instance of bean 'com.datalovers.processing.spark.config.properties.LinguisticProps'
  127. 17:46:04.167 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Registered injected element on class [com.datalovers.processing.spark.config.properties.LinguisticProps$$EnhancerBySpringCGLIB$$63dcc701]: AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.LinguisticProps.lemmatizer
  128. 17:46:04.167 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Registered injected element on class [com.datalovers.processing.spark.config.properties.LinguisticProps$$EnhancerBySpringCGLIB$$63dcc701]: AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.LinguisticProps.postagger
  129. 17:46:04.167 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Eagerly caching bean 'com.datalovers.processing.spark.config.properties.LinguisticProps' to allow for resolving potential circular references
  130. 17:46:04.175 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Processing injected element of bean 'com.datalovers.processing.spark.config.properties.LinguisticProps': AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.LinguisticProps.lemmatizer
  131. 17:46:04.176 [main] DEBUG org.springframework.core.env.PropertySourcesPropertyResolver - Found key 'linguistic.lemmatizer' in [class path resource [de-indexing/app.properties]] with type [String]
  132. 17:46:04.176 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Processing injected element of bean 'com.datalovers.processing.spark.config.properties.LinguisticProps': AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.LinguisticProps.postagger
  133. 17:46:04.177 [main] DEBUG org.springframework.core.env.PropertySourcesPropertyResolver - Found key 'linguistic.postagger' in [class path resource [de-indexing/app.properties]] with type [String]
  134. 17:46:04.178 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Finished creating instance of bean 'com.datalovers.processing.spark.config.properties.LinguisticProps'
  135. 17:46:04.178 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating shared instance of singleton bean 'com.datalovers.processing.spark.config.properties.NominatimProps'
  136. 17:46:04.178 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating instance of bean 'com.datalovers.processing.spark.config.properties.NominatimProps'
  137. 17:46:04.179 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Registered injected element on class [com.datalovers.processing.spark.config.properties.NominatimProps$$EnhancerBySpringCGLIB$$dba7a0c]: AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.NominatimProps.endpoint
  138. 17:46:04.179 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Registered injected element on class [com.datalovers.processing.spark.config.properties.NominatimProps$$EnhancerBySpringCGLIB$$dba7a0c]: AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.NominatimProps.username
  139. 17:46:04.179 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Registered injected element on class [com.datalovers.processing.spark.config.properties.NominatimProps$$EnhancerBySpringCGLIB$$dba7a0c]: AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.NominatimProps.password
  140. 17:46:04.179 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Registered injected element on class [com.datalovers.processing.spark.config.properties.NominatimProps$$EnhancerBySpringCGLIB$$dba7a0c]: AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.NominatimProps.email
  141. 17:46:04.179 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Eagerly caching bean 'com.datalovers.processing.spark.config.properties.NominatimProps' to allow for resolving potential circular references
  142. 17:46:04.192 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Processing injected element of bean 'com.datalovers.processing.spark.config.properties.NominatimProps': AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.NominatimProps.endpoint
  143. 17:46:04.192 [main] DEBUG org.springframework.core.env.PropertySourcesPropertyResolver - Found key 'nominatim.endpoint' in [class path resource [de-indexing/app.properties]] with type [String]
  144. 17:46:04.192 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Processing injected element of bean 'com.datalovers.processing.spark.config.properties.NominatimProps': AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.NominatimProps.username
  145. 17:46:04.193 [main] DEBUG org.springframework.core.env.PropertySourcesPropertyResolver - Found key 'nominatim.username' in [class path resource [de-indexing/app.properties]] with type [String]
  146. 17:46:04.193 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Processing injected element of bean 'com.datalovers.processing.spark.config.properties.NominatimProps': AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.NominatimProps.password
  147. 17:46:04.193 [main] DEBUG org.springframework.core.env.PropertySourcesPropertyResolver - Found key 'nominatim.password' in [class path resource [de-indexing/app.properties]] with type [String]
  148. 17:46:04.193 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Processing injected element of bean 'com.datalovers.processing.spark.config.properties.NominatimProps': AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.NominatimProps.email
  149. 17:46:04.194 [main] DEBUG org.springframework.core.env.PropertySourcesPropertyResolver - Found key 'nominatim.email' in [class path resource [de-indexing/app.properties]] with type [String]
  150. 17:46:04.194 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Finished creating instance of bean 'com.datalovers.processing.spark.config.properties.NominatimProps'
  151. 17:46:04.194 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating shared instance of singleton bean 'com.datalovers.processing.spark.config.properties.TaggerProps'
  152. 17:46:04.194 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating instance of bean 'com.datalovers.processing.spark.config.properties.TaggerProps'
  153. 17:46:04.195 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Registered injected element on class [com.datalovers.processing.spark.config.properties.TaggerProps$$EnhancerBySpringCGLIB$$393d04cc]: AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.TaggerProps.idfSupplier
  154. 17:46:04.195 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Registered injected element on class [com.datalovers.processing.spark.config.properties.TaggerProps$$EnhancerBySpringCGLIB$$393d04cc]: AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.TaggerProps.wikiPath
  155. 17:46:04.196 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Registered injected element on class [com.datalovers.processing.spark.config.properties.TaggerProps$$EnhancerBySpringCGLIB$$393d04cc]: AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.TaggerProps.stopwords
  156. 17:46:04.196 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Registered injected element on class [com.datalovers.processing.spark.config.properties.TaggerProps$$EnhancerBySpringCGLIB$$393d04cc]: AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.TaggerProps.lexicon
  157. 17:46:04.196 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Eagerly caching bean 'com.datalovers.processing.spark.config.properties.TaggerProps' to allow for resolving potential circular references
  158. 17:46:04.203 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Processing injected element of bean 'com.datalovers.processing.spark.config.properties.TaggerProps': AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.TaggerProps.idfSupplier
  159. 17:46:04.203 [main] DEBUG org.springframework.core.env.PropertySourcesPropertyResolver - Found key 'tagger.idfSupplier' in [class path resource [de-indexing/app.properties]] with type [String]
  160. 17:46:04.204 [main] DEBUG org.springframework.core.env.PropertySourcesPropertyResolver - Found key 'data.folder' in [systemProperties] with type [String]
  161. 17:46:04.204 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Processing injected element of bean 'com.datalovers.processing.spark.config.properties.TaggerProps': AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.TaggerProps.wikiPath
  162. 17:46:04.204 [main] DEBUG org.springframework.core.env.PropertySourcesPropertyResolver - Found key 'tagger.wikiPath' in [class path resource [de-indexing/app.properties]] with type [String]
  163. 17:46:04.204 [main] DEBUG org.springframework.core.env.PropertySourcesPropertyResolver - Found key 'data.folder' in [systemProperties] with type [String]
  164. 17:46:04.204 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Processing injected element of bean 'com.datalovers.processing.spark.config.properties.TaggerProps': AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.TaggerProps.stopwords
  165. 17:46:04.205 [main] DEBUG org.springframework.core.env.PropertySourcesPropertyResolver - Found key 'tagger.stopwords' in [class path resource [de-indexing/app.properties]] with type [String]
  166. 17:46:04.205 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Processing injected element of bean 'com.datalovers.processing.spark.config.properties.TaggerProps': AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.TaggerProps.lexicon
  167. 17:46:04.205 [main] DEBUG org.springframework.core.env.PropertySourcesPropertyResolver - Found key 'tagger.lexicon' in [class path resource [de-indexing/app.properties]] with type [String]
  168. 17:46:04.206 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Finished creating instance of bean 'com.datalovers.processing.spark.config.properties.TaggerProps'
  169. 17:46:04.206 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Returning cached instance of singleton bean 'com.datalovers.processing.spark.config.properties.SolrCloudIndexingProp'
  170. 17:46:04.206 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating shared instance of singleton bean 'com.datalovers.processing.spark.config.properties.IndexProps'
  171. 17:46:04.206 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating instance of bean 'com.datalovers.processing.spark.config.properties.IndexProps'
  172. 17:46:04.207 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Registered injected element on class [com.datalovers.processing.spark.config.properties.IndexProps$$EnhancerBySpringCGLIB$$3ec920c2]: AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.IndexProps.version
  173. 17:46:04.207 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Eagerly caching bean 'com.datalovers.processing.spark.config.properties.IndexProps' to allow for resolving potential circular references
  174. 17:46:04.213 [main] DEBUG org.springframework.beans.factory.annotation.InjectionMetadata - Processing injected element of bean 'com.datalovers.processing.spark.config.properties.IndexProps': AutowiredFieldElement for private java.lang.String com.datalovers.processing.spark.config.properties.IndexProps.version
  175. 17:46:04.214 [main] DEBUG org.springframework.core.env.PropertySourcesPropertyResolver - Found key 'index.version' in [class path resource [de-indexing/app.properties]] with type [String]
  176. 17:46:04.214 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Finished creating instance of bean 'com.datalovers.processing.spark.config.properties.IndexProps'
  177. 17:46:04.214 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating shared instance of singleton bean 'getCompanySupplier'
  178. 17:46:04.217 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating instance of bean 'getCompanySupplier'
  179. 17:46:04.217 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Returning cached instance of singleton bean 'indexingConfigurationDe'
  180. 17:46:04.255 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Eagerly caching bean 'getCompanySupplier' to allow for resolving potential circular references
  181. 17:46:04.259 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Finished creating instance of bean 'getCompanySupplier'
  182. 17:46:04.259 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating shared instance of singleton bean 'getSparkConf'
  183. 17:46:04.259 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Creating instance of bean 'getSparkConf'
  184. 17:46:04.259 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Returning cached instance of singleton bean 'indexingConfigurationDe'
  185. 17:46:04.633 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Eagerly caching bean 'getSparkConf' to allow for resolving potential circular references
  186. 17:46:04.649 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Finished creating instance of bean 'getSparkConf'
  187. 17:46:04.649 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Returning cached instance of singleton bean 'org.springframework.context.event.internalEventListenerFactory'
  188. 17:46:04.765 [main] DEBUG org.springframework.context.annotation.AnnotationConfigApplicationContext - Unable to locate LifecycleProcessor with name 'lifecycleProcessor': using default [org.springframework.context.support.DefaultLifecycleProcessor@4b3ed2f0]
  189. 17:46:04.766 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Returning cached instance of singleton bean 'lifecycleProcessor'
  190. 17:46:04.769 [main] DEBUG org.springframework.core.env.PropertySourcesPropertyResolver - Could not find key 'spring.liveBeansView.mbeanDomain' in any property source
  191. 17:46:04.771 [main] INFO com.datalovers.spark.utils.config.SpringContextFactory - Loading com.datalovers.processing.spark.config.IndexingConfigurationDe
  192. 17:46:04.773 [main] DEBUG org.springframework.beans.factory.support.DefaultListableBeanFactory - Returning cached instance of singleton bean 'getSparkConf'
  193. 17:46:04.838 [main] INFO org.apache.spark.SparkContext - Running Spark version 2.1.1
  194. 17:46:04.910 [main] DEBUG org.apache.hadoop.metrics2.lib.MutableMetricsFactory - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, sampleName=Ops, always=false, type=DEFAULT, valueName=Time, value=[Rate of successful kerberos logins and latency (milliseconds)])
  195. 17:46:04.922 [main] DEBUG org.apache.hadoop.metrics2.lib.MutableMetricsFactory - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, sampleName=Ops, always=false, type=DEFAULT, valueName=Time, value=[Rate of failed kerberos logins and latency (milliseconds)])
  196. 17:46:04.922 [main] DEBUG org.apache.hadoop.metrics2.lib.MutableMetricsFactory - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.getGroups with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, sampleName=Ops, always=false, type=DEFAULT, valueName=Time, value=[GetGroups])
  197. 17:46:04.924 [main] DEBUG org.apache.hadoop.metrics2.impl.MetricsSystemImpl - UgiMetrics, User and group related metrics
  198. 17:46:05.211 [main] DEBUG org.apache.hadoop.util.Shell - Failed to detect a valid hadoop home directory
  199. java.io.IOException: HADOOP_HOME or hadoop.home.dir are not set.
  200. at org.apache.hadoop.util.Shell.checkHadoopHome(Shell.java:303)
  201. at org.apache.hadoop.util.Shell.<clinit>(Shell.java:328)
  202. at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:80)
  203. at org.apache.hadoop.security.SecurityUtil.getAuthenticationMethod(SecurityUtil.java:611)
  204. at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:272)
  205. at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:260)
  206. at org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:790)
  207. at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:760)
  208. at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:633)
  209. at org.apache.spark.util.Utils$$anonfun$getCurrentUserName$1.apply(Utils.scala:2391)
  210. at org.apache.spark.util.Utils$$anonfun$getCurrentUserName$1.apply(Utils.scala:2391)
  211. at scala.Option.getOrElse(Option.scala:121)
  212. at org.apache.spark.util.Utils$.getCurrentUserName(Utils.scala:2391)
  213. at org.apache.spark.SparkContext.<init>(SparkContext.scala:295)
  214. at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2320)
  215. at org.apache.spark.sql.SparkSession$Builder$$anonfun$6.apply(SparkSession.scala:868)
  216. at org.apache.spark.sql.SparkSession$Builder$$anonfun$6.apply(SparkSession.scala:860)
  217. at scala.Option.getOrElse(Option.scala:121)
  218. at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:860)
  219. at com.datalovers.processing.spark.task.IndexingSparkTask.buildSession(IndexingSparkTask.java:130)
  220. at com.datalovers.processing.spark.task.IndexingSparkTask.init(IndexingSparkTask.java:67)
  221. at com.datalovers.processing.spark.task.IndexingSparkTaskDeTest.runTest(IndexingSparkTaskDeTest.java:18)
  222. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  223. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  224. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  225. at java.lang.reflect.Method.invoke(Method.java:498)
  226. at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
  227. at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
  228. at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
  229. at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
  230. at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
  231. at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
  232. at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
  233. at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
  234. at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
  235. at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
  236. at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
  237. at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
  238. at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
  239. at org.eclipse.jdt.internal.junit4.runner.JUnit4TestReference.run(JUnit4TestReference.java:86)
  240. at org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38)
  241. at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:459)
  242. at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:678)
  243. at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:382)
  244. at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:192)
  245. 17:46:05.275 [main] DEBUG org.apache.hadoop.util.Shell - setsid exited with exit code 0
  246. 17:46:05.282 [main] DEBUG org.apache.hadoop.security.authentication.util.KerberosName - Kerberos krb5 configuration not found, setting default realm to empty
  247. 17:46:05.285 [main] DEBUG org.apache.hadoop.security.Groups - Creating new Groups object
  248. 17:46:05.286 [main] DEBUG org.apache.hadoop.util.NativeCodeLoader - Trying to load the custom-built native-hadoop library...
  249. 17:46:05.287 [main] DEBUG org.apache.hadoop.util.NativeCodeLoader - Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: no hadoop in java.library.path
  250. 17:46:05.287 [main] DEBUG org.apache.hadoop.util.NativeCodeLoader - java.library.path=/usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib
  251. 17:46:05.287 [main] WARN org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  252. 17:46:05.287 [main] DEBUG org.apache.hadoop.util.PerformanceAdvisory - Falling back to shell based
  253. 17:46:05.287 [main] DEBUG org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback - Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping
  254. 17:46:05.420 [main] DEBUG org.apache.hadoop.security.Groups - Group mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback; cacheTimeout=300000; warningDeltaMs=5000
  255. 17:46:05.423 [main] DEBUG org.apache.hadoop.security.UserGroupInformation - hadoop login
  256. 17:46:05.423 [main] DEBUG org.apache.hadoop.security.UserGroupInformation - hadoop login commit
  257. 17:46:05.428 [main] DEBUG org.apache.hadoop.security.UserGroupInformation - using local user:UnixPrincipal: dev
  258. 17:46:05.429 [main] DEBUG org.apache.hadoop.security.UserGroupInformation - Using user: "UnixPrincipal: dev" with name dev
  259. 17:46:05.429 [main] DEBUG org.apache.hadoop.security.UserGroupInformation - User entry: "dev"
  260. 17:46:05.430 [main] DEBUG org.apache.hadoop.security.UserGroupInformation - UGI loginUser:dev (auth:SIMPLE)
  261. 17:46:05.483 [main] WARN org.apache.spark.util.Utils - Your hostname, dev-Vostro-5568 resolves to a loopback address: 127.0.1.1; using 192.168.111.106 instead (on interface wlp1s0)
  262. 17:46:05.483 [main] WARN org.apache.spark.util.Utils - Set SPARK_LOCAL_IP if you need to bind to another address
  263. 17:46:05.530 [main] INFO org.apache.spark.SecurityManager - Changing view acls to: dev
  264. 17:46:05.531 [main] INFO org.apache.spark.SecurityManager - Changing modify acls to: dev
  265. 17:46:05.532 [main] INFO org.apache.spark.SecurityManager - Changing view acls groups to:
  266. 17:46:05.533 [main] INFO org.apache.spark.SecurityManager - Changing modify acls groups to:
  267. 17:46:05.534 [main] INFO org.apache.spark.SecurityManager - SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(dev); groups with view permissions: Set(); users with modify permissions: Set(dev); groups with modify permissions: Set()
  268. 17:46:05.549 [main] DEBUG org.apache.spark.SecurityManager - Created SSL options for fs: SSLOptions{enabled=false, keyStore=None, keyStorePassword=None, trustStore=None, trustStorePassword=None, protocol=None, enabledAlgorithms=Set()}
  269. 17:46:05.732 [main] DEBUG io.netty.util.internal.logging.InternalLoggerFactory - Using SLF4J as the default logging framework
  270. 17:46:05.739 [main] DEBUG io.netty.util.internal.PlatformDependent0 - java.nio.Buffer.address: available
  271. 17:46:05.740 [main] DEBUG io.netty.util.internal.PlatformDependent0 - sun.misc.Unsafe.theUnsafe: available
  272. 17:46:05.741 [main] DEBUG io.netty.util.internal.PlatformDependent0 - sun.misc.Unsafe.copyMemory: available
  273. 17:46:05.743 [main] DEBUG io.netty.util.internal.PlatformDependent0 - direct buffer constructor: available
  274. 17:46:05.744 [main] DEBUG io.netty.util.internal.PlatformDependent0 - java.nio.Bits.unaligned: available, true
  275. 17:46:05.744 [main] DEBUG io.netty.util.internal.PlatformDependent0 - java.nio.DirectByteBuffer.<init>(long, int): available
  276. 17:46:05.746 [main] DEBUG io.netty.util.internal.Cleaner0 - java.nio.ByteBuffer.cleaner(): available
  277. 17:46:05.749 [main] DEBUG io.netty.util.internal.PlatformDependent - Java version: 8
  278. 17:46:05.750 [main] DEBUG io.netty.util.internal.PlatformDependent - -Dio.netty.noUnsafe: false
  279. 17:46:05.750 [main] DEBUG io.netty.util.internal.PlatformDependent - sun.misc.Unsafe: available
  280. 17:46:05.750 [main] DEBUG io.netty.util.internal.PlatformDependent - -Dio.netty.noJavassist: false
  281. 17:46:05.853 [main] DEBUG io.netty.util.internal.PlatformDependent - Javassist: available
  282. 17:46:05.854 [main] DEBUG io.netty.util.internal.PlatformDependent - -Dio.netty.tmpdir: /tmp (java.io.tmpdir)
  283. 17:46:05.857 [main] DEBUG io.netty.util.internal.PlatformDependent - -Dio.netty.bitMode: 64 (sun.arch.data.model)
  284. 17:46:05.857 [main] DEBUG io.netty.util.internal.PlatformDependent - -Dio.netty.noPreferDirect: false
  285. 17:46:05.857 [main] DEBUG io.netty.util.internal.PlatformDependent - io.netty.maxDirectMemory: 0 bytes
  286. 17:46:05.863 [main] DEBUG io.netty.util.internal.JavassistTypeParameterMatcherGenerator - Generated: io.netty.util.internal.__matchers__.org.apache.spark.network.protocol.MessageMatcher
  287. 17:46:05.874 [main] DEBUG io.netty.util.internal.JavassistTypeParameterMatcherGenerator - Generated: io.netty.util.internal.__matchers__.io.netty.buffer.ByteBufMatcher
  288. 17:46:05.897 [main] DEBUG io.netty.channel.MultithreadEventLoopGroup - -Dio.netty.eventLoopThreads: 8
  289. 17:46:05.940 [main] DEBUG io.netty.channel.nio.NioEventLoop - -Dio.netty.noKeySetOptimization: false
  290. 17:46:05.940 [main] DEBUG io.netty.channel.nio.NioEventLoop - -Dio.netty.selectorAutoRebuildThreshold: 512
  291. 17:46:05.947 [main] DEBUG io.netty.util.internal.PlatformDependent - org.jctools-core.MpscChunkedArrayQueue: available
  292. 17:46:05.982 [main] DEBUG io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.numHeapArenas: 8
  293. 17:46:05.982 [main] DEBUG io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.numDirectArenas: 8
  294. 17:46:05.982 [main] DEBUG io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.pageSize: 8192
  295. 17:46:05.982 [main] DEBUG io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.maxOrder: 11
  296. 17:46:05.982 [main] DEBUG io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.chunkSize: 16777216
  297. 17:46:05.982 [main] DEBUG io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.tinyCacheSize: 512
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!