API tools faq
paste
Guest User

Untitled

a guest
Jul 28th, 2024
206
0
Never
5
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 53.63 KB | None | 0 0
raw download clone embed print report
  1. 2024-07-28T23:57:19+0000 Summary of events during the deployment step:
  2. 2024-07-28T23:57:19+0000 Begin deployment in myhost-dev [CorrelationId: 12345678]
  3. 2024-07-28T23:57:27+0000 Update author indexes job has started.
  4. 2024-07-29T00:00:08+0000 Update author indexes job has finished successfully.
  5. 2024-07-29T00:00:08+0000 Update publish indexes job has started.
  6. 2024-07-29T00:00:24+0000 Update publish indexes job has finished successfully.
  7. 2024-07-29T00:08:42+0000 Build Transform job has started.
  8. 2024-07-29T00:23:04+0000 Build Transform job has failed.
  9. 2024-07-29T00:23:05+0000 Failed deployment in myhost-dev
  10. 2024-07-29T00:23:06+0000 Detailed events during the deployment step:
  11.  
  12. ===== source=updateAuthorIndexes.log =====
  13.  
  14. ==================== container=main, pod=cm-p123456-e654321-aem-author-index-updates-wrapper-44832wgklf ====================
  15.  
  16. 2024-07-28T23:57:52+00:00 [SkylineProxyJob] Waiting for the previous job for cm-p123456-e654321 to be finished.
  17. 2024-07-28T23:57:53+00:00 [SkylineProxyJob] Previous job name: cm-p123456-e654321-aem-index-updates-m2sgs
  18. 2024-07-28T23:57:53+00:00 [SkylineProxyJob] Waiting until it's finished
  19. 2024-07-28T23:57:53+00:00 [SkylineProxyJob] Waiting 43200s for job state Failed|Complete|Pending.
  20. 2024-07-28T23:57:55+00:00 [SkylineProxyJob] Got the expected state: Complete
  21. 2024-07-28T23:57:56+00:00 [SkylineProxyJob] Waiting for the previous job for cm-p123456-e654321-prev to be finished.
  22. 2024-07-28T23:57:58+00:00 [SkylineProxyJob] Previous job name: cm-p123456-e654321-prev-aem-index-updates-z8rvr
  23. 2024-07-28T23:57:58+00:00 [SkylineProxyJob] Waiting until it's finished
  24. 2024-07-28T23:57:58+00:00 [SkylineProxyJob] Waiting 43200s for job state Failed|Complete|Pending.
  25. 2024-07-28T23:57:59+00:00 [SkylineProxyJob] Got the expected state: Complete
  26. 2024-07-28T23:57:59+00:00 [SkylineProxyJob] Updating the environment
  27. % Total % Received % Xferd Average Speed Time Time Time Current
  28. Dload Upload Total Spent Left Speed
  29.  
  30. 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
  31. 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
  32. 100 4615 100 4615 0 0 5558 0 --:--:-- --:--:-- --:--:-- 5553
  33. 2024-07-28T23:58:01+00:00 [SkylineProxyJob] create_json_patch called with: (/spec/indexingJob, {"actionTimestamp":"2024-07-18T02:26:17.904361Z","aemBaseImage":"aem-ethos/aem:fe1695ce81","branchId":"f2f89b74-1e99-4eb0-a7c6-cd5b952a26d0","chartVersion":"1.1.0+8e98cfc3","customerIndexDefinitions":{"checksum":"SHA-512:b35d6074ee8209ec4bbfb29e380e581181993988908ea2f33aadf09daa1724dbbc869369af33a070a6b8f921ecc3bfce810e173b11c01f6cc9daa5dadba2c1f1","location":"https://cm0pl0va80stor0prd.file.core.windows.net/30a7a821-0f12-4637-9539-6ce6d60f165d/build/indexing-job-vars.env?sig=JiP3%2Fo7XsFhTcYZaFvOQoUYnSDK2Z6rnhvVsBHNFBD0%3D\u0026se=2024-09-26T02%3A26%3A17Z\u0026sv=2019-02-02\u0026rsct=application%2Foctet-stream\u0026rscd=attachment%3B%20filename%3Dbuild%2Findexing-job-vars.env\u0026sp=r\u0026sr=f"},"enabled":true,"rollbackFlag":"false"}, authorImage, AUTHOR_IMAGE, publishImage, PUBLISH_IMAGE, chartVersion, CHART_VERSION, aemBaseImage, AEM_BASE_IMAGE, customerIndexDefinitions, CUSTOMER_INDEX_DEFINITIONS, branchId, BRANCH_ID, rollbackFlag, ROLLBACK_FLAG, actionTimestamp, ACTION_TIMESTAMP)
  34. 2024-07-28T23:58:02+00:00 [SkylineProxyJob] patch: [{"op": "replace", "path": "/spec/indexingJob/chartVersion", "value":"1.1.0+8e98cfc3"}, {"op": "replace", "path": "/spec/indexingJob/aemBaseImage", "value":"aem-ethos/aem:fe1695ce81"}, {"op": "replace", "path": "/spec/indexingJob/customerIndexDefinitions", "value":{"location": "https://cm0pl0va80stor0prd.file.core.windows.net/5ccc78a3-9d78-476c-8db7-ebf94b9e8bd4/build/indexing-job-vars.env?sig=gM960oudL7FU%2FrLtQkTHCA2ib%2BgWx4eAdp9YA33ziBg%3D&se=2024-10-06T23%3A57%3A17Z&sv=2019-02-02&rsct=application%2Foctet-stream&rscd=attachment%3B%20filename%3Dbuild%2Findexing-job-vars.env&sp=r&sr=f", "checksum": "SHA-512:b35d6074ee8209ec4bbfb29e380e581181993988908ea2f33aadf09daa1724dbbc869369af33a070a6b8f921ecc3bfce810e173b11c01f6cc9daa5dadba2c1f1"}}, {"op": "replace", "path": "/spec/indexingJob/branchId", "value":"f2f89b74-1e99-4eb0-a7c6-cd5b952a26d0"}, {"op": "replace", "path": "/spec/indexingJob/rollbackFlag", "value":"false"}, {"op": "replace", "path": "/spec/indexingJob/actionTimestamp", "value":"2024-07-28T23:57:17.887507Z"}]
  35. 2024-07-28T23:58:02+00:00 [SkylineProxyJob] Patching: cm-p123456-e654321
  36. skylineenvironment.skyline.adobe.com/cm-p123456-e654321 patched
  37. 2024-07-28T23:58:04+00:00 [SkylineProxyJob] Patching: cm-p123456-e654321-prev
  38. skylineenvironment.skyline.adobe.com/cm-p123456-e654321-prev patched
  39. 2024-07-28T23:58:05+00:00 [SkylineProxyJob] Starting indexing job for the cm-p123456-e654321
  40. 2024-07-28T23:58:05+00:00 [SkylineProxyJob] Waiting until the job status changes
  41. 2024-07-28T23:58:05+00:00 [SkylineProxyJob] Waiting 600s for a new job (old name: cm-p123456-e654321-aem-index-updates-m2sgs).
  42. 2024-07-28T23:58:13+00:00 [SkylineProxyJob] Waiting for the new job to be created
  43. 2024-07-28T23:58:13+00:00 [SkylineProxyJob] Waiting 600s for job state Failed|Complete|Progressing.
  44. 2024-07-28T23:58:15+00:00 [SkylineProxyJob] Got the expected state: Progressing
  45. 2024-07-28T23:58:16+00:00 [SkylineProxyJob] Waiting while cm-p123456-e654321-aem-index-updates-8nnbc is progressing
  46. 2024-07-28T23:58:16+00:00 [SkylineProxyJob] Waiting 43200s for job state Failed|Complete.
  47. 2024-07-28T23:58:19+00:00 [SkylineProxyJob] Job state: Progressing
  48. 2024-07-28T23:58:26+00:00 [SkylineProxyJob] Job state: Progressing
  49. 2024-07-28T23:58:34+00:00 [SkylineProxyJob] Job state: Progressing
  50. 2024-07-28T23:58:42+00:00 [SkylineProxyJob] Job state: Progressing
  51. 2024-07-28T23:58:49+00:00 [SkylineProxyJob] Job state: Progressing
  52. 2024-07-28T23:58:57+00:00 [SkylineProxyJob] - skyline.job.internalState.state = Complete
  53. job.batch/cm-p123456-e654321-aem-author-index-updates-wrapper-4483278 annotated
  54. pod/cm-p123456-e654321-aem-author-index-updates-wrapper-44832wgklf annotated
  55. 2024-07-28T23:58:59+00:00 [SkylineProxyJob] - skyline.job.internalState.reason = authorIndexing:CompleteWithNoNewIndexesFound,publishIndexing:CompleteWithNoNewIndexesFound
  56. job.batch/cm-p123456-e654321-aem-author-index-updates-wrapper-4483278 annotated
  57. pod/cm-p123456-e654321-aem-author-index-updates-wrapper-44832wgklf annotated
  58. 2024-07-28T23:59:01+00:00 [SkylineProxyJob] Job state: Progressing
  59. 2024-07-28T23:59:09+00:00 [SkylineProxyJob] Got the expected state: Complete
  60. 2024-07-28T23:59:10+00:00 [SkylineProxyJob] Gettings logs from all containers in cm-p123456-e654321-aem-index-updates-8nnbc
  61. 2024-07-28T23:59:11+00:00 [SkylineProxyJob] -------------------- start container=copy-author-seed-to-volume, job=cm-p123456-e654321-aem-index-updates-8nnbc --------------------
  62. 2024-07-28T23:59:12+00:00 [SkylineProxyJob] -------------------- end container=copy-author-seed-to-volume logs --------------------
  63. 2024-07-28T23:59:12+00:00 [SkylineProxyJob] -------------------- start container=copy-publish-seed-to-volume, job=cm-p123456-e654321-aem-index-updates-8nnbc --------------------
  64. 2024-07-28T23:59:13+00:00 [SkylineProxyJob] -------------------- end container=copy-publish-seed-to-volume logs --------------------
  65. 2024-07-28T23:59:13+00:00 [SkylineProxyJob] -------------------- start container=add-index-author, job=cm-p123456-e654321-aem-index-updates-8nnbc --------------------
  66. aem-indexing/tools:1.0.116
  67. Waiting for splunk forwarding to start..
  68. Fluent Bit v1.9.9
  69. * Copyright (C) 2015-2022 The Fluent Bit Authors
  70. * Fluent Bit is a CNCF sub-project under the umbrella of Fluentd
  71. * https://fluentbit.io
  72.  
  73. [2024/07/28 23:58:14] [ info] [fluent bit] version=1.9.9, commit=, pid=17
  74. [2024/07/28 23:58:14] [ info] [storage] created root path /var/log/flb-storage/
  75. [2024/07/28 23:58:14] [ info] [storage] version=1.3.0, type=memory+filesystem, sync=normal, checksum=disabled, max_chunks_up=128
  76. [2024/07/28 23:58:14] [ info] [storage] backlog input plugin: storage_backlog.1
  77. [2024/07/28 23:58:14] [ info] [cmetrics] version=0.3.7
  78. [2024/07/28 23:58:14] [ info] [input:storage_backlog:storage_backlog.1] queue memory limit: 95.4M
  79. [2024/07/28 23:58:14] [ info] [output:splunk:splunk.0] worker #0 started
  80. [2024/07/28 23:58:14] [ info] [output:splunk:splunk.0] worker #1 started
  81. [2024/07/28 23:58:14] [ info] [http_server] listen iface=0.0.0.0 tcp_port=2020
  82. [2024/07/28 23:58:14] [ info] [sp] stream processor started
  83. splunk forwarding started!
  84. 23:58:49.358 [main] INFO add.index.author - aem-indexing/tools:1.0.116
  85. /opt/aem/add-index-author.sh: line 80: get_azure_account: command not found
  86. /opt/aem/add-index-author.sh: line 81: get_azure_access_key: command not found
  87. 23:58:49.358 [main] INFO add.index.author - STEP: Download customer index definitions started
  88. 23:58:49.358 [main] INFO add.index.author - Running on top of the base image, downloading customer index definitions
  89. 23:58:50.358 [main] INFO add.index.author - Extracting & decoding customer index definitions from downloaded file
  90. 23:58:50.358 [main] INFO add.index.author - STEP: Download customer index definitions ended
  91. 23:58:50.358 [main] INFO add.index.author - STEP::INDEX_DELETION started
  92. 23:58:50.358 [main] INFO add.index.author - Checking to see if some indexes are marked for deletion.
  93. 23:58:50.358 [main] INFO add.index.author - No indexes marked for deletion. Moving forward.
  94. 23:58:50.358 [main] INFO add.index.author - STEP::INDEX_DELETION ended
  95. 23:58:51.358 [main] INFO add.index.author - STEP::INDEX_COMPARISON started
  96. 23:58:51.358 [main] INFO add.index.author - Getting new indexes...
  97. 23:58:52.097 [main] INFO o.a.j.oak.segment.file.FileStore - Creating file store FileStoreBuilder{version=null, directory=/mnt/sandbox/segmentstore, blobStore=null, binariesInlineThreshold=16512, maxFileSize=256, segmentCacheSize=256, stringCacheSize=256, templateCacheSize=64, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1048576, memoryMapping=true, offHeapAccess=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL, compactorType=PARALLEL_COMPACTOR}}
  98. 23:58:52.286 [main] INFO o.a.j.oak.segment.file.FileStore - TarMK opened at /mnt/sandbox/segmentstore, mmap=true, offHeapAccess=false, size=306.4 MB (306369536 bytes)
  99. 23:58:52.298 [main] INFO o.a.j.o.s.SegmentNodeStore$SegmentNodeStoreBuilder - Creating segment node store SegmentNodeStoreBuilder{blobStore=inline}
  100. 23:58:52.304 [main] INFO o.a.j.o.s.s.LockBasedScheduler - Initializing SegmentNodeStore with the commitFairLock option enabled.
  101. 23:58:52.339 [main] INFO o.a.j.o.b.c.a.b.AzureBlobStoreBackend - Using concurrentRequestsPerOperation=4
  102. 23:58:52.728 [main] INFO o.a.j.o.b.c.a.b.AzureBlobStoreBackend - Reusing existing container. containerName=aem-blob-ns-team-aem-cm-prd-n106455-cm-p123456-e654321
  103. 23:58:52.728 [main] INFO o.a.j.o.b.c.a.b.AzureBlobStoreBackend - presigned GET URI cache enabled, maxSize = 1024 items, expiry = 21600 seconds
  104. 23:58:52.787 [main] INFO o.a.j.o.p.blob.UploadStagingCache - Scheduling pending uploads
  105. 23:58:52.788 [main] INFO o.a.j.o.p.b.DataStoreCacheUpgradeUtils - Deleted asyncUploadMap [async-pending-uploads.ser] from [/tmp/indexing-test12701633783796926156]
  106. 23:58:52.790 [main] INFO o.a.j.o.p.blob.UploadStagingCache - Scheduled [0] pending uploads
  107. 23:58:52.801 [pool-4-thread-1] INFO o.a.j.oak.plugins.blob.FileCache - Cache built with [0] files from file system in [0] seconds
  108. 23:58:53.140 [main] INFO o.a.j.o.p.d.mongo.MongoDocumentStore - Connected to MongoDB 5.0.28 with maxReplicationLagMillis 21600000, maxDeltaForModTimeIdxSecs 60, disableIndexHint false, leaseSocketTimeout 0, clientSessionSupported true, clientSessionInUse true, WriteConcern{w=majority, wTimeout=null ms, fsync=null, journal=null, serverStatus {process=mongod, mem={"bits": 64, "resident": 612, "virtual": 2816, "supported": true}, host=atlas-v0ma66-shard-00-02.ier5g.mongodb.net, repl={"topologyVersion": {"processId": {"$oid": "669966ebfc10997384012fa4"}, "counter": {"$numberLong": "6"}}, "hosts": ["cmp111880e654321rf2f89-shard-00-00.ier5g.mongodb.net:27017", "cmp111880e654321rf2f89-shard-00-01.ier5g.mongodb.net:27017", "cmp111880e654321rf2f89-shard-00-02.ier5g.mongodb.net:27017"], "setName": "atlas-v0ma66-shard-0", "setVersion": 164, "isWritablePrimary": true, "secondary": false, "primary": "cmp111880e654321rf2f89-shard-00-02.ier5g.mongodb.net:27017", "tags": {"nodeType": "ELECTABLE", "provider": "AZURE", "region": "AUSTRALIA_EAST", "diskState": "READY", "workloadType": "OPERATIONAL", "availabilityZone": "3"}, "me": "cmp111880e654321rf2f89-shard-00-02.ier5g.mongodb.net:27017", "electionId": {"$oid": "7fffffff0000000000000271"}, "lastWrite": {"opTime": {"ts": {"$timestamp": {"t": 1722211130, "i": 4}}, "t": {"$numberLong": "625"}}, "lastWriteDate": {"$date": 1722211130000}, "majorityOpTime": {"ts": {"$timestamp": {"t": 1722211130, "i": 4}}, "t": {"$numberLong": "625"}}, "majorityWriteDate": {"$date": 1722211130000}}, "primaryOnlyServices": {"TenantMigrationDonorService": {"state": "running", "numInstances": 0}, "TenantMigrationRecipientService": {"state": "running", "numInstances": 0}}, "rbid": 1}, connections={"current": 82, "available": 1418, "totalCreated": 516115, "active": 18, "threaded": 82, "limitExempt": 9, "exhaustIsMaster": 2, "exhaustHello": 12, "awaitingTopologyChanges": 114527}, storageEngine={"name": "wiredTiger", "supportsCommittedReads": true, "oldestRequiredTimestampForCrashRecovery": {"$timestamp": {"t": 1722211115, "i": 16}}, "supportsPendingDrops": true, "dropPendingIdents": {"$numberLong": "0"}, "supportsSnapshotReadConcern": true, "readOnly": false, "persistent": true, "backupCursorOpen": false, "supportsResumableIndexBuilds": true}}, throttlingSupported false
  109. 23:58:53.149 [main] INFO o.a.j.o.p.document.DocumentNodeStore - System property oak.documentMK.disableSweep2 found to be 'true'
  110. 23:58:53.158 [main] INFO o.a.j.o.p.document.DocumentNodeStore - Server time difference: -8ms (max allowed: 2000ms)
  111. 23:58:53.192 [main] INFO o.a.j.o.p.d.V.auditDGC - <init> VersionGarbageCollector created with fullGcMode = NONE
  112. 23:58:53.201 [main] INFO o.a.j.o.p.d.p.PersistentCache - start, url=/tmp/indexing-test12572301260669270896/diff-cache
  113. 23:58:53.238 [main] INFO o.a.j.o.p.d.p.PersistentCache - wrapping map LOCAL_DIFF
  114. 23:58:53.239 [main] INFO o.a.j.o.p.d.p.NodeCache - The persistent cache LOCAL_DIFF writes will be synchronous
  115. 23:58:53.243 [main] INFO o.a.j.o.p.d.p.PersistentCache - wrapping map DIFF
  116. 23:58:53.243 [main] INFO o.a.j.o.p.d.p.NodeCache - The persistent cache DIFF writes will be synchronous
  117. 23:58:53.283 [main] INFO o.a.j.o.p.document.DocumentNodeStore - ChangeSetBuilder enabled and size set to maxItems: 50, maxDepth: 9
  118. 23:58:53.293 [main] INFO o.a.j.o.p.document.DocumentNodeStore - Initialized DocumentNodeStore with clusterNodeId: 0, updateLimit: 100000 (readOnly:true, id: 0, startTime: 1722211133173, machineId: mac:bee892ddb017, instanceId: /, runtimeId: 950b487b-d6eb-441a-9f6b-72a1a50a4093, pid: 113, uuid: b212a6bd-1337-42c1-ae7c-fd6cd35fdc6e, readWriteMode: null, leaseCheckMode: STRICT, state: ACTIVE, oakVersion: 1.64-T20240626165925-b2552b4, formatVersion: 1.8.0, invisible: true)
  119. 23:58:53.343 [main] INFO o.a.j.o.p.d.b.BundlingConfigHandler - Refreshing the BundledTypesRegistry
  120. 23:58:53.344 [main] INFO o.a.j.o.p.d.b.BundlingConfigHandler - Bundling of nodes enabled
  121. 23:58:53.354 [main] INFO indexing-task - [TASK:COMPARE_INDEXES:START] Starting index comparison
  122. 23:58:53.506 [main] INFO c.a.granite.indexing.tool.CompareCmd - Reading from index definition file /mnt/job-config/index-def.json
  123. 23:58:54.550 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/acPrincipalName
  124. 23:58:54.551 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/appsLibsLucene
  125. 23:58:54.551 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/assetLinkShare-1
  126. 23:58:54.551 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/assetPrefixNodename-1
  127. 23:58:54.551 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/authorizableId
  128. 23:58:54.551 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/authorizables
  129. 23:58:54.551 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/cmLucene-2
  130. 23:58:54.551 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/commerceLucene
  131. 23:58:54.551 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/contentFragments-1
  132. 23:58:54.551 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/counter
  133. 23:58:54.551 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/cqPageLucene
  134. 23:58:54.551 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/cqPageLucene-0-custom-4
  135. 23:58:54.551 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/cqPayloadPath
  136. 23:58:54.551 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/cqProjectLucene
  137. 23:58:54.551 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/cqReportsLucene
  138. 23:58:54.551 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/cqTagLucene-3
  139. 23:58:54.551 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/damAssetLucene-11
  140. 23:58:54.551 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/damAssetStateIndex-6
  141. 23:58:54.551 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/damCollectionLucene-4
  142. 23:58:54.551 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/designFiles-1
  143. 23:58:54.552 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/experienceFragmentsIndex-3
  144. 23:58:54.552 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/externalId
  145. 23:58:54.552 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/externalPrincipalNames
  146. 23:58:54.552 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/formsTemplateLucene
  147. 23:58:54.552 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/fragments-11
  148. 23:58:54.552 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/graphqlConfig-2
  149. 23:58:54.552 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/guidesAssetProperties-1
  150. 23:58:54.552 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/guidesKonnect-1
  151. 23:58:54.552 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/guidesProperties-1
  152. 23:58:54.552 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/internalVerificationLucene
  153. 23:58:54.552 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/jcrLanguage
  154. 23:58:54.552 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/nodetype
  155. 23:58:54.552 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/nodetypeLucene
  156. 23:58:54.552 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/ntBaseLucene-2
  157. 23:58:54.552 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/ntFileFolderLucene
  158. 23:58:54.552 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/ntFolderDamLucene-9
  159. 23:58:54.552 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/packageLucene
  160. 23:58:54.552 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/pathReference
  161. 23:58:54.552 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/principalName
  162. 23:58:54.552 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/reference
  163. 23:58:54.552 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/repAccessControllableDamLucene-1
  164. 23:58:54.552 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/repMembers
  165. 23:58:54.552 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/repTokenIndex
  166. 23:58:54.552 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/screensContentJcrPrimaryType
  167. 23:58:54.553 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/screensSmartSyncJcrPrimaryType
  168. 23:58:54.553 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/slingQuickSites-1
  169. 23:58:54.553 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/slingResourceResolver-3
  170. 23:58:54.553 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/slingSitemaps-1
  171. 23:58:54.553 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/slingeventJob-2
  172. 23:58:54.553 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/slingeventJobStart
  173. 23:58:54.553 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/socialLucene
  174. 23:58:54.553 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/uuid
  175. 23:58:54.553 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/versionStoreIndex
  176. 23:58:54.553 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/workflowDataLucene-2
  177. 23:58:54.555 [main] INFO c.a.granite.indexing.tool.CompareCmd - Index merging complete!
  178. 23:58:54.556 [main] INFO c.a.granite.indexing.tool.CompareCmd - Merging created 0 new index definitions
  179. 23:58:54.560 [main] INFO indexing-task - [TASK:COMPARE_INDEXES:END] Metrics: {"duration":"00:00:01","durationSeconds":1}
  180. 23:58:54.560 [main] INFO o.a.j.o.p.document.DocumentNodeStore - Starting disposal of DocumentNodeStore with clusterNodeId: 0 (readOnly:true, id: 0, startTime: 1722211133173, machineId: mac:bee892ddb017, instanceId: /, runtimeId: 950b487b-d6eb-441a-9f6b-72a1a50a4093, pid: 113, uuid: b212a6bd-1337-42c1-ae7c-fd6cd35fdc6e, readWriteMode: null, leaseCheckMode: STRICT, state: ACTIVE, oakVersion: 1.64-T20240626165925-b2552b4, formatVersion: 1.8.0, invisible: true)
  181. 23:58:54.568 [main] INFO o.a.j.o.b.c.a.b.AzureBlobContainerProvider - Refresh token executor service shutdown completed
  182. 23:58:54.568 [main] INFO o.a.j.o.b.c.a.b.AzureBlobStoreBackend - AzureBlobBackend closed.
  183. 23:58:54.571 [main] INFO o.a.j.oak.plugins.blob.FileCache - Cache stats on close [CacheStats{hitCount=0, hitRate=1.00, missCount=0, missRate=0.00, requestCount=0, loadCount=0, loadSuccessCount=0, loadExceptionCount=0, totalLoadTime=0 min, 0 sec, averageLoadPenalty=0.00 ns, evictionCount=0, elementCount=0, totalWeight=0 B, maxWeight=61.8 GB}]
  184. 23:58:54.571 [main] INFO o.a.j.o.p.blob.UploadStagingCache - Uploads in progress on close [0]
  185. 23:58:54.571 [main] INFO o.a.j.o.p.blob.UploadStagingCache - Uploads completed but not cleared from cache [0]
  186. 23:58:54.571 [main] INFO o.a.j.o.p.blob.UploadStagingCache - Staging cache stats on close [StagingCacheStats{requestCount=0, hitCount=0, hitRate=0.00, missCount=0, missRate=0.00, loadCount=0, loadSuccessCount=0, elementCount=0, currentMemSize=0, totalWeight=0 B, maxWeight=6.9 GB}]
  187. 23:58:54.582 [main] INFO o.a.j.o.p.document.DocumentNodeStore - Disposed DocumentNodeStore with clusterNodeId: 0, (successful)
  188. 23:58:54.629 [main] INFO o.a.j.oak.segment.file.FileStore - TarMK closed: /mnt/sandbox/segmentstore
  189. 23:58:54.358 [main] INFO add.index.author - STEP::INDEX_COMPARISON ended
  190. 23:58:54.358 [main] INFO add.index.author - The new lucene index definitions are:
  191. {}
  192.  
  193. 23:58:54.358 [main] INFO add.index.author - The new elastic index definitions are:
  194. {}
  195.  
  196. 23:58:54.358 [main] INFO add.index.author - No new indexes found
  197. pod/cm-p123456-e654321-aem-index-updates-8nnbc-2js9w annotated
  198. pod/cm-p123456-e654321-aem-index-updates-8nnbc-2js9w annotated
  199. bytes_to_send = 16073
  200. bytes_processed =
  201. logsWaitComplete = 10
  202. logsWaitTimeout = 300
  203. Waited 10 of 300 seconds
  204. [2024/07/28 23:59:14] [ info] [input:tail:tail.0] inotify_fs_add(): inode=63702090 watch_fd=1 name=/opt/aem/work/logs/job.log
  205. 2024-07-28T23:59:14+00:00 [SkylineProxyJob] -------------------- end container=add-index-author logs --------------------
  206. 2024-07-28T23:59:14+00:00 [SkylineProxyJob] -------------------- start container=add-index-publish, job=cm-p123456-e654321-aem-index-updates-8nnbc --------------------
  207. aem-indexing/tools:1.0.116
  208. Waiting for splunk forwarding to start..
  209. Fluent Bit v1.9.9
  210. * Copyright (C) 2015-2022 The Fluent Bit Authors
  211. * Fluent Bit is a CNCF sub-project under the umbrella of Fluentd
  212. * https://fluentbit.io
  213.  
  214. [2024/07/28 23:58:15] [ info] [fluent bit] version=1.9.9, commit=, pid=17
  215. [2024/07/28 23:58:15] [ info] [storage] created root path /var/log/flb-storage/
  216. [2024/07/28 23:58:15] [ info] [storage] version=1.3.0, type=memory+filesystem, sync=normal, checksum=disabled, max_chunks_up=128
  217. [2024/07/28 23:58:15] [ info] [storage] backlog input plugin: storage_backlog.1
  218. [2024/07/28 23:58:15] [ info] [cmetrics] version=0.3.7
  219. [2024/07/28 23:58:15] [ info] [input:storage_backlog:storage_backlog.1] queue memory limit: 95.4M
  220. [2024/07/28 23:58:15] [ info] [output:splunk:splunk.0] worker #0 started
  221. [2024/07/28 23:58:15] [ info] [output:splunk:splunk.0] worker #1 started
  222. [2024/07/28 23:58:15] [ info] [http_server] listen iface=0.0.0.0 tcp_port=2020
  223. [2024/07/28 23:58:15] [ info] [sp] stream processor started
  224. splunk forwarding started!
  225. 23:58:49.358 [main] INFO add.index.publish - aem-indexing/tools:1.0.116
  226. 23:58:50.358 [main] INFO add.index.publish - The most recent container is aem-sgmt-68615a948d827e4b8ea05d1d43ca9e0db1f2b721-0001b5
  227. 23:58:50.358 [main] INFO add.index.publish - STEP: Download customer index definitions started
  228. 23:58:50.358 [main] INFO add.index.publish - Running on top of the base image, downloading customer index definitions
  229. 23:58:51.358 [main] INFO add.index.publish - Extracting & decoding customer index definitions from downloaded file
  230. 23:58:51.358 [main] INFO add.index.publish - STEP: Download customer index definitions ended
  231. 23:58:51.358 [main] INFO add.index.publish - STEP::INDEX_DELETION started
  232. 23:58:51.358 [main] INFO add.index.publish - Checking to see if some indexes are marked for deletion.
  233. 23:58:51.358 [main] INFO add.index.publish - No indexes marked for deletion. Moving forward.
  234. 23:58:51.358 [main] INFO add.index.publish - STEP::INDEX_DELETION ended
  235. 23:58:51.358 [main] INFO add.index.publish - STEP::INDEX_COMPARISON started
  236. 23:58:51.358 [main] INFO add.index.publish - Getting new indexes...
  237. 23:58:51.637 [main] INFO o.a.j.oak.segment.file.FileStore - Creating file store FileStoreBuilder{version=null, directory=/mnt/sandbox/segmentstore, blobStore=null, binariesInlineThreshold=16512, maxFileSize=256, segmentCacheSize=256, stringCacheSize=256, templateCacheSize=64, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1048576, memoryMapping=true, offHeapAccess=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL, compactorType=PARALLEL_COMPACTOR}}
  238. 23:58:51.824 [main] INFO o.a.j.oak.segment.file.FileStore - TarMK opened at /mnt/sandbox/segmentstore, mmap=true, offHeapAccess=false, size=308.6 MB (308552704 bytes)
  239. 23:58:51.835 [main] INFO o.a.j.o.s.SegmentNodeStore$SegmentNodeStoreBuilder - Creating segment node store SegmentNodeStoreBuilder{blobStore=inline}
  240. 23:58:51.841 [main] INFO o.a.j.o.s.s.LockBasedScheduler - Initializing SegmentNodeStore with the commitFairLock option enabled.
  241. 23:58:51.875 [main] INFO o.a.j.o.b.c.a.b.AzureBlobStoreBackend - Using concurrentRequestsPerOperation=4
  242. 23:58:52.321 [main] INFO o.a.j.o.b.c.a.b.AzureBlobStoreBackend - Reusing existing container. containerName=aem-blob-ns-team-aem-cm-prd-n106455-cm-p123456-e654321
  243. 23:58:52.321 [main] INFO o.a.j.o.b.c.a.b.AzureBlobStoreBackend - presigned GET URI cache enabled, maxSize = 1024 items, expiry = 1800 seconds
  244. 23:58:52.397 [main] INFO o.a.j.o.p.blob.UploadStagingCache - Scheduling pending uploads
  245. 23:58:52.398 [main] INFO o.a.j.o.p.b.DataStoreCacheUpgradeUtils - Deleted asyncUploadMap [async-pending-uploads.ser] from [/tmp/indexing-test10910508833232774793]
  246. 23:58:52.400 [main] INFO o.a.j.o.p.blob.UploadStagingCache - Scheduled [0] pending uploads
  247. 23:58:52.413 [pool-4-thread-1] INFO o.a.j.oak.plugins.blob.FileCache - Cache built with [0] files from file system in [0] seconds
  248. 23:58:53.069 [main] INFO o.a.j.oak.segment.file.FileStore - Creating file store FileStoreBuilder{version=null, directory=/tmp/indexing-test10272402685169426983, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.oak.blob.cloud.azure.blobstorage.AzureDataStore], binariesInlineThreshold=16512, maxFileSize=256, segmentCacheSize=256, stringCacheSize=256, templateCacheSize=64, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1048576, memoryMapping=true, offHeapAccess=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL, compactorType=PARALLEL_COMPACTOR}}
  249. 23:58:53.209 [main] INFO o.a.j.oak.segment.file.FileStore - TarMK opened at /tmp/indexing-test10272402685169426983, mmap=true, offHeapAccess=false, size=28.5 MB (28501285 bytes)
  250. 23:58:53.223 [main] INFO o.a.j.o.s.SegmentNodeStore$SegmentNodeStoreBuilder - Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.oak.blob.cloud.azure.blobstorage.AzureDataStore]}
  251. 23:58:53.224 [main] INFO o.a.j.o.s.s.LockBasedScheduler - Initializing SegmentNodeStore with the commitFairLock option enabled.
  252. 23:58:53.284 [main] INFO indexing-task - [TASK:COMPARE_INDEXES:START] Starting index comparison
  253. 23:58:53.450 [main] INFO c.a.granite.indexing.tool.CompareCmd - Reading from index definition file /mnt/job-config/index-def.json
  254. 23:58:54.082 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/acPrincipalName
  255. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/appsLibsLucene
  256. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/assetLinkShare-1
  257. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/assetPrefixNodename-1
  258. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/authorizableId
  259. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/authorizables
  260. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/cmLucene-2
  261. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/commerceLucene
  262. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/contentFragments-1
  263. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/counter
  264. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/cqPageLucene
  265. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/cqPageLucene-0-custom-4
  266. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/cqPayloadPath
  267. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/cqProjectLucene
  268. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/cqReportsLucene
  269. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/cqTagLucene-3
  270. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/damAssetLucene-11
  271. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/damAssetStateIndex-6
  272. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/damCollectionLucene-4
  273. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/designFiles-1
  274. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/experienceFragmentsIndex-3
  275. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/externalId
  276. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/externalPrincipalNames
  277. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/formsTemplateLucene
  278. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/fragments-11
  279. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/graphqlConfig-2
  280. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/guidesAssetProperties-1
  281. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/guidesKonnect-1
  282. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/guidesProperties-1
  283. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/internalVerificationLucene
  284. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/jcrLanguage
  285. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/nodetype
  286. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/nodetypeLucene
  287. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/ntBaseLucene-2
  288. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/ntFileFolderLucene
  289. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/ntFolderDamLucene-9
  290. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/packageLucene
  291. 23:58:54.083 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/pathReference
  292. 23:58:54.084 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/principalName
  293. 23:58:54.084 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/reference
  294. 23:58:54.084 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/repAccessControllableDamLucene-1
  295. 23:58:54.084 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/repMembers
  296. 23:58:54.084 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/repTokenIndex
  297. 23:58:54.084 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/screensContentJcrPrimaryType
  298. 23:58:54.084 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/screensSmartSyncJcrPrimaryType
  299. 23:58:54.084 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/slingQuickSites-1
  300. 23:58:54.084 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/slingResourceResolver-3
  301. 23:58:54.084 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/slingSitemaps-1
  302. 23:58:54.084 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/slingeventJob-2
  303. 23:58:54.084 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/slingeventJobStart
  304. 23:58:54.084 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/socialLucene
  305. 23:58:54.084 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/uuid
  306. 23:58:54.084 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/versionStoreIndex
  307. 23:58:54.084 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/workflowDataLucene-2
  308. 23:58:54.085 [main] INFO c.a.granite.indexing.tool.CompareCmd - Index merging complete!
  309. 23:58:54.086 [main] INFO c.a.granite.indexing.tool.CompareCmd - Merging created 0 new index definitions
  310. 23:58:54.089 [main] INFO indexing-task - [TASK:COMPARE_INDEXES:END] Metrics: {"duration":"00:00:00","durationSeconds":0}
  311. 23:58:54.122 [main] INFO o.a.j.oak.segment.file.FileStore - TarMK closed: /tmp/indexing-test10272402685169426983
  312. 23:58:54.161 [main] INFO o.a.j.oak.segment.file.FileStore - TarMK closed: /mnt/sandbox/segmentstore
  313. 23:58:54.358 [main] INFO add.index.publish - STEP::INDEX_COMPARISON ended
  314. 23:58:54.358 [main] INFO add.index.publish - The new lucene index definitions are:
  315. {}
  316.  
  317. 23:58:54.358 [main] INFO add.index.publish - The new elastic index definitions are:
  318. {}
  319.  
  320. 23:58:54.358 [main] INFO add.index.publish - No new indexes found
  321. pod/cm-p123456-e654321-aem-index-updates-8nnbc-2js9w annotated
  322. pod/cm-p123456-e654321-aem-index-updates-8nnbc-2js9w annotated
  323. 23:58:54.358 [main] INFO add.index.publish - No need to re-enable compaction. Compaction has not been disabled.
  324. bytes_to_send = 12127
  325. bytes_processed =
  326. logsWaitComplete = 10
  327. logsWaitTimeout = 300
  328. Waited 10 of 300 seconds
  329. [2024/07/28 23:59:15] [ info] [input:tail:tail.0] inotify_fs_add(): inode=63702117 watch_fd=1 name=/opt/aem/work/logs/job.log
  330. 2024-07-28T23:59:15+00:00 [SkylineProxyJob] -------------------- end container=add-index-publish logs --------------------
  331. 2024-07-28T23:59:16+00:00 [SkylineProxyJob] Starting indexing job for the cm-p123456-e654321-prev
  332. 2024-07-28T23:59:16+00:00 [SkylineProxyJob] Waiting until the job status changes
  333. 2024-07-28T23:59:16+00:00 [SkylineProxyJob] Waiting 600s for a new job (old name: cm-p123456-e654321-prev-aem-index-updates-z8rvr).
  334. 2024-07-28T23:59:17+00:00 [SkylineProxyJob] Waiting for the new job to be created
  335. 2024-07-28T23:59:17+00:00 [SkylineProxyJob] Waiting 600s for job state Failed|Complete|Progressing.
  336. 2024-07-28T23:59:19+00:00 [SkylineProxyJob] Got the expected state: Complete
  337. 2024-07-28T23:59:20+00:00 [SkylineProxyJob] Waiting while cm-p123456-e654321-prev-aem-index-updates-9dgq5 is progressing
  338. 2024-07-28T23:59:20+00:00 [SkylineProxyJob] Waiting 43200s for job state Failed|Complete.
  339. 2024-07-28T23:59:23+00:00 [SkylineProxyJob] - skyline.job.internalState.preview_state = NoContainerState
  340. job.batch/cm-p123456-e654321-aem-author-index-updates-wrapper-4483278 annotated
  341. pod/cm-p123456-e654321-aem-author-index-updates-wrapper-44832wgklf annotated
  342. 2024-07-28T23:59:25+00:00 [SkylineProxyJob] - skyline.job.internalState.preview_reason = publishIndexing:CompleteWithNoNewIndexesFound
  343. job.batch/cm-p123456-e654321-aem-author-index-updates-wrapper-4483278 annotated
  344. pod/cm-p123456-e654321-aem-author-index-updates-wrapper-44832wgklf annotated
  345. 2024-07-28T23:59:27+00:00 [SkylineProxyJob] Got the expected state: Complete
  346. 2024-07-28T23:59:27+00:00 [SkylineProxyJob] Gettings logs from all containers in cm-p123456-e654321-prev-aem-index-updates-9dgq5
  347. 2024-07-28T23:59:28+00:00 [SkylineProxyJob] -------------------- start container=copy-publish-seed-to-volume, job=cm-p123456-e654321-prev-aem-index-updates-9dgq5 --------------------
  348. 2024-07-28T23:59:29+00:00 [SkylineProxyJob] -------------------- end container=copy-publish-seed-to-volume logs --------------------
  349. 2024-07-28T23:59:29+00:00 [SkylineProxyJob] -------------------- start container=add-index-publish, job=cm-p123456-e654321-prev-aem-index-updates-9dgq5 --------------------
  350. aem-indexing/tools:1.0.116
  351. Waiting for splunk forwarding to start..
  352. Fluent Bit v1.9.9
  353. * Copyright (C) 2015-2022 The Fluent Bit Authors
  354. * Fluent Bit is a CNCF sub-project under the umbrella of Fluentd
  355. * https://fluentbit.io
  356.  
  357. [2024/07/28 23:58:17] [ info] [fluent bit] version=1.9.9, commit=, pid=17
  358. [2024/07/28 23:58:17] [ info] [storage] created root path /var/log/flb-storage/
  359. [2024/07/28 23:58:17] [ info] [storage] version=1.3.0, type=memory+filesystem, sync=normal, checksum=disabled, max_chunks_up=128
  360. [2024/07/28 23:58:17] [ info] [storage] backlog input plugin: storage_backlog.1
  361. [2024/07/28 23:58:17] [ info] [cmetrics] version=0.3.7
  362. [2024/07/28 23:58:17] [ info] [input:storage_backlog:storage_backlog.1] queue memory limit: 95.4M
  363. [2024/07/28 23:58:17] [ info] [output:splunk:splunk.0] worker #0 started
  364. [2024/07/28 23:58:17] [ info] [output:splunk:splunk.0] worker #1 started
  365. [2024/07/28 23:58:17] [ info] [http_server] listen iface=0.0.0.0 tcp_port=2020
  366. [2024/07/28 23:58:17] [ info] [sp] stream processor started
  367. splunk forwarding started!
  368. 23:58:52.358 [main] INFO add.index.publish - aem-indexing/tools:1.0.116
  369. 23:58:53.358 [main] INFO add.index.publish - The most recent container is aem-sgmt-89eafa3a781ce64c78f5d1a0f990d904db0a888b-0001b7
  370. 23:58:53.358 [main] INFO add.index.publish - STEP: Download customer index definitions started
  371. 23:58:53.358 [main] INFO add.index.publish - Running on top of the base image, downloading customer index definitions
  372. 23:58:53.358 [main] INFO add.index.publish - Extracting & decoding customer index definitions from downloaded file
  373. 23:58:54.358 [main] INFO add.index.publish - STEP: Download customer index definitions ended
  374. 23:58:54.358 [main] INFO add.index.publish - STEP::INDEX_DELETION started
  375. 23:58:54.358 [main] INFO add.index.publish - Checking to see if some indexes are marked for deletion.
  376. 23:58:54.358 [main] INFO add.index.publish - No indexes marked for deletion. Moving forward.
  377. 23:58:54.358 [main] INFO add.index.publish - STEP::INDEX_DELETION ended
  378. 23:58:54.358 [main] INFO add.index.publish - STEP::INDEX_COMPARISON started
  379. 23:58:54.358 [main] INFO add.index.publish - Getting new indexes...
  380. 23:58:54.496 [main] INFO o.a.j.oak.segment.file.FileStore - Creating file store FileStoreBuilder{version=null, directory=/mnt/sandbox/segmentstore, blobStore=null, binariesInlineThreshold=16512, maxFileSize=256, segmentCacheSize=256, stringCacheSize=256, templateCacheSize=64, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1048576, memoryMapping=true, offHeapAccess=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL, compactorType=PARALLEL_COMPACTOR}}
  381. 23:58:54.693 [main] INFO o.a.j.oak.segment.file.FileStore - TarMK opened at /mnt/sandbox/segmentstore, mmap=true, offHeapAccess=false, size=308.6 MB (308552704 bytes)
  382. 23:58:54.704 [main] INFO o.a.j.o.s.SegmentNodeStore$SegmentNodeStoreBuilder - Creating segment node store SegmentNodeStoreBuilder{blobStore=inline}
  383. 23:58:54.709 [main] INFO o.a.j.o.s.s.LockBasedScheduler - Initializing SegmentNodeStore with the commitFairLock option enabled.
  384. 23:58:54.743 [main] INFO o.a.j.o.b.c.a.b.AzureBlobStoreBackend - Using concurrentRequestsPerOperation=4
  385. 23:58:55.139 [main] INFO o.a.j.o.b.c.a.b.AzureBlobStoreBackend - Reusing existing container. containerName=aem-blob-ns-team-aem-cm-prd-n106455-cm-p123456-e654321
  386. 23:58:55.139 [main] INFO o.a.j.o.b.c.a.b.AzureBlobStoreBackend - presigned GET URI cache enabled, maxSize = 1024 items, expiry = 1800 seconds
  387. 23:58:55.196 [main] INFO o.a.j.o.p.blob.UploadStagingCache - Scheduling pending uploads
  388. 23:58:55.197 [main] INFO o.a.j.o.p.b.DataStoreCacheUpgradeUtils - Deleted asyncUploadMap [async-pending-uploads.ser] from [/tmp/indexing-test9415660517747558182]
  389. 23:58:55.199 [main] INFO o.a.j.o.p.blob.UploadStagingCache - Scheduled [0] pending uploads
  390. 23:58:55.213 [pool-4-thread-1] INFO o.a.j.oak.plugins.blob.FileCache - Cache built with [0] files from file system in [0] seconds
  391. 23:58:55.924 [main] INFO o.a.j.oak.segment.file.FileStore - Creating file store FileStoreBuilder{version=null, directory=/tmp/indexing-test12237007123074757531, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.oak.blob.cloud.azure.blobstorage.AzureDataStore], binariesInlineThreshold=16512, maxFileSize=256, segmentCacheSize=256, stringCacheSize=256, templateCacheSize=64, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1048576, memoryMapping=true, offHeapAccess=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL, compactorType=PARALLEL_COMPACTOR}}
  392. 23:58:56.020 [main] INFO o.a.j.oak.segment.file.FileStore - TarMK opened at /tmp/indexing-test12237007123074757531, mmap=true, offHeapAccess=false, size=9.7 MB (9676838 bytes)
  393. 23:58:56.034 [main] INFO o.a.j.o.s.SegmentNodeStore$SegmentNodeStoreBuilder - Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.oak.blob.cloud.azure.blobstorage.AzureDataStore]}
  394. 23:58:56.034 [main] INFO o.a.j.o.s.s.LockBasedScheduler - Initializing SegmentNodeStore with the commitFairLock option enabled.
  395. 23:58:56.258 [main] INFO indexing-task - [TASK:COMPARE_INDEXES:START] Starting index comparison
  396. 23:58:56.403 [main] INFO c.a.granite.indexing.tool.CompareCmd - Reading from index definition file /mnt/job-config/index-def.json
  397. 23:58:56.730 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/acPrincipalName
  398. 23:58:56.730 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/appsLibsLucene
  399. 23:58:56.730 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/assetLinkShare-1
  400. 23:58:56.730 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/assetPrefixNodename-1
  401. 23:58:56.730 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/authorizableId
  402. 23:58:56.730 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/authorizables
  403. 23:58:56.730 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/cmLucene-2
  404. 23:58:56.730 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/commerceLucene
  405. 23:58:56.730 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/contentFragments-1
  406. 23:58:56.730 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/counter
  407. 23:58:56.730 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/cqPageLucene
  408. 23:58:56.730 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/cqPageLucene-0-custom-4
  409. 23:58:56.730 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/cqPayloadPath
  410. 23:58:56.730 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/cqProjectLucene
  411. 23:58:56.730 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/cqReportsLucene
  412. 23:58:56.730 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/cqTagLucene-3
  413. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/damAssetLucene-11
  414. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/damAssetStateIndex-6
  415. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/damCollectionLucene-4
  416. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/designFiles-1
  417. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/experienceFragmentsIndex-3
  418. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/externalId
  419. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/externalPrincipalNames
  420. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/formsTemplateLucene
  421. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/fragments-11
  422. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/graphqlConfig-2
  423. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/guidesAssetProperties-1
  424. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/guidesKonnect-1
  425. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/guidesProperties-1
  426. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/internalVerificationLucene
  427. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/jcrLanguage
  428. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/nodetype
  429. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/nodetypeLucene
  430. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/ntBaseLucene-2
  431. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/ntFileFolderLucene
  432. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/ntFolderDamLucene-9
  433. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/packageLucene
  434. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/pathReference
  435. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/principalName
  436. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/reference
  437. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/repAccessControllableDamLucene-1
  438. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/repMembers
  439. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/repTokenIndex
  440. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/screensContentJcrPrimaryType
  441. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/screensSmartSyncJcrPrimaryType
  442. 23:58:56.731 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/slingQuickSites-1
  443. 23:58:56.732 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/slingResourceResolver-3
  444. 23:58:56.732 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/slingSitemaps-1
  445. 23:58:56.732 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/slingeventJob-2
  446. 23:58:56.732 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/slingeventJobStart
  447. 23:58:56.732 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/socialLucene
  448. 23:58:56.732 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/uuid
  449. 23:58:56.732 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/versionStoreIndex
  450. 23:58:56.732 [main] INFO c.a.granite.indexing.tool.CompareCmd - Ignoring existing index /oak:index/workflowDataLucene-2
  451. 23:58:56.734 [main] INFO c.a.granite.indexing.tool.CompareCmd - Index merging complete!
  452. 23:58:56.735 [main] INFO c.a.granite.indexing.tool.CompareCmd - Merging created 0 new index definitions
  453. 23:58:56.737 [main] INFO indexing-task - [TASK:COMPARE_INDEXES:END] Metrics: {"duration":"00:00:00","durationSeconds":0}
  454. 23:58:56.769 [main] INFO o.a.j.oak.segment.file.FileStore - TarMK closed: /tmp/indexing-test12237007123074757531
  455. 23:58:56.807 [main] INFO o.a.j.oak.segment.file.FileStore - TarMK closed: /mnt/sandbox/segmentstore
  456. 23:58:56.358 [main] INFO add.index.publish - STEP::INDEX_COMPARISON ended
  457. 23:58:56.358 [main] INFO add.index.publish - The new lucene index definitions are:
  458. {}
  459.  
  460. 23:58:56.358 [main] INFO add.index.publish - The new elastic index definitions are:
  461. {}
  462.  
  463. 23:58:56.358 [main] INFO add.index.publish - No new indexes found
  464. pod/cm-p123456-e654321-prev-aem-index-updates-9dgq5-c7tth annotated
  465. pod/cm-p123456-e654321-prev-aem-index-updates-9dgq5-c7tth annotated
  466. 23:58:57.358 [main] INFO add.index.publish - No need to re-enable compaction. Compaction has not been disabled.
  467. bytes_to_send = 12124
  468. bytes_processed =
  469. logsWaitComplete = 10
  470. logsWaitTimeout = 300
  471. Waited 10 of 300 seconds
  472. [2024/07/28 23:59:17] [ info] [input:tail:tail.0] inotify_fs_add(): inode=63703569 watch_fd=1 name=/opt/aem/work/logs/job.log
  473. Waited 20 of 300 seconds
  474. Waiting to finish sending all logs (10 sec)
  475. 2024-07-28T23:59:30+00:00 [SkylineProxyJob] -------------------- end container=add-index-publish logs --------------------
  476. 2024-07-28T23:59:30+00:00 [SkylineProxyJob] Waiting 10s for job state Complete.
  477. 2024-07-28T23:59:32+00:00 [SkylineProxyJob] Got the expected state: Complete
  478. 2024-07-28T23:59:33+00:00 [SkylineProxyJob] Waiting 10s for job state Complete.
  479. 2024-07-28T23:59:34+00:00 [SkylineProxyJob] Got the expected state: Complete
  480.  
Advertisement
Comments
  • User was banned
  • User was banned
  • User was banned
  • User was banned
  • User was banned
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!