API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Mar 4th, 2024
23
0
294 days
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 103.08 KB | None | 0 0
raw download clone embed print report
  1. @ 0x55e4af0aa317 rocksdb::BlockBasedTable::RetrieveBlock()
  2. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  3. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  4. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  5. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  6. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  7. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  8. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  9. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  10. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  11. @ 0x55e4ae5ef0d1 yb::docdb::DocRowwiseIterator::Seek()
  12. @ 0x55e4ae5f651b yb::docdb::DocRowwiseIteratorBase::SeekTuple()
  13. W0304 08:55:57.322310 4106 long_operation_tracker.cc:155] Read took a long time: 1.233s
  14. W0304 08:55:57.323707 6569 long_operation_tracker.cc:155] Read took a long time: 1.234s
  15. W0304 08:55:58.344637 484 long_operation_tracker.cc:125] Read running for 1.001s in thread 4787:
  16. @ 0x7f4891105e62 __GI___pread
  17. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  18. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  19. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  20. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  21. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  22. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  23. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  24. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  25. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  26. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  27. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  28. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  29. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  30. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  31. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  32. W0304 08:55:58.369153 484 long_operation_tracker.cc:125] Read running for 1.018s in thread 2938:
  33. @ 0x7f4891105e62 __GI___pread
  34. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  35. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  36. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  37. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  38. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  39. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  40. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  41. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  42. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  43. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  44. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  45. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  46. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  47. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  48. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  49. W0304 08:55:58.661554 4787 long_operation_tracker.cc:155] Read took a long time: 1.335s
  50. W0304 08:55:58.661866 2938 long_operation_tracker.cc:155] Read took a long time: 1.335s
  51. W0304 08:55:59.068168 6542 outbound_call.cc:480] RPC callback for Local RPC call 0x000035166560cf20: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 3831782, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.024s
  52. W0304 08:56:00.188817 6567 outbound_call.cc:480] RPC callback for Local RPC call 0x0000351630088c20: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 3835571, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.018s
  53. W0304 08:56:00.732218 484 long_operation_tracker.cc:125] Read running for 1.000s in thread 4103:
  54. @ 0x7f4891105e62 __GI___pread
  55. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  56. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  57. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  58. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  59. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  60. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  61. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  62. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  63. @ 0x55e4af0d3bde rocksdb::(anonymous namespace)::TwoLevelIterator::DoSkipEmptyDataBlocksForward()
  64. @ 0x55e4af0c2155 rocksdb::MergingIterator::Next()
  65. @ 0x55e4af01673b rocksdb::DBIter::Next()
  66. @ 0x55e4ae57c083 yb::docdb::BoundedRocksDbIterator::Next()
  67. @ 0x55e4ae643d43 yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  68. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  69. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  70. W0304 08:56:00.745498 4767 long_operation_tracker.cc:155] Read took a long time: 1.045s
  71. W0304 08:56:00.746428 4103 long_operation_tracker.cc:155] Read took a long time: 1.046s
  72. W0304 08:56:01.130023 4388 outbound_call.cc:480] RPC callback for Local RPC call 0x000035163997f520: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 3838956, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.019s
  73. W0304 08:56:01.130673 6574 outbound_call.cc:480] RPC callback for Local RPC call 0x000035162ddaf220: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 3839002, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.019s
  74. W0304 08:56:01.764214 484 long_operation_tracker.cc:125] Read running for 1.001s in thread 3780:
  75. @ 0x7f4891105e62 __GI___pread
  76. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  77. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  78. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  79. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  80. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  81. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  82. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  83. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  84. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  85. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  86. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  87. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  88. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  89. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  90. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  91. W0304 08:56:01.781352 484 long_operation_tracker.cc:125] Read running for 1.014s in thread 6570:
  92. @ 0x7f4891105e62 __GI___pread
  93. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  94. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  95. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  96. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  97. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  98. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  99. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  100. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  101. @ 0x55e4af0d3bde rocksdb::(anonymous namespace)::TwoLevelIterator::DoSkipEmptyDataBlocksForward()
  102. @ 0x55e4af0c2155 rocksdb::MergingIterator::Next()
  103. @ 0x55e4af01673b rocksdb::DBIter::Next()
  104. @ 0x55e4ae57c083 yb::docdb::BoundedRocksDbIterator::Next()
  105. @ 0x55e4ae643d43 yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  106. @ 0x55e4ae64096c yb::docdb::IntentAwareIterator::SeekPastSubKey()
  107. @ 0x55e4ae5e4931 yb::docdb::(anonymous namespace)::GetHelperBase<>::DoHandleRecord()
  108. W0304 08:56:02.257279 3780 long_operation_tracker.cc:155] Read took a long time: 1.510s
  109. W0304 08:56:02.257522 6570 long_operation_tracker.cc:155] Read took a long time: 1.507s
  110. W0304 08:56:02.281036 4469 outbound_call.cc:480] RPC callback for Local RPC call 0x0000351819c0ec20: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 3842947, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.023s
  111. W0304 08:56:02.411557 6469 outbound_call.cc:480] RPC callback for Local RPC call 0x000035160befcf20: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 3843317, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.019s
  112. W0304 08:56:03.277768 484 long_operation_tracker.cc:125] Read running for 1.000s in thread 4766:
  113. @ 0x7f4891105e62 __GI___pread
  114. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  115. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  116. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  117. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  118. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  119. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  120. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  121. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  122. @ 0x55e4af0d3bde rocksdb::(anonymous namespace)::TwoLevelIterator::DoSkipEmptyDataBlocksForward()
  123. @ 0x55e4af0c2155 rocksdb::MergingIterator::Next()
  124. @ 0x55e4af01673b rocksdb::DBIter::Next()
  125. @ 0x55e4ae57c083 yb::docdb::BoundedRocksDbIterator::Next()
  126. @ 0x55e4ae643d43 yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  127. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  128. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  129. W0304 08:56:03.295310 484 long_operation_tracker.cc:125] Read running for 1.004s in thread 5081:
  130. @ 0x7f4891105e62 __GI___pread
  131. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  132. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  133. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  134. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  135. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  136. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  137. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  138. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  139. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  140. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  141. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  142. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  143. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  144. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  145. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  146. W0304 08:56:03.502018 4766 long_operation_tracker.cc:155] Read took a long time: 1.240s
  147. W0304 08:56:03.503371 5081 long_operation_tracker.cc:155] Read took a long time: 1.230s
  148. W0304 08:56:03.867805 484 long_operation_tracker.cc:125] Read running for 1.000s in thread 4467:
  149. @ 0x55e4af09ccb1 snappy::DecompressBranchless<>()
  150. @ 0x55e4af09c77e snappy::SnappyDecompressor::DecompressAllTags<>()
  151. @ 0x55e4af0b6051 rocksdb::UncompressBlockContents()
  152. @ 0x55e4af0b59f0 rocksdb::ReadBlockContents()
  153. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  154. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  155. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  156. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  157. @ 0x55e4af0d3bde rocksdb::(anonymous namespace)::TwoLevelIterator::DoSkipEmptyDataBlocksForward()
  158. @ 0x55e4af0c2155 rocksdb::MergingIterator::Next()
  159. @ 0x55e4af01673b rocksdb::DBIter::Next()
  160. @ 0x55e4ae57c083 yb::docdb::BoundedRocksDbIterator::Next()
  161. @ 0x55e4ae643d43 yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  162. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  163. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  164. @ 0x55e4ae5ef0d1 yb::docdb::DocRowwiseIterator::Seek()
  165. W0304 08:56:03.922346 4467 long_operation_tracker.cc:155] Read took a long time: 1.069s
  166. W0304 08:56:34.419930 4789 outbound_call.cc:480] RPC callback for Local RPC call 0x000035160f006920: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 3973133, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.018s
  167. W0304 08:56:37.198577 4477 long_operation_tracker.cc:155] Read took a long time: 1.131s
  168. W0304 08:56:37.198971 1578 long_operation_tracker.cc:155] Read took a long time: 1.140s
  169. W0304 08:56:40.166720 6512 outbound_call.cc:480] RPC callback for Local RPC call 0x000035162235cf20: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 3994192, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.020s
  170. W0304 08:56:46.076112 4789 outbound_call.cc:480] RPC callback for Local RPC call 0x000035164b8ee320: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4021322, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.018s
  171. W0304 08:56:46.551702 3802 outbound_call.cc:480] RPC callback for RPC call 0x000035167b884000: yb.tserver.TabletServerService.Read -> { remote: 10.244.26.28:9100 idx: 3 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4023659, state: FINISHED_SUCCESS, transfer_state: FINISHED took 0.018s
  172. W0304 08:56:46.710050 3783 outbound_call.cc:480] RPC callback for Local RPC call 0x000035163c71e920: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4024339, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.022s
  173. W0304 08:56:46.945060 6476 outbound_call.cc:480] RPC callback for Local RPC call 0x000035161a102020: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4025620, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.019s
  174. W0304 08:56:48.698153 484 long_operation_tracker.cc:125] Read running for 1.000s in thread 4103:
  175. @ 0x7f4891105e62 __GI___pread
  176. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  177. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  178. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  179. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  180. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  181. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  182. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  183. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  184. @ 0x55e4af0d3bde rocksdb::(anonymous namespace)::TwoLevelIterator::DoSkipEmptyDataBlocksForward()
  185. @ 0x55e4af0c2155 rocksdb::MergingIterator::Next()
  186. @ 0x55e4af01673b rocksdb::DBIter::Next()
  187. @ 0x55e4ae57c083 yb::docdb::BoundedRocksDbIterator::Next()
  188. @ 0x55e4ae643d43 yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  189. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  190. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  191. W0304 08:56:48.843355 4103 long_operation_tracker.cc:155] Read took a long time: 1.162s
  192. W0304 08:57:28.199168 3457 long_operation_tracker.cc:155] Read took a long time: 1.006s
  193. W0304 08:57:29.865512 484 long_operation_tracker.cc:125] Read running for 1.000s in thread 4780:
  194. @ 0x7f4891105e62 __GI___pread
  195. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  196. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  197. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  198. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  199. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  200. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  201. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  202. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  203. @ 0x55e4af0d3bde rocksdb::(anonymous namespace)::TwoLevelIterator::DoSkipEmptyDataBlocksForward()
  204. @ 0x55e4af0c2155 rocksdb::MergingIterator::Next()
  205. @ 0x55e4af01673b rocksdb::DBIter::Next()
  206. @ 0x55e4ae57c083 yb::docdb::BoundedRocksDbIterator::Next()
  207. @ 0x55e4ae643d43 yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  208. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  209. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  210. W0304 08:57:29.907166 4780 long_operation_tracker.cc:155] Read took a long time: 1.055s
  211. W0304 08:57:35.651577 484 long_operation_tracker.cc:125] Read running for 1.001s in thread 6407:
  212. @ 0x7f4891105e62 __GI___pread
  213. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  214. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  215. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  216. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  217. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  218. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  219. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  220. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  221. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  222. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  223. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  224. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  225. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  226. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  227. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  228. W0304 08:57:35.696117 6407 long_operation_tracker.cc:155] Read took a long time: 1.058s
  229. W0304 08:57:38.145507 484 long_operation_tracker.cc:125] Read running for 1.000s in thread 4782:
  230. @ 0x55e4af0d9965 rocksdb::crc32c::ExtendImpl<>()
  231. @ 0x55e4af0b74eb rocksdb::(anonymous namespace)::ReadBlock()::BlockChecksumValidator::Validate()
  232. @ 0x55e4af9141d2 yb::RandomAccessFile::ReadAndValidate()
  233. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  234. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  235. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  236. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  237. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  238. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  239. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  240. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  241. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  242. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  243. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  244. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  245. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  246. W0304 08:57:38.223054 4782 long_operation_tracker.cc:155] Read took a long time: 1.090s
  247. W0304 08:57:38.336210 5093 long_operation_tracker.cc:155] Read took a long time: 1.063s
  248. W0304 08:57:39.774210 484 long_operation_tracker.cc:125] Read running for 1.000s in thread 1875:
  249. @ 0x7f4891105e62 __GI___pread
  250. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  251. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  252. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  253. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  254. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  255. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  256. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  257. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  258. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  259. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  260. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  261. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  262. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  263. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  264. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  265. W0304 08:57:40.137305 1875 long_operation_tracker.cc:155] Read took a long time: 1.377s
  266. W0304 08:57:42.991122 484 long_operation_tracker.cc:125] Read running for 1.000s in thread 4474:
  267. @ 0x7f4891105e62 __GI___pread
  268. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  269. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  270. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  271. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  272. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  273. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  274. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  275. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  276. @ 0x55e4af0d3bde rocksdb::(anonymous namespace)::TwoLevelIterator::DoSkipEmptyDataBlocksForward()
  277. @ 0x55e4af0c2155 rocksdb::MergingIterator::Next()
  278. @ 0x55e4af01673b rocksdb::DBIter::Next()
  279. @ 0x55e4ae57c083 yb::docdb::BoundedRocksDbIterator::Next()
  280. @ 0x55e4ae643d43 yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  281. @ 0x55e4ae64096c yb::docdb::IntentAwareIterator::SeekPastSubKey()
  282. @ 0x55e4ae5e4931 yb::docdb::(anonymous namespace)::GetHelperBase<>::DoHandleRecord()
  283. W0304 08:57:43.194352 4474 long_operation_tracker.cc:155] Read took a long time: 1.227s
  284. W0304 08:57:44.173725 484 long_operation_tracker.cc:125] Read running for 1.002s in thread 1872:
  285. @ 0x7f4891105e62 __GI___pread
  286. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  287. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  288. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  289. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  290. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  291. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  292. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  293. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  294. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  295. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  296. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  297. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  298. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  299. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  300. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  301. W0304 08:57:44.297492 1872 long_operation_tracker.cc:155] Read took a long time: 1.142s
  302. W0304 08:57:45.031252 5229 outbound_call.cc:480] RPC callback for Local RPC call 0x000035194a912920: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4252970, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.027s
  303. W0304 08:57:45.180167 484 long_operation_tracker.cc:125] Read running for 1.000s in thread 6491:
  304. @ 0x7f4891105e62 __GI___pread
  305. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  306. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  307. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  308. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  309. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  310. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  311. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  312. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  313. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  314. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  315. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  316. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  317. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  318. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  319. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  320. W0304 08:57:45.323403 484 long_operation_tracker.cc:125] Read running for 1.000s in thread 4764:
  321. @ 0x7f4891105e62 __GI___pread
  322. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  323. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  324. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  325. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  326. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  327. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  328. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  329. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  330. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  331. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  332. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  333. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  334. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  335. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  336. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  337. W0304 08:57:45.339135 4764 long_operation_tracker.cc:155] Read took a long time: 1.036s
  338. W0304 08:57:45.370215 6491 long_operation_tracker.cc:155] Read took a long time: 1.206s
  339. W0304 08:57:46.366847 484 long_operation_tracker.cc:125] Read running for 1.000s in thread 6557:
  340. @ 0x7f4891105e62 __GI___pread
  341. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  342. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  343. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  344. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  345. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  346. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  347. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  348. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  349. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  350. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  351. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  352. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  353. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  354. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  355. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  356. W0304 08:57:46.396888 484 long_operation_tracker.cc:125] Read running for 1.000s in thread 6541:
  357. @ 0x7f4891105e62 __GI___pread
  358. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  359. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  360. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  361. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  362. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  363. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  364. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  365. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  366. @ 0x55e4af0d3bde rocksdb::(anonymous namespace)::TwoLevelIterator::DoSkipEmptyDataBlocksForward()
  367. @ 0x55e4af0c2155 rocksdb::MergingIterator::Next()
  368. @ 0x55e4af01673b rocksdb::DBIter::Next()
  369. @ 0x55e4ae57c083 yb::docdb::BoundedRocksDbIterator::Next()
  370. @ 0x55e4ae643d43 yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  371. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  372. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  373. W0304 08:57:46.564646 5079 outbound_call.cc:480] RPC callback for Local RPC call 0x000035181f783520: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4262460, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.019s
  374. W0304 08:57:46.606673 6557 long_operation_tracker.cc:155] Read took a long time: 1.259s
  375. W0304 08:57:46.623037 6541 long_operation_tracker.cc:155] Read took a long time: 1.244s
  376. W0304 08:57:46.636078 484 long_operation_tracker.cc:125] Read running for 1.000s in thread 6555:
  377. @ 0x7f4891105e62 __GI___pread
  378. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  379. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  380. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  381. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  382. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  383. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  384. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  385. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  386. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  387. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  388. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  389. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  390. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  391. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  392. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  393. W0304 08:57:46.728778 6555 long_operation_tracker.cc:155] Read took a long time: 1.112s
  394. W0304 08:57:47.661792 484 long_operation_tracker.cc:125] Read running for 1.001s in thread 4467:
  395. @ 0x7f4891105e62 __GI___pread
  396. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  397. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  398. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  399. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  400. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  401. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  402. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  403. @ 0x55e4af0c02d6 rocksdb::MultiLevelIterator::InitSubIterator()
  404. @ 0x55e4af0bfd8e rocksdb::MultiLevelIterator::Seek()
  405. @ 0x55e4af0d36e3 rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  406. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  407. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  408. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  409. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  410. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  411. W0304 08:57:47.702049 484 long_operation_tracker.cc:125] Read running for 1.032s in thread 6525:
  412. @ 0x7f4891105e62 __GI___pread
  413. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  414. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  415. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  416. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  417. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  418. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  419. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  420. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  421. @ 0x55e4af0d3bde rocksdb::(anonymous namespace)::TwoLevelIterator::DoSkipEmptyDataBlocksForward()
  422. @ 0x55e4af0c2155 rocksdb::MergingIterator::Next()
  423. @ 0x55e4af01673b rocksdb::DBIter::Next()
  424. @ 0x55e4ae57c083 yb::docdb::BoundedRocksDbIterator::Next()
  425. @ 0x55e4ae643d43 yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  426. @ 0x55e4ae64096c yb::docdb::IntentAwareIterator::SeekPastSubKey()
  427. @ 0x55e4ae5e4931 yb::docdb::(anonymous namespace)::GetHelperBase<>::DoHandleRecord()
  428. W0304 08:57:47.978539 4768 outbound_call.cc:480] RPC callback for Local RPC call 0x0000351a2c44b520: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4265711, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.017s
  429. W0304 08:57:48.030220 6525 long_operation_tracker.cc:155] Read took a long time: 1.401s
  430. W0304 08:57:48.117609 484 long_operation_tracker.cc:125] Read running for 1.000s in thread 1871:
  431. @ 0x7f4891105e62 __GI___pread
  432. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  433. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  434. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  435. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  436. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  437. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  438. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  439. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  440. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  441. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  442. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  443. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  444. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  445. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  446. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  447. W0304 08:57:48.196807 1871 long_operation_tracker.cc:155] Read took a long time: 1.100s
  448. W0304 08:57:48.860688 4467 long_operation_tracker.cc:155] Read took a long time: 2.251s
  449. W0304 08:57:49.068296 484 long_operation_tracker.cc:125] Read running for 1.001s in thread 5083:
  450. @ 0x7f4891105e62 __GI___pread
  451. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  452. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  453. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  454. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  455. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  456. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  457. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  458. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  459. @ 0x55e4af0d3bde rocksdb::(anonymous namespace)::TwoLevelIterator::DoSkipEmptyDataBlocksForward()
  460. @ 0x55e4af0c2155 rocksdb::MergingIterator::Next()
  461. @ 0x55e4af01673b rocksdb::DBIter::Next()
  462. @ 0x55e4ae57c083 yb::docdb::BoundedRocksDbIterator::Next()
  463. @ 0x55e4ae643d43 yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  464. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  465. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  466. W0304 08:57:49.437042 5083 long_operation_tracker.cc:155] Read took a long time: 1.405s
  467. W0304 08:57:49.977025 6476 outbound_call.cc:480] RPC callback for Local RPC call 0x00003516758dbb20: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4270984, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.017s
  468. W0304 08:57:50.238384 484 long_operation_tracker.cc:125] Read running for 1.001s in thread 1771:
  469. @ 0x7f4891105e62 __GI___pread
  470. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  471. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  472. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  473. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  474. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  475. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  476. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  477. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  478. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  479. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  480. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  481. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  482. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  483. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  484. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  485. W0304 08:57:50.461587 484 long_operation_tracker.cc:125] Read running for 1.001s in thread 6478:
  486. @ 0x55e4af09ccbd snappy::DecompressBranchless<>()
  487. @ 0x55e4af09c77e snappy::SnappyDecompressor::DecompressAllTags<>()
  488. @ 0x55e4af0b6051 rocksdb::UncompressBlockContents()
  489. @ 0x55e4af0b59f0 rocksdb::ReadBlockContents()
  490. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  491. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  492. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  493. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  494. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  495. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  496. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  497. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  498. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  499. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  500. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  501. @ 0x55e4ae5ef0d1 yb::docdb::DocRowwiseIterator::Seek()
  502. W0304 08:57:50.601444 1771 long_operation_tracker.cc:155] Read took a long time: 1.398s
  503. W0304 08:57:50.768154 6478 long_operation_tracker.cc:155] Read took a long time: 1.327s
  504. W0304 08:57:50.816011 484 long_operation_tracker.cc:125] Read running for 1.000s in thread 1868:
  505. @ 0x55e4af09cd42 snappy::DecompressBranchless<>()
  506. @ 0x55e4af09c77e snappy::SnappyDecompressor::DecompressAllTags<>()
  507. @ 0x55e4af0b6051 rocksdb::UncompressBlockContents()
  508. @ 0x55e4af0b59f0 rocksdb::ReadBlockContents()
  509. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  510. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  511. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  512. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  513. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  514. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  515. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  516. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  517. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  518. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  519. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  520. @ 0x55e4ae5ef0d1 yb::docdb::DocRowwiseIterator::Seek()
  521. W0304 08:57:50.825742 3344 outbound_call.cc:480] RPC callback for Local RPC call 0x000035162235cf20: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4272549, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.023s
  522. W0304 08:57:50.965507 1868 long_operation_tracker.cc:155] Read took a long time: 1.162s
  523. W0304 08:57:51.468004 6477 outbound_call.cc:480] RPC callback for Local RPC call 0x000035163997e320: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4273953, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.021s
  524. W0304 08:57:51.619787 484 long_operation_tracker.cc:125] Read running for 1.000s in thread 4471:
  525. @ 0x55e4af09cc9f snappy::DecompressBranchless<>()
  526. @ 0x55e4af09c77e snappy::SnappyDecompressor::DecompressAllTags<>()
  527. @ 0x55e4af0b6051 rocksdb::UncompressBlockContents()
  528. @ 0x55e4af0b59f0 rocksdb::ReadBlockContents()
  529. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  530. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  531. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  532. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  533. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  534. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  535. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  536. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  537. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  538. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  539. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  540. @ 0x55e4ae5ef0d1 yb::docdb::DocRowwiseIterator::Seek()
  541. W0304 08:57:52.091563 4103 long_operation_tracker.cc:155] Read took a long time: 1.320s
  542. W0304 08:57:52.114450 4471 long_operation_tracker.cc:155] Read took a long time: 1.509s
  543. W0304 08:57:52.146800 4788 outbound_call.cc:480] RPC callback for Local RPC call 0x0000351674dbcc20: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4275438, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.018s
  544. W0304 08:57:52.149556 6563 outbound_call.cc:480] RPC callback for Local RPC call 0x000035166e8a1220: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4275585, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.018s
  545. W0304 08:57:52.203238 3812 outbound_call.cc:480] RPC callback for Local RPC call 0x000035163c71f820: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4275633, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.017s
  546. W0304 08:57:53.119971 484 long_operation_tracker.cc:125] Read running for 1.000s in thread 5227:
  547. @ 0x7f4891105e62 __GI___pread
  548. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  549. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  550. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  551. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  552. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  553. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  554. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  555. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  556. @ 0x55e4af0d3bde rocksdb::(anonymous namespace)::TwoLevelIterator::DoSkipEmptyDataBlocksForward()
  557. @ 0x55e4af0c2155 rocksdb::MergingIterator::Next()
  558. @ 0x55e4af01673b rocksdb::DBIter::Next()
  559. @ 0x55e4ae57c083 yb::docdb::BoundedRocksDbIterator::Next()
  560. @ 0x55e4ae643d43 yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  561. @ 0x55e4ae64096c yb::docdb::IntentAwareIterator::SeekPastSubKey()
  562. @ 0x55e4ae5e4931 yb::docdb::(anonymous namespace)::GetHelperBase<>::DoHandleRecord()
  563. W0304 08:57:53.139703 484 long_operation_tracker.cc:125] Read running for 1.001s in thread 6570:
  564. @ 0x7f4891105e62 __GI___pread
  565. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  566. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  567. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  568. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  569. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  570. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  571. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  572. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  573. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  574. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  575. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  576. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  577. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  578. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  579. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  580. W0304 08:57:53.340188 5212 outbound_call.cc:480] RPC callback for Local RPC call 0x0000351a2c44b520: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4277917, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.019s
  581. W0304 08:57:53.536012 6570 long_operation_tracker.cc:155] Read took a long time: 1.417s
  582. W0304 08:57:53.735216 5227 long_operation_tracker.cc:155] Read took a long time: 1.638s
  583. W0304 08:57:53.899364 484 long_operation_tracker.cc:125] Read running for 1.000s in thread 5159:
  584. @ 0x7f4891105e62 __GI___pread
  585. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  586. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  587. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  588. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  589. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  590. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  591. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  592. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  593. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  594. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  595. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  596. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  597. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  598. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  599. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  600. W0304 08:57:53.919659 6475 long_operation_tracker.cc:155] Read took a long time: 1.047s
  601. W0304 08:57:53.922224 5159 long_operation_tracker.cc:155] Read took a long time: 1.055s
  602. W0304 08:57:53.924293 6560 long_operation_tracker.cc:155] Read took a long time: 1.055s
  603. W0304 08:57:53.926195 6501 long_operation_tracker.cc:155] Read took a long time: 1.058s
  604. W0304 08:57:54.207573 5193 outbound_call.cc:480] RPC callback for Local RPC call 0x0000351614478920: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4279807, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.018s
  605. W0304 08:57:54.558954 484 long_operation_tracker.cc:125] Read running for 1.002s in thread 6526:
  606. @ 0x7f4891105e62 __GI___pread
  607. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  608. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  609. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  610. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  611. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  612. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  613. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  614. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  615. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  616. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  617. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  618. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  619. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  620. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  621. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  622. W0304 08:57:54.764336 484 long_operation_tracker.cc:125] Read running for 1.000s in thread 3773:
  623. @ 0x7f4891105e62 __GI___pread
  624. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  625. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  626. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  627. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  628. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  629. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  630. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  631. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  632. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  633. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  634. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  635. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  636. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  637. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  638. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  639. W0304 08:57:54.853524 6526 long_operation_tracker.cc:155] Read took a long time: 1.312s
  640. W0304 08:57:55.237496 1869 outbound_call.cc:480] RPC callback for RPC call 0x000035167b884840: yb.tserver.TabletServerService.Read -> { remote: 10.244.26.28:9100 idx: 5 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4282039, state: FINISHED_SUCCESS, transfer_state: FINISHED took 0.017s
  641. W0304 08:57:55.356262 484 long_operation_tracker.cc:125] Read running for 1.003s in thread 3775:
  642. @ 0x7f4891105e62 __GI___pread
  643. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  644. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  645. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  646. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  647. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  648. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  649. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  650. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  651. @ 0x55e4af0d3bde rocksdb::(anonymous namespace)::TwoLevelIterator::DoSkipEmptyDataBlocksForward()
  652. @ 0x55e4af0c2155 rocksdb::MergingIterator::Next()
  653. @ 0x55e4af01673b rocksdb::DBIter::Next()
  654. @ 0x55e4ae64062a yb::docdb::IntentAwareIterator::Next()
  655. @ 0x55e4ae5e41f5 yb::docdb::(anonymous namespace)::GetHelperBase<>::DoRun()
  656. @ 0x55e4ae5f440b yb::docdb::DocRowwiseIterator::FetchNextImpl<>()
  657. @ 0x55e4ae5ee9d7 yb::docdb::DocRowwiseIterator::PgFetchNext()
  658. W0304 08:57:55.392678 3773 long_operation_tracker.cc:155] Read took a long time: 1.649s
  659. W0304 08:57:55.629798 3775 long_operation_tracker.cc:155] Read took a long time: 1.302s
  660. W0304 08:57:56.505790 4918 long_operation_tracker.cc:155] Read took a long time: 1.153s
  661. W0304 08:57:56.814075 3442 outbound_call.cc:480] RPC callback for Local RPC call 0x000035164eddd220: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4285291, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.021s
  662. W0304 08:57:56.930240 1866 long_operation_tracker.cc:155] Read took a long time: 1.534s
  663. W0304 08:57:56.963228 484 long_operation_tracker.cc:125] Read running for 1.313s in thread 5165:
  664. @ 0x7f4891105e62 __GI___pread
  665. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  666. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  667. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  668. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  669. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  670. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  671. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  672. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  673. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  674. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  675. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  676. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  677. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  678. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  679. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  680. W0304 08:57:57.465435 5165 long_operation_tracker.cc:155] Read took a long time: 1.833s
  681. W0304 08:57:57.537855 484 long_operation_tracker.cc:125] Read running for 1.000s in thread 5224:
  682. @ 0x7f4891105e62 __GI___pread
  683. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  684. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  685. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  686. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  687. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  688. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  689. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  690. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  691. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  692. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  693. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  694. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  695. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  696. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  697. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  698. W0304 08:57:57.960758 484 long_operation_tracker.cc:125] Read running for 1.002s in thread 6496:
  699. @ 0x7f4891105e62 __GI___pread
  700. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  701. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  702. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  703. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  704. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  705. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  706. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  707. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  708. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  709. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  710. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  711. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  712. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  713. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  714. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  715. W0304 08:57:58.390758 6496 long_operation_tracker.cc:155] Read took a long time: 1.455s
  716. W0304 08:57:58.575521 5224 long_operation_tracker.cc:155] Read took a long time: 2.062s
  717. W0304 08:57:59.161829 5161 outbound_call.cc:480] RPC callback for Local RPC call 0x00003516595e0320: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4289983, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.029s
  718. W0304 08:57:59.807193 4107 long_operation_tracker.cc:155] Read took a long time: 1.411s
  719. W0304 08:58:00.116307 4104 outbound_call.cc:480] RPC callback for RPC call 0x000035161ee23b80: yb.tserver.TabletServerService.Read -> { remote: 10.244.26.28:9100 idx: 7 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4292479, state: FINISHED_SUCCESS, transfer_state: FINISHED took 0.023s
  720. W0304 08:58:00.116566 5224 outbound_call.cc:480] RPC callback for Local RPC call 0x000035160befcf20: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4292245, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.019s
  721. W0304 08:58:00.379261 484 long_operation_tracker.cc:125] Read running for 1.841s in thread 5225:
  722. Thread did not respond: maybe it was in the middle of a stack trace collection
  723. W0304 08:58:00.407712 484 long_operation_tracker.cc:125] Read running for 1.801s in thread 3159:
  724. @ 0x7f4891105e62 __GI___pread
  725. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  726. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  727. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  728. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  729. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  730. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  731. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  732. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  733. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  734. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  735. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  736. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  737. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  738. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  739. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  740. W0304 08:58:00.531183 4788 outbound_call.cc:480] RPC callback for Local RPC call 0x0000351623e1b520: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4293394, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.032s
  741. W0304 08:58:00.664153 5225 long_operation_tracker.cc:155] Read took a long time: 2.127s
  742. W0304 08:58:00.696204 3159 long_operation_tracker.cc:155] Read took a long time: 2.118s
  743. W0304 08:58:02.259819 3774 long_operation_tracker.cc:155] Read took a long time: 1.452s
  744. W0304 08:58:03.238889 3017 long_operation_tracker.cc:155] Read took a long time: 1.383s
  745. W0304 08:58:03.437050 4113 long_operation_tracker.cc:155] Read took a long time: 1.358s
  746. W0304 08:58:05.380636 3773 long_operation_tracker.cc:155] Read took a long time: 1.002s
  747. W0304 08:58:05.396107 6529 outbound_call.cc:480] RPC callback for Local RPC call 0x000035164b8ef520: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4308159, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.019s
  748. W0304 08:58:05.563328 484 long_operation_tracker.cc:125] Read running for 1.000s in thread 6578:
  749. @ 0x7f4891105e62 __GI___pread
  750. @ 0x55e4af915261 yb::PosixRandomAccessFile::Read()
  751. @ 0x55e4af9141ba yb::RandomAccessFile::ReadAndValidate()
  752. @ 0x55e4af0e24f8 rocksdb::RandomAccessFileReader::ReadAndValidate()
  753. @ 0x55e4af0b575f rocksdb::ReadBlockContents()
  754. @ 0x55e4af0ab2db rocksdb::block_based_table::ReadBlockFromFile()
  755. @ 0x55e4af0aa409 rocksdb::BlockBasedTable::RetrieveBlock()
  756. @ 0x55e4af0ad02f rocksdb::BlockBasedTable::NewDataBlockIterator()
  757. @ 0x55e4af0d3eda rocksdb::(anonymous namespace)::TwoLevelIterator::InitDataBlock()
  758. @ 0x55e4af0d36ef rocksdb::(anonymous namespace)::TwoLevelIterator::Seek()
  759. @ 0x55e4af0c1ef8 rocksdb::MergingIterator::Seek()
  760. @ 0x55e4af019b6e rocksdb::DBIter::Seek()
  761. @ 0x55e4ae57bfba yb::docdb::BoundedRocksDbIterator::Seek()
  762. @ 0x55e4ae643f1c yb::docdb::(anonymous namespace)::SeekPossiblyUsingNext()
  763. @ 0x55e4ae64466f yb::docdb::PerformRocksDBSeek()
  764. @ 0x55e4ae637103 yb::docdb::IntentAwareIterator::Seek()
  765. W0304 08:58:05.689445 6578 long_operation_tracker.cc:155] Read took a long time: 2.246s
  766. W0304 08:58:05.765085 1869 outbound_call.cc:480] RPC callback for Local RPC call 0x0000351676b57520: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4309091, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.035s
  767. W0304 08:58:05.856056 4461 outbound_call.cc:480] RPC callback for Local RPC call 0x00003518fc076f20: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4309251, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.017s
  768. W0304 08:58:05.970147 3778 long_operation_tracker.cc:155] Read took a long time: 1.049s
  769. W0304 08:58:05.976454 4781 long_operation_tracker.cc:155] Read took a long time: 1.048s
  770. W0304 08:58:06.661677 6407 long_operation_tracker.cc:155] Read took a long time: 1.265s
  771. W0304 08:58:06.661228 6479 long_operation_tracker.cc:155] Read took a long time: 1.269s
  772. W0304 08:58:06.661831 2937 long_operation_tracker.cc:155] Read took a long time: 1.272s
  773. W0304 08:58:06.661536 6490 long_operation_tracker.cc:155] Read took a long time: 1.248s
  774. W0304 08:58:06.676328 3783 outbound_call.cc:480] RPC callback for Local RPC call 0x000035160e682320: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4311335, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.033s
  775. W0304 08:58:06.795184 5193 outbound_call.cc:480] RPC callback for Local RPC call 0x000035166e15c920: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4311732, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.024s
  776. W0304 08:58:06.957356 6567 long_operation_tracker.cc:155] Read took a long time: 2.297s
  777. W0304 08:58:07.115231 504 outbound_call.cc:480] RPC callback for RPC call 0x000035167ac7bb80: yb.consensus.ConsensusService.UpdateConsensus -> { remote: 10.244.23.37:9100 idx: 4 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4312605, state: FINISHED_SUCCESS, transfer_state: FINISHED took 0.032s
  778. W0304 08:58:07.118183 6473 outbound_call.cc:480] RPC callback for Local RPC call 0x0000351626c8e320: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4312554, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.051s
  779. W0304 08:58:07.111758 4625 outbound_call.cc:480] RPC callback for Local RPC call 0x0000351675f68c20: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4312553, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.054s
  780. W0304 08:58:07.340533 6558 long_operation_tracker.cc:155] Read took a long time: 1.223s
  781. W0304 08:58:07.340679 4783 long_operation_tracker.cc:155] Read took a long time: 1.229s
  782. W0304 08:58:07.340734 6491 long_operation_tracker.cc:155] Read took a long time: 1.224s
  783. W0304 08:58:07.338919 4288 outbound_call.cc:480] RPC callback for RPC call 0x000035167b885b80: yb.consensus.ConsensusService.UpdateConsensus -> { remote: 10.244.23.37:9100 idx: 7 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4312618, state: FINISHED_SUCCESS, transfer_state: FINISHED took 0.200s
  784. W0304 08:58:07.339056 5083 long_operation_tracker.cc:155] Read took a long time: 1.220s
  785. W0304 08:58:07.338865 507 outbound_call.cc:480] RPC callback for RPC call 0x00003516673c4580: yb.consensus.ConsensusService.UpdateConsensus -> { remote: 10.244.26.28:9100 idx: 6 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4312619, state: FINISHED_SUCCESS, transfer_state: FINISHED took 0.200s
  786. W0304 08:58:07.334496 4253 outbound_call.cc:480] RPC callback for RPC call 0x0000351670ef8b00: yb.consensus.ConsensusService.UpdateConsensus -> { remote: 10.244.23.37:9100 idx: 6 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4312617, state: FINISHED_SUCCESS, transfer_state: FINISHED took 0.196s
  787. W0304 08:58:07.313519 4104 outbound_call.cc:480] RPC callback for Local RPC call 0x000035162ddaf520: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4312567, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.026s
  788. W0304 08:58:07.352018 5165 long_operation_tracker.cc:155] Read took a long time: 1.236s
  789. W0304 08:58:07.427019 4780 outbound_call.cc:480] RPC callback for RPC call 0x0000351667ae1340: yb.tserver.TabletServerService.Read -> { remote: 10.244.26.28:9100 idx: 5 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4313065, state: FINISHED_SUCCESS, transfer_state: FINISHED took 0.023s
  790. W0304 08:58:07.525161 6487 outbound_call.cc:480] RPC callback for RPC call 0x000035165fee9080: yb.tserver.TabletServerService.Read -> { remote: 10.244.26.28:9100 idx: 0 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4313086, state: FINISHED_SUCCESS, transfer_state: FINISHED took 0.052s
  791. W0304 08:58:07.912400 6574 outbound_call.cc:480] RPC callback for RPC call 0x0000351670ef98c0: yb.tserver.TabletServerService.Read -> { remote: 10.244.26.28:9100 idx: 5 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4313383, state: FINISHED_SUCCESS, transfer_state: FINISHED took 0.019s
  792. W0304 08:58:08.560112 4395 long_operation_tracker.cc:155] Read took a long time: 1.392s
  793. W0304 08:58:08.669632 5230 long_operation_tracker.cc:155] Read took a long time: 1.392s
  794. W0304 08:58:08.469089 6577 long_operation_tracker.cc:155] Read took a long time: 1.314s
  795. W0304 08:58:08.770534 3017 long_operation_tracker.cc:155] Read took a long time: 1.566s
  796. W0304 08:58:08.652004 6468 outbound_call.cc:480] RPC callback for RPC call 0x000035167596f340: yb.tserver.TabletServerService.Read -> { remote: 10.244.26.28:9100 idx: 7 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4313395, state: FINISHED_SUCCESS, transfer_state: FINISHED took 0.378s
  797. W0304 08:58:08.507572 4103 long_operation_tracker.cc:155] Read took a long time: 1.343s
  798. W0304 08:58:09.048543 1873 long_operation_tracker.cc:155] Read took a long time: 1.257s
  799. W0304 08:58:07.926043 6569 outbound_call.cc:480] RPC callback for RPC call 0x0000351667ae1340: yb.tserver.TabletServerService.Read -> { remote: 10.244.26.28:9100 idx: 1 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4313389, state: FINISHED_SUCCESS, transfer_state: FINISHED took 0.022s
  800. W0304 08:58:08.434247 4765 outbound_call.cc:480] RPC callback for RPC call 0x000035166846ab00: yb.tserver.TabletServerService.Read -> { remote: 10.244.26.28:9100 idx: 2 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4313417, state: FINISHED_SUCCESS, transfer_state: FINISHED took 0.031s
  801. W0304 08:58:08.507568 6581 long_operation_tracker.cc:155] Read took a long time: 1.345s
  802. W0304 08:58:08.654301 3797 outbound_call.cc:480] RPC callback for RPC call 0x000035165823a840: yb.tserver.TabletServerService.Read -> { remote: 10.244.26.28:9100 idx: 3 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4313449, state: FINISHED_SUCCESS, transfer_state: FINISHED took 0.024s
  803. W0304 08:58:08.445019 6513 outbound_call.cc:480] RPC callback for RPC call 0x0000351674316840: yb.tserver.TabletServerService.Read -> { remote: 10.244.26.28:9100 idx: 3 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4313433, state: FINISHED_SUCCESS, transfer_state: FINISHED took 0.026s
  804. W0304 08:58:09.260020 706 thread.cc:758] consensus [worker] (thread pool) Time spent starting thread: real 0.726s user 0.016s sys 0.078s
  805. W0304 08:58:09.338073 4467 outbound_call.cc:480] RPC callback for Local RPC call 0x00003518be1fec20: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4312794, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.060s
  806. W0304 08:58:09.450726 464 thread.cc:758] rpc_tp_TabletServer-high-pri_70 (rpc_thread_pool) Time spent starting thread: real 0.524s user 0.006s sys 0.079s
  807. W0304 08:58:09.552801 706 outbound_call.cc:480] RPC callback for RPC call 0x000035167596f080: yb.consensus.ConsensusService.UpdateConsensus -> { remote: 10.244.23.37:9100 idx: 0 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4312625, state: FINISHED_SUCCESS, transfer_state: FINISHED took 1.831s
  808. W0304 08:58:09.382467 1771 outbound_call.cc:480] RPC callback for RPC call 0x0000351626177600: yb.tserver.TabletServerService.Read -> { remote: 10.244.26.28:9100 idx: 4 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4313392, state: FINISHED_SUCCESS, transfer_state: FINISHED took 0.687s
  809. W0304 08:58:09.373219 5084 outbound_call.cc:480] RPC callback for Local RPC call 0x00003518ad5fe320: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4312816, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.024s
  810. W0304 08:58:09.625406 4264 thread.cc:758] prepare [worker] (thread pool) Time spent starting thread: real 0.669s user 0.000s sys 0.111s
  811. W0304 08:58:09.340061 1870 outbound_call.cc:480] RPC callback for RPC call 0x0000351637fa0b00: yb.tserver.TabletServerService.Read -> { remote: 10.244.26.28:9100 idx: 4 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4313443, state: FINISHED_SUCCESS, transfer_state: FINISHED took 0.401s
  812. W0304 08:58:08.793440 3441 outbound_call.cc:480] RPC callback for RPC call 0x000035165fee9080: yb.tserver.TabletServerService.Read -> { remote: 10.244.26.28:9100 idx: 0 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4313438, state: FINISHED_SUCCESS, transfer_state: FINISHED took 0.021s
  813. W0304 08:58:10.333092 4264 long_operation_tracker.cc:155] UpdateReplica took a long time: 1.533s
  814. W0304 08:58:10.417328 3781 outbound_call.cc:480] RPC callback for Local RPC call 0x0000351676b56920: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4313470, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.129s
  815. W0304 08:58:10.607893 1060 thread.cc:800] consensus [worker] (thread pool) Time spent waiting for new thread to publish its TID: real 0.849s user 0.008s sys 0.018s
  816. W0304 08:58:09.936731 6568 outbound_call.cc:480] RPC callback for RPC call 0x00003516199c6b00: yb.tserver.TabletServerService.Read -> { remote: 10.244.26.28:9100 idx: 5 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4313444, state: FINISHED_SUCCESS, transfer_state: FINISHED took 0.862s
  817. W0304 08:58:09.769654 6513 outbound_call.cc:480] RPC callback for Local RPC call 0x00003517066ac320: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4313467, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.355s
  818. W0304 08:58:10.417321 4109 outbound_call.cc:480] RPC callback for RPC call 0x000035165cb6d600: yb.tserver.TabletServerService.Read -> { remote: 10.244.26.28:9100 idx: 2 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4313461, state: FINISHED_SUCCESS, transfer_state: FINISHED took 0.802s
  819. W0304 08:58:10.922233 4267 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.148s
  820. W0304 08:58:10.923758 1066 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.134s
  821. W0304 08:58:10.922333 4253 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.091s
  822. W0304 08:58:10.922341 4280 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.090s
  823. W0304 08:58:10.922350 4246 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.080s
  824. W0304 08:58:10.922351 4279 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.080s
  825. W0304 08:58:10.922197 4266 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.130s
  826. W0304 08:58:10.922340 4282 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.091s
  827. W0304 08:58:10.922322 4250 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.091s
  828. W0304 08:58:10.922330 4255 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.091s
  829. W0304 08:58:10.922369 4248 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.076s
  830. W0304 08:58:10.922379 4271 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.062s
  831. W0304 08:58:10.922380 4258 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.057s
  832. W0304 08:58:10.922385 507 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.057s
  833. W0304 08:58:10.922209 1059 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.130s
  834. W0304 08:58:10.922398 4251 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.121s
  835. W0304 08:58:10.922412 4256 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.076s
  836. W0304 08:58:10.923146 4268 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.048s
  837. W0304 08:58:10.923146 4284 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.131s
  838. W0304 08:58:10.923156 4275 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.074s
  839. W0304 08:58:10.923171 4294 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.110s
  840. W0304 08:58:10.922179 1065 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.130s
  841. W0304 08:58:10.922362 4273 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.076s
  842. W0304 08:58:10.924196 4288 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.075s
  843. W0304 08:58:10.228237 4464 outbound_call.cc:480] RPC callback for RPC call 0x0000351672db0dc0: yb.tserver.TabletServerService.Read -> { remote: 10.244.26.28:9100 idx: 1 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4313457, state: FINISHED_SUCCESS, transfer_state: FINISHED took 0.690s
  844. W0304 08:58:10.949102 517 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.084s
  845. W0304 08:58:10.622385 6478 outbound_call.cc:480] RPC callback for Local RPC call 0x00003518db50b820: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4313468, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.179s
  846. W0304 08:58:10.922276 4257 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.109s
  847. W0304 08:58:10.922361 1062 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.080s
  848. W0304 08:58:10.922320 519 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.098s
  849. W0304 08:58:10.922266 4252 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.109s
  850. W0304 08:58:10.922313 4270 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.091s
  851. W0304 08:58:10.922246 707 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.123s
  852. W0304 08:58:11.294066 4250 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:38263 => 10.244.22.47:9100 (request call id 3575264) took 2462ms (client timeout 3000ms).
  853. W0304 08:58:10.922259 1064 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.123s
  854. W0304 08:58:11.291723 1066 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:37919 => 10.244.22.47:9100 (request call id 5689860) took 2503ms (client timeout 3000ms).
  855. W0304 08:58:11.297145 4280 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:39769 => 10.244.22.47:9100 (request call id 3575265) took 2464ms (client timeout 3000ms).
  856. W0304 08:58:11.280580 7872 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:39769 => 10.244.22.47:9100 (request call id 3575299) took 2404ms (client timeout 3000ms).
  857. W0304 08:58:11.284116 4256 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:38363 => 10.244.22.47:9100 (request call id 3575274) took 2429ms (client timeout 3000ms).
  858. W0304 08:58:11.279027 4253 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:35773 => 10.244.22.47:9100 (request call id 3575263) took 2444ms (client timeout 3000ms).
  859. W0304 08:58:11.278915 4288 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:45585 => 10.244.22.47:9100 (request call id 3575272) took 2427ms (client timeout 3000ms).
  860. W0304 08:58:11.293280 519 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:38363 => 10.244.22.47:9100 (request call id 3575260) took 2478ms (client timeout 3000ms).
  861. W0304 08:58:11.278832 4258 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:44047 => 10.244.22.47:9100 (request call id 5689901) took 2410ms (client timeout 3000ms).
  862. W0304 08:58:10.922307 4259 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.118s
  863. W0304 08:58:11.280084 706 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:46103 => 10.244.22.47:9100 (request call id 3575289) took 2391ms (client timeout 3000ms).
  864. W0304 08:58:11.307091 4270 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:37919 => 10.244.22.47:9100 (request call id 5689877) took 2475ms (client timeout 3000ms).
  865. W0304 08:58:11.310245 4251 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:34019 => 10.244.22.47:9100 (request call id 5689865) took 2475ms (client timeout 3000ms).
  866. W0304 08:58:10.922284 4263 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.107s
  867. W0304 08:58:10.922223 1058 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.130s
  868. W0304 08:58:10.922168 520 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.139s
  869. W0304 08:58:11.373497 1064 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:36101 => 10.244.22.47:9100 (request call id 5689861) took 2523ms (client timeout 3000ms).
  870. W0304 08:58:11.282070 4257 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:45585 => 10.244.22.47:9100 (request call id 3575259) took 2468ms (client timeout 3000ms).
  871. W0304 08:58:11.370239 520 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:34209 => 10.244.22.47:9100 (request call id 5689856) took 2587ms (client timeout 3000ms).
  872. W0304 08:58:11.359645 7876 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:34019 => 10.244.22.47:9100 (request call id 5689908) took 2484ms (client timeout 3000ms).
  873. W0304 08:58:10.932765 4293 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.134s
  874. W0304 08:58:10.923233 518 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.092s
  875. W0304 08:58:11.390129 518 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:41523 => 10.244.22.47:9100 (request call id 5689883) took 2558ms (client timeout 3000ms).
  876. W0304 08:58:11.366129 4263 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:34113 => 10.244.22.47:9100 (request call id 5689870) took 2552ms (client timeout 3000ms).
  877. W0304 08:58:11.391225 507 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:34019 => 10.244.22.47:9100 (request call id 5689898) took 2526ms (client timeout 3000ms).
  878. W0304 08:58:10.923749 504 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.137s
  879. W0304 08:58:10.924237 4292 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.142s
  880. W0304 08:58:11.301080 4266 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:45585 => 10.244.22.47:9100 (request call id 3575244) took 2481ms (client timeout 3000ms).
  881. W0304 08:58:10.923774 4283 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.100s
  882. W0304 08:58:11.411680 4283 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:34209 => 10.244.22.47:9100 (request call id 5689873) took 2598ms (client timeout 3000ms).
  883. W0304 08:58:11.296046 4252 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:45285 => 10.244.22.47:9100 (request call id 5689874) took 2482ms (client timeout 3000ms).
  884. W0304 08:58:11.409246 4292 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:38363 => 10.244.22.47:9100 (request call id 3575246) took 2621ms (client timeout 3000ms).
  885. W0304 08:58:11.278798 4264 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:45585 => 10.244.22.47:9100 (request call id 3575295) took 2399ms (client timeout 3000ms).
  886. W0304 08:58:11.384465 4293 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:39769 => 10.244.22.47:9100 (request call id 3575252) took 2591ms (client timeout 3000ms).
  887. W0304 08:58:11.280294 4273 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:34113 => 10.244.22.47:9100 (request call id 5689885) took 2432ms (client timeout 3000ms).
  888. W0304 08:58:11.279304 517 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:39769 => 10.244.22.47:9100 (request call id 3575283) took 2411ms (client timeout 3000ms).
  889. W0304 08:58:11.288197 1062 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:37919 => 10.244.22.47:9100 (request call id 5689890) took 2446ms (client timeout 3000ms).
  890. W0304 08:58:11.370227 1058 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:35773 => 10.244.22.47:9100 (request call id 3575248) took 2577ms (client timeout 3000ms).
  891. W0304 08:58:10.933986 4287 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.092s
  892. W0304 08:58:11.421648 4287 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:43239 => 10.244.22.47:9100 (request call id 3575269) took 2579ms (client timeout 3000ms).
  893. W0304 08:58:10.925572 4249 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.050s
  894. W0304 08:58:11.421674 4249 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:37919 => 10.244.22.47:9100 (request call id 5689905) took 2556ms (client timeout 3000ms).
  895. W0304 08:58:10.927179 4276 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.150s
  896. W0304 08:58:11.421696 4276 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:44047 => 10.244.22.47:9100 (request call id 5689852) took 2644ms (client timeout 3000ms).
  897. W0304 08:58:10.930514 511 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.113s
  898. W0304 08:58:11.421713 511 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:44047 => 10.244.22.47:9100 (request call id 5689871) took 2608ms (client timeout 3000ms).
  899. W0304 08:58:10.527001 3798 outbound_call.cc:480] RPC callback for Local RPC call 0x000035194a912f20: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4313464, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.674s
  900. W0304 08:58:10.525969 4787 outbound_call.cc:480] RPC callback for Local RPC call 0x000035166bdb9b20: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4313472, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.241s
  901. W0304 08:58:11.425082 504 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:46103 => 10.244.22.47:9100 (request call id 3575242) took 2616ms (client timeout 3000ms).
  902. W0304 08:58:11.350178 4259 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:46103 => 10.244.22.47:9100 (request call id 3575256) took 2543ms (client timeout 3000ms).
  903. W0304 08:58:11.298508 4279 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:45285 => 10.244.22.47:9100 (request call id 5689889) took 2456ms (client timeout 3000ms).
  904. W0304 08:58:11.298170 4284 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:43239 => 10.244.22.47:9100 (request call id 3575243) took 2506ms (client timeout 3000ms).
  905. W0304 08:58:11.288319 4275 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:41523 => 10.244.22.47:9100 (request call id 5689893) took 2441ms (client timeout 3000ms).
  906. W0304 08:58:11.281997 4268 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:36101 => 10.244.22.47:9100 (request call id 5689906) took 2416ms (client timeout 3000ms).
  907. W0304 08:58:11.303012 4246 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:34209 => 10.244.22.47:9100 (request call id 5689888) took 2432ms (client timeout 3000ms).
  908. W0304 08:58:11.287623 4282 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:36101 => 10.244.22.47:9100 (request call id 5689880) took 2443ms (client timeout 3000ms).
  909. W0304 08:58:11.289119 1065 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:45285 => 10.244.22.47:9100 (request call id 5689858) took 2497ms (client timeout 3000ms).
  910. W0304 08:58:11.287019 4248 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:36101 => 10.244.22.47:9100 (request call id 5689891) took 2440ms (client timeout 3000ms).
  911. W0304 08:58:11.285992 4255 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:34019 => 10.244.22.47:9100 (request call id 5689884) took 2454ms (client timeout 3000ms).
  912. W0304 08:58:11.283128 1059 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:38263 => 10.244.22.47:9100 (request call id 3575250) took 2481ms (client timeout 3000ms).
  913. W0304 08:58:10.922353 4285 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.080s
  914. W0304 08:58:10.943243 513 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.112s
  915. W0304 08:58:11.292081 4294 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:43239 => 10.244.22.47:9100 (request call id 3575257) took 2487ms (client timeout 3000ms).
  916. W0304 08:58:10.932294 514 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.160s
  917. W0304 08:58:11.358067 707 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:41523 => 10.244.22.47:9100 (request call id 5689864) took 2523ms (client timeout 3000ms).
  918. W0304 08:58:11.288152 4271 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:34209 => 10.244.22.47:9100 (request call id 5689902) took 2428ms (client timeout 3000ms).
  919. W0304 08:58:10.906767 4763 outbound_call.cc:480] RPC callback for Local RPC call 0x000035160f006920: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4313471, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.376s
  920. W0304 08:58:11.061213 1060 thread.cc:758] consensus [worker] (thread pool) Time spent starting thread: real 1.533s user 0.008s sys 0.210s
  921. W0304 08:58:11.350668 4267 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:41523 => 10.244.22.47:9100 (request call id 5689845) took 2576ms (client timeout 3000ms).
  922. W0304 08:58:11.467197 4250 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:35773 => 10.244.22.47:9100 (request call id 3575276) took 2568ms (client timeout 3000ms).
  923. W0304 08:58:11.457397 4285 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:44047 => 10.244.22.47:9100 (request call id 5689886) took 2601ms (client timeout 3000ms).
  924. W0304 08:58:11.467437 7872 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:34209 => 10.244.22.47:9100 (request call id 5689913) took 2571ms (client timeout 3000ms).
  925. W0304 08:58:11.464218 513 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:46103 => 10.244.22.47:9100 (request call id 3575267) took 2615ms (client timeout 3000ms).
  926. W0304 08:58:11.468569 4280 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:36101 => 10.244.22.47:9100 (request call id 5689920) took 2572ms (client timeout 3000ms).
  927. W0304 08:58:11.456215 514 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:34019 => 10.244.22.47:9100 (request call id 5689847) took 2683ms (client timeout 3000ms).
  928. W0304 08:58:11.674634 469 thread.cc:758] rpc_tp_TabletServer-high-pri_72 (rpc_thread_pool) Time spent starting thread: real 0.711s user 0.013s sys 0.119s
  929. W0304 08:58:11.844902 1868 outbound_call.cc:480] RPC callback for Local RPC call 0x0000351607efc920: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4313469, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.512s
  930. W0304 08:58:11.619884 4478 outbound_call.cc:480] RPC callback for RPC call 0x000035161f71e2c0: yb.tserver.TabletServerService.Read -> { remote: 10.244.26.28:9100 idx: 3 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4313462, state: FINISHED_SUCCESS, transfer_state: FINISHED took 1.044s
  931. W0304 08:58:11.644362 4095 outbound_call.cc:480] RPC callback for RPC call 0x000035164e03cdc0: yb.tserver.TabletServerService.Read -> { remote: 10.244.26.28:9100 idx: 7 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4313465, state: FINISHED_SUCCESS, transfer_state: FINISHED took 0.815s
  932. W0304 08:58:11.953922 6409 outbound_call.cc:480] RPC callback for Local RPC call 0x0000351662a18620: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4313477, state: FINISHED_SUCCESS, transfer_state: PENDING took 0.186s
  933. W0304 08:58:12.422616 4269 thread.cc:758] consensus [worker] (thread pool) Time spent starting thread: real 0.557s user 0.010s sys 0.088s
  934. W0304 08:58:11.872740 1060 outbound_call.cc:480] RPC callback for RPC call 0x000035161ecdedc0: yb.consensus.ConsensusService.UpdateConsensus -> { remote: 10.244.23.37:9100 idx: 1 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4312626, state: FINISHED_SUCCESS, transfer_state: FINISHED took 3.635s
  935. W0304 08:58:13.954991 458 thread.cc:800] rpc_tp_TabletServer-high-pri_73 (rpc_thread_pool) Time spent waiting for new thread to publish its TID: real 0.818s user 0.003s sys 0.023s
  936. W0304 08:58:14.668908 4283 long_operation_tracker.cc:155] UpdateReplica took a long time: 2.166s
  937. W0304 08:58:14.612624 4267 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:37693 => 10.244.22.47:9100 (request call id 3575134) took 2833ms (client timeout 3000ms).
  938. W0304 08:58:15.954341 4277 thread.cc:758] consensus [worker] (thread pool) Time spent starting thread: real 1.306s user 0.000s sys 0.360s
  939. W0304 08:58:14.716145 4269 outbound_call.cc:480] RPC callback for RPC call 0x0000351650ed8b00: yb.consensus.ConsensusService.UpdateConsensus -> { remote: 10.244.23.37:9100 idx: 2 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4312628, state: FINISHED_SUCCESS, transfer_state: FINISHED took 5.756s
  940. W0304 08:58:15.203545 458 thread.cc:758] rpc_tp_TabletServer-high-pri_73 (rpc_thread_pool) Time spent starting thread: real 3.165s user 0.035s sys 0.502s
  941. W0304 08:58:15.836329 4266 thread.cc:764] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s user 0.000s sys 0.202s
  942. W0304 08:58:14.553953 519 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:37693 => 10.244.22.47:9100 (request call id 3575111) took 2763ms (client timeout 3000ms).
  943. W0304 08:58:15.011298 3343 outbound_call.cc:480] RPC callback for Local RPC call 0x00003518ad4bef20: yb.tserver.TabletServerService.Read -> { remote: 0.0.0.0:0 idx: 0 protocol: <NULL> }, id: 4313478, state: FINISHED_SUCCESS, transfer_state: PENDING took 1.467s
  944. W0304 08:58:16.576530 4283 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:34019 => 10.244.22.47:9100 (request call id 5689990) took 4263ms (client timeout 3000ms).
  945. W0304 08:58:17.042804 4266 thread.cc:758] prepare [worker] (thread pool) Time spent starting thread: real 2.423s user 0.000s sys 0.573s
  946. W0304 08:58:16.776439 4970 outbound_call.cc:480] RPC callback for RPC call 0x00003516317f62c0: yb.tserver.TabletServerService.Read -> { remote: 10.244.26.28:9100 idx: 1 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4313473, state: FINISHED_SUCCESS, transfer_state: FINISHED took 3.962s
  947. W0304 08:58:17.219898 4260 outbound_call.cc:480] RPC callback for RPC call 0x000035160b9ba2c0: yb.consensus.ConsensusService.UpdateConsensus -> { remote: 10.244.23.37:9100 idx: 4 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4312632, state: FINISHED_SUCCESS, transfer_state: FINISHED took 7.732s
  948. W0304 08:58:16.825073 4277 outbound_call.cc:480] RPC callback for RPC call 0x000035165f5eb600: yb.consensus.ConsensusService.UpdateConsensus -> { remote: 10.244.23.37:9100 idx: 3 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4312631, state: FINISHED_SUCCESS, transfer_state: FINISHED took 7.441s
  949. W0304 08:58:17.749298 4266 long_operation_tracker.cc:155] UpdateReplica took a long time: 5.269s
  950. W0304 08:58:17.986630 4286 thread.cc:758] consensus [worker] (thread pool) Time spent starting thread: real 0.702s user 0.000s sys 0.202s
  951. I0304 08:58:18.074574 4268 raft_consensus.cc:3073] T 7787961a8c144926ba71457162bf9db8 P cfe37107123b4dea983f57a2f35b61ba [term 2074 LEADER]: Leader pre-election vote request: Denying vote to candidate bf5f7cba6912429a8e564c6ef0c2ebfe for term 2075 because replica believes a valid leader to be alive (leader uuid: cfe37107123b4dea983f57a2f35b61ba). Time left: 9223368669.535s
  952. W0304 08:58:17.902218 4258 long_operation_tracker.cc:155] UpdateReplica took a long time: 5.403s
  953. I0304 08:58:18.081473 519 raft_consensus.cc:3073] T c0e6cf3dafe5484c9c9dfc0ddc782f97 P cfe37107123b4dea983f57a2f35b61ba [term 2125 LEADER]: Leader pre-election vote request: Denying vote to candidate bf5f7cba6912429a8e564c6ef0c2ebfe for term 2126 because replica believes a valid leader to be alive (leader uuid: cfe37107123b4dea983f57a2f35b61ba). Time left: 9223368669.539s
  954. W0304 08:58:17.659345 465 thread.cc:758] rpc_tp_TabletServer-high-pri_74 (rpc_thread_pool) Time spent starting thread: real 0.764s user 0.015s sys 0.230s
  955. I0304 08:58:18.097056 4271 raft_consensus.cc:3073] T ce17b948f7ab4007a2e249da33ecf6ee P cfe37107123b4dea983f57a2f35b61ba [term 1982 LEADER]: Leader pre-election vote request: Denying vote to candidate bf5f7cba6912429a8e564c6ef0c2ebfe for term 1983 because replica believes a valid leader to be alive (leader uuid: cfe37107123b4dea983f57a2f35b61ba). Time left: 9223368669.681s
  956. I0304 08:58:18.093513 4284 raft_consensus.cc:3073] T 9b66a853302e40f58da28e9f8a66694a P cfe37107123b4dea983f57a2f35b61ba [term 2263 LEADER]: Leader pre-election vote request: Denying vote to candidate bf5f7cba6912429a8e564c6ef0c2ebfe for term 2264 because replica believes a valid leader to be alive (leader uuid: cfe37107123b4dea983f57a2f35b61ba). Time left: 9223368669.563s
  957. I0304 08:58:18.093483 7878 raft_consensus.cc:3073] T abf36d8169904b7d83d68dbfb7315039 P cfe37107123b4dea983f57a2f35b61ba [term 4200 LEADER]: Leader election vote request: Denying vote to candidate bf5f7cba6912429a8e564c6ef0c2ebfe for term 4201 because replica believes a valid leader to be alive (leader uuid: cfe37107123b4dea983f57a2f35b61ba). Time left: 9223368669.577s
  958. I0304 08:58:18.078827 4279 raft_consensus.cc:3073] T 85e949ff83de46748e91d858e4ce1022 P cfe37107123b4dea983f57a2f35b61ba [term 2460 LEADER]: Leader pre-election vote request: Denying vote to candidate bf5f7cba6912429a8e564c6ef0c2ebfe for term 2461 because replica believes a valid leader to be alive (leader uuid: cfe37107123b4dea983f57a2f35b61ba). Time left: 9223368669.682s
  959. I0304 08:58:18.075835 514 raft_consensus.cc:3073] T a2562f7f62f34acbb3a4ea0bc0faf164 P cfe37107123b4dea983f57a2f35b61ba [term 4217 LEADER]: Leader pre-election vote request: Denying vote to candidate bf5f7cba6912429a8e564c6ef0c2ebfe for term 4218 because replica believes a valid leader to be alive (leader uuid: cfe37107123b4dea983f57a2f35b61ba). Time left: 9223368669.568s
  960. W0304 08:58:17.800696 4252 long_operation_tracker.cc:155] UpdateReplica took a long time: 5.208s
  961. W0304 08:58:18.074556 507 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:37693 => 10.244.22.47:9100 (request call id 3575266) took 3998ms (client timeout 3000ms).
  962. I0304 08:58:17.891096 707 raft_consensus.cc:3606] T ea2cda623acf49f6abc032e16f6482db P cfe37107123b4dea983f57a2f35b61ba [term 2074 LEADER]: Stepping down as leader of term 2074 since new term is 2075
  963. I0304 08:58:17.800159 4294 raft_consensus.cc:3606] T fb908a7f15384b8083b950ef7e3810c0 P cfe37107123b4dea983f57a2f35b61ba [term 2007 LEADER]: Stepping down as leader of term 2007 since new term is 2008
  964. I0304 08:58:17.803970 4280 raft_consensus.cc:3606] T 8ed0ec9932c646aeaaa5c8b764777b79 P cfe37107123b4dea983f57a2f35b61ba [term 3830 LEADER]: Stepping down as leader of term 3830 since new term is 3831
  965. I0304 08:58:17.810385 4246 raft_consensus.cc:3606] T eadc4eccb1544aceb29896e45ce78882 P cfe37107123b4dea983f57a2f35b61ba [term 2029 LEADER]: Stepping down as leader of term 2029 since new term is 2030
  966. W0304 08:58:18.438946 4266 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:34019 => 10.244.22.47:9100 (request call id 5689951) took 6142ms (client timeout 3000ms).
  967. I0304 08:58:18.266425 4251 raft_consensus.cc:3073] T e29d8b7ee40047d9b53b4182a13bfe0b P cfe37107123b4dea983f57a2f35b61ba [term 2116 LEADER]: Leader election vote request: Denying vote to candidate bf5f7cba6912429a8e564c6ef0c2ebfe for term 2117 because replica believes a valid leader to be alive (leader uuid: cfe37107123b4dea983f57a2f35b61ba). Time left: 9223368669.550s
  968. I0304 08:58:18.310429 1059 raft_consensus.cc:3073] T 55ce66d4951143f2bdc987ec50e42adb P cfe37107123b4dea983f57a2f35b61ba [term 6721 LEADER]: Leader election vote request: Denying vote to candidate bf5f7cba6912429a8e564c6ef0c2ebfe for term 6722 because replica believes a valid leader to be alive (leader uuid: cfe37107123b4dea983f57a2f35b61ba). Time left: 9223368669.324s
  969. I0304 08:58:18.411274 707 raft_consensus.cc:1131] T ea2cda623acf49f6abc032e16f6482db P cfe37107123b4dea983f57a2f35b61ba [term 2074 LEADER]: Becoming Follower/Learner. State: Replica: cfe37107123b4dea983f57a2f35b61ba, State: 1, Role: LEADER, Watermarks: {Received: 2074.2065 Committed: 2074.2065} Leader: 2074.2065, new leader: , initial_fd_wait: <uninitialized>
  970. I0304 08:58:18.414323 4294 raft_consensus.cc:1131] T fb908a7f15384b8083b950ef7e3810c0 P cfe37107123b4dea983f57a2f35b61ba [term 2007 LEADER]: Becoming Follower/Learner. State: Replica: cfe37107123b4dea983f57a2f35b61ba, State: 1, Role: LEADER, Watermarks: {Received: 2007.302009 Committed: 2007.302009} Leader: 2007.302009, new leader: , initial_fd_wait: <uninitialized>
  971. W0304 08:58:18.073494 4277 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:34019 => 10.244.22.47:9100 (request call id 5690054) took 3999ms (client timeout 3000ms).
  972. I0304 08:58:18.414328 4280 raft_consensus.cc:1131] T 8ed0ec9932c646aeaaa5c8b764777b79 P cfe37107123b4dea983f57a2f35b61ba [term 3830 LEADER]: Becoming Follower/Learner. State: Replica: cfe37107123b4dea983f57a2f35b61ba, State: 1, Role: LEADER, Watermarks: {Received: 3830.5679 Committed: 3830.5679} Leader: 3830.5679, new leader: , initial_fd_wait: <uninitialized>
  973. W0304 08:58:18.434846 4258 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:37693 => 10.244.22.47:9100 (request call id 3575184) took 6600ms (client timeout 3000ms).
  974. W0304 08:58:18.433454 4252 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.26.28:34019 => 10.244.22.47:9100 (request call id 5689971) took 6136ms (client timeout 3000ms).
  975. I0304 08:58:18.648495 4255 raft_consensus.cc:3073] T ab6b142468fc4abb8591218e7de1c67e P cfe37107123b4dea983f57a2f35b61ba [term 2072 LEADER]: Leader pre-election vote request: Denying vote to candidate bf5f7cba6912429a8e564c6ef0c2ebfe for term 2073 because replica believes a valid leader to be alive (leader uuid: cfe37107123b4dea983f57a2f35b61ba). Time left: 9223368669.335s
  976. W0304 08:58:18.280084 4463 outbound_call.cc:480] RPC callback for RPC call 0x000035164c3afb80: yb.tserver.TabletServerService.Read -> { remote: 10.244.23.37:9100 idx: 4 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4313475, state: FINISHED_SUCCESS, transfer_state: FINISHED took 0.389s
  977. W0304 08:58:18.282501 4286 outbound_call.cc:480] RPC callback for RPC call 0x000035167b884000: yb.consensus.ConsensusService.UpdateConsensus -> { remote: 10.244.23.37:9100 idx: 5 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4312614, state: FINISHED_SUCCESS, transfer_state: FINISHED took 8.565s
  978. I0304 08:58:20.757218 513 raft_consensus.cc:3073] T bf1bb2ada35f47bfa6db3c364b318c7c P cfe37107123b4dea983f57a2f35b61ba [term 2504 LEADER]: Leader election vote request: Denying vote to candidate bf5f7cba6912429a8e564c6ef0c2ebfe for term 2505 because replica believes a valid leader to be alive (leader uuid: cfe37107123b4dea983f57a2f35b61ba). Time left: 9223368667.904s
  979. I0304 08:58:20.216471 4248 raft_consensus.cc:3073] T 33be1d841bf448a888cadb86a1f05264 P cfe37107123b4dea983f57a2f35b61ba [term 4444 LEADER]: Leader pre-election vote request: Denying vote to candidate bf5f7cba6912429a8e564c6ef0c2ebfe for term 4445 because replica believes a valid leader to be alive (leader uuid: cfe37107123b4dea983f57a2f35b61ba). Time left: 9223368668.468s
  980. W0304 08:58:18.727470 4264 thread.cc:758] prepare [worker] (thread pool) Time spent starting thread: real 0.663s user 0.001s sys 0.104s
  981. I0304 08:58:18.414331 4246 raft_consensus.cc:1131] T eadc4eccb1544aceb29896e45ce78882 P cfe37107123b4dea983f57a2f35b61ba [term 2029 LEADER]: Becoming Follower/Learner. State: Replica: cfe37107123b4dea983f57a2f35b61ba, State: 1, Role: LEADER, Watermarks: {Received: 2029.326850 Committed: 2029.326850} Leader: 2029.326850, new leader: , initial_fd_wait: <uninitialized>
  982. W0304 08:58:20.174957 4291 thread.cc:800] consensus [worker] (thread pool) Time spent waiting for new thread to publish its TID: real 0.960s user 0.008s sys 0.050s
  983. W0304 08:58:20.377686 1059 yb_rpc.cc:338] Call yb.consensus.ConsensusService.RequestConsensusVote 10.244.23.37:37693 => 10.244.22.47:9100 (request call id 3576017) took 2569ms (client timeout 3236ms).
  984. W0304 08:58:21.273047 4291 thread.cc:758] consensus [worker] (thread pool) Time spent starting thread: real 2.754s user 0.008s sys 0.414s
  985. W0304 08:58:21.384580 462 thread.cc:764] rpc_tp_TabletServer-high-pri_76 (rpc_thread_pool) Time spent creating pthread: real 0.839s user 0.017s sys 0.232s
  986. W0304 08:58:21.145802 4255 yb_rpc.cc:338] Call yb.consensus.ConsensusService.RequestConsensusVote 10.244.23.37:37693 => 10.244.22.47:9100 (request call id 3575996) took 3378ms (client timeout 3142ms).
  987. W0304 08:58:21.604063 4264 long_operation_tracker.cc:155] UpdateReplica took a long time: 7.286s
  988. W0304 08:58:22.464865 462 thread.cc:758] rpc_tp_TabletServer-high-pri_76 (rpc_thread_pool) Time spent starting thread: real 3.008s user 0.049s sys 0.719s
  989. W0304 08:58:34.275409 1066 thread.cc:800] prepare [worker] (thread pool) Time spent waiting for new thread to publish its TID: real 8.647s user 0.000s sys 0.599s
  990. W0304 08:58:34.878006 4290 thread.cc:800] consensus [worker] (thread pool) Time spent waiting for new thread to publish its TID: real 10.789s user 0.000s sys 0.829s
  991. W0304 08:58:22.447316 4248 yb_rpc.cc:338] Call yb.consensus.ConsensusService.RequestConsensusVote 10.244.23.37:37693 => 10.244.22.47:9100 (request call id 3575972) took 4500ms (client timeout 3120ms).
  992. W0304 08:58:21.988251 4291 outbound_call.cc:480] RPC callback for RPC call 0x000035161490e840: yb.consensus.ConsensusService.UpdateConsensus -> { remote: 10.244.26.28:9100 idx: 1 protocol: 0x000055e4b0d313c8 -> tcpc }, id: 4312629, state: FINISHED_SUCCESS, transfer_state: FINISHED took 11.301s
  993. W0304 08:58:28.603646 513 yb_rpc.cc:338] Call yb.consensus.ConsensusService.RequestConsensusVote 10.244.23.37:37693 => 10.244.22.47:9100 (request call id 3575949) took 9167ms (client timeout 3176ms).
  994. W0304 08:58:29.877537 4264 yb_rpc.cc:338] Call yb.consensus.ConsensusService.UpdateConsensus 10.244.23.37:37693 => 10.244.22.47:9100 (request call id 3575224) took 17589ms (client timeout 3000ms).
  995. W0304 08:59:03.365854 1066 thread.cc:758] prepare [worker] (thread pool) Time spent starting thread: real 36.361s user 0.000s sys 2.792s
  996. 2024-03-04 09:02:39,203 [INFO] k8s_parent.py: Executing operation: yb-tserver-2_post_debug_hook filepath: /opt/debug_hooks_config/yb-tserver-2-post_debug_hook.sh
  997. 2024-03-04 09:02:39,206 [INFO] k8s_parent.py: Output from hook b'hello-from-post\n'
  998. 2024-03-04 09:02:39,207 [INFO] k8s_parent.py: core_pattern is: /mnt/disk1/core.%e.%p.%t
  999. 2024-03-04 09:02:39,207 [INFO] k8s_parent.py: Copying latest 5 core files to '/mnt/disk0/cores' using glob '/mnt/disk1/*core*'
  1000. 2024-03-04 09:02:39,207 [INFO] k8s_parent.py: Copied 0 core files to '/mnt/disk0/cores'
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!