Advertisement
grahamperrin

OpenZFS, FreeBSD: cache device da3p1 online long after `zpool offline Transcend /dev/da3p1`

Apr 29th, 2022
27
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 17.72 KB | None
  1. root@mowa219-gjp4-8570p-freebsd:~ # zpool offline Transcend /dev/da3p1
  2. root@mowa219-gjp4-8570p-freebsd:~ # zpool status -v Transcend
  3. pool: Transcend
  4. state: ONLINE
  5. status: Some supported and requested features are not enabled on the pool.
  6. The pool can still be used, but some features are unavailable.
  7. action: Enable all features using 'zpool upgrade'. Once this is done,
  8. the pool may no longer be accessible by software that does not support
  9. the features. See zpool-features(7) for details.
  10. scan: scrub repaired 0B in 01:32:30 with 0 errors on Sun Dec 12 16:25:35 2021
  11. config:
  12.  
  13. NAME STATE READ WRITE CKSUM
  14. Transcend ONLINE 0 0 0
  15. gpt/Transcend ONLINE 0 0 0
  16. cache
  17. da3p1 ONLINE 0 0 0
  18.  
  19. errors: No known data errors
  20. root@mowa219-gjp4-8570p-freebsd:~ # date ; uptime
  21. Fri Apr 29 23:21:56 BST 2022
  22. 11:21PM up 1 day, 18:18, 6 users, load averages: 2.49, 2.46, 2.02
  23. root@mowa219-gjp4-8570p-freebsd:~ # swapinfo
  24. Device 1K-blocks Used Avail Capacity
  25. /dev/ada0p2.eli 16777216 5349228 11427988 32%
  26. root@mowa219-gjp4-8570p-freebsd:~ # zpool iostat -v Transcend 1
  27. capacity operations bandwidth
  28. pool alloc free read write read write
  29. --------------- ----- ----- ----- ----- ----- -----
  30. Transcend 229G 235G 56 18 3.76M 2.00M
  31. gpt/Transcend 229G 235G 56 18 3.76M 2.00M
  32. cache - - - - - -
  33. da3p1 14.4G 88.6M 0 0 53.5K 22.6K
  34. --------------- ----- ----- ----- ----- ----- -----
  35. capacity operations bandwidth
  36. pool alloc free read write read write
  37. --------------- ----- ----- ----- ----- ----- -----
  38. Transcend 229G 235G 43 57 4.16M 733K
  39. gpt/Transcend 229G 235G 42 57 4.09M 733K
  40. cache - - - - - -
  41. da3p1 14.4G 88.6M 0 0 0 0
  42. --------------- ----- ----- ----- ----- ----- -----
  43. capacity operations bandwidth
  44. pool alloc free read write read write
  45. --------------- ----- ----- ----- ----- ----- -----
  46. Transcend 229G 235G 131 3 10.4M 16.0K
  47. gpt/Transcend 229G 235G 131 3 10.4M 16.0K
  48. cache - - - - - -
  49. da3p1 14.4G 88.6M 0 0 0 0
  50. --------------- ----- ----- ----- ----- ----- -----
  51. capacity operations bandwidth
  52. pool alloc free read write read write
  53. --------------- ----- ----- ----- ----- ----- -----
  54. Transcend 229G 235G 95 0 6.84M 0
  55. gpt/Transcend 229G 235G 95 0 6.84M 0
  56. cache - - - - - -
  57. da3p1 14.4G 88.6M 0 0 0 0
  58. --------------- ----- ----- ----- ----- ----- -----
  59. capacity operations bandwidth
  60. pool alloc free read write read write
  61. --------------- ----- ----- ----- ----- ----- -----
  62. Transcend 229G 235G 95 0 9.22M 0
  63. gpt/Transcend 229G 235G 95 0 9.22M 0
  64. cache - - - - - -
  65. da3p1 14.4G 88.6M 0 0 0 0
  66. --------------- ----- ----- ----- ----- ----- -----
  67. ^C
  68. root@mowa219-gjp4-8570p-freebsd:~ # date ; zpool status -v Transcend
  69. Fri Apr 29 23:22:38 BST 2022
  70. pool: Transcend
  71. state: ONLINE
  72. status: Some supported and requested features are not enabled on the pool.
  73. The pool can still be used, but some features are unavailable.
  74. action: Enable all features using 'zpool upgrade'. Once this is done,
  75. the pool may no longer be accessible by software that does not support
  76. the features. See zpool-features(7) for details.
  77. scan: scrub repaired 0B in 01:32:30 with 0 errors on Sun Dec 12 16:25:35 2021
  78. config:
  79.  
  80. NAME STATE READ WRITE CKSUM
  81. Transcend ONLINE 0 0 0
  82. gpt/Transcend ONLINE 0 0 0
  83. cache
  84. da3p1 ONLINE 0 0 0
  85.  
  86. errors: No known data errors
  87. root@mowa219-gjp4-8570p-freebsd:~ # uname -aKU
  88. FreeBSD mowa219-gjp4-8570p-freebsd 14.0-CURRENT FreeBSD 14.0-CURRENT #1 main-n255078-e140d551b78-dirty: Wed Apr 27 22:51:33 BST 2022 root@mowa219-gjp4-8570p-freebsd:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64 1400057 1400057
  89. root@mowa219-gjp4-8570p-freebsd:~ # sysrc -a | grep zfs
  90. zfs_enable: YES
  91. zfsd_enable: YES
  92. zfskeys_enable: YES
  93. root@mowa219-gjp4-8570p-freebsd:~ # grep zfs /boot/loader.conf | grep -v \#
  94. zfs_load="YES"
  95. openzfs_load="NO"
  96. root@mowa219-gjp4-8570p-freebsd:~ # date ; zpool status -v Transcend
  97. Fri Apr 29 23:24:54 BST 2022
  98. pool: Transcend
  99. state: ONLINE
  100. status: Some supported and requested features are not enabled on the pool.
  101. The pool can still be used, but some features are unavailable.
  102. action: Enable all features using 'zpool upgrade'. Once this is done,
  103. the pool may no longer be accessible by software that does not support
  104. the features. See zpool-features(7) for details.
  105. scan: scrub repaired 0B in 01:32:30 with 0 errors on Sun Dec 12 16:25:35 2021
  106. config:
  107.  
  108. NAME STATE READ WRITE CKSUM
  109. Transcend ONLINE 0 0 0
  110. gpt/Transcend ONLINE 0 0 0
  111. cache
  112. da3p1 ONLINE 0 0 0
  113.  
  114. errors: No known data errors
  115. root@mowa219-gjp4-8570p-freebsd:~ # history | tail -n 11
  116. 2014 23:21 zpool offline Transcend /dev/da3p1
  117. 2015 23:21 zpool status -v Transcend
  118. 2016 23:21 date ; uptime
  119. 2017 23:21 swapinfo
  120. 2018 23:22 zpool iostat -v Transcend 1
  121. 2019 23:22 date ; zpool status -v Transcend
  122. 2020 23:23 uname -aKU
  123. 2021 23:24 sysrc -a | grep zfs
  124. 2022 23:24 grep zfs /boot/loader.conf | grep -v \#
  125. 2023 23:24 date ; zpool status -v Transcend
  126. 2024 23:25 history | tail -n 11
  127. root@mowa219-gjp4-8570p-freebsd:~ # date ; zpool status -v Transcend
  128. Fri Apr 29 23:25:55 BST 2022
  129. pool: Transcend
  130. state: ONLINE
  131. status: Some supported and requested features are not enabled on the pool.
  132. The pool can still be used, but some features are unavailable.
  133. action: Enable all features using 'zpool upgrade'. Once this is done,
  134. the pool may no longer be accessible by software that does not support
  135. the features. See zpool-features(7) for details.
  136. scan: scrub repaired 0B in 01:32:30 with 0 errors on Sun Dec 12 16:25:35 2021
  137. config:
  138.  
  139. NAME STATE READ WRITE CKSUM
  140. Transcend ONLINE 0 0 0
  141. gpt/Transcend ONLINE 0 0 0
  142. cache
  143. da3p1 ONLINE 0 0 0
  144.  
  145. errors: No known data errors
  146. root@mowa219-gjp4-8570p-freebsd:~ # zpool offline Transcend da3p1
  147. root@mowa219-gjp4-8570p-freebsd:~ # date ; zpool status -v Transcend
  148. Fri Apr 29 23:26:24 BST 2022
  149. pool: Transcend
  150. state: ONLINE
  151. status: Some supported and requested features are not enabled on the pool.
  152. The pool can still be used, but some features are unavailable.
  153. action: Enable all features using 'zpool upgrade'. Once this is done,
  154. the pool may no longer be accessible by software that does not support
  155. the features. See zpool-features(7) for details.
  156. scan: scrub repaired 0B in 01:32:30 with 0 errors on Sun Dec 12 16:25:35 2021
  157. config:
  158.  
  159. NAME STATE READ WRITE CKSUM
  160. Transcend ONLINE 0 0 0
  161. gpt/Transcend ONLINE 0 0 0
  162. cache
  163. da3p1 ONLINE 0 0 0
  164.  
  165. errors: No known data errors
  166. root@mowa219-gjp4-8570p-freebsd:~ # lsblk
  167. DEVICE MAJ:MIN SIZE TYPE LABEL MOUNT
  168. ada0 0:119 932G GPT - -
  169. ada0p1 0:121 260M efi gpt/efiboot0 -
  170. <FREE> -:- 1.0M - - -
  171. ada0p2 0:123 16G freebsd-swap gpt/swap0 SWAP
  172. ada0p2.eli 2:49 16G freebsd-swap - SWAP
  173. ada0p3 0:125 915G freebsd-zfs gpt/zfs0 <ZFS>
  174. ada0p3.eli 0:131 915G zfs - -
  175. <FREE> -:- 708K - - -
  176. da0 2:76 15G GPT - -
  177. <FREE> -:- 1.0M - - -
  178. da0p1 2:77 15G freebsd-zfs gpt/duracell <ZFS>
  179. da1 2:103 466G GPT - -
  180. <FREE> -:- 1.0M - - -
  181. da1p1 2:104 466G freebsd-zfs gpt/Transcend <ZFS>
  182. da2 2:165 29G GPT - -
  183. <FREE> -:- 1.0M - - -
  184. da2p1 2:166 29G freebsd-zfs gpt/cache-august <ZFS>
  185. da3 2:174 14G GPT - -
  186. <FREE> -:- 1.0M - - -
  187. da3p1 2:175 14G freebsd-zfs gpt/cache-transcend <ZFS>
  188. root@mowa219-gjp4-8570p-freebsd:~ # zpool iostat -v Transcend 1
  189. capacity operations bandwidth
  190. pool alloc free read write read write
  191. --------------- ----- ----- ----- ----- ----- -----
  192. Transcend 229G 235G 56 18 3.76M 1.98M
  193. gpt/Transcend 229G 235G 56 18 3.76M 1.98M
  194. cache - - - - - -
  195. da3p1 14.4G 85.4M 0 0 52.7K 22.3K
  196. --------------- ----- ----- ----- ----- ----- -----
  197. capacity operations bandwidth
  198. pool alloc free read write read write
  199. --------------- ----- ----- ----- ----- ----- -----
  200. Transcend 229G 235G 33 28 1.65M 4.18M
  201. gpt/Transcend 229G 235G 33 28 1.65M 4.18M
  202. cache - - - - - -
  203. da3p1 14.4G 85.4M 0 0 0 0
  204. --------------- ----- ----- ----- ----- ----- -----
  205. capacity operations bandwidth
  206. pool alloc free read write read write
  207. --------------- ----- ----- ----- ----- ----- -----
  208. Transcend 229G 235G 26 47 1.15M 504K
  209. gpt/Transcend 229G 235G 26 47 1.15M 504K
  210. cache - - - - - -
  211. da3p1 14.4G 85.4M 0 0 0 0
  212. --------------- ----- ----- ----- ----- ----- -----
  213. capacity operations bandwidth
  214. pool alloc free read write read write
  215. --------------- ----- ----- ----- ----- ----- -----
  216. Transcend 229G 235G 57 0 2.87M 0
  217. gpt/Transcend 229G 235G 57 0 2.87M 0
  218. cache - - - - - -
  219. da3p1 14.4G 85.1M 0 4 0 299K
  220. --------------- ----- ----- ----- ----- ----- -----
  221. capacity operations bandwidth
  222. pool alloc free read write read write
  223. --------------- ----- ----- ----- ----- ----- -----
  224. Transcend 229G 235G 51 0 2.22M 0
  225. gpt/Transcend 229G 235G 51 0 2.22M 0
  226. cache - - - - - -
  227. da3p1 14.4G 85.1M 0 0 0 0
  228. --------------- ----- ----- ----- ----- ----- -----
  229. ^C
  230. root@mowa219-gjp4-8570p-freebsd:~ # history | tail -n 5
  231. 2026 23:26 zpool offline Transcend da3p1
  232. 2027 23:26 date ; zpool status -v Transcend
  233. 2028 23:27 lsblk
  234. 2029 23:29 zpool iostat -v Transcend 1
  235. 2030 23:29 history | tail -n 5
  236. root@mowa219-gjp4-8570p-freebsd:~ # geom disk list da1
  237. Geom name: da1
  238. Providers:
  239. 1. Name: da1
  240. Mediasize: 500107862016 (466G)
  241. Sectorsize: 512
  242. Stripesize: 4096
  243. Stripeoffset: 0
  244. Mode: r1w1e3
  245. descr: StoreJet Transcend
  246. lunid: 5000000000000001
  247. ident: (null)
  248. rotationrate: unknown
  249. fwsectors: 63
  250. fwheads: 255
  251.  
  252. root@mowa219-gjp4-8570p-freebsd:~ # geom disk list da3
  253. Geom name: da3
  254. Providers:
  255. 1. Name: da3
  256. Mediasize: 15518924800 (14G)
  257. Sectorsize: 512
  258. Mode: r1w1e2
  259. descr: Kingston DataTraveler 3.0
  260. lunname: KingstonDataTraveler 3.0
  261. lunid: KingstonDataTraveler 3.0
  262. ident: 60A44C3FACC93110B9970045
  263. rotationrate: 0
  264. fwsectors: 63
  265. fwheads: 255
  266.  
  267. root@mowa219-gjp4-8570p-freebsd:~ # zdb -l /dev/da3p1
  268. ------------------------------------
  269. LABEL 0
  270. ------------------------------------
  271. version: 5000
  272. state: 4
  273. guid: 1869112229494633056
  274. labels = 0 1 2 3
  275. ------------------------------------
  276. L2ARC device header
  277. ------------------------------------
  278. magic: 6504978260106102853
  279. version: 1
  280. pool_guid: 8076233369858608335
  281. flags: 0
  282. start_lbps[0]: 6405963776
  283. start_lbps[1]: 6355226624
  284. log_blk_ent: 924
  285. start: 4198400
  286. end: 15517089792
  287. evict: 6449340416
  288. lb_asize_refcount: 4300800
  289. lb_count_refcount: 245
  290. trim_action_time: 0
  291. trim_state: 0
  292.  
  293. ------------------------------------
  294. L2ARC device log blocks
  295. ------------------------------------
  296. log_blk_count: 245 with valid cksum
  297. 0 with invalid cksum
  298. log_blk_asize: 4300800
  299.  
  300. root@mowa219-gjp4-8570p-freebsd:~ # date ; zpool status -v Transcend
  301. Sat Apr 30 00:04:34 BST 2022
  302. pool: Transcend
  303. state: ONLINE
  304. status: Some supported and requested features are not enabled on the pool.
  305. The pool can still be used, but some features are unavailable.
  306. action: Enable all features using 'zpool upgrade'. Once this is done,
  307. the pool may no longer be accessible by software that does not support
  308. the features. See zpool-features(7) for details.
  309. scan: scrub repaired 0B in 01:32:30 with 0 errors on Sun Dec 12 16:25:35 2021
  310. config:
  311.  
  312. NAME STATE READ WRITE CKSUM
  313. Transcend ONLINE 0 0 0
  314. gpt/Transcend ONLINE 0 0 0
  315. cache
  316. da3p1 ONLINE 0 0 0
  317.  
  318. errors: No known data errors
  319. root@mowa219-gjp4-8570p-freebsd:~ # date ; zpool iostat -v Transcend 1
  320. Sat Apr 30 00:04:55 BST 2022
  321. capacity operations bandwidth
  322. pool alloc free read write read write
  323. --------------- ----- ----- ----- ----- ----- -----
  324. Transcend 228G 236G 56 18 3.66M 1.93M
  325. gpt/Transcend 228G 236G 56 18 3.66M 1.93M
  326. cache - - - - - -
  327. da3p1 14.3G 133M 0 0 54.9K 25.9K
  328. --------------- ----- ----- ----- ----- ----- -----
  329. capacity operations bandwidth
  330. pool alloc free read write read write
  331. --------------- ----- ----- ----- ----- ----- -----
  332. Transcend 228G 236G 64 0 2.19M 0
  333. gpt/Transcend 228G 236G 64 0 2.19M 0
  334. cache - - - - - -
  335. da3p1 14.3G 133M 2 0 180K 0
  336. --------------- ----- ----- ----- ----- ----- -----
  337. ^C
  338. root@mowa219-gjp4-8570p-freebsd:~ # date ; zpool status -v Transcend
  339. Sat Apr 30 00:18:00 BST 2022
  340. pool: Transcend
  341. state: ONLINE
  342. status: Some supported and requested features are not enabled on the pool.
  343. The pool can still be used, but some features are unavailable.
  344. action: Enable all features using 'zpool upgrade'. Once this is done,
  345. the pool may no longer be accessible by software that does not support
  346. the features. See zpool-features(7) for details.
  347. scan: scrub repaired 0B in 01:32:30 with 0 errors on Sun Dec 12 16:25:35 2021
  348. config:
  349.  
  350. NAME STATE READ WRITE CKSUM
  351. Transcend ONLINE 0 0 0
  352. gpt/Transcend ONLINE 0 0 0
  353. cache
  354. da3p1 ONLINE 0 0 0
  355.  
  356. errors: No known data errors
  357. root@mowa219-gjp4-8570p-freebsd:~ # swapinfo
  358. Device 1K-blocks Used Avail Capacity
  359. /dev/ada0p2.eli 16777216 3469484 13307732 21%
  360. root@mowa219-gjp4-8570p-freebsd:~ # /usr/home/grahamperrin/dev/swapflush/swapflush -a
  361. root@mowa219-gjp4-8570p-freebsd:~ # date ; swapinfo ; zpool status Transcend
  362. Sat Apr 30 00:41:13 BST 2022
  363. Device 1K-blocks Used Avail Capacity
  364. /dev/ada0p2.eli 16777216 1246020 15531196 7%
  365. pool: Transcend
  366. state: ONLINE
  367. status: Some supported and requested features are not enabled on the pool.
  368. The pool can still be used, but some features are unavailable.
  369. action: Enable all features using 'zpool upgrade'. Once this is done,
  370. the pool may no longer be accessible by software that does not support
  371. the features. See zpool-features(7) for details.
  372. scan: scrub repaired 0B in 01:32:30 with 0 errors on Sun Dec 12 16:25:35 2021
  373. config:
  374.  
  375. NAME STATE READ WRITE CKSUM
  376. Transcend ONLINE 0 0 0
  377. gpt/Transcend ONLINE 0 0 0
  378. cache
  379. da3p1 ONLINE 0 0 0
  380.  
  381. errors: No known data errors
  382. root@mowa219-gjp4-8570p-freebsd:~ #
Advertisement
RAW Paste Data Copied
Advertisement