API tools faq
paste
Advertisement
grahamperrin

OpenZFS, FreeBSD: cache device da3p1 online long after `zpool offline Transcend /dev/da3p1`

grahamperrin
Apr 29th, 2022
124
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 17.72 KB | None | 0 0
raw download clone embed print report
  1. root@mowa219-gjp4-8570p-freebsd:~ # zpool offline Transcend /dev/da3p1
  2. root@mowa219-gjp4-8570p-freebsd:~ # zpool status -v Transcend
  3. pool: Transcend
  4. state: ONLINE
  5. status: Some supported and requested features are not enabled on the pool.
  6. The pool can still be used, but some features are unavailable.
  7. action: Enable all features using 'zpool upgrade'. Once this is done,
  8. the pool may no longer be accessible by software that does not support
  9. the features. See zpool-features(7) for details.
  10. scan: scrub repaired 0B in 01:32:30 with 0 errors on Sun Dec 12 16:25:35 2021
  11. config:
  12.  
  13. NAME STATE READ WRITE CKSUM
  14. Transcend ONLINE 0 0 0
  15. gpt/Transcend ONLINE 0 0 0
  16. cache
  17. da3p1 ONLINE 0 0 0
  18.  
  19. errors: No known data errors
  20. root@mowa219-gjp4-8570p-freebsd:~ # date ; uptime
  21. Fri Apr 29 23:21:56 BST 2022
  22. 11:21PM up 1 day, 18:18, 6 users, load averages: 2.49, 2.46, 2.02
  23. root@mowa219-gjp4-8570p-freebsd:~ # swapinfo
  24. Device 1K-blocks Used Avail Capacity
  25. /dev/ada0p2.eli 16777216 5349228 11427988 32%
  26. root@mowa219-gjp4-8570p-freebsd:~ # zpool iostat -v Transcend 1
  27. capacity operations bandwidth
  28. pool alloc free read write read write
  29. --------------- ----- ----- ----- ----- ----- -----
  30. Transcend 229G 235G 56 18 3.76M 2.00M
  31. gpt/Transcend 229G 235G 56 18 3.76M 2.00M
  32. cache - - - - - -
  33. da3p1 14.4G 88.6M 0 0 53.5K 22.6K
  34. --------------- ----- ----- ----- ----- ----- -----
  35. capacity operations bandwidth
  36. pool alloc free read write read write
  37. --------------- ----- ----- ----- ----- ----- -----
  38. Transcend 229G 235G 43 57 4.16M 733K
  39. gpt/Transcend 229G 235G 42 57 4.09M 733K
  40. cache - - - - - -
  41. da3p1 14.4G 88.6M 0 0 0 0
  42. --------------- ----- ----- ----- ----- ----- -----
  43. capacity operations bandwidth
  44. pool alloc free read write read write
  45. --------------- ----- ----- ----- ----- ----- -----
  46. Transcend 229G 235G 131 3 10.4M 16.0K
  47. gpt/Transcend 229G 235G 131 3 10.4M 16.0K
  48. cache - - - - - -
  49. da3p1 14.4G 88.6M 0 0 0 0
  50. --------------- ----- ----- ----- ----- ----- -----
  51. capacity operations bandwidth
  52. pool alloc free read write read write
  53. --------------- ----- ----- ----- ----- ----- -----
  54. Transcend 229G 235G 95 0 6.84M 0
  55. gpt/Transcend 229G 235G 95 0 6.84M 0
  56. cache - - - - - -
  57. da3p1 14.4G 88.6M 0 0 0 0
  58. --------------- ----- ----- ----- ----- ----- -----
  59. capacity operations bandwidth
  60. pool alloc free read write read write
  61. --------------- ----- ----- ----- ----- ----- -----
  62. Transcend 229G 235G 95 0 9.22M 0
  63. gpt/Transcend 229G 235G 95 0 9.22M 0
  64. cache - - - - - -
  65. da3p1 14.4G 88.6M 0 0 0 0
  66. --------------- ----- ----- ----- ----- ----- -----
  67. ^C
  68. root@mowa219-gjp4-8570p-freebsd:~ # date ; zpool status -v Transcend
  69. Fri Apr 29 23:22:38 BST 2022
  70. pool: Transcend
  71. state: ONLINE
  72. status: Some supported and requested features are not enabled on the pool.
  73. The pool can still be used, but some features are unavailable.
  74. action: Enable all features using 'zpool upgrade'. Once this is done,
  75. the pool may no longer be accessible by software that does not support
  76. the features. See zpool-features(7) for details.
  77. scan: scrub repaired 0B in 01:32:30 with 0 errors on Sun Dec 12 16:25:35 2021
  78. config:
  79.  
  80. NAME STATE READ WRITE CKSUM
  81. Transcend ONLINE 0 0 0
  82. gpt/Transcend ONLINE 0 0 0
  83. cache
  84. da3p1 ONLINE 0 0 0
  85.  
  86. errors: No known data errors
  87. root@mowa219-gjp4-8570p-freebsd:~ # uname -aKU
  88. FreeBSD mowa219-gjp4-8570p-freebsd 14.0-CURRENT FreeBSD 14.0-CURRENT #1 main-n255078-e140d551b78-dirty: Wed Apr 27 22:51:33 BST 2022 root@mowa219-gjp4-8570p-freebsd:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64 1400057 1400057
  89. root@mowa219-gjp4-8570p-freebsd:~ # sysrc -a | grep zfs
  90. zfs_enable: YES
  91. zfsd_enable: YES
  92. zfskeys_enable: YES
  93. root@mowa219-gjp4-8570p-freebsd:~ # grep zfs /boot/loader.conf | grep -v \#
  94. zfs_load="YES"
  95. openzfs_load="NO"
  96. root@mowa219-gjp4-8570p-freebsd:~ # date ; zpool status -v Transcend
  97. Fri Apr 29 23:24:54 BST 2022
  98. pool: Transcend
  99. state: ONLINE
  100. status: Some supported and requested features are not enabled on the pool.
  101. The pool can still be used, but some features are unavailable.
  102. action: Enable all features using 'zpool upgrade'. Once this is done,
  103. the pool may no longer be accessible by software that does not support
  104. the features. See zpool-features(7) for details.
  105. scan: scrub repaired 0B in 01:32:30 with 0 errors on Sun Dec 12 16:25:35 2021
  106. config:
  107.  
  108. NAME STATE READ WRITE CKSUM
  109. Transcend ONLINE 0 0 0
  110. gpt/Transcend ONLINE 0 0 0
  111. cache
  112. da3p1 ONLINE 0 0 0
  113.  
  114. errors: No known data errors
  115. root@mowa219-gjp4-8570p-freebsd:~ # history | tail -n 11
  116. 2014 23:21 zpool offline Transcend /dev/da3p1
  117. 2015 23:21 zpool status -v Transcend
  118. 2016 23:21 date ; uptime
  119. 2017 23:21 swapinfo
  120. 2018 23:22 zpool iostat -v Transcend 1
  121. 2019 23:22 date ; zpool status -v Transcend
  122. 2020 23:23 uname -aKU
  123. 2021 23:24 sysrc -a | grep zfs
  124. 2022 23:24 grep zfs /boot/loader.conf | grep -v \#
  125. 2023 23:24 date ; zpool status -v Transcend
  126. 2024 23:25 history | tail -n 11
  127. root@mowa219-gjp4-8570p-freebsd:~ # date ; zpool status -v Transcend
  128. Fri Apr 29 23:25:55 BST 2022
  129. pool: Transcend
  130. state: ONLINE
  131. status: Some supported and requested features are not enabled on the pool.
  132. The pool can still be used, but some features are unavailable.
  133. action: Enable all features using 'zpool upgrade'. Once this is done,
  134. the pool may no longer be accessible by software that does not support
  135. the features. See zpool-features(7) for details.
  136. scan: scrub repaired 0B in 01:32:30 with 0 errors on Sun Dec 12 16:25:35 2021
  137. config:
  138.  
  139. NAME STATE READ WRITE CKSUM
  140. Transcend ONLINE 0 0 0
  141. gpt/Transcend ONLINE 0 0 0
  142. cache
  143. da3p1 ONLINE 0 0 0
  144.  
  145. errors: No known data errors
  146. root@mowa219-gjp4-8570p-freebsd:~ # zpool offline Transcend da3p1
  147. root@mowa219-gjp4-8570p-freebsd:~ # date ; zpool status -v Transcend
  148. Fri Apr 29 23:26:24 BST 2022
  149. pool: Transcend
  150. state: ONLINE
  151. status: Some supported and requested features are not enabled on the pool.
  152. The pool can still be used, but some features are unavailable.
  153. action: Enable all features using 'zpool upgrade'. Once this is done,
  154. the pool may no longer be accessible by software that does not support
  155. the features. See zpool-features(7) for details.
  156. scan: scrub repaired 0B in 01:32:30 with 0 errors on Sun Dec 12 16:25:35 2021
  157. config:
  158.  
  159. NAME STATE READ WRITE CKSUM
  160. Transcend ONLINE 0 0 0
  161. gpt/Transcend ONLINE 0 0 0
  162. cache
  163. da3p1 ONLINE 0 0 0
  164.  
  165. errors: No known data errors
  166. root@mowa219-gjp4-8570p-freebsd:~ # lsblk
  167. DEVICE MAJ:MIN SIZE TYPE LABEL MOUNT
  168. ada0 0:119 932G GPT - -
  169. ada0p1 0:121 260M efi gpt/efiboot0 -
  170. <FREE> -:- 1.0M - - -
  171. ada0p2 0:123 16G freebsd-swap gpt/swap0 SWAP
  172. ada0p2.eli 2:49 16G freebsd-swap - SWAP
  173. ada0p3 0:125 915G freebsd-zfs gpt/zfs0 <ZFS>
  174. ada0p3.eli 0:131 915G zfs - -
  175. <FREE> -:- 708K - - -
  176. da0 2:76 15G GPT - -
  177. <FREE> -:- 1.0M - - -
  178. da0p1 2:77 15G freebsd-zfs gpt/duracell <ZFS>
  179. da1 2:103 466G GPT - -
  180. <FREE> -:- 1.0M - - -
  181. da1p1 2:104 466G freebsd-zfs gpt/Transcend <ZFS>
  182. da2 2:165 29G GPT - -
  183. <FREE> -:- 1.0M - - -
  184. da2p1 2:166 29G freebsd-zfs gpt/cache-august <ZFS>
  185. da3 2:174 14G GPT - -
  186. <FREE> -:- 1.0M - - -
  187. da3p1 2:175 14G freebsd-zfs gpt/cache-transcend <ZFS>
  188. root@mowa219-gjp4-8570p-freebsd:~ # zpool iostat -v Transcend 1
  189. capacity operations bandwidth
  190. pool alloc free read write read write
  191. --------------- ----- ----- ----- ----- ----- -----
  192. Transcend 229G 235G 56 18 3.76M 1.98M
  193. gpt/Transcend 229G 235G 56 18 3.76M 1.98M
  194. cache - - - - - -
  195. da3p1 14.4G 85.4M 0 0 52.7K 22.3K
  196. --------------- ----- ----- ----- ----- ----- -----
  197. capacity operations bandwidth
  198. pool alloc free read write read write
  199. --------------- ----- ----- ----- ----- ----- -----
  200. Transcend 229G 235G 33 28 1.65M 4.18M
  201. gpt/Transcend 229G 235G 33 28 1.65M 4.18M
  202. cache - - - - - -
  203. da3p1 14.4G 85.4M 0 0 0 0
  204. --------------- ----- ----- ----- ----- ----- -----
  205. capacity operations bandwidth
  206. pool alloc free read write read write
  207. --------------- ----- ----- ----- ----- ----- -----
  208. Transcend 229G 235G 26 47 1.15M 504K
  209. gpt/Transcend 229G 235G 26 47 1.15M 504K
  210. cache - - - - - -
  211. da3p1 14.4G 85.4M 0 0 0 0
  212. --------------- ----- ----- ----- ----- ----- -----
  213. capacity operations bandwidth
  214. pool alloc free read write read write
  215. --------------- ----- ----- ----- ----- ----- -----
  216. Transcend 229G 235G 57 0 2.87M 0
  217. gpt/Transcend 229G 235G 57 0 2.87M 0
  218. cache - - - - - -
  219. da3p1 14.4G 85.1M 0 4 0 299K
  220. --------------- ----- ----- ----- ----- ----- -----
  221. capacity operations bandwidth
  222. pool alloc free read write read write
  223. --------------- ----- ----- ----- ----- ----- -----
  224. Transcend 229G 235G 51 0 2.22M 0
  225. gpt/Transcend 229G 235G 51 0 2.22M 0
  226. cache - - - - - -
  227. da3p1 14.4G 85.1M 0 0 0 0
  228. --------------- ----- ----- ----- ----- ----- -----
  229. ^C
  230. root@mowa219-gjp4-8570p-freebsd:~ # history | tail -n 5
  231. 2026 23:26 zpool offline Transcend da3p1
  232. 2027 23:26 date ; zpool status -v Transcend
  233. 2028 23:27 lsblk
  234. 2029 23:29 zpool iostat -v Transcend 1
  235. 2030 23:29 history | tail -n 5
  236. root@mowa219-gjp4-8570p-freebsd:~ # geom disk list da1
  237. Geom name: da1
  238. Providers:
  239. 1. Name: da1
  240. Mediasize: 500107862016 (466G)
  241. Sectorsize: 512
  242. Stripesize: 4096
  243. Stripeoffset: 0
  244. Mode: r1w1e3
  245. descr: StoreJet Transcend
  246. lunid: 5000000000000001
  247. ident: (null)
  248. rotationrate: unknown
  249. fwsectors: 63
  250. fwheads: 255
  251.  
  252. root@mowa219-gjp4-8570p-freebsd:~ # geom disk list da3
  253. Geom name: da3
  254. Providers:
  255. 1. Name: da3
  256. Mediasize: 15518924800 (14G)
  257. Sectorsize: 512
  258. Mode: r1w1e2
  259. descr: Kingston DataTraveler 3.0
  260. lunname: KingstonDataTraveler 3.0
  261. lunid: KingstonDataTraveler 3.0
  262. ident: 60A44C3FACC93110B9970045
  263. rotationrate: 0
  264. fwsectors: 63
  265. fwheads: 255
  266.  
  267. root@mowa219-gjp4-8570p-freebsd:~ # zdb -l /dev/da3p1
  268. ------------------------------------
  269. LABEL 0
  270. ------------------------------------
  271. version: 5000
  272. state: 4
  273. guid: 1869112229494633056
  274. labels = 0 1 2 3
  275. ------------------------------------
  276. L2ARC device header
  277. ------------------------------------
  278. magic: 6504978260106102853
  279. version: 1
  280. pool_guid: 8076233369858608335
  281. flags: 0
  282. start_lbps[0]: 6405963776
  283. start_lbps[1]: 6355226624
  284. log_blk_ent: 924
  285. start: 4198400
  286. end: 15517089792
  287. evict: 6449340416
  288. lb_asize_refcount: 4300800
  289. lb_count_refcount: 245
  290. trim_action_time: 0
  291. trim_state: 0
  292.  
  293. ------------------------------------
  294. L2ARC device log blocks
  295. ------------------------------------
  296. log_blk_count: 245 with valid cksum
  297. 0 with invalid cksum
  298. log_blk_asize: 4300800
  299.  
  300. root@mowa219-gjp4-8570p-freebsd:~ # date ; zpool status -v Transcend
  301. Sat Apr 30 00:04:34 BST 2022
  302. pool: Transcend
  303. state: ONLINE
  304. status: Some supported and requested features are not enabled on the pool.
  305. The pool can still be used, but some features are unavailable.
  306. action: Enable all features using 'zpool upgrade'. Once this is done,
  307. the pool may no longer be accessible by software that does not support
  308. the features. See zpool-features(7) for details.
  309. scan: scrub repaired 0B in 01:32:30 with 0 errors on Sun Dec 12 16:25:35 2021
  310. config:
  311.  
  312. NAME STATE READ WRITE CKSUM
  313. Transcend ONLINE 0 0 0
  314. gpt/Transcend ONLINE 0 0 0
  315. cache
  316. da3p1 ONLINE 0 0 0
  317.  
  318. errors: No known data errors
  319. root@mowa219-gjp4-8570p-freebsd:~ # date ; zpool iostat -v Transcend 1
  320. Sat Apr 30 00:04:55 BST 2022
  321. capacity operations bandwidth
  322. pool alloc free read write read write
  323. --------------- ----- ----- ----- ----- ----- -----
  324. Transcend 228G 236G 56 18 3.66M 1.93M
  325. gpt/Transcend 228G 236G 56 18 3.66M 1.93M
  326. cache - - - - - -
  327. da3p1 14.3G 133M 0 0 54.9K 25.9K
  328. --------------- ----- ----- ----- ----- ----- -----
  329. capacity operations bandwidth
  330. pool alloc free read write read write
  331. --------------- ----- ----- ----- ----- ----- -----
  332. Transcend 228G 236G 64 0 2.19M 0
  333. gpt/Transcend 228G 236G 64 0 2.19M 0
  334. cache - - - - - -
  335. da3p1 14.3G 133M 2 0 180K 0
  336. --------------- ----- ----- ----- ----- ----- -----
  337. ^C
  338. root@mowa219-gjp4-8570p-freebsd:~ # date ; zpool status -v Transcend
  339. Sat Apr 30 00:18:00 BST 2022
  340. pool: Transcend
  341. state: ONLINE
  342. status: Some supported and requested features are not enabled on the pool.
  343. The pool can still be used, but some features are unavailable.
  344. action: Enable all features using 'zpool upgrade'. Once this is done,
  345. the pool may no longer be accessible by software that does not support
  346. the features. See zpool-features(7) for details.
  347. scan: scrub repaired 0B in 01:32:30 with 0 errors on Sun Dec 12 16:25:35 2021
  348. config:
  349.  
  350. NAME STATE READ WRITE CKSUM
  351. Transcend ONLINE 0 0 0
  352. gpt/Transcend ONLINE 0 0 0
  353. cache
  354. da3p1 ONLINE 0 0 0
  355.  
  356. errors: No known data errors
  357. root@mowa219-gjp4-8570p-freebsd:~ # swapinfo
  358. Device 1K-blocks Used Avail Capacity
  359. /dev/ada0p2.eli 16777216 3469484 13307732 21%
  360. root@mowa219-gjp4-8570p-freebsd:~ # /usr/home/grahamperrin/dev/swapflush/swapflush -a
  361. root@mowa219-gjp4-8570p-freebsd:~ # date ; swapinfo ; zpool status Transcend
  362. Sat Apr 30 00:41:13 BST 2022
  363. Device 1K-blocks Used Avail Capacity
  364. /dev/ada0p2.eli 16777216 1246020 15531196 7%
  365. pool: Transcend
  366. state: ONLINE
  367. status: Some supported and requested features are not enabled on the pool.
  368. The pool can still be used, but some features are unavailable.
  369. action: Enable all features using 'zpool upgrade'. Once this is done,
  370. the pool may no longer be accessible by software that does not support
  371. the features. See zpool-features(7) for details.
  372. scan: scrub repaired 0B in 01:32:30 with 0 errors on Sun Dec 12 16:25:35 2021
  373. config:
  374.  
  375. NAME STATE READ WRITE CKSUM
  376. Transcend ONLINE 0 0 0
  377. gpt/Transcend ONLINE 0 0 0
  378. cache
  379. da3p1 ONLINE 0 0 0
  380.  
  381. errors: No known data errors
  382. root@mowa219-gjp4-8570p-freebsd:~ #
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!