Swampcritter

HomeLab - Testing Results for Ceph SSE-S3 and Vault HA

Sep 6th, 2024
86
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 1.88 KB | Source Code | 0 0
  1. I setup a ceph cluster at home under VMware (2x ceph-monitor/managers VMs, 3x Ceph OSD VMs). I got Vault High Availability operational as well on 3x Ubuntu VMs. I am currently working on an ansible script for the SSE-S3 encryption stuff. I also got an HAProxy front-end with a RGW as well. I got part of the S3 aws commands (aws-cli and s3cmd client) working to communicate with the RGW HAproxy front-end to talk with the configuration I applied. I can run the command and 'list' the bucket and its contents. The issue seems to be when I attempt to do a 'put' to the actual encrypted S3 bucket. In the Ceph dashboard it is showing that the 'testbucket' bucket is encrypted, so that is at least a positive note.
  2.  
  3. ubuntu@ansible:~$ aws s3 ls --endpoint-url
  4. http://192.168.1.175
  5. 2024-08-29 01:20:12 testbucket
  6.  
  7. ubuntu@ansible:~$ aws s3 cp myfile.txt s3://testbucket/ --endpoint-url
  8. http://192.168.1.175
  9. upload failed: ./myfile.txt to s3://testbucket/myfile.txt argument of type 'NoneType' is not iterable
  10.  
  11. ubuntu@ansible:~$ s3cmd ls
  12. 2024-08-29 02:02 s3://testbucket
  13.  
  14. ubuntu@ansible:~$ s3cmd put myfile.txt s3://testbucket
  15. upload: 'myfile.txt' -> 's3://testbucket/myfile.txt' [1 of 1]
  16. 21 of 21 100% in 0s 433.09 B/s done
  17. ERROR: S3 error: 400 (InvalidRequest)
  18.  
  19. ubuntu@ansible:~$ s3cmd info s3://testbucket
  20.  
  21. s3://testbucket/ (bucket):
  22. Location: default
  23. Payer: BucketOwner
  24. Expiration Rule: none
  25. Policy: {
  26. "Version": "2012-10-17",
  27. "Id": "S3Policy1",
  28. "Statement": [
  29. {
  30. "Sid": "BucketAllow",
  31. "Effect": "Allow",
  32. "Principal": {
  33. "AWS": ["arn:aws:iam:::user/test"]
  34. },
  35. "Action": [
  36. "s3:ListBucket",
  37. "s3:PutObject",
  38. "s3:GetObject"
  39. ],
  40. "Resource": [
  41. "arn:aws:s3:::testbucket",
  42. "arn:aws:s3:::testbucket/*"
  43. ]
  44. }
  45. ]
  46. }
  47.  
  48. CORS: none
  49. ACL: Test User: FULL_CONTROL
  50.  
Advertisement
Add Comment
Please, Sign In to add comment