(04:11:22 PM) xarses: hello
(04:11:41 PM) odyssey4me: joshd - thanks for the help... it turns out that adding the client.volumes with the keyfile parameter resolves the issue :)
(04:12:31 PM) joshd: odyssey4me: you're welcome, glad that fixed it
(04:12:50 PM) odyssey4me: this will be easy enough to automate with chef, so it's not too much of a hassle
(04:13:22 PM) odyssey4me: @alram - btw, I've done a ton of setup automation in the chef cookbooks... you're well overdue for a review ;)
(04:13:22 PM) cephalobot: odyssey4me: Error: "alram" is not a valid command.
(04:14:07 PM) joshd: itatar: fedora should work fine, although most tested on is ubuntu
(04:18:21 PM) xarses: hi all, I'm trying to setup glance to use ceph
(04:18:39 PM) xarses: it appears that the problem is with the generated keyring file
(04:19:24 PM) xarses: glance gives me no hint of this, but attempting to set up rdb map, it compains about the keyring file
(04:19:24 PM) pbojanic [~Adium@65-112-206-178.dia.static.qwest.net] entered the room.
(04:19:34 PM) pbojanic left the room.
(04:19:37 PM) itatar: thanks joshd
(04:19:51 PM) xarses: rbd map foo --pool images --name client.images --keyfile ceph.client.images.keyring
(04:19:51 PM) xarses: 2013-08-22 23:18:13.917482 7f39b2c48760 -1 auth: failed to decode key '
(04:19:51 PM) xarses: [client.images]
(04:19:51 PM) xarses:         key = AQDGmBZS+B4rDhAADaqqi78QiJvoHjExyd64SQ==
(04:19:51 PM) xarses: '
(04:20:15 PM) odyssey4me: xarses - the keyfile needs to onlye contain the key itself
(04:20:19 PM) xarses: ceph auth get-or-create client.images mon 'allow r' osd     'allow class-read object_prefix rbd_children, allow rwx pool=images' > ceph.client.images.keyring
(04:20:23 PM) odyssey4me: ie: AQDGmBZS+B4rDhAADaqqi78QiJvoHjExyd64SQ==
(04:20:36 PM) odyssey4me: what you have there is a keyring... :)
(04:24:47 PM) xarses: ok
(04:25:25 PM) xarses: so adding [client.images] keyfile = ceph.client.images.keyring makes rdb map happy (minus the --keyfile)
(04:25:45 PM) xarses: however glance still doesn't work right
(04:26:03 PM) xarses: glance image-create --name cirros --container-format bare --disk-format qcow2 --is-public yes --location https://launchpad.net/cirros/trunk/0.3.0/+download/cirros-0.3.0-x86_64-disk.img
(04:26:08 PM) xarses: takes the imagee
(04:26:16 PM) xarses: and pretends to save it correctly
(04:26:31 PM) xarses: but no data is stored in ceph
(04:26:43 PM) xarses: or /var/lib/glance/images
(04:27:06 PM) xarses: and retreving the image blocks sending 0 bytes
(04:27:21 PM) xarses: i have no clue what to check futher
(04:27:40 PM) odyssey4me: xarses - I followed this to the letter for glance, and it worked: http://ceph.com/docs/next/rbd/rbd-openstack/
(04:30:58 PM) joshd: xarses: there was a bug in grizzly with --location - https://bugs.launchpad.net/glance/+bug/1146830
(04:31:27 PM) xarses: ya, i saw that
(04:31:40 PM) xarses: never had issues with it while the backend was swift or localfs
(04:31:47 PM) xarses: and it says the image is 100%
(04:32:07 PM) joshd: the patch in that bug fixes it
(04:32:38 PM) ircolle left the room (quit: Quit: Leaving.).
(04:32:43 PM) xarses: nova image-show 8858ebcf-2d78-453e-af06-a71a308746de
(04:32:43 PM) xarses: +----------------------+--------------------------------------+
(04:32:43 PM) xarses: | Property             | Value                                |
(04:32:43 PM) xarses: +----------------------+--------------------------------------+
(04:32:43 PM) xarses: | status               | ACTIVE                               |
(04:32:43 PM) xarses: | updated              | 2013-08-22T23:29:58Z                 |
(04:32:43 PM) xarses: | name                 | cirros                               |
(04:32:43 PM) xarses: | created              | 2013-08-22T23:29:58Z                 |
(04:32:43 PM) xarses: | minDisk              | 0                                    |
(04:32:43 PM) xarses: | progress             | 100                                  |
(04:32:43 PM) xarses: | minRam               | 0                                    |
(04:32:43 PM) xarses: | OS-EXT-IMG-SIZE:size | 9761280                              |
(04:32:43 PM) xarses: | id                   | 8858ebcf-2d78-453e-af06-a71a308746de |
(04:32:43 PM) xarses: +----------------------+--------------------------------------+
(04:36:18 PM) itatar: the instructions to install ceph-deploy (on http://ceph.com/docs/master/start/quick-start-preflight/) are debian centric. is there something written up for fedora?
(04:38:02 PM) odyssey4me: xarses - did you set glance_api_version = 2 ?
(04:38:24 PM) dmick: sagewk: hm, this is after connect()
(04:38:28 PM) ***dmick digs
(04:38:33 PM) joshd: itatar: I think you just need epel and one of the ceph.com repos listed here: http://ceph.com/docs/master/install/rpm/
(04:38:37 PM) sagewk: sigh.. not sure then.  never actually used the _get method
(04:38:50 PM) sagewk: there are unit tests, but that is probably the only user
(04:40:16 PM) dmick: so the problem is when it's *not* in .conf, rados_conf_get can't seem to get the default
(04:40:35 PM) sagewk: huh
(04:41:28 PM) dmick: gdb'ing
(04:41:41 PM) xarses: odyssey4me: no, im not on trying to get cinder to work yet, just glance
(04:42:21 PM) xarses: i applied that patch and it didn't do anything for me
(04:43:37 PM) xarses: odyssey4me: do i need to add that somewhere for glance its self?
(04:43:54 PM) dmick: really odd.  finds it, but it's ""
(04:44:15 PM) dmick: maybe there's no default for clients?
(04:44:46 PM) joshd: xarses: does uploading a local file work?
(04:44:49 PM) dmick: ARGH
(04:45:05 PM) dmick: common_preinit
(04:47:21 PM) Tamil1 [~Adium@cpe-108-184-66-69.socal.res.rr.com] entered the room.
(04:47:51 PM) itatar: thank you joshd
(04:49:30 PM) xarses: joshd: ok that worked
(04:49:41 PM) xarses: now how do i fix that --location doesn't work?
(04:50:52 PM) joshd: xarses: not sure exactly, but this may help: https://review.openstack.org/#/c/42640/
(04:51:18 PM) joshd: xarses: glance-api.log with debug on of an upload with --location may give a clue to the problem
(04:51:27 PM) madkiss left the room (quit: Quit: Leaving.).
(04:51:47 PM) xarses: i have all of the glance logs going to glance-all.log
(04:51:57 PM) xarses: never saw anything that looked like an error
(04:52:12 PM) xarses: debug was on the whole time
(04:52:17 PM) joshd: but it might show the details of the request at least
(04:52:46 PM) xarses: i applied https://review.openstack.org/#/c/27457/
(04:52:51 PM) xarses: but that didn't help
(04:54:05 PM) torment2 [~torment@pool-72-64-192-26.tampfl.fios.verizon.net] entered the room.
(04:55:08 PM) xarses: they are both trying to address a similar problem
(04:55:20 PM) xarses: but not exactly doing the same thing
(04:55:53 PM) joshd: right
(04:56:41 PM) joshd: I'm wondering if the --location upload somehow provided a size of 0 to rbd
(04:57:09 PM) joshd: which the second patch would fix
(05:02:06 PM) AfC [~andrew@2407:7800:200:1011:31b2:f929:558b:657f] entered the room.
(05:04:59 PM) itatar: sigh, now the os I have is based on fedora18 called "applianceoperatingsystem" so ceph_deploy doesn't like it:
(05:04:59 PM) itatar: -bash-4.2# ceph-deploy install cephadmin
(05:04:59 PM) itatar: [ceph_deploy.install][DEBUG ] Installing stable version dumpling on cluster ceph hosts cephadmin
(05:04:59 PM) itatar: [ceph_deploy.install][DEBUG ] Detecting platform for host cephadmin ...
(05:04:59 PM) itatar: [ceph_deploy][ERROR ] UnsupportedPlatform: Platform is not supported: applianceoperatingsystem
(05:05:01 PM) itatar: is there a way to override this check?
(05:07:42 PM) dmick: hack the source?
(05:09:50 PM) dmick: hosts/__init__.py:_get_distro()
(05:15:08 PM) xarses: joshd: i had to apply both patches
(05:15:20 PM) xarses: as the second is based on the first
(05:15:34 PM) xarses: but it didn't resolve the problem with --location
(05:16:22 PM) joshd: xarses: could you create a new bug on launchpad and add your glance log to it then?
(05:16:48 PM) xarses: neither "chunk" or "resize" are in my glance log
(05:17:13 PM) tnt left the room (quit: Ping timeout: 480 seconds).
(05:17:23 PM) xarses: also, the line numbers in my rbd.py didn't match up, should i fetch the current master and try that first?
(05:18:46 PM) odyssey4me left the room (quit: Ping timeout: 480 seconds).
(05:18:57 PM) sagelap1 [~sage@2600:1012:b00b:952b:c5a2:f13c:f3e3:162b] entered the room.
(05:19:20 PM) joshd: it's worth a shot, but I don't think any of the other changes would affect uploading
(05:20:36 PM) sagelap left the room (quit: Ping timeout: 480 seconds).
(05:21:11 PM) alram left the room (quit: Quit: leaving).
(05:21:30 PM) joshd: xarses: could you see that the rbd image is actually being created on the backend (rbd ls images) and what the size shown there is (rbd info images/uuid)
(05:21:37 PM) nwat_ left the room (quit: Ping timeout: 480 seconds).
(05:22:07 PM) alfredo|afk: itatar: that doesn't sound like something we support, hence the message
(05:22:13 PM) alfredo|afk is now known as alfredodeza
(05:22:30 PM) alfredodeza: the problem is that we need to determine package manager and dependencies according to the OS
(05:24:30 PM) xarses: joshd, so i removed the .pyo and pyc and it hasn't recompiled them after restarting glance
(05:25:05 PM) xarses: and i added another from the local filesystem just for fun, works fine, but the driver still didn't compile
(05:25:17 PM) xarses: in glance/store/rbd.py
(05:26:54 PM) joshd: xarses: is rbd set as the default store? it might be lazy-loading and not compile it until it's used as well
(05:27:05 PM) xarses: joshd: ls images only shows the two images from local files
(05:27:09 PM) xarses: rbd ls images
(05:27:09 PM) xarses: 1e6a7b44-1a05-4f4f-9ed9-7f08fca40ce7
(05:27:09 PM) xarses: 2abe4fd2-4d6a-42c0-b041-9fb073fc41af
(05:27:45 PM) joshd: xarses: ok, that's a good clue - it's not even getting to create the images when --location is used
(05:27:47 PM) xarses: grep rbd /etc/glance/glance-api.conf
(05:27:47 PM) xarses: default_store = rbd
(05:27:47 PM) xarses: #               glance.store.rbd.Store,
(05:27:47 PM) xarses: rbd_store_ceph_conf = /etc/ceph/ceph.conf
(05:27:47 PM) xarses: rbd_store_user = images
(05:27:47 PM) xarses: rbd_store_pool = images
(05:27:47 PM) xarses: rbd_store_chunk_size = 8
(05:28:12 PM) xarses: rbd info images/2abe4fd2-4d6a-42c0-b041-9fb073fc41af
(05:28:12 PM) xarses: rbd image '2abe4fd2-4d6a-42c0-b041-9fb073fc41af':
(05:28:12 PM) xarses:         size 9532 KB in 2 objects
(05:28:12 PM) xarses:         order 23 (8192 KB objects)
(05:28:12 PM) xarses:         block_name_prefix: rbd_data.10c15e2be4d4
(05:28:13 PM) xarses:         format: 2
(05:28:13 PM) xarses:         features: layering
(05:28:44 PM) xarses: same for the other object
(05:28:53 PM) xarses: (ish)
(05:30:17 PM) Tamil1 left the room (quit: Quit: Leaving.).
(05:31:21 PM) madkiss [~madkiss@184.105.243.235] entered the room.
(05:32:10 PM) joshd: xarses: could you pastebin the glance-all.log containing one of the --location uploads?
(05:32:15 PM) Cube1 [~Cube@88.128.80.12] entered the room.
(05:33:07 PM) Cube left the room (quit: Read error: Connection reset by peer).
(05:34:15 PM) xarses: joshd you can have the whole thing if you'd like =)
(05:34:37 PM) joshd: sure