I just encountered a bug, where I upgraded my stronghold with gems to level 9, but the upgrade didn't happen, while the gems where stripped of my account. I hit the button multiple times, so I can't say how many gems I lost through this. Maybe you can check and get rid of the bug.