machine......................> copying path '/nix/store/f4mm74is6zxzmi8nfwlms92c70lkcha8-logrotate-3.13.0' to 'ssh://root@40.83.161.252'...
machine......................> copying path '/nix/store/589bqh6k13d9mvas9mqqf3pgs89b6873-waagent-2.0' to 'ssh://root@40.83.161.252'...
machine......................> copying path '/nix/store/zzyy3vpinghkvskhgm3q8vdqqsmwglyw-zfs-user-0.7.9-lib' to 'ssh://root@40.83.161.252'...
machine......................> copying path '/nix/store/k6w7kzz2a9qwf8cqmqwwf6ww9xhlp9hd-unit-script' to 'ssh://root@40.83.161.252'...
machine......................> copying path '/nix/store/py5wd5aixdz45b5mcqipqn2ffxb2xcra-unit-systemd-udevd.service' to 'ssh://root@40.83.161.252'...
machine......................> copying path '/nix/store/lzv42cn29rhp2ms733dgmy10d1lg3h0a-unit-waagent.service' to 'ssh://root@40.83.161.252'...
machine......................> copying path '/nix/store/rbk693wz8yizc3yhavh1w4y9syhrjdjd-grub-2.02' to 'ssh://root@40.83.161.252'...
machine......................> copying path '/nix/store/said3kzk9p99mavc5wscjl0vkk2kxxss-unit-logrotate.service' to 'ssh://root@40.83.161.252'...
machine......................> copying path '/nix/store/hw2cq4qs4k3y65sh65il6d6qigidmhgf-system-path' to 'ssh://root@40.83.161.252'...
machine......................> copying path '/nix/store/bjjlpwwg76sxpalmhwmj4zg10f599gjy-grub-config.xml' to 'ssh://root@40.83.161.252'...
machine......................> copying path '/nix/store/dgd16bcp225ky8sjyrg7fffmb8ndi1bl-install-grub.sh' to 'ssh://root@40.83.161.252'...
machine......................> copying path '/nix/store/z7isypxx1v39qpi2rq6sjg08an28mrqb-dbus-1' to 'ssh://root@40.83.161.252'...
machine......................> copying path '/nix/store/54pqqy4d1ywiz5sd30im1zich7pvmwgz-unit-polkit.service' to 'ssh://root@40.83.161.252'...
machine......................> copying path '/nix/store/k8ya7zvf84dw57aplx0wxh1wpzpv6971-unit-systemd-fsck-.service' to 'ssh://root@40.83.161.252'...
machine......................> copying path '/nix/store/pzb233jq46gaf5hqxwwx71a8d1azxasw-unit-dbus.service' to 'ssh://root@40.83.161.252'...
machine......................> copying path '/nix/store/5xidxk77rv74hkwfa78v0h8m72irnc96-user-units' to 'ssh://root@40.83.161.252'...
machine......................> copying path '/nix/store/a598bnnaw5p3dg12cmx8nwx4hkz1304q-system-units' to 'ssh://root@40.83.161.252'...
machine......................> copying path '/nix/store/35510k19i0ld12q0g1id7ppb91zqmvz6-etc' to 'ssh://root@40.83.161.252'...
machine......................> copying path '/nix/store/ijph5k70ysckrxfcpyzfyx85qzcq6jdv-nixos-system-machine-18.03.132645.43c77db3aa5' to 'ssh://root@40.83.161.252'...
unnamed> closures copied successfully
machine......................> updating GRUB 2 menu...
machine......................> installing the GRUB 2 boot loader on /dev/sda...
machine......................> Installing for i386-pc platform.
machine......................> Installation finished. No error reported.
machine......................> stopping the following units: -.slice, audit.service, consume-hypervisor-entropy.service, fetch-ssh-keys.service, ip-up.target, kmod-static-nodes.service, logrotate.timer, metadata.mount, network-local-commands.service, network-setup.service, nix-daemon.service, nix-daemon.socket, nscd.service, ntpd.service, systemd-modules-load.service, systemd-sysctl.service, systemd-tmpfiles-clean.timer, systemd-tmpfiles-setup-dev.service, systemd-udev-trigger.service, systemd-udevd-control.socket, systemd-udevd-kernel.socket, systemd-udevd.service, systemd-vconsole-setup.service, waagent.service
machine......................> Failed to stop -.slice: Operation refused, unit -.slice may be requested by dependency only.
machine......................> See system logs and 'systemctl status -.slice' for details.
machine......................> NOT restarting the following changed units: systemd-journal-flush.service, systemd-logind.service, systemd-random-seed.service, systemd-remount-fs.service, systemd-tmpfiles-setup.service, systemd-update-utmp.service, systemd-user-sessions.service, user@0.service
machine......................> activating the configuration...
machine......................> removing user ‘ntp’
machine......................> setting up /etc...
machine......................> removing obsolete file ‘/etc/localtime’...
machine......................> restarting systemd...
machine......................> setting up tmpfiles
machine......................> reloading the following units: dbus.service, dev-hugepages.mount, dev-mqueue.mount, firewall.service, sys-kernel-debug.mount
machine......................> restarting the following units: dhcpcd.service, sshd.service, systemd-journald.service
machine......................> starting the following units: audit.service, consume-hypervisor-entropy.service, kmod-static-nodes.service, logrotate.timer, network-local-commands.service, network-setup.service, nix-daemon.socket, nscd.service, systemd-modules-load.service, systemd-sysctl.service, systemd-tmpfiles-clean.timer, systemd-tmpfiles-setup-dev.service, systemd-udev-trigger.service, systemd-udevd-control.socket, systemd-udevd-kernel.socket, systemd-vconsole-setup.service, waagent.service
machine......................> the following new units were started: local-fs.target, network-online.target, run-wrappers.mount, systemd-journal-catalog-update.service, systemd-timesyncd.service, systemd-update-done.service
machine......................> activation finished successfully
unnamed> deployment finished successfully
machine......................> stopping Azure machine...
warning: non-fatal error on destroy resources for deployment ‘b956b266-74af-11e8-9061-0242e49a1d0c’: {"error":{"code":"ExpiredAuthenticationToken","message":"The access token expiry UTC time '6/20/2018 5:52:36 PM' is earlier than current UTC time '6/20/2018 5:52:41 PM'."}}
Exception in thread Thread-47:
Traceback (most recent call last):
  File "/nix/store/wj95m7mnglqih1hhwyywchl0bgcldhad-python-2.7.15/lib/python2.7/threading.py", line 801, in __bootstrap_inner
    self.run()
  File "/nix/store/wj95m7mnglqih1hhwyywchl0bgcldhad-python-2.7.15/lib/python2.7/threading.py", line 754, in run
    self.__target(*self.__args, **self.__kwargs)
  File "/home/srghma/projects/nixops/tests/functional/shared/destroy_deployments_and_remove_state_file.py", line 44, in destroy_deployments
    deployment.delete()
  File "/home/srghma/projects/nixops/nixops/deployment.py", line 180, in delete
    raise Exception("cannot delete this deployment because it still has resources")
Exception: cannot delete this deployment because it still has resources

warning: not all deployments have been destroyed; some resources may still exist!
ERROR

======================================================================
ERROR: tests.functional.test_starting_starts.test_starting_starts('nixops', ('azure', ['/home/srghma/projects/nixops/tests/functional/shared/nix_expressions/logical_base.nix', '/home/srghma/projects/nixops/tests/functional/shared/nix_expressions/azure_base.nix']))
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/nix/store/qyqsfqjpksrvaa387yk4y5bgxnslfyx8-python2.7-nose-1.3.7/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
    self.test(*self.arg)
  File "/nix/store/kwq9a1bjhc3w1672khipz85qrwpxj5lv-python2.7-parameterized-0.6.1/lib/python2.7/site-packages/parameterized/parameterized.py", line 280, in <lambda>
    nose_func = wraps(func)(lambda *args: func(*args))
  File "/home/srghma/projects/nixops/tests/functional/test_starting_starts/__init__.py", line 63, in test_starting_starts
    deployment.stop_machines()
  File "/home/srghma/projects/nixops/nixops/deployment.py", line 1116, in stop_machines
    nixops.parallel.run_tasks(nr_workers=-1, tasks=self.active.itervalues(), worker_fun=worker)
  File "/home/srghma/projects/nixops/nixops/parallel.py", line 44, in thread_fun
    result_queue.put((worker_fun(t), None, t.name))
  File "/home/srghma/projects/nixops/nixops/deployment.py", line 1114, in worker
    m.stop()
  File "/home/srghma/projects/nixops/nixops/backends/azure_vm.py", line 978, in stop
    self.cmc().virtual_machines.power_off(self.resource_group, self.machine_name)
  File "/nix/store/sarfr7ipad09id2fy05bxbfzf9wk1mhh-python2.7-azure-mgmt-compute-0.20.0/lib/python2.7/site-packages/azure/mgmt/compute/computemanagement.py", line 12887, in power_off
    result = client2.get_long_running_operation_status(response.azure_async_operation)
  File "/nix/store/sarfr7ipad09id2fy05bxbfzf9wk1mhh-python2.7-azure-mgmt-compute-0.20.0/lib/python2.7/site-packages/azure/mgmt/compute/computemanagement.py", line 2898, in get_long_running_operation_status
    raise error
AzureHttpError: {"error":{"code":"ExpiredAuthenticationToken","message":"The access token expiry UTC time '6/20/2018 5:52:36 PM' is earlier than current UTC time '6/20/2018 5:52:40 PM'."}}
-------------------- >> begin captured stdout << ---------------------
{'status_code': 201, '_azure_async_operation': 'https://management.azure.com/subscriptions/33b665da-153c-4cc5-98f1-4bbb5ee15fa2/providers/Microsoft.Compute/locations/westus/operations/aab1519f-de31-4de8-9bf9-e79899129ecf?api-version=2015-05-01-preview', '_virtual_machine': <azure.mgmt.compute.computemanagement.VirtualMachine object at 0x7f96572fa550>, 'request_id': 'aab1519f-de31-4de8-9bf9-e79899129ecf'}

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
azure.mgmt.common.filters: DEBUG: Request: GET https://management.azure.com/subscriptions/33b665da-153c-4cc5-98f1-4bbb5ee15fa2/resourcegroups/nixops-b956b266-74af-11e8-9061-0242e49a1d0c-def-group?api-version=2014-04-01-preview
Connection: keep-alive
Accept-Encoding: gzip, deflate
Accept: */*
User-Agent: python-requests/2.18.4
Content-Type: application/json; charset=utf-8
Authorization: *****

urllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): management.azure.com
urllib3.connectionpool: DEBUG: https://management.azure.com:443 "GET /subscriptions/33b665da-153c-4cc5-98f1-4bbb5ee15fa2/resourcegroups/nixops-b956b266-74af-11e8-9061-0242e49a1d0c-def-group?api-version=2014-04-01-preview HTTP/1.1" 404 145
azure.mgmt.common.filters: DEBUG: Response: 404 Not Found
Cache-Control: no-cache
Pragma: no-cache
Content-Type: application/json; charset=utf-8
Expires: -1
x-ms-failure-cause: gateway
x-ms-ratelimit-remaining-subscription-reads: 14999
x-ms-request-id: bf3077f4-a4f2-4579-bf9a-5784ce1d947f
x-ms-correlation-request-id: bf3077f4-a4f2-4579-bf9a-5784ce1d947f
x-ms-routing-request-id: WESTEUROPE:20180620T173112Z:bf3077f4-a4f2-4579-bf9a-5784ce1d947f
Strict-Transport-Security: max-age=31536000; includeSubDomains
X-Content-Type-Options: nosniff