Advertisement
Guest User

Untitled

a guest
Dec 21st, 2015
105
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 9.00 KB | None | 0 0
  1. hannes-mbpr:~ hannes$ export CGCLOUD_PLUGINS=cgcloud.toil
  2. hannes-mbpr:~ hannes$ export CGCLOUD_ZONE=us-west-2a
  3. hannes-mbpr:~ hannes$ export CGCLOUD_KEYPAIRS="__me__ almussel@ucsc.edu fnothaft@berkeley.edu hannes@ucsc.edu heuermh@gmail.com jtvivian@gmail.com"
  4. hannes-mbpr:~ hannes$ virtualenv cgcloud
  5. New python executable in cgcloud/bin/python
  6. Installing setuptools, pip, wheel...done.
  7. hannes-mbpr:~ hannes$ . cgcloud/bin/activate
  8. (cgcloud)hannes-mbpr:~ hannes$ pip list
  9. pip (7.1.2)
  10. setuptools (18.2)
  11. wheel (0.24.0)
  12. (cgcloud)hannes-mbpr:~ hannes$ pip install cgcloud-toil
  13. Collecting cgcloud-toil
  14. Collecting Fabric==1.10.2 (from cgcloud-toil)
  15. Using cached Fabric-1.10.2-py2-none-any.whl
  16. Collecting bd2k-python-lib==1.11.dev6 (from cgcloud-toil)
  17. Collecting cgcloud-lib==1.3 (from cgcloud-toil)
  18. Collecting cgcloud-core==1.3 (from cgcloud-toil)
  19. Collecting cgcloud-mesos==1.3 (from cgcloud-toil)
  20. Collecting paramiko>=1.10 (from Fabric==1.10.2->cgcloud-toil)
  21. Using cached paramiko-1.16.0-py2.py3-none-any.whl
  22. Collecting boto==2.38.0 (from cgcloud-lib==1.3->cgcloud-toil)
  23. Using cached boto-2.38.0-py2.py3-none-any.whl
  24. Collecting PyYAML==3.11 (from cgcloud-core==1.3->cgcloud-toil)
  25. Collecting ecdsa>=0.11 (from paramiko>=1.10->Fabric==1.10.2->cgcloud-toil)
  26. Using cached ecdsa-0.13-py2.py3-none-any.whl
  27. Collecting pycrypto!=2.4,>=2.1 (from paramiko>=1.10->Fabric==1.10.2->cgcloud-toil)
  28. Installing collected packages: ecdsa, pycrypto, paramiko, Fabric, bd2k-python-lib, boto, cgcloud-lib, PyYAML, cgcloud-core, cgcloud-mesos, cgcloud-toil
  29. Successfully installed Fabric-1.10.2 PyYAML-3.11 bd2k-python-lib-1.11.dev6 boto-2.38.0 cgcloud-core-1.3 cgcloud-lib-1.3 cgcloud-mesos-1.3 cgcloud-toil-1.3 ecdsa-0.13 paramiko-1.16.0 pycrypto-2.6.1
  30. (cgcloud)hannes-mbpr:~ hannes$ pip list
  31. bd2k-python-lib (1.11.dev6)
  32. boto (2.38.0)
  33. cgcloud-core (1.3)
  34. cgcloud-lib (1.3)
  35. cgcloud-mesos (1.3)
  36. cgcloud-toil (1.3)
  37. ecdsa (0.13)
  38. Fabric (1.10.2)
  39. paramiko (1.16.0)
  40. pip (7.1.2)
  41. pycrypto (2.6.1)
  42. PyYAML (3.11)
  43. setuptools (18.2)
  44. wheel (0.24.0)
  45. (cgcloud)hannes-mbpr:~ hannes$ cat ~/.boto
  46. [Credentials]
  47. aws_access_key_id = AKIAJLXBKGOUYVOHV4VQ
  48. aws_secret_access_key =xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
  49. [Boto]
  50. num_retries = 20
  51. [preview]
  52. sdb = true
  53. (cgcloud)hannes-mbpr:~ hannes$ pip install argcomplete
  54. Collecting argcomplete
  55. Using cached argcomplete-1.0.0-py2.py3-none-any.whl
  56. Installing collected packages: argcomplete
  57. Successfully installed argcomplete-1.0.0
  58. (cgcloud)hannes-mbpr:~ hannes$ eval "$(~/cgcloud/bin/register-python-argcomplete cgcloud)"
  59. (cgcloud)hannes-mbpr:~ hannes$ cgcloud register-key ~/.ssh/hannes@ucsc.edu.pub
  60. INFO: Using zone 'us-west-2a' and namespace '/hannes/'
  61. (cgcloud)hannes-mbpr:~ hannes$ cgcloud create -IT toil-box
  62. INFO: Using zone 'us-west-2a' and namespace '/hannes/'
  63. INFO: Looking up default image for role toil-box and virtualization type hvm, ...
  64. INFO: ... found ami-c94856a8.
  65. INFO: Creating t2.micro instance(s) ...
  66. INFO: ... got InvalidParameterValue, trying again in 5s ...
  67. INFO: ... got InvalidParameterValue, trying again in 5s ...
  68. INFO: ... created i-f7e0e733.
  69. INFO: Tagging instance ...
  70. INFO: ... instance tagged {'cluster_name': u'i-f7e0e733', 'ebs_volume_size': '0', 'cluster_ordinal': '0', 'Name': u'hannes_toil-box', 'enable_agent': 'True', 'generation': '0'}.
  71. INFO: ... waiting for instance i-f7e0e733 ...
  72. INFO: ... running, waiting for assignment of public IP ...
  73. INFO: ... assigned, waiting for SSH port ...
  74. .
  75. .
  76. .
  77. [54.201.137.171] out: Installing /opt/mesosbox/tools/lib/python2.7/site-packages/bd2k_python_lib-1.11.dev6-py2.7-nspkg.pth
  78. [54.201.137.171] out: Successfully installed cgcloud-lib cgcloud-mesos-tools bd2k-python-lib boto
  79. [54.201.137.171] out: Cleaning up...
  80. [54.201.137.171] out:
  81.  
  82. [54.201.137.171] sudo: chown -R root:root /opt/mesosbox/tools
  83. [54.201.137.171] put: <file obj> -> /etc/init/mesosbox.conf
  84. [54.201.137.171] sudo: chown root:root '/etc/init/mesosbox.conf'
  85. INFO: Stopping instance ...
  86. INFO: ... instance stopped.
  87. INFO: Creating image ...
  88. INFO: ... created ami-b50618d4 (hannes_toil-box__2015-12-21__12-15-48).
  89. INFO: Checking if image ami-b50618d4 is discoverable ...
  90. INFO: ... image now discoverable.
  91. INFO: Terminating instance ...
  92. INFO: ... instance terminated.
  93. cgcloud)hannes-mbpr:~ hannes$ cgcloud create-cluster -t m3.large --ebs-volume-size 30 -s 2 toil
  94. INFO: Using zone 'us-west-2a' and namespace '/hannes/'
  95. INFO: === Launching leader ===
  96. INFO: Creating m3.large instance(s) ...
  97. INFO: ... got InvalidParameterValue, trying again in 5s ...
  98. INFO: ... created i-dbe9ee1f.
  99. INFO: Tagging instance ...
  100. INFO: ... instance tagged {'cluster_name': u'i-dbe9ee1f', 'ebs_volume_size': '30', 'leader_instance_id': u'i-dbe9ee1f', 'Name': u'hannes_toil-leader', 'enable_agent': 'True', 'generation': '1', 'cluster_ordinal': '0'}.
  101. INFO: ... waiting for instance i-dbe9ee1f ...
  102. INFO: ... running, waiting for assignment of public IP ...
  103. INFO: ... assigned, waiting for SSH port ...
  104. INFO: ... open ...
  105. INFO: ... testing SSH ...
  106. INFO: ... SSH working ...,
  107. INFO: ... instance ready.
  108. INFO: Waiting for cloud-init to finish ....
  109. INFO: .
  110. INFO: .
  111. INFO: .
  112. INFO: ... cloud-init done.
  113. INFO: === Launching workers ===
  114. INFO: Creating m3.large instance(s) ...
  115. INFO: ... got InvalidParameterValue, trying again in 5s ...
  116. Thread-5 INFO: ... created i-90e9ee54.
  117. Thread-6 INFO: ... created i-91e9ee55.
  118. Thread-5 INFO: Tagging instance ...
  119. Thread-6 INFO: Tagging instance ...
  120. Thread-5 INFO: ... instance tagged {'cluster_name': u'i-dbe9ee1f', 'ebs_volume_size': '30', 'leader_instance_id': u'i-dbe9ee1f', 'Name': u'hannes_toil-worker', 'enable_agent': 'True', 'generation': '1', 'cluster_ordinal': '1'}.
  121. Thread-5 INFO: ... waiting for instance i-90e9ee54 ...
  122. Thread-6 INFO: ... instance tagged {'cluster_name': u'i-dbe9ee1f', 'ebs_volume_size': '30', 'leader_instance_id': u'i-dbe9ee1f', 'Name': u'hannes_toil-worker', 'enable_agent': 'True', 'generation': '1', 'cluster_ordinal': '2'}.
  123. Thread-6 INFO: ... waiting for instance i-91e9ee55 ...
  124. Thread-6 INFO: ... running, waiting for assignment of public IP ...
  125. Thread-6 INFO: ... assigned, waiting for SSH port ...
  126. Thread-5 INFO: ... running, waiting for assignment of public IP ...
  127. Thread-5 INFO: ... assigned, waiting for SSH port ...
  128. Thread-5 INFO: ... open ...
  129. Thread-5 INFO: ... testing SSH ...
  130. Thread-5 INFO: ... SSH working ...,
  131. Thread-5 INFO: ... instance ready.
  132. Thread-5 INFO: Waiting for cloud-init to finish ....
  133. Thread-5 INFO: .
  134. Thread-5 INFO: .
  135. Thread-5 INFO: .
  136. Thread-5 INFO: ... cloud-init done.
  137. Thread-6 INFO: ... open ...
  138. Thread-6 INFO: ... testing SSH ...
  139. Thread-6 INFO: ... SSH working ...,
  140. Thread-6 INFO: ... instance ready.
  141. Thread-6 INFO: Waiting for cloud-init to finish ....
  142. Thread-6 INFO: .
  143. Thread-6 INFO: .
  144. Thread-6 INFO: .
  145. Thread-6 INFO: .
  146. Thread-6 INFO: .
  147. Thread-6 INFO: ... cloud-init done.
  148. INFO: Run 'cgcloud ssh toil-leader' to start using this cluster.
  149. (cgcloud)hannes-mbpr:~ hannes$ cgcloud ssh toil-leader
  150. INFO: Using zone 'us-west-2a' and namespace '/hannes/'
  151. INFO: Binding to instance ...
  152. INFO: ... waiting for instance i-dbe9ee1f ...
  153. INFO: ... running, waiting for assignment of public IP ...
  154. INFO: ... assigned, waiting for SSH port ...
  155. INFO: ... open ...
  156. INFO: ... instance ready.
  157. The authenticity of host 'ec2-54-201-122-169.us-west-2.compute.amazonaws.com (54.201.122.169)' can't be established.
  158. ECDSA key fingerprint is SHA256:lrYxP6RLiPT/K/cXZBDiu0XEQ0r8aUsBWC7PkWVSDw0.
  159. Are you sure you want to continue connecting (yes/no)? yes
  160. Warning: Permanently added 'ec2-54-201-122-169.us-west-2.compute.amazonaws.com,54.201.122.169' (ECDSA) to the list of known hosts.
  161. Welcome to Ubuntu 14.04.3 LTS (GNU/Linux 3.13.0-74-generic x86_64)
  162.  
  163. * Documentation: https://help.ubuntu.com/
  164.  
  165. System information as of Mon Dec 21 20:29:40 UTC 2015
  166.  
  167. System load: 0.38 Processes: 122
  168. Usage of /: 17.3% of 9.71GB Users logged in: 0
  169. Memory usage: 2% IP address for eth0: 172.31.24.146
  170. Swap usage: 0% IP address for docker0: 172.17.0.1
  171.  
  172. Graph this data and manage this system at:
  173. https://landscape.canonical.com/
  174.  
  175. Get cloud support with Ubuntu Advantage Cloud Guest:
  176. http://www.ubuntu.com/business/services/cloud
  177.  
  178. 1 package can be updated.
  179. 0 updates are security updates.
  180.  
  181.  
  182. Last login: Mon Dec 21 20:14:08 2015 from c-67-180-92-62.hsd1.ca.comcast.net
  183. mesosbox@ip-172-31-24-146:~$
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement