reservation failed on vmguest-129: process failed after trying to load or make available
------------------------------------------------------------------------
time: 2012-10-03 11:47:04
caller: State.pm:reservation_failed(213)
( 0) State.pm, reservation_failed (line: 213)
(-1) new.pm , process (line: 298)
(-2) vcld, make_new_child (line: 568)
(-3) vcld, main (line: 346)
------------------------------------------------------------------------
management node: vclnfs01.calstate.edu
reservation PID: 31797
parent vcld PID: 5613

request ID: 94677
reservation ID: 94413
request state/laststate: reload/reload
request start time: 2012-10-03 11:30:00
request end time: 2012-10-03 11:50:00
for imaging: no
log ID: none

computer: vmguest-129
computer id: 137
computer type: virtualmachine
computer eth0 MAC address: 00:50:56:2a:3b:fe
computer eth1 MAC address: 00:50:56:2a:3b:ff
computer private IP address: 10.10.10.37
computer public IP address: 137.145.56.240
computer in block allocation: no
provisioning module: VCL::Module::Provisioning::VMware::VMware

vm host: vclesxi21
vm host ID: 2
vm host computer ID: 3
vm profile: VMware ESXI Network Storage
vm profile VM path: /vmfs/volumes/netappfiler02-sata1
vm profile repository path:
vm profile datastore path: /vmfs/volumes/netappfiler02-sata1
vm profile disk type: networkdisk

image: vmwarewincw7vista-CSUEBStatistics142-v6
image display name: CSUEB Statistics
image ID: 142
image revision ID: 401
image size: 34816 MB
use Sysprep: no
root access: yes
image owner ID: 10
image owner affiliation: CSUEB
image revision date created: 2012-09-17 10:56:00
image revision production: yes
OS module: VCL::Module::OS::Windows::Version_6::Vista
image revision comments: Updated

user: vclreload
user name: vcl reload
user ID: 2
user affiliation: Local
------------------------------------------------------------------------
RECENT LOG ENTRIES FOR THIS PROCESS:
2012-10-03 11:42:37|31797|94677:94413|reload|Module.pm:code_loop_timeout(759)|attempt 18: waiting for vmguest-129 to respond to SSH
2012-10-03 11:42:38|31797|94677:94413|reload|OS.pm:is_ssh_responding(386)|vmguest-129 is NOT responding to SSH, ports 22 or 24 are both closed
2012-10-03 11:42:38|31797|94677:94413|reload|Module.pm:code_loop_timeout(755)|attempt 18: code returned false, seconds elapsed/remaining: 348/252, sleeping for 20 seconds
2012-10-03 11:42:58|31797|94677:94413|reload|Module.pm:code_loop_timeout(759)|attempt 19: waiting for vmguest-129 to respond to SSH
2012-10-03 11:42:58|31797|94677:94413|reload|OS.pm:is_ssh_responding(386)|vmguest-129 is NOT responding to SSH, ports 22 or 24 are both closed
2012-10-03 11:42:58|31797|94677:94413|reload|Module.pm:code_loop_timeout(755)|attempt 19: code returned false, seconds elapsed/remaining: 368/232, sleeping for 20 seconds
2012-10-03 11:43:18|31797|94677:94413|reload|Module.pm:code_loop_timeout(759)|attempt 20: waiting for vmguest-129 to respond to SSH
2012-10-03 11:43:19|31797|94677:94413|reload|OS.pm:is_ssh_responding(386)|vmguest-129 is NOT responding to SSH, ports 22 or 24 are both closed
2012-10-03 11:43:19|31797|94677:94413|reload|Module.pm:code_loop_timeout(755)|attempt 20: code returned false, seconds elapsed/remaining: 389/211, sleeping for 20 seconds
2012-10-03 11:43:39|31797|94677:94413|reload|Module.pm:code_loop_timeout(759)|attempt 21: waiting for vmguest-129 to respond to SSH
2012-10-03 11:43:39|31797|94677:94413|reload|OS.pm:is_ssh_responding(386)|vmguest-129 is NOT responding to SSH, ports 22 or 24 are both closed
2012-10-03 11:43:39|31797|94677:94413|reload|Module.pm:code_loop_timeout(755)|attempt 21: code returned false, seconds elapsed/remaining: 409/191, sleeping for 20 seconds
2012-10-03 11:43:59|31797|94677:94413|reload|Module.pm:code_loop_timeout(759)|attempt 22: waiting for vmguest-129 to respond to SSH
2012-10-03 11:44:00|31797|94677:94413|reload|OS.pm:is_ssh_responding(386)|vmguest-129 is NOT responding to SSH, ports 22 or 24 are both closed
2012-10-03 11:44:00|31797|94677:94413|reload|Module.pm:code_loop_timeout(755)|attempt 22: code returned false, seconds elapsed/remaining: 430/170, sleeping for 20 seconds
2012-10-03 11:44:20|31797|94677:94413|reload|Module.pm:code_loop_timeout(759)|attempt 23: waiting for vmguest-129 to respond to SSH
2012-10-03 11:44:20|31797|94677:94413|reload|OS.pm:is_ssh_responding(386)|vmguest-129 is NOT responding to SSH, ports 22 or 24 are both closed
2012-10-03 11:44:20|31797|94677:94413|reload|Module.pm:code_loop_timeout(755)|attempt 23: code returned false, seconds elapsed/remaining: 450/150, sleeping for 20 seconds
2012-10-03 11:44:40|31797|94677:94413|reload|Module.pm:code_loop_timeout(759)|attempt 24: waiting for vmguest-129 to respond to SSH
2012-10-03 11:44:41|31797|94677:94413|reload|OS.pm:is_ssh_responding(386)|vmguest-129 is NOT responding to SSH, ports 22 or 24 are both closed
2012-10-03 11:44:41|31797|94677:94413|reload|Module.pm:code_loop_timeout(755)|attempt 24: code returned false, seconds elapsed/remaining: 471/129, sleeping for 20 seconds
2012-10-03 11:45:01|31797|94677:94413|reload|Module.pm:code_loop_timeout(759)|attempt 25: waiting for vmguest-129 to respond to SSH
2012-10-03 11:45:01|31797|94677:94413|reload|OS.pm:is_ssh_responding(386)|vmguest-129 is NOT responding to SSH, ports 22 or 24 are both closed
2012-10-03 11:45:01|31797|94677:94413|reload|Module.pm:code_loop_timeout(755)|attempt 25: code returned false, seconds elapsed/remaining: 491/109, sleeping for 20 seconds
2012-10-03 11:45:21|31797|94677:94413|reload|Module.pm:code_loop_timeout(759)|attempt 26: waiting for vmguest-129 to respond to SSH
2012-10-03 11:45:21|31797|94677:94413|reload|OS.pm:is_ssh_responding(386)|vmguest-129 is NOT responding to SSH, ports 22 or 24 are both closed
2012-10-03 11:45:21|31797|94677:94413|reload|Module.pm:code_loop_timeout(755)|attempt 26: code returned false, seconds elapsed/remaining: 511/89, sleeping for 20 seconds
2012-10-03 11:45:41|31797|94677:94413|reload|Module.pm:code_loop_timeout(759)|attempt 27: waiting for vmguest-129 to respond to SSH
2012-10-03 11:45:42|31797|94677:94413|reload|OS.pm:is_ssh_responding(386)|vmguest-129 is NOT responding to SSH, ports 22 or 24 are both closed
2012-10-03 11:45:42|31797|94677:94413|reload|Module.pm:code_loop_timeout(755)|attempt 27: code returned false, seconds elapsed/remaining: 532/68, sleeping for 20 seconds
2012-10-03 11:46:02|31797|94677:94413|reload|Module.pm:code_loop_timeout(759)|attempt 28: waiting for vmguest-129 to respond to SSH
2012-10-03 11:46:02|31797|94677:94413|reload|OS.pm:is_ssh_responding(386)|vmguest-129 is NOT responding to SSH, ports 22 or 24 are both closed
2012-10-03 11:46:02|31797|94677:94413|reload|Module.pm:code_loop_timeout(755)|attempt 28: code returned false, seconds elapsed/remaining: 552/48, sleeping for 20 seconds
2012-10-03 11:46:22|31797|94677:94413|reload|Module.pm:code_loop_timeout(759)|attempt 29: waiting for vmguest-129 to respond to SSH
2012-10-03 11:46:23|31797|94677:94413|reload|OS.pm:is_ssh_responding(386)|vmguest-129 is NOT responding to SSH, ports 22 or 24 are both closed
2012-10-03 11:46:23|31797|94677:94413|reload|Module.pm:code_loop_timeout(755)|attempt 29: code returned false, seconds elapsed/remaining: 573/27, sleeping for 20 seconds
2012-10-03 11:46:43|31797|94677:94413|reload|Module.pm:code_loop_timeout(759)|attempt 30: waiting for vmguest-129 to respond to SSH
2012-10-03 11:46:43|31797|94677:94413|reload|OS.pm:is_ssh_responding(386)|vmguest-129 is NOT responding to SSH, ports 22 or 24 are both closed
2012-10-03 11:46:43|31797|94677:94413|reload|Module.pm:code_loop_timeout(755)|attempt 30: code returned false, seconds elapsed/remaining: 593/7, sleeping for 20 seconds
2012-10-03 11:47:03|31797|94677:94413|reload|Module.pm:code_loop_timeout(759)|attempt 31: waiting for vmguest-129 to respond to SSH
2012-10-03 11:47:04|31797|94677:94413|reload|OS.pm:is_ssh_responding(386)|vmguest-129 is NOT responding to SSH, ports 22 or 24 are both closed
2012-10-03 11:47:04|31797|94677:94413|reload|Module.pm:code_loop_timeout(767)|waiting for vmguest-129 to respond to SSH, code did not return true after waiting 600 seconds
|31797|94677:94413|reload| ---- WARNING ----
|31797|94677:94413|reload| 2012-10-03 11:47:04|31797|94677:94413|reload|OS.pm:wait_for_response(465)|failed to connect to vmguest-129 via SSH after 600 seconds
|31797|94677:94413|reload| ( 0) OS.pm, wait_for_response (line: 465)
|31797|94677:94413|reload| (-1) Version_6.pm, wait_for_response (line: 1767)
|31797|94677:94413|reload| (-2) Windows.pm, post_load (line: 591)
|31797|94677:94413|reload| (-3) Version_6.pm, post_load (line: 194)
|31797|94677:94413|reload| (-4) VMware.pm, load (line: 415)
|31797|94677:94413|reload| (-5) new.pm , reload_image (line: 618)
|31797|94677:94413|reload| ---- WARNING ----
|31797|94677:94413|reload| 2012-10-03 11:47:04|31797|94677:94413|reload|Windows.pm:post_load(592)|vmguest-129 never responded to SSH
|31797|94677:94413|reload| ( 0) Windows.pm, post_load (line: 592)
|31797|94677:94413|reload| (-1) Version_6.pm, post_load (line: 194)
|31797|94677:94413|reload| (-2) VMware.pm, load (line: 415)
|31797|94677:94413|reload| (-3) new.pm , reload_image (line: 618)
|31797|94677:94413|reload| (-4) new.pm , process (line: 248)
|31797|94677:94413|reload| (-5) vcld, make_new_child (line: 568)
|31797|94677:94413|reload| ---- WARNING ----
|31797|94677:94413|reload| 2012-10-03 11:47:04|31797|94677:94413|reload|Version_6.pm:post_load(198)|failed to execute parent class post_load() subroutine
|31797|94677:94413|reload| ( 0) Version_6.pm, post_load (line: 198)
|31797|94677:94413|reload| (-1) VMware.pm, load (line: 415)
|31797|94677:94413|reload| (-2) new.pm , reload_image (line: 618)
|31797|94677:94413|reload| (-3) new.pm , process (line: 248)
|31797|94677:94413|reload| (-4) vcld, make_new_child (line: 568)
|31797|94677:94413|reload| (-5) vcld, main (line: 346)
|31797|94677:94413|reload| ---- WARNING ----
|31797|94677:94413|reload| 2012-10-03 11:47:04|31797|94677:94413|reload|VMware.pm:load(419)|failed to perform OS post-load tasks on VM vmguest-129 on VM host: vclesxi21
|31797|94677:94413|reload| ( 0) VMware.pm, load (line: 419)
|31797|94677:94413|reload| (-1) new.pm , reload_image (line: 618)
|31797|94677:94413|reload| (-2) new.pm , process (line: 248)
|31797|94677:94413|reload| (-3) vcld, make_new_child (line: 568)
|31797|94677:94413|reload| (-4) vcld, main (line: 346)
|31797|94677:94413|reload| ---- WARNING ----
|31797|94677:94413|reload| 2012-10-03 11:47:04|31797|94677:94413|reload|new.pm:reload_image(623)|vmwarewincw7vista-CSUEBStatistics142-v6 failed to load on vmguest-129, returning
|31797|94677:94413|reload| ( 0) new.pm , reload_image (line: 623)
|31797|94677:94413|reload| (-1) new.pm , process (line: 248)
|31797|94677:94413|reload| (-2) vcld, make_new_child (line: 568)
|31797|94677:94413|reload| (-3) vcld, main (line: 346)
2012-10-03 11:47:04|31797|94677:94413|reload|utils.pm:insertloadlog(3875)|inserted computer=137, loadimagefailed, vmwarewincw7vista-CSUEBStatistics142-v6 failed to load on vmguest-129
|31797|94677:94413|reload| ---- WARNING ----
|31797|94677:94413|reload| 2012-10-03 11:47:04|31797|94677:94413|reload|new.pm:process(295)|failed to load vmguest-129 with vmwarewincw7vista-CSUEBStatistics142-v6
|31797|94677:94413|reload| ( 0) new.pm , process (line: 295)
|31797|94677:94413|reload| (-1) vcld, make_new_child (line: 568)
|31797|94677:94413|reload| (-2) vcld, main (line: 346)
2012-10-03 11:47:04|31797|94677:94413|reload|DataStructure.pm:get_computer_state_name(2305)|attempting to retrieve current state of computer vmguest-129 from the database
2012-10-03 11:47:04|31797|94677:94413|reload|DataStructure.pm:get_computer_state_name(2336)|retrieved current state of computer vmguest-129 from the database: reloading
2012-10-03 11:47:04|31797|94677:94413|reload|DataStructure.pm:_automethod(834)|data structure updated: $self->request_data->{reservation}{94413}{computer}{state}{name}
|31797|94677:94413|reload| computer_state_name = reloading
2012-10-03 11:47:04|31797|94677:94413|reload|DataStructure.pm:get_computer_private_ip_address(1581)|attempting to retrieve private IP address for computer: vmguest-129
2012-10-03 11:47:04|31797|94677:94413|reload|DataStructure.pm:get_computer_private_ip_address(1585)|retrieved contents of /etc/hosts on this management node, contains 531 lines
2012-10-03 11:47:04|31797|94677:94413|reload|DataStructure.pm:get_computer_private_ip_address(1645)|returning IP address from /etc/hosts file: 10.10.10.37
2012-10-03 11:47:04|31797|94677:94413|reload|utils.pm:is_inblockrequest(6163)|zero rows were returned from database select
2012-10-03 11:47:04|31797|94677:94413|reload|DataStructure.pm:get_image_affiliation_name(2035)|image owner id: 10
2012-10-03 11:47:04|31797|94677:94413|reload|utils.pm:getnewdbh(2709)|database requested (information_schema) does not match handle stored in $ENV{dbh} (vcl:localhost)
2012-10-03 11:47:04|31797|94677:94413|reload|utils.pm:getnewdbh(2760)|database handle stored in $ENV{dbh}
2012-10-03 11:47:05|31797|94677:94413|reload|DataStructure.pm:retrieve_user_data(1352)|attempting to retrieve and store data for user: user.id  = '10'
2012-10-03 11:47:05|31797|94677:94413|reload|utils.pm:getnewdbh(2709)|database requested (vcl) does not match handle stored in $ENV{dbh} (information_schema:localhost)
2012-10-03 11:47:05|31797|94677:94413|reload|utils.pm:getnewdbh(2760)|database handle stored in $ENV{dbh}
2012-10-03 11:47:05|31797|94677:94413|reload|DataStructure.pm:retrieve_user_data(1415)|data has been retrieved for user: wv4973 (id: 10