API tools faq
paste
Guest User

node2-cvutrace.log.0

a guest
Oct 24th, 2018
216
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 238.82 KB | None | 0 0
raw download clone embed print report
  1. [[email protected]] [main] [ 2018-10-24 18:51:13.305 IST ] [VerificationUtil.setupTracing:8029] tracing is on at level 5 to file /tmp/cvutrace_new//cvutrace.log
  2. [[email protected]] [main] [ 2018-10-24 18:51:13.318 IST ] [CluvfyDriver.<init>:113] Security manager is set
  3. [[email protected]] [main] [ 2018-10-24 18:51:13.324 IST ] [NativeSystem.isCmdScv:502] isCmdScv: cmd=[]
  4. [[email protected]] [main] [ 2018-10-24 18:51:13.326 IST ] [RuntimeExec.runCommand:75] Calling Runtime.exec() with the command
  5. [[email protected]] [main] [ 2018-10-24 18:51:13.326 IST ] [RuntimeExec.runCommand:77] /bin/sh
  6. [[email protected]] [main] [ 2018-10-24 18:51:13.327 IST ] [RuntimeExec.runCommand:77] -c
  7. [[email protected]] [main] [ 2018-10-24 18:51:13.327 IST ] [RuntimeExec.runCommand:77] /bin/uname -m
  8. [[email protected]] [main] [ 2018-10-24 18:51:13.333 IST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
  9. [[email protected]] [Thread-0] [ 2018-10-24 18:51:13.334 IST ] [StreamReader.run:61] In StreamReader.run
  10. [[email protected]] [Thread-1] [ 2018-10-24 18:51:13.334 IST ] [StreamReader.run:61] In StreamReader.run
  11. [[email protected]] [Thread-0] [ 2018-10-24 18:51:13.336 IST ] [StreamReader.run:65] OUTPUT>x86_64
  12. [[email protected]] [main] [ 2018-10-24 18:51:13.336 IST ] [RuntimeExec.runCommand:144] runCommand: process returns 0
  13. [[email protected]] [main] [ 2018-10-24 18:51:13.336 IST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
  14. [[email protected]] [main] [ 2018-10-24 18:51:13.337 IST ] [RuntimeExec.runCommand:164] x86_64
  15. [[email protected]] [main] [ 2018-10-24 18:51:13.338 IST ] [RuntimeExec.runCommand:170] RunTimeExec: error>
  16. [[email protected]] [main] [ 2018-10-24 18:51:13.338 IST ] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
  17. [[email protected]] [main] [ 2018-10-24 18:51:13.339 IST ] [UnixSystem.dorunRemoteExecCmd:3232] retval = 0
  18. [[email protected]] [main] [ 2018-10-24 18:51:13.340 IST ] [UnixSystem.dorunRemoteExecCmd:3256] exitValue = 0
  19. [[email protected]] [main] [ 2018-10-24 18:51:13.343 IST ] [sVerificationUtil.checkPlatform:1203] Match = true
  20. [[email protected]] [main] [ 2018-10-24 18:51:13.343 IST ] [sVerificationUtil.checkPlatform:1209] Return value = true
  21. [[email protected]] [main] [ 2018-10-24 18:51:13.344 IST ] [VerificationUtil.getLocalHost:854] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  22. [[email protected]] [main] [ 2018-10-24 18:51:13.353 IST ] [ParamManager.<init>:560] m_paramInstantiated set to TRUE
  23. [[email protected]] [main] [ 2018-10-24 18:51:13.353 IST ] [VerificationUtil.getVersionForCL:9115] Executing getVersionForCL()
  24. [[email protected]] [main] [ 2018-10-24 18:51:13.357 IST ] [ConfigUtil.importConfig:96] ==== CVU config file: /tmp/bootstrap/cv/admin/cvu_config
  25. [[email protected]] [main] [ 2018-10-24 18:51:13.358 IST ] [ConfigUtil.importConfig:113] ==== Picked up config variable: cv_raw_check_enabled : TRUE
  26. [[email protected]] [main] [ 2018-10-24 18:51:13.359 IST ] [ConfigUtil.importConfig:113] ==== Picked up config variable: cv_assume_distid : OEL4
  27. [[email protected]] [main] [ 2018-10-24 18:51:13.359 IST ] [ConfigUtil.isDefined:199] ==== Is CV_ASSUME_CL_VERSION defined? : false
  28. [[email protected]] [main] [ 2018-10-24 18:51:13.360 IST ] [ConfigUtil.getConfiguredValue:181] ==== Fallback to env var 'CV_ASSUME_CL_VERSION'=null
  29. [[email protected]] [main] [ 2018-10-24 18:51:13.365 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  30. [[email protected]] [main] [ 2018-10-24 18:51:13.365 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  31. [[email protected]] [main] [ 2018-10-24 18:51:13.366 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  32. [[email protected]] [main] [ 2018-10-24 18:51:13.366 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  33. [[email protected]] [main] [ 2018-10-24 18:51:13.367 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against11
  34. [[email protected]] [main] [ 2018-10-24 18:51:13.368 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  35. [[email protected]] [main] [ 2018-10-24 18:51:13.368 IST ] [Version.isPre112:427] version to be checked 11.2.0.4.0 minor version to check against2
  36. [[email protected]] [main] [ 2018-10-24 18:51:13.369 IST ] [Version.isPre112:438] isPre112 : Returning FALSE for minor version check
  37. [[email protected]] [main] [ 2018-10-24 18:51:13.369 IST ] [UnixSystem.isHAConfigured:2661] olrFileName = /etc/oracle/olr.loc
  38. [[email protected]] [main] [ 2018-10-24 18:51:13.370 IST ] [VerificationUtil.isHAConfigured:3184] haConfigured=false
  39. [[email protected]] [main] [ 2018-10-24 18:51:13.370 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  40. [[email protected]] [main] [ 2018-10-24 18:51:13.371 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  41. [[email protected]] [main] [ 2018-10-24 18:51:13.372 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  42. [[email protected]] [main] [ 2018-10-24 18:51:13.372 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  43. [[email protected]] [main] [ 2018-10-24 18:51:13.373 IST ] [VerificationUtil.isCRSConfigured:3208] crsConfigured=false
  44. [[email protected]] [main] [ 2018-10-24 18:51:13.373 IST ] [ParamManager.validate:574] clVersion=11.2.0.4.0
  45. [[email protected]] [main] [ 2018-10-24 18:51:13.398 IST ] [CLSyntax2.setRunCluvfyTxt:461] Method Entry.
  46. [[email protected]] [main] [ 2018-10-24 18:51:13.401 IST ] [CLSyntax2.validate:224] Method entry. release=11.2.0.4.0, commandStr=compssa-nrac-node2-s/dev/mapper/asm-data1p1
  47. [[email protected]] [main] [ 2018-10-24 18:51:13.749 IST ] [VerificationUtil.setVariableValue:7877] setting variable: VAR = NODE_LIST VALUE=rac-node2
  48. [[email protected]] [main] [ 2018-10-24 18:51:13.750 IST ] [VerificationUtil.setVariableValue:7877] setting variable: VAR = STORAGE_ID_LIST VALUE=/dev/mapper/asm-data1p1
  49. [[email protected]] [main] [ 2018-10-24 18:51:13.750 IST ] [ParamManager.setGroupSupport:5670] ==== Is group options supported? true
  50. [[email protected]] [main] [ 2018-10-24 18:51:13.751 IST ] [ParamManager.setWindowsSystem:5692] ==== Is Windows system? false
  51. [[email protected]] [main] [ 2018-10-24 18:51:13.753 IST ] [sNativeCLOption.addFixedKey:68] ==== Total number of native options added: 3
  52. [[email protected]] [main] [ 2018-10-24 18:51:13.754 IST ] [ParamManager.debug_out:5822] ---Picking up args for '-help' flag
  53. [[email protected]] [main] [ 2018-10-24 18:51:13.754 IST ] [ParamManager.debug_out:5822] ---Picking up args for common options
  54. [[email protected]] [main] [ 2018-10-24 18:51:13.755 IST ] [ParamManager.debug_out:5822] ---Picking up args for Cluvfy's Oracle home
  55. [[email protected]] [main] [ 2018-10-24 18:51:13.755 IST ] [ParamManager.debug_out:5822] ---picking up args for nodelist
  56. [[email protected]] [main] [ 2018-10-24 18:51:13.757 IST ] [ParamManager.debug_out:5822] ---Picking up args for storage ID list
  57. [[email protected]] [main] [ 2018-10-24 18:51:13.757 IST ] [ParamManager.debug_out:5822] ---Picking up args for Oracle File Type
  58. [[email protected]] [main] [ 2018-10-24 18:51:13.758 IST ] [CluvfyDriver.parseArguments:131] ParamManager contains:
  59. Command line arguments:
  60. comp ssa -n rac-node2 -s /dev/mapper/asm-data1p1
  61. ParamManager object contains:
  62.  
  63. checkArgStage returns: false
  64. checkArgComp returns: true
  65. checkArgPre returns: false
  66. checkArgPost returns: false
  67. checkArgProfile returns: false
  68. checkArgHelp returns: false
  69. checkArgVerbose returns: false
  70. checkArgVer10gR1 returns: false
  71. checkArgVer10gR2 returns: false
  72. checkArgDisplayStatus returns: false
  73. checkArgVersion returns: false
  74. checkArgDiag returns: false
  75. checkArgSshonly returns: false
  76. Argument[0] contains:
  77. Type: 1
  78. Local: false
  79. All: false
  80. rac-node2
  81. Argument[1] contains:
  82. Type: 4
  83. Local: false
  84. All: false
  85. /dev/mapper/asm-data1p1
  86. [[email protected]] [main] [ 2018-10-24 18:51:13.759 IST ] [ClusterVerifier.<init>:78] Inside ClusterVerifier() constructor...
  87. [[email protected]] [main] [ 2018-10-24 18:51:13.759 IST ] [VerificationUtil.getDestLoc:2725] ==== CV_DESTLOC system property set as '/tmp'
  88. [[email protected]] [main] [ 2018-10-24 18:51:13.760 IST ] [VerificationUtil.getDestLoc:2742] ==== CV_DESTLOC: '/tmp/'
  89. [[email protected]] [main] [ 2018-10-24 18:51:13.760 IST ] [VerificationUtil.getExecutionEnvironment:5752] RDBMS Version is -->11.2.0.4.0
  90. [[email protected]] [main] [ 2018-10-24 18:51:13.761 IST ] [VerificationUtil.validateCmdLineExecEnvironment:5768] Entered validateCmdLineExecEnvironment
  91. [[email protected]] [main] [ 2018-10-24 18:51:13.761 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  92. [[email protected]] [main] [ 2018-10-24 18:51:13.762 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  93. [[email protected]] [main] [ 2018-10-24 18:51:13.762 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  94. [[email protected]] [main] [ 2018-10-24 18:51:13.763 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  95. [[email protected]] [main] [ 2018-10-24 18:51:13.763 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against11
  96. [[email protected]] [main] [ 2018-10-24 18:51:13.764 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  97. [[email protected]] [main] [ 2018-10-24 18:51:13.764 IST ] [Version.isPre112:427] version to be checked 11.2.0.4.0 minor version to check against2
  98. [[email protected]] [main] [ 2018-10-24 18:51:13.765 IST ] [Version.isPre112:438] isPre112 : Returning FALSE for minor version check
  99. [[email protected]] [main] [ 2018-10-24 18:51:13.765 IST ] [UnixSystem.isHAConfigured:2661] olrFileName = /etc/oracle/olr.loc
  100. [[email protected]] [main] [ 2018-10-24 18:51:13.766 IST ] [VerificationUtil.isHAConfigured:3184] haConfigured=false
  101. [[email protected]] [main] [ 2018-10-24 18:51:13.766 IST ] [VerificationUtil.validateCmdLineExecEnvironment:5805] Exit validateCmdLineExecEnvironment
  102. [[email protected]] [main] [ 2018-10-24 18:51:13.767 IST ] [ConfigUtil.isDefined:199] ==== Is ORACLE_SRVM_REMOTESHELL defined? : false
  103. [[email protected]] [main] [ 2018-10-24 18:51:13.767 IST ] [ConfigUtil.getConfiguredValue:181] ==== Fallback to env var 'ORACLE_SRVM_REMOTESHELL'=null
  104. [[email protected]] [main] [ 2018-10-24 18:51:13.768 IST ] [ConfigUtil.isDefined:199] ==== Is ORACLE_SRVM_REMOTECOPY defined? : false
  105. [[email protected]] [main] [ 2018-10-24 18:51:13.768 IST ] [ConfigUtil.getConfiguredValue:181] ==== Fallback to env var 'ORACLE_SRVM_REMOTECOPY'=null
  106. [[email protected]] [main] [ 2018-10-24 18:51:13.786 IST ] [ReportUtil.printReportHeader:1312] Component name in ReportUtil is:ssa
  107. [[email protected]] [main] [ 2018-10-24 18:51:13.787 IST ] [ReportUtil.printReportHeader:1314] Component ID in ReportUtil is:shared storage accessibility
  108. [[email protected]] [main] [ 2018-10-24 18:51:13.804 IST ] [ParamManager.getArgument:5600] Found argtype = 1
  109. [[email protected]] [main] [ 2018-10-24 18:51:13.805 IST ] [ParamManager.getMultiPartArgVal:5617] Retrieving argument of type = 1
  110. [[email protected]] [main] [ 2018-10-24 18:51:13.805 IST ] [ParamManager.getArgument:5600] Found argtype = 1
  111. [[email protected]] [main] [ 2018-10-24 18:51:13.806 IST ] [VerificationUtil.getNodelist:663] ====VerificationUtil gets the nodelist from ParamManager as:
  112. [[email protected]] [main] [ 2018-10-24 18:51:13.806 IST ] [VerificationUtil.getNodelist:666] ==Node 0 is:rac-node2
  113. [[email protected]] [main] [ 2018-10-24 18:51:13.807 IST ] [VerificationUtil.getNodelist:689] ==== Nodelist before processing: nodelist[0]:rac-node2
  114. [[email protected]] [main] [ 2018-10-24 18:51:13.807 IST ] [VerificationUtil.getNodelist:705] ==== Nodelist after: nodelist[0]:rac-node2
  115. [[email protected]] [main] [ 2018-10-24 18:51:13.808 IST ] [ParamManager.getMultiPartArgVal:5617] Retrieving argument of type = 4
  116. [[email protected]] [main] [ 2018-10-24 18:51:13.808 IST ] [ParamManager.getArgument:5600] Found argtype = 4
  117. [[email protected]] [main] [ 2018-10-24 18:51:13.809 IST ] [ParamManager.getMultiPartArgVal:5617] Retrieving argument of type = 27
  118. [[email protected]] [main] [ 2018-10-24 18:51:13.809 IST ] [ParamManager.getArgument:5600] Found argtype = 1
  119. [[email protected]] [main] [ 2018-10-24 18:51:13.810 IST ] [VerificationUtil.isLocalNodeOperation:6908] nodelistArg not NULL
  120. [[email protected]] [main] [ 2018-10-24 18:51:13.810 IST ] [ParamManager.getArgument:5600] Found argtype = 1
  121. [[email protected]] [main] [ 2018-10-24 18:51:13.811 IST ] [ParamManager.getMultiPartArgVal:5617] Retrieving argument of type = 1
  122. [[email protected]] [main] [ 2018-10-24 18:51:13.811 IST ] [ParamManager.getArgument:5600] Found argtype = 1
  123. [[email protected]] [main] [ 2018-10-24 18:51:13.811 IST ] [VerificationUtil.getNodelist:663] ====VerificationUtil gets the nodelist from ParamManager as:
  124. [[email protected]] [main] [ 2018-10-24 18:51:13.812 IST ] [VerificationUtil.getNodelist:666] ==Node 0 is:rac-node2
  125. [[email protected]] [main] [ 2018-10-24 18:51:13.812 IST ] [VerificationUtil.getNodelist:689] ==== Nodelist before processing: nodelist[0]:rac-node2
  126. [[email protected]] [main] [ 2018-10-24 18:51:13.813 IST ] [VerificationUtil.getNodelist:705] ==== Nodelist after: nodelist[0]:rac-node2
  127. [[email protected]] [main] [ 2018-10-24 18:51:13.815 IST ] [Utils.getLocalHost:481] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  128. [[email protected]] [main] [ 2018-10-24 18:51:13.816 IST ] [VerificationUtil.isLocalNodeOperation:6926]
  129. Comparing localhost 'rac-node1' with nodelist[0] 'rac-node2'
  130.  
  131. [[email protected]] [main] [ 2018-10-24 18:51:13.817 IST ] [VerificationUtil.sameHost:7109] VerificationUtil::sameHost() Host:rac-node2 and Host: rac-node1 are not same.
  132. [[email protected]] [main] [ 2018-10-24 18:51:13.817 IST ] [VerificationUtil.isLocalNodeOperation:6940] Nodelist not equal to localhost
  133. [[email protected]] [main] [ 2018-10-24 18:51:13.821 IST ] [VerificationUtil.getCRSHome:2853] Executing getCRSHome()
  134. [[email protected]] [main] [ 2018-10-24 18:51:13.822 IST ] [VerificationUtil.getCRSHome:2856] Checking CRS Home on local node for the first time
  135. [[email protected]] [main] [ 2018-10-24 18:51:13.823 IST ] [VerificationUtil.getCRSHome:1481] Executing getCRSHome(node=rac-node1, result)
  136. [[email protected]] [main] [ 2018-10-24 18:51:13.823 IST ] [Utils.getLocalHost:481] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  137. [[email protected]] [main] [ 2018-10-24 18:51:13.824 IST ] [UnixSystem.getCRSHome:2743] olrFileName = /etc/oracle/olr.loc
  138. [[email protected]] [main] [ 2018-10-24 18:51:13.831 IST ] [VerificationUtil.getCRSHome:1492] IGNORED: PRKC-1144 : File "/etc/oracle/olr.loc" not found.
  139. [[email protected]] [main] [ 2018-10-24 18:51:13.832 IST ] [VerificationUtil.getCRSHome:1493] Will attempt a fallback.
  140. [[email protected]] [main] [ 2018-10-24 18:51:13.834 IST ] [VerificationUtil.getCRSHomeFromInitCSSD:2973] Executing getCRSHomeFromInitCSSD(node=rac-node1, result)
  141. [[email protected]] [main] [ 2018-10-24 18:51:13.835 IST ] [CommandsUtil.<init>:63] Commands defined
  142. [[email protected]] [main] [ 2018-10-24 18:51:13.843 IST ] [VerificationUtil.getCRSHomeFromInitCSSD:2997] The command Approach failed, now using Fallback (grep) approach
  143. [[email protected]] [main] [ 2018-10-24 18:51:13.843 IST ] [CommandsUtil.getGrep:164] Returning '/bin/grep'
  144. [[email protected]] [main] [ 2018-10-24 18:51:13.844 IST ] [GlobalExecution.runExe:1579] GlobalExecution::inside runExe...
  145. [[email protected]] [main] [ 2018-10-24 18:51:13.848 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  146. [[email protected]] [main] [ 2018-10-24 18:51:13.855 IST ] [VerificationDataManager.<init>:65] **** VDM constructed
  147. [[email protected]] [main] [ 2018-10-24 18:51:13.856 IST ] [VerificationDataManager.isDataSegmentLoaded:111] **** Load status for segment admin_data is false
  148. [[email protected]] [main] [ 2018-10-24 18:51:13.856 IST ] [VerificationDataManager.getDataSegment:134] DataSegment 'admin_data' to be loaded
  149. [[email protected]] [main] [ 2018-10-24 18:51:13.858 IST ] [VDMUtil.getAdminDataFilename:184] ==== Admin data file: /tmp/bootstrap/cv/cvdata/admin.xml
  150. [[email protected]] [main] [ 2018-10-24 18:51:14.033 IST ] [AdminLoader.createSegment:129] Parser validation set to: true
  151. [[email protected]] [main] [ 2018-10-24 18:51:14.033 IST ] [AdminLoader.createSegment:132] /tmp/bootstrap/cv/cvdata/admin.xml is well-formed
  152. [[email protected]] [main] [ 2018-10-24 18:51:14.034 IST ] [AdminLoader.createSegment:163] ==== Added Property[file_constraints_xml = constraints.xml]
  153. [[email protected]] [main] [ 2018-10-24 18:51:14.034 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_user_oracle = oracle]
  154. [[email protected]] [main] [ 2018-10-24 18:51:14.035 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_user_nobody = nobody]
  155. [[email protected]] [main] [ 2018-10-24 18:51:14.035 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_group_dba = dba]
  156. [[email protected]] [main] [ 2018-10-24 18:51:14.036 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_group_asmadmin = asmadmin]
  157. [[email protected]] [main] [ 2018-10-24 18:51:14.036 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_asm_disks_permissions = 0660]
  158. [[email protected]] [main] [ 2018-10-24 18:51:14.037 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_group_oper = oper]
  159. [[email protected]] [main] [ 2018-10-24 18:51:14.037 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_group_oinstall = oinstall]
  160. [[email protected]] [main] [ 2018-10-24 18:51:14.038 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_ocr_ver = 3]
  161. [[email protected]] [main] [ 2018-10-24 18:51:14.038 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_ocr_ver_11_0 = 2]
  162. [[email protected]] [main] [ 2018-10-24 18:51:14.039 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_ocr_ver_11_1 = 2]
  163. [[email protected]] [main] [ 2018-10-24 18:51:14.039 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_ocr_ver_10_2 = 2]
  164. [[email protected]] [main] [ 2018-10-24 18:51:14.040 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_nfs_options = rw,acregmin=0&acregmax=0&acdirmin=0&acdirmax=0|actimeo=0]
  165. [[email protected]] [main] [ 2018-10-24 18:51:14.040 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_rac_software_nfs_options = rw,hard,rsize>=32768,wsize>=32768,proto=tcp|tcp,vers=3|nfsvers=3|nfsv3|v3,timeo>=600,acregmin=0&acregmax=0&acdirmin=0&acdirmax=0|actimeo=0]
  166. [[email protected]] [main] [ 2018-10-24 18:51:14.040 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_rac_data_nfs_options = rw,hard,rsize>=32768,wsize>=32768,proto=tcp|tcp,vers=3|nfsvers=3|nfsv3|v3,timeo>=600,acregmin=0&acregmax=0&acdirmin=0&acdirmax=0|actimeo=0]
  167. [[email protected]] [main] [ 2018-10-24 18:51:14.041 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_rac_ocr_vdisk_nfs_options = rw,hard,rsize>=32768,wsize>=32768,proto=tcp|tcp,vers=3|nfsvers=3|nfsv3|v3,timeo>=600,acregmin=0&acregmax=0&acdirmin=0&acdirmax=0|actimeo=0]
  168. [[email protected]] [main] [ 2018-10-24 18:51:14.041 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_si_software_nfs_options = rw,hard,rsize>=32768,wsize>=32768,proto=tcp|tcp,vers=3|nfsvers=3|nfsv3|v3,timeo>=600]
  169. [[email protected]] [main] [ 2018-10-24 18:51:14.042 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_si_data_nfs_options = rw,hard,rsize>=32768,wsize>=32768,proto=tcp|tcp,vers=3|nfsvers=3|nfsv3|v3,timeo>=600]
  170. [[email protected]] [main] [ 2018-10-24 18:51:14.042 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_ocr_loc_owner = root]
  171. [[email protected]] [main] [ 2018-10-24 18:51:14.043 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_ocr_loc_group = root]
  172. [[email protected]] [main] [ 2018-10-24 18:51:14.043 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_ocr_loc_permissions = 0644]
  173. [[email protected]] [main] [ 2018-10-24 18:51:14.044 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_ocr_owner = root]
  174. [[email protected]] [main] [ 2018-10-24 18:51:14.044 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_ocr_group = $INSTALL_GROUP]
  175. [[email protected]] [main] [ 2018-10-24 18:51:14.045 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_ocr_permissions = 0640]
  176. [[email protected]] [main] [ 2018-10-24 18:51:14.045 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_ocr_permissions_10 = 0644]
  177. [[email protected]] [main] [ 2018-10-24 18:51:14.045 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_ocr_permissions_10_2_0_5 = 0640]
  178. [[email protected]] [main] [ 2018-10-24 18:51:14.046 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_ocr_size = 262144]
  179. [[email protected]] [main] [ 2018-10-24 18:51:14.046 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_olr_loc_owner = root]
  180. [[email protected]] [main] [ 2018-10-24 18:51:14.047 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_olr_loc_group = $INSTALL_GROUP]
  181. [[email protected]] [main] [ 2018-10-24 18:51:14.047 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_olr_loc_permissions = 0644]
  182. [[email protected]] [main] [ 2018-10-24 18:51:14.048 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_olr_loc_siha_permissions_11_2_0_1 = 0644]
  183. [[email protected]] [main] [ 2018-10-24 18:51:14.048 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_olr_loc_siha_permissions = 0640]
  184. [[email protected]] [main] [ 2018-10-24 18:51:14.049 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_olr_owner_crs = root]
  185. [[email protected]] [main] [ 2018-10-24 18:51:14.049 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_olr_owner_siha = $ORACLE_USER]
  186. [[email protected]] [main] [ 2018-10-24 18:51:14.049 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_olr_group = $INSTALL_GROUP]
  187. [[email protected]] [main] [ 2018-10-24 18:51:14.050 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_olr_permissions = 0600]
  188. [[email protected]] [main] [ 2018-10-24 18:51:14.051 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_vdisk_permissions = 0640]
  189. [[email protected]] [main] [ 2018-10-24 18:51:14.051 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_vdisk_permissions_10 = 0644]
  190. [[email protected]] [main] [ 2018-10-24 18:51:14.052 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_vdisk_permissions_10_2_0_5 = 0640]
  191. [[email protected]] [main] [ 2018-10-24 18:51:14.052 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_crshome_freespace_default_limit = 5]
  192. [[email protected]] [main] [ 2018-10-24 18:51:14.052 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_crshome_freespace_percentage_limit = 0.05]
  193. [[email protected]] [main] [ 2018-10-24 18:51:14.053 IST ] [AdminLoader.createSegment:163] ==== Added Property[rem_command = exectask.sh]
  194. [[email protected]] [main] [ 2018-10-24 18:51:14.053 IST ] [AdminLoader.createSegment:163] ==== Added Property[rem_cmd_files = cv/remenv/runfixup.sh,cv/remenv/orarun.sh,cv/remenv/cvuqdisk-1.0.9-1.rpm,cv/remenv/exectask.sh,cv/remenv/exectask,cv/remenv/pluggable]
  195. [[email protected]] [main] [ 2018-10-24 18:51:14.054 IST ] [AdminLoader.createSegment:163] ==== Added Property[DAEMON_INAME_CRS = crsd.bin]
  196. [[email protected]] [main] [ 2018-10-24 18:51:14.054 IST ] [AdminLoader.createSegment:163] ==== Added Property[DAEMON_DNAME_CRS = CRS daemon]
  197. [[email protected]] [main] [ 2018-10-24 18:51:14.055 IST ] [AdminLoader.createSegment:163] ==== Added Property[DAEMON_INAME_CSS = ocssd.bin]
  198. [[email protected]] [main] [ 2018-10-24 18:51:14.055 IST ] [AdminLoader.createSegment:163] ==== Added Property[DAEMON_DNAME_CSS = CSS daemon]
  199. [[email protected]] [main] [ 2018-10-24 18:51:14.056 IST ] [AdminLoader.createSegment:163] ==== Added Property[DAEMON_INAME_EVM = evmd.bin]
  200. [[email protected]] [main] [ 2018-10-24 18:51:14.056 IST ] [AdminLoader.createSegment:163] ==== Added Property[DAEMON_DNAME_EVM = EVM daemon]
  201. [[email protected]] [main] [ 2018-10-24 18:51:14.056 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_dir_temp = /tmp]
  202. [[email protected]] [main] [ 2018-10-24 18:51:14.057 IST ] [AdminLoader.createSegment:163] ==== Added Property[xcheck_app_location = /usr/X11R6/bin/]
  203. [[email protected]] [main] [ 2018-10-24 18:51:14.057 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_ssh_app = /usr/bin/ssh]
  204. [[email protected]] [main] [ 2018-10-24 18:51:14.058 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_scp_app = /usr/bin/scp]
  205. [[email protected]] [main] [ 2018-10-24 18:51:14.058 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_rsh_app = /usr/bin/rsh]
  206. [[email protected]] [main] [ 2018-10-24 18:51:14.059 IST ] [AdminLoader.createSegment:163] ==== Added Property[def_umask = 0022]
  207. [[email protected]] [main] [ 2018-10-24 18:51:14.059 IST ] [VDMUtil.getCmd4RemExec:123] ==== getCmd4RemExec() called...
  208. [[email protected]] [main] [ 2018-10-24 18:51:14.060 IST ] [VDMUtil.getCmd4RemExec:130] ==== PROP_REM_COMMAND = 'exectask.sh'
  209. [[email protected]] [main] [ 2018-10-24 18:51:14.060 IST ] [VerificationUtil.getCmd4RemExec:2830] ==== Remote Exec name: exectask.sh
  210. [[email protected]] [main] [ 2018-10-24 18:51:14.061 IST ] [VerificationUtil.isLocalNodeOperation:6891] Returning saved value of: false
  211. [[email protected]] [main] [ 2018-10-24 18:51:14.061 IST ] [VDMUtil.getCmdFiles4RemExec:145] ==== getCmdFiles4RemExec() called...
  212. [[email protected]] [main] [ 2018-10-24 18:51:14.061 IST ] [VDMUtil.getCmdFiles4RemExec:150] ==== PROP_REM_CDMFILES = 'cv/remenv/runfixup.sh,cv/remenv/orarun.sh,cv/remenv/cvuqdisk-1.0.9-1.rpm,cv/remenv/exectask.sh,cv/remenv/exectask,cv/remenv/pluggable'
  213. [[email protected]] [main] [ 2018-10-24 18:51:14.062 IST ] [VerificationUtil.listRecursiveFiles:1071] InputList=cv/remenv/runfixup.sh,cv/remenv/orarun.sh,cv/remenv/cvuqdisk-1.0.9-1.rpm,cv/remenv/exectask.sh,cv/remenv/exectask,cv/remenv/pluggable
  214. [[email protected]] [main] [ 2018-10-24 18:51:14.068 IST ] [VerificationUtil.listRecursiveFiles:1128] OutputList=cv/remenv/runfixup.sh,cv/remenv/orarun.sh,cv/remenv/cvuqdisk-1.0.9-1.rpm,cv/remenv/exectask.sh,cv/remenv/exectask,cv/remenv/pluggable/unix/checkramfs.sh,cv/remenv/pluggable/unix/check_default_gateway.sh,cv/remenv/pluggable/unix/checksyslog.sh,cv/remenv/pluggable/unix/ora_00600_errors_analyzer.sh,cv/remenv/pluggable/unix/shutdown_hwclock_sync.sh,cv/remenv/pluggable/unix/check_jumbo_frames.sh,cv/remenv/pluggable/unix/ora_07445_errors_analyzer.sh,cv/remenv/pluggable/unix/css_reboot_time.sh,cv/remenv/pluggable/unix/css_disk_timeout.sh,cv/remenv/pluggable/unix/check_tcp_packet_retransmit.sh,cv/remenv/pluggable/unix/checksshd.sh,cv/remenv/pluggable/unix/css_diagwait.sh,cv/remenv/pluggable/unix/css_misscount.sh,cv/remenv/pluggable/unix/check_vip_restart_attempt.sh,cv/remenv/pluggable/unix/check_network_packet_reassembly.sh,cv/remenv/pluggable/unix/hangcheck_margin.sh,cv/remenv/pluggable/unix/common_include.sh,cv/remenv/pluggable/unix/listener_naming_convention.sh,cv/remenv/pluggable/unix/check_disk_asynch_io_linking.sh,cv/remenv/pluggable/unix/checkportavail.sh,cv/remenv/pluggable/unix/check_vmm.sh,cv/remenv/pluggable/unix/bdump_dest_trace_analyzer.sh,cv/remenv/pluggable/unix/checkcorefile.sh,cv/remenv/pluggable/unix/hangcheck_tick.sh,cv/remenv/pluggable/unix/getNICSpeed.sh,cv/remenv/pluggable/unix/check_rp_filter.sh,cv/remenv/pluggable/unix/hangchecktimer.sh,cv/remenv/pluggable/unix/check_network_param.sh,cv/remenv/pluggable/unix/alert_log_file_size_analyzer.sh,cv/remenv/pluggable/unix/checkhugepage.sh,cv/remenv/pluggable/unix/checkmemlock.sh,cv/remenv/pluggable/unix/check_non_routable_network_interconnect.sh,cv/remenv/pluggable/unix/core_dump_dest_analyzer.sh,cv/remenv/pluggable/unix/check_e1000.sh,cv/remenv/pluggable/unix/hangcheck_reboot.sh
  215. [[email protected]] [main] [ 2018-10-24 18:51:14.068 IST ] [CVUAutoUpdateManager.getCmdFiles4RemExec:175] cvHome=/tmp/bootstrap/
  216. [[email protected]] [main] [ 2018-10-24 18:51:14.069 IST ] [CVUAutoUpdateManager.getCmdFiles4RemExec:176] derivedCVHomeString=/tmp/bootstrap
  217. [[email protected]] [main] [ 2018-10-24 18:51:14.071 IST ] [CVUAutoUpdateManager.getCmdFiles4RemExec:193] s_remExecFiles=/tmp/bootstrap/cv/remenv/runfixup.sh,/tmp/bootstrap/cv/remenv/orarun.sh,/tmp/bootstrap/cv/remenv/cvuqdisk-1.0.9-1.rpm,/tmp/bootstrap/cv/remenv/exectask.sh,/tmp/bootstrap/cv/remenv/exectask,/tmp/bootstrap/cv/remenv/pluggable/unix/checkramfs.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/check_default_gateway.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/checksyslog.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/ora_00600_errors_analyzer.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/shutdown_hwclock_sync.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/check_jumbo_frames.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/ora_07445_errors_analyzer.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/css_reboot_time.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/css_disk_timeout.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/check_tcp_packet_retransmit.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/checksshd.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/css_diagwait.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/css_misscount.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/check_vip_restart_attempt.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/check_network_packet_reassembly.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/hangcheck_margin.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/common_include.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/listener_naming_convention.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/check_disk_asynch_io_linking.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/checkportavail.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/check_vmm.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/bdump_dest_trace_analyzer.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/checkcorefile.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/hangcheck_tick.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/getNICSpeed.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/check_rp_filter.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/hangchecktimer.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/check_network_param.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/alert_log_file_size_analyzer.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/checkhugepage.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/checkmemlock.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/check_non_routable_network_interconnect.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/core_dump_dest_analyzer.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/check_e1000.sh,/tmp/bootstrap/cv/remenv/pluggable/unix/hangcheck_reboot.sh
  218. [[email protected]] [main] [ 2018-10-24 18:51:14.072 IST ] [CVUAutoUpdateManager.getFiles4RemExecServer:261] s_remExecServerFiles=
  219. [[email protected]] [main] [ 2018-10-24 18:51:14.072 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  220. [[email protected]] [main] [ 2018-10-24 18:51:14.073 IST ] [NativeResult.<init>:91] NativeResult: The String obtained is0
  221. [[email protected]] [main] [ 2018-10-24 18:51:14.074 IST ] [NativeResult.<init>:99] The status string is: 0
  222. [[email protected]] [main] [ 2018-10-24 18:51:14.075 IST ] [RemoteExecCommand.<init>:751] End of constructor call (called by many other constructors internally): RemoteExecCommand(String cmd, String[] args, String[] env, String node, boolean localExecution, String[] cmdFiles, String srcLoc, String[] remExecServerFiles, String destLoc, boolean chkException
  223. [[email protected]] [main] [ 2018-10-24 18:51:14.075 IST ] [RemoteExecCommand.<init>:687] End of constructor call: RemoteExecCommand(String cmd, String[] args, String[] env, String node, boolean localExecution, String[] cmdFiles, String[] remExecFiles, String destLoc
  224. [[email protected]] [main] [ 2018-10-24 18:51:14.076 IST ] [RemoteExecCommand.setSubDirAndGroup:1484] Calling setSubDirAndGroup(String subDir, String group) with 'subDir ='CVU_11.2.0.4.0_grid' and 'group = 'null
  225. [[email protected]] [main] [ 2018-10-24 18:51:14.076 IST ] [VerificationUtil.getLocalHost:854] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  226. [[email protected]] [main] [ 2018-10-24 18:51:14.077 IST ] [VerificationUtil.isLocalNode:7023]
  227. Comparing 'rac-node1' to localHOST 'rac-node1'
  228. [[email protected]] [main] [ 2018-10-24 18:51:14.077 IST ] [RemoteExecCommand.setLocalExecution:1469] Changed ivar value for m_localExecution to true
  229. [[email protected]] [main] [ 2018-10-24 18:51:14.078 IST ] [RemoteExecCommand.setArgs:1429] Setting value for ivar 'm_args'
  230. [[email protected]] [main] [ 2018-10-24 18:51:14.091 IST ] [ClusterConfig.isClusterInstalled:363] hasJarPresent=false
  231. [[email protected]] [main] [ 2018-10-24 18:51:14.091 IST ] [ClusterConfig.<init>:230] ClusterConfig:Number of workers = 0
  232. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.096 IST ] [Semaphore.acquire:109] SyncBufferFull:Acquire called by thread Worker 1 m_count=0
  233. [[email protected]] [main] [ 2018-10-24 18:51:14.096 IST ] [ClusterConfig.createWorkers:315] Started worker threads count=4
  234. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.097 IST ] [Semaphore.acquire:109] SyncBufferFull:Acquire called by thread Worker 3 m_count=0
  235. [[email protected]] [main] [ 2018-10-24 18:51:14.097 IST ] [ClusterConfig.isClusterInstalled:363] hasJarPresent=false
  236. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.097 IST ] [Semaphore.acquire:109] SyncBufferFull:Acquire called by thread Worker 2 m_count=0
  237. [[email protected]] [main] [ 2018-10-24 18:51:14.098 IST ] [ClusterConfig.init:423] Returning same instance to clientmain
  238. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.098 IST ] [Semaphore.acquire:109] SyncBufferFull:Acquire called by thread Worker 0 m_count=0
  239. [[email protected]] [main] [ 2018-10-24 18:51:14.099 IST ] [ClusterConfig.submit:488] Entering submit, cmdCount=1
  240. [[email protected]] [main] [ 2018-10-24 18:51:14.100 IST ] [Semaphore.acquire:109] SyncBufferEmpty:Acquire called by thread main m_count=4
  241. [[email protected]] [main] [ 2018-10-24 18:51:14.100 IST ] [Semaphore.release:85] SyncBufferFull:Release called by thread main m_count=1
  242. [[email protected]] [main] [ 2018-10-24 18:51:14.100 IST ] [ClusterConfig.submit:523] submitted commands=1
  243. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.101 IST ] [Semaphore.release:85] SyncBufferEmpty:Release called by thread Worker 1 m_count=4
  244. [[email protected]] [main] [ 2018-10-24 18:51:14.101 IST ] [ClusterConfig.block:596] block called by thread main commandNum 1
  245. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.101 IST ] [RunExeCommand.execute:91] RunExeCommand::Inside execute() Worker 1
  246. [[email protected]] [main] [ 2018-10-24 18:51:14.101 IST ] [Semaphore.acquire:109] ClientResource Constructor:Blocking Semaphore owned by main:Acquire called by thread main m_count=0
  247. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.101 IST ] [VerificationCommand.execute:215] :: Inside execute() [Thread:
  248. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.102 IST ] [RemoteExecCommand.validateCmdArgs:1049] Calling validateCmdArgs
  249. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.102 IST ] [RemoteExecCommand.validateCmdArgs:1055] Checking for arguments validity
  250. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.103 IST ] [RemoteExecCommand.execute:824] Trying to runRemoteExecCmd first to check if server is already running
  251. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.103 IST ] [RemoteExecCommand.executeInternal:990] Calling executeInternal()
  252. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.103 IST ] [RemoteExecCommand.executeInternal:1006] executing the command: '/tmp/CVU_11.2.0.4.0_grid/exectask.sh' with args '-runexe /bin/grep ORA_CRS_HOME= /etc/init.d/init.cssd ', 'm_stdin == null ->true', 'm_localExecution ->true', 'm_chkException ->false'
  253. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.104 IST ] [NativeSystem.isCmdScv:502] isCmdScv: cmd=[]
  254. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.104 IST ] [RuntimeExec.runCommand:75] Calling Runtime.exec() with the command
  255. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.105 IST ] [RuntimeExec.runCommand:77] /bin/sh
  256. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.105 IST ] [RuntimeExec.runCommand:77] -c
  257. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.105 IST ] [RuntimeExec.runCommand:77] /tmp/CVU_11.2.0.4.0_grid/exectask.sh -runexe /bin/grep ORA_CRS_HOME= /etc/init.d/init.cssd
  258. [[email protected]] [Thread-2] [ 2018-10-24 18:51:14.110 IST ] [StreamReader.run:61] In StreamReader.run
  259. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.110 IST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
  260. [[email protected]] [Thread-3] [ 2018-10-24 18:51:14.110 IST ] [StreamReader.run:61] In StreamReader.run
  261. [[email protected]] [Thread-2] [ 2018-10-24 18:51:14.130 IST ] [StreamReader.run:65] OUTPUT><CV_CMD>/bin/grep ORA_CRS_HOME= /etc/init.d/init.cssd </CV_CMD><CV_VAL>/bin/grep: /etc/init.d/init.cssd: No such file or directory
  262. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.131 IST ] [RuntimeExec.runCommand:144] runCommand: process returns 0
  263. [[email protected]] [Thread-2] [ 2018-10-24 18:51:14.131 IST ] [StreamReader.run:65] OUTPUT></CV_VAL><CV_VRES>2</CV_VRES><CV_LOG>Exectask: runexe was successful</CV_LOG><CV_ERES>0</CV_ERES>
  264. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.131 IST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
  265. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.132 IST ] [RuntimeExec.runCommand:164] <CV_CMD>/bin/grep ORA_CRS_HOME= /etc/init.d/init.cssd </CV_CMD><CV_VAL>/bin/grep: /etc/init.d/init.cssd: No such file or directory
  266. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.132 IST ] [RuntimeExec.runCommand:164] </CV_VAL><CV_VRES>2</CV_VRES><CV_LOG>Exectask: runexe was successful</CV_LOG><CV_ERES>0</CV_ERES>
  267. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.132 IST ] [RuntimeExec.runCommand:170] RunTimeExec: error>
  268. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.133 IST ] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
  269. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.133 IST ] [UnixSystem.dorunRemoteExecCmd:3232] retval = 0
  270. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.134 IST ] [UnixSystem.dorunRemoteExecCmd:3256] exitValue = 0
  271. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.134 IST ] [RemoteExecCommand.executeInternal:1037] cmdSuccess status: true
  272. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.135 IST ] [RemoteExecCommand.execute:894] cmdSuccess status: true
  273. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.135 IST ] [VerificationUtil.fetchTextByTags:2318]
  274. Tags <CV_VAL> and </CV_VAL> contains:/bin/grep: /etc/init.d/init.cssd: No such file or directory
  275.  
  276.  
  277. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.136 IST ] [VerificationCommand.execute:234] Formatted exectask output is:
  278. <CV_CMD>/bin/grep ORA_CRS_HOME= /etc/init.d/init.cssd </CV_CMD><CV_VAL>/bin/grep: /etc/init.d/init.cssd: No such file or directory
  279. </CV_VAL><CV_VRES>2</CV_VRES><CV_LOG>Exectask: runexe was successful</CV_LOG><CV_ERES>0</CV_ERES>
  280. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.136 IST ] [VerificationUtil.fetchTextByTags:2318]
  281. Tags <CV_VRES> and </CV_VRES> contains:2
  282.  
  283. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.137 IST ] [VerificationCommand.execute:245] VfyCode is: 2
  284. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.137 IST ] [VerificationUtil.fetchTextByTags:2318]
  285. Tags <CV_CMD> and </CV_CMD> contains:/bin/grep ORA_CRS_HOME= /etc/init.d/init.cssd
  286.  
  287. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.137 IST ] [VerificationUtil.fetchTextByTags:2318]
  288. Tags <CV_ERES> and </CV_ERES> contains:0
  289.  
  290. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.146 IST ] [sExecutionAnalyzer.pickRunExeOutput:2413] ==== Exectask output: <CV_CMD>/bin/grep ORA_CRS_HOME= /etc/init.d/init.cssd </CV_CMD><CV_VAL>/bin/grep: /etc/init.d/init.cssd: No such file or directory
  291. </CV_VAL><CV_VRES>2</CV_VRES><CV_LOG>Exectask: runexe was successful</CV_LOG><CV_ERES>0</CV_ERES>
  292. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.146 IST ] [VerificationUtil.fetchTextByTags:2318]
  293. Tags <CV_ERES> and </CV_ERES> contains:0
  294.  
  295. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.146 IST ] [VerificationUtil.fetchTextByTags:2318]
  296. Tags <CV_VAL> and </CV_VAL> contains:/bin/grep: /etc/init.d/init.cssd: No such file or directory
  297.  
  298.  
  299. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.147 IST ] [ClusterConfig$ExecuteCommand.returnCommandToClient:2951] returnCommandToClient; fillCount=0 is full=false
  300. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.147 IST ] [Semaphore.acquire:109] SyncBufferEmpty:Acquire called by thread Worker 1 m_count=200
  301. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.148 IST ] [Semaphore.release:85] SyncBufferFull:Release called by thread Worker 1 m_count=1
  302. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.148 IST ] [ClientResource.getListener:157] Calling getListener
  303. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.148 IST ] [ClusterConfig$ExecuteCommand.run:3046] Owner Thread name of the blocking Semaphore main
  304. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.149 IST ] [ClusterConfig$ExecuteCommand.run:3054] Obtained Semaphore
  305. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.149 IST ] [Semaphore.release:85] ClientResource Constructor:Blocking Semaphore owned by main:Release called by thread Worker 1 m_count=1
  306. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.150 IST ] [ClusterConfig$ExecuteCommand.run:3069] Released Semaphore by worker=Worker 1
  307. [[email protected]] [main] [ 2018-10-24 18:51:14.150 IST ] [ClusterConfig.block:608] block acquired semnum=0
  308. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.150 IST ] [Semaphore.acquire:109] SyncBufferFull:Acquire called by thread Worker 1 m_count=0
  309. [[email protected]] [main] [ 2018-10-24 18:51:14.150 IST ] [ClusterConfig.submit:557] Out of block
  310. [[email protected]] [main] [ 2018-10-24 18:51:14.151 IST ] [ClusterConfig.submit:574] status=true
  311. [[email protected]] [main] [ 2018-10-24 18:51:14.151 IST ] [ClusterConfig.destroy:452] destroying resources for client thread Thread[main,5,main]
  312. [[email protected]] [main] [ 2018-10-24 18:51:14.152 IST ] [GlobalExecution.dumpTraceInfo:938] ---- Execution Trace for runExe from node: rac-node1 -----
  313. [[email protected]] [main] [ 2018-10-24 18:51:14.152 IST ] [GlobalExecution.dumpTraceInfo:946] ::Inside execute()
  314. [[email protected]] [main] [ 2018-10-24 18:51:14.153 IST ] [GlobalExecution.dumpTraceInfo:946] *** Inside sExecutionAnalyzer.pickRunExeOutput...
  315. [[email protected]] [main] [ 2018-10-24 18:51:14.153 IST ] [VerificationUtil.fetchTextByTags:2318]
  316. Tags <CV_VRES> and </CV_VRES> contains:2
  317.  
  318. [[email protected]] [main] [ 2018-10-24 18:51:14.153 IST ] [VerificationUtil.getCRSHomeFromInitCSSD:3040] Failed, the command did not return success (CV Val is non-zero).
  319. [[email protected]] [main] [ 2018-10-24 18:51:14.154 IST ] [VerificationUtil.getCRSHomeFromInventory:2871] Executing getCRSHomeFromInventory(result)
  320. [[email protected]] [main] [ 2018-10-24 18:51:14.154 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  321. [[email protected]] [main] [ 2018-10-24 18:51:14.155 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  322. [[email protected]] [main] [ 2018-10-24 18:51:14.155 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  323. [[email protected]] [main] [ 2018-10-24 18:51:14.156 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  324. [[email protected]] [main] [ 2018-10-24 18:51:14.156 IST ] [VerificationUtil.isCRSConfigured:3208] crsConfigured=false
  325. [[email protected]] [main] [ 2018-10-24 18:51:14.156 IST ] [VerificationUtil.getCRSHomeFromInventory:2877] getCRSHome() : Returning NULL as CRS is not found configured
  326. [[email protected]] [main] [ 2018-10-24 18:51:14.158 IST ] [VerificationUtil.getCRSHome:1520] crsHomeFromInv=null
  327. [[email protected]] [main] [ 2018-10-24 18:51:14.158 IST ] [VerificationUtil.getCRSHomeFromOCRDump:2920] Executing getCRSHomeFromOCRDump(crsHomeFromInv=null, node=rac-node1)
  328. [[email protected]] [main] [ 2018-10-24 18:51:14.158 IST ] [VerificationUtil.getCRSHomeFromOCRDump:2923] CRS home could not be retrieved from inventory hence returning null!
  329. [[email protected]] [main] [ 2018-10-24 18:51:14.159 IST ] [VerificationUtil.getCRSHome:1547] Returning failure in getting CRS home
  330. [[email protected]] [main] [ 2018-10-24 18:51:14.159 IST ] [VerificationUtil.getCRSHome:2864] Returning CRS home as 'null'
  331. [[email protected]] [main] [ 2018-10-24 18:51:14.160 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  332. [[email protected]] [main] [ 2018-10-24 18:51:14.160 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  333. [[email protected]] [main] [ 2018-10-24 18:51:14.160 IST ] [VerificationUtil.isLocalNodeOperation:6959] ClusterInfoException caught
  334. [[email protected]] [main] [ 2018-10-24 18:51:14.161 IST ] [VerificationUtil.isLocalNodeOperation:6976]
  335. nodelistArg is: '
  336. Type: 1
  337. Local: false
  338. All: false
  339. rac-node2'
  340. referenceNodeArg is: 'null'
  341. sourceNodeArg is: 'null'
  342. localNode is: 'false'
  343. [[email protected]] [main] [ 2018-10-24 18:51:14.161 IST ] [VerificationUtil.isLocalNodeOperation:6988] m_isLocal is: 'false'
  344. [[email protected]] [main] [ 2018-10-24 18:51:14.169 IST ] [VerifyNetwork.checkReachFromLocalNode:154] timeout = 3
  345. [[email protected]] [main] [ 2018-10-24 18:51:14.172 IST ] [ClusterConfig.init:423] Returning same instance to clientmain
  346. [[email protected]] [main] [ 2018-10-24 18:51:14.172 IST ] [ClusterConfig.submit:488] Entering submit, cmdCount=1
  347. [[email protected]] [main] [ 2018-10-24 18:51:14.172 IST ] [Semaphore.acquire:109] SyncBufferEmpty:Acquire called by thread main m_count=4
  348. [[email protected]] [main] [ 2018-10-24 18:51:14.173 IST ] [Semaphore.release:85] SyncBufferFull:Release called by thread main m_count=1
  349. [[email protected]] [main] [ 2018-10-24 18:51:14.173 IST ] [ClusterConfig.submit:523] submitted commands=1
  350. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.173 IST ] [Semaphore.release:85] SyncBufferEmpty:Release called by thread Worker 3 m_count=4
  351. [[email protected]] [main] [ 2018-10-24 18:51:14.173 IST ] [ClusterConfig.block:596] block called by thread main commandNum 1
  352. [[email protected]] [main] [ 2018-10-24 18:51:14.174 IST ] [Semaphore.acquire:109] ClientResource Constructor:Blocking Semaphore owned by main:Acquire called by thread main m_count=0
  353. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.174 IST ] [RuntimeExec.runCommand:75] Calling Runtime.exec() with the command
  354. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.174 IST ] [RuntimeExec.runCommand:77] /bin/ping
  355. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.175 IST ] [RuntimeExec.runCommand:77] -c
  356. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.175 IST ] [RuntimeExec.runCommand:77] 1
  357. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.175 IST ] [RuntimeExec.runCommand:77] -w
  358. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.176 IST ] [RuntimeExec.runCommand:77] 3
  359. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.176 IST ] [RuntimeExec.runCommand:77] rac-node2
  360. [[email protected]] [Thread-4] [ 2018-10-24 18:51:14.181 IST ] [StreamReader.run:61] In StreamReader.run
  361. [[email protected]] [Thread-5] [ 2018-10-24 18:51:14.181 IST ] [StreamReader.run:61] In StreamReader.run
  362. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.181 IST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
  363. [[email protected]] [Thread-4] [ 2018-10-24 18:51:14.186 IST ] [StreamReader.run:65] OUTPUT>PING rac-node2.lhrc.com (192.168.100.69) 56(84) bytes of data.
  364. [[email protected]] [Thread-4] [ 2018-10-24 18:51:14.186 IST ] [StreamReader.run:65] OUTPUT>64 bytes from rac-node2.lhrc.com (192.168.100.69): icmp_seq=1 ttl=64 time=0.231 ms
  365. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.186 IST ] [RuntimeExec.runCommand:144] runCommand: process returns 0
  366. [[email protected]] [Thread-4] [ 2018-10-24 18:51:14.187 IST ] [StreamReader.run:65] OUTPUT>
  367. [[email protected]] [Thread-4] [ 2018-10-24 18:51:14.187 IST ] [StreamReader.run:65] OUTPUT>--- rac-node2.lhrc.com ping statistics ---
  368. [[email protected]] [Thread-4] [ 2018-10-24 18:51:14.187 IST ] [StreamReader.run:65] OUTPUT>1 packets transmitted, 1 received, 0% packet loss, time 0ms
  369. [[email protected]] [Thread-4] [ 2018-10-24 18:51:14.188 IST ] [StreamReader.run:65] OUTPUT>rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms
  370. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.188 IST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
  371. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.188 IST ] [RuntimeExec.runCommand:164] PING rac-node2.lhrc.com (192.168.100.69) 56(84) bytes of data.
  372. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.189 IST ] [RuntimeExec.runCommand:164] 64 bytes from rac-node2.lhrc.com (192.168.100.69): icmp_seq=1 ttl=64 time=0.231 ms
  373. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.189 IST ] [RuntimeExec.runCommand:164]
  374. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.189 IST ] [RuntimeExec.runCommand:164] --- rac-node2.lhrc.com ping statistics ---
  375. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.190 IST ] [RuntimeExec.runCommand:164] 1 packets transmitted, 1 received, 0% packet loss, time 0ms
  376. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.190 IST ] [RuntimeExec.runCommand:164] rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms
  377. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.190 IST ] [RuntimeExec.runCommand:170] RunTimeExec: error>
  378. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.191 IST ] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
  379. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.191 IST ] [UnixSystem.isNodeAlive:4229] msgBuf=PING rac-node2.lhrc.com (192.168.100.69) 56(84) bytes of data.
  380. 64 bytes from rac-node2.lhrc.com (192.168.100.69): icmp_seq=1 ttl=64 time=0.231 ms
  381.  
  382. --- rac-node2.lhrc.com ping statistics ---
  383. 1 packets transmitted, 1 received, 0% packet loss, time 0ms
  384. rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms
  385.  
  386. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.193 IST ] [NodeLivenessCommand.postEvent:103] Inside NodeLivenessCommand.postEvent, listener size=0
  387. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.193 IST ] [ClusterConfig$ExecuteCommand.returnCommandToClient:2951] returnCommandToClient; fillCount=0 is full=false
  388. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.193 IST ] [Semaphore.acquire:109] SyncBufferEmpty:Acquire called by thread Worker 3 m_count=200
  389. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.194 IST ] [Semaphore.release:85] SyncBufferFull:Release called by thread Worker 3 m_count=1
  390. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.194 IST ] [ClientResource.getListener:157] Calling getListener
  391. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.194 IST ] [ClusterConfig$ExecuteCommand.run:3046] Owner Thread name of the blocking Semaphore main
  392. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.195 IST ] [ClusterConfig$ExecuteCommand.run:3054] Obtained Semaphore
  393. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.195 IST ] [Semaphore.release:85] ClientResource Constructor:Blocking Semaphore owned by main:Release called by thread Worker 3 m_count=1
  394. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.195 IST ] [ClusterConfig$ExecuteCommand.run:3069] Released Semaphore by worker=Worker 3
  395. [[email protected]] [main] [ 2018-10-24 18:51:14.195 IST ] [ClusterConfig.block:608] block acquired semnum=0
  396. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.196 IST ] [Semaphore.acquire:109] SyncBufferFull:Acquire called by thread Worker 3 m_count=0
  397. [[email protected]] [main] [ 2018-10-24 18:51:14.196 IST ] [ClusterConfig.submit:557] Out of block
  398. [[email protected]] [main] [ 2018-10-24 18:51:14.196 IST ] [ClusterConfig.submit:574] status=true
  399. [[email protected]] [main] [ 2018-10-24 18:51:14.196 IST ] [ClusterConfig.destroy:452] destroying resources for client thread Thread[main,5,main]
  400. [[email protected]] [main] [ 2018-10-24 18:51:14.197 IST ] [VerificationUtil.areNodesReachable:5150] VerificationUtil:: checkReachFromSrcNode() performed!!
  401. [[email protected]] [main] [ 2018-10-24 18:51:14.197 IST ] [VerificationUtil.areNodesReachable:5158] Node 'rac-node2' is reachable
  402. [[email protected]] [main] [ 2018-10-24 18:51:14.199 IST ] [ConfigUtil.isDefined:199] ==== Is CV_XCHK_FOR_SSH_ENABLED defined? : false
  403. [[email protected]] [main] [ 2018-10-24 18:51:14.199 IST ] [ConfigUtil.getConfiguredValue:181] ==== Fallback to env var 'CV_XCHK_FOR_SSH_ENABLED'=null
  404. [[email protected]] [main] [ 2018-10-24 18:51:14.200 IST ] [VerificationUtil.isLocalNodeOperation:6891] Returning saved value of: false
  405. [[email protected]] [main] [ 2018-10-24 18:51:14.200 IST ] [NativeResult.<init>:91] NativeResult: The String obtained is0
  406. [[email protected]] [main] [ 2018-10-24 18:51:14.200 IST ] [NativeResult.<init>:99] The status string is: 0
  407. [[email protected]] [main] [ 2018-10-24 18:51:14.201 IST ] [RemoteExecCommand.<init>:479] End of constructor call (called by many other constructors internally): RemoteExecCommand(String cmd, String[] args, String[] env, String node, boolean localExecution, String[] cmdFiles, String srcLoc, String destLoc, boolean chkException
  408. [[email protected]] [main] [ 2018-10-24 18:51:14.201 IST ] [RemoteExecCommand.<init>:358] End of constructor call: RemoteExecCommand(String cmd, String[] args, String[] env, String node, boolean localExecution, String[] cmdFiles, String srcLoc, String destLoc
  409. [[email protected]] [main] [ 2018-10-24 18:51:14.202 IST ] [RemoteExecCommand.setSubDirAndGroup:1484] Calling setSubDirAndGroup(String subDir, String group) with 'subDir ='CVU_11.2.0.4.0_grid' and 'group = 'null
  410. [[email protected]] [main] [ 2018-10-24 18:51:14.202 IST ] [VerificationUtil.getLocalHost:854] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  411. [[email protected]] [main] [ 2018-10-24 18:51:14.203 IST ] [VerificationUtil.isLocalNode:7023]
  412. Comparing 'rac-node2' to localHOST 'rac-node1'
  413. [[email protected]] [main] [ 2018-10-24 18:51:14.203 IST ] [VerificationUtil.sameHost:7109] VerificationUtil::sameHost() Host:rac-node2 and Host: rac-node1 are not same.
  414. [[email protected]] [main] [ 2018-10-24 18:51:14.203 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  415. [[email protected]] [main] [ 2018-10-24 18:51:14.204 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  416. [[email protected]] [main] [ 2018-10-24 18:51:14.204 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  417. [[email protected]] [main] [ 2018-10-24 18:51:14.205 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  418. [[email protected]] [main] [ 2018-10-24 18:51:14.205 IST ] [VerificationUtil.isLocalNode:7078] Returning: false
  419. [[email protected]] [main] [ 2018-10-24 18:51:14.206 IST ] [ClusterConfig.isClusterInstalled:363] hasJarPresent=false
  420. [[email protected]] [main] [ 2018-10-24 18:51:14.206 IST ] [ClusterConfig.init:423] Returning same instance to clientmain
  421. [[email protected]] [main] [ 2018-10-24 18:51:14.207 IST ] [ClusterConfig.submit:488] Entering submit, cmdCount=1
  422. [[email protected]] [main] [ 2018-10-24 18:51:14.207 IST ] [Semaphore.acquire:109] SyncBufferEmpty:Acquire called by thread main m_count=4
  423. [[email protected]] [main] [ 2018-10-24 18:51:14.208 IST ] [Semaphore.release:85] SyncBufferFull:Release called by thread main m_count=1
  424. [[email protected]] [main] [ 2018-10-24 18:51:14.208 IST ] [ClusterConfig.submit:523] submitted commands=1
  425. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.208 IST ] [Semaphore.release:85] SyncBufferEmpty:Release called by thread Worker 2 m_count=4
  426. [[email protected]] [main] [ 2018-10-24 18:51:14.209 IST ] [ClusterConfig.block:596] block called by thread main commandNum 1
  427. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.209 IST ] [CheckUserEquivCommand.execute:88] CheckUserEquivCommand:: Inside execute() [Thread:Worker 2]
  428. [[email protected]] [main] [ 2018-10-24 18:51:14.209 IST ] [Semaphore.acquire:109] ClientResource Constructor:Blocking Semaphore owned by main:Acquire called by thread main m_count=0
  429. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.209 IST ] [UnixSystem.isNodeAccessible:1015] Checking accessibility of node: rac-node2
  430. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.210 IST ] [UnixSystem.checkRemoteExecutionSetup:2185] checkRemoteExecutionSetup:: Checking user equivalence using Secured Shell '/usr/bin/ssh'
  431. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.210 IST ] [UnixSystem.checkRemoteExecutionSetup:2187] checkRemoteExecutionSetup:: Running Unix command: /usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o NumberOfPasswordPrompts=0 rac-node2 /bin/true
  432. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.211 IST ] [RuntimeExec.runCommand:75] Calling Runtime.exec() with the command
  433. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.211 IST ] [RuntimeExec.runCommand:77] /usr/bin/ssh
  434. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.211 IST ] [RuntimeExec.runCommand:77] -o
  435. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.212 IST ] [RuntimeExec.runCommand:77] FallBackToRsh=no
  436. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.212 IST ] [RuntimeExec.runCommand:77] -o
  437. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.212 IST ] [RuntimeExec.runCommand:77] PasswordAuthentication=no
  438. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.213 IST ] [RuntimeExec.runCommand:77] -o
  439. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.213 IST ] [RuntimeExec.runCommand:77] StrictHostKeyChecking=yes
  440. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.213 IST ] [RuntimeExec.runCommand:77] -o
  441. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.214 IST ] [RuntimeExec.runCommand:77] NumberOfPasswordPrompts=0
  442. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.214 IST ] [RuntimeExec.runCommand:77] rac-node2
  443. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.214 IST ] [RuntimeExec.runCommand:77] /bin/true
  444. [[email protected]] [Thread-6] [ 2018-10-24 18:51:14.219 IST ] [StreamReader.run:61] In StreamReader.run
  445. [[email protected]] [Thread-7] [ 2018-10-24 18:51:14.219 IST ] [StreamReader.run:61] In StreamReader.run
  446. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.219 IST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
  447. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.331 IST ] [RuntimeExec.runCommand:144] runCommand: process returns 0
  448. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.332 IST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
  449. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.333 IST ] [RuntimeExec.runCommand:170] RunTimeExec: error>
  450. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.333 IST ] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
  451. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.334 IST ] [UnixSystem.checkRemoteExecutionSetup:2293] Using Remote Shell Command: '/usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o NumberOfPasswordPrompts=0 '
  452. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.334 IST ] [UnixSystem.checkRemoteExecutionSetup:2294] Using Remote Copy Command: '/usr/bin/scp'
  453. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.334 IST ] [UnixSystem.isNodeAccessible:1021] isNodeAccessible:: Running Unix command: /usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o NumberOfPasswordPrompts=0 rac-node2 -n /bin/true
  454. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.335 IST ] [RuntimeExec.runCommand:75] Calling Runtime.exec() with the command
  455. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.335 IST ] [RuntimeExec.runCommand:77] /usr/bin/ssh
  456. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.335 IST ] [RuntimeExec.runCommand:77] -o
  457. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.336 IST ] [RuntimeExec.runCommand:77] FallBackToRsh=no
  458. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.336 IST ] [RuntimeExec.runCommand:77] -o
  459. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.336 IST ] [RuntimeExec.runCommand:77] PasswordAuthentication=no
  460. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.337 IST ] [RuntimeExec.runCommand:77] -o
  461. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.337 IST ] [RuntimeExec.runCommand:77] StrictHostKeyChecking=yes
  462. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.337 IST ] [RuntimeExec.runCommand:77] -o
  463. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.338 IST ] [RuntimeExec.runCommand:77] NumberOfPasswordPrompts=0
  464. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.338 IST ] [RuntimeExec.runCommand:77] rac-node2
  465. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.338 IST ] [RuntimeExec.runCommand:77] -n
  466. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.339 IST ] [RuntimeExec.runCommand:77] /bin/true
  467. [[email protected]] [Thread-8] [ 2018-10-24 18:51:14.343 IST ] [StreamReader.run:61] In StreamReader.run
  468. [[email protected]] [Thread-9] [ 2018-10-24 18:51:14.343 IST ] [StreamReader.run:61] In StreamReader.run
  469. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.343 IST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
  470. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.453 IST ] [RuntimeExec.runCommand:144] runCommand: process returns 0
  471. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.454 IST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
  472. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.454 IST ] [RuntimeExec.runCommand:170] RunTimeExec: error>
  473. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.455 IST ] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
  474. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.455 IST ] [NativeResult.<init>:91] NativeResult: The String obtained is1|
  475. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.456 IST ] [NativeResult.<init>:99] The status string is: 1
  476. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.456 IST ] [CheckUserEquivCommand.execute:115] The user equivalence on node rac-node2 is TRUE
  477. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.456 IST ] [CheckUserEquivCommand.execute:129] ==== XCHK for SSH disabled.
  478. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.457 IST ] [ClusterConfig$ExecuteCommand.returnCommandToClient:2951] returnCommandToClient; fillCount=0 is full=false
  479. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.457 IST ] [Semaphore.acquire:109] SyncBufferEmpty:Acquire called by thread Worker 2 m_count=200
  480. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.457 IST ] [Semaphore.release:85] SyncBufferFull:Release called by thread Worker 2 m_count=1
  481. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.458 IST ] [ClientResource.getListener:157] Calling getListener
  482. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.458 IST ] [ClusterConfig$ExecuteCommand.run:3046] Owner Thread name of the blocking Semaphore main
  483. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.458 IST ] [ClusterConfig$ExecuteCommand.run:3054] Obtained Semaphore
  484. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.459 IST ] [Semaphore.release:85] ClientResource Constructor:Blocking Semaphore owned by main:Release called by thread Worker 2 m_count=1
  485. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.459 IST ] [ClusterConfig$ExecuteCommand.run:3069] Released Semaphore by worker=Worker 2
  486. [[email protected]] [main] [ 2018-10-24 18:51:14.459 IST ] [ClusterConfig.block:608] block acquired semnum=0
  487. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.459 IST ] [Semaphore.acquire:109] SyncBufferFull:Acquire called by thread Worker 2 m_count=0
  488. [[email protected]] [main] [ 2018-10-24 18:51:14.460 IST ] [ClusterConfig.submit:557] Out of block
  489. [[email protected]] [main] [ 2018-10-24 18:51:14.460 IST ] [ClusterConfig.submit:574] status=true
  490. [[email protected]] [main] [ 2018-10-24 18:51:14.460 IST ] [ClusterConfig.destroy:452] destroying resources for client thread Thread[main,5,main]
  491. [[email protected]] [main] [ 2018-10-24 18:51:14.461 IST ] [GlobalExecution.checkUserEquiv:293] --------- Execution Trace for CheckUserEquivCommand from node: rac-node2 ------------
  492. [[email protected]] [main] [ 2018-10-24 18:51:14.461 IST ] [GlobalExecution.checkUserEquiv:298] CheckUserEquivCommand::Inside execute() Worker 2
  493. [[email protected]] [main] [ 2018-10-24 18:51:14.461 IST ] [GlobalExecution.checkUserEquiv:298] The user equivalence on node rac-node2 is true
  494. [[email protected]] [main] [ 2018-10-24 18:51:14.462 IST ] [GlobalExecution.checkUserEquiv:310] User Equivalence exists on node: rac-node2
  495. [[email protected]] [main] [ 2018-10-24 18:51:14.462 IST ] [VerificationUtil.isUserEquivalence:4902] VerificationUtil:: checkUserEquiv() performed!!
  496. [[email protected]] [main] [ 2018-10-24 18:51:14.462 IST ] [VerificationUtil.isUserEquivalence:4914] User Equivalence exists on on node: rac-node2
  497. [[email protected]] [main] [ 2018-10-24 18:51:14.463 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  498. [[email protected]] [main] [ 2018-10-24 18:51:14.463 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  499. [[email protected]] [main] [ 2018-10-24 18:51:14.463 IST ] [VerificationUtil.checkDestLoc:3824] destloc is--->/tmp/
  500. [[email protected]] [main] [ 2018-10-24 18:51:14.464 IST ] [VerificationUtil.checkDestLoc:3825] subDirPath is--->/tmp/CVU_11.2.0.4.0_grid/
  501. [[email protected]] [main] [ 2018-10-24 18:51:14.465 IST ] [ClusterConfig.isClusterInstalled:363] hasJarPresent=false
  502. [[email protected]] [main] [ 2018-10-24 18:51:14.465 IST ] [ClusterConfig.init:423] Returning same instance to clientmain
  503. [[email protected]] [main] [ 2018-10-24 18:51:14.465 IST ] [ClusterConfig.createDirInNode:1694] Creating dir in nodes: rac-node2, /tmp/CVU_11.2.0.4.0_grid/, true, null
  504. [[email protected]] [main] [ 2018-10-24 18:51:14.466 IST ] [Semaphore.acquire:109] SyncBufferEmpty:Acquire called by thread main m_count=4
  505. [[email protected]] [main] [ 2018-10-24 18:51:14.467 IST ] [Semaphore.release:85] SyncBufferFull:Release called by thread main m_count=1
  506. [[email protected]] [main] [ 2018-10-24 18:51:14.467 IST ] [ClusterConfig.block:596] block called by thread main commandNum 1
  507. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.467 IST ] [Semaphore.release:85] SyncBufferEmpty:Release called by thread Worker 0 m_count=4
  508. [[email protected]] [main] [ 2018-10-24 18:51:14.467 IST ] [Semaphore.acquire:109] ClientResource Constructor:Blocking Semaphore owned by main:Acquire called by thread main m_count=0
  509. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.468 IST ] [DirCreateCommand.execute:67] In DirCreateCommand.execute, recurseFlag=false, modeFlag=true
  510. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.468 IST ] [RuntimeExec.runCommand:75] Calling Runtime.exec() with the command
  511. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.469 IST ] [RuntimeExec.runCommand:77] /bin/sh
  512. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.475 IST ] [RuntimeExec.runCommand:112] runCommand: input length=1
  513. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.476 IST ] [RuntimeExec.runCommand:120] runCommand: closed input for process
  514. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.476 IST ] [RuntimeExec.runCommand:126] runCommand: submitted input
  515. [[email protected]] [Thread-11] [ 2018-10-24 18:51:14.477 IST ] [StreamReader.run:61] In StreamReader.run
  516. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.477 IST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
  517. [[email protected]] [Thread-10] [ 2018-10-24 18:51:14.477 IST ] [StreamReader.run:61] In StreamReader.run
  518. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.478 IST ] [RuntimeExec.runCommand:144] runCommand: process returns 0
  519. [[email protected]] [Thread-10] [ 2018-10-24 18:51:14.478 IST ] [StreamReader.run:65] OUTPUT>u=rwx,g=rx,o=rx
  520. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.478 IST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
  521. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.479 IST ] [RuntimeExec.runCommand:164] u=rwx,g=rx,o=rx
  522. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.479 IST ] [RuntimeExec.runCommand:170] RunTimeExec: error>
  523. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.479 IST ] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
  524. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.480 IST ] [Utils.getLocalHost:481] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  525. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.481 IST ] [RuntimeExec.runCommand:75] Calling Runtime.exec() with the command
  526. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.481 IST ] [RuntimeExec.runCommand:77] /usr/bin/ssh
  527. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.481 IST ] [RuntimeExec.runCommand:77] -o
  528. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.482 IST ] [RuntimeExec.runCommand:77] FallBackToRsh=no
  529. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.482 IST ] [RuntimeExec.runCommand:77] -o
  530. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.482 IST ] [RuntimeExec.runCommand:77] PasswordAuthentication=no
  531. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.483 IST ] [RuntimeExec.runCommand:77] -o
  532. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.483 IST ] [RuntimeExec.runCommand:77] StrictHostKeyChecking=yes
  533. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.484 IST ] [RuntimeExec.runCommand:77] -o
  534. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.484 IST ] [RuntimeExec.runCommand:77] NumberOfPasswordPrompts=0
  535. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.484 IST ] [RuntimeExec.runCommand:77] rac-node2
  536. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.485 IST ] [RuntimeExec.runCommand:77] -n
  537. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.485 IST ] [RuntimeExec.runCommand:77] /bin/mkdir
  538. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.485 IST ] [RuntimeExec.runCommand:77] -p
  539. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.486 IST ] [RuntimeExec.runCommand:77] -m
  540. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.486 IST ] [RuntimeExec.runCommand:77] u=rwx,g=rx,o=rx
  541. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.486 IST ] [RuntimeExec.runCommand:77] /tmp/CVU_11.2.0.4.0_grid/
  542. [[email protected]] [Thread-13] [ 2018-10-24 18:51:14.492 IST ] [StreamReader.run:61] In StreamReader.run
  543. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.492 IST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
  544. [[email protected]] [Thread-12] [ 2018-10-24 18:51:14.492 IST ] [StreamReader.run:61] In StreamReader.run
  545. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.600 IST ] [RuntimeExec.runCommand:144] runCommand: process returns 0
  546. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.600 IST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
  547. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.601 IST ] [RuntimeExec.runCommand:170] RunTimeExec: error>
  548. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.602 IST ] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
  549. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.602 IST ] [NativeSystem.isCmdScv:502] isCmdScv: cmd=[/usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o NumberOfPasswordPrompts=0 rac-node2 -n /bin/mkdir -p -m u=rwx,g=rx,o=rx /tmp/CVU_11.2.0.4.0_grid/]
  550. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.603 IST ] [NativeSystem.isCmdScv:552] isCmdScv: /usr/bin/ssh is present.
  551. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.604 IST ] [NativeSystem.isCmdScv:554] isCmdScv: /usr/bin/ssh is a file.
  552. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.604 IST ] [NativeSystem.isCmdScv:571] isCmdScv: returned true
  553. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.605 IST ] [NativeSystem.rununixcmd:1152] NativeSystem.rununixcmd: RetString 1| :successful
  554. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.606 IST ] [NativeResult.<init>:91] NativeResult: The String obtained is1| :successful
  555. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.606 IST ] [NativeResult.<init>:99] The status string is: 1
  556. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.606 IST ] [NativeResult.<init>:112] The result string is: :successful 1
  557. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.607 IST ] [ClusterConfig$ExecuteCommand.returnCommandToClient:2951] returnCommandToClient; fillCount=0 is full=false
  558. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.607 IST ] [Semaphore.acquire:109] SyncBufferEmpty:Acquire called by thread Worker 0 m_count=200
  559. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.607 IST ] [Semaphore.release:85] SyncBufferFull:Release called by thread Worker 0 m_count=1
  560. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.607 IST ] [ClientResource.getListener:157] Calling getListener
  561. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.608 IST ] [ClusterConfig$ExecuteCommand.run:3046] Owner Thread name of the blocking Semaphore main
  562. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.608 IST ] [ClusterConfig$ExecuteCommand.run:3054] Obtained Semaphore
  563. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.608 IST ] [Semaphore.release:85] ClientResource Constructor:Blocking Semaphore owned by main:Release called by thread Worker 0 m_count=1
  564. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.609 IST ] [ClusterConfig$ExecuteCommand.run:3069] Released Semaphore by worker=Worker 0
  565. [[email protected]] [main] [ 2018-10-24 18:51:14.609 IST ] [ClusterConfig.block:608] block acquired semnum=0
  566. [[email protected]] [Worker 0] [ 2018-10-24 18:51:14.609 IST ] [Semaphore.acquire:109] SyncBufferFull:Acquire called by thread Worker 0 m_count=0
  567. [[email protected]] [main] [ 2018-10-24 18:51:14.609 IST ] [ClusterConfig.destroy:452] destroying resources for client thread Thread[main,5,main]
  568. [[email protected]] [main] [ 2018-10-24 18:51:14.610 IST ] [VerificationUtil.isLocalNodeOperation:6891] Returning saved value of: false
  569. [[email protected]] [main] [ 2018-10-24 18:51:14.612 IST ] [ClusterConfig.isClusterInstalled:363] hasJarPresent=false
  570. [[email protected]] [main] [ 2018-10-24 18:51:14.612 IST ] [ClusterConfig.init:423] Returning same instance to clientmain
  571. [[email protected]] [main] [ 2018-10-24 18:51:14.613 IST ] [ClusterConfig.submit:488] Entering submit, cmdCount=1
  572. [[email protected]] [main] [ 2018-10-24 18:51:14.613 IST ] [Semaphore.acquire:109] SyncBufferEmpty:Acquire called by thread main m_count=4
  573. [[email protected]] [main] [ 2018-10-24 18:51:14.614 IST ] [Semaphore.release:85] SyncBufferFull:Release called by thread main m_count=1
  574. [[email protected]] [main] [ 2018-10-24 18:51:14.614 IST ] [ClusterConfig.submit:523] submitted commands=1
  575. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.615 IST ] [Semaphore.release:85] SyncBufferEmpty:Release called by thread Worker 1 m_count=4
  576. [[email protected]] [main] [ 2018-10-24 18:51:14.615 IST ] [ClusterConfig.block:596] block called by thread main commandNum 1
  577. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.616 IST ] [Utils.getLocalHost:481] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  578. [[email protected]] [main] [ 2018-10-24 18:51:14.616 IST ] [Semaphore.acquire:109] ClientResource Constructor:Blocking Semaphore owned by main:Acquire called by thread main m_count=0
  579. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.616 IST ] [UnixSystem.pathExists:973] unixcmd=/usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o NumberOfPasswordPrompts=0 rac-node2 -n /bin/sh -c "if [ -d /tmp -a -w /tmp ] ; then echo exists; fi"
  580. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.616 IST ] [RuntimeExec.runCommand:75] Calling Runtime.exec() with the command
  581. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.617 IST ] [RuntimeExec.runCommand:77] /usr/bin/ssh
  582. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.617 IST ] [RuntimeExec.runCommand:77] -o
  583. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.617 IST ] [RuntimeExec.runCommand:77] FallBackToRsh=no
  584. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.617 IST ] [RuntimeExec.runCommand:77] -o
  585. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.618 IST ] [RuntimeExec.runCommand:77] PasswordAuthentication=no
  586. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.618 IST ] [RuntimeExec.runCommand:77] -o
  587. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.618 IST ] [RuntimeExec.runCommand:77] StrictHostKeyChecking=yes
  588. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.619 IST ] [RuntimeExec.runCommand:77] -o
  589. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.619 IST ] [RuntimeExec.runCommand:77] NumberOfPasswordPrompts=0
  590. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.619 IST ] [RuntimeExec.runCommand:77] rac-node2
  591. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.620 IST ] [RuntimeExec.runCommand:77] -n
  592. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.620 IST ] [RuntimeExec.runCommand:77] /bin/sh
  593. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.620 IST ] [RuntimeExec.runCommand:77] -c
  594. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.620 IST ] [RuntimeExec.runCommand:77] "if
  595. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.621 IST ] [RuntimeExec.runCommand:77] [
  596. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.621 IST ] [RuntimeExec.runCommand:77] -d
  597. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.621 IST ] [RuntimeExec.runCommand:77] /tmp
  598. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.622 IST ] [RuntimeExec.runCommand:77] -a
  599. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.622 IST ] [RuntimeExec.runCommand:77] -w
  600. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.622 IST ] [RuntimeExec.runCommand:77] /tmp
  601. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.622 IST ] [RuntimeExec.runCommand:77] ]
  602. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.623 IST ] [RuntimeExec.runCommand:77] ;
  603. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.623 IST ] [RuntimeExec.runCommand:77] then
  604. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.623 IST ] [RuntimeExec.runCommand:77] echo
  605. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.624 IST ] [RuntimeExec.runCommand:77] exists;
  606. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.624 IST ] [RuntimeExec.runCommand:77] fi"
  607. [[email protected]] [Thread-15] [ 2018-10-24 18:51:14.629 IST ] [StreamReader.run:61] In StreamReader.run
  608. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.629 IST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
  609. [[email protected]] [Thread-14] [ 2018-10-24 18:51:14.629 IST ] [StreamReader.run:61] In StreamReader.run
  610. [[email protected]] [Thread-14] [ 2018-10-24 18:51:14.745 IST ] [StreamReader.run:65] OUTPUT>exists
  611. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.746 IST ] [RuntimeExec.runCommand:144] runCommand: process returns 0
  612. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.747 IST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
  613. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.747 IST ] [RuntimeExec.runCommand:164] exists
  614. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.748 IST ] [RuntimeExec.runCommand:170] RunTimeExec: error>
  615. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.748 IST ] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
  616. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.749 IST ] [UnixSystem.pathExists:976] pathExists..RuntimeExec returned 0
  617. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.749 IST ] [NativeSystem.isCmdScv:502] isCmdScv: cmd=[/usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o NumberOfPasswordPrompts=0 rac-node2 -n /bin/sh -c "if [ -d /tmp -a -w /tmp ] ; then echo exists; fi"]
  618. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.750 IST ] [NativeSystem.isCmdScv:552] isCmdScv: /usr/bin/ssh is present.
  619. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.751 IST ] [NativeSystem.isCmdScv:554] isCmdScv: /usr/bin/ssh is a file.
  620. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.751 IST ] [NativeSystem.isCmdScv:571] isCmdScv: returned true
  621. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.752 IST ] [UnixSystem.pathExists:998] erroutString is :exists
  622. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.752 IST ] [ClusterConfig$ExecuteCommand.returnCommandToClient:2951] returnCommandToClient; fillCount=0 is full=false
  623. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.753 IST ] [Semaphore.acquire:109] SyncBufferEmpty:Acquire called by thread Worker 1 m_count=200
  624. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.753 IST ] [Semaphore.release:85] SyncBufferFull:Release called by thread Worker 1 m_count=1
  625. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.754 IST ] [ClientResource.getListener:157] Calling getListener
  626. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.754 IST ] [ClusterConfig$ExecuteCommand.run:3046] Owner Thread name of the blocking Semaphore main
  627. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.755 IST ] [ClusterConfig$ExecuteCommand.run:3054] Obtained Semaphore
  628. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.755 IST ] [Semaphore.release:85] ClientResource Constructor:Blocking Semaphore owned by main:Release called by thread Worker 1 m_count=1
  629. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.756 IST ] [ClusterConfig$ExecuteCommand.run:3069] Released Semaphore by worker=Worker 1
  630. [[email protected]] [main] [ 2018-10-24 18:51:14.756 IST ] [ClusterConfig.block:608] block acquired semnum=0
  631. [[email protected]] [Worker 1] [ 2018-10-24 18:51:14.756 IST ] [Semaphore.acquire:109] SyncBufferFull:Acquire called by thread Worker 1 m_count=0
  632. [[email protected]] [main] [ 2018-10-24 18:51:14.756 IST ] [ClusterConfig.submit:557] Out of block
  633. [[email protected]] [main] [ 2018-10-24 18:51:14.757 IST ] [ClusterConfig.submit:574] status=true
  634. [[email protected]] [main] [ 2018-10-24 18:51:14.757 IST ] [ClusterConfig.destroy:452] destroying resources for client thread Thread[main,5,main]
  635. [[email protected]] [main] [ 2018-10-24 18:51:14.757 IST ] [VerificationUtil.isLocalNodeOperation:6891] Returning saved value of: false
  636. [[email protected]] [main] [ 2018-10-24 18:51:14.758 IST ] [ClusterConfig.isClusterInstalled:363] hasJarPresent=false
  637. [[email protected]] [main] [ 2018-10-24 18:51:14.758 IST ] [ClusterConfig.init:423] Returning same instance to clientmain
  638. [[email protected]] [main] [ 2018-10-24 18:51:14.759 IST ] [ClusterConfig.submit:488] Entering submit, cmdCount=1
  639. [[email protected]] [main] [ 2018-10-24 18:51:14.759 IST ] [Semaphore.acquire:109] SyncBufferEmpty:Acquire called by thread main m_count=4
  640. [[email protected]] [main] [ 2018-10-24 18:51:14.759 IST ] [Semaphore.release:85] SyncBufferFull:Release called by thread main m_count=1
  641. [[email protected]] [main] [ 2018-10-24 18:51:14.760 IST ] [ClusterConfig.submit:523] submitted commands=1
  642. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.760 IST ] [Semaphore.release:85] SyncBufferEmpty:Release called by thread Worker 3 m_count=4
  643. [[email protected]] [main] [ 2018-10-24 18:51:14.760 IST ] [ClusterConfig.block:596] block called by thread main commandNum 1
  644. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.761 IST ] [Utils.getLocalHost:481] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  645. [[email protected]] [main] [ 2018-10-24 18:51:14.761 IST ] [Semaphore.acquire:109] ClientResource Constructor:Blocking Semaphore owned by main:Acquire called by thread main m_count=0
  646. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.762 IST ] [UnixSystem.pathExists:973] unixcmd=/usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o NumberOfPasswordPrompts=0 rac-node2 -n /bin/sh -c "if [ -d /tmp/CVU_11.2.0.4.0_grid -a -w /tmp/CVU_11.2.0.4.0_grid ] ; then echo exists; fi"
  647. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.762 IST ] [RuntimeExec.runCommand:75] Calling Runtime.exec() with the command
  648. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.763 IST ] [RuntimeExec.runCommand:77] /usr/bin/ssh
  649. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.763 IST ] [RuntimeExec.runCommand:77] -o
  650. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.764 IST ] [RuntimeExec.runCommand:77] FallBackToRsh=no
  651. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.764 IST ] [RuntimeExec.runCommand:77] -o
  652. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.765 IST ] [RuntimeExec.runCommand:77] PasswordAuthentication=no
  653. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.765 IST ] [RuntimeExec.runCommand:77] -o
  654. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.766 IST ] [RuntimeExec.runCommand:77] StrictHostKeyChecking=yes
  655. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.766 IST ] [RuntimeExec.runCommand:77] -o
  656. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.766 IST ] [RuntimeExec.runCommand:77] NumberOfPasswordPrompts=0
  657. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.767 IST ] [RuntimeExec.runCommand:77] rac-node2
  658. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.767 IST ] [RuntimeExec.runCommand:77] -n
  659. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.767 IST ] [RuntimeExec.runCommand:77] /bin/sh
  660. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.767 IST ] [RuntimeExec.runCommand:77] -c
  661. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.768 IST ] [RuntimeExec.runCommand:77] "if
  662. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.768 IST ] [RuntimeExec.runCommand:77] [
  663. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.768 IST ] [RuntimeExec.runCommand:77] -d
  664. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.769 IST ] [RuntimeExec.runCommand:77] /tmp/CVU_11.2.0.4.0_grid
  665. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.769 IST ] [RuntimeExec.runCommand:77] -a
  666. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.769 IST ] [RuntimeExec.runCommand:77] -w
  667. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.770 IST ] [RuntimeExec.runCommand:77] /tmp/CVU_11.2.0.4.0_grid
  668. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.770 IST ] [RuntimeExec.runCommand:77] ]
  669. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.770 IST ] [RuntimeExec.runCommand:77] ;
  670. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.771 IST ] [RuntimeExec.runCommand:77] then
  671. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.771 IST ] [RuntimeExec.runCommand:77] echo
  672. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.771 IST ] [RuntimeExec.runCommand:77] exists;
  673. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.771 IST ] [RuntimeExec.runCommand:77] fi"
  674. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.777 IST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
  675. [[email protected]] [Thread-16] [ 2018-10-24 18:51:14.777 IST ] [StreamReader.run:61] In StreamReader.run
  676. [[email protected]] [Thread-17] [ 2018-10-24 18:51:14.777 IST ] [StreamReader.run:61] In StreamReader.run
  677. [[email protected]] [Thread-16] [ 2018-10-24 18:51:14.893 IST ] [StreamReader.run:65] OUTPUT>exists
  678. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.894 IST ] [RuntimeExec.runCommand:144] runCommand: process returns 0
  679. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.894 IST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
  680. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.895 IST ] [RuntimeExec.runCommand:164] exists
  681. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.895 IST ] [RuntimeExec.runCommand:170] RunTimeExec: error>
  682. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.896 IST ] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
  683. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.896 IST ] [UnixSystem.pathExists:976] pathExists..RuntimeExec returned 0
  684. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.897 IST ] [NativeSystem.isCmdScv:502] isCmdScv: cmd=[/usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o NumberOfPasswordPrompts=0 rac-node2 -n /bin/sh -c "if [ -d /tmp/CVU_11.2.0.4.0_grid -a -w /tmp/CVU_11.2.0.4.0_grid ] ; then echo exists; fi"]
  685. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.898 IST ] [NativeSystem.isCmdScv:552] isCmdScv: /usr/bin/ssh is present.
  686. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.898 IST ] [NativeSystem.isCmdScv:554] isCmdScv: /usr/bin/ssh is a file.
  687. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.899 IST ] [NativeSystem.isCmdScv:571] isCmdScv: returned true
  688. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.899 IST ] [UnixSystem.pathExists:998] erroutString is :exists
  689. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.900 IST ] [ClusterConfig$ExecuteCommand.returnCommandToClient:2951] returnCommandToClient; fillCount=0 is full=false
  690. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.900 IST ] [Semaphore.acquire:109] SyncBufferEmpty:Acquire called by thread Worker 3 m_count=200
  691. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.901 IST ] [Semaphore.release:85] SyncBufferFull:Release called by thread Worker 3 m_count=1
  692. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.901 IST ] [ClientResource.getListener:157] Calling getListener
  693. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.902 IST ] [ClusterConfig$ExecuteCommand.run:3046] Owner Thread name of the blocking Semaphore main
  694. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.902 IST ] [ClusterConfig$ExecuteCommand.run:3054] Obtained Semaphore
  695. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.903 IST ] [Semaphore.release:85] ClientResource Constructor:Blocking Semaphore owned by main:Release called by thread Worker 3 m_count=1
  696. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.903 IST ] [ClusterConfig$ExecuteCommand.run:3069] Released Semaphore by worker=Worker 3
  697. [[email protected]] [main] [ 2018-10-24 18:51:14.903 IST ] [ClusterConfig.block:608] block acquired semnum=0
  698. [[email protected]] [Worker 3] [ 2018-10-24 18:51:14.904 IST ] [Semaphore.acquire:109] SyncBufferFull:Acquire called by thread Worker 3 m_count=0
  699. [[email protected]] [main] [ 2018-10-24 18:51:14.904 IST ] [ClusterConfig.submit:557] Out of block
  700. [[email protected]] [main] [ 2018-10-24 18:51:14.904 IST ] [ClusterConfig.submit:574] status=true
  701. [[email protected]] [main] [ 2018-10-24 18:51:14.905 IST ] [ClusterConfig.destroy:452] destroying resources for client thread Thread[main,5,main]
  702. [[email protected]] [main] [ 2018-10-24 18:51:14.906 IST ] [GlobalExecution.getExectaskVer:668] GlobalExecution: inside getExectaskVer...
  703. [[email protected]] [main] [ 2018-10-24 18:51:14.908 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  704. [[email protected]] [main] [ 2018-10-24 18:51:14.908 IST ] [VDMUtil.getCmd4RemExec:123] ==== getCmd4RemExec() called...
  705. [[email protected]] [main] [ 2018-10-24 18:51:14.909 IST ] [VDMUtil.getCmd4RemExec:130] ==== PROP_REM_COMMAND = 'exectask.sh'
  706. [[email protected]] [main] [ 2018-10-24 18:51:14.909 IST ] [VerificationUtil.getCmd4RemExec:2830] ==== Remote Exec name: exectask.sh
  707. [[email protected]] [main] [ 2018-10-24 18:51:14.910 IST ] [VerificationUtil.isLocalNodeOperation:6891] Returning saved value of: false
  708. [[email protected]] [main] [ 2018-10-24 18:51:14.910 IST ] [VDMUtil.getCmdFiles4RemExec:145] ==== getCmdFiles4RemExec() called...
  709. [[email protected]] [main] [ 2018-10-24 18:51:14.911 IST ] [VDMUtil.getCmdFiles4RemExec:150] ==== PROP_REM_CDMFILES = 'cv/remenv/runfixup.sh,cv/remenv/orarun.sh,cv/remenv/cvuqdisk-1.0.9-1.rpm,cv/remenv/exectask.sh,cv/remenv/exectask,cv/remenv/pluggable'
  710. [[email protected]] [main] [ 2018-10-24 18:51:14.912 IST ] [VerificationUtil.listRecursiveFiles:1071] InputList=cv/remenv/runfixup.sh,cv/remenv/orarun.sh,cv/remenv/cvuqdisk-1.0.9-1.rpm,cv/remenv/exectask.sh,cv/remenv/exectask,cv/remenv/pluggable
  711. [[email protected]] [main] [ 2018-10-24 18:51:14.920 IST ] [VerificationUtil.listRecursiveFiles:1128] OutputList=cv/remenv/runfixup.sh,cv/remenv/orarun.sh,cv/remenv/cvuqdisk-1.0.9-1.rpm,cv/remenv/exectask.sh,cv/remenv/exectask,cv/remenv/pluggable/unix/checkramfs.sh,cv/remenv/pluggable/unix/check_default_gateway.sh,cv/remenv/pluggable/unix/checksyslog.sh,cv/remenv/pluggable/unix/ora_00600_errors_analyzer.sh,cv/remenv/pluggable/unix/shutdown_hwclock_sync.sh,cv/remenv/pluggable/unix/check_jumbo_frames.sh,cv/remenv/pluggable/unix/ora_07445_errors_analyzer.sh,cv/remenv/pluggable/unix/css_reboot_time.sh,cv/remenv/pluggable/unix/css_disk_timeout.sh,cv/remenv/pluggable/unix/check_tcp_packet_retransmit.sh,cv/remenv/pluggable/unix/checksshd.sh,cv/remenv/pluggable/unix/css_diagwait.sh,cv/remenv/pluggable/unix/css_misscount.sh,cv/remenv/pluggable/unix/check_vip_restart_attempt.sh,cv/remenv/pluggable/unix/check_network_packet_reassembly.sh,cv/remenv/pluggable/unix/hangcheck_margin.sh,cv/remenv/pluggable/unix/common_include.sh,cv/remenv/pluggable/unix/listener_naming_convention.sh,cv/remenv/pluggable/unix/check_disk_asynch_io_linking.sh,cv/remenv/pluggable/unix/checkportavail.sh,cv/remenv/pluggable/unix/check_vmm.sh,cv/remenv/pluggable/unix/bdump_dest_trace_analyzer.sh,cv/remenv/pluggable/unix/checkcorefile.sh,cv/remenv/pluggable/unix/hangcheck_tick.sh,cv/remenv/pluggable/unix/getNICSpeed.sh,cv/remenv/pluggable/unix/check_rp_filter.sh,cv/remenv/pluggable/unix/hangchecktimer.sh,cv/remenv/pluggable/unix/check_network_param.sh,cv/remenv/pluggable/unix/alert_log_file_size_analyzer.sh,cv/remenv/pluggable/unix/checkhugepage.sh,cv/remenv/pluggable/unix/checkmemlock.sh,cv/remenv/pluggable/unix/check_non_routable_network_interconnect.sh,cv/remenv/pluggable/unix/core_dump_dest_analyzer.sh,cv/remenv/pluggable/unix/check_e1000.sh,cv/remenv/pluggable/unix/hangcheck_reboot.sh
  712. [[email protected]] [main] [ 2018-10-24 18:51:14.920 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  713. [[email protected]] [main] [ 2018-10-24 18:51:14.921 IST ] [NativeResult.<init>:91] NativeResult: The String obtained is0
  714. [[email protected]] [main] [ 2018-10-24 18:51:14.921 IST ] [NativeResult.<init>:99] The status string is: 0
  715. [[email protected]] [main] [ 2018-10-24 18:51:14.922 IST ] [RemoteExecCommand.<init>:751] End of constructor call (called by many other constructors internally): RemoteExecCommand(String cmd, String[] args, String[] env, String node, boolean localExecution, String[] cmdFiles, String srcLoc, String[] remExecServerFiles, String destLoc, boolean chkException
  716. [[email protected]] [main] [ 2018-10-24 18:51:14.922 IST ] [RemoteExecCommand.<init>:687] End of constructor call: RemoteExecCommand(String cmd, String[] args, String[] env, String node, boolean localExecution, String[] cmdFiles, String[] remExecFiles, String destLoc
  717. [[email protected]] [main] [ 2018-10-24 18:51:14.922 IST ] [RemoteExecCommand.setSubDirAndGroup:1484] Calling setSubDirAndGroup(String subDir, String group) with 'subDir ='CVU_11.2.0.4.0_grid' and 'group = 'null
  718. [[email protected]] [main] [ 2018-10-24 18:51:14.923 IST ] [VerificationUtil.getLocalHost:854] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  719. [[email protected]] [main] [ 2018-10-24 18:51:14.923 IST ] [VerificationUtil.isLocalNode:7023]
  720. Comparing 'rac-node2' to localHOST 'rac-node1'
  721. [[email protected]] [main] [ 2018-10-24 18:51:14.924 IST ] [VerificationUtil.sameHost:7109] VerificationUtil::sameHost() Host:rac-node2 and Host: rac-node1 are not same.
  722. [[email protected]] [main] [ 2018-10-24 18:51:14.925 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  723. [[email protected]] [main] [ 2018-10-24 18:51:14.925 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  724. [[email protected]] [main] [ 2018-10-24 18:51:14.926 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  725. [[email protected]] [main] [ 2018-10-24 18:51:14.926 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  726. [[email protected]] [main] [ 2018-10-24 18:51:14.926 IST ] [VerificationUtil.isLocalNode:7078] Returning: false
  727. [[email protected]] [main] [ 2018-10-24 18:51:14.927 IST ] [RemoteExecCommand.setArgs:1429] Setting value for ivar 'm_args'
  728. [[email protected]] [main] [ 2018-10-24 18:51:14.927 IST ] [ClusterConfig.isClusterInstalled:363] hasJarPresent=false
  729. [[email protected]] [main] [ 2018-10-24 18:51:14.928 IST ] [ClusterConfig.init:423] Returning same instance to clientmain
  730. [[email protected]] [main] [ 2018-10-24 18:51:14.928 IST ] [ClusterConfig.submit:488] Entering submit, cmdCount=1
  731. [[email protected]] [main] [ 2018-10-24 18:51:14.928 IST ] [Semaphore.acquire:109] SyncBufferEmpty:Acquire called by thread main m_count=4
  732. [[email protected]] [main] [ 2018-10-24 18:51:14.929 IST ] [Semaphore.release:85] SyncBufferFull:Release called by thread main m_count=1
  733. [[email protected]] [main] [ 2018-10-24 18:51:14.929 IST ] [ClusterConfig.submit:523] submitted commands=1
  734. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.929 IST ] [Semaphore.release:85] SyncBufferEmpty:Release called by thread Worker 2 m_count=4
  735. [[email protected]] [main] [ 2018-10-24 18:51:14.929 IST ] [ClusterConfig.block:596] block called by thread main commandNum 1
  736. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.930 IST ] [GetExectaskVerCommand.execute:64] GetExectaskVerCommand::Inside execute() Worker 2
  737. [[email protected]] [main] [ 2018-10-24 18:51:14.930 IST ] [Semaphore.acquire:109] ClientResource Constructor:Blocking Semaphore owned by main:Acquire called by thread main m_count=0
  738. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.930 IST ] [VerificationCommand.execute:215] :: Inside execute() [Thread:
  739. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.931 IST ] [RemoteExecCommand.validateCmdArgs:1049] Calling validateCmdArgs
  740. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.931 IST ] [RemoteExecCommand.validateCmdArgs:1055] Checking for arguments validity
  741. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.932 IST ] [RemoteExecCommand.execute:824] Trying to runRemoteExecCmd first to check if server is already running
  742. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.932 IST ] [RemoteExecCommand.executeInternal:990] Calling executeInternal()
  743. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.932 IST ] [RemoteExecCommand.executeInternal:1006] executing the command: '/tmp/CVU_11.2.0.4.0_grid/exectask.sh' with args '-getver ', 'm_stdin == null ->true', 'm_localExecution ->false', 'm_chkException ->false'
  744. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.933 IST ] [Utils.getLocalHost:481] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  745. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.934 IST ] [NativeSystem.isCmdScv:502] isCmdScv: cmd=[/usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o NumberOfPasswordPrompts=0 rac-node2 -n ]
  746. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.935 IST ] [NativeSystem.isCmdScv:552] isCmdScv: /usr/bin/ssh is present.
  747. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.935 IST ] [NativeSystem.isCmdScv:554] isCmdScv: /usr/bin/ssh is a file.
  748. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.936 IST ] [NativeSystem.isCmdScv:571] isCmdScv: returned true
  749. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.936 IST ] [RuntimeExec.runCommand:75] Calling Runtime.exec() with the command
  750. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.937 IST ] [RuntimeExec.runCommand:77] /bin/sh
  751. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.937 IST ] [RuntimeExec.runCommand:77] -c
  752. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.938 IST ] [RuntimeExec.runCommand:77] /usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o NumberOfPasswordPrompts=0 rac-node2 -n /tmp/CVU_11.2.0.4.0_grid/exectask.sh -getver
  753. [[email protected]] [Thread-19] [ 2018-10-24 18:51:14.944 IST ] [StreamReader.run:61] In StreamReader.run
  754. [[email protected]] [Worker 2] [ 2018-10-24 18:51:14.944 IST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
  755. [[email protected]] [Thread-18] [ 2018-10-24 18:51:14.944 IST ] [StreamReader.run:61] In StreamReader.run
  756. [[email protected]] [Thread-18] [ 2018-10-24 18:51:15.076 IST ] [StreamReader.run:65] OUTPUT><CV_VRES>0</CV_VRES><CV_VAL>11.2.0.4.0.07_25_13_x86_64</CV_VAL><CV_ERES>0</CV_ERES>
  757. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.079 IST ] [RuntimeExec.runCommand:144] runCommand: process returns 0
  758. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.079 IST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
  759. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.080 IST ] [RuntimeExec.runCommand:164] <CV_VRES>0</CV_VRES><CV_VAL>11.2.0.4.0.07_25_13_x86_64</CV_VAL><CV_ERES>0</CV_ERES>
  760. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.080 IST ] [RuntimeExec.runCommand:170] RunTimeExec: error>
  761. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.081 IST ] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
  762. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.081 IST ] [UnixSystem.dorunRemoteExecCmd:3232] retval = 0
  763. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.082 IST ] [UnixSystem.dorunRemoteExecCmd:3256] exitValue = 0
  764. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.082 IST ] [RemoteExecCommand.executeInternal:1037] cmdSuccess status: true
  765. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.083 IST ] [RemoteExecCommand.execute:894] cmdSuccess status: true
  766. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.083 IST ] [VerificationUtil.fetchTextByTags:2318]
  767. Tags <CV_VAL> and </CV_VAL> contains:11.2.0.4.0.07_25_13_x86_64
  768.  
  769. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.084 IST ] [VerificationCommand.execute:234] Formatted exectask output is:
  770. <CV_VRES>0</CV_VRES><CV_VAL>11.2.0.4.0.07_25_13_x86_64</CV_VAL><CV_ERES>0</CV_ERES>
  771. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.084 IST ] [VerificationUtil.fetchTextByTags:2318]
  772. Tags <CV_VRES> and </CV_VRES> contains:0
  773.  
  774. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.085 IST ] [VerificationCommand.execute:245] VfyCode is: 0
  775. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.085 IST ] [VerificationUtil.fetchTextByTags:2318]
  776. Tags <CV_ERES> and </CV_ERES> contains:0
  777.  
  778. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.086 IST ] [GetExectaskVerCommand.execute:86] super.execute() was succcessful for GetExectaskVerCommand...
  779. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.086 IST ] [VerificationUtil.fetchTextByTags:2318]
  780. Tags <CV_ERES> and </CV_ERES> contains:0
  781.  
  782. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.086 IST ] [VerificationUtil.fetchTextByTags:2318]
  783. Tags <CV_VAL> and </CV_VAL> contains:11.2.0.4.0.07_25_13_x86_64
  784.  
  785. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.087 IST ] [GetExectaskVerCommand.execute:110] after calling fetchVerificationValue()
  786. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.087 IST ] [GetExectaskVerCommand.execute:114] The version of exectask at node 'rac-node2' is '11.2.0.4.0.07_25_13_x86_64'
  787. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.087 IST ] [ClusterConfig$ExecuteCommand.returnCommandToClient:2951] returnCommandToClient; fillCount=0 is full=false
  788. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.087 IST ] [Semaphore.acquire:109] SyncBufferEmpty:Acquire called by thread Worker 2 m_count=200
  789. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.088 IST ] [Semaphore.release:85] SyncBufferFull:Release called by thread Worker 2 m_count=1
  790. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.088 IST ] [ClientResource.getListener:157] Calling getListener
  791. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.088 IST ] [ClusterConfig$ExecuteCommand.run:3046] Owner Thread name of the blocking Semaphore main
  792. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.089 IST ] [ClusterConfig$ExecuteCommand.run:3054] Obtained Semaphore
  793. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.089 IST ] [Semaphore.release:85] ClientResource Constructor:Blocking Semaphore owned by main:Release called by thread Worker 2 m_count=1
  794. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.089 IST ] [ClusterConfig$ExecuteCommand.run:3069] Released Semaphore by worker=Worker 2
  795. [[email protected]] [main] [ 2018-10-24 18:51:15.089 IST ] [ClusterConfig.block:608] block acquired semnum=0
  796. [[email protected]] [Worker 2] [ 2018-10-24 18:51:15.089 IST ] [Semaphore.acquire:109] SyncBufferFull:Acquire called by thread Worker 2 m_count=0
  797. [[email protected]] [main] [ 2018-10-24 18:51:15.089 IST ] [ClusterConfig.submit:557] Out of block
  798. [[email protected]] [main] [ 2018-10-24 18:51:15.090 IST ] [ClusterConfig.submit:574] status=true
  799. [[email protected]] [main] [ 2018-10-24 18:51:15.090 IST ] [ClusterConfig.destroy:452] destroying resources for client thread Thread[main,5,main]
  800. [[email protected]] [main] [ 2018-10-24 18:51:15.091 IST ] [GlobalExecution.dumpTraceInfo:938] ---- Execution Trace for getExectaskVer from node: rac-node2 -----
  801. [[email protected]] [main] [ 2018-10-24 18:51:15.091 IST ] [GlobalExecution.dumpTraceInfo:946] ::Inside execute()
  802. [[email protected]] [main] [ 2018-10-24 18:51:15.092 IST ] [GlobalExecution.dumpTraceInfo:946] The version of exectask at node 'rac-node2' is '11.2.0.4.0.07_25_13_x86_64'
  803. [[email protected]] [main] [ 2018-10-24 18:51:15.092 IST ] [VerificationUtil.checkDestLoc:4097] VerificationUtil:: getExectaskVer() performed!!
  804. [[email protected]] [main] [ 2018-10-24 18:51:15.093 IST ] [VerificationUtil.checkGetExectaskVerResults:4819] Exectask version on node 'rac-node2' is '11.2.0.4.0.07_25_13_x86_64"
  805. [[email protected]] [main] [ 2018-10-24 18:51:15.093 IST ] [VerificationUtil.compatibleExectask:5817] Comparing framework version '11.2.0.4.0.07_25_13_x86_64' with exectask version '11.2.0.4.0.07_25_13_x86_64'
  806. [[email protected]] [main] [ 2018-10-24 18:51:15.094 IST ] [VerificationUtil.checkGetExectaskVerResults:4822] Compatible exectask found on node: rac-node2
  807. [[email protected]] [main] [ 2018-10-24 18:51:15.094 IST ] [VDMUtil.getCmdFiles4RemExec:145] ==== getCmdFiles4RemExec() called...
  808. [[email protected]] [main] [ 2018-10-24 18:51:15.095 IST ] [VDMUtil.getCmdFiles4RemExec:150] ==== PROP_REM_CDMFILES = 'cv/remenv/runfixup.sh,cv/remenv/orarun.sh,cv/remenv/cvuqdisk-1.0.9-1.rpm,cv/remenv/exectask.sh,cv/remenv/exectask,cv/remenv/pluggable'
  809. [[email protected]] [main] [ 2018-10-24 18:51:15.095 IST ] [VerificationUtil.listRecursiveFiles:1071] InputList=cv/remenv/runfixup.sh,cv/remenv/orarun.sh,cv/remenv/cvuqdisk-1.0.9-1.rpm,cv/remenv/exectask.sh,cv/remenv/exectask,cv/remenv/pluggable
  810. [[email protected]] [main] [ 2018-10-24 18:51:15.099 IST ] [VerificationUtil.listRecursiveFiles:1128] OutputList=cv/remenv/runfixup.sh,cv/remenv/orarun.sh,cv/remenv/cvuqdisk-1.0.9-1.rpm,cv/remenv/exectask.sh,cv/remenv/exectask,cv/remenv/pluggable/unix/checkramfs.sh,cv/remenv/pluggable/unix/check_default_gateway.sh,cv/remenv/pluggable/unix/checksyslog.sh,cv/remenv/pluggable/unix/ora_00600_errors_analyzer.sh,cv/remenv/pluggable/unix/shutdown_hwclock_sync.sh,cv/remenv/pluggable/unix/check_jumbo_frames.sh,cv/remenv/pluggable/unix/ora_07445_errors_analyzer.sh,cv/remenv/pluggable/unix/css_reboot_time.sh,cv/remenv/pluggable/unix/css_disk_timeout.sh,cv/remenv/pluggable/unix/check_tcp_packet_retransmit.sh,cv/remenv/pluggable/unix/checksshd.sh,cv/remenv/pluggable/unix/css_diagwait.sh,cv/remenv/pluggable/unix/css_misscount.sh,cv/remenv/pluggable/unix/check_vip_restart_attempt.sh,cv/remenv/pluggable/unix/check_network_packet_reassembly.sh,cv/remenv/pluggable/unix/hangcheck_margin.sh,cv/remenv/pluggable/unix/common_include.sh,cv/remenv/pluggable/unix/listener_naming_convention.sh,cv/remenv/pluggable/unix/check_disk_asynch_io_linking.sh,cv/remenv/pluggable/unix/checkportavail.sh,cv/remenv/pluggable/unix/check_vmm.sh,cv/remenv/pluggable/unix/bdump_dest_trace_analyzer.sh,cv/remenv/pluggable/unix/checkcorefile.sh,cv/remenv/pluggable/unix/hangcheck_tick.sh,cv/remenv/pluggable/unix/getNICSpeed.sh,cv/remenv/pluggable/unix/check_rp_filter.sh,cv/remenv/pluggable/unix/hangchecktimer.sh,cv/remenv/pluggable/unix/check_network_param.sh,cv/remenv/pluggable/unix/alert_log_file_size_analyzer.sh,cv/remenv/pluggable/unix/checkhugepage.sh,cv/remenv/pluggable/unix/checkmemlock.sh,cv/remenv/pluggable/unix/check_non_routable_network_interconnect.sh,cv/remenv/pluggable/unix/core_dump_dest_analyzer.sh,cv/remenv/pluggable/unix/check_e1000.sh,cv/remenv/pluggable/unix/hangcheck_reboot.sh
  811. [[email protected]] [main] [ 2018-10-24 18:51:15.099 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  812. [[email protected]] [main] [ 2018-10-24 18:51:15.099 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  813. [[email protected]] [main] [ 2018-10-24 18:51:15.100 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  814. [[email protected]] [main] [ 2018-10-24 18:51:15.100 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  815. [[email protected]] [main] [ 2018-10-24 18:51:15.100 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  816. [[email protected]] [main] [ 2018-10-24 18:51:15.101 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  817. [[email protected]] [main] [ 2018-10-24 18:51:15.101 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  818. [[email protected]] [main] [ 2018-10-24 18:51:15.101 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  819. [[email protected]] [main] [ 2018-10-24 18:51:15.102 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  820. [[email protected]] [main] [ 2018-10-24 18:51:15.102 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  821. [[email protected]] [main] [ 2018-10-24 18:51:15.102 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  822. [[email protected]] [main] [ 2018-10-24 18:51:15.102 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  823. [[email protected]] [main] [ 2018-10-24 18:51:15.103 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  824. [[email protected]] [main] [ 2018-10-24 18:51:15.103 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  825. [[email protected]] [main] [ 2018-10-24 18:51:15.103 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  826. [[email protected]] [main] [ 2018-10-24 18:51:15.104 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  827. [[email protected]] [main] [ 2018-10-24 18:51:15.104 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  828. [[email protected]] [main] [ 2018-10-24 18:51:15.104 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  829. [[email protected]] [main] [ 2018-10-24 18:51:15.104 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  830. [[email protected]] [main] [ 2018-10-24 18:51:15.105 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  831. [[email protected]] [main] [ 2018-10-24 18:51:15.105 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  832. [[email protected]] [main] [ 2018-10-24 18:51:15.105 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  833. [[email protected]] [main] [ 2018-10-24 18:51:15.106 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  834. [[email protected]] [main] [ 2018-10-24 18:51:15.106 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  835. [[email protected]] [main] [ 2018-10-24 18:51:15.106 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  836. [[email protected]] [main] [ 2018-10-24 18:51:15.106 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  837. [[email protected]] [main] [ 2018-10-24 18:51:15.107 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  838. [[email protected]] [main] [ 2018-10-24 18:51:15.107 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  839. [[email protected]] [main] [ 2018-10-24 18:51:15.107 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  840. [[email protected]] [main] [ 2018-10-24 18:51:15.108 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  841. [[email protected]] [main] [ 2018-10-24 18:51:15.108 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  842. [[email protected]] [main] [ 2018-10-24 18:51:15.108 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  843. [[email protected]] [main] [ 2018-10-24 18:51:15.108 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  844. [[email protected]] [main] [ 2018-10-24 18:51:15.109 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  845. [[email protected]] [main] [ 2018-10-24 18:51:15.109 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  846. [[email protected]] [main] [ 2018-10-24 18:51:15.109 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  847. [[email protected]] [main] [ 2018-10-24 18:51:15.110 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  848. [[email protected]] [main] [ 2018-10-24 18:51:15.110 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  849. [[email protected]] [main] [ 2018-10-24 18:51:15.110 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  850. [[email protected]] [main] [ 2018-10-24 18:51:15.110 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  851. [[email protected]] [main] [ 2018-10-24 18:51:15.111 IST ] [GlobalExecution.getFileInfo:2192] GlobalExecution: inside getFileInfo...
  852. [[email protected]] [main] [ 2018-10-24 18:51:15.111 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  853. [[email protected]] [main] [ 2018-10-24 18:51:15.121 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  854. [[email protected]] [main] [ 2018-10-24 18:51:15.121 IST ] [GlobalExecution.copyFile:2040] GlobalExecution::inside checkFileExistence...
  855. [[email protected]] [main] [ 2018-10-24 18:51:15.123 IST ] [VerificationUtil.isLocalNodeOperation:6891] Returning saved value of: false
  856. [[email protected]] [main] [ 2018-10-24 18:51:15.123 IST ] [NativeResult.<init>:91] NativeResult: The String obtained is0
  857. [[email protected]] [main] [ 2018-10-24 18:51:15.123 IST ] [NativeResult.<init>:99] The status string is: 0
  858. [[email protected]] [main] [ 2018-10-24 18:51:15.124 IST ] [RemoteExecCommand.<init>:479] End of constructor call (called by many other constructors internally): RemoteExecCommand(String cmd, String[] args, String[] env, String node, boolean localExecution, String[] cmdFiles, String srcLoc, String destLoc, boolean chkException
  859. [[email protected]] [main] [ 2018-10-24 18:51:15.124 IST ] [RemoteExecCommand.<init>:358] End of constructor call: RemoteExecCommand(String cmd, String[] args, String[] env, String node, boolean localExecution, String[] cmdFiles, String srcLoc, String destLoc
  860. [[email protected]] [main] [ 2018-10-24 18:51:15.124 IST ] [RemoteExecCommand.setSubDirAndGroup:1484] Calling setSubDirAndGroup(String subDir, String group) with 'subDir ='CVU_11.2.0.4.0_grid' and 'group = 'null
  861. [[email protected]] [main] [ 2018-10-24 18:51:15.125 IST ] [VerificationUtil.getLocalHost:854] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  862. [[email protected]] [main] [ 2018-10-24 18:51:15.125 IST ] [VerificationUtil.isLocalNode:7023]
  863. Comparing 'rac-node2' to localHOST 'rac-node1'
  864. [[email protected]] [main] [ 2018-10-24 18:51:15.125 IST ] [VerificationUtil.sameHost:7109] VerificationUtil::sameHost() Host:rac-node2 and Host: rac-node1 are not same.
  865. [[email protected]] [main] [ 2018-10-24 18:51:15.126 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  866. [[email protected]] [main] [ 2018-10-24 18:51:15.126 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  867. [[email protected]] [main] [ 2018-10-24 18:51:15.126 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  868. [[email protected]] [main] [ 2018-10-24 18:51:15.127 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  869. [[email protected]] [main] [ 2018-10-24 18:51:15.127 IST ] [VerificationUtil.isLocalNode:7078] Returning: false
  870. [[email protected]] [main] [ 2018-10-24 18:51:15.128 IST ] [ClusterConfig.isClusterInstalled:363] hasJarPresent=false
  871. [[email protected]] [main] [ 2018-10-24 18:51:15.128 IST ] [ClusterConfig.init:423] Returning same instance to clientmain
  872. [[email protected]] [main] [ 2018-10-24 18:51:15.128 IST ] [ClusterConfig.submit:488] Entering submit, cmdCount=1
  873. [[email protected]] [main] [ 2018-10-24 18:51:15.128 IST ] [Semaphore.acquire:109] SyncBufferEmpty:Acquire called by thread main m_count=4
  874. [[email protected]] [main] [ 2018-10-24 18:51:15.129 IST ] [Semaphore.release:85] SyncBufferFull:Release called by thread main m_count=1
  875. [[email protected]] [main] [ 2018-10-24 18:51:15.129 IST ] [ClusterConfig.submit:523] submitted commands=1
  876. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.129 IST ] [Semaphore.release:85] SyncBufferEmpty:Release called by thread Worker 0 m_count=4
  877. [[email protected]] [main] [ 2018-10-24 18:51:15.129 IST ] [ClusterConfig.block:596] block called by thread main commandNum 1
  878. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.129 IST ] [CopyFileCommand.execute:67] CopyFileCommand:: Inside execute() [Thread:Worker 0]
  879. [[email protected]] [main] [ 2018-10-24 18:51:15.130 IST ] [Semaphore.acquire:109] ClientResource Constructor:Blocking Semaphore owned by main:Acquire called by thread main m_count=0
  880. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.130 IST ] [UnixSystem.copyFile:660] Copy file localnode:/tmp/getfileinfoconfigfile_5327269377188734357.txt to rac-node2:/tmp/getfileinfoconfigfile_7621726115728340518.txt
  881. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.131 IST ] [Utils.getLocalHost:481] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  882. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.131 IST ] [UnixSystem.remoteCopyFile:637] Copying files localnode/tmp/getfileinfoconfigfile_5327269377188734357.txt rac-node2/tmp/getfileinfoconfigfile_7621726115728340518.txt
  883. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.132 IST ] [Utils.getLocalHost:481] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  884. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.132 IST ] [UnixSystem.remoteCopyFile:654] UnixSystem: /usr/bin/scp -p /tmp/getfileinfoconfigfile_5327269377188734357.txt rac-node2:'/tmp/getfileinfoconfigfile_7621726115728340518.txt'
  885. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.133 IST ] [RuntimeExec.runCommand:75] Calling Runtime.exec() with the command
  886. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.133 IST ] [RuntimeExec.runCommand:77] /usr/bin/scp
  887. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.134 IST ] [RuntimeExec.runCommand:77] -p
  888. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.134 IST ] [RuntimeExec.runCommand:77] /tmp/getfileinfoconfigfile_5327269377188734357.txt
  889. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.135 IST ] [RuntimeExec.runCommand:77] rac-node2:'/tmp/getfileinfoconfigfile_7621726115728340518.txt'
  890. [[email protected]] [Thread-20] [ 2018-10-24 18:51:15.140 IST ] [StreamReader.run:61] In StreamReader.run
  891. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.140 IST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
  892. [[email protected]] [Thread-21] [ 2018-10-24 18:51:15.140 IST ] [StreamReader.run:61] In StreamReader.run
  893. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.272 IST ] [RuntimeExec.runCommand:144] runCommand: process returns 0
  894. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.272 IST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
  895. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.273 IST ] [RuntimeExec.runCommand:170] RunTimeExec: error>
  896. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.273 IST ] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
  897. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.274 IST ] [NativeSystem.isCmdScv:502] isCmdScv: cmd=[/usr/bin/scp -p /tmp/getfileinfoconfigfile_5327269377188734357.txt rac-node2:'/tmp/getfileinfoconfigfile_7621726115728340518.txt']
  898. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.275 IST ] [NativeSystem.isCmdScv:552] isCmdScv: /usr/bin/scp is present.
  899. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.275 IST ] [NativeSystem.isCmdScv:554] isCmdScv: /usr/bin/scp is a file.
  900. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.275 IST ] [NativeSystem.isCmdScv:571] isCmdScv: returned true
  901. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.276 IST ] [NativeSystem.rununixcmd:1152] NativeSystem.rununixcmd: RetString 1| :successful
  902. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.276 IST ] [NativeResult.<init>:91] NativeResult: The String obtained is1| :successful
  903. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.277 IST ] [NativeResult.<init>:99] The status string is: 1
  904. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.277 IST ] [NativeResult.<init>:112] The result string is: :successful 1
  905. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.277 IST ] [ClusterConfig$ExecuteCommand.returnCommandToClient:2951] returnCommandToClient; fillCount=0 is full=false
  906. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.278 IST ] [Semaphore.acquire:109] SyncBufferEmpty:Acquire called by thread Worker 0 m_count=200
  907. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.278 IST ] [Semaphore.release:85] SyncBufferFull:Release called by thread Worker 0 m_count=1
  908. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.278 IST ] [ClientResource.getListener:157] Calling getListener
  909. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.279 IST ] [ClusterConfig$ExecuteCommand.run:3046] Owner Thread name of the blocking Semaphore main
  910. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.279 IST ] [ClusterConfig$ExecuteCommand.run:3054] Obtained Semaphore
  911. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.279 IST ] [Semaphore.release:85] ClientResource Constructor:Blocking Semaphore owned by main:Release called by thread Worker 0 m_count=1
  912. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.279 IST ] [ClusterConfig$ExecuteCommand.run:3069] Released Semaphore by worker=Worker 0
  913. [[email protected]] [main] [ 2018-10-24 18:51:15.280 IST ] [ClusterConfig.block:608] block acquired semnum=0
  914. [[email protected]] [Worker 0] [ 2018-10-24 18:51:15.280 IST ] [Semaphore.acquire:109] SyncBufferFull:Acquire called by thread Worker 0 m_count=0
  915. [[email protected]] [main] [ 2018-10-24 18:51:15.280 IST ] [ClusterConfig.submit:557] Out of block
  916. [[email protected]] [main] [ 2018-10-24 18:51:15.280 IST ] [ClusterConfig.submit:574] status=true
  917. [[email protected]] [main] [ 2018-10-24 18:51:15.281 IST ] [ClusterConfig.destroy:452] destroying resources for client thread Thread[main,5,main]
  918. [[email protected]] [main] [ 2018-10-24 18:51:15.281 IST ] [GlobalExecution.dumpTraceInfo:938] ---- Execution Trace for copyFile from node: rac-node2 -----
  919. [[email protected]] [main] [ 2018-10-24 18:51:15.281 IST ] [GlobalExecution.dumpTraceInfo:946] CopyFileCommand::Inside execute() Worker 0
  920. [[email protected]] [main] [ 2018-10-24 18:51:15.282 IST ] [ResultSet.traceResultSet:359]
  921.  
  922. Target ResultSet BEFORE Upload===>
  923. Overall Status->UNKNOWN
  924.  
  925.  
  926.  
  927. [[email protected]] [main] [ 2018-10-24 18:51:15.282 IST ] [ResultSet.traceResultSet:359]
  928.  
  929. Source ResultSet ===>
  930. Overall Status->SUCCESSFUL
  931.  
  932. rac-node2-->SUCCESSFUL
  933.  
  934.  
  935. [[email protected]] [main] [ 2018-10-24 18:51:15.282 IST ] [ResultSet.traceResultSet:359]
  936.  
  937. Target ResultSet AFTER Upload===>
  938. Overall Status->SUCCESSFUL
  939.  
  940. rac-node2-->SUCCESSFUL
  941.  
  942.  
  943. [[email protected]] [main] [ 2018-10-24 18:51:15.283 IST ] [ResultSet.getSuccNodes:574] Checking for Success nodes from the total list of nodes in the resultset
  944. [[email protected]] [main] [ 2018-10-24 18:51:15.283 IST ] [ResultSet.getSuccNodes:587] Adding node rac-node2 to list of Succ nodes
  945. [[email protected]] [main] [ 2018-10-24 18:51:15.285 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  946. [[email protected]] [main] [ 2018-10-24 18:51:15.285 IST ] [VDMUtil.getCmd4RemExec:123] ==== getCmd4RemExec() called...
  947. [[email protected]] [main] [ 2018-10-24 18:51:15.286 IST ] [VDMUtil.getCmd4RemExec:130] ==== PROP_REM_COMMAND = 'exectask.sh'
  948. [[email protected]] [main] [ 2018-10-24 18:51:15.286 IST ] [VerificationUtil.getCmd4RemExec:2830] ==== Remote Exec name: exectask.sh
  949. [[email protected]] [main] [ 2018-10-24 18:51:15.286 IST ] [VerificationUtil.isLocalNodeOperation:6891] Returning saved value of: false
  950. [[email protected]] [main] [ 2018-10-24 18:51:15.287 IST ] [VDMUtil.getCmdFiles4RemExec:145] ==== getCmdFiles4RemExec() called...
  951. [[email protected]] [main] [ 2018-10-24 18:51:15.287 IST ] [VDMUtil.getCmdFiles4RemExec:150] ==== PROP_REM_CDMFILES = 'cv/remenv/runfixup.sh,cv/remenv/orarun.sh,cv/remenv/cvuqdisk-1.0.9-1.rpm,cv/remenv/exectask.sh,cv/remenv/exectask,cv/remenv/pluggable'
  952. [[email protected]] [main] [ 2018-10-24 18:51:15.287 IST ] [VerificationUtil.listRecursiveFiles:1071] InputList=cv/remenv/runfixup.sh,cv/remenv/orarun.sh,cv/remenv/cvuqdisk-1.0.9-1.rpm,cv/remenv/exectask.sh,cv/remenv/exectask,cv/remenv/pluggable
  953. [[email protected]] [main] [ 2018-10-24 18:51:15.291 IST ] [VerificationUtil.listRecursiveFiles:1128] OutputList=cv/remenv/runfixup.sh,cv/remenv/orarun.sh,cv/remenv/cvuqdisk-1.0.9-1.rpm,cv/remenv/exectask.sh,cv/remenv/exectask,cv/remenv/pluggable/unix/checkramfs.sh,cv/remenv/pluggable/unix/check_default_gateway.sh,cv/remenv/pluggable/unix/checksyslog.sh,cv/remenv/pluggable/unix/ora_00600_errors_analyzer.sh,cv/remenv/pluggable/unix/shutdown_hwclock_sync.sh,cv/remenv/pluggable/unix/check_jumbo_frames.sh,cv/remenv/pluggable/unix/ora_07445_errors_analyzer.sh,cv/remenv/pluggable/unix/css_reboot_time.sh,cv/remenv/pluggable/unix/css_disk_timeout.sh,cv/remenv/pluggable/unix/check_tcp_packet_retransmit.sh,cv/remenv/pluggable/unix/checksshd.sh,cv/remenv/pluggable/unix/css_diagwait.sh,cv/remenv/pluggable/unix/css_misscount.sh,cv/remenv/pluggable/unix/check_vip_restart_attempt.sh,cv/remenv/pluggable/unix/check_network_packet_reassembly.sh,cv/remenv/pluggable/unix/hangcheck_margin.sh,cv/remenv/pluggable/unix/common_include.sh,cv/remenv/pluggable/unix/listener_naming_convention.sh,cv/remenv/pluggable/unix/check_disk_asynch_io_linking.sh,cv/remenv/pluggable/unix/checkportavail.sh,cv/remenv/pluggable/unix/check_vmm.sh,cv/remenv/pluggable/unix/bdump_dest_trace_analyzer.sh,cv/remenv/pluggable/unix/checkcorefile.sh,cv/remenv/pluggable/unix/hangcheck_tick.sh,cv/remenv/pluggable/unix/getNICSpeed.sh,cv/remenv/pluggable/unix/check_rp_filter.sh,cv/remenv/pluggable/unix/hangchecktimer.sh,cv/remenv/pluggable/unix/check_network_param.sh,cv/remenv/pluggable/unix/alert_log_file_size_analyzer.sh,cv/remenv/pluggable/unix/checkhugepage.sh,cv/remenv/pluggable/unix/checkmemlock.sh,cv/remenv/pluggable/unix/check_non_routable_network_interconnect.sh,cv/remenv/pluggable/unix/core_dump_dest_analyzer.sh,cv/remenv/pluggable/unix/check_e1000.sh,cv/remenv/pluggable/unix/hangcheck_reboot.sh
  954. [[email protected]] [main] [ 2018-10-24 18:51:15.291 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  955. [[email protected]] [main] [ 2018-10-24 18:51:15.291 IST ] [NativeResult.<init>:91] NativeResult: The String obtained is0
  956. [[email protected]] [main] [ 2018-10-24 18:51:15.292 IST ] [NativeResult.<init>:99] The status string is: 0
  957. [[email protected]] [main] [ 2018-10-24 18:51:15.292 IST ] [RemoteExecCommand.<init>:751] End of constructor call (called by many other constructors internally): RemoteExecCommand(String cmd, String[] args, String[] env, String node, boolean localExecution, String[] cmdFiles, String srcLoc, String[] remExecServerFiles, String destLoc, boolean chkException
  958. [[email protected]] [main] [ 2018-10-24 18:51:15.292 IST ] [RemoteExecCommand.<init>:687] End of constructor call: RemoteExecCommand(String cmd, String[] args, String[] env, String node, boolean localExecution, String[] cmdFiles, String[] remExecFiles, String destLoc
  959. [[email protected]] [main] [ 2018-10-24 18:51:15.292 IST ] [RemoteExecCommand.setSubDirAndGroup:1484] Calling setSubDirAndGroup(String subDir, String group) with 'subDir ='CVU_11.2.0.4.0_grid' and 'group = 'null
  960. [[email protected]] [main] [ 2018-10-24 18:51:15.293 IST ] [VerificationUtil.getLocalHost:854] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  961. [[email protected]] [main] [ 2018-10-24 18:51:15.293 IST ] [VerificationUtil.isLocalNode:7023]
  962. Comparing 'rac-node2' to localHOST 'rac-node1'
  963. [[email protected]] [main] [ 2018-10-24 18:51:15.294 IST ] [VerificationUtil.sameHost:7109] VerificationUtil::sameHost() Host:rac-node2 and Host: rac-node1 are not same.
  964. [[email protected]] [main] [ 2018-10-24 18:51:15.294 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  965. [[email protected]] [main] [ 2018-10-24 18:51:15.294 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  966. [[email protected]] [main] [ 2018-10-24 18:51:15.295 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  967. [[email protected]] [main] [ 2018-10-24 18:51:15.295 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  968. [[email protected]] [main] [ 2018-10-24 18:51:15.295 IST ] [VerificationUtil.isLocalNode:7078] Returning: false
  969. [[email protected]] [main] [ 2018-10-24 18:51:15.295 IST ] [RemoteExecCommand.setArgs:1429] Setting value for ivar 'm_args'
  970. [[email protected]] [main] [ 2018-10-24 18:51:15.296 IST ] [ClusterConfig.isClusterInstalled:363] hasJarPresent=false
  971. [[email protected]] [main] [ 2018-10-24 18:51:15.296 IST ] [ClusterConfig.init:423] Returning same instance to clientmain
  972. [[email protected]] [main] [ 2018-10-24 18:51:15.297 IST ] [ClusterConfig.submit:488] Entering submit, cmdCount=1
  973. [[email protected]] [main] [ 2018-10-24 18:51:15.297 IST ] [Semaphore.acquire:109] SyncBufferEmpty:Acquire called by thread main m_count=4
  974. [[email protected]] [main] [ 2018-10-24 18:51:15.297 IST ] [Semaphore.release:85] SyncBufferFull:Release called by thread main m_count=1
  975. [[email protected]] [main] [ 2018-10-24 18:51:15.298 IST ] [ClusterConfig.submit:523] submitted commands=1
  976. [[email protected]] [main] [ 2018-10-24 18:51:15.298 IST ] [ClusterConfig.block:596] block called by thread main commandNum 1
  977. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.298 IST ] [Semaphore.release:85] SyncBufferEmpty:Release called by thread Worker 1 m_count=4
  978. [[email protected]] [main] [ 2018-10-24 18:51:15.298 IST ] [Semaphore.acquire:109] ClientResource Constructor:Blocking Semaphore owned by main:Acquire called by thread main m_count=0
  979. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.298 IST ] [GetFileInfoCommand.execute:91] GetFileVerCommand::Inside execute() Worker 1
  980. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.299 IST ] [VerificationCommand.execute:215] :: Inside execute() [Thread:
  981. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.299 IST ] [RemoteExecCommand.validateCmdArgs:1049] Calling validateCmdArgs
  982. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.300 IST ] [RemoteExecCommand.validateCmdArgs:1055] Checking for arguments validity
  983. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.300 IST ] [RemoteExecCommand.execute:824] Trying to runRemoteExecCmd first to check if server is already running
  984. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.301 IST ] [RemoteExecCommand.executeInternal:990] Calling executeInternal()
  985. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.301 IST ] [RemoteExecCommand.executeInternal:1006] executing the command: '/tmp/CVU_11.2.0.4.0_grid/exectask.sh' with args '-getfileinfo /tmp/getfileinfoconfigfile_7621726115728340518.txt ', 'm_stdin == null ->true', 'm_localExecution ->false', 'm_chkException ->false'
  986. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.302 IST ] [Utils.getLocalHost:481] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  987. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.303 IST ] [NativeSystem.isCmdScv:502] isCmdScv: cmd=[/usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o NumberOfPasswordPrompts=0 rac-node2 -n ]
  988. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.303 IST ] [NativeSystem.isCmdScv:552] isCmdScv: /usr/bin/ssh is present.
  989. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.304 IST ] [NativeSystem.isCmdScv:554] isCmdScv: /usr/bin/ssh is a file.
  990. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.304 IST ] [NativeSystem.isCmdScv:571] isCmdScv: returned true
  991. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.305 IST ] [RuntimeExec.runCommand:75] Calling Runtime.exec() with the command
  992. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.305 IST ] [RuntimeExec.runCommand:77] /bin/sh
  993. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.306 IST ] [RuntimeExec.runCommand:77] -c
  994. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.306 IST ] [RuntimeExec.runCommand:77] /usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o NumberOfPasswordPrompts=0 rac-node2 -n /tmp/CVU_11.2.0.4.0_grid/exectask.sh -getfileinfo /tmp/getfileinfoconfigfile_7621726115728340518.txt
  995. [[email protected]] [Thread-23] [ 2018-10-24 18:51:15.311 IST ] [StreamReader.run:61] In StreamReader.run
  996. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.311 IST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
  997. [[email protected]] [Thread-22] [ 2018-10-24 18:51:15.311 IST ] [StreamReader.run:61] In StreamReader.run
  998. [[email protected]] [Thread-22] [ 2018-10-24 18:51:15.448 IST ] [StreamReader.run:65] OUTPUT><CV_VAL>/tmp/CVU_11.2.0.4.0_grid/scratch/getFileInfo7274.out</CV_VAL><CV_ERES>0</CV_ERES>
  999. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.449 IST ] [RuntimeExec.runCommand:144] runCommand: process returns 0
  1000. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.450 IST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
  1001. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.450 IST ] [RuntimeExec.runCommand:164] <CV_VAL>/tmp/CVU_11.2.0.4.0_grid/scratch/getFileInfo7274.out</CV_VAL><CV_ERES>0</CV_ERES>
  1002. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.451 IST ] [RuntimeExec.runCommand:170] RunTimeExec: error>
  1003. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.451 IST ] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
  1004. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.452 IST ] [UnixSystem.dorunRemoteExecCmd:3232] retval = 0
  1005. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.452 IST ] [UnixSystem.dorunRemoteExecCmd:3256] exitValue = 0
  1006. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.453 IST ] [RemoteExecCommand.executeInternal:1037] cmdSuccess status: true
  1007. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.453 IST ] [RemoteExecCommand.execute:894] cmdSuccess status: true
  1008. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.454 IST ] [VerificationUtil.fetchTextByTags:2318]
  1009. Tags <CV_VAL> and </CV_VAL> contains:/tmp/CVU_11.2.0.4.0_grid/scratch/getFileInfo7274.out
  1010.  
  1011. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.454 IST ] [VerificationCommand.execute:234] Formatted exectask output is:
  1012. <CV_VAL>/tmp/CVU_11.2.0.4.0_grid/scratch/getFileInfo7274.out</CV_VAL><CV_ERES>0</CV_ERES>
  1013. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.455 IST ] [VerificationCommand.execute:241] VRES value was NULL, VfyCode is set to 1.
  1014. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.455 IST ] [VerificationUtil.fetchTextByTags:2318]
  1015. Tags <CV_ERES> and </CV_ERES> contains:0
  1016.  
  1017. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.456 IST ] [VerificationUtil.fetchTextByTags:2318]
  1018. Tags <CV_VAL> and </CV_VAL> contains:/tmp/CVU_11.2.0.4.0_grid/scratch/getFileInfo7274.out
  1019.  
  1020. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.456 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  1021. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.456 IST ] [UnixSystem.copyFile:660] Copy file rac-node2:/tmp/CVU_11.2.0.4.0_grid/scratch/getFileInfo7274.out to localnode:/tmp/rac-node2.getFileInfo7274.out
  1022. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.457 IST ] [Utils.getLocalHost:481] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  1023. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.457 IST ] [UnixSystem.remoteCopyFile:637] Copying files rac-node2/tmp/CVU_11.2.0.4.0_grid/scratch/getFileInfo7274.out localnode/tmp/rac-node2.getFileInfo7274.out
  1024. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.458 IST ] [Utils.getLocalHost:481] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  1025. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.458 IST ] [Utils.getLocalHost:481] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  1026. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.459 IST ] [UnixSystem.remoteCopyFile:654] UnixSystem: /usr/bin/scp -p rac-node2:'/tmp/CVU_11.2.0.4.0_grid/scratch/getFileInfo7274.out' /tmp/rac-node2.getFileInfo7274.out
  1027. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.459 IST ] [RuntimeExec.runCommand:75] Calling Runtime.exec() with the command
  1028. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.459 IST ] [RuntimeExec.runCommand:77] /usr/bin/scp
  1029. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.459 IST ] [RuntimeExec.runCommand:77] -p
  1030. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.460 IST ] [RuntimeExec.runCommand:77] rac-node2:'/tmp/CVU_11.2.0.4.0_grid/scratch/getFileInfo7274.out'
  1031. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.460 IST ] [RuntimeExec.runCommand:77] /tmp/rac-node2.getFileInfo7274.out
  1032. [[email protected]] [Thread-24] [ 2018-10-24 18:51:15.466 IST ] [StreamReader.run:61] In StreamReader.run
  1033. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.466 IST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
  1034. [[email protected]] [Thread-25] [ 2018-10-24 18:51:15.466 IST ] [StreamReader.run:61] In StreamReader.run
  1035. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.594 IST ] [RuntimeExec.runCommand:144] runCommand: process returns 0
  1036. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.595 IST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
  1037. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.595 IST ] [RuntimeExec.runCommand:170] RunTimeExec: error>
  1038. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.596 IST ] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
  1039. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.596 IST ] [NativeSystem.isCmdScv:502] isCmdScv: cmd=[/usr/bin/scp -p rac-node2:'/tmp/CVU_11.2.0.4.0_grid/scratch/getFileInfo7274.out' /tmp/rac-node2.getFileInfo7274.out]
  1040. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.597 IST ] [NativeSystem.isCmdScv:552] isCmdScv: /usr/bin/scp is present.
  1041. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.597 IST ] [NativeSystem.isCmdScv:554] isCmdScv: /usr/bin/scp is a file.
  1042. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.597 IST ] [NativeSystem.isCmdScv:571] isCmdScv: returned true
  1043. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.598 IST ] [NativeSystem.rununixcmd:1152] NativeSystem.rununixcmd: RetString 1| :successful
  1044. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.599 IST ] [GetFileInfoCommand.execute:151] <FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/runfixup.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0755></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/orarun.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0755></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/cvuqdisk-1.0.9-1.rpm><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0644></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/exectask.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0755></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/exectask><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0755></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/checkramfs.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/check_default_gateway.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/checksyslog.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/ora_00600_errors_analyzer.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/shutdown_hwclock_sync.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/check_jumbo_frames.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/ora_07445_errors_analyzer.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/css_reboot_time.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/css_disk_timeout.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/check_tcp_packet_retransmit.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/checksshd.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/css_diagwait.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/css_misscount.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/check_vip_restart_attempt.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/check_network_packet_reassembly.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/hangcheck_margin.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/common_include.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/listener_naming_convention.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/check_disk_asynch_io_linking.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/checkportavail.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/check_vmm.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/bdump_dest_trace_analyzer.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/checkcorefile.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/hangcheck_tick.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/getNICSpeed.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/check_rp_filter.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/hangchecktimer.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/check_network_param.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/alert_log_file_size_analyzer.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/checkhugepage.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/checkmemlock.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/check_non_routable_network_interconnect.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/core_dump_dest_analyzer.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/check_e1000.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE><FILE><NAME,/tmp/CVU_11.2.0.4.0_grid/hangcheck_reboot.sh><STATUS,0><USER,grid><GROUP,oinstall><PERMISSIONS,0555></FILE>
  1045. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.599 IST ] [Utils.getLocalHost:481] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  1046. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.600 IST ] [RuntimeExec.runCommand:75] Calling Runtime.exec() with the command
  1047. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.600 IST ] [RuntimeExec.runCommand:77] /usr/bin/ssh
  1048. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.600 IST ] [RuntimeExec.runCommand:77] -o
  1049. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.601 IST ] [RuntimeExec.runCommand:77] FallBackToRsh=no
  1050. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.601 IST ] [RuntimeExec.runCommand:77] -o
  1051. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.601 IST ] [RuntimeExec.runCommand:77] PasswordAuthentication=no
  1052. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.602 IST ] [RuntimeExec.runCommand:77] -o
  1053. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.602 IST ] [RuntimeExec.runCommand:77] StrictHostKeyChecking=yes
  1054. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.602 IST ] [RuntimeExec.runCommand:77] -o
  1055. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.603 IST ] [RuntimeExec.runCommand:77] NumberOfPasswordPrompts=0
  1056. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.603 IST ] [RuntimeExec.runCommand:77] rac-node2
  1057. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.603 IST ] [RuntimeExec.runCommand:77] -n
  1058. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.604 IST ] [RuntimeExec.runCommand:77] /bin/rm
  1059. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.604 IST ] [RuntimeExec.runCommand:77] -f
  1060. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.604 IST ] [RuntimeExec.runCommand:77] /tmp/CVU_11.2.0.4.0_grid/scratch/getFileInfo7274.out
  1061. [[email protected]] [Thread-26] [ 2018-10-24 18:51:15.623 IST ] [StreamReader.run:61] In StreamReader.run
  1062. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.623 IST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
  1063. [[email protected]] [Thread-27] [ 2018-10-24 18:51:15.623 IST ] [StreamReader.run:61] In StreamReader.run
  1064. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.726 IST ] [RuntimeExec.runCommand:144] runCommand: process returns 0
  1065. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.726 IST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
  1066. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.727 IST ] [RuntimeExec.runCommand:170] RunTimeExec: error>
  1067. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.727 IST ] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
  1068. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.728 IST ] [NativeSystem.isCmdScv:502] isCmdScv: cmd=[/usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o NumberOfPasswordPrompts=0 rac-node2 -n /bin/rm -f /tmp/CVU_11.2.0.4.0_grid/scratch/getFileInfo7274.out]
  1069. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.729 IST ] [NativeSystem.isCmdScv:552] isCmdScv: /usr/bin/ssh is present.
  1070. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.729 IST ] [NativeSystem.isCmdScv:554] isCmdScv: /usr/bin/ssh is a file.
  1071. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.729 IST ] [NativeSystem.isCmdScv:571] isCmdScv: returned true
  1072. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.730 IST ] [NativeSystem.rununixcmd:1152] NativeSystem.rununixcmd: RetString 1| :successful
  1073. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.730 IST ] [RuntimeExec.runCommand:75] Calling Runtime.exec() with the command
  1074. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.731 IST ] [RuntimeExec.runCommand:77] /bin/rm
  1075. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.731 IST ] [RuntimeExec.runCommand:77] -f
  1076. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.732 IST ] [RuntimeExec.runCommand:77] /tmp/rac-node2.getFileInfo7274.out
  1077. [[email protected]] [Thread-28] [ 2018-10-24 18:51:15.738 IST ] [StreamReader.run:61] In StreamReader.run
  1078. [[email protected]] [Thread-29] [ 2018-10-24 18:51:15.738 IST ] [StreamReader.run:61] In StreamReader.run
  1079. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.738 IST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
  1080. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.741 IST ] [RuntimeExec.runCommand:144] runCommand: process returns 0
  1081. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.741 IST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
  1082. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.742 IST ] [RuntimeExec.runCommand:170] RunTimeExec: error>
  1083. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.742 IST ] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
  1084. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.742 IST ] [NativeSystem.isCmdScv:502] isCmdScv: cmd=[/bin/rm -f /tmp/rac-node2.getFileInfo7274.out]
  1085. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.743 IST ] [NativeSystem.isCmdScv:571] isCmdScv: returned false
  1086. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.743 IST ] [NativeSystem.rununixcmd:1152] NativeSystem.rununixcmd: RetString 1| :successful
  1087. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.752 IST ] [ClusterConfig$ExecuteCommand.returnCommandToClient:2951] returnCommandToClient; fillCount=0 is full=false
  1088. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.752 IST ] [Semaphore.acquire:109] SyncBufferEmpty:Acquire called by thread Worker 1 m_count=200
  1089. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.752 IST ] [Semaphore.release:85] SyncBufferFull:Release called by thread Worker 1 m_count=1
  1090. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.753 IST ] [ClientResource.getListener:157] Calling getListener
  1091. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.753 IST ] [ClusterConfig$ExecuteCommand.run:3046] Owner Thread name of the blocking Semaphore main
  1092. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.753 IST ] [ClusterConfig$ExecuteCommand.run:3054] Obtained Semaphore
  1093. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.753 IST ] [Semaphore.release:85] ClientResource Constructor:Blocking Semaphore owned by main:Release called by thread Worker 1 m_count=1
  1094. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.754 IST ] [ClusterConfig$ExecuteCommand.run:3069] Released Semaphore by worker=Worker 1
  1095. [[email protected]] [Worker 1] [ 2018-10-24 18:51:15.754 IST ] [Semaphore.acquire:109] SyncBufferFull:Acquire called by thread Worker 1 m_count=0
  1096. [[email protected]] [main] [ 2018-10-24 18:51:15.754 IST ] [ClusterConfig.block:608] block acquired semnum=0
  1097. [[email protected]] [main] [ 2018-10-24 18:51:15.755 IST ] [ClusterConfig.submit:557] Out of block
  1098. [[email protected]] [main] [ 2018-10-24 18:51:15.755 IST ] [ClusterConfig.submit:574] status=true
  1099. [[email protected]] [main] [ 2018-10-24 18:51:15.756 IST ] [ClusterConfig.destroy:452] destroying resources for client thread Thread[main,5,main]
  1100. [[email protected]] [main] [ 2018-10-24 18:51:15.756 IST ] [ResultSet.traceResultSet:359]
  1101.  
  1102. Target ResultSet BEFORE Upload===>
  1103. Overall Status->SUCCESSFUL
  1104.  
  1105. rac-node2-->SUCCESSFUL
  1106.  
  1107.  
  1108. [[email protected]] [main] [ 2018-10-24 18:51:15.757 IST ] [ResultSet.traceResultSet:359]
  1109.  
  1110. Source ResultSet ===>
  1111. Overall Status->SUCCESSFUL
  1112.  
  1113. rac-node2-->SUCCESSFUL
  1114.  
  1115.  
  1116. [[email protected]] [main] [ 2018-10-24 18:51:15.757 IST ] [ResultSet.traceResultSet:359]
  1117.  
  1118. Target ResultSet AFTER Upload===>
  1119. Overall Status->SUCCESSFUL
  1120.  
  1121. rac-node2-->SUCCESSFUL
  1122.  
  1123.  
  1124. [[email protected]] [main] [ 2018-10-24 18:51:15.758 IST ] [GlobalExecution.deleteFile:2074] GlobalExecution::inside checkFileExistence...
  1125. [[email protected]] [main] [ 2018-10-24 18:51:15.760 IST ] [VerificationUtil.isLocalNodeOperation:6891] Returning saved value of: false
  1126. [[email protected]] [main] [ 2018-10-24 18:51:15.760 IST ] [NativeResult.<init>:91] NativeResult: The String obtained is0
  1127. [[email protected]] [main] [ 2018-10-24 18:51:15.761 IST ] [NativeResult.<init>:99] The status string is: 0
  1128. [[email protected]] [main] [ 2018-10-24 18:51:15.761 IST ] [RemoteExecCommand.<init>:479] End of constructor call (called by many other constructors internally): RemoteExecCommand(String cmd, String[] args, String[] env, String node, boolean localExecution, String[] cmdFiles, String srcLoc, String destLoc, boolean chkException
  1129. [[email protected]] [main] [ 2018-10-24 18:51:15.762 IST ] [RemoteExecCommand.<init>:358] End of constructor call: RemoteExecCommand(String cmd, String[] args, String[] env, String node, boolean localExecution, String[] cmdFiles, String srcLoc, String destLoc
  1130. [[email protected]] [main] [ 2018-10-24 18:51:15.762 IST ] [RemoteExecCommand.setSubDirAndGroup:1484] Calling setSubDirAndGroup(String subDir, String group) with 'subDir ='CVU_11.2.0.4.0_grid' and 'group = 'null
  1131. [[email protected]] [main] [ 2018-10-24 18:51:15.763 IST ] [VerificationUtil.getLocalHost:854] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  1132. [[email protected]] [main] [ 2018-10-24 18:51:15.764 IST ] [VerificationUtil.isLocalNode:7023]
  1133. Comparing 'rac-node2' to localHOST 'rac-node1'
  1134. [[email protected]] [main] [ 2018-10-24 18:51:15.764 IST ] [VerificationUtil.sameHost:7109] VerificationUtil::sameHost() Host:rac-node2 and Host: rac-node1 are not same.
  1135. [[email protected]] [main] [ 2018-10-24 18:51:15.765 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  1136. [[email protected]] [main] [ 2018-10-24 18:51:15.765 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  1137. [[email protected]] [main] [ 2018-10-24 18:51:15.766 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  1138. [[email protected]] [main] [ 2018-10-24 18:51:15.766 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  1139. [[email protected]] [main] [ 2018-10-24 18:51:15.767 IST ] [VerificationUtil.isLocalNode:7078] Returning: false
  1140. [[email protected]] [main] [ 2018-10-24 18:51:15.768 IST ] [ClusterConfig.isClusterInstalled:363] hasJarPresent=false
  1141. [[email protected]] [main] [ 2018-10-24 18:51:15.768 IST ] [ClusterConfig.init:423] Returning same instance to clientmain
  1142. [[email protected]] [main] [ 2018-10-24 18:51:15.769 IST ] [ClusterConfig.submit:488] Entering submit, cmdCount=1
  1143. [[email protected]] [main] [ 2018-10-24 18:51:15.769 IST ] [Semaphore.acquire:109] SyncBufferEmpty:Acquire called by thread main m_count=4
  1144. [[email protected]] [main] [ 2018-10-24 18:51:15.770 IST ] [Semaphore.release:85] SyncBufferFull:Release called by thread main m_count=1
  1145. [[email protected]] [main] [ 2018-10-24 18:51:15.770 IST ] [ClusterConfig.submit:523] submitted commands=1
  1146. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.770 IST ] [Semaphore.release:85] SyncBufferEmpty:Release called by thread Worker 3 m_count=4
  1147. [[email protected]] [main] [ 2018-10-24 18:51:15.771 IST ] [ClusterConfig.block:596] block called by thread main commandNum 1
  1148. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.771 IST ] [DeleteFileCommand.execute:63] DeleteFileCommand:: Inside execute() [Thread:Worker 3]
  1149. [[email protected]] [main] [ 2018-10-24 18:51:15.771 IST ] [Semaphore.acquire:109] ClientResource Constructor:Blocking Semaphore owned by main:Acquire called by thread main m_count=0
  1150. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.772 IST ] [Utils.getLocalHost:481] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  1151. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.772 IST ] [RuntimeExec.runCommand:75] Calling Runtime.exec() with the command
  1152. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.773 IST ] [RuntimeExec.runCommand:77] /usr/bin/ssh
  1153. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.773 IST ] [RuntimeExec.runCommand:77] -o
  1154. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.774 IST ] [RuntimeExec.runCommand:77] FallBackToRsh=no
  1155. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.774 IST ] [RuntimeExec.runCommand:77] -o
  1156. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.775 IST ] [RuntimeExec.runCommand:77] PasswordAuthentication=no
  1157. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.775 IST ] [RuntimeExec.runCommand:77] -o
  1158. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.775 IST ] [RuntimeExec.runCommand:77] StrictHostKeyChecking=yes
  1159. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.776 IST ] [RuntimeExec.runCommand:77] -o
  1160. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.776 IST ] [RuntimeExec.runCommand:77] NumberOfPasswordPrompts=0
  1161. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.776 IST ] [RuntimeExec.runCommand:77] rac-node2
  1162. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.777 IST ] [RuntimeExec.runCommand:77] -n
  1163. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.777 IST ] [RuntimeExec.runCommand:77] /bin/rm
  1164. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.777 IST ] [RuntimeExec.runCommand:77] -f
  1165. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.778 IST ] [RuntimeExec.runCommand:77] /tmp/getfileinfoconfigfile_7621726115728340518.txt
  1166. [[email protected]] [Thread-30] [ 2018-10-24 18:51:15.784 IST ] [StreamReader.run:61] In StreamReader.run
  1167. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.784 IST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
  1168. [[email protected]] [Thread-31] [ 2018-10-24 18:51:15.784 IST ] [StreamReader.run:61] In StreamReader.run
  1169. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.901 IST ] [RuntimeExec.runCommand:144] runCommand: process returns 0
  1170. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.901 IST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
  1171. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.902 IST ] [RuntimeExec.runCommand:170] RunTimeExec: error>
  1172. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.902 IST ] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
  1173. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.903 IST ] [NativeSystem.isCmdScv:502] isCmdScv: cmd=[/usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o NumberOfPasswordPrompts=0 rac-node2 -n /bin/rm -f /tmp/getfileinfoconfigfile_7621726115728340518.txt]
  1174. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.904 IST ] [NativeSystem.isCmdScv:552] isCmdScv: /usr/bin/ssh is present.
  1175. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.904 IST ] [NativeSystem.isCmdScv:554] isCmdScv: /usr/bin/ssh is a file.
  1176. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.905 IST ] [NativeSystem.isCmdScv:571] isCmdScv: returned true
  1177. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.905 IST ] [NativeSystem.rununixcmd:1152] NativeSystem.rununixcmd: RetString 1| :successful
  1178. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.905 IST ] [NativeResult.<init>:91] NativeResult: The String obtained is1| :successful
  1179. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.906 IST ] [NativeResult.<init>:99] The status string is: 1
  1180. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.906 IST ] [NativeResult.<init>:112] The result string is: :successful 1
  1181. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.906 IST ] [ClusterConfig$ExecuteCommand.returnCommandToClient:2951] returnCommandToClient; fillCount=0 is full=false
  1182. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.907 IST ] [Semaphore.acquire:109] SyncBufferEmpty:Acquire called by thread Worker 3 m_count=200
  1183. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.907 IST ] [Semaphore.release:85] SyncBufferFull:Release called by thread Worker 3 m_count=1
  1184. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.907 IST ] [ClientResource.getListener:157] Calling getListener
  1185. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.907 IST ] [ClusterConfig$ExecuteCommand.run:3046] Owner Thread name of the blocking Semaphore main
  1186. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.908 IST ] [ClusterConfig$ExecuteCommand.run:3054] Obtained Semaphore
  1187. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.908 IST ] [Semaphore.release:85] ClientResource Constructor:Blocking Semaphore owned by main:Release called by thread Worker 3 m_count=1
  1188. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.908 IST ] [ClusterConfig$ExecuteCommand.run:3069] Released Semaphore by worker=Worker 3
  1189. [[email protected]] [main] [ 2018-10-24 18:51:15.908 IST ] [ClusterConfig.block:608] block acquired semnum=0
  1190. [[email protected]] [Worker 3] [ 2018-10-24 18:51:15.909 IST ] [Semaphore.acquire:109] SyncBufferFull:Acquire called by thread Worker 3 m_count=0
  1191. [[email protected]] [main] [ 2018-10-24 18:51:15.909 IST ] [ClusterConfig.submit:557] Out of block
  1192. [[email protected]] [main] [ 2018-10-24 18:51:15.909 IST ] [ClusterConfig.submit:574] status=true
  1193. [[email protected]] [main] [ 2018-10-24 18:51:15.910 IST ] [ClusterConfig.destroy:452] destroying resources for client thread Thread[main,5,main]
  1194. [[email protected]] [main] [ 2018-10-24 18:51:15.910 IST ] [GlobalExecution.dumpTraceInfo:938] ---- Execution Trace for copyFile from node: rac-node2 -----
  1195. [[email protected]] [main] [ 2018-10-24 18:51:15.910 IST ] [GlobalExecution.dumpTraceInfo:946] DeleteFileCommand::Inside execute() Worker 3
  1196. [[email protected]] [main] [ 2018-10-24 18:51:15.911 IST ] [ResultSet.traceResultSet:359]
  1197.  
  1198. Target ResultSet BEFORE Upload===>
  1199. Overall Status->SUCCESSFUL
  1200.  
  1201. rac-node2-->SUCCESSFUL
  1202.  
  1203.  
  1204. [[email protected]] [main] [ 2018-10-24 18:51:15.911 IST ] [ResultSet.traceResultSet:359]
  1205.  
  1206. Source ResultSet ===>
  1207. Overall Status->SUCCESSFUL
  1208.  
  1209. rac-node2-->SUCCESSFUL
  1210.  
  1211.  
  1212. [[email protected]] [main] [ 2018-10-24 18:51:15.912 IST ] [ResultSet.traceResultSet:359]
  1213.  
  1214. Target ResultSet AFTER Upload===>
  1215. Overall Status->SUCCESSFUL
  1216.  
  1217. rac-node2-->SUCCESSFUL
  1218.  
  1219.  
  1220. [[email protected]] [main] [ 2018-10-24 18:51:15.912 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/runfixup.sh
  1221. Owner: grid
  1222. Group: oinstall
  1223. Perms: 0755
  1224.  
  1225. [[email protected]] [main] [ 2018-10-24 18:51:15.913 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/orarun.sh
  1226. Owner: grid
  1227. Group: oinstall
  1228. Perms: 0755
  1229.  
  1230. [[email protected]] [main] [ 2018-10-24 18:51:15.914 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/cvuqdisk-1.0.9-1.rpm
  1231. Owner: grid
  1232. Group: oinstall
  1233. Perms: 0644
  1234.  
  1235. [[email protected]] [main] [ 2018-10-24 18:51:15.914 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/exectask.sh
  1236. Owner: grid
  1237. Group: oinstall
  1238. Perms: 0755
  1239.  
  1240. [[email protected]] [main] [ 2018-10-24 18:51:15.914 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/exectask
  1241. Owner: grid
  1242. Group: oinstall
  1243. Perms: 0755
  1244.  
  1245. [[email protected]] [main] [ 2018-10-24 18:51:15.915 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/checkramfs.sh
  1246. Owner: grid
  1247. Group: oinstall
  1248. Perms: 0555
  1249.  
  1250. [[email protected]] [main] [ 2018-10-24 18:51:15.915 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/check_default_gateway.sh
  1251. Owner: grid
  1252. Group: oinstall
  1253. Perms: 0555
  1254.  
  1255. [[email protected]] [main] [ 2018-10-24 18:51:15.916 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/checksyslog.sh
  1256. Owner: grid
  1257. Group: oinstall
  1258. Perms: 0555
  1259.  
  1260. [[email protected]] [main] [ 2018-10-24 18:51:15.916 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/ora_00600_errors_analyzer.sh
  1261. Owner: grid
  1262. Group: oinstall
  1263. Perms: 0555
  1264.  
  1265. [[email protected]] [main] [ 2018-10-24 18:51:15.916 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/shutdown_hwclock_sync.sh
  1266. Owner: grid
  1267. Group: oinstall
  1268. Perms: 0555
  1269.  
  1270. [[email protected]] [main] [ 2018-10-24 18:51:15.917 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/check_jumbo_frames.sh
  1271. Owner: grid
  1272. Group: oinstall
  1273. Perms: 0555
  1274.  
  1275. [[email protected]] [main] [ 2018-10-24 18:51:15.917 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/ora_07445_errors_analyzer.sh
  1276. Owner: grid
  1277. Group: oinstall
  1278. Perms: 0555
  1279.  
  1280. [[email protected]] [main] [ 2018-10-24 18:51:15.917 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/css_reboot_time.sh
  1281. Owner: grid
  1282. Group: oinstall
  1283. Perms: 0555
  1284.  
  1285. [[email protected]] [main] [ 2018-10-24 18:51:15.918 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/css_disk_timeout.sh
  1286. Owner: grid
  1287. Group: oinstall
  1288. Perms: 0555
  1289.  
  1290. [[email protected]] [main] [ 2018-10-24 18:51:15.918 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/check_tcp_packet_retransmit.sh
  1291. Owner: grid
  1292. Group: oinstall
  1293. Perms: 0555
  1294.  
  1295. [[email protected]] [main] [ 2018-10-24 18:51:15.918 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/checksshd.sh
  1296. Owner: grid
  1297. Group: oinstall
  1298. Perms: 0555
  1299.  
  1300. [[email protected]] [main] [ 2018-10-24 18:51:15.918 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/css_diagwait.sh
  1301. Owner: grid
  1302. Group: oinstall
  1303. Perms: 0555
  1304.  
  1305. [[email protected]] [main] [ 2018-10-24 18:51:15.919 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/css_misscount.sh
  1306. Owner: grid
  1307. Group: oinstall
  1308. Perms: 0555
  1309.  
  1310. [[email protected]] [main] [ 2018-10-24 18:51:15.919 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/check_vip_restart_attempt.sh
  1311. Owner: grid
  1312. Group: oinstall
  1313. Perms: 0555
  1314.  
  1315. [[email protected]] [main] [ 2018-10-24 18:51:15.919 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/check_network_packet_reassembly.sh
  1316. Owner: grid
  1317. Group: oinstall
  1318. Perms: 0555
  1319.  
  1320. [[email protected]] [main] [ 2018-10-24 18:51:15.920 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/hangcheck_margin.sh
  1321. Owner: grid
  1322. Group: oinstall
  1323. Perms: 0555
  1324.  
  1325. [[email protected]] [main] [ 2018-10-24 18:51:15.920 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/common_include.sh
  1326. Owner: grid
  1327. Group: oinstall
  1328. Perms: 0555
  1329.  
  1330. [[email protected]] [main] [ 2018-10-24 18:51:15.920 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/listener_naming_convention.sh
  1331. Owner: grid
  1332. Group: oinstall
  1333. Perms: 0555
  1334.  
  1335. [[email protected]] [main] [ 2018-10-24 18:51:15.921 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/check_disk_asynch_io_linking.sh
  1336. Owner: grid
  1337. Group: oinstall
  1338. Perms: 0555
  1339.  
  1340. [[email protected]] [main] [ 2018-10-24 18:51:15.921 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/checkportavail.sh
  1341. Owner: grid
  1342. Group: oinstall
  1343. Perms: 0555
  1344.  
  1345. [[email protected]] [main] [ 2018-10-24 18:51:15.921 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/check_vmm.sh
  1346. Owner: grid
  1347. Group: oinstall
  1348. Perms: 0555
  1349.  
  1350. [[email protected]] [main] [ 2018-10-24 18:51:15.921 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/bdump_dest_trace_analyzer.sh
  1351. Owner: grid
  1352. Group: oinstall
  1353. Perms: 0555
  1354.  
  1355. [[email protected]] [main] [ 2018-10-24 18:51:15.922 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/checkcorefile.sh
  1356. Owner: grid
  1357. Group: oinstall
  1358. Perms: 0555
  1359.  
  1360. [[email protected]] [main] [ 2018-10-24 18:51:15.922 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/hangcheck_tick.sh
  1361. Owner: grid
  1362. Group: oinstall
  1363. Perms: 0555
  1364.  
  1365. [[email protected]] [main] [ 2018-10-24 18:51:15.922 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/getNICSpeed.sh
  1366. Owner: grid
  1367. Group: oinstall
  1368. Perms: 0555
  1369.  
  1370. [[email protected]] [main] [ 2018-10-24 18:51:15.923 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/check_rp_filter.sh
  1371. Owner: grid
  1372. Group: oinstall
  1373. Perms: 0555
  1374.  
  1375. [[email protected]] [main] [ 2018-10-24 18:51:15.923 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/hangchecktimer.sh
  1376. Owner: grid
  1377. Group: oinstall
  1378. Perms: 0555
  1379.  
  1380. [[email protected]] [main] [ 2018-10-24 18:51:15.923 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/check_network_param.sh
  1381. Owner: grid
  1382. Group: oinstall
  1383. Perms: 0555
  1384.  
  1385. [[email protected]] [main] [ 2018-10-24 18:51:15.924 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/alert_log_file_size_analyzer.sh
  1386. Owner: grid
  1387. Group: oinstall
  1388. Perms: 0555
  1389.  
  1390. [[email protected]] [main] [ 2018-10-24 18:51:15.925 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/checkhugepage.sh
  1391. Owner: grid
  1392. Group: oinstall
  1393. Perms: 0555
  1394.  
  1395. [[email protected]] [main] [ 2018-10-24 18:51:15.925 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/checkmemlock.sh
  1396. Owner: grid
  1397. Group: oinstall
  1398. Perms: 0555
  1399.  
  1400. [[email protected]] [main] [ 2018-10-24 18:51:15.925 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/check_non_routable_network_interconnect.sh
  1401. Owner: grid
  1402. Group: oinstall
  1403. Perms: 0555
  1404.  
  1405. [[email protected]] [main] [ 2018-10-24 18:51:15.925 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/core_dump_dest_analyzer.sh
  1406. Owner: grid
  1407. Group: oinstall
  1408. Perms: 0555
  1409.  
  1410. [[email protected]] [main] [ 2018-10-24 18:51:15.926 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/check_e1000.sh
  1411. Owner: grid
  1412. Group: oinstall
  1413. Perms: 0555
  1414.  
  1415. [[email protected]] [main] [ 2018-10-24 18:51:15.926 IST ] [VerificationUtil.checkFileAttributes:4532] Checking file: /tmp/CVU_11.2.0.4.0_grid/hangcheck_reboot.sh
  1416. Owner: grid
  1417. Group: oinstall
  1418. Perms: 0555
  1419.  
  1420. [[email protected]] [main] [ 2018-10-24 18:51:15.926 IST ] [ResultSet.traceResultSet:359]
  1421.  
  1422. Before return from checkDestLoc with #succNodes=1;#failNodes=0;#nodes=1
  1423. Overall Status->SUCCESSFUL
  1424.  
  1425. rac-node2-->SUCCESSFUL
  1426.  
  1427.  
  1428. [[email protected]] [main] [ 2018-10-24 18:51:15.927 IST ] [Component.checkSetup:303] succNodes passed setupChecks: rac-node2
  1429. [[email protected]] [main] [ 2018-10-24 18:51:15.937 IST ] [Task.perform:386]
  1430. TaskSharedStorageAccess:Shared Storage Accessibility:/dev/mapper/asm-data1p1:TASK_START
  1431. [[email protected]] [main] [ 2018-10-24 18:51:15.937 IST ] [TaskSharedStorageAccess.performTask:308] Performing SharedStorage Accessibility verification task...
  1432. [[email protected]] [main] [ 2018-10-24 18:51:15.938 IST ] [TaskSharedStorageAccess.performTask:310] discoveryASMPaths: 'null'
  1433. [[email protected]] [main] [ 2018-10-24 18:51:15.940 IST ] [TaskSharedStorageAccess.performTask:379] ==> Running t_/dev/mapper/asm-data1p1
  1434. [[email protected]] [main] [ 2018-10-24 18:51:15.940 IST ] [TaskSharedStorageAccess.performTask:387] ==> Waiting to join t_/dev/mapper/asm-data1p1
  1435. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.955 IST ] [TaskSharedStorageAccess$StorageThread.run:898] discoveryASMPaths is null
  1436. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.955 IST ] [TaskSharedStorageAccess$StorageThread.run:902] About to check sharedness for: '/dev/mapper/asm-data1p1'
  1437. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.957 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  1438. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.957 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  1439. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.957 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  1440. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.958 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  1441. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.958 IST ] [Utils.getLocalHost:481] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  1442. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.959 IST ] [Utils.getLocalHost:481] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  1443. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.959 IST ] [UnixSystem.pathExists:973] unixcmd=/usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o NumberOfPasswordPrompts=0 rac-node2 -n /bin/sh -c "if [ -f /etc/oracle/ocr.loc ] ; then echo exists; fi"
  1444. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.960 IST ] [RuntimeExec.runCommand:75] Calling Runtime.exec() with the command
  1445. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.960 IST ] [RuntimeExec.runCommand:77] /usr/bin/ssh
  1446. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.960 IST ] [RuntimeExec.runCommand:77] -o
  1447. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.960 IST ] [RuntimeExec.runCommand:77] FallBackToRsh=no
  1448. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.961 IST ] [RuntimeExec.runCommand:77] -o
  1449. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.961 IST ] [RuntimeExec.runCommand:77] PasswordAuthentication=no
  1450. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.961 IST ] [RuntimeExec.runCommand:77] -o
  1451. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.961 IST ] [RuntimeExec.runCommand:77] StrictHostKeyChecking=yes
  1452. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.962 IST ] [RuntimeExec.runCommand:77] -o
  1453. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.962 IST ] [RuntimeExec.runCommand:77] NumberOfPasswordPrompts=0
  1454. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.962 IST ] [RuntimeExec.runCommand:77] rac-node2
  1455. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.962 IST ] [RuntimeExec.runCommand:77] -n
  1456. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.963 IST ] [RuntimeExec.runCommand:77] /bin/sh
  1457. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.963 IST ] [RuntimeExec.runCommand:77] -c
  1458. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.963 IST ] [RuntimeExec.runCommand:77] "if
  1459. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.963 IST ] [RuntimeExec.runCommand:77] [
  1460. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.964 IST ] [RuntimeExec.runCommand:77] -f
  1461. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.964 IST ] [RuntimeExec.runCommand:77] /etc/oracle/ocr.loc
  1462. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.964 IST ] [RuntimeExec.runCommand:77] ]
  1463. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.964 IST ] [RuntimeExec.runCommand:77] ;
  1464. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.965 IST ] [RuntimeExec.runCommand:77] then
  1465. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.965 IST ] [RuntimeExec.runCommand:77] echo
  1466. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.965 IST ] [RuntimeExec.runCommand:77] exists;
  1467. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.965 IST ] [RuntimeExec.runCommand:77] fi"
  1468. [[email protected]] [Thread-33] [ 2018-10-24 18:51:15.971 IST ] [StreamReader.run:61] In StreamReader.run
  1469. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:15.971 IST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
  1470. [[email protected]] [Thread-34] [ 2018-10-24 18:51:15.971 IST ] [StreamReader.run:61] In StreamReader.run
  1471. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.084 IST ] [RuntimeExec.runCommand:144] runCommand: process returns 0
  1472. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.085 IST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
  1473. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.085 IST ] [RuntimeExec.runCommand:170] RunTimeExec: error>
  1474. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.086 IST ] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
  1475. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.086 IST ] [UnixSystem.pathExists:976] pathExists..RuntimeExec returned 0
  1476. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.087 IST ] [NativeSystem.isCmdScv:502] isCmdScv: cmd=[/usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o NumberOfPasswordPrompts=0 rac-node2 -n /bin/sh -c "if [ -f /etc/oracle/ocr.loc ] ; then echo exists; fi"]
  1477. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.088 IST ] [NativeSystem.isCmdScv:552] isCmdScv: /usr/bin/ssh is present.
  1478. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.088 IST ] [NativeSystem.isCmdScv:554] isCmdScv: /usr/bin/ssh is a file.
  1479. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.088 IST ] [NativeSystem.isCmdScv:571] isCmdScv: returned true
  1480. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.089 IST ] [UnixSystem.pathExists:998] erroutString is :
  1481. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.089 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  1482. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.089 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  1483. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.090 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  1484. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.090 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  1485. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.090 IST ] [Utils.getLocalHost:481] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  1486. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.091 IST ] [Utils.getLocalHost:481] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  1487. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.091 IST ] [UnixSystem.pathExists:973] unixcmd=/usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o NumberOfPasswordPrompts=0 rac-node2 -n /bin/sh -c "if [ -f /etc/oracle/ocr.loc ] ; then echo exists; fi"
  1488. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.092 IST ] [RuntimeExec.runCommand:75] Calling Runtime.exec() with the command
  1489. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.092 IST ] [RuntimeExec.runCommand:77] /usr/bin/ssh
  1490. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.092 IST ] [RuntimeExec.runCommand:77] -o
  1491. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.093 IST ] [RuntimeExec.runCommand:77] FallBackToRsh=no
  1492. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.093 IST ] [RuntimeExec.runCommand:77] -o
  1493. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.094 IST ] [RuntimeExec.runCommand:77] PasswordAuthentication=no
  1494. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.094 IST ] [RuntimeExec.runCommand:77] -o
  1495. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.095 IST ] [RuntimeExec.runCommand:77] StrictHostKeyChecking=yes
  1496. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.095 IST ] [RuntimeExec.runCommand:77] -o
  1497. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.095 IST ] [RuntimeExec.runCommand:77] NumberOfPasswordPrompts=0
  1498. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.096 IST ] [RuntimeExec.runCommand:77] rac-node2
  1499. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.096 IST ] [RuntimeExec.runCommand:77] -n
  1500. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.096 IST ] [RuntimeExec.runCommand:77] /bin/sh
  1501. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.097 IST ] [RuntimeExec.runCommand:77] -c
  1502. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.097 IST ] [RuntimeExec.runCommand:77] "if
  1503. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.097 IST ] [RuntimeExec.runCommand:77] [
  1504. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.097 IST ] [RuntimeExec.runCommand:77] -f
  1505. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.098 IST ] [RuntimeExec.runCommand:77] /etc/oracle/ocr.loc
  1506. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.098 IST ] [RuntimeExec.runCommand:77] ]
  1507. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.098 IST ] [RuntimeExec.runCommand:77] ;
  1508. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.098 IST ] [RuntimeExec.runCommand:77] then
  1509. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.099 IST ] [RuntimeExec.runCommand:77] echo
  1510. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.099 IST ] [RuntimeExec.runCommand:77] exists;
  1511. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.099 IST ] [RuntimeExec.runCommand:77] fi"
  1512. [[email protected]] [Thread-36] [ 2018-10-24 18:51:16.106 IST ] [StreamReader.run:61] In StreamReader.run
  1513. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.106 IST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
  1514. [[email protected]] [Thread-35] [ 2018-10-24 18:51:16.106 IST ] [StreamReader.run:61] In StreamReader.run
  1515. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.223 IST ] [RuntimeExec.runCommand:144] runCommand: process returns 0
  1516. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.224 IST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
  1517. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.224 IST ] [RuntimeExec.runCommand:170] RunTimeExec: error>
  1518. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.225 IST ] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
  1519. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.225 IST ] [UnixSystem.pathExists:976] pathExists..RuntimeExec returned 0
  1520. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.226 IST ] [NativeSystem.isCmdScv:502] isCmdScv: cmd=[/usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o NumberOfPasswordPrompts=0 rac-node2 -n /bin/sh -c "if [ -f /etc/oracle/ocr.loc ] ; then echo exists; fi"]
  1521. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.226 IST ] [NativeSystem.isCmdScv:552] isCmdScv: /usr/bin/ssh is present.
  1522. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.227 IST ] [NativeSystem.isCmdScv:554] isCmdScv: /usr/bin/ssh is a file.
  1523. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.227 IST ] [NativeSystem.isCmdScv:571] isCmdScv: returned true
  1524. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.227 IST ] [UnixSystem.pathExists:998] erroutString is :
  1525. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.228 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against11
  1526. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.228 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  1527. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.228 IST ] [Version.isPre112:427] version to be checked 11.2.0.4.0 minor version to check against2
  1528. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.228 IST ] [Version.isPre112:438] isPre112 : Returning FALSE for minor version check
  1529. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.229 IST ] [UnixSystem.isHAConfigured:2661] olrFileName = /etc/oracle/olr.loc
  1530. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.229 IST ] [Utils.getLocalHost:481] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  1531. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.230 IST ] [Utils.getLocalHost:481] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  1532. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.230 IST ] [UnixSystem.pathExists:973] unixcmd=/usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o NumberOfPasswordPrompts=0 rac-node2 -n /bin/sh -c "if [ -f /etc/oracle/olr.loc ] ; then echo exists; fi"
  1533. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.230 IST ] [RuntimeExec.runCommand:75] Calling Runtime.exec() with the command
  1534. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.231 IST ] [RuntimeExec.runCommand:77] /usr/bin/ssh
  1535. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.231 IST ] [RuntimeExec.runCommand:77] -o
  1536. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.231 IST ] [RuntimeExec.runCommand:77] FallBackToRsh=no
  1537. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.231 IST ] [RuntimeExec.runCommand:77] -o
  1538. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.232 IST ] [RuntimeExec.runCommand:77] PasswordAuthentication=no
  1539. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.232 IST ] [RuntimeExec.runCommand:77] -o
  1540. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.232 IST ] [RuntimeExec.runCommand:77] StrictHostKeyChecking=yes
  1541. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.232 IST ] [RuntimeExec.runCommand:77] -o
  1542. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.233 IST ] [RuntimeExec.runCommand:77] NumberOfPasswordPrompts=0
  1543. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.233 IST ] [RuntimeExec.runCommand:77] rac-node2
  1544. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.233 IST ] [RuntimeExec.runCommand:77] -n
  1545. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.233 IST ] [RuntimeExec.runCommand:77] /bin/sh
  1546. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.233 IST ] [RuntimeExec.runCommand:77] -c
  1547. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.234 IST ] [RuntimeExec.runCommand:77] "if
  1548. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.234 IST ] [RuntimeExec.runCommand:77] [
  1549. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.234 IST ] [RuntimeExec.runCommand:77] -f
  1550. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.234 IST ] [RuntimeExec.runCommand:77] /etc/oracle/olr.loc
  1551. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.235 IST ] [RuntimeExec.runCommand:77] ]
  1552. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.235 IST ] [RuntimeExec.runCommand:77] ;
  1553. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.235 IST ] [RuntimeExec.runCommand:77] then
  1554. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.235 IST ] [RuntimeExec.runCommand:77] echo
  1555. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.236 IST ] [RuntimeExec.runCommand:77] exists;
  1556. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.236 IST ] [RuntimeExec.runCommand:77] fi"
  1557. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.241 IST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
  1558. [[email protected]] [Thread-38] [ 2018-10-24 18:51:16.241 IST ] [StreamReader.run:61] In StreamReader.run
  1559. [[email protected]] [Thread-37] [ 2018-10-24 18:51:16.241 IST ] [StreamReader.run:61] In StreamReader.run
  1560. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.354 IST ] [RuntimeExec.runCommand:144] runCommand: process returns 0
  1561. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.355 IST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
  1562. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.355 IST ] [RuntimeExec.runCommand:170] RunTimeExec: error>
  1563. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.356 IST ] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
  1564. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.356 IST ] [UnixSystem.pathExists:976] pathExists..RuntimeExec returned 0
  1565. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.357 IST ] [NativeSystem.isCmdScv:502] isCmdScv: cmd=[/usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o NumberOfPasswordPrompts=0 rac-node2 -n /bin/sh -c "if [ -f /etc/oracle/olr.loc ] ; then echo exists; fi"]
  1566. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.357 IST ] [NativeSystem.isCmdScv:552] isCmdScv: /usr/bin/ssh is present.
  1567. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.358 IST ] [NativeSystem.isCmdScv:554] isCmdScv: /usr/bin/ssh is a file.
  1568. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.358 IST ] [NativeSystem.isCmdScv:571] isCmdScv: returned true
  1569. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.358 IST ] [UnixSystem.pathExists:998] erroutString is :
  1570. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.358 IST ] [TypeFinder.getStorageInstance:161] NOT on ACFS: '/dev/mapper/asm-data1p1'
  1571. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.359 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  1572. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.359 IST ] [VDMUtil.getCmd4RemExec:123] ==== getCmd4RemExec() called...
  1573. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.359 IST ] [VDMUtil.getCmd4RemExec:130] ==== PROP_REM_COMMAND = 'exectask.sh'
  1574. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.359 IST ] [VerificationUtil.getCmd4RemExec:2830] ==== Remote Exec name: exectask.sh
  1575. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.360 IST ] [VerificationUtil.isLocalNodeOperation:6891] Returning saved value of: false
  1576. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.360 IST ] [VDMUtil.getCmdFiles4RemExec:145] ==== getCmdFiles4RemExec() called...
  1577. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.360 IST ] [VDMUtil.getCmdFiles4RemExec:150] ==== PROP_REM_CDMFILES = 'cv/remenv/runfixup.sh,cv/remenv/orarun.sh,cv/remenv/cvuqdisk-1.0.9-1.rpm,cv/remenv/exectask.sh,cv/remenv/exectask,cv/remenv/pluggable'
  1578. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.360 IST ] [VerificationUtil.listRecursiveFiles:1071] InputList=cv/remenv/runfixup.sh,cv/remenv/orarun.sh,cv/remenv/cvuqdisk-1.0.9-1.rpm,cv/remenv/exectask.sh,cv/remenv/exectask,cv/remenv/pluggable
  1579. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.364 IST ] [VerificationUtil.listRecursiveFiles:1128] OutputList=cv/remenv/runfixup.sh,cv/remenv/orarun.sh,cv/remenv/cvuqdisk-1.0.9-1.rpm,cv/remenv/exectask.sh,cv/remenv/exectask,cv/remenv/pluggable/unix/checkramfs.sh,cv/remenv/pluggable/unix/check_default_gateway.sh,cv/remenv/pluggable/unix/checksyslog.sh,cv/remenv/pluggable/unix/ora_00600_errors_analyzer.sh,cv/remenv/pluggable/unix/shutdown_hwclock_sync.sh,cv/remenv/pluggable/unix/check_jumbo_frames.sh,cv/remenv/pluggable/unix/ora_07445_errors_analyzer.sh,cv/remenv/pluggable/unix/css_reboot_time.sh,cv/remenv/pluggable/unix/css_disk_timeout.sh,cv/remenv/pluggable/unix/check_tcp_packet_retransmit.sh,cv/remenv/pluggable/unix/checksshd.sh,cv/remenv/pluggable/unix/css_diagwait.sh,cv/remenv/pluggable/unix/css_misscount.sh,cv/remenv/pluggable/unix/check_vip_restart_attempt.sh,cv/remenv/pluggable/unix/check_network_packet_reassembly.sh,cv/remenv/pluggable/unix/hangcheck_margin.sh,cv/remenv/pluggable/unix/common_include.sh,cv/remenv/pluggable/unix/listener_naming_convention.sh,cv/remenv/pluggable/unix/check_disk_asynch_io_linking.sh,cv/remenv/pluggable/unix/checkportavail.sh,cv/remenv/pluggable/unix/check_vmm.sh,cv/remenv/pluggable/unix/bdump_dest_trace_analyzer.sh,cv/remenv/pluggable/unix/checkcorefile.sh,cv/remenv/pluggable/unix/hangcheck_tick.sh,cv/remenv/pluggable/unix/getNICSpeed.sh,cv/remenv/pluggable/unix/check_rp_filter.sh,cv/remenv/pluggable/unix/hangchecktimer.sh,cv/remenv/pluggable/unix/check_network_param.sh,cv/remenv/pluggable/unix/alert_log_file_size_analyzer.sh,cv/remenv/pluggable/unix/checkhugepage.sh,cv/remenv/pluggable/unix/checkmemlock.sh,cv/remenv/pluggable/unix/check_non_routable_network_interconnect.sh,cv/remenv/pluggable/unix/core_dump_dest_analyzer.sh,cv/remenv/pluggable/unix/check_e1000.sh,cv/remenv/pluggable/unix/hangcheck_reboot.sh
  1580. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.365 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  1581. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.365 IST ] [NativeResult.<init>:91] NativeResult: The String obtained is0
  1582. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.365 IST ] [NativeResult.<init>:99] The status string is: 0
  1583. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.365 IST ] [RemoteExecCommand.<init>:751] End of constructor call (called by many other constructors internally): RemoteExecCommand(String cmd, String[] args, String[] env, String node, boolean localExecution, String[] cmdFiles, String srcLoc, String[] remExecServerFiles, String destLoc, boolean chkException
  1584. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.366 IST ] [RemoteExecCommand.<init>:687] End of constructor call: RemoteExecCommand(String cmd, String[] args, String[] env, String node, boolean localExecution, String[] cmdFiles, String[] remExecFiles, String destLoc
  1585. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.366 IST ] [RemoteExecCommand.setSubDirAndGroup:1484] Calling setSubDirAndGroup(String subDir, String group) with 'subDir ='CVU_11.2.0.4.0_grid' and 'group = 'null
  1586. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.366 IST ] [VerificationUtil.getLocalHost:854] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  1587. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.367 IST ] [VerificationUtil.isLocalNode:7023]
  1588. Comparing 'rac-node2' to localHOST 'rac-node1'
  1589. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.367 IST ] [VerificationUtil.sameHost:7109] VerificationUtil::sameHost() Host:rac-node2 and Host: rac-node1 are not same.
  1590. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.367 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  1591. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.367 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  1592. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.368 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  1593. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.368 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  1594. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.368 IST ] [VerificationUtil.isLocalNode:7078] Returning: false
  1595. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.369 IST ] [TypeFinder.getStorageInstance:180] stList.size(): 0 cmdList.size(): 1 nodeArray.length: 1
  1596. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.369 IST ] [TypeFinder.getStorageInstance:188] about to get storage type
  1597. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.371 IST ] [ClusterConfig.isClusterInstalled:363] hasJarPresent=false
  1598. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.371 IST ] [ClusterConfig.init:423] Returning same instance to clientt_/dev/mapper/asm-data1p1
  1599. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.371 IST ] [ClusterConfig.submit:488] Entering submit, cmdCount=1
  1600. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.372 IST ] [Semaphore.acquire:109] SyncBufferEmpty:Acquire called by thread t_/dev/mapper/asm-data1p1 m_count=4
  1601. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.372 IST ] [Semaphore.release:85] SyncBufferFull:Release called by thread t_/dev/mapper/asm-data1p1 m_count=1
  1602. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.372 IST ] [ClusterConfig.submit:523] submitted commands=1
  1603. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.373 IST ] [Semaphore.release:85] SyncBufferEmpty:Release called by thread Worker 2 m_count=4
  1604. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.373 IST ] [ClusterConfig.block:596] block called by thread t_/dev/mapper/asm-data1p1 commandNum 1
  1605. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.373 IST ] [VerificationCommand.execute:215] :: Inside execute() [Thread:
  1606. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.373 IST ] [Semaphore.acquire:109] ClientResource Constructor:Blocking Semaphore owned by t_/dev/mapper/asm-data1p1:Acquire called by thread t_/dev/mapper/asm-data1p1 m_count=0
  1607. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.373 IST ] [RemoteExecCommand.validateCmdArgs:1049] Calling validateCmdArgs
  1608. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.373 IST ] [RemoteExecCommand.validateCmdArgs:1055] Checking for arguments validity
  1609. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.374 IST ] [RemoteExecCommand.execute:824] Trying to runRemoteExecCmd first to check if server is already running
  1610. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.374 IST ] [RemoteExecCommand.executeInternal:990] Calling executeInternal()
  1611. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.374 IST ] [RemoteExecCommand.executeInternal:1006] executing the command: '/tmp/CVU_11.2.0.4.0_grid/exectask.sh' with args '-getsttype /dev/mapper/asm-data1p1 ', 'm_stdin == null ->true', 'm_localExecution ->false', 'm_chkException ->false'
  1612. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.375 IST ] [Utils.getLocalHost:481] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  1613. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.375 IST ] [NativeSystem.isCmdScv:502] isCmdScv: cmd=[/usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o NumberOfPasswordPrompts=0 rac-node2 -n ]
  1614. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.376 IST ] [NativeSystem.isCmdScv:552] isCmdScv: /usr/bin/ssh is present.
  1615. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.376 IST ] [NativeSystem.isCmdScv:554] isCmdScv: /usr/bin/ssh is a file.
  1616. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.376 IST ] [NativeSystem.isCmdScv:571] isCmdScv: returned true
  1617. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.377 IST ] [RuntimeExec.runCommand:75] Calling Runtime.exec() with the command
  1618. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.377 IST ] [RuntimeExec.runCommand:77] /bin/sh
  1619. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.377 IST ] [RuntimeExec.runCommand:77] -c
  1620. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.377 IST ] [RuntimeExec.runCommand:77] /usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o NumberOfPasswordPrompts=0 rac-node2 -n /tmp/CVU_11.2.0.4.0_grid/exectask.sh -getsttype /dev/mapper/asm-data1p1
  1621. [[email protected]] [Thread-39] [ 2018-10-24 18:51:16.382 IST ] [StreamReader.run:61] In StreamReader.run
  1622. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.382 IST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
  1623. [[email protected]] [Thread-40] [ 2018-10-24 18:51:16.382 IST ] [StreamReader.run:61] In StreamReader.run
  1624. [[email protected]] [Thread-39] [ 2018-10-24 18:51:16.506 IST ] [StreamReader.run:65] OUTPUT><CV_VAL><BEGIN_STTYPE><STTYPE,DISK><ACCESS,4294967295><REALPATH,/dev/mapper/asm-data1><PREFNAME,/dev/mapper/asm-data1><ENDSTTYPE></CV_VAL><CV_VRES>0</CV_VRES><CV_LOG>Exectask:getsttype success</CV_LOG><CV_ERES>0</CV_ERES>
  1625. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.507 IST ] [RuntimeExec.runCommand:144] runCommand: process returns 0
  1626. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.508 IST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
  1627. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.508 IST ] [RuntimeExec.runCommand:164] <CV_VAL><BEGIN_STTYPE><STTYPE,DISK><ACCESS,4294967295><REALPATH,/dev/mapper/asm-data1><PREFNAME,/dev/mapper/asm-data1><ENDSTTYPE></CV_VAL><CV_VRES>0</CV_VRES><CV_LOG>Exectask:getsttype success</CV_LOG><CV_ERES>0</CV_ERES>
  1628. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.509 IST ] [RuntimeExec.runCommand:170] RunTimeExec: error>
  1629. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.509 IST ] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
  1630. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.510 IST ] [UnixSystem.dorunRemoteExecCmd:3232] retval = 0
  1631. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.510 IST ] [UnixSystem.dorunRemoteExecCmd:3256] exitValue = 0
  1632. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.510 IST ] [RemoteExecCommand.executeInternal:1037] cmdSuccess status: true
  1633. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.511 IST ] [RemoteExecCommand.execute:894] cmdSuccess status: true
  1634. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.511 IST ] [VerificationUtil.fetchTextByTags:2318]
  1635. Tags <CV_VAL> and </CV_VAL> contains:<BEGIN_STTYPE><STTYPE,DISK><ACCESS,4294967295><REALPATH,/dev/mapper/asm-data1><PREFNAME,/dev/mapper/asm-data1><ENDSTTYPE>
  1636.  
  1637. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.512 IST ] [VerificationCommand.execute:234] Formatted exectask output is:
  1638. <CV_VAL><BEGIN_STTYPE><STTYPE,DISK><ACCESS,4294967295><REALPATH,/dev/mapper/asm-data1><PREFNAME,/dev/mapper/asm-data1><ENDSTTYPE></CV_VAL><CV_VRES>0</CV_VRES><CV_LOG>Exectask:getsttype success</CV_LOG><CV_ERES>0</CV_ERES>
  1639. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.512 IST ] [VerificationUtil.fetchTextByTags:2318]
  1640. Tags <CV_VRES> and </CV_VRES> contains:0
  1641.  
  1642. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.512 IST ] [VerificationCommand.execute:245] VfyCode is: 0
  1643. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.513 IST ] [VerificationUtil.fetchTextByTags:2318]
  1644. Tags <CV_ERES> and </CV_ERES> contains:0
  1645.  
  1646. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.513 IST ] [ClusterConfig$ExecuteCommand.returnCommandToClient:2951] returnCommandToClient; fillCount=0 is full=false
  1647. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.514 IST ] [Semaphore.acquire:109] SyncBufferEmpty:Acquire called by thread Worker 2 m_count=200
  1648. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.514 IST ] [Semaphore.release:85] SyncBufferFull:Release called by thread Worker 2 m_count=1
  1649. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.514 IST ] [ClientResource.getListener:157] Calling getListener
  1650. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.515 IST ] [ClusterConfig$ExecuteCommand.run:3046] Owner Thread name of the blocking Semaphore t_/dev/mapper/asm-data1p1
  1651. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.515 IST ] [ClusterConfig$ExecuteCommand.run:3054] Obtained Semaphore
  1652. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.516 IST ] [Semaphore.release:85] ClientResource Constructor:Blocking Semaphore owned by t_/dev/mapper/asm-data1p1:Release called by thread Worker 2 m_count=1
  1653. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.516 IST ] [ClusterConfig$ExecuteCommand.run:3069] Released Semaphore by worker=Worker 2
  1654. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.516 IST ] [ClusterConfig.block:608] block acquired semnum=0
  1655. [[email protected]] [Worker 2] [ 2018-10-24 18:51:16.516 IST ] [Semaphore.acquire:109] SyncBufferFull:Acquire called by thread Worker 2 m_count=0
  1656. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.516 IST ] [ClusterConfig.submit:557] Out of block
  1657. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.517 IST ] [ClusterConfig.submit:574] status=true
  1658. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.517 IST ] [ClusterConfig.destroy:452] destroying resources for client thread Thread[t_/dev/mapper/asm-data1p1,5,main]
  1659. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.517 IST ] [TypeFinder.getStorageInstance:206] getting storage type for noderac-node2
  1660. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.518 IST ] [sCommandHandler.parseTypeResult:210] Access value unknown: '4294967295'
  1661. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.518 IST ] [sCommandHandler.parseTypeResult:215] Adding Access: '-1' for path '/dev/mapper/asm-data1p1'
  1662. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.521 IST ] [RuntimeExec.runCommand:75] Calling Runtime.exec() with the command
  1663. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.521 IST ] [RuntimeExec.runCommand:77] /bin/sh
  1664. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.521 IST ] [RuntimeExec.runCommand:77] -c
  1665. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.522 IST ] [RuntimeExec.runCommand:77] /bin/rpm -q --qf %{version} redhat-release
  1666. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.527 IST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
  1667. [[email protected]] [Thread-41] [ 2018-10-24 18:51:16.527 IST ] [StreamReader.run:61] In StreamReader.run
  1668. [[email protected]] [Thread-42] [ 2018-10-24 18:51:16.527 IST ] [StreamReader.run:61] In StreamReader.run
  1669. [[email protected]] [Thread-41] [ 2018-10-24 18:51:16.593 IST ] [StreamReader.run:65] OUTPUT>package redhat-release is not installed
  1670. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.594 IST ] [RuntimeExec.runCommand:144] runCommand: process returns 1
  1671. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.594 IST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
  1672. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.595 IST ] [RuntimeExec.runCommand:164] package redhat-release is not installed
  1673. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.595 IST ] [RuntimeExec.runCommand:170] RunTimeExec: error>
  1674. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.596 IST ] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
  1675. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.596 IST ] [sVerificationUtil.getUniqueDistributionID:365] Non-zero exit status for cmd: /bin/sh
  1676. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.596 IST ] [sVerificationUtil.getUniqueDistributionID:369] package redhat-release is not installed
  1677. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.597 IST ] [RuntimeExec.runCommand:75] Calling Runtime.exec() with the command
  1678. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.597 IST ] [RuntimeExec.runCommand:77] /bin/sh
  1679. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.597 IST ] [RuntimeExec.runCommand:77] -c
  1680. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.597 IST ] [RuntimeExec.runCommand:77] /bin/rpm -q --qf %{version} enterprise-release
  1681. [[email protected]] [Thread-43] [ 2018-10-24 18:51:16.604 IST ] [StreamReader.run:61] In StreamReader.run
  1682. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.604 IST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
  1683. [[email protected]] [Thread-44] [ 2018-10-24 18:51:16.604 IST ] [StreamReader.run:61] In StreamReader.run
  1684. [[email protected]] [Thread-43] [ 2018-10-24 18:51:16.672 IST ] [StreamReader.run:65] OUTPUT>package enterprise-release is not installed
  1685. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.673 IST ] [RuntimeExec.runCommand:144] runCommand: process returns 1
  1686. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.673 IST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
  1687. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.674 IST ] [RuntimeExec.runCommand:164] package enterprise-release is not installed
  1688. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.674 IST ] [RuntimeExec.runCommand:170] RunTimeExec: error>
  1689. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.674 IST ] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
  1690. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.674 IST ] [sVerificationUtil.getUniqueDistributionID:365] Non-zero exit status for cmd: /bin/sh
  1691. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.675 IST ] [sVerificationUtil.getUniqueDistributionID:369] package enterprise-release is not installed
  1692. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.675 IST ] [RuntimeExec.runCommand:75] Calling Runtime.exec() with the command
  1693. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.675 IST ] [RuntimeExec.runCommand:77] /bin/sh
  1694. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.675 IST ] [RuntimeExec.runCommand:77] -c
  1695. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.676 IST ] [RuntimeExec.runCommand:77] /bin/rpm -q --qf %{version} oraclelinux-release
  1696. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.682 IST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
  1697. [[email protected]] [Thread-45] [ 2018-10-24 18:51:16.682 IST ] [StreamReader.run:61] In StreamReader.run
  1698. [[email protected]] [Thread-46] [ 2018-10-24 18:51:16.682 IST ] [StreamReader.run:61] In StreamReader.run
  1699. [[email protected]] [Thread-45] [ 2018-10-24 18:51:16.750 IST ] [StreamReader.run:65] OUTPUT>6Server
  1700. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.751 IST ] [RuntimeExec.runCommand:144] runCommand: process returns 0
  1701. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.751 IST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
  1702. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.751 IST ] [RuntimeExec.runCommand:164] 6Server
  1703. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.752 IST ] [RuntimeExec.runCommand:170] RunTimeExec: error>
  1704. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.752 IST ] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
  1705. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.753 IST ] [sVerificationUtil.getUniqueDistributionID:390] Successfully executed command: '/bin/sh -c /bin/rpm -q --qf %{version} oraclelinux-release'
  1706. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.753 IST ] [sVerificationUtil.getUniqueDistributionID:402] The command output is: '6Server'
  1707. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.757 IST ] [sCommandHandler.parseTypeResult:222] _st_:type is --> /dev/mapper/asm-data1|rac-node2|/dev/mapper/asm-data1|Disk
  1708. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.757 IST ] [TypeFinder.getStorageInstance:211] There are 1 storage instances in list
  1709. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.758 IST ] [ConfigUtil.isDefined:199] ==== Is CV_RAW_CHECK_ENABLED defined? : true
  1710. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.758 IST ] [ConfigUtil.getConfiguredValue:177] ==== CV_RAW_CHECK_ENABLED is defined as : TRUE
  1711. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.758 IST ] [sStorageUtil.isRawDiscoveryEnabled:113] RawDiscovery enabled? true
  1712. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.758 IST ] [sStorageUtil.isValidStorageType:207] The file type 'Disk' is found suitable for: RAC_DATA_FILES
  1713. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.759 IST ] [VerifyStorage.isSharedInternal:244] _st_:after calling TypeFindergetStorageInstance/dev/mapper/asm-data1|rac-node2|/dev/mapper/asm-data1|Disk
  1714. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.763 IST ] [sStrategyProvider.getSharedVerifyStrategy:108] sDiskSharedVerifyStrategy chosen.
  1715. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.764 IST ] [VerifyStorage.isSharedInternal:252] _st_:about to call strategy.isShared
  1716. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.765 IST ] [SharedVerifyStrategy.isShared:144] This storage type = 1
  1717. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.765 IST ] [SharedVerifyStrategy.isShared:161] about to call getStorageInfo(4 args)
  1718. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.765 IST ] [SharedVerifyStrategy.getStorageInfoByPath:301] getStorageInfoByPath: Calling genInfoCmd with path = /dev/mapper/asm-data1%/dev/mapper/asm-data1p1, and type =1
  1719. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.766 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  1720. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.766 IST ] [VDMUtil.getCmd4RemExec:123] ==== getCmd4RemExec() called...
  1721. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.766 IST ] [VDMUtil.getCmd4RemExec:130] ==== PROP_REM_COMMAND = 'exectask.sh'
  1722. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.766 IST ] [VerificationUtil.getCmd4RemExec:2830] ==== Remote Exec name: exectask.sh
  1723. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.767 IST ] [VerificationUtil.isLocalNodeOperation:6891] Returning saved value of: false
  1724. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.767 IST ] [VDMUtil.getCmdFiles4RemExec:145] ==== getCmdFiles4RemExec() called...
  1725. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.767 IST ] [VDMUtil.getCmdFiles4RemExec:150] ==== PROP_REM_CDMFILES = 'cv/remenv/runfixup.sh,cv/remenv/orarun.sh,cv/remenv/cvuqdisk-1.0.9-1.rpm,cv/remenv/exectask.sh,cv/remenv/exectask,cv/remenv/pluggable'
  1726. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.767 IST ] [VerificationUtil.listRecursiveFiles:1071] InputList=cv/remenv/runfixup.sh,cv/remenv/orarun.sh,cv/remenv/cvuqdisk-1.0.9-1.rpm,cv/remenv/exectask.sh,cv/remenv/exectask,cv/remenv/pluggable
  1727. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.770 IST ] [VerificationUtil.listRecursiveFiles:1128] OutputList=cv/remenv/runfixup.sh,cv/remenv/orarun.sh,cv/remenv/cvuqdisk-1.0.9-1.rpm,cv/remenv/exectask.sh,cv/remenv/exectask,cv/remenv/pluggable/unix/checkramfs.sh,cv/remenv/pluggable/unix/check_default_gateway.sh,cv/remenv/pluggable/unix/checksyslog.sh,cv/remenv/pluggable/unix/ora_00600_errors_analyzer.sh,cv/remenv/pluggable/unix/shutdown_hwclock_sync.sh,cv/remenv/pluggable/unix/check_jumbo_frames.sh,cv/remenv/pluggable/unix/ora_07445_errors_analyzer.sh,cv/remenv/pluggable/unix/css_reboot_time.sh,cv/remenv/pluggable/unix/css_disk_timeout.sh,cv/remenv/pluggable/unix/check_tcp_packet_retransmit.sh,cv/remenv/pluggable/unix/checksshd.sh,cv/remenv/pluggable/unix/css_diagwait.sh,cv/remenv/pluggable/unix/css_misscount.sh,cv/remenv/pluggable/unix/check_vip_restart_attempt.sh,cv/remenv/pluggable/unix/check_network_packet_reassembly.sh,cv/remenv/pluggable/unix/hangcheck_margin.sh,cv/remenv/pluggable/unix/common_include.sh,cv/remenv/pluggable/unix/listener_naming_convention.sh,cv/remenv/pluggable/unix/check_disk_asynch_io_linking.sh,cv/remenv/pluggable/unix/checkportavail.sh,cv/remenv/pluggable/unix/check_vmm.sh,cv/remenv/pluggable/unix/bdump_dest_trace_analyzer.sh,cv/remenv/pluggable/unix/checkcorefile.sh,cv/remenv/pluggable/unix/hangcheck_tick.sh,cv/remenv/pluggable/unix/getNICSpeed.sh,cv/remenv/pluggable/unix/check_rp_filter.sh,cv/remenv/pluggable/unix/hangchecktimer.sh,cv/remenv/pluggable/unix/check_network_param.sh,cv/remenv/pluggable/unix/alert_log_file_size_analyzer.sh,cv/remenv/pluggable/unix/checkhugepage.sh,cv/remenv/pluggable/unix/checkmemlock.sh,cv/remenv/pluggable/unix/check_non_routable_network_interconnect.sh,cv/remenv/pluggable/unix/core_dump_dest_analyzer.sh,cv/remenv/pluggable/unix/check_e1000.sh,cv/remenv/pluggable/unix/hangcheck_reboot.sh
  1728. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.771 IST ] [VerificationUtil.getDestLoc:2717] ==== CV_DESTLOC(pre-fetched value): '/tmp/'
  1729. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.771 IST ] [NativeResult.<init>:91] NativeResult: The String obtained is0
  1730. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.771 IST ] [NativeResult.<init>:99] The status string is: 0
  1731. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.772 IST ] [RemoteExecCommand.<init>:751] End of constructor call (called by many other constructors internally): RemoteExecCommand(String cmd, String[] args, String[] env, String node, boolean localExecution, String[] cmdFiles, String srcLoc, String[] remExecServerFiles, String destLoc, boolean chkException
  1732. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.772 IST ] [RemoteExecCommand.<init>:687] End of constructor call: RemoteExecCommand(String cmd, String[] args, String[] env, String node, boolean localExecution, String[] cmdFiles, String[] remExecFiles, String destLoc
  1733. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.772 IST ] [RemoteExecCommand.setSubDirAndGroup:1484] Calling setSubDirAndGroup(String subDir, String group) with 'subDir ='CVU_11.2.0.4.0_grid' and 'group = 'null
  1734. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.773 IST ] [VerificationUtil.getLocalHost:854] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  1735. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.773 IST ] [VerificationUtil.isLocalNode:7023]
  1736. Comparing 'rac-node2' to localHOST 'rac-node1'
  1737. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.773 IST ] [VerificationUtil.sameHost:7109] VerificationUtil::sameHost() Host:rac-node2 and Host: rac-node1 are not same.
  1738. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.773 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  1739. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.774 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  1740. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.774 IST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against10
  1741. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.774 IST ] [Version.isPre:594] isPre.java: Returning FALSE
  1742. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.775 IST ] [VerificationUtil.isLocalNode:7078] Returning: false
  1743. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.775 IST ] [SharedVerifyStrategy.getStorageInfoByPath:307] _st_:about to gather stinfo
  1744. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.775 IST ] [ClusterConfig.isClusterInstalled:363] hasJarPresent=false
  1745. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.776 IST ] [ClusterConfig.init:423] Returning same instance to clientt_/dev/mapper/asm-data1p1
  1746. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.776 IST ] [ClusterConfig.submit:488] Entering submit, cmdCount=1
  1747. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.776 IST ] [Semaphore.acquire:109] SyncBufferEmpty:Acquire called by thread t_/dev/mapper/asm-data1p1 m_count=4
  1748. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.776 IST ] [Semaphore.release:85] SyncBufferFull:Release called by thread t_/dev/mapper/asm-data1p1 m_count=1
  1749. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.777 IST ] [ClusterConfig.submit:523] submitted commands=1
  1750. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.777 IST ] [Semaphore.release:85] SyncBufferEmpty:Release called by thread Worker 0 m_count=4
  1751. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.777 IST ] [ClusterConfig.block:596] block called by thread t_/dev/mapper/asm-data1p1 commandNum 1
  1752. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.777 IST ] [VerificationCommand.execute:215] :: Inside execute() [Thread:
  1753. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.777 IST ] [Semaphore.acquire:109] ClientResource Constructor:Blocking Semaphore owned by t_/dev/mapper/asm-data1p1:Acquire called by thread t_/dev/mapper/asm-data1p1 m_count=0
  1754. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.777 IST ] [RemoteExecCommand.validateCmdArgs:1049] Calling validateCmdArgs
  1755. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.778 IST ] [RemoteExecCommand.validateCmdArgs:1055] Checking for arguments validity
  1756. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.778 IST ] [RemoteExecCommand.execute:824] Trying to runRemoteExecCmd first to check if server is already running
  1757. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.778 IST ] [RemoteExecCommand.executeInternal:990] Calling executeInternal()
  1758. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.779 IST ] [RemoteExecCommand.executeInternal:1006] executing the command: '/tmp/CVU_11.2.0.4.0_grid/exectask.sh' with args '-getstinfo -getdiskinfo /dev/mapper/asm-data1%/dev/mapper/asm-data1p1 ', 'm_stdin == null ->true', 'm_localExecution ->false', 'm_chkException ->false'
  1759. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.780 IST ] [Utils.getLocalHost:481] Hostname retrieved: rac-node1.lhrc.com, returned: rac-node1
  1760. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.780 IST ] [NativeSystem.isCmdScv:502] isCmdScv: cmd=[/usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o NumberOfPasswordPrompts=0 rac-node2 -n ]
  1761. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.781 IST ] [NativeSystem.isCmdScv:552] isCmdScv: /usr/bin/ssh is present.
  1762. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.781 IST ] [NativeSystem.isCmdScv:554] isCmdScv: /usr/bin/ssh is a file.
  1763. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.782 IST ] [NativeSystem.isCmdScv:571] isCmdScv: returned true
  1764. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.782 IST ] [RuntimeExec.runCommand:75] Calling Runtime.exec() with the command
  1765. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.783 IST ] [RuntimeExec.runCommand:77] /bin/sh
  1766. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.783 IST ] [RuntimeExec.runCommand:77] -c
  1767. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.783 IST ] [RuntimeExec.runCommand:77] /usr/bin/ssh -o FallBackToRsh=no -o PasswordAuthentication=no -o StrictHostKeyChecking=yes -o NumberOfPasswordPrompts=0 rac-node2 -n /tmp/CVU_11.2.0.4.0_grid/exectask.sh -getstinfo -getdiskinfo /dev/mapper/asm-data1%/dev/mapper/asm-data1p1
  1768. [[email protected]] [Thread-48] [ 2018-10-24 18:51:16.790 IST ] [StreamReader.run:61] In StreamReader.run
  1769. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.790 IST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
  1770. [[email protected]] [Thread-47] [ 2018-10-24 18:51:16.790 IST ] [StreamReader.run:61] In StreamReader.run
  1771. [[email protected]] [Thread-47] [ 2018-10-24 18:51:16.923 IST ] [StreamReader.run:65] OUTPUT><CV_ERR>location:sprvsdsk opname:findDisk category:10011</CV_ERR><CV_VRES>10011</CV_VRES><CV_LOG>Exectask:getDiskInfo failed</CV_LOG><CV_ERES>0</CV_ERES>
  1772. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.924 IST ] [RuntimeExec.runCommand:144] runCommand: process returns 0
  1773. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.924 IST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
  1774. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.924 IST ] [RuntimeExec.runCommand:164] <CV_ERR>location:sprvsdsk opname:findDisk category:10011</CV_ERR><CV_VRES>10011</CV_VRES><CV_LOG>Exectask:getDiskInfo failed</CV_LOG><CV_ERES>0</CV_ERES>
  1775. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.925 IST ] [RuntimeExec.runCommand:170] RunTimeExec: error>
  1776. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.925 IST ] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
  1777. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.925 IST ] [UnixSystem.dorunRemoteExecCmd:3232] retval = 0
  1778. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.926 IST ] [UnixSystem.dorunRemoteExecCmd:3256] exitValue = 0
  1779. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.926 IST ] [RemoteExecCommand.executeInternal:1037] cmdSuccess status: true
  1780. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.926 IST ] [RemoteExecCommand.execute:894] cmdSuccess status: true
  1781. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.927 IST ] [VerificationCommand.execute:234] Formatted exectask output is:
  1782. <CV_ERR>location:sprvsdsk opname:findDisk category:10011</CV_ERR><CV_VRES>10011</CV_VRES><CV_LOG>Exectask:getDiskInfo failed</CV_LOG><CV_ERES>0</CV_ERES>
  1783. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.927 IST ] [VerificationUtil.fetchTextByTags:2318]
  1784. Tags <CV_ERR> and </CV_ERR> contains:location:sprvsdsk opname:findDisk category:10011
  1785.  
  1786. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.927 IST ] [VerificationUtil.fetchTextByTags:2318]
  1787. Tags <CV_VRES> and </CV_VRES> contains:10011
  1788.  
  1789. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.927 IST ] [VerificationCommand.execute:245] VfyCode is: 10011
  1790. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.927 IST ] [VerificationUtil.fetchTextByTags:2318]
  1791. Tags <CV_ERES> and </CV_ERES> contains:0
  1792.  
  1793. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.928 IST ] [ClusterConfig$ExecuteCommand.returnCommandToClient:2951] returnCommandToClient; fillCount=0 is full=false
  1794. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.928 IST ] [Semaphore.acquire:109] SyncBufferEmpty:Acquire called by thread Worker 0 m_count=200
  1795. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.928 IST ] [Semaphore.release:85] SyncBufferFull:Release called by thread Worker 0 m_count=1
  1796. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.928 IST ] [ClientResource.getListener:157] Calling getListener
  1797. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.929 IST ] [ClusterConfig$ExecuteCommand.run:3046] Owner Thread name of the blocking Semaphore t_/dev/mapper/asm-data1p1
  1798. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.929 IST ] [ClusterConfig$ExecuteCommand.run:3054] Obtained Semaphore
  1799. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.929 IST ] [Semaphore.release:85] ClientResource Constructor:Blocking Semaphore owned by t_/dev/mapper/asm-data1p1:Release called by thread Worker 0 m_count=1
  1800. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.929 IST ] [ClusterConfig$ExecuteCommand.run:3069] Released Semaphore by worker=Worker 0
  1801. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.929 IST ] [ClusterConfig.block:608] block acquired semnum=0
  1802. [[email protected]] [Worker 0] [ 2018-10-24 18:51:16.929 IST ] [Semaphore.acquire:109] SyncBufferFull:Acquire called by thread Worker 0 m_count=0
  1803. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.930 IST ] [ClusterConfig.submit:557] Out of block
  1804. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.930 IST ] [ClusterConfig.submit:574] status=true
  1805. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.930 IST ] [ClusterConfig.destroy:452] destroying resources for client thread Thread[t_/dev/mapper/asm-data1p1,5,main]
  1806. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.931 IST ] [sCommandHandler.parseInfoResult:691] Storage type=1, Storage path=/dev/mapper/asm-data1%/dev/mapper/asm-data1p1
  1807. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.931 IST ] [sCommandHandler.parseDiskByName:1536] No disks found
  1808. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.932 IST ] [sCommandHandler.parseInfoResult:740] _st_:_st_:couldn't find /dev/mapper/asm-data1%/dev/mapper/asm-data1p1 in lines:
  1809. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.932 IST ] [sCommandHandler.parseInfoResult:743] _st_:<CV_ERR>location:sprvsdsk opname:findDisk category:10011</CV_ERR><CV_VRES>10011</CV_VRES><CV_LOG>Exectask:getDiskInfo failed</CV_LOG><CV_ERES>0</CV_ERES>
  1810. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.932 IST ] [SharedVerifyStrategy.getStorageInfoByPath:352] _st_:Failed to get info from:rac-node2:/dev/mapper/asm-data1%/dev/mapper/asm-data1p1
  1811. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.933 IST ] [SharedVerifyStrategy.isShared:251] No instances found, storage: {rac-node2=/dev/mapper/asm-data1|rac-node2|/dev/mapper/asm-data1|Disk}
  1812. [[email protected]] [t_/dev/mapper/asm-data1p1] [ 2018-10-24 18:51:16.934 IST ] [TaskSharedStorageAccess$StorageThread.run:937] STORAGEEXCEPTION: oracle.ops.verification.framework.storage.StorageException: Could not find the storage
  1813. [[email protected]] [main] [ 2018-10-24 18:51:16.935 IST ] [TaskSharedStorageAccess.performTask:389] ==> Joined t_/dev/mapper/asm-data1p1
  1814. [[email protected]] [main] [ 2018-10-24 18:51:16.936 IST ] [ResultSet.traceResultSet:359]
  1815.  
  1816. Target ResultSet BEFORE Upload===>
  1817. Overall Status->UNKNOWN
  1818.  
  1819.  
  1820.  
  1821. [[email protected]] [main] [ 2018-10-24 18:51:16.936 IST ] [ResultSet.traceResultSet:359]
  1822.  
  1823. Source ResultSet ===>
  1824. Overall Status->OPERATION_FAILED
  1825.  
  1826. rac-node2-->OPERATION_FAILED
  1827.  
  1828.  
  1829. [[email protected]] [main] [ 2018-10-24 18:51:16.937 IST ] [ResultSet.traceResultSet:359]
  1830.  
  1831. Target ResultSet AFTER Upload===>
  1832. Overall Status->OPERATION_FAILED
  1833.  
  1834. rac-node2-->OPERATION_FAILED
  1835.  
  1836.  
  1837. [[email protected]] [main] [ 2018-10-24 18:51:16.938 IST ] [Task.perform:446]
  1838. TaskSharedStorageAccess:Shared Storage Accessibility:/dev/mapper/asm-data1p1:TASK_SUMMARY:FAILED:CRITICAL:OPERATION_FAILED
  1839. ERRORMSG(GLOBAL): Could not find the storage
  1840. [[email protected]] [main] [ 2018-10-24 18:51:16.938 IST ] [StorageComponent.verify:159]
  1841. >>>> StorageComponent:: Upload taskSSA >>>>>
  1842.  
  1843. [[email protected]] [main] [ 2018-10-24 18:51:16.939 IST ] [ResultSet.traceResultSet:359]
  1844.  
  1845. Target ResultSet BEFORE Upload===>
  1846. Overall Status->SUCCESSFUL
  1847.  
  1848. rac-node2-->SUCCESSFUL
  1849.  
  1850.  
  1851. [[email protected]] [main] [ 2018-10-24 18:51:16.939 IST ] [ResultSet.traceResultSet:359]
  1852.  
  1853. Source ResultSet ===>
  1854. Overall Status->OPERATION_FAILED
  1855.  
  1856. rac-node2-->OPERATION_FAILED
  1857.  
  1858.  
  1859. [[email protected]] [main] [ 2018-10-24 18:51:16.940 IST ] [ResultSet.traceResultSet:359]
  1860.  
  1861. Target ResultSet AFTER Upload===>
  1862. Overall Status->OPERATION_FAILED
  1863.  
  1864. rac-node2-->OPERATION_FAILED
  1865.  
  1866.  
  1867. [[email protected]] [main] [ 2018-10-24 18:51:16.940 IST ] [ReportUtil.printReportFooter:1579] compName: ssa
  1868. [[email protected]] [main] [ 2018-10-24 18:51:16.941 IST ] [CluvfyDriver.main:371] ==== cluvfy exiting normally.
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!