Advertisement
Guest User

Untitled

a guest
Nov 4th, 2010
135
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 12.21 KB | None | 0 0
  1. Nov 4 18:06:55 xenmaster004 kernel: DLM (built Oct 10 2010 20:43:00) installed
  2. Nov 4 18:06:56 xenmaster004 corosync[2327]: [MAIN ] Corosync Cluster Engine ('1.2.8'): started and ready to provide service.
  3. Nov 4 18:06:56 xenmaster004 corosync[2327]: [MAIN ] Corosync built-in features: nss rdma
  4. Nov 4 18:06:56 xenmaster004 corosync[2327]: [MAIN ] Successfully read config from /etc/cluster/cluster.conf
  5. Nov 4 18:06:56 xenmaster004 corosync[2327]: [MAIN ] Successfully parsed cman config
  6. Nov 4 18:06:56 xenmaster004 corosync[2327]: [MAIN ] Successfully configured openais services to load
  7. Nov 4 18:06:56 xenmaster004 corosync[2327]: [TOTEM ] Initializing transport (UDP/IP).
  8. Nov 4 18:06:56 xenmaster004 corosync[2327]: [TOTEM ] Initializing transmit/receive security: libtomcrypt SOBER128/SHA1HMAC (mode 0).
  9. Nov 4 18:06:56 xenmaster004 corosync[2327]: [TOTEM ] The network interface [10.255.129.4] is now up.
  10. Nov 4 18:06:56 xenmaster004 corosync[2327]: [QUORUM] Using quorum provider quorum_cman
  11. Nov 4 18:06:56 xenmaster004 corosync[2327]: [SERV ] Service engine loaded: corosync cluster quorum service v0.1
  12. Nov 4 18:06:56 xenmaster004 corosync[2327]: [CMAN ] CMAN 3.0.17 (built Oct 7 2010 06:54:58) started
  13. Nov 4 18:06:56 xenmaster004 corosync[2327]: [SERV ] Service engine loaded: corosync CMAN membership service 2.90
  14. Nov 4 18:06:56 xenmaster004 corosync[2327]: [SERV ] Service engine loaded: openais cluster membership service B.01.01
  15. Nov 4 18:06:56 xenmaster004 corosync[2327]: [SERV ] Service engine loaded: openais event service B.01.01
  16. Nov 4 18:06:56 xenmaster004 corosync[2327]: [SERV ] Service engine loaded: openais checkpoint service B.01.01
  17. Nov 4 18:06:56 xenmaster004 corosync[2327]: [SERV ] Service engine loaded: openais message service B.03.01
  18. Nov 4 18:06:56 xenmaster004 corosync[2327]: [SERV ] Service engine loaded: openais distributed locking service B.03.01
  19. Nov 4 18:06:56 xenmaster004 corosync[2327]: [SERV ] Service engine loaded: openais timer service A.01.01
  20. Nov 4 18:06:56 xenmaster004 corosync[2327]: [SERV ] Service engine loaded: corosync extended virtual synchrony service
  21. Nov 4 18:06:56 xenmaster004 corosync[2327]: [SERV ] Service engine loaded: corosync configuration service
  22. Nov 4 18:06:56 xenmaster004 corosync[2327]: [SERV ] Service engine loaded: corosync cluster closed process group service v1.01
  23. Nov 4 18:06:56 xenmaster004 corosync[2327]: [SERV ] Service engine loaded: corosync cluster config database access v1.01
  24. Nov 4 18:06:56 xenmaster004 corosync[2327]: [SERV ] Service engine loaded: corosync profile loading service
  25. Nov 4 18:06:56 xenmaster004 corosync[2327]: [QUORUM] Using quorum provider quorum_cman
  26. Nov 4 18:06:56 xenmaster004 corosync[2327]: [SERV ] Service engine loaded: corosync cluster quorum service v0.1
  27. Nov 4 18:06:56 xenmaster004 corosync[2327]: [MAIN ] Compatibility mode set to whitetank. Using V1 and V2 of the synchronization engine.
  28. Nov 4 18:06:56 xenmaster004 corosync[2327]: [CLM ] CLM CONFIGURATION CHANGE
  29. Nov 4 18:06:56 xenmaster004 corosync[2327]: [CLM ] New Configuration:
  30. Nov 4 18:06:56 xenmaster004 corosync[2327]: [CLM ] Members Left:
  31. Nov 4 18:06:56 xenmaster004 corosync[2327]: [CLM ] Members Joined:
  32. Nov 4 18:06:56 xenmaster004 corosync[2327]: [CLM ] CLM CONFIGURATION CHANGE
  33. Nov 4 18:06:56 xenmaster004 corosync[2327]: [CLM ] New Configuration:
  34. Nov 4 18:06:56 xenmaster004 corosync[2327]: [CLM ] #011r(0) ip(10.255.129.4)
  35. Nov 4 18:06:56 xenmaster004 corosync[2327]: [CLM ] Members Left:
  36. Nov 4 18:06:56 xenmaster004 corosync[2327]: [CLM ] Members Joined:
  37. Nov 4 18:06:56 xenmaster004 corosync[2327]: [CLM ] #011r(0) ip(10.255.129.4)
  38. Nov 4 18:06:56 xenmaster004 corosync[2327]: [TOTEM ] A processor joined or left the membership and a new membership was formed.
  39. Nov 4 18:06:56 xenmaster004 corosync[2327]: [CMAN ] quorum regained, resuming activity
  40. Nov 4 18:06:56 xenmaster004 corosync[2327]: [QUORUM] This node is within the primary component and will provide service.
  41. Nov 4 18:06:56 xenmaster004 corosync[2327]: [QUORUM] Members[1]: 2
  42. Nov 4 18:06:56 xenmaster004 corosync[2327]: [QUORUM] Members[1]: 2
  43. Nov 4 18:06:56 xenmaster004 corosync[2327]: [MAIN ] Completed service synchronization, ready to provide service.
  44. Nov 4 18:06:56 xenmaster004 corosync[2327]: [CLM ] CLM CONFIGURATION CHANGE
  45. Nov 4 18:06:56 xenmaster004 corosync[2327]: [CLM ] New Configuration:
  46. Nov 4 18:06:56 xenmaster004 corosync[2327]: [CLM ] #011r(0) ip(10.255.129.4)
  47. Nov 4 18:06:56 xenmaster004 corosync[2327]: [CLM ] Members Left:
  48. Nov 4 18:06:56 xenmaster004 corosync[2327]: [CLM ] Members Joined:
  49. Nov 4 18:06:56 xenmaster004 corosync[2327]: [CLM ] CLM CONFIGURATION CHANGE
  50. Nov 4 18:06:56 xenmaster004 corosync[2327]: [CLM ] New Configuration:
  51. Nov 4 18:06:56 xenmaster004 corosync[2327]: [CLM ] #011r(0) ip(10.255.129.3)
  52. Nov 4 18:06:56 xenmaster004 corosync[2327]: [CLM ] #011r(0) ip(10.255.129.4)
  53. Nov 4 18:06:56 xenmaster004 corosync[2327]: [CLM ] Members Left:
  54. Nov 4 18:06:56 xenmaster004 corosync[2327]: [CLM ] Members Joined:
  55. Nov 4 18:06:56 xenmaster004 corosync[2327]: [CLM ] #011r(0) ip(10.255.129.3)
  56. Nov 4 18:06:56 xenmaster004 corosync[2327]: [TOTEM ] A processor joined or left the membership and a new membership was formed.
  57. Nov 4 18:06:56 xenmaster004 corosync[2327]: [QUORUM] Members[2]: 1 2
  58. Nov 4 18:06:56 xenmaster004 corosync[2327]: [QUORUM] Members[2]: 1 2
  59. Nov 4 18:06:56 xenmaster004 corosync[2327]: [MAIN ] Completed service synchronization, ready to provide service.
  60. Nov 4 18:07:00 xenmaster004 fenced[2380]: fenced 3.0.17 started
  61. Nov 4 18:07:00 xenmaster004 dlm_controld[2395]: dlm_controld 3.0.17 started
  62. Nov 4 18:07:00 xenmaster004 gfs_controld[2433]: gfs_controld 3.0.17 started
  63. Nov 4 18:07:55 xenmaster004 kernel: dlm: Using SCTP for communications
  64. Nov 4 18:07:55 xenmaster004 kernel: SCTP: Hash tables configured (established 65536 bind 65536)
  65. Nov 4 18:07:55 xenmaster004 kernel: dlm: connecting to 1 sctp association 1
  66. Nov 4 18:07:56 xenmaster004 clvmd: Cluster LVM daemon started - connected to CMAN
  67. Nov 4 18:11:10 xenmaster004 kernel: INFO: task clvmd:2577 blocked for more than 120 seconds.
  68. Nov 4 18:11:10 xenmaster004 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
  69. Nov 4 18:11:10 xenmaster004 kernel: clvmd D ffff88003a1ebb80 0 2577 1 0x00000080
  70. Nov 4 18:11:10 xenmaster004 kernel: ffff880028c93cc0 0000000000000282 0000000000000000 ffff880028c93fd8
  71. Nov 4 18:11:10 xenmaster004 kernel: 0000000000011cb0 0000000000000001 ffff880028c93fd8 ffff880028c93fd8
  72. Nov 4 18:11:10 xenmaster004 kernel: ffff8800032cb270 000000000000f980 0000000000015740 ffff8800032cb270
  73. Nov 4 18:11:10 xenmaster004 kernel: Call Trace:
  74. Nov 4 18:11:10 xenmaster004 kernel: [<ffffffff8145ccc1>] rwsem_down_failed_common+0x84/0xa1
  75. Nov 4 18:11:10 xenmaster004 kernel: [<ffffffff8145cd2e>] rwsem_down_read_failed+0x26/0x30
  76. Nov 4 18:11:10 xenmaster004 kernel: [<ffffffff81231bc4>] call_rwsem_down_read_failed+0x14/0x30
  77. Nov 4 18:11:10 xenmaster004 kernel: [<ffffffff8145c43a>] ? down_read+0x37/0x3b
  78. Nov 4 18:11:10 xenmaster004 kernel: [<ffffffffa01bfe49>] dlm_user_request+0x46/0x1d9 [dlm]
  79. Nov 4 18:11:10 xenmaster004 kernel: [<ffffffff8100ef91>] ? xen_force_evtchn_callback+0xd/0xf
  80. Nov 4 18:11:10 xenmaster004 kernel: [<ffffffff8100ef91>] ? xen_force_evtchn_callback+0xd/0xf
  81. Nov 4 18:11:10 xenmaster004 kernel: [<ffffffff8100f6af>] ? xen_restore_fl_direct_end+0x0/0x1
  82. Nov 4 18:11:10 xenmaster004 kernel: [<ffffffff8110f556>] ? kmem_cache_alloc_notrace+0x9b/0xbf
  83. Nov 4 18:11:10 xenmaster004 kernel: [<ffffffffa01c7f5b>] device_write+0x362/0x697 [dlm]
  84. Nov 4 18:11:10 xenmaster004 kernel: [<ffffffff811f2200>] ? selinux_file_permission+0x5c/0xb3
  85. Nov 4 18:11:10 xenmaster004 kernel: [<ffffffff811e8535>] ? security_file_permission+0x16/0x18
  86. Nov 4 18:11:10 xenmaster004 kernel: [<ffffffff8111d864>] vfs_write+0xae/0x10b
  87. Nov 4 18:11:10 xenmaster004 kernel: [<ffffffff8111d981>] sys_write+0x4a/0x6e
  88. Nov 4 18:11:10 xenmaster004 kernel: [<ffffffff81012d32>] system_call_fastpath+0x16/0x1b
  89. Nov 4 18:13:10 xenmaster004 kernel: INFO: task clvmd:2577 blocked for more than 120 seconds.
  90. Nov 4 18:13:10 xenmaster004 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
  91. Nov 4 18:13:10 xenmaster004 kernel: clvmd D ffff88003a1ebb80 0 2577 1 0x00000080
  92. Nov 4 18:13:10 xenmaster004 kernel: ffff880028c93cc0 0000000000000282 0000000000000000 ffff880028c93fd8
  93. Nov 4 18:13:10 xenmaster004 kernel: 0000000000011cb0 0000000000000001 ffff880028c93fd8 ffff880028c93fd8
  94. Nov 4 18:13:10 xenmaster004 kernel: ffff8800032cb270 000000000000f980 0000000000015740 ffff8800032cb270
  95. Nov 4 18:13:10 xenmaster004 kernel: Call Trace:
  96. Nov 4 18:13:10 xenmaster004 kernel: [<ffffffff8145ccc1>] rwsem_down_failed_common+0x84/0xa1
  97. Nov 4 18:13:10 xenmaster004 kernel: [<ffffffff8145cd2e>] rwsem_down_read_failed+0x26/0x30
  98. Nov 4 18:13:10 xenmaster004 kernel: [<ffffffff81231bc4>] call_rwsem_down_read_failed+0x14/0x30
  99. Nov 4 18:13:10 xenmaster004 kernel: [<ffffffff8145c43a>] ? down_read+0x37/0x3b
  100. Nov 4 18:13:10 xenmaster004 kernel: [<ffffffffa01bfe49>] dlm_user_request+0x46/0x1d9 [dlm]
  101. Nov 4 18:13:10 xenmaster004 kernel: [<ffffffff8100ef91>] ? xen_force_evtchn_callback+0xd/0xf
  102. Nov 4 18:13:10 xenmaster004 kernel: [<ffffffff8100ef91>] ? xen_force_evtchn_callback+0xd/0xf
  103. Nov 4 18:13:10 xenmaster004 kernel: [<ffffffff8100f6af>] ? xen_restore_fl_direct_end+0x0/0x1
  104. Nov 4 18:13:10 xenmaster004 kernel: [<ffffffff8110f556>] ? kmem_cache_alloc_notrace+0x9b/0xbf
  105. Nov 4 18:13:10 xenmaster004 kernel: [<ffffffffa01c7f5b>] device_write+0x362/0x697 [dlm]
  106. Nov 4 18:13:10 xenmaster004 kernel: [<ffffffff811f2200>] ? selinux_file_permission+0x5c/0xb3
  107. Nov 4 18:13:10 xenmaster004 kernel: [<ffffffff811e8535>] ? security_file_permission+0x16/0x18
  108. Nov 4 18:13:10 xenmaster004 kernel: [<ffffffff8111d864>] vfs_write+0xae/0x10b
  109. Nov 4 18:13:10 xenmaster004 kernel: [<ffffffff8111d981>] sys_write+0x4a/0x6e
  110. Nov 4 18:13:10 xenmaster004 kernel: [<ffffffff81012d32>] system_call_fastpath+0x16/0x1b
  111. Nov 4 18:15:00 xenmaster004 kernel: dlm: writequeue empty for nodeid 1
  112. Nov 4 18:15:10 xenmaster004 kernel: INFO: task clvmd:2577 blocked for more than 120 seconds.
  113. Nov 4 18:15:10 xenmaster004 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
  114. Nov 4 18:15:10 xenmaster004 kernel: clvmd D ffff88003a1ebb80 0 2577 1 0x00000080
  115. Nov 4 18:15:10 xenmaster004 kernel: ffff880028c93cc0 0000000000000282 0000000000000000 ffff880028c93fd8
  116. Nov 4 18:15:10 xenmaster004 kernel: 0000000000011cb0 0000000000000001 ffff880028c93fd8 ffff880028c93fd8
  117. Nov 4 18:15:10 xenmaster004 kernel: ffff8800032cb270 000000000000f980 0000000000015740 ffff8800032cb270
  118. Nov 4 18:15:10 xenmaster004 kernel: Call Trace:
  119. Nov 4 18:15:10 xenmaster004 kernel: [<ffffffff8145ccc1>] rwsem_down_failed_common+0x84/0xa1
  120. Nov 4 18:15:10 xenmaster004 kernel: [<ffffffff8145cd2e>] rwsem_down_read_failed+0x26/0x30
  121. Nov 4 18:15:10 xenmaster004 kernel: [<ffffffff81231bc4>] call_rwsem_down_read_failed+0x14/0x30
  122. Nov 4 18:15:10 xenmaster004 kernel: [<ffffffff8145c43a>] ? down_read+0x37/0x3b
  123. Nov 4 18:15:10 xenmaster004 kernel: [<ffffffffa01bfe49>] dlm_user_request+0x46/0x1d9 [dlm]
  124. Nov 4 18:15:10 xenmaster004 kernel: [<ffffffff8100ef91>] ? xen_force_evtchn_callback+0xd/0xf
  125. Nov 4 18:15:10 xenmaster004 kernel: [<ffffffff8100ef91>] ? xen_force_evtchn_callback+0xd/0xf
  126. Nov 4 18:15:10 xenmaster004 kernel: [<ffffffff8100f6af>] ? xen_restore_fl_direct_end+0x0/0x1
  127. Nov 4 18:15:10 xenmaster004 kernel: [<ffffffff8110f556>] ? kmem_cache_alloc_notrace+0x9b/0xbf
  128. Nov 4 18:15:10 xenmaster004 kernel: [<ffffffffa01c7f5b>] device_write+0x362/0x697 [dlm]
  129. Nov 4 18:15:10 xenmaster004 kernel: [<ffffffff811f2200>] ? selinux_file_permission+0x5c/0xb3
  130. Nov 4 18:15:10 xenmaster004 kernel: [<ffffffff811e8535>] ? security_file_permission+0x16/0x18
  131. Nov 4 18:15:10 xenmaster004 kernel: [<ffffffff8111d864>] vfs_write+0xae/0x10b
  132. Nov 4 18:15:10 xenmaster004 kernel: [<ffffffff8111d981>] sys_write+0x4a/0x6e
  133. Nov 4 18:15:10 xenmaster004 kernel: [<ffffffff81012d32>] system_call_fastpath+0x16/0x1b
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement