Sep 24 14:30:04 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:30:04 xen2 ha-lizard: 11185 ha-lizard already running: Attempt 42 on PIDS: 11187 Sep 24 14:30:07 xen2 ha-lizard: 9924 ha-lizard already running: Attempt 45 on PIDS: 11187 Sep 24 14:30:14 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:30:14 xen2 ha-lizard: 11185 ha-lizard already running: Attempt 43 on PIDS: 11187 Sep 24 14:30:17 xen2 ha-lizard: 9924 ha-lizard already running: Attempt 46 on PIDS: 11187 Sep 24 14:30:24 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:30:25 xen2 ha-lizard: 11185 ha-lizard already running: Attempt 44 on PIDS: 11187 Sep 24 14:30:27 xen2 ha-lizard: 9924 ha-lizard already running: Attempt 47 on PIDS: 11187 Sep 24 14:30:34 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:30:35 xen2 ha-lizard: 11185 ha-lizard already running: Attempt 45 on PIDS: 11187 Sep 24 14:30:37 xen2 ha-lizard: 9924 ha-lizard already running: Attempt 48 on PIDS: 11187 Sep 24 14:30:44 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:30:45 xen2 ha-lizard: 11185 ha-lizard already running: Attempt 46 on PIDS: 11187 Sep 24 14:30:47 xen2 ha-lizard: 9924 ha-lizard already running: Attempt 49 on PIDS: 11187 Sep 24 14:30:54 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:30:55 xen2 ha-lizard: 11185 ha-lizard already running: Attempt 47 on PIDS: 11187 Sep 24 14:30:57 xen2 ha-lizard: 9924 ha-lizard already running: Attempt 50 on PIDS: 11187 Sep 24 14:31:04 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:31:05 xen2 ha-lizard: 11185 ha-lizard already running: Attempt 48 on PIDS: 11187 Sep 24 14:31:07 xen2 ha-lizard: 9924 ha-lizard already running: Attempt 51 on PIDS: 11187 Sep 24 14:31:07 xen2 ha-lizard: 9924 ha-lizard failed to spawn new instance after 51 attmepts. Check xen2.xenpool.local for possible hung process Sep 24 14:31:07 xen2 ha-lizard: 9924 MONITOR has reached configured threshhold - 50 - MONITOR_KILLALL is enabled. - attempting to kill all existing processes Sep 24 14:31:07 xen2 ha-lizard: 9924 Successfully killed all instances of ha-lizard.sh Sep 24 14:31:14 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:31:15 xen2 ha-lizard: 11185 Spawning new instance of ha-lizard Sep 24 14:31:15 xen2 ha-lizard: 26594 Checking if this host is a Pool Master or Slave Sep 24 14:31:15 xen2 ha-lizard: 26594 This host's pool status = slave:10.10.10242 Sep 24 14:31:15 xen2 ha-lizard: 26594 Successfully updated global pool configuration settings in /etc/ha-lizard/ha-lizard.pool.conf. Settings take effect on subsequent run Sep 24 14:31:15 xen2 ha-lizard: 26594 DISABLED_VAPPS=(31b5e105-7d27-d752-db38-f8c5a93852af) ENABLE_LOGGING=1 FENCE_ACTION=stop FENCE_ENABLED=1 FENCE_FILE_LOC=/etc/ha-lizard/fence FENCE_HA_ONFAIL=1 FENCE_HEURISTICS_IPS=() FENCE_HOST_FORGET=0 FENCE_IPADDRESS= FENCE_METHOD=POOL FENCE_MIN_HOSTS=2 FENCE_PASSWD= FENCE_QUORUM_REQUIRED=1 FENCE_REBOOT_LONE_HOST=1 FENCE_USE_IP_HEURISTICS=1 GLOBAL_VM_HA=1 MAIL_FROM="root@localhost" MAIL_ON=0 MAIL_SUBJECT="SYSTEM_ALERT-FROM_HOST:$HOSTNAME" MAIL_TO="root@localhost" MONITOR_DELAY=45 MONITOR_KILLALL=1 MONITOR_MAX_STARTS=50 MONITOR_SCANRATE=10 OP_MODE=1 PROMOTE_SLAVE=1 SLAVE_HA=1 SLAVE_VM_STAT=1 XAPI_COUNT=5 XAPI_DELAY=15 XC_FIELD_NAME='ha-lizard-enabled' XE_TIMEOUT=10 Sep 24 14:31:15 xen2 ha-lizard: 26594 master_ip: Pool Master IP Address = 10.10.10242 Sep 24 14:31:15 xen2 ha-lizard: 26594 This slave - xen2.xenpool.local: f71545f5-e8e6-4cc8-9130-89d67992b735 selected as allowed to become master: setting ALLOW_PROMOTE_MASTER=1 Sep 24 14:31:15 xen2 ha-lizard: 26594 check_xapi: Pool Host 10.10.10242 xapi status = 1 Sep 24 14:31:15 xen2 ha-lizard: 26594 Pool Master is OK - calling function check_ha_enabled - updating local status Sep 24 14:31:16 xen2 ha-lizard: 26594 check_ha_enabled: Checking if ha-lizard is enabled for pool: 43974b5c-6bc8-5030-a990-def1bd87f683 Sep 24 14:31:16 xen2 ha-lizard: 26594 check_ha_enabled: ha-lizard is enabled Sep 24 14:31:16 xen2 ha-lizard: 26594 Checking state file for status if ha-lizard is enabled Sep 24 14:31:16 xen2 ha-lizard: 26594 Statefile /etc/ha-lizard/state/ha_lizard_enabled found: checking if ha-lizard is enabled Sep 24 14:31:16 xen2 ha-lizard: 26594 ha-lizard is enabled - continuing Sep 24 14:31:16 xen2 ha-lizard: 26594 Calling Function write_pool_state - updating local state files Sep 24 14:31:16 xen2 ha-lizard: 26705 Calling Function vm_mon - check if any VMs need to be started Sep 24 14:31:16 xen2 ha-lizard: 26705 vm_mon: ha-lizard in operating mode 1 - managing pool appliances Sep 24 14:31:16 xen2 ha-lizard: 26705 vm_mon: 1 vapps found: 31b5e105-7d27-d752-db38-f8c5a93852af a132f9d0-b7f4-fa64-085c-466dc602b992 Sep 24 14:31:16 xen2 ha-lizard: 26705 vm_mon: Checking if ha_lizard is enabled for UUID: 31b5e105-7d27-d752-db38-f8c5a93852af a132f9d0-b7f4-fa64-085c-466dc602b992 Sep 24 14:31:16 xen2 ha-lizard: 26705 vm_mon: HA disabled for UUID: 31b5e105-7d27-d752-db38-f8c5a93852af a132f9d0-b7f4-fa64-085c-466dc602b992 Sep 24 14:31:16 xen2 ha-lizard: 26594 get_vms_on_host: Returned 9ecfe259-5dee-8ab7-789e-fca5ebcc2795 4f8e9022-4792-af51-b008-35a69f4504b4 2e2860b5-8e28-f33f-0ec6-db0b4053b9d3 Sep 24 14:31:16 xen2 ha-lizard: 26594 get_vms_on_host: Returned 89d5824d-f56c-91c0-793d-ca1cdb7b46fd f6e5d909-d19c-4299-e42d-d1c11ec82a6c 58e722f9-daea-97f4-65d5-7d8271d569ae Sep 24 14:31:17 xen2 ha-lizard: 26594 check_ha_enabled: Checking if ha-lizard is enabled for pool: 43974b5c-6bc8-5030-a990-def1bd87f683 Sep 24 14:31:17 xen2 ha-lizard: 26594 check_ha_enabled: ha-lizard is enabled Sep 24 14:31:17 xen2 ha-lizard: 9924 ha-lizard already running: Attempt 52 on PIDS: 26897 26705 26594 26589 26588 Sep 24 14:31:17 xen2 ha-lizard: 9924 ha-lizard failed to spawn new instance after 52 attmepts. Check xen2.xenpool.local for possible hung process Sep 24 14:31:17 xen2 ha-lizard: 9924 MONITOR has reached configured threshhold - 50 - MONITOR_KILLALL is enabled. - attempting to kill all existing processes Sep 24 14:31:17 xen2 ha-lizard: 9924 Successfully killed all instances of ha-lizard.sh Sep 24 14:31:24 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:31:27 xen2 ha-lizard: 9924 Spawning new instance of ha-lizard Sep 24 14:31:27 xen2 ha-lizard: 27231 Checking if this host is a Pool Master or Slave Sep 24 14:31:27 xen2 ha-lizard: 27231 This host's pool status = slave:10.10.10242 Sep 24 14:31:28 xen2 ha-lizard: 27231 Successfully updated global pool configuration settings in /etc/ha-lizard/ha-lizard.pool.conf. Settings take effect on subsequent run Sep 24 14:31:28 xen2 ha-lizard: 27231 DISABLED_VAPPS=(31b5e105-7d27-d752-db38-f8c5a93852af) ENABLE_LOGGING=1 FENCE_ACTION=stop FENCE_ENABLED=1 FENCE_FILE_LOC=/etc/ha-lizard/fence FENCE_HA_ONFAIL=1 FENCE_HEURISTICS_IPS=() FENCE_HOST_FORGET=0 FENCE_IPADDRESS= FENCE_METHOD=POOL FENCE_MIN_HOSTS=2 FENCE_PASSWD= FENCE_QUORUM_REQUIRED=1 FENCE_REBOOT_LONE_HOST=1 FENCE_USE_IP_HEURISTICS=1 GLOBAL_VM_HA=1 MAIL_FROM="root@localhost" MAIL_ON=0 MAIL_SUBJECT="SYSTEM_ALERT-FROM_HOST:$HOSTNAME" MAIL_TO="root@localhost" MONITOR_DELAY=45 MONITOR_KILLALL=1 MONITOR_MAX_STARTS=50 MONITOR_SCANRATE=10 OP_MODE=1 PROMOTE_SLAVE=1 SLAVE_HA=1 SLAVE_VM_STAT=1 XAPI_COUNT=5 XAPI_DELAY=15 XC_FIELD_NAME='ha-lizard-enabled' XE_TIMEOUT=10 Sep 24 14:31:28 xen2 ha-lizard: 27231 master_ip: Pool Master IP Address = 10.10.10242 Sep 24 14:31:28 xen2 ha-lizard: 27231 This slave - xen2.xenpool.local: f71545f5-e8e6-4cc8-9130-89d67992b735 selected as allowed to become master: setting ALLOW_PROMOTE_MASTER=1 Sep 24 14:31:28 xen2 ha-lizard: 27231 check_xapi: Pool Host 10.10.10242 xapi status = 1 Sep 24 14:31:28 xen2 ha-lizard: 27231 Pool Master is OK - calling function check_ha_enabled - updating local status Sep 24 14:31:28 xen2 ha-lizard: 27231 check_ha_enabled: Checking if ha-lizard is enabled for pool: 43974b5c-6bc8-5030-a990-def1bd87f683 Sep 24 14:31:28 xen2 ha-lizard: 27231 check_ha_enabled: ha-lizard is enabled Sep 24 14:31:28 xen2 ha-lizard: 27231 Checking state file for status if ha-lizard is enabled Sep 24 14:31:28 xen2 ha-lizard: 27231 Statefile /etc/ha-lizard/state/ha_lizard_enabled found: checking if ha-lizard is enabled Sep 24 14:31:28 xen2 ha-lizard: 27231 ha-lizard is enabled - continuing Sep 24 14:31:28 xen2 ha-lizard: 27231 Calling Function write_pool_state - updating local state files Sep 24 14:31:28 xen2 ha-lizard: 27342 Calling Function vm_mon - check if any VMs need to be started Sep 24 14:31:28 xen2 ha-lizard: 27342 vm_mon: ha-lizard in operating mode 1 - managing pool appliances Sep 24 14:31:28 xen2 ha-lizard: 27342 vm_mon: 1 vapps found: 31b5e105-7d27-d752-db38-f8c5a93852af a132f9d0-b7f4-fa64-085c-466dc602b992 Sep 24 14:31:28 xen2 ha-lizard: 27342 vm_mon: Checking if ha_lizard is enabled for UUID: 31b5e105-7d27-d752-db38-f8c5a93852af a132f9d0-b7f4-fa64-085c-466dc602b992 Sep 24 14:31:28 xen2 ha-lizard: 27342 vm_mon: HA disabled for UUID: 31b5e105-7d27-d752-db38-f8c5a93852af a132f9d0-b7f4-fa64-085c-466dc602b992 Sep 24 14:31:29 xen2 ha-lizard: 27231 get_vms_on_host: Returned 9ecfe259-5dee-8ab7-789e-fca5ebcc2795 4f8e9022-4792-af51-b008-35a69f4504b4 2e2860b5-8e28-f33f-0ec6-db0b4053b9d3 Sep 24 14:31:29 xen2 ha-lizard: 27231 get_vms_on_host: Returned 89d5824d-f56c-91c0-793d-ca1cdb7b46fd f6e5d909-d19c-4299-e42d-d1c11ec82a6c 58e722f9-daea-97f4-65d5-7d8271d569ae Sep 24 14:31:30 xen2 ha-lizard: 27231 check_ha_enabled: Checking if ha-lizard is enabled for pool: 43974b5c-6bc8-5030-a990-def1bd87f683 Sep 24 14:31:30 xen2 ha-lizard: 27231 check_ha_enabled: ha-lizard is enabled Sep 24 14:31:30 xen2 ha-lizard: 27231 get_pool_host_list: enabled flag set - returning only hosts with enabled=true Sep 24 14:31:30 xen2 ha-lizard: 27231 get_pool_host_list: returned f71545f5-e8e6-4cc8-9130-89d67992b735 de769f75-ac15-4c1f-8be9-24e457319c55 Sep 24 14:31:30 xen2 ha-lizard: 27231 get_pool_ip_list: returned 10.10.10243 Sep 24 14:31:30 xen2 ha-lizard: 27231 get_pool_ip_list: returned 10.10.10243 10.10.10242 Sep 24 14:31:34 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:31:44 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:31:54 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:32:00 xen2 ha-lizard: 26586 Spawning new instance of ha-lizard Sep 24 14:32:00 xen2 ha-lizard: 28600 Checking if this host is a Pool Master or Slave Sep 24 14:32:00 xen2 ha-lizard: 28600 This host's pool status = slave:10.10.10242 Sep 24 14:32:00 xen2 ha-lizard: 28600 Successfully updated global pool configuration settings in /etc/ha-lizard/ha-lizard.pool.conf. Settings take effect on subsequent run Sep 24 14:32:00 xen2 ha-lizard: 28600 DISABLED_VAPPS=(31b5e105-7d27-d752-db38-f8c5a93852af) ENABLE_LOGGING=1 FENCE_ACTION=stop FENCE_ENABLED=1 FENCE_FILE_LOC=/etc/ha-lizard/fence FENCE_HA_ONFAIL=1 FENCE_HEURISTICS_IPS=() FENCE_HOST_FORGET=0 FENCE_IPADDRESS= FENCE_METHOD=POOL FENCE_MIN_HOSTS=2 FENCE_PASSWD= FENCE_QUORUM_REQUIRED=1 FENCE_REBOOT_LONE_HOST=1 FENCE_USE_IP_HEURISTICS=1 GLOBAL_VM_HA=1 MAIL_FROM="root@localhost" MAIL_ON=0 MAIL_SUBJECT="SYSTEM_ALERT-FROM_HOST:$HOSTNAME" MAIL_TO="root@localhost" MONITOR_DELAY=45 MONITOR_KILLALL=1 MONITOR_MAX_STARTS=50 MONITOR_SCANRATE=10 OP_MODE=1 PROMOTE_SLAVE=1 SLAVE_HA=1 SLAVE_VM_STAT=1 XAPI_COUNT=5 XAPI_DELAY=15 XC_FIELD_NAME='ha-lizard-enabled' XE_TIMEOUT=10 Sep 24 14:32:00 xen2 ha-lizard: 28600 master_ip: Pool Master IP Address = 10.10.10242 Sep 24 14:32:00 xen2 ha-lizard: 28600 This slave - xen2.xenpool.local: f71545f5-e8e6-4cc8-9130-89d67992b735 selected as allowed to become master: setting ALLOW_PROMOTE_MASTER=1 Sep 24 14:32:00 xen2 ha-lizard: 28600 check_xapi: Pool Host 10.10.10.242 xapi status = 1 Sep 24 14:32:00 xen2 ha-lizard: 28600 Pool Master is OK - calling function check_ha_enabled - updating local status Sep 24 14:32:01 xen2 ha-lizard: 28600 check_ha_enabled: Checking if ha-lizard is enabled for pool: 43974b5c-6bc8-5030-a990-def1bd87f683 Sep 24 14:32:01 xen2 ha-lizard: 28600 check_ha_enabled: ha-lizard is enabled Sep 24 14:32:01 xen2 ha-lizard: 28600 Checking state file for status if ha-lizard is enabled Sep 24 14:32:01 xen2 ha-lizard: 28600 Statefile /etc/ha-lizard/state/ha_lizard_enabled found: checking if ha-lizard is enabled Sep 24 14:32:01 xen2 ha-lizard: 28600 ha-lizard is enabled - continuing Sep 24 14:32:01 xen2 ha-lizard: 28600 Calling Function write_pool_state - updating local state files Sep 24 14:32:01 xen2 ha-lizard: 28720 Calling Function vm_mon - check if any VMs need to be started Sep 24 14:32:01 xen2 ha-lizard: 28720 vm_mon: ha-lizard in operating mode 1 - managing pool appliances Sep 24 14:32:01 xen2 ha-lizard: 28720 vm_mon: 1 vapps found: 31b5e105-7d27-d752-db38-f8c5a93852af a132f9d0-b7f4-fa64-085c-466dc602b992 Sep 24 14:32:01 xen2 ha-lizard: 28720 vm_mon: Checking if ha_lizard is enabled for UUID: 31b5e105-7d27-d752-db38-f8c5a93852af a132f9d0-b7f4-fa64-085c-466dc602b992 Sep 24 14:32:01 xen2 ha-lizard: 28720 vm_mon: HA disabled for UUID: 31b5e105-7d27-d752-db38-f8c5a93852af a132f9d0-b7f4-fa64-085c-466dc602b992 Sep 24 14:32:01 xen2 ha-lizard: 28600 get_vms_on_host: Returned 9ecfe259-5dee-8ab7-789e-fca5ebcc2795 4f8e9022-4792-af51-b008-35a69f4504b4 2e2860b5-8e28-f33f-0ec6-db0b4053b9d3 Sep 24 14:32:01 xen2 ha-lizard: 28600 get_vms_on_host: Returned 89d5824d-f56c-91c0-793d-ca1cdb7b46fd f6e5d909-d19c-4299-e42d-d1c11ec82a6c 58e722f9-daea-97f4-65d5-7d8271d569ae Sep 24 14:32:02 xen2 ha-lizard: 28600 check_ha_enabled: Checking if ha-lizard is enabled for pool: 43974b5c-6bc8-5030-a990-def1bd87f683 Sep 24 14:32:02 xen2 ha-lizard: 28600 check_ha_enabled: ha-lizard is enabled Sep 24 14:32:02 xen2 ha-lizard: 28600 get_pool_host_list: enabled flag set - returning only hosts with enabled=true Sep 24 14:32:02 xen2 ha-lizard: 28600 get_pool_host_list: returned f71545f5-e8e6-4cc8-9130-89d67992b735 de769f75-ac15-4c1f-8be9-24e457319c55 Sep 24 14:32:03 xen2 ha-lizard: 28600 get_pool_ip_list: returned 10.10.10.243 Sep 24 14:32:03 xen2 ha-lizard: 28600 get_pool_ip_list: returned 10.10.10.243 10.10.10.242 Sep 24 14:32:04 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:32:12 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 1 on PIDS: 28594 Sep 24 14:32:14 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:32:22 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 2 on PIDS: 28594 Sep 24 14:32:24 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:32:32 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 3 on PIDS: 28594 Sep 24 14:32:34 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:32:42 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 4 on PIDS: 28594 Sep 24 14:32:44 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:32:45 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 1 on PIDS: 28594 Sep 24 14:32:52 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 5 on PIDS: 28594 Sep 24 14:32:54 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:32:55 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 2 on PIDS: 28594 Sep 24 14:33:03 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 6 on PIDS: 28594 Sep 24 14:33:04 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:33:05 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 3 on PIDS: 28594 Sep 24 14:33:13 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 7 on PIDS: 28594 Sep 24 14:33:14 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:33:15 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 4 on PIDS: 28594 Sep 24 14:33:23 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 8 on PIDS: 28594 Sep 24 14:33:25 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:33:25 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 5 on PIDS: 28594 Sep 24 14:33:33 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 9 on PIDS: 28594 Sep 24 14:33:35 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:33:35 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 6 on PIDS: 28594 Sep 24 14:33:43 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 10 on PIDS: 28594 Sep 24 14:33:45 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:33:45 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 7 on PIDS: 28594 Sep 24 14:33:53 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 11 on PIDS: 28594 Sep 24 14:33:55 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:33:55 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 8 on PIDS: 28594 Sep 24 14:34:03 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 12 on PIDS: 28594 Sep 24 14:34:05 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:34:05 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 9 on PIDS: 28594 Sep 24 14:34:13 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 13 on PIDS: 28594 Sep 24 14:34:15 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:34:16 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 10 on PIDS: 28594 Sep 24 14:34:23 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 14 on PIDS: 28594 Sep 24 14:34:25 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:34:26 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 11 on PIDS: 28594 Sep 24 14:34:33 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 15 on PIDS: 28594 Sep 24 14:34:35 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:34:36 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 12 on PIDS: 28594 Sep 24 14:34:43 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 16 on PIDS: 28594 Sep 24 14:34:45 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:34:46 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 13 on PIDS: 28594 Sep 24 14:34:53 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 17 on PIDS: 28594 Sep 24 14:34:55 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:34:56 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 14 on PIDS: 28594 Sep 24 14:35:03 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 18 on PIDS: 28594 Sep 24 14:35:05 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:35:06 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 15 on PIDS: 28594 Sep 24 14:35:13 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 19 on PIDS: 28594 Sep 24 14:35:15 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:35:16 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 16 on PIDS: 28594 Sep 24 14:35:23 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 20 on PIDS: 28594 Sep 24 14:35:25 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:35:26 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 17 on PIDS: 28594 Sep 24 14:35:33 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 21 on PIDS: 28594 Sep 24 14:35:35 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:35:36 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 18 on PIDS: 28594 Sep 24 14:35:44 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 22 on PIDS: 28594 Sep 24 14:35:45 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:35:46 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 19 on PIDS: 28594 Sep 24 14:35:54 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 23 on PIDS: 28594 Sep 24 14:35:55 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:35:56 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 20 on PIDS: 28594 Sep 24 14:36:04 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 24 on PIDS: 28594 Sep 24 14:36:05 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:36:06 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 21 on PIDS: 28594 Sep 24 14:36:14 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 25 on PIDS: 28594 Sep 24 14:36:15 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:36:16 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 22 on PIDS: 28594 Sep 24 14:36:24 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 26 on PIDS: 28594 Sep 24 14:36:25 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:36:26 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 23 on PIDS: 28594 Sep 24 14:36:34 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 27 on PIDS: 28594 Sep 24 14:36:35 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:36:36 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 24 on PIDS: 28594 Sep 24 14:36:44 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 28 on PIDS: 28594 Sep 24 14:36:45 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:36:46 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 25 on PIDS: 28594 Sep 24 14:36:54 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 29 on PIDS: 28594 Sep 24 14:36:55 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:36:57 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 26 on PIDS: 28594 Sep 24 14:37:04 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 30 on PIDS: 28594 Sep 24 14:37:05 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:37:07 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 27 on PIDS: 28594 Sep 24 14:37:14 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 31 on PIDS: 28594 Sep 24 14:37:15 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:37:17 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 28 on PIDS: 28594 Sep 24 14:37:24 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 32 on PIDS: 28594 Sep 24 14:37:25 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:37:27 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 29 on PIDS: 28594 Sep 24 14:37:34 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 33 on PIDS: 28594 Sep 24 14:37:35 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:37:37 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 30 on PIDS: 28594 Sep 24 14:37:44 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 34 on PIDS: 28594 Sep 24 14:37:45 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:37:47 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 31 on PIDS: 28594 Sep 24 14:37:54 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 35 on PIDS: 28594 Sep 24 14:37:55 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:37:57 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 32 on PIDS: 28594 Sep 24 14:38:04 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 36 on PIDS: 28594 Sep 24 14:38:05 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:38:07 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 33 on PIDS: 28594 Sep 24 14:38:14 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 37 on PIDS: 28594 Sep 24 14:38:15 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:38:17 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 34 on PIDS: 28594 Sep 24 14:38:24 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 38 on PIDS: 28594 Sep 24 14:38:25 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:38:27 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 35 on PIDS: 28594 Sep 24 14:38:35 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 39 on PIDS: 28594 Sep 24 14:38:35 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:38:37 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 36 on PIDS: 28594 Sep 24 14:38:45 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 40 on PIDS: 28594 Sep 24 14:38:45 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:38:47 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 37 on PIDS: 28594 Sep 24 14:38:55 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 41 on PIDS: 28594 Sep 24 14:38:55 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:38:57 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 38 on PIDS: 28594 Sep 24 14:39:05 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 42 on PIDS: 28594 Sep 24 14:39:05 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:39:07 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 39 on PIDS: 28594 Sep 24 14:39:15 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 43 on PIDS: 28594 Sep 24 14:39:15 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:39:17 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 40 on PIDS: 28594 Sep 24 14:39:25 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 44 on PIDS: 28594 Sep 24 14:39:25 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:39:27 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 41 on PIDS: 28594 Sep 24 14:39:35 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 45 on PIDS: 28594 Sep 24 14:39:35 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:39:37 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 42 on PIDS: 28594 Sep 24 14:39:45 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 46 on PIDS: 28594 Sep 24 14:39:45 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:39:48 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 43 on PIDS: 28594 Sep 24 14:39:55 xen2 ha-lizard: 8668 ha-lizard Watchdog: ha-lizard running - OK Sep 24 14:39:55 xen2 ha-lizard: 27223 ha-lizard already running: Attempt 47 on PIDS: 28594 Sep 24 14:39:58 xen2 ha-lizard: 28592 ha-lizard already running: Attempt 44 on PIDS: 28594