Sep 10 16:48:14 xs2 ha-lizard: 3957 ha-lizard Watchdog: ha-lizard running - OK Sep 10 16:48:14 xs2 ha-lizard: 11235 Spawning new instance of ha-lizard Sep 10 16:48:14 xs2 ha-lizard: 11757 Mail Spool Directory Found /dev/shm/ha-lizard-mail Sep 10 16:48:14 xs2 ha-lizard: 11757 This iteration is count 9 Sep 10 16:48:14 xs2 ha-lizard: 11757 Checking if this host is a Pool Master or Slave Sep 10 16:48:14 xs2 ha-lizard: 11757 This host's pool status = slave:192.168.199.200 Sep 10 16:48:14 xs2 ha-lizard: 11757 Successfully updated global pool configuration settings in /etc/ha-lizard/ha-lizard.pool.conf. Settings take effect on subsequent run Sep 10 16:48:14 xs2 ha-lizard: 11757 DISABLED_VAPPS=() ENABLE_LOGGING=1 FENCE_ACTION=stop FENCE_ENABLED=1 FENCE_FILE_LOC=/etc/ha-lizard/fence FENCE_HA_ONFAIL=0 FENCE_HEURISTICS_IPS=192.168.199.1 FENCE_HOST_FORGET=0 FENCE_IPADDRESS= FENCE_METHOD=POOL FENCE_MIN_HOSTS=2 FENCE_PASSWD= FENCE_QUORUM_REQUIRED=1 FENCE_REBOOT_LONE_HOST=0 FENCE_USE_IP_HEURISTICS=1 GLOBAL_VM_HA=1 MAIL_FROM="root@localhost" MAIL_ON=1 MAIL_SUBJECT="SYSTEM_ALERT-FROM_HOST:$HOSTNAME" MAIL_TO="root@localhost" MONITOR_DELAY=15 MONITOR_KILLALL=1 MONITOR_MAX_STARTS=20 MONITOR_SCANRATE=10 OP_MODE=2 PROMOTE_SLAVE=1 SLAVE_HA=1 SLAVE_VM_STAT=0 SMTP_PASS="" SMTP_PORT="25" SMTP_SERVER="127.0.0.1" SMTP_USER="" XAPI_COUNT=2 XAPI_DELAY=10 XC_FIELD_NAME='ha-lizard-enabled' XE_TIMEOUT=10 Sep 10 16:48:14 xs2 ha-lizard: 11757 master_ip: Pool Master IP Address = 192.168.199.200 Sep 10 16:48:14 xs2 ha-lizard: 11757 This slave - xs2: 79769bcb-ad49-4ce1-8b27-51234c5b418f selected as allowed to become master: setting ALLOW_PROMOTE_MASTER=1 Sep 10 16:48:14 xs2 ha-lizard: 11757 check_xapi: Pool Host 192.168.199.200 xapi status = 1 Sep 10 16:48:14 xs2 ha-lizard: 11757 Pool Master is OK - calling function check_ha_enabled - updating local status Sep 10 16:48:14 xs2 ha-lizard: 11757 check_ha_enabled: Checking if ha-lizard is enabled for pool: 3243bef3-b686-d02f-0d53-9e9529ee9639 Sep 10 16:48:14 xs2 ha-lizard: 11757 check_ha_enabled: ha-lizard is enabled Sep 10 16:48:14 xs2 ha-lizard: 11757 Checking state file for status if ha-lizard is enabled Sep 10 16:48:14 xs2 ha-lizard: 11757 Statefile /etc/ha-lizard/state/ha_lizard_enabled found: checking if ha-lizard is enabled Sep 10 16:48:14 xs2 ha-lizard: 11757 ha-lizard is enabled - continuing Sep 10 16:48:14 xs2 ha-lizard: 11757 check_xs_ha: Checking XenServer HA status Sep 10 16:48:15 xs2 ha-lizard: 11757 Calling Function write_pool_state - updating local state files Sep 10 16:48:15 xs2 ha-lizard: 11757 get_vms_on_host: No VMs found on host: 26c15cda-7a26-41e8-a2f7-cdd7a9d5df8f Sep 10 16:48:15 xs2 ha-lizard: 11757 get_vms_on_host: No VMs found on host: 79769bcb-ad49-4ce1-8b27-51234c5b418f Sep 10 16:48:16 xs2 ha-lizard: 11757 check_ha_enabled: Checking if ha-lizard is enabled for pool: 3243bef3-b686-d02f-0d53-9e9529ee9639 Sep 10 16:48:16 xs2 ha-lizard: 11757 check_ha_enabled: ha-lizard is enabled Sep 10 16:48:16 xs2 ha-lizard: 11757 get_pool_host_list: enabled flag set - returning only hosts with enabled=true Sep 10 16:48:16 xs2 ha-lizard: 11757 get_pool_host_list: returned 26c15cda-7a26-41e8-a2f7-cdd7a9d5df8f 79769bcb-ad49-4ce1-8b27-51234c5b418f Sep 10 16:48:16 xs2 ha-lizard: 11757 get_pool_ip_list: returned 192.168.199.200 Sep 10 16:48:16 xs2 ha-lizard: 11757 get_pool_ip_list: returned 192.168.199.200 192.168.199.159 Sep 10 16:48:24 xs2 ha-lizard: 3957 ha-lizard Watchdog: ha-lizard running - OK Sep 10 16:48:29 xs2 ha-lizard: 11749 Spawning new instance of ha-lizard Sep 10 16:48:29 xs2 ha-lizard: 12333 Mail Spool Directory Found /dev/shm/ha-lizard-mail Sep 10 16:48:29 xs2 ha-lizard: 12333 This iteration is count 10 Sep 10 16:48:29 xs2 ha-lizard: 12333 Checking if this host is a Pool Master or Slave Sep 10 16:48:29 xs2 ha-lizard: 12333 This host's pool status = slave:192.168.199.200 Sep 10 16:48:29 xs2 ha-lizard: 12333 Successfully updated global pool configuration settings in /etc/ha-lizard/ha-lizard.pool.conf. Settings take effect on subsequent run Sep 10 16:48:29 xs2 ha-lizard: 12333 DISABLED_VAPPS=() ENABLE_LOGGING=1 FENCE_ACTION=stop FENCE_ENABLED=1 FENCE_FILE_LOC=/etc/ha-lizard/fence FENCE_HA_ONFAIL=0 FENCE_HEURISTICS_IPS=192.168.199.1 FENCE_HOST_FORGET=0 FENCE_IPADDRESS= FENCE_METHOD=POOL FENCE_MIN_HOSTS=2 FENCE_PASSWD= FENCE_QUORUM_REQUIRED=1 FENCE_REBOOT_LONE_HOST=0 FENCE_USE_IP_HEURISTICS=1 GLOBAL_VM_HA=1 MAIL_FROM="root@localhost" MAIL_ON=1 MAIL_SUBJECT="SYSTEM_ALERT-FROM_HOST:$HOSTNAME" MAIL_TO="root@localhost" MONITOR_DELAY=15 MONITOR_KILLALL=1 MONITOR_MAX_STARTS=20 MONITOR_SCANRATE=10 OP_MODE=2 PROMOTE_SLAVE=1 SLAVE_HA=1 SLAVE_VM_STAT=0 SMTP_PASS="" SMTP_PORT="25" SMTP_SERVER="127.0.0.1" SMTP_USER="" XAPI_COUNT=2 XAPI_DELAY=10 XC_FIELD_NAME='ha-lizard-enabled' XE_TIMEOUT=10 Sep 10 16:48:29 xs2 ha-lizard: 12333 master_ip: Pool Master IP Address = 192.168.199.200 Sep 10 16:48:29 xs2 ha-lizard: 12333 This slave - xs2: 79769bcb-ad49-4ce1-8b27-51234c5b418f selected as allowed to become master: setting ALLOW_PROMOTE_MASTER=1 Sep 10 16:48:29 xs2 ha-lizard: 12333 check_xapi: Pool Host 192.168.199.200 xapi status = 1 Sep 10 16:48:29 xs2 ha-lizard: 12333 Pool Master is OK - calling function check_ha_enabled - updating local status Sep 10 16:48:30 xs2 ha-lizard: 12333 check_ha_enabled: Checking if ha-lizard is enabled for pool: 3243bef3-b686-d02f-0d53-9e9529ee9639 Sep 10 16:48:30 xs2 ha-lizard: 12333 check_ha_enabled: ha-lizard is enabled Sep 10 16:48:30 xs2 ha-lizard: 12333 Checking state file for status if ha-lizard is enabled Sep 10 16:48:30 xs2 ha-lizard: 12333 Statefile /etc/ha-lizard/state/ha_lizard_enabled found: checking if ha-lizard is enabled Sep 10 16:48:30 xs2 ha-lizard: 12333 ha-lizard is enabled - continuing Sep 10 16:48:30 xs2 ha-lizard: 12333 check_xs_ha: Checking XenServer HA status Sep 10 16:48:30 xs2 ha-lizard: 12333 Calling Function write_pool_state - updating local state files Sep 10 16:48:30 xs2 ha-lizard: 12333 get_vms_on_host: No VMs found on host: 26c15cda-7a26-41e8-a2f7-cdd7a9d5df8f Sep 10 16:48:30 xs2 ha-lizard: 12333 get_vms_on_host: No VMs found on host: 79769bcb-ad49-4ce1-8b27-51234c5b418f Sep 10 16:48:31 xs2 ha-lizard: 12333 check_ha_enabled: Checking if ha-lizard is enabled for pool: 3243bef3-b686-d02f-0d53-9e9529ee9639 Sep 10 16:48:31 xs2 ha-lizard: 12333 check_ha_enabled: ha-lizard is enabled Sep 10 16:48:31 xs2 ha-lizard: 12333 get_pool_host_list: enabled flag set - returning only hosts with enabled=true Sep 10 16:48:31 xs2 ha-lizard: 12333 get_pool_host_list: returned 79769bcb-ad49-4ce1-8b27-51234c5b418f Sep 10 16:48:31 xs2 ha-lizard: 12333 get_pool_ip_list: returned 192.168.199.159 Sep 10 16:48:34 xs2 ha-lizard: 3957 ha-lizard Watchdog: ha-lizard running - OK Sep 10 16:48:44 xs2 ha-lizard: 3957 ha-lizard Watchdog: ha-lizard running - OK Sep 10 16:48:44 xs2 ha-lizard: 12325 Spawning new instance of ha-lizard Sep 10 16:48:44 xs2 ha-lizard: 12790 Mail Spool Directory Found /dev/shm/ha-lizard-mail Sep 10 16:48:44 xs2 ha-lizard: 12790 This iteration is count 11 Sep 10 16:48:44 xs2 ha-lizard: 12790 Checking if this host is a Pool Master or Slave Sep 10 16:48:44 xs2 ha-lizard: 12790 This host's pool status = slave:192.168.199.200 Sep 10 16:48:47 xs2 ha-lizard: 12790 Failed to update global pool configuration settings in /etc/ha-lizard/ha-lizard.pool.conf - Check Configuration! Sep 10 16:48:47 xs2 ha-lizard: 12790 Mail Spool Directory Found /dev/shm/ha-lizard-mail Sep 10 16:48:47 xs2 ha-lizard: 12790 email: Sending ALERT email to root@localhost: Failed to update global pool configuration settings in /etc/ha-lizard/ha-lizard.pool.conf - Check Configuration! Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Sending email from: root@localhost Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Sending email to: root@localhost Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Email Alert Subject: SYSTEM_ALERT-FROM_HOST:xs2 Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Email Alert Timestamp: Thu Sep 10 16:48:47 EDT 2015 Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Email Alert Process: ha-lizard Version: 1.8.7 Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Email Alert Message Content: Failed to update global pool configuration settings in /etc/ha-lizard/ha-lizard.pool.conf - Check Configuration! Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Email Alert Message Hostname: xs2 Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Traceback (most recent call last): Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: File "/etc/ha-lizard/scripts/email_alert.py", line 104, in ? Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: message = smtplib.SMTP(smtp_server, smtp_port, hostname) Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: File "/usr/lib64/python2.4/smtplib.py", line 244, in __init__ Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: (code, msg) = self.connect(host, port) Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: File "/usr/lib64/python2.4/smtplib.py", line 306, in connect Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: raise socket.error, msg Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: socket.error: (111, 'Connection refused') Sep 10 16:48:47 xs2 ha-lizard: 12790 email: Message copied to /dev/shm/ha-lizard-mail/1441918127.msg - Suppressing duplicates for 60 Minutes Sep 10 16:48:47 xs2 ha-lizard: 12790 master_ip: Pool Master IP Address = 192.168.199.200 Sep 10 16:48:47 xs2 ha-lizard: 12790 This slave - xs2: 79769bcb-ad49-4ce1-8b27-51234c5b418f selected as allowed to become master: setting ALLOW_PROMOTE_MASTER=1 Sep 10 16:48:47 xs2 ha-lizard: 12790 check_xapi: Pool Host 192.168.199.200 xapi status = 0 Sep 10 16:48:47 xs2 ha-lizard: 12790 Mail Spool Directory Found /dev/shm/ha-lizard-mail Sep 10 16:48:47 xs2 ha-lizard: 12790 email: Sending ALERT email to root@localhost: check_xapi: Pool Host on Server: 192.168.199.200 not responding to HTTP - manual intervention may be required Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Sending email from: root@localhost Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Traceback (most recent call last): Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: File "/etc/ha-lizard/scripts/email_alert.py", line 104, in ? Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Sending email to: root@localhost Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Email Alert Subject: SYSTEM_ALERT-FROM_HOST:xs2 Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: message = smtplib.SMTP(smtp_server, smtp_port, hostname) Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: File "/usr/lib64/python2.4/smtplib.py", line 244, in __init__ Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Email Alert Timestamp: Thu Sep 10 16:48:47 EDT 2015 Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Email Alert Process: ha-lizard Version: 1.8.7 Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: (code, msg) = self.connect(host, port) Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: File "/usr/lib64/python2.4/smtplib.py", line 306, in connect Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Email Alert Message Content: check_xapi: Pool Host on Server: 192.168.199.200 not responding to HTTP - manual intervention may be required Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: raise socket.error, msg Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Email Alert Message Hostname: xs2 Sep 10 16:48:47 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: socket.error: (111, 'Connection refused') Sep 10 16:48:47 xs2 ha-lizard: 12790 email: Message copied to /dev/shm/ha-lizard-mail/1441918127.msg - Suppressing duplicates for 60 Minutes Sep 10 16:48:47 xs2 ha-lizard: 12790 Pool Master NOT OK - Checking if ha-lizard is enabled in latest state file Sep 10 16:48:47 xs2 ha-lizard: 12790 Checking if ha-lizard is enabled Sep 10 16:48:47 xs2 ha-lizard: 12790 Statefile /etc/ha-lizard/state/ha_lizard_enabled found: checking if ha-lizard is enabled Sep 10 16:48:47 xs2 ha-lizard: 12790 ha-lizard is enabled - continuing Sep 10 16:48:47 xs2 ha-lizard: 12790 Pool Master Monitor = Failed Sep 10 16:48:48 xs2 ha-lizard: 12790 Mail Spool Directory Found /dev/shm/ha-lizard-mail Sep 10 16:48:48 xs2 ha-lizard: 12790 email: Sending ALERT email to root@localhost: Server xs2: Failed to contact pool master - manual intervention may be required Sep 10 16:48:48 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Traceback (most recent call last): Sep 10 16:48:48 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: File "/etc/ha-lizard/scripts/email_alert.py", line 104, in ? Sep 10 16:48:48 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Sending email from: root@localhost Sep 10 16:48:48 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: message = smtplib.SMTP(smtp_server, smtp_port, hostname) Sep 10 16:48:48 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Sending email to: root@localhost Sep 10 16:48:48 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Email Alert Subject: SYSTEM_ALERT-FROM_HOST:xs2 Sep 10 16:48:48 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: File "/usr/lib64/python2.4/smtplib.py", line 244, in __init__ Sep 10 16:48:48 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: (code, msg) = self.connect(host, port) Sep 10 16:48:48 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: File "/usr/lib64/python2.4/smtplib.py", line 306, in connect Sep 10 16:48:48 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: raise socket.error, msg Sep 10 16:48:48 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: socket.error: (111, 'Connection refused') Sep 10 16:48:48 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Email Alert Timestamp: Thu Sep 10 16:48:48 EDT 2015 Sep 10 16:48:48 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Email Alert Process: ha-lizard Version: 1.8.7 Sep 10 16:48:48 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Email Alert Message Content: Server xs2: Failed to contact pool master - manual intervention may be required Sep 10 16:48:48 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Email Alert Message Hostname: xs2 Sep 10 16:48:48 xs2 ha-lizard: 12790 email: Message copied to /dev/shm/ha-lizard-mail/1441918128.msg - Suppressing duplicates for 60 Minutes Sep 10 16:48:48 xs2 ha-lizard: 12790 Retry Count set to 2. Retrying 2 times in 10 second intervals.. Sep 10 16:48:48 xs2 ha-lizard: 12790 Attempt 0: Checking Pool Master Status Sep 10 16:48:54 xs2 ha-lizard: 3957 ha-lizard Watchdog: ha-lizard running - OK Sep 10 16:48:58 xs2 ha-lizard: 12790 check_xapi: Pool Host 192.168.199.200 xapi status = 0 Sep 10 16:48:58 xs2 ha-lizard: 12790 Mail Spool Directory Found /dev/shm/ha-lizard-mail Sep 10 16:48:58 xs2 ha-lizard: 12790 email: Duplicate message - not sending. Content = check_xapi: Pool Host on Server: 192.168.199.200 not responding to HTTP - manual intervention may be required Sep 10 16:48:58 xs2 ha-lizard: 12790 email: Message barred for 60 minutes Sep 10 16:48:58 xs2 ha-lizard: 12790 Attempt 1: Checking Pool Master Status Sep 10 16:48:59 xs2 ha-lizard: 12782 ha-lizard already running: Attempt 1 on PIDS: 12790 12785 12784 12782 Sep 10 16:49:04 xs2 ha-lizard: 3957 ha-lizard Watchdog: ha-lizard running - OK Sep 10 16:49:09 xs2 ha-lizard: 12782 ha-lizard already running: Attempt 2 on PIDS: 12790 12785 12784 12782 Sep 10 16:49:14 xs2 ha-lizard: 3957 ha-lizard Watchdog: ha-lizard running - OK Sep 10 16:49:18 xs2 ha-lizard: 12790 check_xapi: Pool Host 192.168.199.200 failed to respond to ICMP ping Sep 10 16:49:18 xs2 ha-lizard: 12790 Mail Spool Directory Found /dev/shm/ha-lizard-mail Sep 10 16:49:18 xs2 ha-lizard: 12790 email: Sending ALERT email to root@localhost: check_xapi: Pool Host on Server: 192.168.199.200 not responding to ICMP ping - manual intervention may be required Sep 10 16:49:18 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Sending email from: root@localhost Sep 10 16:49:18 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Traceback (most recent call last): Sep 10 16:49:18 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: File "/etc/ha-lizard/scripts/email_alert.py", line 104, in ? Sep 10 16:49:18 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Sending email to: root@localhost Sep 10 16:49:18 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: message = smtplib.SMTP(smtp_server, smtp_port, hostname) Sep 10 16:49:18 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: File "/usr/lib64/python2.4/smtplib.py", line 244, in __init__ Sep 10 16:49:18 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: (code, msg) = self.connect(host, port) Sep 10 16:49:18 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Email Alert Subject: SYSTEM_ALERT-FROM_HOST:xs2 Sep 10 16:49:18 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: File "/usr/lib64/python2.4/smtplib.py", line 306, in connect Sep 10 16:49:18 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: raise socket.error, msg Sep 10 16:49:18 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Email Alert Timestamp: Thu Sep 10 16:49:18 EDT 2015 Sep 10 16:49:18 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: socket.error: (111, 'Connection refused') Sep 10 16:49:18 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Email Alert Process: ha-lizard Version: 1.8.7 Sep 10 16:49:18 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Email Alert Message Content: check_xapi: Pool Host on Server: 192.168.199.200 not responding to ICMP ping - manual intervention may be required Sep 10 16:49:18 xs2 ha-lizard-NOTICE-/etc/ha-lizard/ha-lizard.sh: Email Alert Message Hostname: xs2 Sep 10 16:49:18 xs2 ha-lizard: 12790 email: Message copied to /dev/shm/ha-lizard-mail/1441918158.msg - Suppressing duplicates for 60 Minutes Sep 10 16:49:18 xs2 ha-lizard: 12790 Retrieving number of hosts in pool. Setting NUM_HOSTS = 1 Sep 10 16:49:18 xs2 ha-lizard: 12790 Failed to reach Pool Master - Checking if this host promotes to Master.. Sep 10 16:49:18 xs2 ha-lizard: 12790 State file MASTER UUID = 26c15cda-7a26-41e8-a2f7-cdd7a9d5df8f