Dec 16 14:34:42 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:34:47 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:34:48 xen-01 iscsi-ha: 17115 Spawning new instance of iscsi-ha
Dec 16 14:34:48 xen-01 iscsi-ha: 17115 check_logger_processes Checking logger processes
Dec 16 14:34:49 xen-01 iscsi-ha: 17115 check_logger_processes No processes to clear
Dec 16 14:34:49 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:34:49 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:34:49 xen-01 iscsi-ha:  This iteration is count 14
Dec 16 14:34:49 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:34:49 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:34:49 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:34:49 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:34:49 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:34:49 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:34:49 xen-01 iscsi-ha: 17741 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:34:49 xen-01 iscsi-ha: 17741 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:34:49 xen-01 iscsi-ha: 17741 service_execute: systemctl mode being used
Dec 16 14:34:49 xen-01 iscsi-ha: 17741 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:34:49 xen-01 iscsi-ha: 17741 service_execute: Returning exit status [ 3 ]
Dec 16 14:34:49 xen-01 iscsi-ha: 17741 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:34:49 xen-01 iscsi-ha: 17741 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:34:49 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:34:49 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:34:49 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:34:49 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:34:49 xen-01 iscsi-ha: 17741 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:34:49 xen-01 iscsi-ha: 17741 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:34:49 xen-01 iscsi-ha: 17741 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:34:49 xen-01 iscsi-ha: 17741 email: Message barred for 30 minutes
Dec 16 14:34:49 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:34:49 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:34:49 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:34:49 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:34:49 xen-01 iscsi-ha: 17741 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:34:49 xen-01 iscsi-ha: 17741 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:34:49 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:34:49 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:34:49 xen-01 iscsi-ha: 17741 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:34:49 xen-01 iscsi-ha: 17741 email: Message barred for 30 minutes
Dec 16 14:34:49 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:34:49 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:34:49 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:34:49 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:34:49 xen-01 iscsi-ha: 17741 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:34:49 xen-01 iscsi-ha: 17741 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:34:49 xen-01 iscsi-ha: 17741 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:34:49 xen-01 iscsi-ha: 17741 email: Message barred for 30 minutes
Dec 16 14:34:52 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:34:57 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:34:59 xen-01 iscsi-ha: 17706 Spawning new instance of iscsi-ha
Dec 16 14:34:59 xen-01 iscsi-ha: 17706 check_logger_processes Checking logger processes
Dec 16 14:34:59 xen-01 iscsi-ha: 17706 check_logger_processes No processes to clear
Dec 16 14:34:59 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:34:59 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:34:59 xen-01 iscsi-ha:  This iteration is count 15
Dec 16 14:34:59 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:34:59 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:34:59 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:34:59 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:34:59 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:34:59 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:34:59 xen-01 iscsi-ha: 18404 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:34:59 xen-01 iscsi-ha: 18404 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:34:59 xen-01 iscsi-ha: 18404 service_execute: systemctl mode being used
Dec 16 14:34:59 xen-01 iscsi-ha: 18404 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:34:59 xen-01 iscsi-ha: 18404 service_execute: Returning exit status [ 3 ]
Dec 16 14:34:59 xen-01 iscsi-ha: 18404 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:34:59 xen-01 iscsi-ha: 18404 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:34:59 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:34:59 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:34:59 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:34:59 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:34:59 xen-01 iscsi-ha: 18404 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:34:59 xen-01 iscsi-ha: 18404 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:34:59 xen-01 iscsi-ha: 18404 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:34:59 xen-01 iscsi-ha: 18404 email: Message barred for 30 minutes
Dec 16 14:34:59 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:34:59 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:34:59 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:34:59 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:34:59 xen-01 iscsi-ha: 18404 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:34:59 xen-01 iscsi-ha: 18404 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:34:59 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:34:59 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:34:59 xen-01 iscsi-ha: 18404 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:34:59 xen-01 iscsi-ha: 18404 email: Message barred for 30 minutes
Dec 16 14:34:59 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:34:59 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:34:59 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:34:59 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:34:59 xen-01 iscsi-ha: 18404 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:34:59 xen-01 iscsi-ha: 18404 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:34:59 xen-01 iscsi-ha: 18404 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:34:59 xen-01 iscsi-ha: 18404 email: Message barred for 30 minutes
Dec 16 14:35:02 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:35:07 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:35:09 xen-01 iscsi-ha: 18369 Spawning new instance of iscsi-ha
Dec 16 14:35:09 xen-01 iscsi-ha: 18369 check_logger_processes Checking logger processes
Dec 16 14:35:09 xen-01 iscsi-ha: 18369 check_logger_processes No processes to clear
Dec 16 14:35:09 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:35:09 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:35:09 xen-01 iscsi-ha:  This iteration is count 16
Dec 16 14:35:09 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:35:09 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:35:09 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:35:09 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:35:09 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:35:09 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:35:09 xen-01 iscsi-ha: 19189 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:35:09 xen-01 iscsi-ha: 19189 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:35:09 xen-01 iscsi-ha: 19189 service_execute: systemctl mode being used
Dec 16 14:35:09 xen-01 iscsi-ha: 19189 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:35:09 xen-01 iscsi-ha: 19189 service_execute: Returning exit status [ 3 ]
Dec 16 14:35:09 xen-01 iscsi-ha: 19189 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:35:09 xen-01 iscsi-ha: 19189 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:35:09 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:35:09 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:35:09 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:35:09 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:35:09 xen-01 iscsi-ha: 19189 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:35:09 xen-01 iscsi-ha: 19189 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:35:09 xen-01 iscsi-ha: 19189 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:35:09 xen-01 iscsi-ha: 19189 email: Message barred for 30 minutes
Dec 16 14:35:09 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:35:09 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:35:09 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:35:09 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:35:09 xen-01 iscsi-ha: 19189 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:35:09 xen-01 iscsi-ha: 19189 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:35:09 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:35:09 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:35:09 xen-01 iscsi-ha: 19189 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:35:09 xen-01 iscsi-ha: 19189 email: Message barred for 30 minutes
Dec 16 14:35:09 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:35:09 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:35:09 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:35:09 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:35:09 xen-01 iscsi-ha: 19189 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:35:09 xen-01 iscsi-ha: 19189 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:35:09 xen-01 iscsi-ha: 19189 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:35:09 xen-01 iscsi-ha: 19189 email: Message barred for 30 minutes
Dec 16 14:35:12 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:35:17 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:35:19 xen-01 iscsi-ha: 19114 Spawning new instance of iscsi-ha
Dec 16 14:35:19 xen-01 iscsi-ha: 19114 check_logger_processes Checking logger processes
Dec 16 14:35:19 xen-01 iscsi-ha: 19114 check_logger_processes No processes to clear
Dec 16 14:35:19 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:35:19 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:35:19 xen-01 iscsi-ha:  This iteration is count 17
Dec 16 14:35:19 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:35:19 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:35:19 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:35:19 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:35:19 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:35:19 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:35:19 xen-01 iscsi-ha: 20382 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:35:19 xen-01 iscsi-ha: 20382 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:35:19 xen-01 iscsi-ha: 20382 service_execute: systemctl mode being used
Dec 16 14:35:19 xen-01 iscsi-ha: 20382 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:35:19 xen-01 iscsi-ha: 20382 service_execute: Returning exit status [ 3 ]
Dec 16 14:35:19 xen-01 iscsi-ha: 20382 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:35:19 xen-01 iscsi-ha: 20382 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:35:19 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:35:19 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:35:19 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:35:19 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:35:19 xen-01 iscsi-ha: 20382 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:35:19 xen-01 iscsi-ha: 20382 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:35:19 xen-01 iscsi-ha: 20382 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:35:19 xen-01 iscsi-ha: 20382 email: Message barred for 30 minutes
Dec 16 14:35:19 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:35:19 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:35:19 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:35:19 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:35:19 xen-01 iscsi-ha: 20382 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:35:19 xen-01 iscsi-ha: 20382 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:35:19 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:35:19 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:35:19 xen-01 iscsi-ha: 20382 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:35:19 xen-01 iscsi-ha: 20382 email: Message barred for 30 minutes
Dec 16 14:35:19 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:35:19 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:35:19 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:35:19 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:35:19 xen-01 iscsi-ha: 20382 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:35:19 xen-01 iscsi-ha: 20382 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:35:19 xen-01 iscsi-ha: 20382 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:35:19 xen-01 iscsi-ha: 20382 email: Message barred for 30 minutes
Dec 16 14:35:22 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:35:27 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:35:29 xen-01 iscsi-ha: 20347 Spawning new instance of iscsi-ha
Dec 16 14:35:29 xen-01 iscsi-ha: 20347 check_logger_processes Checking logger processes
Dec 16 14:35:29 xen-01 iscsi-ha: 20347 check_logger_processes No processes to clear
Dec 16 14:35:29 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:35:29 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:35:29 xen-01 iscsi-ha:  This iteration is count 18
Dec 16 14:35:29 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:35:29 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:35:29 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:35:29 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:35:29 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:35:29 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:35:29 xen-01 iscsi-ha: 21046 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:35:29 xen-01 iscsi-ha: 21046 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:35:29 xen-01 iscsi-ha: 21046 service_execute: systemctl mode being used
Dec 16 14:35:29 xen-01 iscsi-ha: 21046 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:35:29 xen-01 iscsi-ha: 21046 service_execute: Returning exit status [ 3 ]
Dec 16 14:35:29 xen-01 iscsi-ha: 21046 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:35:29 xen-01 iscsi-ha: 21046 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:35:29 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:35:29 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:35:29 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:35:29 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:35:29 xen-01 iscsi-ha: 21046 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:35:29 xen-01 iscsi-ha: 21046 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:35:29 xen-01 iscsi-ha: 21046 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:35:29 xen-01 iscsi-ha: 21046 email: Message barred for 30 minutes
Dec 16 14:35:29 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:35:29 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:35:29 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:35:29 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:35:29 xen-01 iscsi-ha: 21046 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:35:29 xen-01 iscsi-ha: 21046 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:35:29 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:35:29 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:35:29 xen-01 iscsi-ha: 21046 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:35:29 xen-01 iscsi-ha: 21046 email: Message barred for 30 minutes
Dec 16 14:35:29 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:35:29 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:35:29 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:35:29 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:35:29 xen-01 iscsi-ha: 21046 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:35:29 xen-01 iscsi-ha: 21046 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:35:29 xen-01 iscsi-ha: 21046 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:35:29 xen-01 iscsi-ha: 21046 email: Message barred for 30 minutes
Dec 16 14:35:32 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:35:37 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:35:39 xen-01 iscsi-ha: 21011 Spawning new instance of iscsi-ha
Dec 16 14:35:39 xen-01 iscsi-ha: 21011 check_logger_processes Checking logger processes
Dec 16 14:35:39 xen-01 iscsi-ha: 21011 check_logger_processes No processes to clear
Dec 16 14:35:39 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:35:39 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:35:39 xen-01 iscsi-ha:  This iteration is count 19
Dec 16 14:35:39 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:35:39 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:35:39 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:35:39 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:35:39 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:35:39 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:35:39 xen-01 iscsi-ha: 21551 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:35:39 xen-01 iscsi-ha: 21551 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:35:39 xen-01 iscsi-ha: 21551 service_execute: systemctl mode being used
Dec 16 14:35:39 xen-01 iscsi-ha: 21551 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:35:39 xen-01 iscsi-ha: 21551 service_execute: Returning exit status [ 3 ]
Dec 16 14:35:39 xen-01 iscsi-ha: 21551 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:35:39 xen-01 iscsi-ha: 21551 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:35:39 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:35:39 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:35:39 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:35:39 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:35:39 xen-01 iscsi-ha: 21551 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:35:39 xen-01 iscsi-ha: 21551 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:35:39 xen-01 iscsi-ha: 21551 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:35:39 xen-01 iscsi-ha: 21551 email: Message barred for 30 minutes
Dec 16 14:35:39 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:35:39 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:35:39 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:35:39 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:35:39 xen-01 iscsi-ha: 21551 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:35:39 xen-01 iscsi-ha: 21551 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:35:39 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:35:39 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:35:39 xen-01 iscsi-ha: 21551 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:35:39 xen-01 iscsi-ha: 21551 email: Message barred for 30 minutes
Dec 16 14:35:39 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:35:39 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:35:39 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:35:39 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:35:39 xen-01 iscsi-ha: 21551 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:35:39 xen-01 iscsi-ha: 21551 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:35:40 xen-01 iscsi-ha: 21551 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:35:40 xen-01 iscsi-ha: 21551 email: Message barred for 30 minutes
Dec 16 14:35:42 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:35:47 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:35:49 xen-01 iscsi-ha: 21516 Spawning new instance of iscsi-ha
Dec 16 14:35:49 xen-01 iscsi-ha: 21516 check_logger_processes Checking logger processes
Dec 16 14:35:49 xen-01 iscsi-ha: 21516 check_logger_processes No processes to clear
Dec 16 14:35:49 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:35:49 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:35:49 xen-01 iscsi-ha:  This iteration is count 20
Dec 16 14:35:49 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:35:49 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:35:49 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:35:49 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:35:49 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:35:49 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:35:49 xen-01 iscsi-ha: 23039 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:35:49 xen-01 iscsi-ha: 23039 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:35:49 xen-01 iscsi-ha: 23039 service_execute: systemctl mode being used
Dec 16 14:35:49 xen-01 iscsi-ha: 23039 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:35:49 xen-01 iscsi-ha: 23039 service_execute: Returning exit status [ 3 ]
Dec 16 14:35:49 xen-01 iscsi-ha: 23039 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:35:49 xen-01 iscsi-ha: 23039 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:35:49 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:35:49 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:35:49 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:35:49 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:35:49 xen-01 iscsi-ha: 23039 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:35:49 xen-01 iscsi-ha: 23039 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:35:49 xen-01 iscsi-ha: 23039 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:35:49 xen-01 iscsi-ha: 23039 email: Message barred for 30 minutes
Dec 16 14:35:49 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:35:49 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:35:49 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:35:49 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:35:49 xen-01 iscsi-ha: 23039 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:35:49 xen-01 iscsi-ha: 23039 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:35:49 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:35:49 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:35:50 xen-01 iscsi-ha: 23039 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:35:50 xen-01 iscsi-ha: 23039 email: Message barred for 30 minutes
Dec 16 14:35:50 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:35:50 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:35:50 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:35:50 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:35:50 xen-01 iscsi-ha: 23039 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:35:50 xen-01 iscsi-ha: 23039 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:35:50 xen-01 iscsi-ha: 23039 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:35:50 xen-01 iscsi-ha: 23039 email: Message barred for 30 minutes
Dec 16 14:35:52 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:35:57 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:35:59 xen-01 iscsi-ha: 23004 Spawning new instance of iscsi-ha
Dec 16 14:35:59 xen-01 iscsi-ha: 23004 check_logger_processes Checking logger processes
Dec 16 14:35:59 xen-01 iscsi-ha: 23004 check_logger_processes No processes to clear
Dec 16 14:35:59 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:35:59 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:35:59 xen-01 iscsi-ha:  This iteration is count 21
Dec 16 14:35:59 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:35:59 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:35:59 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:35:59 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:35:59 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:35:59 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:35:59 xen-01 iscsi-ha: 23701 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:35:59 xen-01 iscsi-ha: 23701 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:35:59 xen-01 iscsi-ha: 23701 service_execute: systemctl mode being used
Dec 16 14:35:59 xen-01 iscsi-ha: 23701 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:35:59 xen-01 iscsi-ha: 23701 service_execute: Returning exit status [ 3 ]
Dec 16 14:35:59 xen-01 iscsi-ha: 23701 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:36:00 xen-01 iscsi-ha: 23701 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:36:00 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:36:00 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:36:00 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:36:00 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:36:00 xen-01 iscsi-ha: 23701 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:36:00 xen-01 iscsi-ha: 23701 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:36:00 xen-01 iscsi-ha: 23701 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:36:00 xen-01 iscsi-ha: 23701 email: Message barred for 30 minutes
Dec 16 14:36:00 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:36:00 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:36:00 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:36:00 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:36:00 xen-01 iscsi-ha: 23701 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:36:00 xen-01 iscsi-ha: 23701 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:36:00 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:36:00 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:36:00 xen-01 iscsi-ha: 23701 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:36:00 xen-01 iscsi-ha: 23701 email: Message barred for 30 minutes
Dec 16 14:36:00 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:36:00 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:36:00 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:36:00 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:36:00 xen-01 iscsi-ha: 23701 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:36:00 xen-01 iscsi-ha: 23701 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:36:00 xen-01 iscsi-ha: 23701 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:36:00 xen-01 iscsi-ha: 23701 email: Message barred for 30 minutes
Dec 16 14:36:02 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:36:07 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:36:09 xen-01 iscsi-ha: 23665 Spawning new instance of iscsi-ha
Dec 16 14:36:09 xen-01 iscsi-ha: 23665 check_logger_processes Checking logger processes
Dec 16 14:36:09 xen-01 iscsi-ha: 23665 check_logger_processes No processes to clear
Dec 16 14:36:09 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:36:09 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:36:09 xen-01 iscsi-ha:  This iteration is count 22
Dec 16 14:36:09 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:36:09 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:36:09 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:36:09 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:36:10 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:36:10 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:36:10 xen-01 iscsi-ha: 24196 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:36:10 xen-01 iscsi-ha: 24196 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:36:10 xen-01 iscsi-ha: 24196 service_execute: systemctl mode being used
Dec 16 14:36:10 xen-01 iscsi-ha: 24196 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:36:10 xen-01 iscsi-ha: 24196 service_execute: Returning exit status [ 3 ]
Dec 16 14:36:10 xen-01 iscsi-ha: 24196 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:36:10 xen-01 iscsi-ha: 24196 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:36:10 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:36:10 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:36:10 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:36:10 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:36:10 xen-01 iscsi-ha: 24196 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:36:10 xen-01 iscsi-ha: 24196 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:36:10 xen-01 iscsi-ha: 24196 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:36:10 xen-01 iscsi-ha: 24196 email: Message barred for 30 minutes
Dec 16 14:36:10 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:36:10 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:36:10 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:36:10 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:36:10 xen-01 iscsi-ha: 24196 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:36:10 xen-01 iscsi-ha: 24196 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:36:10 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:36:10 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:36:10 xen-01 iscsi-ha: 24196 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:36:10 xen-01 iscsi-ha: 24196 email: Message barred for 30 minutes
Dec 16 14:36:10 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:36:10 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:36:10 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:36:10 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:36:10 xen-01 iscsi-ha: 24196 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:36:10 xen-01 iscsi-ha: 24196 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:36:10 xen-01 iscsi-ha: 24196 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:36:10 xen-01 iscsi-ha: 24196 email: Message barred for 30 minutes
Dec 16 14:36:12 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:36:17 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:36:19 xen-01 iscsi-ha: 24154 Spawning new instance of iscsi-ha
Dec 16 14:36:19 xen-01 iscsi-ha: 24154 check_logger_processes Checking logger processes
Dec 16 14:36:19 xen-01 iscsi-ha: 24154 check_logger_processes No processes to clear
Dec 16 14:36:19 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:36:19 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:36:20 xen-01 iscsi-ha:  This iteration is count 23
Dec 16 14:36:20 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:36:20 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:36:20 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:36:20 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:36:20 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:36:20 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:36:20 xen-01 iscsi-ha: 25490 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:36:20 xen-01 iscsi-ha: 25490 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:36:20 xen-01 iscsi-ha: 25490 service_execute: systemctl mode being used
Dec 16 14:36:20 xen-01 iscsi-ha: 25490 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:36:20 xen-01 iscsi-ha: 25490 service_execute: Returning exit status [ 3 ]
Dec 16 14:36:20 xen-01 iscsi-ha: 25490 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:36:20 xen-01 iscsi-ha: 25490 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:36:20 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:36:20 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:36:20 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:36:20 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:36:20 xen-01 iscsi-ha: 25490 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:36:20 xen-01 iscsi-ha: 25490 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:36:20 xen-01 iscsi-ha: 25490 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:36:20 xen-01 iscsi-ha: 25490 email: Message barred for 30 minutes
Dec 16 14:36:20 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:36:20 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:36:20 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:36:20 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:36:20 xen-01 iscsi-ha: 25490 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:36:20 xen-01 iscsi-ha: 25490 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:36:20 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:36:20 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:36:20 xen-01 iscsi-ha: 25490 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:36:20 xen-01 iscsi-ha: 25490 email: Message barred for 30 minutes
Dec 16 14:36:20 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:36:20 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:36:20 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:36:20 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:36:20 xen-01 iscsi-ha: 25490 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:36:20 xen-01 iscsi-ha: 25490 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:36:20 xen-01 iscsi-ha: 25490 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:36:20 xen-01 iscsi-ha: 25490 email: Message barred for 30 minutes
Dec 16 14:36:22 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:36:27 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:36:30 xen-01 iscsi-ha: 25409 Spawning new instance of iscsi-ha
Dec 16 14:36:30 xen-01 iscsi-ha: 25409 check_logger_processes Checking logger processes
Dec 16 14:36:30 xen-01 iscsi-ha: 25409 check_logger_processes No processes to clear
Dec 16 14:36:30 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:36:30 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:36:30 xen-01 iscsi-ha:  This iteration is count 24
Dec 16 14:36:30 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:36:30 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:36:30 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:36:30 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:36:30 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:36:30 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:36:30 xen-01 iscsi-ha: 26342 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:36:30 xen-01 iscsi-ha: 26342 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:36:30 xen-01 iscsi-ha: 26342 service_execute: systemctl mode being used
Dec 16 14:36:30 xen-01 iscsi-ha: 26342 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:36:30 xen-01 iscsi-ha: 26342 service_execute: Returning exit status [ 3 ]
Dec 16 14:36:30 xen-01 iscsi-ha: 26342 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:36:30 xen-01 iscsi-ha: 26342 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:36:30 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:36:30 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:36:30 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:36:30 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:36:30 xen-01 iscsi-ha: 26342 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:36:30 xen-01 iscsi-ha: 26342 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:36:30 xen-01 iscsi-ha: 26342 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:36:30 xen-01 iscsi-ha: 26342 email: Message barred for 30 minutes
Dec 16 14:36:30 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:36:30 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:36:30 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:36:30 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:36:30 xen-01 iscsi-ha: 26342 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:36:30 xen-01 iscsi-ha: 26342 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:36:30 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:36:30 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:36:30 xen-01 iscsi-ha: 26342 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:36:30 xen-01 iscsi-ha: 26342 email: Message barred for 30 minutes
Dec 16 14:36:30 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:36:30 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:36:30 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:36:30 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:36:30 xen-01 iscsi-ha: 26342 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:36:30 xen-01 iscsi-ha: 26342 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:36:30 xen-01 iscsi-ha: 26342 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:36:30 xen-01 iscsi-ha: 26342 email: Message barred for 30 minutes
Dec 16 14:36:32 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:36:37 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:36:40 xen-01 iscsi-ha: 26307 Spawning new instance of iscsi-ha
Dec 16 14:36:40 xen-01 iscsi-ha: 26307 check_logger_processes Checking logger processes
Dec 16 14:36:40 xen-01 iscsi-ha: 26307 check_logger_processes No processes to clear
Dec 16 14:36:40 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:36:40 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:36:40 xen-01 iscsi-ha:  This iteration is count 25
Dec 16 14:36:40 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:36:40 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:36:40 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:36:40 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:36:40 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:36:40 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:36:40 xen-01 iscsi-ha: 26836 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:36:40 xen-01 iscsi-ha: 26836 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:36:40 xen-01 iscsi-ha: 26836 service_execute: systemctl mode being used
Dec 16 14:36:40 xen-01 iscsi-ha: 26836 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:36:40 xen-01 iscsi-ha: 26836 service_execute: Returning exit status [ 3 ]
Dec 16 14:36:40 xen-01 iscsi-ha: 26836 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:36:40 xen-01 iscsi-ha: 26836 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:36:40 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:36:40 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:36:40 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:36:40 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:36:40 xen-01 iscsi-ha: 26836 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:36:40 xen-01 iscsi-ha: 26836 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:36:40 xen-01 iscsi-ha: 26836 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:36:40 xen-01 iscsi-ha: 26836 email: Message barred for 30 minutes
Dec 16 14:36:40 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:36:40 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:36:40 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:36:40 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:36:40 xen-01 iscsi-ha: 26836 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:36:40 xen-01 iscsi-ha: 26836 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:36:40 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:36:40 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:36:40 xen-01 iscsi-ha: 26836 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:36:40 xen-01 iscsi-ha: 26836 email: Message barred for 30 minutes
Dec 16 14:36:40 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:36:40 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:36:40 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:36:40 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:36:40 xen-01 iscsi-ha: 26836 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:36:40 xen-01 iscsi-ha: 26836 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:36:40 xen-01 iscsi-ha: 26836 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:36:40 xen-01 iscsi-ha: 26836 email: Message barred for 30 minutes
Dec 16 14:36:42 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:36:47 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:36:50 xen-01 iscsi-ha: 26748 Spawning new instance of iscsi-ha
Dec 16 14:36:50 xen-01 iscsi-ha: 26748 check_logger_processes Checking logger processes
Dec 16 14:36:50 xen-01 iscsi-ha: 26748 check_logger_processes No processes to clear
Dec 16 14:36:50 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:36:50 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:36:50 xen-01 iscsi-ha:  This iteration is count 26
Dec 16 14:36:50 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:36:50 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:36:50 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:36:50 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:36:50 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:36:50 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:36:50 xen-01 iscsi-ha: 27429 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:36:50 xen-01 iscsi-ha: 27429 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:36:50 xen-01 iscsi-ha: 27429 service_execute: systemctl mode being used
Dec 16 14:36:50 xen-01 iscsi-ha: 27429 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:36:50 xen-01 iscsi-ha: 27429 service_execute: Returning exit status [ 3 ]
Dec 16 14:36:50 xen-01 iscsi-ha: 27429 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:36:50 xen-01 iscsi-ha: 27429 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:36:50 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:36:50 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:36:50 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:36:50 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:36:50 xen-01 iscsi-ha: 27429 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:36:50 xen-01 iscsi-ha: 27429 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:36:50 xen-01 iscsi-ha: 27429 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:36:50 xen-01 iscsi-ha: 27429 email: Message barred for 30 minutes
Dec 16 14:36:50 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:36:50 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:36:50 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:36:50 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:36:50 xen-01 iscsi-ha: 27429 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:36:50 xen-01 iscsi-ha: 27429 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:36:50 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:36:50 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:36:50 xen-01 iscsi-ha: 27429 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:36:50 xen-01 iscsi-ha: 27429 email: Message barred for 30 minutes
Dec 16 14:36:50 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:36:50 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:36:50 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:36:50 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:36:50 xen-01 iscsi-ha: 27429 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:36:50 xen-01 iscsi-ha: 27429 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:36:50 xen-01 iscsi-ha: 27429 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:36:50 xen-01 iscsi-ha: 27429 email: Message barred for 30 minutes
Dec 16 14:36:52 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:36:57 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:37:00 xen-01 iscsi-ha: 27394 Spawning new instance of iscsi-ha
Dec 16 14:37:00 xen-01 iscsi-ha: 27394 check_logger_processes Checking logger processes
Dec 16 14:37:00 xen-01 iscsi-ha: 27394 check_logger_processes No processes to clear
Dec 16 14:37:00 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:37:00 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:37:00 xen-01 iscsi-ha:  This iteration is count 27
Dec 16 14:37:00 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:37:00 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:37:00 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:37:00 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:37:00 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:37:00 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:37:00 xen-01 iscsi-ha: 28993 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:37:00 xen-01 iscsi-ha: 28993 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:37:00 xen-01 iscsi-ha: 28993 service_execute: systemctl mode being used
Dec 16 14:37:00 xen-01 iscsi-ha: 28993 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:37:00 xen-01 iscsi-ha: 28993 service_execute: Returning exit status [ 3 ]
Dec 16 14:37:00 xen-01 iscsi-ha: 28993 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:37:00 xen-01 iscsi-ha: 28993 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:37:00 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:37:00 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:37:00 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:37:00 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:37:00 xen-01 iscsi-ha: 28993 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:37:00 xen-01 iscsi-ha: 28993 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:37:00 xen-01 iscsi-ha: 28993 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:37:00 xen-01 iscsi-ha: 28993 email: Message barred for 30 minutes
Dec 16 14:37:00 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:37:00 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:37:00 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:37:00 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:37:00 xen-01 iscsi-ha: 28993 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:37:00 xen-01 iscsi-ha: 28993 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:37:00 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:37:00 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:37:00 xen-01 iscsi-ha: 28993 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:37:00 xen-01 iscsi-ha: 28993 email: Message barred for 30 minutes
Dec 16 14:37:00 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:37:00 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:37:00 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:37:00 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:37:00 xen-01 iscsi-ha: 28993 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:37:00 xen-01 iscsi-ha: 28993 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:37:00 xen-01 iscsi-ha: 28993 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:37:00 xen-01 iscsi-ha: 28993 email: Message barred for 30 minutes
Dec 16 14:37:02 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:37:07 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:37:10 xen-01 iscsi-ha: 28958 Spawning new instance of iscsi-ha
Dec 16 14:37:10 xen-01 iscsi-ha: 28958 check_logger_processes Checking logger processes
Dec 16 14:37:10 xen-01 iscsi-ha: 28958 check_logger_processes No processes to clear
Dec 16 14:37:10 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:37:10 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:37:10 xen-01 iscsi-ha:  This iteration is count 28
Dec 16 14:37:10 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:37:10 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:37:10 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:37:10 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:37:10 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:37:10 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:37:10 xen-01 iscsi-ha: 29462 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:37:10 xen-01 iscsi-ha: 29462 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:37:10 xen-01 iscsi-ha: 29462 service_execute: systemctl mode being used
Dec 16 14:37:10 xen-01 iscsi-ha: 29462 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:37:10 xen-01 iscsi-ha: 29462 service_execute: Returning exit status [ 3 ]
Dec 16 14:37:10 xen-01 iscsi-ha: 29462 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:37:10 xen-01 iscsi-ha: 29462 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:37:10 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:37:10 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:37:10 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:37:10 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:37:10 xen-01 iscsi-ha: 29462 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:37:10 xen-01 iscsi-ha: 29462 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:37:10 xen-01 iscsi-ha: 29462 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:37:10 xen-01 iscsi-ha: 29462 email: Message barred for 30 minutes
Dec 16 14:37:10 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:37:10 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:37:10 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:37:10 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:37:10 xen-01 iscsi-ha: 29462 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:37:10 xen-01 iscsi-ha: 29462 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:37:10 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:37:10 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:37:10 xen-01 iscsi-ha: 29462 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:37:10 xen-01 iscsi-ha: 29462 email: Message barred for 30 minutes
Dec 16 14:37:10 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:37:10 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:37:10 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:37:10 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:37:10 xen-01 iscsi-ha: 29462 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:37:10 xen-01 iscsi-ha: 29462 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:37:11 xen-01 iscsi-ha: 29462 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:37:11 xen-01 iscsi-ha: 29462 email: Message barred for 30 minutes
Dec 16 14:37:12 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:37:17 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:37:20 xen-01 iscsi-ha: 29329 Spawning new instance of iscsi-ha
Dec 16 14:37:20 xen-01 iscsi-ha: 29329 check_logger_processes Checking logger processes
Dec 16 14:37:20 xen-01 iscsi-ha: 29329 check_logger_processes No processes to clear
Dec 16 14:37:20 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:37:20 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:37:20 xen-01 iscsi-ha:  This iteration is count 29
Dec 16 14:37:20 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:37:20 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:37:20 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:37:20 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:37:20 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:37:20 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:37:20 xen-01 iscsi-ha: 30069 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:37:20 xen-01 iscsi-ha: 30069 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:37:20 xen-01 iscsi-ha: 30069 service_execute: systemctl mode being used
Dec 16 14:37:20 xen-01 iscsi-ha: 30069 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:37:20 xen-01 iscsi-ha: 30069 service_execute: Returning exit status [ 3 ]
Dec 16 14:37:20 xen-01 iscsi-ha: 30069 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:37:20 xen-01 iscsi-ha: 30069 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:37:20 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:37:20 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:37:20 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:37:20 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:37:20 xen-01 iscsi-ha: 30069 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:37:20 xen-01 iscsi-ha: 30069 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:37:20 xen-01 iscsi-ha: 30069 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:37:20 xen-01 iscsi-ha: 30069 email: Message barred for 30 minutes
Dec 16 14:37:20 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:37:20 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:37:20 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:37:20 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:37:20 xen-01 iscsi-ha: 30069 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:37:20 xen-01 iscsi-ha: 30069 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:37:20 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:37:20 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:37:21 xen-01 iscsi-ha: 30069 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:37:21 xen-01 iscsi-ha: 30069 email: Message barred for 30 minutes
Dec 16 14:37:21 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:37:21 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:37:21 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:37:21 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:37:21 xen-01 iscsi-ha: 30069 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:37:21 xen-01 iscsi-ha: 30069 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:37:21 xen-01 iscsi-ha: 30069 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:37:21 xen-01 iscsi-ha: 30069 email: Message barred for 30 minutes
Dec 16 14:37:22 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:37:27 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:37:30 xen-01 iscsi-ha: 30034 Spawning new instance of iscsi-ha
Dec 16 14:37:30 xen-01 iscsi-ha: 30034 check_logger_processes Checking logger processes
Dec 16 14:37:30 xen-01 iscsi-ha: 30034 check_logger_processes No processes to clear
Dec 16 14:37:30 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:37:30 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:37:30 xen-01 iscsi-ha:  This iteration is count 30
Dec 16 14:37:30 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:37:30 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:37:30 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:37:30 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:37:30 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:37:30 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:37:30 xen-01 iscsi-ha: 31630 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:37:30 xen-01 iscsi-ha: 31630 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:37:30 xen-01 iscsi-ha: 31630 service_execute: systemctl mode being used
Dec 16 14:37:30 xen-01 iscsi-ha: 31630 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:37:30 xen-01 iscsi-ha: 31630 service_execute: Returning exit status [ 3 ]
Dec 16 14:37:30 xen-01 iscsi-ha: 31630 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:37:30 xen-01 iscsi-ha: 31630 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:37:30 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:37:30 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:37:30 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:37:30 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:37:30 xen-01 iscsi-ha: 31630 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:37:30 xen-01 iscsi-ha: 31630 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:37:31 xen-01 iscsi-ha: 31630 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:37:31 xen-01 iscsi-ha: 31630 email: Message barred for 30 minutes
Dec 16 14:37:31 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:37:31 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:37:31 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:37:31 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:37:31 xen-01 iscsi-ha: 31630 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:37:31 xen-01 iscsi-ha: 31630 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:37:31 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:37:31 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:37:31 xen-01 iscsi-ha: 31630 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:37:31 xen-01 iscsi-ha: 31630 email: Message barred for 30 minutes
Dec 16 14:37:31 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:37:31 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:37:31 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:37:31 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:37:31 xen-01 iscsi-ha: 31630 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:37:31 xen-01 iscsi-ha: 31630 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:37:31 xen-01 iscsi-ha: 31630 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:37:31 xen-01 iscsi-ha: 31630 email: Message barred for 30 minutes
Dec 16 14:37:32 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:37:37 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:37:40 xen-01 iscsi-ha: 31595 Spawning new instance of iscsi-ha
Dec 16 14:37:40 xen-01 iscsi-ha: 31595 check_logger_processes Checking logger processes
Dec 16 14:37:40 xen-01 iscsi-ha: 31595 check_logger_processes No processes to clear
Dec 16 14:37:40 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:37:40 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:37:40 xen-01 iscsi-ha:  This iteration is count 31
Dec 16 14:37:40 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:37:40 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:37:40 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:37:40 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:37:40 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:37:40 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:37:41 xen-01 iscsi-ha: 32035 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:37:41 xen-01 iscsi-ha: 32035 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:37:41 xen-01 iscsi-ha: 32035 service_execute: systemctl mode being used
Dec 16 14:37:41 xen-01 iscsi-ha: 32035 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:37:41 xen-01 iscsi-ha: 32035 service_execute: Returning exit status [ 3 ]
Dec 16 14:37:41 xen-01 iscsi-ha: 32035 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:37:41 xen-01 iscsi-ha: 32035 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:37:41 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:37:41 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:37:41 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:37:41 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:37:41 xen-01 iscsi-ha: 32035 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:37:41 xen-01 iscsi-ha: 32035 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:37:41 xen-01 iscsi-ha: 32035 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:37:41 xen-01 iscsi-ha: 32035 email: Message barred for 30 minutes
Dec 16 14:37:41 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:37:41 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:37:41 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:37:41 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:37:41 xen-01 iscsi-ha: 32035 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:37:41 xen-01 iscsi-ha: 32035 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:37:41 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:37:41 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:37:41 xen-01 iscsi-ha: 32035 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:37:41 xen-01 iscsi-ha: 32035 email: Message barred for 30 minutes
Dec 16 14:37:41 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:37:41 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:37:41 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:37:41 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:37:41 xen-01 iscsi-ha: 32035 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:37:41 xen-01 iscsi-ha: 32035 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:37:41 xen-01 iscsi-ha: 32035 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:37:41 xen-01 iscsi-ha: 32035 email: Message barred for 30 minutes
Dec 16 14:37:42 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:37:47 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:37:50 xen-01 iscsi-ha: 31924 Spawning new instance of iscsi-ha
Dec 16 14:37:50 xen-01 iscsi-ha: 31924 check_logger_processes Checking logger processes
Dec 16 14:37:50 xen-01 iscsi-ha: 31924 check_logger_processes No processes to clear
Dec 16 14:37:50 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:37:50 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:37:50 xen-01 iscsi-ha:  This iteration is count 32
Dec 16 14:37:50 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:37:50 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:37:50 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:37:50 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:37:51 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:37:51 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:37:51 xen-01 iscsi-ha: 342 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:37:51 xen-01 iscsi-ha: 342 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:37:51 xen-01 iscsi-ha: 342 service_execute: systemctl mode being used
Dec 16 14:37:51 xen-01 iscsi-ha: 342 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:37:51 xen-01 iscsi-ha: 342 service_execute: Returning exit status [ 3 ]
Dec 16 14:37:51 xen-01 iscsi-ha: 342 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:37:51 xen-01 iscsi-ha: 342 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:37:51 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:37:51 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:37:51 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:37:51 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:37:51 xen-01 iscsi-ha: 342 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:37:51 xen-01 iscsi-ha: 342 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:37:51 xen-01 iscsi-ha: 342 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:37:51 xen-01 iscsi-ha: 342 email: Message barred for 30 minutes
Dec 16 14:37:51 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:37:51 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:37:51 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:37:51 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:37:51 xen-01 iscsi-ha: 342 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:37:51 xen-01 iscsi-ha: 342 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:37:51 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:37:51 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:37:51 xen-01 iscsi-ha: 342 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:37:51 xen-01 iscsi-ha: 342 email: Message barred for 30 minutes
Dec 16 14:37:51 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:37:51 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:37:51 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:37:51 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:37:51 xen-01 iscsi-ha: 342 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:37:51 xen-01 iscsi-ha: 342 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:37:51 xen-01 iscsi-ha: 342 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:37:51 xen-01 iscsi-ha: 342 email: Message barred for 30 minutes
Dec 16 14:37:52 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:37:57 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:38:00 xen-01 iscsi-ha: 300 Spawning new instance of iscsi-ha
Dec 16 14:38:00 xen-01 iscsi-ha: 300 check_logger_processes Checking logger processes
Dec 16 14:38:01 xen-01 iscsi-ha: 300 check_logger_processes No processes to clear
Dec 16 14:38:01 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:38:01 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:38:01 xen-01 iscsi-ha:  This iteration is count 33
Dec 16 14:38:01 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:38:01 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:38:01 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:38:01 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:38:01 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:38:01 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:38:01 xen-01 iscsi-ha: 1295 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:38:01 xen-01 iscsi-ha: 1295 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:38:01 xen-01 iscsi-ha: 1295 service_execute: systemctl mode being used
Dec 16 14:38:01 xen-01 iscsi-ha: 1295 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:38:01 xen-01 iscsi-ha: 1295 service_execute: Returning exit status [ 3 ]
Dec 16 14:38:01 xen-01 iscsi-ha: 1295 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:38:01 xen-01 iscsi-ha: 1295 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:38:01 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:38:01 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:38:01 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:38:01 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:38:01 xen-01 iscsi-ha: 1295 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:38:01 xen-01 iscsi-ha: 1295 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:38:01 xen-01 iscsi-ha: 1295 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:38:01 xen-01 iscsi-ha: 1295 email: Message barred for 30 minutes
Dec 16 14:38:01 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:38:01 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:38:01 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:38:01 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:38:01 xen-01 iscsi-ha: 1295 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:38:01 xen-01 iscsi-ha: 1295 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:38:01 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:38:01 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:38:01 xen-01 iscsi-ha: 1295 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:38:01 xen-01 iscsi-ha: 1295 email: Message barred for 30 minutes
Dec 16 14:38:01 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:38:01 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:38:01 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:38:01 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:38:01 xen-01 iscsi-ha: 1295 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:38:01 xen-01 iscsi-ha: 1295 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:38:01 xen-01 iscsi-ha: 1295 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:38:01 xen-01 iscsi-ha: 1295 email: Message barred for 30 minutes
Dec 16 14:38:02 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:38:07 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:38:11 xen-01 iscsi-ha: 1215 Spawning new instance of iscsi-ha
Dec 16 14:38:11 xen-01 iscsi-ha: 1215 check_logger_processes Checking logger processes
Dec 16 14:38:11 xen-01 iscsi-ha: 1215 check_logger_processes No processes to clear
Dec 16 14:38:11 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:38:11 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:38:11 xen-01 iscsi-ha:  This iteration is count 34
Dec 16 14:38:11 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:38:11 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:38:11 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:38:11 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:38:11 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:38:11 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:38:11 xen-01 iscsi-ha: 2579 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:38:11 xen-01 iscsi-ha: 2579 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:38:11 xen-01 iscsi-ha: 2579 service_execute: systemctl mode being used
Dec 16 14:38:11 xen-01 iscsi-ha: 2579 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:38:11 xen-01 iscsi-ha: 2579 service_execute: Returning exit status [ 3 ]
Dec 16 14:38:11 xen-01 iscsi-ha: 2579 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:38:11 xen-01 iscsi-ha: 2579 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:38:11 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:38:11 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:38:11 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:38:11 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:38:11 xen-01 iscsi-ha: 2579 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:38:11 xen-01 iscsi-ha: 2579 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:38:11 xen-01 iscsi-ha: 2579 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:38:11 xen-01 iscsi-ha: 2579 email: Message barred for 30 minutes
Dec 16 14:38:11 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:38:11 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:38:11 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:38:11 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:38:11 xen-01 iscsi-ha: 2579 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:38:11 xen-01 iscsi-ha: 2579 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:38:11 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:38:11 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:38:11 xen-01 iscsi-ha: 2579 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:38:11 xen-01 iscsi-ha: 2579 email: Message barred for 30 minutes
Dec 16 14:38:11 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:38:11 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:38:11 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:38:11 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:38:11 xen-01 iscsi-ha: 2579 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:38:11 xen-01 iscsi-ha: 2579 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:38:11 xen-01 iscsi-ha: 2579 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:38:11 xen-01 iscsi-ha: 2579 email: Message barred for 30 minutes
Dec 16 14:38:12 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:38:17 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:38:21 xen-01 iscsi-ha: 2537 Spawning new instance of iscsi-ha
Dec 16 14:38:21 xen-01 iscsi-ha: 2537 check_logger_processes Checking logger processes
Dec 16 14:38:21 xen-01 iscsi-ha: 2537 check_logger_processes No processes to clear
Dec 16 14:38:21 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:38:21 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:38:21 xen-01 iscsi-ha:  This iteration is count 35
Dec 16 14:38:21 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:38:21 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:38:21 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:38:21 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:38:21 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:38:21 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:38:21 xen-01 iscsi-ha: 3352 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:38:21 xen-01 iscsi-ha: 3352 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:38:21 xen-01 iscsi-ha: 3352 service_execute: systemctl mode being used
Dec 16 14:38:21 xen-01 iscsi-ha: 3352 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:38:21 xen-01 iscsi-ha: 3352 service_execute: Returning exit status [ 3 ]
Dec 16 14:38:21 xen-01 iscsi-ha: 3352 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:38:21 xen-01 iscsi-ha: 3352 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:38:21 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:38:21 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:38:21 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:38:21 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:38:21 xen-01 iscsi-ha: 3352 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:38:21 xen-01 iscsi-ha: 3352 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:38:21 xen-01 iscsi-ha: 3352 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:38:21 xen-01 iscsi-ha: 3352 email: Message barred for 30 minutes
Dec 16 14:38:21 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:38:21 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:38:21 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:38:21 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:38:21 xen-01 iscsi-ha: 3352 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:38:21 xen-01 iscsi-ha: 3352 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:38:21 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:38:21 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:38:21 xen-01 iscsi-ha: 3352 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:38:21 xen-01 iscsi-ha: 3352 email: Message barred for 30 minutes
Dec 16 14:38:21 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:38:21 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:38:21 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:38:21 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:38:21 xen-01 iscsi-ha: 3352 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:38:21 xen-01 iscsi-ha: 3352 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:38:21 xen-01 iscsi-ha: 3352 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:38:21 xen-01 iscsi-ha: 3352 email: Message barred for 30 minutes
Dec 16 14:38:22 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:38:27 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:38:31 xen-01 iscsi-ha: 3317 Spawning new instance of iscsi-ha
Dec 16 14:38:31 xen-01 iscsi-ha: 3317 check_logger_processes Checking logger processes
Dec 16 14:38:31 xen-01 iscsi-ha: 3317 check_logger_processes No processes to clear
Dec 16 14:38:31 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:38:31 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:38:31 xen-01 iscsi-ha:  This iteration is count 36
Dec 16 14:38:31 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:38:31 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:38:31 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:38:31 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:38:31 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:38:31 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:38:31 xen-01 iscsi-ha: 4156 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:38:31 xen-01 iscsi-ha: 4156 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:38:31 xen-01 iscsi-ha: 4156 service_execute: systemctl mode being used
Dec 16 14:38:31 xen-01 iscsi-ha: 4156 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:38:31 xen-01 iscsi-ha: 4156 service_execute: Returning exit status [ 3 ]
Dec 16 14:38:31 xen-01 iscsi-ha: 4156 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:38:31 xen-01 iscsi-ha: 4156 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:38:31 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:38:31 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:38:31 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:38:31 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:38:31 xen-01 iscsi-ha: 4156 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:38:31 xen-01 iscsi-ha: 4156 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:38:31 xen-01 iscsi-ha: 4156 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:38:31 xen-01 iscsi-ha: 4156 email: Message barred for 30 minutes
Dec 16 14:38:31 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:38:31 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:38:31 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:38:31 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:38:31 xen-01 iscsi-ha: 4156 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:38:31 xen-01 iscsi-ha: 4156 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:38:31 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:38:31 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:38:31 xen-01 iscsi-ha: 4156 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:38:31 xen-01 iscsi-ha: 4156 email: Message barred for 30 minutes
Dec 16 14:38:31 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:38:31 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:38:31 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:38:31 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:38:31 xen-01 iscsi-ha: 4156 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:38:31 xen-01 iscsi-ha: 4156 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:38:31 xen-01 iscsi-ha: 4156 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:38:31 xen-01 iscsi-ha: 4156 email: Message barred for 30 minutes
Dec 16 14:38:32 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:38:37 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:38:41 xen-01 iscsi-ha: 4112 Spawning new instance of iscsi-ha
Dec 16 14:38:41 xen-01 iscsi-ha: 4112 check_logger_processes Checking logger processes
Dec 16 14:38:41 xen-01 iscsi-ha: 4112 check_logger_processes No processes to clear
Dec 16 14:38:41 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:38:41 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:38:41 xen-01 iscsi-ha:  This iteration is count 37
Dec 16 14:38:41 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:38:41 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:38:41 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:38:41 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:38:41 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:38:41 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:38:41 xen-01 iscsi-ha: 5429 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:38:41 xen-01 iscsi-ha: 5429 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:38:41 xen-01 iscsi-ha: 5429 service_execute: systemctl mode being used
Dec 16 14:38:41 xen-01 iscsi-ha: 5429 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:38:41 xen-01 iscsi-ha: 5429 service_execute: Returning exit status [ 3 ]
Dec 16 14:38:41 xen-01 iscsi-ha: 5429 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:38:41 xen-01 iscsi-ha: 5429 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:38:41 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:38:41 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:38:41 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:38:41 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:38:41 xen-01 iscsi-ha: 5429 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:38:41 xen-01 iscsi-ha: 5429 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:38:41 xen-01 iscsi-ha: 5429 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:38:41 xen-01 iscsi-ha: 5429 email: Message barred for 30 minutes
Dec 16 14:38:41 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:38:41 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:38:41 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:38:41 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:38:41 xen-01 iscsi-ha: 5429 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:38:41 xen-01 iscsi-ha: 5429 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:38:41 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:38:41 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:38:41 xen-01 iscsi-ha: 5429 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:38:41 xen-01 iscsi-ha: 5429 email: Message barred for 30 minutes
Dec 16 14:38:41 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:38:41 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:38:41 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:38:41 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:38:41 xen-01 iscsi-ha: 5429 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:38:41 xen-01 iscsi-ha: 5429 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:38:41 xen-01 iscsi-ha: 5429 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:38:41 xen-01 iscsi-ha: 5429 email: Message barred for 30 minutes
Dec 16 14:38:43 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:38:48 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:38:51 xen-01 iscsi-ha: 5352 Spawning new instance of iscsi-ha
Dec 16 14:38:51 xen-01 iscsi-ha: 5352 check_logger_processes Checking logger processes
Dec 16 14:38:51 xen-01 iscsi-ha: 5352 check_logger_processes No processes to clear
Dec 16 14:38:51 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:38:51 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:38:51 xen-01 iscsi-ha:  This iteration is count 38
Dec 16 14:38:51 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:38:51 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:38:51 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:38:51 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:38:51 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:38:51 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:38:51 xen-01 iscsi-ha: 6197 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:38:51 xen-01 iscsi-ha: 6197 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:38:51 xen-01 iscsi-ha: 6197 service_execute: systemctl mode being used
Dec 16 14:38:51 xen-01 iscsi-ha: 6197 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:38:51 xen-01 iscsi-ha: 6197 service_execute: Returning exit status [ 3 ]
Dec 16 14:38:51 xen-01 iscsi-ha: 6197 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:38:51 xen-01 iscsi-ha: 6197 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:38:51 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:38:51 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:38:51 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:38:51 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:38:51 xen-01 iscsi-ha: 6197 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:38:51 xen-01 iscsi-ha: 6197 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:38:51 xen-01 iscsi-ha: 6197 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:38:51 xen-01 iscsi-ha: 6197 email: Message barred for 30 minutes
Dec 16 14:38:51 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:38:51 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:38:51 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:38:51 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:38:51 xen-01 iscsi-ha: 6197 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:38:51 xen-01 iscsi-ha: 6197 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:38:51 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:38:51 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:38:51 xen-01 iscsi-ha: 6197 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:38:51 xen-01 iscsi-ha: 6197 email: Message barred for 30 minutes
Dec 16 14:38:51 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:38:51 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:38:51 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:38:51 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:38:51 xen-01 iscsi-ha: 6197 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:38:51 xen-01 iscsi-ha: 6197 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:38:52 xen-01 iscsi-ha: 6197 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:38:52 xen-01 iscsi-ha: 6197 email: Message barred for 30 minutes
Dec 16 14:38:53 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:38:58 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:39:01 xen-01 iscsi-ha: 6150 Spawning new instance of iscsi-ha
Dec 16 14:39:01 xen-01 iscsi-ha: 6150 check_logger_processes Checking logger processes
Dec 16 14:39:01 xen-01 iscsi-ha: 6150 check_logger_processes No processes to clear
Dec 16 14:39:01 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:39:01 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:39:01 xen-01 iscsi-ha:  This iteration is count 39
Dec 16 14:39:01 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:39:01 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:39:01 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:39:01 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:39:01 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:39:01 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:39:01 xen-01 iscsi-ha: 6895 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:39:01 xen-01 iscsi-ha: 6895 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:39:01 xen-01 iscsi-ha: 6895 service_execute: systemctl mode being used
Dec 16 14:39:01 xen-01 iscsi-ha: 6895 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:39:01 xen-01 iscsi-ha: 6895 service_execute: Returning exit status [ 3 ]
Dec 16 14:39:01 xen-01 iscsi-ha: 6895 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:39:01 xen-01 iscsi-ha: 6895 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:39:01 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:39:01 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:39:01 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:39:01 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:39:01 xen-01 iscsi-ha: 6895 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:39:01 xen-01 iscsi-ha: 6895 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:39:01 xen-01 iscsi-ha: 6895 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:39:01 xen-01 iscsi-ha: 6895 email: Message barred for 30 minutes
Dec 16 14:39:01 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:39:01 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:39:01 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:39:01 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:39:01 xen-01 iscsi-ha: 6895 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:39:01 xen-01 iscsi-ha: 6895 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:39:01 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:39:01 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:39:02 xen-01 iscsi-ha: 6895 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:39:02 xen-01 iscsi-ha: 6895 email: Message barred for 30 minutes
Dec 16 14:39:02 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:39:02 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:39:02 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:39:02 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:39:02 xen-01 iscsi-ha: 6895 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:39:02 xen-01 iscsi-ha: 6895 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:39:02 xen-01 iscsi-ha: 6895 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:39:02 xen-01 iscsi-ha: 6895 email: Message barred for 30 minutes
Dec 16 14:39:03 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:39:08 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:39:11 xen-01 iscsi-ha: 6857 Spawning new instance of iscsi-ha
Dec 16 14:39:11 xen-01 iscsi-ha: 6857 check_logger_processes Checking logger processes
Dec 16 14:39:11 xen-01 iscsi-ha: 6857 check_logger_processes No processes to clear
Dec 16 14:39:11 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:39:11 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:39:11 xen-01 iscsi-ha:  This iteration is count 40
Dec 16 14:39:11 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:39:11 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:39:11 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:39:11 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:39:11 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:39:11 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:39:11 xen-01 iscsi-ha: 7908 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:39:11 xen-01 iscsi-ha: 7908 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:39:11 xen-01 iscsi-ha: 7908 service_execute: systemctl mode being used
Dec 16 14:39:11 xen-01 iscsi-ha: 7908 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:39:11 xen-01 iscsi-ha: 7908 service_execute: Returning exit status [ 3 ]
Dec 16 14:39:12 xen-01 iscsi-ha: 7908 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:39:12 xen-01 iscsi-ha: 7908 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:39:12 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:39:12 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:39:12 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:39:12 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:39:12 xen-01 iscsi-ha: 7908 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:39:12 xen-01 iscsi-ha: 7908 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:39:12 xen-01 iscsi-ha: 7908 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:39:12 xen-01 iscsi-ha: 7908 email: Message barred for 30 minutes
Dec 16 14:39:12 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:39:12 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:39:12 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:39:12 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:39:12 xen-01 iscsi-ha: 7908 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:39:12 xen-01 iscsi-ha: 7908 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:39:12 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:39:12 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:39:12 xen-01 iscsi-ha: 7908 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:39:12 xen-01 iscsi-ha: 7908 email: Message barred for 30 minutes
Dec 16 14:39:12 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:39:12 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:39:12 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:39:12 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:39:12 xen-01 iscsi-ha: 7908 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:39:12 xen-01 iscsi-ha: 7908 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:39:12 xen-01 iscsi-ha: 7908 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:39:12 xen-01 iscsi-ha: 7908 email: Message barred for 30 minutes
Dec 16 14:39:13 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:39:18 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Dec 16 14:39:21 xen-01 iscsi-ha: 7803 Spawning new instance of iscsi-ha
Dec 16 14:39:21 xen-01 iscsi-ha: 7803 check_logger_processes Checking logger processes
Dec 16 14:39:21 xen-01 iscsi-ha: 7803 check_logger_processes No processes to clear
Dec 16 14:39:21 xen-01 iscsi-ha:  XenServer Major Release = [ 7 ]
Dec 16 14:39:21 xen-01 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:39:21 xen-01 iscsi-ha:  This iteration is count 41
Dec 16 14:39:21 xen-01 iscsi-ha:  Checking if this host is a Pool Master or Slave
Dec 16 14:39:21 xen-01 iscsi-ha:  This host's pool status = slave:172.16.14.200
Dec 16 14:39:21 xen-01 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Dec 16 14:39:21 xen-01 iscsi-ha:  service_execute: System V mode detected
Dec 16 14:39:21 xen-01 iscsi-ha:  service_execute: [  OK  ]#015iscsi-ha running: 4094
Dec 16 14:39:22 xen-01 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Dec 16 14:39:22 xen-01 iscsi-ha: 8894 local_ip_list: Local IP list returned 127.0.0.1#01210.10.10.1#012172.16.14.199
Dec 16 14:39:22 xen-01 iscsi-ha: 8894 service_execute: Execute [ status ] on [ tgtd ]
Dec 16 14:39:22 xen-01 iscsi-ha: 8894 service_execute: systemctl mode being used
Dec 16 14:39:22 xen-01 iscsi-ha: 8894 service_execute: ● tgtd.service - tgtd iSCSI target daemon#012   Loaded: loaded (/usr/lib/systemd/system/tgtd.service; disabled; vendor preset: disabled)#012  Drop-In: /etc/systemd/system/tgtd.service.d#012           └─local.conf#012   Active: inactive (dead)
Dec 16 14:39:22 xen-01 iscsi-ha: 8894 service_execute: Returning exit status [ 3 ]
Dec 16 14:39:22 xen-01 iscsi-ha: 8894 iSCSI target: tgtd status stopped. Expected Stopped . [inactive (dead)]
Dec 16 14:39:22 xen-01 iscsi-ha: 8894 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101)#012srcversion: FB3AC7056350AC64629E395
Dec 16 14:39:22 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:39:22 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:39:22 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:39:22 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 role 1' terminated with exit code 10
Dec 16 14:39:22 xen-01 iscsi-ha: 8894 check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:39:22 xen-01 iscsi-ha: 8894 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:39:22 xen-01 iscsi-ha: 8894 email: Duplicate message - not sending. Content = check_drbd_resource_state: Error retrieving DRBD state for resouce: iscsi1 - check configuration
Dec 16 14:39:22 xen-01 iscsi-ha: 8894 email: Message barred for 30 minutes
Dec 16 14:39:22 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:39:22 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:39:22 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:39:22 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 secondary 1' terminated with exit code 10
Dec 16 14:39:22 xen-01 iscsi-ha: 8894 DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:39:22 xen-01 iscsi-ha: 8894 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:39:22 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:39:22 xen-01 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: b88adcc4-b907-8315-6aa3-b9d781c78c5e
Dec 16 14:39:22 xen-01 iscsi-ha: 8894 email: Duplicate message - not sending. Content = DRBD Resource: iscsi1 failed transition to Secondary
Dec 16 14:39:22 xen-01 iscsi-ha: 8894 email: Message barred for 30 minutes
Dec 16 14:39:22 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: 1: Failure: (127) Device minor not allocated
Dec 16 14:39:22 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: additional info from kernel:
Dec 16 14:39:22 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: unknown minor
Dec 16 14:39:22 xen-01 iscsi-ha-ERROR-/etc/iscsi-ha/init/iscsi-ha.mon: Command 'drbdsetup-84 cstate 1' terminated with exit code 10
Dec 16 14:39:22 xen-01 iscsi-ha: 8894 DRBD Resource: iscsi1 in  state - expected Connected state
Dec 16 14:39:22 xen-01 iscsi-ha: 8894 email: Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Dec 16 14:39:22 xen-01 iscsi-ha: 8894 email: Duplicate message - not sending. Content = DRBD Resource:       iscsi1 in  state - expected Connected state
Dec 16 14:39:22 xen-01 iscsi-ha: 8894 email: Message barred for 30 minutes
Dec 16 14:39:23 xen-01 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK