Table of Content

libvirtd down after upgrade

[root@tripleo ~]# systemctl status libvirtd.service
● libvirtd.service - Virtualization daemon
Loaded: loaded (/usr/lib/systemd/system/libvirtd.service; enabled; vendor preset: enabled)
Active: failed (Result: start-limit) since Sat 2018-12-15 11:10:40 EST; 10s ago
Docs: man:libvirtd(8)
https://libvirt.org
Process: 2507 ExecStart=/usr/sbin/libvirtd $LIBVIRTD_ARGS (code=exited, status=3)
Main PID: 2507 (code=exited, status=3)
Tasks: 2 (limit: 32768)
CGroup: /system.slice/libvirtd.service
├─1753 /usr/sbin/dnsmasq --conf-file=/var/lib/libvirt/dnsmasq/default.conf --leasefile-ro --dhcp...
└─1754 /usr/sbin/dnsmasq --conf-file=/var/lib/libvirt/dnsmasq/default.conf --leasefile-ro --dhcp...

no clue from log

journalctl -x
Dec 15 11:10:40 tripleo systemd[1]: libvirtd.service: main process exited, code=exited, status=3/NOTIM...ENTED
Dec 15 11:10:40 tripleo systemd[1]: Failed to start Virtualization daemon.
Dec 15 11:10:40 tripleo systemd[1]: Unit libvirtd.service entered failed state.
Dec 15 11:10:40 tripleo systemd[1]: libvirtd.service failed.
Dec 15 11:10:40 tripleo systemd[1]: libvirtd.service holdoff time over, scheduling restart.
Dec 15 11:10:40 tripleo systemd[1]: start request repeated too quickly for libvirtd.service
Dec 15 11:10:40 tripleo systemd[1]: Failed to start Virtualization daemon.
Dec 15 11:10:40 tripleo systemd[1]: Unit libvirtd.service entered failed state.
Dec 15 11:10:40 tripleo systemd[1]: libvirtd.service failed.
Hint: Some lines were ellipsized, use -l to show in full.

narrow down to module rbd

[root@tripleo ~]# libvirtd -v
2018-12-15 16:13:55.861+0000: 2551: info : libvirt version: 4.5.0, package: 10.el7_6.3 (CentOS BuildSystem <http://bugs.centos.org>, 2018-11-28-20:51:39, x86-01.bsys.centos.org)
2018-12-15 16:13:55.861+0000: 2551: info : hostname: tripleo
2018-12-15 16:13:55.861+0000: 2551: info : virObjectNew:248 : OBJECT_NEW: obj=0x5642eaaee630 classname=virAccessManager
2018-12-15 16:13:55.861+0000: 2551: info : virObjectNew:248 : OBJECT_NEW: obj=0x5642eaadefe0 classname=virAccessManager
2018-12-15 16:13:55.861+0000: 2551: info : virObjectRef:382 : OBJECT_REF: obj=0x5642eaaee630
2018-12-15 16:13:55.861+0000: 2551: info : virObjectUnref:344 : OBJECT_UNREF: obj=0x5642eaaee630
2018-12-15 16:13:55.862+0000: 2551: info : virObjectNew:248 : OBJECT_NEW: obj=0x5642eaadf440 classname=virNetDaemon
2018-12-15 16:13:55.862+0000: 2551: info : virEventPollAddHandle:140 : EVENT_POLL_ADD_HANDLE: watch=1 fd=5 events=1 cb=0x7f594ede92d0 opaque=(nil) ff=(nil)
2018-12-15 16:13:55.862+0000: 2551: info : virObjectNew:248 : OBJECT_NEW: obj=0x5642eaadf7a0 classname=virNetServer
2018-12-15 16:13:55.862+0000: 2551: info : virObjectRef:382 : OBJECT_REF: obj=0x5642eaadf7a0
2018-12-15 16:13:55.875+0000: 2551: error : virModuleLoadFile:53 : internal error: Failed to load module '/usr/lib64/libvirt/storage-backend/libvirt_storage_backend_rbd.so': /usr/lib64/libvirt/storage-backend/libvirt_storage_backend_rbd.so: undefined symbol: rbd_diff_iterate2
2018-12-15 16:13:55.875+0000: 2551: info : virNetlinkEventServiceStopAll:865 : stopping all netlink event services

remedy

found right redhat fix here

remedy works exactly:

yum update librbd1
systemctl restart libvirtd