1、检查时间同步服务
时间不准确,导致计算节点没法同步控制节点的时间,配置控制节点的ntp配置文件,使两台服务器时间同步。
(控制节点写入)
server 127.127.1.0
fudge 127.127.1.0 startum 10
(计算节点)
ntpdate 192.168.100.10
重启cinder volume :systemctl restart openstack-cinder-volume
即可解决
2、清理残留信息
开始尚未定位到磁阵问题,以为是僵尸实例,删除了虚机后,发现云硬盘无法删除。想到可能是云硬盘的故障导致虚机无法启动,先手动清理云硬盘。
先手动清理cinder残余信息,查看数据库。
mysql> select id,availability_zone,status,display_name,attached_host from volumes;
+--------------------------------------+-------------------+---------+-------------------------------------+---------------+
| id | availability_zone | status | display_name | attached_host |
+--------------------------------------+-------------------+---------+-------------------------------------+---------------+
| 137975a0-1d46-45bc-b8fd-f206419bd4d3 | nova | deleted | ostf-test-volume1108178581 | NULL |
| 334974b2-8362-43cb-b46a-8c45e118519d | nova | in-use | disk_03 | NULL |
| 63ff6a75-a178-48eb-b705-2926c43b50f0 | nova | deleted | 123 | NULL |
| 82a76c96-798a-4329-b4d7-c7971548d969 | nova | deleted | testR | NULL |
| 8dcc6020-d770-40f8-a6f5-f43c2d7045cf | nova | deleted | ost1_test-bootable-volume1487712752 | NULL |
| 8f1a62fc-4daf-4f43-a8a1-e3ace71d9d89 | nova | in-use | disk_02 | NULL |
| 9ebaf91a-298a-4631-bd7f-56b5953f516c | nova | deleted | ostf-test-volume799806496 | NULL |
| c67a871a-b83a-4620-b64f-4de1cedae933 | nova | in-use | disk_01 | NULL |
+--------------------------------------+-------------------+---------+-------------------------------------+---------------+
8 rows in set (0.00 sec)
其中 disk_01/02/03 都是原先创建的云硬盘,直接删除发现有依赖表
mysql> delete from volumes where id='334974b2-8362-43cb-b46a-8c45e118519d';
ERROR 1451 (23000): Cannot delete or update a parent row: a foreign key constraint fails (`cinder`.`volume_admin_metadata`, CONSTRAINT `volume_admin_metadata_ibfk_1` FOREIGN KEY (`volume_id`) REFERENCES `volumes` (`id`))
mysql> select * from volume_admin_metadata;
+---------------------+------------+---------------------+---------+----+--------------------------------------+---------------+-------+
| created_at | updated_at | deleted_at | deleted | id | volume_id | key | value |
+---------------------+------------+---------------------+---------+----+--------------------------------------+---------------+-------+
| 2019-09-30 01:08:24 | NULL | 2019-09-30 01:08:49 | 1 | 1 | 8dcc6020-d770-40f8-a6f5-f43c2d7045cf | readonly | False |
| 2019-09-30 01:08:25 | NULL | 2019-09-30 01:08:37 | 1 | 2 | 8dcc6020-d770-40f8-a6f5-f43c2d7045cf | attached_mode | rw |
| 2019-09-30 01:09:17 | NULL | 2019-09-30 01:09:38 | 1 | 3 | 9ebaf91a-298a-4631-bd7f-56b5953f516c | readonly | False |
| 2019-09-30 01:09:17 | NULL | 2019-09-30 01:09:25 | 1 | 4 | 9ebaf91a-298a-4631-bd7f-56b5953f516c | attached_mode | rw |
| 2019-10-28 13:14:41 | NULL | NULL | 0 | 5 | c67a871a-b83a-4620-b64f-4de1cedae933 | readonly | False |
| 2019-10-28 13:14:41 | NULL | NULL | 0 | 6 | c67a871a-b83a-4620-b64f-4de1cedae933 | attached_mode | rw |
| 2019-11-02 07:43:17 | NULL | NULL | 0 | 7 | 8f1a62fc-4daf-4f43-a8a1-e3ace71d9d89 | readonly | False |
| 2019-11-02 07:43:17 | NULL | NULL | 0 | 8 | 8f1a62fc-4daf-4f43-a8a1-e3ace71d9d89 | attached_mode | rw |
| 2019-11-02 07:43:49 | NULL | NULL | 0 | 9 | 334974b2-8362-43cb-b46a-8c45e118519d | readonly | False |
| 2019-11-02 07:43:49 | NULL | NULL | 0 | 10 | 334974b2-8362-43cb-b46a-8c45e118519d | attached_mode | rw |
+---------------------+------------+---------------------+---------+----+--------------------------------------+---------------+-------+
10 rows in set (0.00 sec)
先在依赖表中删掉相关数据条,再在volumes表中清理
mysql> delete from volume_admin_metadata where volume_id='334974b2-8362-43cb-b46a-8c45e118519d';
Query OK, 2 rows affected (0.00 sec)
mysql> delete from volumes where id='334974b2-8362-43cb-b46a-8c45e118519d';
Query OK, 1 row affected (0.00 sec)