admin 发表于 2021-12-28 10:38:41

关闭新创建卷的exclusive-lock功能 ceph 创建的镜像保留layering

关闭新创建卷的exclusive-lock功能
如果是用Ceph Deploy进行的部署,则需要将配置文件分发到各个节点,在ceph.conf中增加rbd_default_features,写明你创建的卷需要哪几种属性。


rbd_default_features = "layering, deep-flatten"


或者只保留
rbd_default_features = "layering"

ceph-deploy --overwrite-conf configpush host09 host10 host11 compute06 compute07 compute08 compute09


此时再使用rbd create创建的卷默认就是这两种属性了
# rbd create -p images testimage --size 5G
# rbd info images/testimage
rbd image 'testimage':
size 5 GiB in 1280 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 68b1eebfa9994b
block_name_prefix: rbd_data.68b1eebfa9994b
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 28 10:45:15 2021
access_timestamp: Tue Dec 28 10:45:15 2021
modify_timestamp: Tue Dec 28 10:45:15 2021


最后还需要对OpenStack各个模块的ceph进行更新,如果使用kolla更新,则替换所有配置文件,并重启容器。
# scp ceph.conf controller1:/etc/kolla/config/glance/
ceph.conf                                                                                                                                                                      100%595   1.2MB/s   00:00   
# scp ceph.conf controller1:/etc/kolla/config/nova
ceph.conf                                                                                                                                                                      100%595   1.2MB/s   00:00   
# scp ceph.conf controller1:/etc/kolla/config/cinder
ceph.conf                                                                           

kolla-ansible -i multinode reconfigure

需要重启cinder相关服务



# rbd info volume-5764f3d4-6654-4d5d-ad7c-2c36d03d1ccb -p pool-ssd-2
rbd image 'volume-5764f3d4-6654-4d5d-ad7c-2c36d03d1ccb':
size 10 GiB in 2560 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 8b52d05df0f51e
block_name_prefix: rbd_data.8b52d05df0f51e
format: 2
features: layering, exclusive-lock, object-map, fast-diff, deep-flatten
op_features:
flags:
create_timestamp: Tue Dec 28 14:02:52 2021
access_timestamp: Tue Dec 28 14:02:52 2021
modify_timestamp: Tue Dec 28 14:02:52 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB

# docker restart cinder_volume cinder_backup cinder_scheduler cinder_api
cinder_volume
cinder_backup
cinder_scheduler
cinder_api


# rbd info volume-5764f3d4-6654-4d5d-ad7c-2c36d03d1ccb -p pool-ssd-2
rbd: error opening image volume-5764f3d4-6654-4d5d-ad7c-2c36d03d1ccb: (2) No such file or directory
# rbd info volume-94e28573-bfb9-4092-8d81-34f1e4059d97 -p pool-ssd-2
rbd image 'volume-94e28573-bfb9-4092-8d81-34f1e4059d97':
size 10 GiB in 2560 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 8b576837a8afd1
block_name_prefix: rbd_data.8b576837a8afd1
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 28 14:07:46 2021
access_timestamp: Tue Dec 28 14:07:46 2021
modify_timestamp: Tue Dec 28 14:07:46 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB



关闭exclusive-lock功能
通过查看rbd info,获取当前卷是否开启了exclusive-lock
# rbd info volumes/volume-cad6425c-4453-4489-b2d1-45050b062bd2


关闭exclusive-lock功能,这里必须要和object-map或journaling一起关闭才能生效
rbd feature disable volumes/volume-cad6425c-4453-4489-b2d1-45050b062bd2 exclusive-lock,object-map

再次查看功能列表,features只剩下layering和deep-flattern
# rbd info volumes/volume-cad6425c-4453-4489-b2d1-45050b062bd2
rbd image '27cea94c-9351-462f-a8ab-2cc84c9c2373':
size 12 GiB in 1536 objects
order 23 (8 MiB objects)
snapshot_count: 1
id: 6761d8e16f525e
block_name_prefix: rbd_data.6761d8e16f525e
format: 2
features: layering, deep-flatten
op_features:
flags:
create_timestamp: Tue Dec 21 14:41:18 2021
access_timestamp: Tue Dec 21 14:41:18 2021
modify_timestamp: Tue Dec 21 14:41:18 2021

批量关闭所有卷的exclusive-lock


for i in $(rbd ls -p images );do rbd feature disable images/$i exclusive-lock,object-map,deep-flatten ;rbd info images/$i ;done





admin 发表于 2021-12-28 10:40:30

ceph支持 layering,striping exclusive lock, object map,fast diff ,deep-flatten 等新的new features
layering
image的克隆操作。可以对image创建快照并保护,然后从快照克隆出新的image出来,父子image之间采用COW技术,共享对象数据。striping v2
条带化对象数据,类似raid 0,可改善顺序读写场景较多情况下的性能。exclusive lock
保护image数据一致性,对image做修改时,需要持有此锁。这个可以看做是一个分布式锁,在开启的时候,确保只有一个客户端在访问image,否则锁的竞争会导致io急剧下降。 主要应用场景是qemu live-migration。object map
此特性依赖于exclusive lock。因为image的对象分配是thin-provisioning,此特性开启的时候,会记录image所有对象的一个位图,用以标记对象是否真的存在,在一些场景下可以加速io。fast diff
此特性依赖于object map和exlcusive lock。快速比较image的snapshot之间的差异。deep-flatten
layering特性使得克隆image的时候,父子image之间采用COW,他们之间的对象文件存在依赖关系,flatten操作的目的是解除父子image的依赖关系,但是子image的快照并没有解除依赖,deep-flatten特性使得快照的依赖也解除。journaling
依赖于exclusive lock。将image的所有修改操作进行日志化,并且复制到另外一个集群(mirror),可以做到块存储的异地灾备。这个特性在部署的时候需要新部署一个daemon进程,目前还在试验阶段,不过这个特性很重要,可以做跨集群/机房容灾。创建image的时候,jewel默认开启的特性包括: layering/exlcusive lock/object map/fast diff/deep flattenExclusive Lock
从上面可以看出,很多特性都依赖于exclusive lock,重点介绍一下。exclusive lock 是分布式锁,实现的时候默认是客户端在第一次写的时候获取锁,并且在收到其他客户端的锁请求时自动释放锁。这个特性在jewel默认开启后,本身没什么问题, 客户端可以自动获取和释放锁,在客户端crash后也能够正确处理。

admin 发表于 2021-12-28 11:07:17

# for i in $(rbd ls -p pool-ssd-2);do rbd feature disable pool-ssd-2/$i exclusive-lock,object-map,deep-flatten ;rbd info pool-ssd-2/$i ;done
rbd image 'volume-09fba6c8-5105-4ad5-9baf-2edc9c51fac7':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 6764efb2270ebd
block_name_prefix: rbd_data.6764efb2270ebd
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 14:26:04 2021
access_timestamp: Tue Dec 21 14:26:04 2021
modify_timestamp: Tue Dec 21 14:26:04 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-0d4b255b-5d7a-41a4-a29a-4b088f2abd7d':
size 200 GiB in 51200 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 76655d32817107
block_name_prefix: rbd_data.76655d32817107
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 15:07:26 2021
access_timestamp: Tue Dec 21 15:07:26 2021
modify_timestamp: Tue Dec 21 15:07:26 2021
rbd image 'volume-0e9a7ecb-4cb0-4f89-8831-da02a3fb23c6':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 767423573973d5
block_name_prefix: rbd_data.767423573973d5
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 14:25:33 2021
access_timestamp: Tue Dec 21 14:25:33 2021
modify_timestamp: Tue Dec 21 14:25:33 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-1a39ac81-4359-4e8c-b7b2-f5b8499c1136':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 7649ce2516e319
block_name_prefix: rbd_data.7649ce2516e319
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:03:06 2021
access_timestamp: Tue Dec 21 16:03:06 2021
modify_timestamp: Tue Dec 21 16:03:06 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-1e7c9937-a00b-411a-b79b-d31d2a37f2cb':
size 300 GiB in 76800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 76c7001d371b6d
block_name_prefix: rbd_data.76c7001d371b6d
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:55:37 2021
access_timestamp: Tue Dec 21 16:55:37 2021
modify_timestamp: Tue Dec 21 16:55:37 2021
rbd image 'volume-24f9176e-7e23-407e-9e1d-d10598df72e4':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 764a9a39902847
block_name_prefix: rbd_data.764a9a39902847
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:03:35 2021
access_timestamp: Tue Dec 21 16:03:35 2021
modify_timestamp: Tue Dec 21 16:03:35 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-297f6c84-8653-4e62-96c1-60bc93ab2d5f':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 764e686c9e848a
block_name_prefix: rbd_data.764e686c9e848a
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 14:25:34 2021
access_timestamp: Tue Dec 21 14:25:34 2021
modify_timestamp: Tue Dec 21 14:25:34 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-2b0f3d5a-63ee-464e-a5a6-9f1ee639596b':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 76839f1e2b2b2b
block_name_prefix: rbd_data.76839f1e2b2b2b
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:03:00 2021
access_timestamp: Tue Dec 21 16:03:00 2021
modify_timestamp: Tue Dec 21 16:03:00 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-2c99bf04-bf03-405d-a628-559451192a24':
size 200 GiB in 51200 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 762c34716910bc
block_name_prefix: rbd_data.762c34716910bc
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 15:07:28 2021
access_timestamp: Tue Dec 21 15:07:28 2021
modify_timestamp: Tue Dec 21 15:07:28 2021
rbd image 'volume-33537697-c9c4-47de-8a06-912d35b7a681':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 7649a12f5bd696
block_name_prefix: rbd_data.7649a12f5bd696
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:02:57 2021
access_timestamp: Tue Dec 21 16:02:57 2021
modify_timestamp: Tue Dec 21 16:02:57 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-3496b392-f1b0-4d04-a1ff-dbe4195ab53d':
size 200 GiB in 51200 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 762aea3188652e
block_name_prefix: rbd_data.762aea3188652e
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 15:05:26 2021
access_timestamp: Tue Dec 21 15:05:26 2021
modify_timestamp: Tue Dec 21 15:05:26 2021
rbd image 'volume-3d0f3268-ae7a-4495-9024-c35eae56e408':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 764a102ec950ae
block_name_prefix: rbd_data.764a102ec950ae
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:03:14 2021
access_timestamp: Tue Dec 21 16:03:14 2021
modify_timestamp: Tue Dec 21 16:03:14 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-4292ad38-b702-4efc-8c78-1640ef035dc1':
size 300 GiB in 76800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 76a0221ac5a494
block_name_prefix: rbd_data.76a0221ac5a494
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:55:29 2021
access_timestamp: Tue Dec 21 16:55:29 2021
modify_timestamp: Tue Dec 21 16:55:29 2021
rbd image 'volume-4462eabd-ca96-49e1-9441-cbdbd3ca5545':
size 800 GiB in 204800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 7667c83f695d0d
block_name_prefix: rbd_data.7667c83f695d0d
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:57:06 2021
access_timestamp: Tue Dec 21 16:57:06 2021
modify_timestamp: Tue Dec 21 16:57:06 2021
rbd image 'volume-44b8b50b-da58-4f87-b763-2e486db57c40':
size 300 GiB in 76800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 76a03465b93493
block_name_prefix: rbd_data.76a03465b93493
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:55:32 2021
access_timestamp: Tue Dec 21 16:55:32 2021
modify_timestamp: Tue Dec 21 16:55:32 2021
rbd image 'volume-56bbe515-a46f-4032-b83d-4c550984c221':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 67683abfd264bb
block_name_prefix: rbd_data.67683abfd264bb
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:03:03 2021
access_timestamp: Tue Dec 21 16:03:03 2021
modify_timestamp: Tue Dec 21 16:03:03 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-5977cc4e-e74a-4c1e-9633-143300fad25c':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 764a5854b54223
block_name_prefix: rbd_data.764a5854b54223
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:03:23 2021
access_timestamp: Tue Dec 21 16:03:23 2021
modify_timestamp: Tue Dec 21 16:03:23 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-5df5a07d-32d7-468c-bfe4-eaa8ce1bfe2b':
size 300 GiB in 76800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 76683d768f7399
block_name_prefix: rbd_data.76683d768f7399
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:57:41 2021
access_timestamp: Tue Dec 21 16:57:41 2021
modify_timestamp: Tue Dec 21 16:57:41 2021
rbd image 'volume-6bb44053-a438-46f5-b716-7be5e117f4a2':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 765bd35e155cdb
block_name_prefix: rbd_data.765bd35e155cdb
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 14:50:07 2021
access_timestamp: Tue Dec 21 14:50:07 2021
modify_timestamp: Tue Dec 21 14:50:07 2021
parent: images/27cea94c-9351-462f-a8ab-2cc84c9c2373@snap
overlap: 12 GiB
rbd image 'volume-6ef2c4bd-6dbd-45f3-8c4a-85d9bb5096c7':
size 200 GiB in 51200 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 768c1d3a46efa1
block_name_prefix: rbd_data.768c1d3a46efa1
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 15:07:33 2021
access_timestamp: Tue Dec 21 15:07:33 2021
modify_timestamp: Tue Dec 21 15:07:33 2021
rbd image 'volume-7112c816-6e1f-478c-9662-84022148b452':
size 1000 GiB in 256000 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 76649a1ff835b9
block_name_prefix: rbd_data.76649a1ff835b9
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 15:06:06 2021
access_timestamp: Tue Dec 21 15:06:06 2021
modify_timestamp: Tue Dec 21 15:06:06 2021
rbd image 'volume-7ac3c10a-3bd5-47e1-b72d-a4d489d9463c':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 76155d2dcd247a
block_name_prefix: rbd_data.76155d2dcd247a
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 14:25:56 2021
access_timestamp: Tue Dec 21 14:25:56 2021
modify_timestamp: Tue Dec 21 14:25:56 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-7de50d45-4d09-48ff-a852-fd37ae7a52a4':
size 500 GiB in 128000 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 768af72c0cea68
block_name_prefix: rbd_data.768af72c0cea68
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 15:05:51 2021
access_timestamp: Tue Dec 21 15:05:51 2021
modify_timestamp: Tue Dec 21 15:05:51 2021
rbd image 'volume-7eca33cd-9496-45da-a002-08bfd3b9c03c':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 7649f56b7c40d7
block_name_prefix: rbd_data.7649f56b7c40d7
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:03:08 2021
access_timestamp: Tue Dec 21 16:03:08 2021
modify_timestamp: Tue Dec 21 16:03:08 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-80f9c548-d859-4179-ba43-c4fdec3452aa':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 761590277f00cd
block_name_prefix: rbd_data.761590277f00cd
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 14:26:08 2021
access_timestamp: Tue Dec 21 14:26:08 2021
modify_timestamp: Tue Dec 21 14:26:08 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-82c1ab08-9ddc-461b-8138-673673e838a8':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 6761512d939d64
block_name_prefix: rbd_data.6761512d939d64
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 14:25:44 2021
access_timestamp: Tue Dec 21 14:25:44 2021
modify_timestamp: Tue Dec 21 14:25:44 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-88639cfc-006b-4122-bf79-3d365f7dd61e':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 7614fa6c44421e
block_name_prefix: rbd_data.7614fa6c44421e
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 14:25:37 2021
access_timestamp: Tue Dec 21 14:25:37 2021
modify_timestamp: Tue Dec 21 14:25:37 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-938b9eef-d356-4e5d-9426-8294308b7ecf':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 6768435708b0de
block_name_prefix: rbd_data.6768435708b0de
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:03:29 2021
access_timestamp: Tue Dec 21 16:03:29 2021
modify_timestamp: Tue Dec 21 16:03:29 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-95b875c4-b19f-472d-b96f-a960f6f8ff9e':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 764ebf7edc1ffb
block_name_prefix: rbd_data.764ebf7edc1ffb
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 14:25:52 2021
access_timestamp: Tue Dec 21 14:25:52 2021
modify_timestamp: Tue Dec 21 14:25:52 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-9644fae0-c650-496a-90d7-4fff86cd07ea':
size 100 GiB in 25600 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 67629faddb27d7
block_name_prefix: rbd_data.67629faddb27d7
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 15:03:45 2021
access_timestamp: Tue Dec 21 15:03:45 2021
modify_timestamp: Tue Dec 21 15:03:45 2021
rbd image 'volume-99a12832-9533-43b4-8c5e-f8cc22743fcc':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 6764a255c03488
block_name_prefix: rbd_data.6764a255c03488
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:03:17 2021
access_timestamp: Tue Dec 21 16:03:17 2021
modify_timestamp: Tue Dec 21 16:03:17 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-9e8b1bd5-5f9a-4ab4-a850-0ff6dfb17812':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 6764ee913a8d51
block_name_prefix: rbd_data.6764ee913a8d51
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 14:25:59 2021
access_timestamp: Tue Dec 21 14:25:59 2021
modify_timestamp: Tue Dec 21 14:25:59 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-a0ec6af3-dc17-4350-8512-f54b8174f846':
size 300 GiB in 76800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 7667fb7ecb6a2d
block_name_prefix: rbd_data.7667fb7ecb6a2d
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:57:27 2021
access_timestamp: Tue Dec 21 16:57:27 2021
modify_timestamp: Tue Dec 21 16:57:27 2021
rbd image 'volume-a22d3c0b-2a37-4b44-8786-e7e118c8d420':
size 200 GiB in 51200 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 768be1577139e0
block_name_prefix: rbd_data.768be1577139e0
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 15:07:21 2021
access_timestamp: Tue Dec 21 15:07:21 2021
modify_timestamp: Tue Dec 21 15:07:21 2021
rbd image 'volume-a3fdc982-9b86-4630-913f-77c2b3bce265':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 76152a17b25c38
block_name_prefix: rbd_data.76152a17b25c38
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 14:25:49 2021
access_timestamp: Tue Dec 21 14:25:49 2021
modify_timestamp: Tue Dec 21 14:25:49 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-a5075012-cb83-44d5-8b8d-48da26f651ef':
size 300 GiB in 76800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 76c6f156306791
block_name_prefix: rbd_data.76c6f156306791
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:55:35 2021
access_timestamp: Tue Dec 21 16:55:35 2021
modify_timestamp: Tue Dec 21 16:55:35 2021
rbd image 'volume-a6f435a4-5365-4959-af97-2b332d4043c0':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 6765bfd302d612
block_name_prefix: rbd_data.6765bfd302d612
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 14:50:16 2021
access_timestamp: Tue Dec 21 14:50:16 2021
modify_timestamp: Tue Dec 21 14:50:16 2021
parent: images/27cea94c-9351-462f-a8ab-2cc84c9c2373@snap
overlap: 12 GiB
rbd image 'volume-a6fbd219-2954-49e5-a1f3-31fb5dd367b0':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 764eaa37d57693
block_name_prefix: rbd_data.764eaa37d57693
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 14:25:46 2021
access_timestamp: Tue Dec 21 14:25:46 2021
modify_timestamp: Tue Dec 21 14:25:46 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-a77c496b-3cce-40d5-9599-8db25bbaae6b':
size 200 GiB in 51200 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 762c5563f65e63
block_name_prefix: rbd_data.762c5563f65e63
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 15:07:36 2021
access_timestamp: Tue Dec 21 15:07:36 2021
modify_timestamp: Tue Dec 21 15:07:36 2021
rbd image 'volume-a89d9954-8bfa-4a5c-9311-4a8a48c9fc34':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 76817050826b7b
block_name_prefix: rbd_data.76817050826b7b
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 14:49:13 2021
access_timestamp: Tue Dec 21 14:49:13 2021
modify_timestamp: Tue Dec 21 14:49:13 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-a93290f8-d97e-4650-9b8c-9e6ccdc64eaa':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 764f197a9ea6a4
block_name_prefix: rbd_data.764f197a9ea6a4
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 14:26:10 2021
access_timestamp: Tue Dec 21 14:26:10 2021
modify_timestamp: Tue Dec 21 14:26:10 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-a9e1f522-6381-4f46-8e4d-89f0903c69fd':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 67615033e84ba7
block_name_prefix: rbd_data.67615033e84ba7
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 14:25:40 2021
access_timestamp: Tue Dec 21 14:25:40 2021
modify_timestamp: Tue Dec 21 14:25:40 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-ab893b99-b16a-4bb2-9267-057f837dc3e8':
size 800 GiB in 204800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 76b58e343acc17
block_name_prefix: rbd_data.76b58e343acc17
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 17:33:39 2021
access_timestamp: Tue Dec 21 17:33:39 2021
modify_timestamp: Tue Dec 21 17:33:39 2021
rbd image 'volume-b873845e-5531-4e20-b03d-f4804e36ea30':
size 300 GiB in 76800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 676c709d6a8f9a
block_name_prefix: rbd_data.676c709d6a8f9a
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:55:41 2021
access_timestamp: Tue Dec 21 16:55:41 2021
modify_timestamp: Tue Dec 21 16:55:41 2021
rbd image 'volume-bdef9eb8-24d1-4e9e-8fbb-c934a65ad9db':
size 200 GiB in 51200 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 762c3d74495521
block_name_prefix: rbd_data.762c3d74495521
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 15:07:31 2021
access_timestamp: Tue Dec 21 15:07:31 2021
modify_timestamp: Tue Dec 21 15:07:31 2021
rbd image 'volume-be8c6b33-cf02-43b4-9747-99b85cd34420':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 764a4073521264
block_name_prefix: rbd_data.764a4073521264
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:03:20 2021
access_timestamp: Tue Dec 21 16:03:20 2021
modify_timestamp: Tue Dec 21 16:03:20 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-cda2c070-56e5-48e6-b842-bdf0eb77011c':
size 300 GiB in 76800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 76670549b0bdc7
block_name_prefix: rbd_data.76670549b0bdc7
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:55:43 2021
access_timestamp: Tue Dec 21 16:55:43 2021
modify_timestamp: Tue Dec 21 16:55:43 2021
rbd image 'volume-d7df52f9-e093-4221-b0a8-6169d0222fa8':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 6764a0194b60bd
block_name_prefix: rbd_data.6764a0194b60bd
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:03:11 2021
access_timestamp: Tue Dec 21 16:03:11 2021
modify_timestamp: Tue Dec 21 16:03:11 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-d8ec53b6-c759-4b3c-a737-a6f389ef8350':
size 300 GiB in 76800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 76c6ca1fb6d17d
block_name_prefix: rbd_data.76c6ca1fb6d17d
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:55:27 2021
access_timestamp: Tue Dec 21 16:55:27 2021
modify_timestamp: Tue Dec 21 16:55:27 2021
rbd image 'volume-e1438141-7eba-4f51-bc94-415357c7d9f5':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 76b19447a4e2de
block_name_prefix: rbd_data.76b19447a4e2de
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:15:52 2021
access_timestamp: Tue Dec 21 16:15:52 2021
modify_timestamp: Tue Dec 21 16:15:52 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-e7009ca3-3464-411e-929f-4908c6d9e0bf':
size 500 GiB in 128000 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 762b2c42063fd7
block_name_prefix: rbd_data.762b2c42063fd7
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 15:05:54 2021
access_timestamp: Tue Dec 21 15:05:54 2021
modify_timestamp: Tue Dec 21 15:05:54 2021
rbd image 'volume-e8deaee0-94dc-4b97-8e85-8a834c6e3105':
size 200 GiB in 51200 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 762c28603b89fa
block_name_prefix: rbd_data.762c28603b89fa
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 15:07:24 2021
access_timestamp: Tue Dec 21 15:07:24 2021
modify_timestamp: Tue Dec 21 15:07:24 2021
rbd image 'volume-e9f69e5c-944a-4575-87bc-b39303ab180f':
size 300 GiB in 76800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 676671dbaa29c6
block_name_prefix: rbd_data.676671dbaa29c6
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:55:51 2021
access_timestamp: Tue Dec 21 16:55:51 2021
modify_timestamp: Tue Dec 21 16:55:51 2021
rbd image 'volume-eab97070-36a0-4e21-b9bf-ff62667f57b7':
size 300 GiB in 76800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 76a05e1312c292
block_name_prefix: rbd_data.76a05e1312c292
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:55:46 2021
access_timestamp: Tue Dec 21 16:55:46 2021
modify_timestamp: Tue Dec 21 16:55:46 2021
rbd image 'volume-ee0c41d7-0eca-47c5-8c65-0e85ce0cd3e3':
size 50 GiB in 12800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 76842942f7b9b8
block_name_prefix: rbd_data.76842942f7b9b8
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:03:26 2021
access_timestamp: Tue Dec 21 16:03:26 2021
modify_timestamp: Tue Dec 21 16:03:26 2021
parent: images/cf388a13-e476-47eb-8bb8-ef8544cfa8eb@snap
overlap: 3 GiB
rbd image 'volume-f0716fa2-8864-4b29-ae24-8afc9380d6f9':
size 300 GiB in 76800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 676a190347ba9c
block_name_prefix: rbd_data.676a190347ba9c
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:57:44 2021
access_timestamp: Tue Dec 21 16:57:44 2021
modify_timestamp: Tue Dec 21 16:57:44 2021
rbd image 'volume-f38923e0-bba4-4c57-be10-c04246c6f7a7':
size 1000 GiB in 256000 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 7664ac1069eb97
block_name_prefix: rbd_data.7664ac1069eb97
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 15:06:10 2021
access_timestamp: Tue Dec 21 15:06:10 2021
modify_timestamp: Tue Dec 21 15:06:10 2021
rbd image 'volume-f45e5cca-0a25-4f00-afab-ad9438c18415':
size 300 GiB in 76800 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 7667177732beee
block_name_prefix: rbd_data.7667177732beee
format: 2
features: layering
op_features:
flags:
create_timestamp: Tue Dec 21 16:55:48 2021
access_timestamp: Tue Dec 21 16:55:48 2021
modify_timestamp: Tue Dec 21 16:55:48 2021

admin 发表于 2021-12-28 14:15:32

涉及的nova模块也需要重启。
控制节点:
docer restartnova_api          nova_conductor    nova_consoleauthnova_novncproxy   nova_scheduler
计算节点:
docer restartnova_computenova_libvirtnova_ssh

admin 发表于 2021-12-28 14:18:31

docker restart nova_api nova_conductor nova_consoleauth nova_novncproxy nova_scheduler

admin 发表于 2021-12-28 15:15:34

docker restart cinder_volume cinder_backup cinder_api cinder_scheduler
页: [1]
查看完整版本: 关闭新创建卷的exclusive-lock功能 ceph 创建的镜像保留layering