CEPH Performans Optimizasyonu

TCMalloc Değerinin Değiştirilmesi

ceph.conf

Increasing the TCMalloc thread cache to 128M can improve performance 4-5x. It would be great to have a way of setting the TCMalloc thread cache to 128M, instead of the default 32M. 

TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES=134217728
ceph-deploy --overwrite-conf admin zula209 zula210 zula211 zula212 
ceph tell osd.* heap stats
ceph tell osd.* heap release

OSD lern CPU core map Edilmesi

root@zula201:~# numactl --hardware available: 2 nodes (0-1) node 0 cpus: 0 1 2 3 4 5 6 7 8 9 20 21 22 23 24 25 26 27 28 29 node 0 size: 64320 MB node 0 free: 63198 MB node 1 cpus: 10 11 12 13 14 15 16 17 18 19 30 31 32 33 34 35 36 37 38 39 node 1 size: 64508 MB node 1 free: 62399 MB node distances: node 0 1

 0:  10  21 
 1:  21  10 

Ref: Designing for High Performance Ceph at Scale https://www.youtube.com/watch?v=P6SCdZXpM2Q https://access.redhat.com/documentation/en-us/red_hat_ceph_storage/3/pdf/configuration_guide/Red_Hat_Ceph_Storage-3-Configuration_Guide-en-US.pdf https://access.redhat.com/documentation/en-us/red_hat_ceph_storage/3/pdf/installation_guide_for_red_hat_enterprise_linux/Red_Hat_Ceph_Storage-3-Installation_Guide_for_Red_Hat_Enterprise_Linux-en-US.pdf