CEPH Paketleri Kurlum Öncesi Yapılması Gerekenler

Donanımların Kontrolü

Donanım Marka/Model Kontrolü

İhale kapsamında aldığımız donanımların kontrolü için aşağıdaki betik kullanıldı, bu sayede disk,bellek ve diğer bilşenlerin istenilen özelliklere sahip olup olmadıkları kontrol edildi

root@zula201:~/ulakceph# more sysinfo.sh 
#!/bin/bash
INFOFILE="sysinfo.txt"
export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
echo "---------------------------------------------------------------------------------------------\n" >> $INFOFILE
RAM=`free | grep Mem | awk '{print $2}'`
echo "RAM: ${RAM}"  > $INFOFILE
lshw -class memory | egrep 'vendor:|product:|size:|clock: ' | grep -v "NO DIMM" | egrep -v 'MiB|KiB' >> $INFOFILE
echo "---------------------------------------------------------------------------------------------\n" >> $INFOFILE
num_CPU=`cat /proc/cpuinfo | grep -i "model name" | awk -F: '{print $2}' | wc -l`
echo "CPU Count: ${num_CPU}" >> $INFOFILE
cat /proc/cpuinfo | grep -i "model name" | awk -F: '{print $2}' >> $INFOFILE
num_CPU=`cat /proc/cpuinfo | grep -i "model name" | awk -F: '{print $2}' | wc -l`
echo "---------------------------------------------------------------------------------------------\n" >> $INFOFILE
lsblk -a  >> $INFOFILE
for i in sdb sdc sdd sde sdf sdg sdh sdi sdj sdk sdl sdm
   do
   echo "Disk ${i}" >> $INFOFILE
   smartctl -a /dev/${i}  | egrep 'Product|Revision:|Manufactured in|Accumulated start-stop cycles' >> $INFOFILE
   echo >> $INFOFILE
done

Disk Hata Kontrolü

badblocks programı kullanılarak sabit disklerde kurulum öncesi bad block olup olmadığının kontrolü yapıldı. İlgiki Betik.

root@zula201:~/ulakceph# more systest.sh 
#!/bin/bash
for disk in `lsblk | grep -i 7.3 | awk  '{print $1}'` 
    do badblocks -b4096 -w  -o ${disk}.badblock.txt /dev/${disk} &
done

Driver ve Firmware Güncellemleri

10G Intel Ethernet Kartı Driver Güncellemesi

Linux çekirdeği ile gelen driver yerine Intel web sayfasından 10G ethernet kartının güncel driver'larının indirilerek kurulması daha az sorun ve daha yüksek performans almanızı sağlayacaktır.

root@zula201:~/calisma/ixgbe-5.3.6/src# modinfo ixgbe          
filename:       /lib/modules/4.4.0-124-generic/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko
version:        4.2.1-k


apt-get -y install gcc make

root@zula201:~/calisma/ixgbe-5.3.6/src# make
root@zula201:~/calisma/ixgbe-5.3.6/src# make install
root@zula201:~/calisma/ixgbe-5.3.6/src# modinfo ixgbe
filename:       /lib/modules/4.4.0-124-generic/updates/drivers/net/ethernet/intel/ixgbe/ixgbe.ko
version:        5.3.6

40G Mellanox Connectx 4 Driver ve Firmware güncellemesi

root@zula202:~# lsmod | grep -i mlx5_core
 mlx5_core             208896  0
root@zula202:~# modinfo mlx5_core
 filename:       /lib/modules/4.4.0-124-generic/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko
 version:        3.0-1
 license:        Dual BSD/GPL
 description:    Mellanox Connect-IB, ConnectX-4 core driver
 author:         Eli Cohen <eli@mellanox.com>
 srcversion:     B033A1086EAE3BE4103F5B2

root@zula201:~/calisma/mlnx-en-4.3-1.0.1.0-ubuntu16.04-x86_64# ./install 
Logs dir: /tmp/mlnx-en.9519.logs
General log file: /tmp/mlnx-en.9519.logs/general.log

Below is the list of mlnx-en packages that you have chosen
(some may have been added by the installer due to package dependencies):
ofed-scripts
mlnx-en-utils
mlnx-en-dkms
mstflint
This program will install the mlnx-en package on your machine.
Note that all other Mellanox, OEM, OFED, RDMA or Distribution IB packages will be removed.
Those packages are removed due to conflicts with mlnx-en, do not reinstall them.
Do you want to continue?[y/N]:y
Attempting to perform Firmware update...
Querying Mellanox devices firmware ...

Device #1:
----------
 Device Type:      ConnectX4
 Part Number:      MCX414A-BCA_Ax
 Description:      ConnectX-4 EN network interface card; 40GbE dual-port QSFP28; PCIe3.0 x8; ROHS R6
 PSID:             MT_2130110027
 PCI Device Name:  83:00.0
 Base GUID:        ec0d9a0300d9ca62
 Base MAC:         ec0d9ad9ca62
 Versions:         Current        Available     
    FW             12.18.1000     12.22.1002    
    PXE            3.5.0109       3.5.0403      
    UEFI           N/A            14.15.0019    

 Status:           Update required

root@zula201:~/calisma/mlnx-en-4.3-1.0.1.0-ubuntu16.04-x86_64# /etc/init.d/mlnx-en.d restart
modinfo mlx5_core

root@zula201:~/calisma/mlnx-en-4.3-1.0.1.0-ubuntu16.04-x86_64# modinfo mlx5_core
filename:       /lib/modules/4.4.0-124-generic/updates/dkms/mlx5_core.ko
version:        4.3-1.0.1
license:        Dual BSD/GPL