wiki:UfoClusterStorage

Version 2 (modified by Suren A. Chilingaryan, 12 years ago) (diff)

--

Fast Storage Server

  • Forwards fast raw devices using iSER protocol
  • Read-ahead of the raid should be adjusted for the optimum performance
    blockdev --setra 65536 /dev/sd#
    
  • Package tgt
    • No iSER support in OpenSuSE RPMS
    • Recompile adding ISCSI_RDMA=1 parameter to make command
  • /etc/tgt/targets.conf
    default-driver iser
    <target iqn.ipepdvcompute1.fast>
        <direct-store /dev/disk/by-partlabel/fast>
            bs-type aio
            MaxRecvDataSegmentLength 2097152
            MaxXmitDataSegmentLength 2097152
            FirstBurstLength 8388608
            MaxBurstLength 8388608
            block-size 512
            write-cache off
        </direct-strore>
    </target>
    

Camera Computer

  • openiscsi package, iscsid should be started on boot
  • Server node configuration
    iscsi_discovery 192.168.11.1 -t iser -f
    iscsi_discovery 192.168.11.3 -t iser -f
    
  • It will populate 2 extra /dev/sd? nodes
  • Create softraid 0 for optimal performance
    mdadm --create /dev/md3 -n 2 -l 0 /dev/disk/by-path/pci-0000\:06\:00.0-ip-192.168.11.1\:3260-iscsi-iqn.ipepdvcompute1.fast-lun-1 /dev/disk/by-path/pci-0000\:06\:00.0-ip-192.168.11.3\:3260-iscsi-iqn.ipekatrinadei.fast-lun-1
    
  • Format it with XFS
    mkfs -t xfs /dev/md3
    
  • fstab entry
    /dev/md3 /mnt/server xfs noauto,noatime,allocsize=1GiB,largeio,swalloc,delaylog,nobarrier 0 0