Changes between Version 14 and Version 15 of UfoServer


Ignore:
Timestamp:
Feb 21, 2012, 1:23:46 PM (13 years ago)
Author:
Tomy Rolo
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • UfoServer

    v14 v15  
    1 = UFO Server =
    2 
     1= UFO Server =
    32[[TOC]]
     3
    44== System ==
    55 * Host name: ufosrv1.ka.fzk.de
    66 * Interfaces: eth0 (10 GBit), eth1 (upper-right socket)
    7   * eth0: dhcp
    8   * eth1: 141.52.111.135/22
    9   * Gateway: 141.52.111.208 (via dhcp)
    10   * Name server: 141.52.111.248 (via dhcp)
     7   * eth0: dhcp
     8   * eth1: 141.52.111.135/22
     9   * Gateway: 141.52.111.208 (via dhcp)
     10   * Name server: 141.52.111.248 (via dhcp)
    1111 * Running services
    12   * SSH on ports 22 and 24
    13   * NX server over SSH
    14   * VirtualGL (OpenGL forwarding)
     12   * SSH on ports 22 and 24
     13   * NX server over SSH
     14   * VirtualGL (OpenGL forwarding)
    1515
    1616== Hardware ==
    … …  
    1919 * System drives: 2 x Hitachi 2TB SATA2
    2020 * Areca ARC-1880 Raid Controller (x16 slot)
    21   * 16 x 2 TB  Hitachi HUA722020ALA330 in external Areca Enclosure
    22   * 4 x 256 Crucial RealSSD C300
     21   * 16 x 2 TB  Hitachi HUA722020ALA330 in external Areca Enclosure
     22   * 4 x 256 Crucial RealSSD C300
    2323 * External PCIe 2.0 x16 (x16 slot)
    24   * External GPU box from One Stop Systems
    25   * 4 x NVIDIA GeForce GTX580
     24   * External GPU box from One Stop Systems
     25   * 4 x NVIDIA GeForce GTX580
    2626 * 2 x NVIDIA GeForce GTX580 (x16 slots)
    2727 * Intel 82598EB 10GBit Ethernet (x4 slot)
    … …  
    3636 * 4 x Crucial SSD C300 in the server case are organized as Raid-0
    3737
    38 == Partitioning ==
    39  * Two system hard-drives are connected to internal SATA controller and mirrored as Raid-1 using Linux Software Raid.
    40   * Devices: /dev/sda, /dev/sdb
    41   * Partitions: /boot (2GB ext2), / (256GB ext4), /home (ext4)
    42  * The RAID is split into the 2 partitions (GPT partition table): the fast and normal.
    43   * Device: /dev/sdc
    44   * The fast partition will be used to stream the data from the camera and should be able to stand throughput of 850 MB/s. The data should be moved out as soon as possible. Only a single application is allowed to write to the disk.
    45    * Size: first 6TB of disk array
    46    * File system: non-journaled ext4
    47    * Mount point: /mnt/fast
    48   * Standard partition is for short term data storage (before offloading to LSDF)
    49    * Size: 22 TB
     38== Partitioning ==
     39 * Two system hard-drives are connected to internal SATA controller and mirrored as Raid-1 using Linux Software Raid.
     40   * Devices: /dev/sda, /dev/sdb
     41   * Partitions: /boot (2GB ext2), / (256GB ext4), /home (ext4)
     42 * The RAID is split into the 2 partitions (GPT partition table): the fast and normal.
     43   * Device: /dev/sdc
     44   * The fast partition will be used to stream the data from the camera and should be able to stand throughput of 850 MB/s. The data should be moved out as soon as possible. Only a single application is allowed to write to the disk.
     45     * Size: first 6TB of disk array
     46     * File system: non-journaled ext4
     47     * Mount point: /mnt/fast
     48   * Standard partition is for short term data storage (before offloading to LSDF)
     49     * Size: 22 TB
     50     * File system: ext4
     51     * Mount point: /mnt/raid
     52 * The SSD cache
     53   * Device: /dev/sdd
     54   * Size: 1 TB
    5055   * File system: ext4
    51    * Mount point: /mnt/raid
    52  * The SSD cache
    53   * Device: /dev/sdd
    54   * Size: 1 TB
    55   * File system: ext4
    56   * Mount point: /mnt/ssd
     56   * Mount point: /mnt/ssd
    5757 * Partition table (/dev/sda & /dev/sdc)
    5858{{{
    … …  
    130130}}}
    131131
    132 
    133132== Software ==
    134 
    135133=== Base System ===
    136 
    137134 * openSUSE 12.1
    138135 * Desktop: Gnome
    … …  
    140137
    141138=== Additional Packages ===
    142 
    143139{{{
    144140zypper install bzr cmake
    … …  
    149145zypper install gtk-doc python-Sphinx
    150146zypper install libtiff-devel
    151 }}}
    152 
     147zypper install nano
     148}}}
    153149=== Camera Drivers ===
    154150 * Get Silicon Software driver and SDK
    155   * Download from [http://www.silicon-software.de/en/download.html here]
    156   * Driver version 3.9.14/4.0.3 is tested. Get it [http://www.silicon-software.de/download/systemsoftware/Linux/menable_linuxdrv_src_3.9.14_4.0.3.tar.bz2 here]
    157   * SDK version 5.1.2 is tested. Get it [http://www.silicon-software.de/download/systemsoftware/Linux/siso-rt5-5.1.2-1.x86_64.rpm 1] [http://www.silicon-software.de/download/systemsoftware/Linux/siso-rt5-devel-5.1.2-1.x86_64.rpm 2] [http://www.silicon-software.de/download/systemsoftware/Linux/siso-rt5-gui-5.1.2-1.i586.rpm 3]
     151   * Download from [http://www.silicon-software.de/en/download.html here]
     152   * Driver version 3.9.14/4.0.3 is tested. Get it [http://www.silicon-software.de/download/systemsoftware/Linux/menable_linuxdrv_src_3.9.14_4.0.3.tar.bz2 here]
     153   * SDK version 5.1.2 is tested. Get it [http://www.silicon-software.de/download/systemsoftware/Linux/siso-rt5-5.1.2-1.x86_64.rpm 1] [http://www.silicon-software.de/download/systemsoftware/Linux/siso-rt5-devel-5.1.2-1.x86_64.rpm 2] [http://www.silicon-software.de/download/systemsoftware/Linux/siso-rt5-gui-5.1.2-1.i586.rpm 3]
    158154 * Install menable driver for Silicon Software micronEnable CameraLink frame-grabber
    159   * Extract source
    160   * For post 3.2 kernels, you may need to apply a patch [attachment:menable-ds.patch]
    161   * Compile with default compiler (the system will crash if you use different version of compiler to build kernel and modules). Please, be careful here, if you have already installed CUDA and set default compiler to gcc-4.3, you need temporarily to revert to gcc-4.6 to build the kernel module!
    162   * Install and load the module
     155   * Extract source
     156   * For post 3.2 kernels, you may need to apply a patch [attachment:menable-ds.patch]
     157   * Compile with default compiler (the system will crash if you use different version of compiler to build kernel and modules). Please, be careful here, if you have already installed CUDA and set default compiler to gcc-4.3, you need temporarily to revert to gcc-4.6 to build the kernel module!
     158   * Install and load the module
    163159{{{
    164160tar xjf menable_linuxdrv_src_3.9.14_4.0.3.tar.bz2
    … …  
    170166modprobe menable
    171167}}}
    172   * Install SDK RPMs
     168   * Install SDK RPMs
    173169{{{
    174170rpm -i siso-rt5*.rpm
    … …  
    176172
    177173=== FreeNX ===
    178 
    179174Install FreeNX server to allow remote desktop
     175
    180176{{{
    181177zypper ar http://download.opensuse.org/repositories/X11:/RemoteDesktop/openSUSE_12.1/X11:RemoteDesktop.repo
    … …  
    183179nxsetup
    184180}}}
    185 
    186181=== VirtualGL ===
    187 
    188182Install VirtualGL to provide OpenGL forwarding (HOW?)
    189183
    190184=== CUDA ===
    191185 * Downgrade to gcc 4.3 (gcc-4.6 is not compatible with the latest CUDA toolkit)
    192 {{{ 
     186{{{
    193187zypper ar http://download.opensuse.org/repositories/devel:/gcc/openSUSE_12.1/devel:gcc.repo
    194188zypper install gcc43 gcc43-c++ gcc43-locale
    … …  
    196190}}}
    197191 * Currently installed
    198   * Driver: 285.05.32
    199   * Toolkit: 4.1 (installed into /opt/cuda)
    200   * SDK: 4.1 (installed into /opt/cuda/sdk)
    201   * SDK must be compiled
     192   * Driver: 285.05.32
     193   * Toolkit: 4.1 (installed into /opt/cuda)
     194   * SDK: 4.1 (installed into /opt/cuda/sdk)
     195   * SDK must be compiled
    202196{{{
    203197cd /opt/cuda/sdk
    … …  
    214208
    215209=== PyHST ===
    216 
    217210 * Currently installed in `/opt/pyhst`
    218211 * To build from [source:pyhst/pyhst]