Installing OS from the scratch

  • Download the most recent version of CentOS, copy the downloaded ISO image onto a USB disk, make the USB disk bootable (ask Ohad for details).
  • Connect the USB disk to the machine and reboot the machine.
  • Enter into the BIOS menu and configure the booting order to have the machine booted from USB drive.
  • At the prompt, press enter and enter “linux text” (google it if you wonder why) and press enter again to load the graphic installation interface.
  • Partition the disks. Partition /sda (or /hda, or whatever comes first) into /boot (~2,000Mb), /tmp (~4,000Mb), /swap (~twice the capacity of the machine's memory), / (~100,000Mb). Leave the rest of /sda to be /scr1. Partition the rest disks into /scr2, /scr3, etc., you can also use software RAID0 to assemble multiple disks to get a bigger scratch space.
  • Install the GRUB to MBR
  • Set the root password (ask the System Administrator for the password).
  • Install necessary packages (minimum installation is preferred).
  • Reboot the machine after the installation is finished.

Configuring the system after installation

  • Open a terminal, go to /etc/hosts on vostok, add new machine name and its IP address exist there.
  • Issue command 'service network restart' to bring up the network.
  • On the new machine, go to /etc/sysconfig/network-scripts, edit the network card configuration file: ifcfg-eth* (* is a number starting from 0) to include correct IP address and other network information. Check with the System Administrator if you do not know how to do it.
  • Still on vostok, type “cd /var/yp; make”
  • On new machine, login as root, in /etc/yp.conf, add “domain sep server ”
  • In /etc/sysconfig/network add 'NISDOMAIN=sep'
  • In /etc/nsswitch.conf, change things to “ passwd: nis files
  • group : nis files
  • hosts : nis files”
  • in /etc/passwd
  • /etc/group
  • /etc/hosts
  • add “+::::::” to the end of each file
  • start yp service by typing “/etc/init.d/ypbind start”
  • make symbolic link of yp service for booting by typing “ln -s /etc/init.d/ypbind /etc/rc5.d/S27ypbind”
  • after this, logout the new machine, and you should be able to login the new machine with your existing SEP usrname and password
  • on the new machine, create/make symbolic link /homes —> /net/server/homes
  • /opt —> /net/server/opt_local
  • /wrk —> /net/server/wrk
  • /usr/local/share —> /net/server/usr/local/share
  • Install fuse fuselib from ~ohad/sysadm/RPM
  • Install glusterfs packages (*client* and *common*) from ~ohad/sysadm/RPM
  • rcp/scp glusterfs from tesla1 or any existing machine to /etc/glusterfs on new machine
  • “mkdir /data” and “mkdir /scratch” on the new machine
  • edit /etc/fstab to define mount point for /data /scratch, these can be copied from tesla1 or any other exsiting work horse
  • Congrats! You are all set! Have a cup of tea and wait for your colleagues to mess up with this machine LOL

Nvidia GPU driver/software installation

  • make sure GPUs are connected to CPU machine and are powered on.
  • As root user, edit /etc/iniitab, change default init level to 3 (should be 5)
  • Reboot system, install GPU driver for the corresponding GPUs
  • edit /etc/iniitab, change default init level back to 5
  • Reboot system, install cuda toolkit
  • Reboot system, run “nvidia-smi -a” to boot up all the gpus, this needs to be run from root usr everytime the system is rebooted.

Monitor bricks

sep/internal/workhorse.txt · Last modified: 2015/05/27 02:06 (external edit)
CC Attribution-Share Alike 4.0 International
Driven by DokuWiki Recent changes RSS feed Valid CSS Valid XHTML 1.0