Difference between revisions of "Test Lab DAQ test stands"

Revision as of 09:09, 1 November 2024

Set up the Server

• Name: hatestlab1.jlab.org (procured on 2024 April, RHEL9)
• Shared account: hatdaq
• Roles:

1. The TFTP server for SBCs
2. The NFS server for computers under same LAN

• Set up pxeboot for SBUs

1. Follow instructions on: [coda website]
   • Configuration file is: /diskless/centos7_dist/walkthrough_hatestlab1.cfg
   • tftp boot path "/tftpboot" is defined in /usr/lib/systemd/system/tftp.service
   • "pxelinux.0" is installed in /tftpboot/pxelinux.0 by "syslinux-tftpboot"
   • "TFTP_PATH=/tftpboot/linux-install" is a historical reason that at the CST DHCP configuration, it's looking for "linux-install/pxelinux.0".
   • nfs version 3 is required in the pxelinux.cfg/default for the root file system (without this flag, two CPUs can't be on same time, would give "input/output error")
2. Request CC to change the tftp server for the SBUs from "atedf3" to "hatestlab1"
3. The rest steps are similar to Set_up_PXE_boot_VM

• Home directory for the SBUs
  • The home directories for the SBUs are at:

hatdaq@hatestlab1:/home/diskless/

1. If "/home" is defined in "/diskless/CentOS7/x86_64/root/etc/statestab", the SBUs will use the home directory defined in its snapshot folder.
2. An example account "hatdaq" is created at hatdaq@hatestlab1:/home/diskless/hatdaq
   • Need to add "hatdaq" to the SBUs's /etc/passwd file
   • Need to create .ssh directory for ssh-key login
   • Need to create .bashrc, .bash_profile
3. Set up a local shared account "hatmol" for MOLLER SBUs, and it is created at hatdaq@hatestlab1:/home/diskless/hatmol
   • Need to add "hatmol" to the SBUs's /etc/passwd and /etc/group
   • Need to use "passwd" at the SBU to set up the password for "hatmol", so it's added to "/et/shadow"
   • The rest is similar to "hatdaq" setup

• Structure of the "hatestlab1" pxeboot:

1. Boot images are located at : /tftpboot/linux-install
2. Boot file systems are located at: /diskless/CentOS7
3. SBU home directory are located at: /home/diskless
   • This is mounted under "home.hatestlab1" at the SBUs, and the SBU home directory is a soft link which is defined under /diskless/CentOS7/x86_64/snapshot/apol1/home
4. Notes:
   • DiagGuiServer is not included in the x86_64 diskless distribution. I copied it over from atedf3:/diskless/x86_64/root/usr/local/src/DiagGuiServer, and added to the systemd

CODA Installation

• Copy coda/3.10_devel from /site/coda/3.10_devel.
• Download coda 3.10_arm from coda website
• Download coda_scripts from GitHub

Set up the VXS crate

Set up the CPU

1. The CPU should be plugged into the slot 01
2. Connect the ethernet cable, and a display cable (such as: VGA) to the CPU and power on the crate
3. Use a monitor to obtain the MAC address
4. Open a ticket at CC: give them the MAC address, a desired hostname, and ask them to set up the pxeboot using "hatestlab1" as the TFTP server
5. Create the pxelinux configuration under /tftpboot/pxelinux.cfg/: (most time this step is not needed; using the default should be good)
   1. Get the host ip: gethostip <hostname>
   2. Make a copy of an existing configuration to the new host ip, for example:
   • gethostip apol1 gives: 81392580
   • cp hcvme06 81392580
   • ln -s apol1 81392580
6. Create a folder under snapshot/, such as root@hatestlab1:/diskless/CentOS7/x86_64/snapshot/<hostname>
7. Set up home directory for the CPU
   1. cd /diskless/CentOS7/x86_64/snapshot/<hostname>
   2. ln -s /home.hatestlab1/<shared account> .
8. Set up the NFS mount: modify root@hatestlab1:/etc/exports/ to export "*/root/" and "*/snapshot/" to <hostname>, and other necessary folders
9. exportfs -a: to export the nfs mount
10. Power cycle the crate

Set up the VTP

1. The VTP should be plugged into the slot 11
2. The VTP from Ben usually has boot env.bin loaded. We need to change the environment variables accordingly. Use "apolvtp1" as an example:
   1. Connect the serial cable to a computer, and run "screen /dev/ttyUSB0 115200" (if it's Linux)
   2. Power on the crate, then you will see the VTP output at the screen session
   3. At the screen session, run "printenv" to display all the environment variables
   4. Use "setenv" and "saveenv" to adjust the environment variables accordingly
   5. Open a ticket at CC to request an IP and hostname for the given VTP MAC address. It should be under the same LAN as "atedf3", and set the VTP to be booted from "atedf3"
   6. Create a folder under snapshot/, such as root@atedf3:/data/disk2/diskless/arm7/snapshot/apolvtp1
   7. Set up the NFS mount: modify root@atedf3:/etc/exports/ to export "*/root/" and "*/snapshot/" to "apolvtp1"
   8. Restart the nfs service: /etc/init.d/nfs restart ("atedf3" is RHEL6, latest RHEL* would have a different command to restart NFS service)
   9. Power cycle the crate.
3. Set up home directory (using havtp1 home directory temporarily)
   1. cd /data/disk2/home/sbs-onl
   2. cp -r havtp1 apolvtp1
   3. cd /data/disk2/diskless/CentOS7/armv7/snapshot/apolvtp1/home
   4. ln -s data/disk2/home/sbs-on/apolvtp1 sbs-onl
   5. modify /etc/exports
   6. reboot the module