Complete How-To
Contents
- 1 How-Tos
- 2 Shift workers
- 3 ioc_portserver_reboot_locations
- 4 Beam Recovery Procedure
- 5 Data Acquisition
- 6 Data analysis
- 7 Spectrometer detectors (Needs to be updated for current run)
- 8 Beam Line
- 9 Slow control
How-Tos
This page is being copied over from the Tritium shift how-to (many thanks to the Tritium Students!), and is being updated for the APEX.
A shift portal page is available with summarized instructions for shift takers.
This page contains a listing of all procedures, including information that may be relevant only in specific cases.
Shift workers
How to manage your BTA (for Shift Leader)
Open your browser on an a-onl@aonl machine
[1] https://bta/
[2] Login with your jlab username/pass word
[3] File->Open Timesheet
[4] choose: Hall:A -> Day-> Shift: Owl(or Day/Swing)
[5] click "Open"
[6] You see the address bar:
(Note that NO time specifically required! e.g.:https://bta/experimenter/a/2014-12-16/owl/end=2014_12_16_08_00;start2014_12_16_00_00) -> this will give you error when you save info for MCC
Instead, do the following
https://bta/experimenter/a/2014-12-16/owl/
[7] If you want to edit hour(s), Please click very right "pencil" icon, then make a comment or edit time
DO NOT USE *EDIT ALL* ON THE BOTTOM
[8] To save your edited info into DATABASE, just click "V" (check-mark) in same place of "pencil" icon
[9] When MCC call you for BTA (An hour before your shift end), click "SAVE INFO for MCC"
[10] Read number ABU and BANU. (That's it ! This should work !)
[11] End of shift, please sign off
[12] Once you've done, please Logout.
STEP #1 | STEP #2 |
How to make logbook entry
- Open a terminal
- Type "halog"
- You should see halog app pops up.
How to set Big monitor screens (Above CH01A04 and CH01A06 rack)
- Open a terminal on adaq machine
- Type "go_wall". This will open a vnc window.
How to open HallA General Tool GUI
- Open a terminal
- Type "NewTools". It will open OPS Menu.
- Click OPS Menu and go to: EDM (HLA) -> JMenu (HLA)
- From JMenu (HLA), Hall A -> Tools Display
How to Open Target FSD Masking GUI
- JMenu -> Operation -> FSD -> FSD Overview -> Click "Target Masking Screen"
ioc_portserver_reboot_locations
Beam Recovery Procedure
NEED TO DEVELOP PROCEDURE FOR APEX TARGET
Update: November 13, 2017.
- Carbon Hole target, 2x2 raster (Hall A units)
- Nominal beam offset is on the whiteboard
- 5 uA
- Check spotL and spotR that hole is centered in raster square
- Carbon Hole target, no raster
- Write down T1 scaler rates
- Raster target, 2x2 raster (Hall A units)
- Check that T1 rates are ~same as with carbon hole and no raster
Data Acquisition
Basic Data Acquisition with CODA (updated Feb 6, 2019)
- DAQ Configurations.
- APEX : will have all HRS without SciFi FADC, that will be the default production configuration
- RHRSTwoArm reads all the detectors - should be used for general cosmics
- TwoArmNoBuf : same as previous without buffering
- SciFi : is similar to RHRSTwoArm, it reads out all the detectors but points to a different readout list for the FADC ROCs so that Sci Fi parameters can be adjusted without affecting the RHRSTwoArm config
Note, we only have one DAQ, and the Trigger Supervisor is on the R-HR
- How to run the DAQ
- Here we assume runcontrol is already up. If not, go to Starting CODA From Scratch below.
- The default configuration is "APEX", if it is not loaded you can choose it from the menu "configurations->Cool", select "APEX"
- Click "Platform->connect"
- Click on "Download" button
- Click on "Start (>>)" button, and acknowledge the "start-of-run" pop-up window
- To end a run click on "End" button
- How to kill coda processes
- At the terminal of adaq2 type "kcoda".
Some common issues with the DAQ
Triggers, Scalers, and Dead Time
Trigger definitions for APEX Let S0A and S0B be the 2 pmts of S0, a vertical scint. and S2L and S2R are left and right PMTs of an S2 paddle and S0=S0A&S0B = the "and" of 2 pmts and S2=S2L&S2R = the "or" of [left&right] pmts then T1 = LHRS S0&S2 with S2R timing T2 = LHRS S2 with S2R timing T3 = RHRS S2R (right PMTs only) T4 = RHRS S0&S2R with S2R timing T5 = RHRS S2R&GC with S2R timing T6 = Coincidence = T2&T5 with T5 timing for trues T7 = SciFi cosmics (one trigger for both arms) T8 = LHRS Clock (103.7 kHz) T9-T12 empty
There is only one DAQ. The Trigger Supervisor is on the R-HRS.
How to set prescale factors
On adaq account on adaq1 or adaq2, type "prescaleR" and enter the numbers and remember to "Save"
How to access the Remote Scopes
Starting xscaler (HRS) and checking raw trigger rates
Raw rates of trigger and detector channels can be accessed using a GUI. Below are the instructions for opening "xscaler" GUI
- These screens are generally already open on the agen5 machine (above the DAQ machine)
- If it is xscaler is not open then follow these instructions:
- login as a-onl on adaq1 or adaq2 machines (eg: "ssh a-onl@adaq1" )
- passwords are written in the counting house
- type "goxscaler" and follow the instructions printed on the screen
- type "./xscaler Left" or "./xscaler Right" to access xscaler display
How to check the dead time
datamon should work, type "datamon" on adaq account on adaq2. There should be scripts to analyze the data, too. For your convenience, I keep the instructions for tritium here, but someone should take care of it for APEX.
last update 12/2/14
After you replay the run, ssh to aonl1, aonl2, aonl3 or aonl4 machine and:
> gotritium > cd scipts/ > analyzer >.X deadtimeL(R).C
Cold Start Checklist (when beam has been off for several hours)
NEED TO UPDATE FOR APEX
- Confirm target is “empty target”
- Call for pulsed beam for tuning
- Tune beam to beam dump (straight through, no Compton chicane)
- Call for 10μA beam
- establish beam position
- check beam charge monitors
- check beam position monitors
- Confirm HRSs set to correct value
- Move target to THIN Carbon position for detector check out
- For detector checkout: current = 0.5μA
- Check out detectors at different currents
- In standard production configuration, check that the raster is off.
- Resume runplan
Starting CODA From Scratch
Start the vncviewer. This is not fundamentally important, though. You could just start CODA on adaq2.
vncviewer -shared adaq2:1
Why ? Because if the DAQ is started in VNC it is easy to trouble shoot and share.
- If CODA is not already running.
- The DAQ runs on the adaq account on adaq2
- Type startcoda
- You might need to reboot the ROCs or power cycle them (see next sections)
- Download the APEX configuration (normally used for production) or another configuration
- Start a run (see instructions above).
'You do not need to do this routinely - only if you are starting from a fresh login or after a computer crash or power outage Log in the epics computer( check with Run Coordinator in case you don't know the password ) Open NewTools from the terminal then:-> EDM(HLA)-> Hall A -> Tool Display
Power cycling Fastbus crates
Right HRS only : In the Tools Display -> Crate Resets -> Lower Fastbus AC
This will power cycle all 3 ROCs of the fastbus
Same for Left HRS but it will get stuck off. To get the Fastbus back on login into hareboot2 from an accelerator account or hlal00 and power cycle iocha4 which is on port 1
Reboot ROCs
If a ROC fails to configure or download, see if the ROC window is still visible.
--For VXWORKS ROCs
- LHRS : ROC3, ROC4, ROC5, TS11
- RHRS : ROC1, ROC2, ROC6, TS0
- click in the terminal
- press enter to get a prompt ("->")
- type "reboot", hit enter, and wait
- the ROC will reboot and reconnect to CODA
If the ROC window cannot be seen, do the following:
--if the ROC is either ROC31 or ROC20
- ROC31 is on LHRS : In a terminal on adaq@adaq1, type 'kcoda'
- ROC20 is on RHRS : In a terminal on adaq@adaq2, type 'kcoda'
Arm | ROC | Port Server | Port |
---|---|---|---|
RHRS | ROC20 | hatsv3 | 7 |
- Telnet to the port connected to the ROC you need to service (e.g. telnet hatsv21 2002). ROC31 is on hatsv4 port 4 (2004), ROC20 is on hatsv3 port 7 (2007)
- Type 'q'
- Type 'CAEN'. (Nothing will display on screen at you type.)
- A menu with options to control the Crate will appear. Type 'C' to view the status of the crate.
- If the crate is off, type the letter 'o' to turn it on.
- (If the crate is ON but is stuck and needs rebooted : type "o" to turn crate OFF. After 20 seconds, type "o" to turn it back ON)
- Type the letter 'q' twice to leave the crate control.
- Type 'ctrl+]' to exit the ROC.
- Type 'q' at the "telnet>" prompt.
- Start CODA
To reboot ROC31 follow instrunction at the end of the page
For full details about the Hall A DAQ (including reboot procedures) see This or This
If you have trouble downloading to ROC31
- Follow this link for [1]
Start CODA
Open a terminal and type startcoda. Make sure you are in the right aqd1(adaq2) system for the left(right) arm.
The runcontrol window will appear: File:Startcoda.png
Hit the "Connect" button, then "Configure" (choose a configuration e.g. LeftHrs), and "Start Run", or, to troubleshoot, "Download", "Prestart", and "Go".
How to Take a Pedestal Run
HRS pedestals
If you've been running the normal spectrometer DAQ configuration, you'll need to press "Abort", then "RunTypes" and select the PEDRUN configuration. Download, StartRun. Run for about 5000 events, then EndRun. You may check the pedestal files in ~/ped (pedN.dat corresponding to ROC #N). See README there for more details. After pedestal run, change back to the running configuration.
NOTE: DONT try to use PEDRUN for anything other than pedestal determination -- its confusing since the prescale factors are in a different file, etc. If you want a run with pedestal suppression turned off, see the README.
How to check disk space for writing (updated 11/05)
As adaq@adaq1, type "df -k /adaq1/data1/"
Data analysis
How to replay the data
First replay 50k events.
Login to aonl1, aonl2, aonl3, or aonl4 as user a-onl (ssh -Y a-onl@aonl#, where # is 1,2,3, or 4) - (password on the white board) and run
$ goapex $ ./myAnalysis <Run number>
This will replay data and bring up the online GUIs, and post the plots to the logbook.
To replay only one arm:
$ ./myAnalysis <Run Number> -s L (for left arm) $ ./myAnalysis <Run Number> -s R (for right arm)
You can also do:
$ ./onlineReplay $ Type run number
The rootfile is copied under /chafs1/work1/apex/Rootfiles/. To look at the data you might want to use the online GUI (see the instructions below).
OnlineGUI
Once the run has been replayed (see instructions above), login to aonl1, aonl2, aonl3, or aonl4 as user a-onl (ssh -Y a-onl@aonl#, where # is 1,2,3, or 4) - (password on the white board) and do
$ goapex $ ./onlinePlots $ Type run number
Saving the pdfs version is not necessary, since a full set of plots is saved automatically with the onlineReplay script in: /chafs1/work1/apex/Run_pdfs/
Full replay
Auto replay script will run on aonl3. Be careful not to close terminals on that machine.
Starting the Port Server Windows
On adaql2 type : start_monitors
this will open 6 xterms with in the title on which portserver to log :
so for example to log on hatsv4 port 3 type :
telnet hatsv4 2003
Spectrometer detectors (Needs to be updated for current run)
Link to current magnet ramping procedures. [this]
How to change the momentum setting of HRS
APEX: Please go to the above link
March 2016: Read [this] to learn about the special LHRS setting.
From the HAC window, there is a P0 SET field for each spectrometer in which you can enter the desired momentum setting. To change to a lower momentum from a higher previous setting, you just need to enter the new momentum value. To raise the momentum setting, you need to cycle the quadrupole magnets first and then enter the desired momentum setting.
To cycle the quads, turn off their regulation (Hall A General Tools, click the button right of P0set), send the quad to the higher values listed below.
L-HRS Q1 to 900 A, Q2 1600 A, Q3 1600 A. R-HRS Q1 to 900 A, Q2 1400 A, Q3 1400 A.
With the quad at higher current, wait two minutes, set the p0 to the desired value, turn on Q2 and Q3 regulations. If you run into trouble with the dipole NMR lock, [this] might help you.
The nominal current values for the APEX septum and corrector magnets are set by calling MCC and asking them to do it.
How to reset the Bogie IOC
Sometimes the HRS bogie controllers get in a funny state and will not respond to the GUI. For example, you click on the buttons (PSM enable, DM enable, etc), but the state field doesn't change, even after a patient wait of 5--10 seconds.
The first thing you should try is to close the Bogie GUI window using the disconnect button, wait for 5 minutes and try again. Sometimes the system will correct itself. If it doesn't you may want to try rebooting the Bogie IOC.
Follow this link: Resetting the HRS Bogie IOC
How to reset the quadrupoles
The reset for Q2 is simply on the front of the power supply, there are red lights on when the power supply is tripped. At the bottom of the board that has the red light, there is a blue reset button. There may be more than one light on so there may be more than one blue button that needs to be pushed. Push blue buttons until all of the red lights are out. Once all of the lights are out, lower the large lever on the lower right side of the power supply and lift it back into position. this will reset the Q2 and Q3 power supplies locally. For Q1, it's simpler, there is a large sign in the back of the Q1 equipment rack on the power supply balcony that says the blue reset button is here. you press the button and the magnet resets.
How to reboot HRS magnet IOC
Go to the hall A main menu screen.
Click "IOCS". Note that the left HRS magnet IOC's (iocha14) are accessible at http://hareboot10 and the right HRS magnet IOC's(iocha16) are accessible at http://hareboot25 (Username and password for IOC reboot are available in the counting house). Close the "Hall A IOC Systems" window. To reboot:
- the left HRS magnet IOC's, go to http://hareboot10 and from the pull-up menu next to iocha14, select "immediate reboot".
- the right HRS magnet IOC's, go to http://hareboot25, click on control, select iocha16, from the pull-up menu select "immediate reboot".
After the IOC reboot, please make sure that the spectrometer-angle information is reentered into the Hall A General Tools GUI.
How to restart the HRS hall probe gaussmeters
This procedure is NEW as of September 28, 2010.
From HALOG 333032:
The Lakeshore gaussmeters for the magnet hall probes are no longer being controlled by the Slow Controls VME crates (iocha14 and iocha16). You will notice that the GUI for each gaussmeter is slightly different than the previous GUI. The functions are still the same. However, if a meter "hangs", a person must notify accelerator Software On Call to reset the interface; ask MCC to make the call. At present this is not something we can do from the Counting House.
DO NOT attempt to reboot iocha14 or iocha16 to correct any problem with a gaussmeter readout. The control is now done through a portserver with an Accelerator PC acting as a "soft"-IOC. We do not have direct access to this PC.
Beam Line
Is the beam energy locked?
[How to check status of 2A energy lock]
Is the raster on?
One way is to check the raster current on the scope. Another way is to connect to JTAB, go to the Hall A tab and type "raster" in the search box.
How to Check the Raster (spot++)
Use spot++ script.
The instructions are:
- login as a-onl on adaq1 (eg: "'ssh a-onl@adaq1").
- passwords are written on the counting house
- goapex
- From the terminal, type"spot++ runnumber"
- To set the maximum number of events manually, type "spot++ runnumber max_number_of events" (without the quotes, and where runnumber and max_number_of events should be integers)
- root should analyze and display the raster and bpm histograms
- At the end of the script, it will ask for writing halog entry and posting the plots. Type "y" for yes.
How to do harp scan
Go to the JTabs menu and select tab "Hall A", then "ARC Integral" and after that click tab "ARC Scanners". A window named "New ARC" will pop up. Six charts are in this window and below each chart there is a blue box with the current value of gain. To do harp scan we need to have CW beam above 5 muA and the gain should be at least 16, and beam position should be stable.
Since the beginning of 2016, MCC is in charge of the Harps. Just request the harps to be done by them and make sure they post their result in the log. On JTab, under the operation tabs, you can look at the most recent raw harp scan by selecting the Harps button and then harp history.
How to record info for the arc energy measurement
Ultrastab reading, ninth dipole field
How to insert sieve slit
- Go to the hall and follow this instruction: [How to insert sieve slit]
- This only takes a few minutes to do
Slow control
How to bring up HAC control window (Hall A Tools), Monticello and JTabs
We like to run this display on is hacsbc2. The monitor is located in the Hall A Counting House in rack CH01A02, just below the NMR dipole oscilloscopes. Click here to see the screen.
If the display is not here: log onto the a-onl or the adaq accounts:
- Hall A Tools: 'hlamain'
- JTabs: 'jtabs'
- Monticello" 'monticello'
JTabs is the newest version of the accelerator tools (it replaces monticello) and has some overlap witht he old EDM monticello and hlamain GUIs. It is most likely to be up to date and working, but maybe missing some items from the EDM tools. [Original halog with nice pictures
High Voltage controls
- The High Voltage control computer is the very left computer on the counting house table.
- When you find the computer, you will see a screen like this
- On the right bottom corner, you are able to use the mouse to choose the display window which you are looking for through 1/4 box.
- 1/4 is the LHRS window
- 2/4 is the RHRS window
- Each green dot shows corresponding channel status, green means that channel HV is on, blue means off.
- When you double click each green dot, it will show you corresponding channel information, and you also can read the corresponding voltage information from the high voltage control system (big canvas with numbers).
LHRS/RHRS : High Voltage controls
Login as "aslow" on the "adaqsc" computer. (since I have added voice alarm for LEFT, RIGHT HRS and Compton HV, please note that command is different !)
cd ~aslow/slowc
To run the Left HRS alone: ./hvs LEFT
To run the Right HRS alone: ./hvs RIGHT
To run the beamline (Compton) crate: ./hvs BEAMLINE
The following instructions can be used for running the GUI using the vnc server [How to open high voltage GUI]. This is not how we want to run routinely.
Troubleshoot
If you start HV-GUI but get error "initialization" In this case, >login: a-onl@aonl2 > ps -ef | grep -i hvs (make sure you are not Killing HRS HV ~!!) > kill -9 PROCESS# > cd ~/slowc/ > .hvs DVCS
HRS HV alarm
If you hear about Left/Right HV alarm (either Red flashing rectangular box on screen .OR. Voice), please look at either LeftHRS or RightHRS HV GUI which are running on "adev" on the "adaql1" or "adaql2"
- make sure "beepServer" is running on hapc3...If you are not sure run "/home/adaq/beep/start_beepserver"
Alarm Detail hapc3.jlab.org (which has HV GUI screen here !, username:adaq, passwd: same as adaq1)
/home/adaq/beep/ -> LeftHRS_HV_Alarm.wav
adev@adaq1.jlab.org (username:adaq, passwd: NOT same as adaq1: gev instead daq)
/adaqfs/home/adev/slowc/hvg.newAug2014/hvtools -. VoiceAlarm.java "ssh adaq@hapc3 /usr/bin/play /home/adaq/beep/call_alarm3" ==Links to more HV help== These two links provide some <b>old</b> but useful information. <pre> http://hallaweb.jlab.org/equipment/daq/HVhelp.html http://hallaweb.jlab.org/equipment/daq/gen_slow_control.html
For experts
https://hallaweb.jlab.org/wiki/index.php/HV_HowTo_for_Experts = [Contact List (to be updated)]= [https://hallaweb.jlab.org/wiki/index.php/Graduate_Students Graduate Students] = [[ Tritium-Target How-To (to be added)]]= [https://wiki.jlab.org/tegwiki/index.php/Main_Page <B>Back to Tritium-Main</B>] [https://wiki.jlab.org/tegwiki/index.php/How-To_and_Shift_Info <B>Back one page</B>]