\item[Epics Power] Opens a VNC with the EPICS control for power supplies
\item[Eventbuilder] Opens a browser pointed at \url{https://hades33/eb} to monitor eventbuilders -
mainly for experts
- \item[Daq VNC] This VNC is typically used by experts to remotely control the system. Not used for
-operating the system from the control room
+% \item[Daq VNC] This VNC is typically used by experts to remotely control the system. Not used for
+% operating the system from the control room
\item[Chat] A terminal based chat window, not used during beam time
\item[Hmon Snapshot] Creates a copy of all plots and windows in Hmon for documentation
\end{description}
in the eventbuilder input nodes have turned from blue to green color. On pressing, the ''TC''
files are stopped and the new calibration is used for the next data taking runs. For more info see sec.~\ref{sec:tdc_calibration_procedure}.
\item[Stop EB] Stop eventbuilders. For expert and testing purpose only!
- \item[MDC HighVoltageRamp] ! NOT working at the moment
+% \item[MDC HighVoltageRamp] ! NOT working at the moment
\item[Restart BNET Control] Restart the DABC master process that controls the building
network (BNET). This process also delivers the eventbuilder monitoring at \url{https://hades33/eb}
\item[Restart Hmon] use to activate changes in main monitoring
\item[Set RICH HV] Switches on all RICH HV lines and sets all HV modules to the correct supply voltage setting.
If only one module is already switched on, this button will ramp down all HV modules instead.
During ramp up keep an eye on \url{hades33/mon/monitor.cgi?6-RichRatev2} maximum rate should not exceed 1 MHz for longer times
- \item[Start Speech Output] Restart speech output of DAQ issues
- \item[Stop Speech Output] Silence the speech output of DAQ issues
+ \item[Start / Stop Speech Output] Restart / Silence speech output of DAQ issues
+
\end{description}
\begin{description}
- \item[Powercycle all] LV power cycle of everything. Requires ''Reprogram FPGA'', ''Reboot OEP'', and ''Reboot MDCHub''
- afterwards
+% \item[Powercycle all] LV power cycle of everything. Requires ''Reprogram FPGA'', ''Reboot OEP'', and ''Reboot MDCHub''
+% afterwards
\item[RICH Powercycle] LV power cycle of RICH.
\item[RICH Fan Powercycle] LV power cycle of RICH Fans.
\item[ECAL RPC 48V Powercycle] LV powercycle for all DAQ boards mounted in the ECAL frame
\item EPICS Power from the control GUI
\begin{description}
- \item[MDC/TOF/Trigger] MDC Hubs, TOF Trb \& Fee, iTOF Trb
+ \item[MDC/TOF/Trigger] MDC Hubs, TOF Trb \& Fee, %iTOF Trb
\item[ECAL/RPC] ECal Trb, RPC Trb, ECal pulser, Trigger distribution in ECAL
\item[Central] RICH Hubs, Central Hubs
- \item[STS] STS Trb
- \item[fRPC] fRPC Trb
- \item[RPC LV] Group of 2 supplies: RPC Fee
+ \item[ForwardWall] Forward Wall Trb \& FEE
+% \item[STS] STS Trb
+% \item[fRPC] fRPC Trb
+ \item[RPC LV] Group of 2 supplies: RPC Fee (no DAQ), RPC DCS
\item[RICH LV] Group of 9 supplies: RICH Fee
\item[MDC LV] Group of 6 supplies: MDC Fee
\end{description}
\begin{description}
\item[RichFans] Coolings fans on RICH
\item[ECal 1/2/3] ECal Padiwa (two channels per sector)
- \item[CentralControls] Channel 1: iTOF Padiwa\\ Channel 2: Trigger fanout at CTS, Triggerbox,
+ \item[CentralControls] %Channel 1: iTOF Padiwa\\
+ Channel 2: Trigger fanout at CTS, Triggerbox,
Beammonitor\\Channel 3+4: CTS Trb, BLR, some DCS modules
- \item[STS 1/2] STS Fee
- \item[Start] Channel 2+4: Start Trb \\Channel 1: Start Padiwa\\Channel 3: Start Fans
+% \item[STS 1/2] STS Fee
+ \item[Start] %Channel 2+4: Start Trb \\Channel 1: Start Padiwa\\Channel 3: Start Fans
\item[Veto] Hodo Trb, Hodo Fee
- \item[iTofHV] Channel 4: iTOF SiPM power
+% \item[iTofHV] Channel 4: iTOF SiPM power
\end{description}
\item Power Switches\newline
Web interface and/or a button in the control GUI
\begin{description}
- \item[ForwardWall] \url{http://haepcp06}
+% \item[ForwardWall] \url{http://haepcp06}
\item[ECal Laser] \url{http://haepcp15}
\item[White Rabbit PC] \url{http://haepcp10}
\item[Pexor PC] \url{http://haepcp02}
\end{itemize}
Some reference values can be found at
-\url{https://hessenbox-a10.rz.uni-frankfurt.de/getlink/fiPKXwN7sRuy82d9Bbf9Md2m/PowerSupply.xlsx}
+\url{https://hessenbox-a10.rz.uni-frankfurt.de/getlink/fiKRc8JdQecpnVPDSKFB54/PowerSupply.xlsx}
\item[EcalSimpleRate] ECal rate of all channels
\item[Environment] Temperature, Pressure and Humidity over time
\item[EvtsPerSpill] Number of recorded events per spill
- \item[FrpcRate] fRPC rate on all channels
- \item[FrpcRateHist] fRPC rate on all modules over time
+% \item[FrpcRate] fRPC rate on all channels
+% \item[FrpcRateHist] fRPC rate on all modules over time
\item[GbeRate] Amount of data on each Ethernet link
\item[HodoPosition] Position of the beam on the hodoscope
\item[HodoRate] Rate on all channels of the Hodoscope
\item[HodoRatePlot] Rate on all channels of the Hodoscope
\item[HodoRate*\_0] Rate on all channels of the Hodoscope
\item[HodoSpillShapeAnalysis*\_0] Spill structure from Hodoscope
- \item[ItofRate] Rate of all TDC channels in iTOF
- \item[ItofRateNumbers] Rate from all paddles of iTOF
+% \item[ItofRate] Rate of all TDC channels in iTOF
+% \item[ItofRateNumbers] Rate from all paddles of iTOF
\item[MDCBusy] Time of busyness of each MDC front-end motherboard (MBO).
\item[MDCFailure] Front-end Errors recieved by DAQ.
\item[MDCHV] Current HV \& ionisation current measurement of field \& cathode wire layers inside each of 24 drift-chambers.
\item[MDCTokenMiss] Lost tokens for each MDC front-end motherboard (MBO).
\item[MDCTriggerError] Errors in trigger signals recieved by each MDC front-end motherboard (MBO).
\item[MdcPressure] outdated ?
- \item[MdcPressurePlane1] Trend plot of overpressure inside each of 6 Plane 1 drift-chambers.
- \item[MdcPressurePlane2] Trend plot of overpressure inside each of 6 Plane 2 drift-chambers.
- \item[MdcPressurePlane3] Trend plot of overpressure inside each of 6 Plane 3 drift-chambers.
- \item[MdcPressurePlane4] Trend plot of overpressure inside each of 6 Plane 4 drift-chambers.
+ \item[MdcPressurePlaneX] Trend plot of overpressure inside each of 6 Plane X drift-chambers.
\item[MdcScales] Trend plot of the air temperature inside the cave
\item[MicroSpillStructure] The beam intensity in 20us bins, from Start detector
\item[Muxhist] Rates from two monitoring channels in the CTS
\item[StartRate*histbar] Rates from the Start detector, separate for X and Y direction
\item[StartSpillShapeAnalysis*\_0] Analysis of the spill shape and regularity based on X or Y
part of Start detector
- \item[StsRate] STS rate for each channel
- \item[StsRateSplit] STS for each channel, separated in STS-1 and STS-2
+% \item[StsRate] STS rate for each channel
+% \item[StsRateSplit] STS for each channel, separated in STS-1 and STS-2
\item[TDCErrors] TDC Error numbers
\item[TdcCal] TDC Calibration quality analysis, from EB
\item[TdcCalMon] TDC Calibration quality analysis, from extra script
\item[hldlast] List of latest hld files written to disk
\item[hubmon] Monitor for link activity on DAQ hubs
\item[logfile] Logfile with DAQ error messages
- \item[mdchvC0] Trend plot of ionisation current measurement of field \& cathode wire layers inside each of 6 Plane 1 drift-chambers.
- \item[mdchvC1] Trend plot of ionisation current measurement of field \& cathode wire layers inside each of 6 Plane 2 drift-chambers.
- \item[mdchvC2] Trend plot of ionisation current measurement of field \& cathode wire layers inside each of 6 Plane 3 drift-chambers.
- \item[mdchvC3] Trend plot of ionisation current measurement of field \& cathode wire layers inside each of 6 Plane 4 drift-chambers.
- \item[mdchvV0] Trend plot of high voltage measurement of field \& cathode wire layers inside each of 6 Plane 1 drift-chambers.
- \item[mdchvV1] Trend plot of high voltage measurement of field \& cathode wire layers inside each of 6 Plane 2 drift-chambers.
- \item[mdchvV2] Trend plot of high voltage measurement of field \& cathode wire layers inside each of 6 Plane 3 drift-chambers.
- \item[mdchvV3] Trend plot of high voltage measurement of field \& cathode wire layers inside each of 6 Plane 4 drift-chambers.
+ \item[mdchvCx] Trend plot of ionisation current measurement of field \& cathode wire layers inside each of 6 Plane x drift-chambers.
+ \item[mdchvVx] Trend plot of high voltage measurement of field \& cathode wire layers inside each of 6 Plane x drift-chambers.
\item[richvolt] RICH LV voltages and currents, bargraphs
\subsection*{Full MDC}
If it's unclear which part of MDC causes an error, or if there is a larger number of boards
-failing, you can do a complete MDC power cycle using "EPICS Power" and "MDC Group" instead of using
+failing, you can do a complete MDC power cycle using "MDC Group" in EPICS instead of using
the "MDC LV Powercycle".
\subsection*{RICH}
All boards of the RICH subsystem (addresses 7xxx and 82xx) are powered by the supplies in the "RICH
Group". Use the button "RICH Powercycle" to switch them off and on again. When all power supplies
-are active again (see the list in ``EPICS Power'' -> ``RICH LV''), do a DAQ restart.
+are active again (see the list in EPICS -> ``RICH LV''), do a DAQ restart.
-In the case that the power cycle triggered the temperature interlock for RICH power supplies.
-The 3.3V supply might be blocked by the temperature interlock - restart DAQ, then try to reset it.
+Sometimes the power cycle triggers the temperature interlock for RICH power supplies.
+The 3.3V supply might be blocked and doesn't switch on - restart DAQ, then try to switch on this powersupply again.
\subsection*{Other Subdetectors}
looking at the ECAL rate plot seeing weird structures (e.g. 8 green dots in a row) or completely
missing parts.
-\item After the powercycle and DAQ restart often the RPC is still not fully operational. Often you
-need to repeat the powercycle until RPC and ECAL (connected to same LV) are both operational again.
+% \item After the powercycle and DAQ restart often the RPC is still not fully operational. Often you
+% need to repeat the powercycle until RPC and ECAL (connected to same LV) are both operational again.
-\item After the first DAQ restart you should press the Fix missing IP preemptively as otherwise the
-EB might fail.
+% \item After the first DAQ restart you should press the Fix missing IP preemptively as otherwise the
+% EB might fail.
\end{itemize}
-\subsubsection*{STS}
-\begin{itemize}
-\item Whenever you do an STS powercycle, you need to do "Thresholds STS" if it did not work (you
-see e.g. blue spots in the STS Hit rate plot) do a "Thresholds STS reset" (this takes a bit longer
-as it is comprised of four different scripts)
-\end{itemize}
+% \subsubsection*{STS}
+% \begin{itemize}
+% \item Whenever you do an STS powercycle, you need to do "Thresholds STS" if it did not work (you
+% see e.g. blue spots in the STS Hit rate plot) do a "Thresholds STS reset" (this takes a bit longer
+% as it is comprised of four different scripts)
+% \end{itemize}
\subsubsection*{TOF}
\begin{itemize}
\item If settings thresholds doesn't work in the first try, repeat it a couple more times.
\end{itemize}
-\subsubsection*{iTOF}
-\begin{itemize}
-\item After the iTOF powercycle check if the rates in all sectors are equal - if not a "Thresholds
-iTOF" is needed. If this doesn't help, do a "Powercycle iTOF Padiwa" and try again.
-\end{itemize}
+% \subsubsection*{iTOF}
+% \begin{itemize}
+% \item After the iTOF powercycle check if the rates in all sectors are equal - if not a "Thresholds
+% iTOF" is needed. If this doesn't help, do a "Powercycle iTOF Padiwa" and try again.
+% \end{itemize}
-\subsubsection*{"Everything failed" / 'Invaild' during startup}
-If suddenly TRBnet fails (normally indicated by every button on the tactical display blinking red),
+\subsubsection*{"Everything failed" / 'Invaild' messages during startup}
+If suddenly TRBnet fails (normally indicated by almost every button on the tactical display blinking red),
you usually can solve the problem by using the Reboot buttons. Start with RICH, ECAL, RPC and then the
rest. Try to restart after a couple of reboots before continuing.
-Rarely a powercycle of RICH or the Common Group is needed.
+Rarely a full power cycle is needed.
\subsubsection*{General remark}
\begin{itemize}
-\item If the EBs do not come up after a (or several) power cycles, try a "Fix missing IP".
+% \item If the EBs do not come up after a (or several) power cycles, try a "Fix missing IP".
\item Sometimes some MDC boards are missing for a longer time such that the tactical overview
informs you to take action.
Very often a DAQ restart is sufficient to get these boards working again.
\item Check that all supplies are on. Sometimes the 3.3V supply doesn't switch on due to an interlock.
\end{itemize*}
\item Start DAQ (it won't run, that's fine)
- \begin{itemize*}
- \item Check if all RPC and ECAL boards are there. If not, redo ECAL/RPC powercycle in EPICS and
-repeat
- \item Check if all iTOF boards are there. If not, redo MDC/TOF powercycle in EPICS and repeat
- \item Check if all Start boards are there. If not, redo Powercycle Start and repeat
- \end{itemize*}
+% \begin{itemize*}
+% \item Check if all RPC and ECAL boards are there. If not, redo ECAL/RPC powercycle in EPICS and
+% repeat
+% \item Check if all iTOF boards are there. If not, redo MDC/TOF powercycle in EPICS and repeat
+% \item Check if all Start boards are there. If not, redo Powercycle Start and repeat
+% \end{itemize*}
\item Reprogram FPGA \\
BLR Reinit FPGA \\
ECAL Padiwa Powercycle \\
- Hodo Powercycle\\
+% Hodo Powercycle\\
Start Powercycle \\
- STS Fee Powercycle\\
- iTof Padiwa Powercycle \\
+% STS Fee Powercycle\\
+% iTof Padiwa Powercycle \\
Triggerbox Beam Powercycle
\item Start DAQ
-\item Run Fix Missing IP
+% \item Run Fix Missing IP
\item MDC power supply group on (EPICS) \\
MDC LV Turn On All Relais
\item Reboot OEP
\begin{itemize*}
\item In case of corresponding message, redo Reboot OEP as necessary and try again.
\end{itemize*}
-\item Thresholds STS Reset \\
+\item %Thresholds STS Reset \\
Check Eventbuilders getting data \\
Check all FEE to deliver proper signals. Load thresholds or do another Fee/Padiwa powercycle\\
Check if there are no 'MBO without data' - otherwise do a powercycle for this chamber, Reboot OEP, Start DAQ
The documentation of the trigger box can be found here:
-\url{https://hessenbox-a10.rz.uni-frankfurt.de/getlink/fiUjpMeXrUCkLQeTXHtuw8un/TriggerBoxLogic.docx
+\url{https://hessenbox-a10.rz.uni-frankfurt.de/getlink/fiFWrwrySpuFZPt2pnqXCU/TriggerBoxLogic.docx
}
-More information on the trigger collection scheme:
-\url{https://hessenbox-a10.rz.uni-frankfurt.de/getlink/fi3okFdMs98kqxjyqKvziPid/Trigger2021.pptx}
+More information on the trigger collection scheme: to be updated for 2023
+
jspc29 / daqdocu.git / commitdiff