From: Jan Michel <mail@janmichel.eu>
Date: Thu, 10 Mar 2022 19:37:43 +0000 (+0100)
Subject: update operator notes
X-Git-Url: https://jspc29.x-matter.uni-frankfurt.de/git/?a=commitdiff_plain;h=583009ec54e332c770df71432d8535d4d8ae9ddf;p=daqdocu.git

update operator notes
---

diff --git a/hadesoperator/powercycles.tex b/hadesoperator/powercycles.tex
index 2752666..bec001a 100644
--- a/hadesoperator/powercycles.tex
+++ b/hadesoperator/powercycles.tex
@@ -36,6 +36,10 @@ The 3.3V supply might be blocked by the temperature interlock - restart DAQ, the
 \subsection*{Other Subdetectors}
 Check section \ref{powersupplies} to see which power supply to switch.
 
+\subsection*{Full Powercycle}
+A full powercycle should only be done after contact with an expert. Follow the guide for the 
+``Daily DAQ reboot''.
+
 
 \subsection{Jörg's helpful tips}
 \subsubsection*{ECAL / RPC}
@@ -71,12 +75,11 @@ TOF" is needed.
 iTOF" is needed. If this doesn't help, do a "Powercycle iTOF Padiwa" and try again.
 \end{itemize}
 
-\subsubsection*{Procedure if TRBnet fails}
-If suddenly TRBnet fails (normally indicated by every button on the tactical display blinking red) 
-do a powercycle of the common group. Thereafter you need to switch on the RICH LV again after 
-waiting about 10 seconds.
-If you powercycled the common group, check all the thresholds and rates as explained in the ECAL, 
-RPC and TOF sections.
+\subsubsection*{"Everything failed" / 'Invaild' during startup}
+If suddenly TRBnet fails (normally indicated by every button on the tactical display blinking red),
+you usually can solve the problem by using the Reboot buttons. Start with RICH, ECAL, RPC and then the
+rest. Try to restart after a couple of reboots before continuing. 
+Rarely a powercycle of RICH or the Common Group is needed.
 
 \subsubsection*{General remark}
 \begin{itemize}
@@ -93,25 +96,27 @@ server room.
 
 \end{itemize}
 
-\subsection*{Full Powercycle}
-A full powercycle should only be done after contact with an expert. Follow the guide for the 
-``Daily DAQ reboot''.
 
 
 \section{Full Power Cycle / Daily DAQ reboot}
-This should be performed at least once a day, when there is a break of ~ 15 minutes and in presence 
-of the DAQ expert: {\bf To be updated for 2022!}
+This should be performed at least once a day, when there is a break of ~ 15 minutes. Steps listed under the same item can be done in parallel.
 \begin{enumerate}
 \item Switch off beam on control panel\\
       Switch EB to No File
 \item MDC power supply group off (EPICS)\\
-      Common Group power supply power cycle (EPICS)  
-\item RICH power supply group power cycle (EPICS) 
+      Common Group power supply power off (EPICS)  
+\item Common Group power supply power on (EPICS)        
+\item (wait 10 seconds) 
+\item RICH power supply group power on (EPICS) 
+ \begin{itemize*}
+  \item Check that all supplies are on. Sometimes the 3.3V supply doesn't switch on due to an interlock.
+ \end{itemize*}
 \item Start DAQ (it won't run, that's fine) 
  \begin{itemize*}
   \item Check if all RPC and ECAL boards are there. If not, redo ECAL/RPC powercycle in EPICS and 
 repeat
   \item Check if all iTOF boards are there. If not, redo MDC/TOF powercycle in EPICS and repeat
+  \item Check if all Start boards are there. If not, redo Powercycle Start and repeat
  \end{itemize*}
 
 \item Reprogram FPGA \\ 
@@ -130,8 +135,14 @@ repeat
       MDC LV Turn On All Relais
 \item Reboot OEP
 \item Start DAQ
-\item Thresholds STS Reset\\
-      Check Eventbuilders getting data
+ \begin{itemize*}
+  \item In case of corresponding message, redo Reboot OEP as necessary and try again.
+ \end{itemize*}
+\item Thresholds STS Reset \\
+      Check Eventbuilders getting data \\
+      Check all FEE to deliver proper signals. Load thresholds or do another Fee/Padiwa powercycle\\
+      Check if there are no 'MBO without data' - otherwise do a powercycle for this chamber, Reboot OEP, Start DAQ
+
 
 \item Switch on beam
 \end{enumerate}