----------------------------------------------------------------------------- Mauna Loa Solar Observatory Observer's Log ----------------------------------------------------------------------------- Sun Feb 9 20:30:20 GMT 1997 Year: 97 Doy: 040 Observer: yasukawa DPMON COMMENT: Sun Feb 9 20:32:50 GMT 1997 CHIP and DPMON were dead this morning. Problem seemed to be in MCC. Started MKIII and kept logs on 11-44. I will transfer those logs here shortly. Meanwhile, we're back up so I will start systems first. Sun Feb 9 20:34:57 GMT 1997 CHIP Startup--Initializing new tape Sun Feb 9 20:35:27 GMT 1997 dPMon Start Patrol Sun Feb 9 20:38:11 GMT 1997 CHIP CHIP Start Patrol LOG-LIST ### NCAR-HAO-MLSO LOG 17:30:22. 2/9/97 DOY 40 ### 1733 STARTING ONLY MKIII AT THIS TIME. CHIP AND DPMON 160 1734 ARE DOWN. MONITOR IS IN POWER-SAVE MODE, YBOX DRIVE 1735 UNIT IS OFF, STATUS UNIT IS LIVE, MCC 2533,4105, AND 3125 1735 CARDS' FAIL LEDS ARE ON. RUN FAILS DUE TO MCC FAILURE. 1736 KEEPING RUNNING LOG ON MKIII'S OLD LOG SYSTEM FOR NOW. 1808 LOWL TAPE IN DRIVE 0 WAS POPPED. L00439 REMOVED, DRIVE 1809 CLEANED, L00441 LOADED. DATA GOING TO L00440 IN DRIVE 1. 1814 1815 TRIED ALERTING BOULDER VIA EMAIL, NETWORK IS DOWN. PING 1816 GETS TO SAN FRANCISCO BEFORE DYING. 1838 *** MARK-III CALIBRATION 1857 SKY TRANMISSION: 1444 DVM 0256 AR11 1909 STATIC CRASHED 4105. CANNOT RECOVER. 1909 EXABYTE HAD ALSO STOPPED. DID 0EOF TO SAVE DATA 1910 BUT KEEP STARTED AFTER 0EOF WRITTEN. DID WEEP 1910 TO STOP DRIVE. WILL PUT ON TWO EOFS BEFORE REBOOTING. KEY 1911 TEK AND LA120 TERMINALS OK, BY THE WAY. 161 1921 REMOVED H01491, LOADED H01492. 1921 H01491 CONTAINS 26 FILES. 1935 DECLINATION PROBLEM. REPOINTED AND RESET. OK Sun Feb 9 21:03:01 GMT 1997 dPMon Flat Sun Feb 9 21:03:05 GMT 1997 CHIP Bias Sun Feb 9 21:03:50 GMT 1997 CHIP End Bias Sun Feb 9 21:03:56 GMT 1997 dPMon End Flat Sun Feb 9 21:03:57 GMT 1997 CHIP Water Sun Feb 9 21:04:25 GMT 1997 CHIP End Water COMMENT: Sun Feb 9 20:53:21 GMT 1997 Synopsis of today's problem: Run on CHIP and DPMON would not start up, MCC monitor was dark this morning. A check revealed that the FAIL LEDs on three MCC cards were on. These cards were the VMIC 2533 Digital Output Card, the VMIC 4105 8-channel D/A Card, and the VMIC 3125 32-channel A/D Card. I tried resetting the MCC processor card with no results. Checked AC power and DC power and they were OK. Tried cycling power at Switched Power on YBOX front panel, no result. Began looking over documentation for clues. Later on when I got brave (or desperate) I turned off power at the front panel of the MCC. OH WAIT< before that, I tried rebooting the host computers to see if some interfaces might need resetting--no result. Back to the MCC.... After turning off power, I removed the cables and pulled the three cards to look for any physical damage or obvious signs of a failure. All cards looked good. I replaced the cards and replaced the cables. When I powered the MCC back up, the processor leds began to flash like normal and after a shor time, (nominal time for built-in test to run) the FAIL leds went off. MCC monitor came to life and hosts responded to Run command. DPMON COMMENT: Sun Feb 9 21:06:10 GMT 1997 Forgot to switch back from slew to clock drive on Coude bench. Made angular correction. COMMENT: Sun Feb 9 21:34:05 GMT 1997 Going down to GONG to attend to their tape drive problem. Sun Feb 9 22:02:04 GMT 1997 CHIP Bias Sun Feb 9 22:02:51 GMT 1997 CHIP End Bias Sun Feb 9 22:03:00 GMT 1997 dPMon Flat Sun Feb 9 22:03:01 GMT 1997 CHIP Water Sun Feb 9 22:03:28 GMT 1997 CHIP End Water Sun Feb 9 22:03:55 GMT 1997 dPMon End Flat COMMENT: Sun Feb 9 22:33:47 GMT 1997 Back from GONG. Sun Feb 9 23:01:03 GMT 1997 CHIP Bias Sun Feb 9 23:01:50 GMT 1997 CHIP End Bias Sun Feb 9 23:02:00 GMT 1997 CHIP Water Sun Feb 9 23:02:29 GMT 1997 CHIP End Water Sun Feb 9 23:03:00 GMT 1997 dPMon Flat Sun Feb 9 23:03:51 GMT 1997 dPMon End Flat Sun Feb 9 23:08:00 GMT 1997 dPMon End Patrol Sun Feb 9 23:08:34 GMT 1997 CHIP CHIP End Patrol Sun Feb 9 23:09:06 GMT 1997 CHIP ending tape COMMENT: Sun Feb 9 23:09:30 GMT 1997 Activity report: QP: 95; 115; 120; 254; No coronal activity Tapes: MKIII: H01491 and H01492 DPMON: P00819 CHIP: C00236 LOWL: L00440 SCAN-LOG SCAN-LOG 17:30:22. 2/9/97 DOY 40 H01491------ 17:39:48 17:43:02 17:46:15 17:49:30 17:52:43 17:55:58 17:59:11 18:02:27 18:05:41 18:08:57 18:12:11 18:15:27 18:18:42 18:21:58 18:25:13 18:28:29 18:31:44 18:35:01 18:38:15 1842 0 CL 18:45:28 1849 15CL 18:58:37 19:02:55 19:06:08 19:08:34 H01492------ 19:24:04 19:27:17 19:30:36 19:33:48 19:37:01 19:40:13 19:43:26 19:46:38 19:49:55 19:53:07 19:56:19 19:59:31 20:02:43 20:05:54 20:09:08 20:12:19 20:15:32 20:18:43 20:21:56 20:25:07 20:28:20 20:31:31 20:34:48 20:38:00 20:41:12 20:44:24 20:47:38 20:50:49 20:54:06 20:57:19 21:00:32 21:03:43 21:06:56 21:10:07 21:13:20 21:16:31 21:19:44 21:22:56 21:26:09 21:29:21 21:32:38 21:35:50 21:39:03 21:42:14 21:45:27 21:48:38 21:51:51 21:55:03 21:58:15 22:01:27 22:04:40 22:07:51 22:11:04 22:14:15 22:17:28 22:20:39 22:23:52 22:27:03 22:30:16 22:33:28 22:36:41 22:39:53 22:43:10 22:46:22 22:49:34 22:52:46 22:55:58 22:59:09 23:02:22 0 ERRORS OK