----------------------------------------------------------------------------- Mauna Loa Solar Observatory Observer's Log ----------------------------------------------------------------------------- Wed Jan 25 17:24:17 GMT 2012 Year: 12 Doy: 025 Observer: berkey Wed Jan 25 17:31:54 GMT 2012: PSPT Start Patrol Wed Jan 25 17:32:17 GMT 2012 H-ALPHA Start Patrol Wed Jan 25 17:42:28 GMT 2012 COMP Start Patrol WEATHER COMMENT: Wed Jan 25 17:42:25 GMT 2012 Clear skies, temp 35f, wind 5mph from se ___end___ Wed Jan 25 18:02:03 GMT 2012 MKIV Start Patrol **MKIV PROBLEM COMMENT BY BEN**: Wed Jan 25 18:41:48 GMT 2012 Akamai crash with following error: Execption at interrupt level: Access Fault Program Counter: 0x001e8ba6 Status Register: 0x2100 Access Address : 0x02000000 Special Status : 0x0105 Regs at 0xab930 ___end___ **MKIV PROBLEM COMMENT BY BEN**: Wed Jan 25 18:43:52 GMT 2012 After this akamai rebooted but the video signal on the monitor did not change. ___end___ **MKIV PROBLEM COMMENT BY BEN**: Wed Jan 25 18:46:11 GMT 2012 After reboot: setCortab 1 Access Fault Program Counter: 0x0015b206 Status Register: 0x3014 Access Address : 0xffff2510 Special Status : 0x00c5 2ec24 _vxTaskEntry +10 : _shell (0, 0, 0, 0, 0, 0, 0, 0, 0, 0) 5b5bc _shell +138: 5b5da ([0, 0, 0, 5b3e0, 0]) 5b75c _shell +2d8: _execute (3a868e) 5b880 _execute +ac : _yyparse ([0, 0, 0, 3a868e, 0]) 5faea _yyparse +514: 5e4b4 (34f0d8, 34f0f8) 5e5c0 _yystart +758: _setCortab (1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0) 15305e _setCortab +1c : _loadCortab (0, 0, 0) shell restarted. ___end___ Wed Jan 25 18:48:37 GMT 2012 COMP End Patrol Wed Jan 25 18:54:38 GMT 2012 MKIV Start Patrol Wed Jan 25 18:56:09 GMT 2012 COMP Start Patrol Wed Jan 25 19:07:02 GMT 2012 MKIV End Patrol Wed Jan 25 19:07:12 GMT 2012 MKIV Start Cal Wed Jan 25 19:23:19 GMT 2012 CHIP Start Patrol Wed Jan 25 19:24:29 GMT 2012: PSPT Start Patrol Wed Jan 25 19:26:06 GMT 2012 MKIV End Cal Wed Jan 25 19:26:12 GMT 2012 MKIV Start Patrol Wed Jan 25 21:15:23 GMT 2012: PSPT Start Patrol Wed Jan 25 21:44:09 GMT 2012 COMP End Patrol Wed Jan 25 21:44:44 GMT 2012 COMP Start Patrol Wed Jan 25 21:56:53 GMT 2012 CHIP End Patrol **CHIP PROBLEM COMMENT BY BEN**: Wed Jan 25 21:57:18 GMT 2012 Kii crashed with a watch dog fault, but memory checks showed nowthing wrong ___end___ **PSPT PROBLEM COMMENT BY BEN**: Wed Jan 25 22:06:29 GMT 2012 Pspt got stuck homeing the filter ___end___ Wed Jan 25 22:15:42 GMT 2012 CHIP Start Patrol Wed Jan 25 22:26:31 GMT 2012: PSPT Start Patrol Wed Jan 25 23:00:41 GMT 2012 CHIP LSD Wed Jan 25 23:02:26 GMT 2012 CHIP End LSD Wed Jan 25 23:02:34 GMT 2012 CHIP BiasLSD Wed Jan 25 23:03:24 GMT 2012 CHIP End BiasLSD Wed Jan 25 23:03:32 GMT 2012 CHIP Bias Wed Jan 25 23:04:15 GMT 2012 CHIP End Bias Wed Jan 25 23:04:28 GMT 2012 CHIP ReStart Patrol Wed Jan 25 23:40:50 GMT 2012 CHIP End Patrol Wed Jan 25 23:44:39 GMT 2012 COMP End Patrol Wed Jan 25 23:43:39 GMT 2012 CHIP Start Patrol Wed Jan 25 23:46:04 GMT 2012 MKIV End Patrol NOTE BY BEN: Wed Jan 25 23:48:50 GMT 2012 Cloluds starting to move in, might have to close domes soon ___end___ Thu Jan 26 00:04:45 GMT 2012 CHIP End Patrol Thu Jan 26 00:06:04 GMT 2012: PSPT Abort Patrol Thu Jan 26 00:06:12 GMT 2012: PSPT Abort Patrol Thu Jan 26 00:06:20 GMT 2012: PSPT Abort Patrol Thu Jan 26 00:06:28 GMT 2012: PSPT Abort Patrol Thu Jan 26 00:06:36 GMT 2012: PSPT Abort Patrol NOTE BY BEN: Thu Jan 26 01:48:58 GMT 2012 Fog now very thick. ___end___ **GENERAL PROBLEM COMMENT BY BEN**: Thu Jan 26 01:59:41 GMT 2012 The MLSO-PC vpn client isn't functional, I beleive this is why the svn software wasnt working on the computer. ___end___ CHIP COMMENT BY BEN: Thu Jan 26 02:01:02 GMT 2012 Kii check summary. -Repeat test from yesterday using photon hardware with kii edt board and kii hard drive. Here I found the same Async memory error that we got yesterday. Various google searches seem to say this problem is likely a bad cpu. -Moved kii edt board and kii hard drive back to kii shell then replaced kii ram with photon ram. Kii then ran fine for about 2.5 hours before crashing with a watch dog timer fault. -Restarting kii ran again for about 45 minutes. -Next the photon cpu boards were swapped into kii, this gave the same Async errors seen when the kii hard drive was in photon. I think this conclusively says the one or both of the photon processors are bad. -Next the nene edt board was swapped into kii The final configuration of kii for today is: the kii box with photon ram and nene edt board. It seems to work during the 15 minute test I able to conduct before the clouds rolled in. Hopefully tomorrow we get a better test. I really hope the edt board was the problem. ___end___ **PSPT PROBLEM COMMENT BY BEN**: Thu Jan 26 02:06:10 GMT 2012 I found some oil on the table at the north end of the pspt pier. It looks like it is dripping from the motor/drive train of the shutter. ___end___ Thu Jan 26 02:14:15 GMT 2012 MkIV 18_02.rawmk4 19_49.rawmk4 20_51.rawmk4 21_57.rawmk4 22_58.rawmk4 18_05.rawmk4 19_52.rawmk4 20_54.rawmk4 21_59.rawmk4 23_01.rawmk4 18_08.rawmk4 19_55.rawmk4 20_57.rawmk4 22_02.rawmk4 23_04.rawmk4 18_10.rawmk4 19_58.rawmk4 21_00.rawmk4 22_05.rawmk4 23_07.rawmk4 18_13.rawmk4 20_01.rawmk4 21_03.rawmk4 22_08.rawmk4 23_10.rawmk4 18_16.rawmk4 20_04.rawmk4 21_06.rawmk4 22_11.rawmk4 23_13.rawmk4 18_54.rawmk4 20_07.rawmk4 21_09.rawmk4 22_14.rawmk4 23_16.rawmk4 18_57.rawmk4 20_10.rawmk4 21_12.rawmk4 22_17.rawmk4 23_19.rawmk4 19_00.rawmk4 20_13.rawmk4 21_17.rawmk4 22_20.rawmk4 23_22.rawmk4 19_03.rawmk4 20_16.rawmk4 21_21.rawmk4 22_23.rawmk4 23_25.rawmk4 19_10.rawmk4 20_19.rawmk4 21_24.rawmk4 22_26.rawmk4 23_28.rawmk4 19_16.rawmk4 20_22.rawmk4 21_27.rawmk4 22_29.rawmk4 23_31.rawmk4 19_22.rawmk4 20_25.rawmk4 21_30.rawmk4 22_32.rawmk4 23_34.rawmk4 19_26.rawmk4 20_27.rawmk4 21_33.rawmk4 22_35.rawmk4 23_36.rawmk4 19_29.rawmk4 20_30.rawmk4 21_36.rawmk4 22_38.rawmk4 23_39.rawmk4 19_32.rawmk4 20_33.rawmk4 21_39.rawmk4 22_41.rawmk4 23_42.rawmk4 19_35.rawmk4 20_36.rawmk4 21_42.rawmk4 22_44.rawmk4 c19_07.rawmk4 19_38.rawmk4 20_39.rawmk4 21_45.rawmk4 22_46.rawmk4 c19_13.rawmk4 19_40.rawmk4 20_42.rawmk4 21_48.rawmk4 22_49.rawmk4 c19_19.rawmk4 19_43.rawmk4 20_45.rawmk4 21_51.rawmk4 22_52.rawmk4 19_46.rawmk4 20_48.rawmk4 21_54.rawmk4 22_55.rawmk4