Delivered-To: iguana@ucar.edu Date: Thu, 12 May 2005 02:42:45 GMT From: yasukawa@nahenahe.mlso.ucar.edu To: alice@ucar.edu, holzer@ucar.edu, iggy@ucar.edu, iguana@ucar.edu, mprast@ucar.edu, pfox@ucar.edu Subject: 05d131 X-Virus-Scanned: amavisd-new at ucar.edu ----------------------------------------------------------------------------- Mauna Loa Solar Observatory Observer's Log ----------------------------------------------------------------------------- Wed May 11 16:24:25 GMT 2005 Year: 05 Doy: 131 Observer: yasukawa WEATHER COMMENT: Wed May 11 16:24:49 GMT 2005 Clear, NE wind 5 mph, temp 48 F. ___end___ **MLSO PROBLEM**: Wed May 11 16:26:55 GMT 2005 Kaiee has been trying to reboot since I arrived. Assuming CSMT is doing it remotely. ___end___ ECHO COMMENT: Wed May 11 16:31:15 GMT 2005 Time OK. ___end___ PSPT COMMENT: Wed May 11 16:31:24 GMT 2005 Starting up. ___end___ Wed May 11 16:32:06 GMT 2005 CHIP Start Patrol Wed May 11 16:32:16 GMT 2005 PICS Start Patrol **MKIV PROBLEM**: Wed May 11 16:39:07 GMT 2005 KCC failure at startup, reset did not restart. Cycled power, KCC restarted OK. ___end___ PSPT COMMENT: Wed May 11 16:41:02 GMT 2005 Observing. ___end___ Wed May 11 16:46:24 GMT 2005 MKIV Start Patrol **MLSO PROBLEM**: Wed May 11 16:51:52 GMT 2005 Cycling power to kaiee. ___end___ **MLSO PROBLEM**: Wed May 11 17:04:51 GMT 2005 Kaiee still in a loop, rebooting itself. Called Barry at CSMT to report problem as email is down with kaiee, left voicemail. ___end___ **GONG PROBLEM**: Wed May 11 17:14:19 GMT 2005 GONG has been in typical crash mode since arrival. Going down there to install the recently received second UPS, restart system, and check eScope for any captured error traces. ___end___ Wed May 11 18:00:17 GMT 2005 PICS Flat Wed May 11 18:02:33 GMT 2005 PICS End Flat Wed May 11 18:02:43 GMT 2005 PICS ReStart Patrol Wed May 11 18:02:50 GMT 2005 CHIP LSD Wed May 11 18:04:45 GMT 2005 CHIP End LSD Wed May 11 18:04:54 GMT 2005 CHIP BiasLSD Wed May 11 18:05:46 GMT 2005 CHIP End BiasLSD Wed May 11 18:05:58 GMT 2005 CHIP Bias Wed May 11 18:07:00 GMT 2005 CHIP End Bias Wed May 11 18:07:07 GMT 2005 CHIP ReStart Patrol **GONG PROBLEM**: Wed May 11 18:18:07 GMT 2005 Back from GONG. ___end___ Wed May 11 18:20:52 GMT 2005 MKIV End Patrol Wed May 11 18:20:58 GMT 2005 MKIV Start Cal Wed May 11 18:39:40 GMT 2005 MKIV End Cal Wed May 11 18:47:41 GMT 2005 MKIV Start Patrol **MLSO PROBLEM**: Wed May 11 19:35:00 GMT 2005 Kaiee still down. Have been on phone with Barry since I returned from GONG, troubleshooting. Taking a break to reconfigure dome, Barry is having the lunch break he has been missing and regrouping his thoughts. ___end___ COMMENT: Wed May 11 19:36:35 GMT 2005 Stopping to reconfigure dome shutter. ___end___ Wed May 11 19:36:50 GMT 2005 CHIP End Patrol Wed May 11 19:37:06 GMT 2005 PICS End Patrol **GONG PROBLEM**: Wed May 11 19:37:27 GMT 2005 Ah rats! GONG is crashed again. Leaving it like that until I resolve kaiee. ___end___ Wed May 11 19:40:57 GMT 2005 MKIV End Patrol **MLSO PROBLEM**: Wed May 11 19:38:56 GMT 2005 This is a great situation that is pointing out the need to tailor the MLSO data reduction effort so that data is not backed up when instrumental problems consume a lot of the observer's time. We don't want to end up with a gazillion hours of data reduction backed up when we are stalled with serious instrumental problems. ___end___ Wed May 11 19:48:02 GMT 2005 MKIV Start Patrol Wed May 11 19:48:18 GMT 2005 CHIP Start Patrol Wed May 11 19:48:29 GMT 2005 PICS Start Patrol NICE MK4 IMAGE: 1802 NICE CHIP IMAGE: 1802 NICE PICSLIMB IMAGE: 1803 NICE PICSDISC IMAGE: 1803 **MLSO PROBLEM**: Wed May 11 20:38:53 GMT 2005 We did a bunch of stuff to boot from alternate disk (c0t3dos0) after adding hosts to it (couldn't get on net from this disk). Now Barry is able to log into kaiee and will do some poking around to find some clues to our problem. ___end___ **GONG PROBLEM**: Wed May 11 20:47:58 GMT 2005 Going down to GONG to reset their system while Barry looks thru kaiee. ___end___ **GONG PROBLEM**: Wed May 11 21:05:00 GMT 2005 Back from GONG. ___end___ WEATHER COMMENT: Wed May 11 21:05:13 GMT 2005 Construction crew doing some digging and rock-busting between the old AEC butler bldg and the TelCo microwave bldg with a back hoe. Site is upwind from station so sky is very noisy. ___end___ A NEW TAPE HAS BEEN PUT INTO KAIEE DLT DRIVE, Wed May 11 22:13:25 GMT 2005 **GONG PROBLEM**: Wed May 11 23:14:02 GMT 2005 GONG has crashed shortly after I came back. Waited until I stabilized dome rotation around midday and got to a place with CSMT's troubleshooting effort with kaiee to spare a few minutes to restart GONG. Going back down now. ___end___ **GONG PROBLEM**: Wed May 11 23:30:05 GMT 2005 Back from GONG. ___end___ **GONG PROBLEM**: Thu May 12 00:13:03 GMT 2005 GONG has hung up again. ___end___ WEATHER COMMENT: Thu May 12 00:22:58 GMT 2005 In scattered orographic clouds. ___end___ Thu May 12 01:18:52 GMT 2005 CHIP End Patrol Thu May 12 01:19:40 GMT 2005 PICS End Patrol COMMENT: Thu May 12 01:19:42 GMT 2005 Reconfiguring dome shutter. ___end___ Thu May 12 01:20:27 GMT 2005 MKIV End Patrol Thu May 12 01:26:52 GMT 2005 MKIV Start Patrol Thu May 12 01:27:08 GMT 2005 CHIP Start Patrol Thu May 12 01:27:19 GMT 2005 PICS Start Patrol **GONG PROBLEM**: Thu May 12 01:27:29 GMT 2005 Going down to GONG to reset it. ___end___ **MLSO PROBLEM**: Thu May 12 02:24:16 GMT 2005 As far as I know, kaiee is still running on disk1. Any email sent before we rebooted with disk1 is on disk0 and unavailable at this time. Bunny will get email accessible once we figure out the current problem with disk0. ___end___ Thu May 12 02:29:58 GMT 2005 PICS End Patrol Thu May 12 02:30:57 GMT 2005 CHIP End Patrol Thu May 12 02:31:48 GMT 2005 MKIV End Patrol COMMENT: Thu May 12 02:31:12 GMT 2005 Alice indicated earlier that data was being transferred over the net to Boulder. ECHO appears to have data that hasn't been FTP'd (to kaiee?) since early this morning or yesterday. ___end___ GONG COMMENT: Thu May 12 02:33:33 GMT 2005 GONG still running since last reset. ___end___ PSPT COMMENT: Thu May 12 02:41:22 GMT 2005 Topped off spring water reservoir in PSPT coolant circulator. ___end___ Thu May 12 02:42:12 GMT 2005 MkIV 00_00.rawmk4 02_02.rawmk4 18_11.rawmk4 20_32.rawmk4 22_26.rawmk4 00_03.rawmk4 02_05.rawmk4 18_14.rawmk4 20_35.rawmk4 22_29.rawmk4 00_06.rawmk4 02_07.rawmk4 18_17.rawmk4 20_37.rawmk4 22_32.rawmk4 00_09.rawmk4 02_10.rawmk4 18_24.rawmk4 20_40.rawmk4 22_35.rawmk4 00_12.rawmk4 02_13.rawmk4 18_30.rawmk4 20_43.rawmk4 22_38.rawmk4 00_15.rawmk4 02_16.rawmk4 18_36.rawmk4 20_46.rawmk4 22_41.rawmk4 00_18.rawmk4 02_19.rawmk4 18_47.rawmk4 20_49.rawmk4 22_44.rawmk4 00_21.rawmk4 02_22.rawmk4 18_50.rawmk4 20_52.rawmk4 22_47.rawmk4 00_24.rawmk4 02_25.rawmk4 18_53.rawmk4 20_55.rawmk4 22_50.rawmk4 00_27.rawmk4 02_28.rawmk4 18_56.rawmk4 20_58.rawmk4 22_53.rawmk4 00_30.rawmk4 16_46.rawmk4 18_59.rawmk4 21_01.rawmk4 22_56.rawmk4 00_33.rawmk4 16_49.rawmk4 19_02.rawmk4 21_04.rawmk4 22_59.rawmk4 00_36.rawmk4 16_52.rawmk4 19_05.rawmk4 21_07.rawmk4 23_01.rawmk4 00_39.rawmk4 16_55.rawmk4 19_08.rawmk4 21_10.rawmk4 23_04.rawmk4 00_42.rawmk4 16_58.rawmk4 19_11.rawmk4 21_13.rawmk4 23_07.rawmk4 00_44.rawmk4 17_01.rawmk4 19_14.rawmk4 21_16.rawmk4 23_10.rawmk4 00_47.rawmk4 17_04.rawmk4 19_17.rawmk4 21_19.rawmk4 23_13.rawmk4 00_50.rawmk4 17_07.rawmk4 19_19.rawmk4 21_22.rawmk4 23_16.rawmk4 00_53.rawmk4 17_10.rawmk4 19_22.rawmk4 21_25.rawmk4 23_17.rawmk4 00_56.rawmk4 17_12.rawmk4 19_25.rawmk4 21_27.rawmk4 23_18.rawmk4 00_59.rawmk4 17_15.rawmk4 19_28.rawmk4 21_30.rawmk4 23_21.rawmk4 01_02.rawmk4 17_18.rawmk4 19_31.rawmk4 21_33.rawmk4 23_24.rawmk4 01_05.rawmk4 17_21.rawmk4 19_34.rawmk4 21_36.rawmk4 23_27.rawmk4 01_08.rawmk4 17_24.rawmk4 19_37.rawmk4 21_39.rawmk4 23_30.rawmk4 01_11.rawmk4 17_27.rawmk4 19_48.rawmk4 21_42.rawmk4 23_33.rawmk4 01_14.rawmk4 17_30.rawmk4 19_50.rawmk4 21_45.rawmk4 23_39.rawmk4 01_17.rawmk4 17_33.rawmk4 19_53.rawmk4 21_48.rawmk4 23_43.rawmk4 01_26.rawmk4 17_36.rawmk4 19_56.rawmk4 21_51.rawmk4 23_46.rawmk4 01_29.rawmk4 17_39.rawmk4 19_59.rawmk4 21_54.rawmk4 23_49.rawmk4 01_32.rawmk4 17_42.rawmk4 20_02.rawmk4 21_57.rawmk4 23_52.rawmk4 01_35.rawmk4 17_45.rawmk4 20_05.rawmk4 22_00.rawmk4 23_55.rawmk4 01_38.rawmk4 17_48.rawmk4 20_08.rawmk4 22_03.rawmk4 23_57.rawmk4 01_41.rawmk4 17_51.rawmk4 20_11.rawmk4 22_06.rawmk4 c18_20.rawmk4 01_44.rawmk4 17_54.rawmk4 20_14.rawmk4 22_09.rawmk4 c18_27.rawmk4 01_47.rawmk4 17_56.rawmk4 20_17.rawmk4 22_12.rawmk4 c18_33.rawmk4 01_50.rawmk4 17_59.rawmk4 20_20.rawmk4 22_14.rawmk4 01_53.rawmk4 18_02.rawmk4 20_23.rawmk4 22_17.rawmk4 01_56.rawmk4 18_05.rawmk4 20_26.rawmk4 22_20.rawmk4 01_59.rawmk4 18_08.rawmk4 20_29.rawmk4 22_23.rawmk4