EVENT LOG FOR SITE BO2 The first line of each entry contains a date/time stamp & who is reporting. The most recent entry is listed first. Date Time Who ---------- ----- -------- 12/29/2008 08:55 Dave The Cascades Island exit has remained open since 0840 on 11 July, to provide an exit for sockeye trapped upstream of the UMT picket leads. The leads are still in, so most PIT-tagged fish should be diverted through the UMT to the Washington Shore ladder. 12/15/2008 07:30 Alan Manually pushed BO208350.B1 to PTAGIS via PCA without incident. 12/07/2008 09:24 Troy Manually pushed BO208342.C1. 11/25/2008 07:49 Troy Manually pushed BO208330.A1, .A2. It appears there was a DSL issue that has now been resolved. 11/19/2008 08:29 Alan No data exsist to fill the gap created by the power outage on 11/13/2008. While PC1 continued to operate on UPS power until ~9:45 (PC2 ran until ~9:15) transceiver power was out from 7:28 to 14:21. This created a gap in data of 6:53. 11/17/2008 08:36 Darren I PCA'd into the site to push the .B1 file but it had already been archived. I placed the file back into the data directory and resent it to PTAGIS. 11/13/2008 10:50 Darren According to site personnel there was a scheduled power outage at both BCC and BO2 today. The outage should only last until sometime after 13:00. 11/12/2008 15:27 scottl At a moments notice, Embarc the DSL provider informed us that they were switching over to some new equipment that would require us to reconfigure our network with the new addressing scheme. With help from Todd, this was finished at Nov 12th at 3:15 pst. The DSL modem was also upgraded to the new 655 model at absolutely no charge to PTAGIS. The password for the Sonic Wall box in the AFF network cabinet was changed to the PTAGIS remote universal PW. Hobbit reports GREEN for the entire site, no problems to report at this time. Will monitr the network while onsite to ensure the network remains stable. 11/12/2008 10:38 Don_Warf Jon Thomas reports that there will be power outages of unknown durations tomorrow at BCC and BO2. 11/05/2008 08:36 Alan The Corp inadvertently cut power to BO2 at ~10:05 PST 11/4/2008. Power was restored at ~17:28 PST 11/4/2008. The PCs continued to operate for over two hours on UPS power. The transceivers were out of service for the duration of the outage, yielding a gap in data collection of ~7:23:00. 11/04/2008 15:52 Don_Warf All connectivity to the site has been lost. We are currently investigating. 10/31/2008 19:26 scottl The site interrogation platform has been upgraded with new high performance Dell PC'S that incorporate the Win Vista business version operating system. All configurations were successful and some corrections to the configuration were done. No problems to report. 10/01/2008 15:12 Darren This message was sent to PSMFC to alert of us upcoming power switches. All, On Thursday, 2 October 2008 at approximately 0100 hours we will be performing Station Service Switching. The same equipment will be effected as is listed below. 1) Outfall Building 2) Intertie Lines #1 and #2 3) Bradford Island Service Building 4) Adult Fish Facility 5) Fish View Building 6) Visitors Observation Building 7) Pit Building @ A/B Branch If you have any questions please call the control room at ext. 2221. Thanks, Brenda 10/01/2008 07:41 troy@bay 01:HighTemp,03:HighTemp,04:HighTemp,08:HighTemp,0C:HighTemp: These are common for this time of year. 09/29/2008 12:36 Scott_Li Per Jon Rerecich All, On Wednesday, 1 October 2008 in the early morning and again in the evening we will be performing Station Service Switching. There will be power outages to the following buildings and equipment: 1) Outfall Building 2) Intertie Lines #1 and #2 3) Bradford Island Service Building 4) Adult Fish Facility 5) Fish View Building 6) Visitors Observation Building 7) Pit Building @ A/B Branch If you have any questions please call the control room at ext. 2221. Thanks, Rob Witham 09/18/2008 14:27 Darren PSMFC is on site to do some cable management and may have had the network connection briefly disconnected at the time of the upload at 12:00. I manually pushed the missing files for all the sites up to PTAGIS. 09/17/2008 07:58 darren@b 01:HighTemp,02:HighTemp,03:HighTemp,04:HighTemp,05:HighTemp,06:HighTemp,07 :HighTemp,08:HighTemp,09:HighTemp,0A:HighTemp,0B:HighTemp,0C:HighTemp,0D:H ighTemp,0E:HighTemp,0F:HighTemp,10:HighTemp: These alarms were generated by unseasonably warm weather. 09/16/2008 07:23 darren@b 01:HighTemp,02:HighTemp,03:HighTemp,04:HighTemp,05:HighTemp,06:HighTemp,07 :HighTemp,08:HighTemp,0B:HighTemp,0C:HighTemp,0E:HighTemp,0F:HighTemp: These alarms were generated by unseasonably warm tempuratures. 09/15/2008 15:08 Scott_Li The network renovation for the entire Bonneville data collection platforms has been completed. The following lists the changes and the replacement appliances that were installed. The old Black Box network cabinet was completely tore out and replaced with a new standup Black Box cabinet that will allow easier access and more room for expansion. All new appliances were installed that includes the replacement of the Watch Guard firewall with a new Sonic Wall firewall. A new managed 24 port Dell switch and new 24 port punch down panel. All the existing FO media converters were re-used along with the FO to copper phone converter. The DSL junction box was re-routed to a new, more convenient location. All cabling and connections have been labeled and are being documented. The next phase will consist of more labeling and documentation of the fiber optic runs from the AFF PIT room to all PIT tag rooms and junctions in between. 09/11/2008 11:05 PTOC_Bot The network renovation for these sites has been completed. No outstanding issues exist. The SMP office has also been reconnected to the PSMFC DSL network. 09/11/2008 10:00 scottl Performed site GMC, all transceivers were retuned and calibrated as necessary, no problems to report. 09/11/2008 07:56 troy@bay 01:HighTemp,03:HighTemp,04:HighTemp,08:HighTemp,0C:HighTemp: These alarms are normal for this time of year. 09/10/2008 19:41 Dave Site had not uploaded since queued files were pushed at noon. pcA'd in and verified that the Auto-Upload mode was selected. However, the Auto-Upload status was reported as 'Disabled' on the Device Status tab. I opened a new file to no effect. I then stopped and immediately re-started data collection, and this initiated the Upload count-down timer. I manually uploaded all accumulated files. 09/10/2008 14:06 scottl Successfully submitted delinquent data files that were in que while the network was being renovated. Re-engauged the auto upload process. 09/09/2008 09:17 Troy These sites data collection has been verified while the internet connection(s) is being reconfigured. 09/09/2008 07:08 darren@b 0C:HighTemp: Alarm noted. 09/08/2008 13:38 Alan The network equipment is going to be upgraded starting today (9/8/2008) in the AFF PIT Tag room. Network connectivity for all Bonneville interrogation sites will be down for the duration of the work. The sites will continue to collect data as normal. The outstanding data files will be submitted after the upgrade is complete. The outage is expected to last no later than Thursday morning (9/11/2008). 08/25/2008 08:08 Scott_Li All, On Monday, 25 August 2008 in the early morning and again in the evening we will be performing Station Service Switching. There will be power outages to the following buildings and equipment: 1) Outfall Building 2) Intertie Lines #1 and #2 3) Bradford Island Service Building 4) Adult Fish Facility 5) Fish View Building 6) Visitors Observation Building 7) Pit Building @ A/B Branch If you have any questions please call the control room at ext. 2221. Thanks, Brenda 08/24/2008 10:10 scottl@b 03:HighTemp,04:HighTemp,05:HighTemp,07:HighTemp,08:HighTemp,0B:HighTemp,0C :HighTemp,0E:HighTemp: Noted 08/17/2008 08:24 alan@bay 0C:HighTemp: Noted. These alarms are common this time of year. 08/16/2008 08:02 alan@bay 06:LowExcCurrent,0D:LowExcCurrent: No apparent reason for these alarms. PTAGIS Field Operations will continue to monitor. 08/16/2008 07:59 alan@bay 01:HighTemp,02:HighTemp,03:HighTemp,04:HighTemp,05:HighTemp,06:HighTemp,07 :HighTemp,08:HighTemp,09:HighTemp,0A:HighTemp,0B:HighTemp,0C:HighTemp,0D:H ighTemp,0E:HighTemp,0F:HighTemp,10:HighTemp: Noted. These alarms are common this time of year. 08/15/2008 12:52 Don_Warf It sounds like Dave Smith of Operations contacted you guys yesterday before the new 480V receptacle breaker was added near the Domestic Water Well #3? When I talked to Dave, he said that he thought it was down for around ½ hour. I can't confirm that because I had to work clearance issues around that time related to the Spillway Power Replacement job. Hopefully, we didn't cause you too much of an outage at B2CC or too much grief. On the up side, the Spillway contractor does now have access for sufficient power for his trailer. Jon Thomas 08/15/2008 08:15 alan@bay 02:HighTemp,03:HighTemp,04:HighTemp,05:HighTemp,06:HighTemp,07:HighTemp,08 :HighTemp,0B:HighTemp,0C:HighTemp,0E:HighTemp,0F:HighTemp: These alarms are normal for this time of year. 08/13/2008 08:48 alan@bay 06:LowExcCurrent: This alarm was generated by PTAGIS Field Operations personnel during a site visit. 08/12/2008 11:45 scottl Performed site GMC, all transceivers were retuned and calibrated as necessary, no problems to report. Note that due to excessive temperatures, some units required additional capacitance to be added in order to tune to 100 percent hit rate. 08/11/2008 17:00 Dave I checked the BO2 files on PC2 (created every hour) and found no additional detection data for either the outage on August 9-10 or on August 11. That is the BO2-PC2 computer, running on the UPS, continued to generate keep-alive timestamps every 15 minutes for 2-3 hours after the outage, but the transceivers were without power and so unable to detect or report any tags that may have been present during the outages. After confirming that no additional data were available, I archived some 750 files on BO2-PC2. 08/11/2008 13:47 Darren Jon Thomas called to inform us that the problem that was causing the breaker to freely trip was located and rectified. The casue was a plug with moisture in causing a fault. The cord and connector were changed and the facility is back up and running. It came back on line at 11:27 PST. I PCA'd into the site and found that the 21:00 to 00:00 file did exist but was not submitted, which puts the outage time after midnight on 8/10 - 8/11, I submitted the file but I am unable to patch any time loss. Communications were checked by submitting the file and there were no problems. PSMFC will have to monitor this PITtag building for future power outages. 08/11/2008 11:19 Darren After speaking with Jonathan Rerecich site Biologists I need to clarify the last event log entry. Although the exit is open the picketed leads are in place and all undetected PITtags traveling up the ladder at Cascade Island are being diverted over to the Washington Shore exit thus passing through the slot antennas at BO4. 08/11/2008 10:44 Darren Jon Thomas informed us that after checking the breaker feeding Cascade Island PITtag room the electrician found the breaker to be tripping freely. They are investigating the cause and may have to replace the breaker. All PITtags passing up through this ladder will not be detected at BO4. According to the #0829 weekly report from Bonneville the exit was opened to provide an exit for sockeye trapped upstream of the UMT picketed leads. I will be updating this event log with the progress of this repair. 08/11/2008 09:50 Darren The site has not loaded since the 21:00 file 8/10. PSMFC is checking with site COE electricians to reset the breaker that has probably tripped. This would make two times in the last two days. We have spoke to Jon Thomas and he stated that the electricians are going to check the breaker that is currently feeding the PITtag room at Cascade Island to determine if the breaker is weak. He also stated that it may need to be replaced. I will update this event log as soon as power has been restored and I can verify data collection and submittal. 08/10/2008 10:33 Dave Following up on Darren's discovery, I pcA'd into BO2-PC1, opened a new file, and uploaded the "A" file. No problems. I noted that the clock on PC1 is 1 minute 45 seconds slow relative to atomic time. 08/10/2008 09:28 Darren I discovered this morning that the site had not loaded since yesterday on the 09:00 load. It appears that the problem occured around 07:42 PST. I tried to contact the site biologist but was not able. I then contacted site personnel at B2J and with their assistance was able to determine that the site was without power. According to the site operator the building was placed on a temporary patch since last week and the breaker had tripped. The breaker was reset and the site was verified to have power. There was no files to patch any information and the transceivers were without power as well. PSMFC will have to aware of this power situation and will investigate next Thursday while we are on site. 08/06/2008 08:12 scottl@b 02:HighTemp,03:HighTemp,04:HighTemp,05:HighTemp,06:HighTemp,07:HighTemp,08 :HighTemp,0B:HighTemp,0C:HighTemp,0E:HighTemp,0F:HighTemp: High temp alarms are common for this site at this time of year. 08/05/2008 08:15 darren@b 03:HighTemp,04:HighTemp,08:HighTemp,0C:HighTemp: Alarms not uncommon for this time of year. PSMFC will continue to monitor for this alarm. 08/02/2008 18:08 Dave As Troy reported, there was a power outage at BO2 from just before 1:15AM (PST) until 8:02AM today, August 2. The BO208215.A1 file was not truncated, so the BO2 computer (at least the primary machine) ran on the UPS battery for at least 1.75 hours (through the switch to the BO208215.B1 file). However, none of the transceivers are battery-protected, and so there was no detection data reported during the entire 5.75-hour outage. Since the outage occurred in the middle of the night, it's doubtful that any tagged fish were present in the ladder, at least until the last hour or so. Any tagged fish that may have passed through the BO2 detectors during the outage and continued through the UMT to the Washington Shore ladder were most likely detected on the BO4 antennas. 08/02/2008 09:14 Troy John reports that the site took a hit and lost power last night a 2:14:53 PDT. They reset the circuit breakers and the site came back up. I verified both PC's and manually pushed BO208215.A1. The site powered back up at 09:02:11 PDT. There is no pittag data for that time period. 08/02/2008 08:51 Troy John of the JFF is in route to investigate why this site hasn't loaded. More when available. 07/30/2008 13:18 Don_Warf Per Jon Thomas: We took the Cascade Island PIT Tag Bldg off of power at 8:42AM this morning. We had power back to the bldg by approx. 9:10AM. So, the Contractor got his work done for the temporary power within 1/2 hr. The lights came on after the changeover, so it appears to have been done properly. We'll have other interruptions for equipment and fish bldgs in the next 2 or more months during this Spillway Power Replacement job. I'll try to give you heads ups as I get a handle on the planned various outages as they approach 07/30/2008 08:03 Don_Warf From Jon Thomas: It looks like the Cascade Island PIT Tag Bldg will be going down briefly tomorrow (7/30) for a temporary power changeover for the Spillway Power Replacement job. It will probably happen around 9AM. Hopefully, it will be down for only about ½ hour before coming back up again. I will track the time that power is off to the bldg and pass the info on to you. We will probably need to take the B2CC PIT Tag bldgs down next week for the installation of a 480V breaker in the DW3 panelboard. Hopefully, that will be brief as well. I'll give you a heads up when it is scheduled to happen and will track the outage time when it happens. Thanks again, --Jon (541) 374-4574 07/24/2008 11:20 Alan Disregard the previous pitevent. The PC2 issue was at BO1. 07/24/2008 11:10 Alan During remote access it was noticed that PC2 was generating "Unknown Communication Errors". PC1 was/is running normally. PC2 was remotely restarted via PCA and normal operation have been restored. 07/23/2008 13:03 Troy A site GMC was performed 07/23/2008. All transceivers were checked for tune and adjustments made where needed. PC1 and PC2 are 51 seconds behind atomic time. No problems to report. 07/13/2008 07:22 darren@b 03:HighTemp,04:HighTemp,05:HighTemp,08:HighTemp,0C:HighTemp: Alarms of this nature are expected this time of year. PSMFC will monitor for system performance. 07/08/2008 11:42 Alan A GMC was performed 7/8/2008. All transceivers were checked and tuned as necessary. The clocks on both PCs (~00:02:15 slow) were set to within one second of atomic time. No problems found. 07/07/2008 08:14 darren@b 07:TestTagFailure: This alarm will be addressed during a site GMC tomorrow by PSMFC personnel. 06/29/2008 09:12 scottl@b 0C:HighTemp: Typical alarm for this site at this time year. 06/17/2008 14:22 scottl The switch over to the new ISP is complete. All internal DNS entries are now pointing to the new server. Did a diagnositc test upload on all computers without errors. B2J FF system is experiencing some noise in all transcievers that cannot be tuned out, especially 04. This phenom in the past has been associated with grounding but never been proven. BO4 also has intermittent and sometime persistent elevated noise levels that also cannot be tuned out. Will talk it over and get a game plan to correct the situations or atl east minimize the effects. 06/17/2008 08:18 darren@b 05:LowExcCurrent: The alarm level and the currrent alarm are equal. This will be addressed today during a site GMC. 06/12/2008 13:51 Troy A site GMC was performed 06/12/2008. All transceivers were checked for tune and no problems were found. 06/05/2008 16:32 Alan Manually pushed BO208157.E1 to PTAGIS via PCA. 06/04/2008 11:17 Alan A GMC was performed 6/4/2008. All transceivers were checked and tuned as necessary. Both PCs clocks are 20 seconds behind atomic time, no problems found. 05/29/2008 12:15 Alan A GMC was performed 5/29/2008. All transceivers were checked and tuned as necessary. The clocks on both PCs (~1:50:00 slow) were set to within one second of atomic time. No problems found. 05/20/2008 13:34 scottl Performed site GMC, all tranceivers were tuned and TT hit rates were verified at 100 percent. No problems to report. 05/13/2008 13:27 Darren A GMC was performed today (5-13-08). All transceivers were checked for tuning, noise, and detection ability. No problems were discovered during this visit. 05/06/2008 12:56 Troy A site GMC was performed 05/06/2008. All transceivers were checked for tune and no adjustments were needed. No problems to report. 04/30/2008 13:49 Darren A site GMC was performed today (4-30-08). All transcievers were checked for tuning, noise and detection ability. No problems were discovered during this visit. 04/24/2008 12:58 Alan A GMC was performed 4/24/2008. All transceivers were checked and tuned as necessary. The clocks on both PCs (~1.5 minutes slow) were adjusted to within one second of atomic time. No problems found. 04/18/2008 13:55 scottl Performed GMC, all transceivers were tuned and calibrated as necessary. No problems to report. 04/11/2008 10:11 alan@ruf 0E:LowLithium: This was addressed during a site vist 4/9/2008. 04/09/2008 13:23 Troy A site GMC was performed 04/09/2008. All transceivers were checked for tune. The battery was removed from OE and checked and the terminals scrapped off. The battery was replaced and power was cycled. PSMFC will watch for future alarms and replace the battery if needed. No other problems to report. 04/08/2008 08:19 alan@ruf 0E:LowLithium: This alarm will be addresed on the next site visit. The alarm is only in memeory. 04/07/2008 08:29 alan@ruf 0E:LowLithium: This alarm will be addresed on the next site visit. The alarm is only in memeory. 04/06/2008 08:06 darren@r 0E:LowLithium: This alarm will be addresed on the next site visit. The alarm is only in memeory. 04/05/2008 08:31 darren@r 0E:LowLithium: Alarm will be addressed on the next site visit or via PCA. 04/04/2008 08:33 darren@r 0E:LowLithium: Alarms were generated by PSMFC personnel while performing maintenance on the site. 04/03/2008 11:55 scottl Performed GMC, all transceivers were retuned and calibrated as necessary, all xcvrs internal batteries were replaced and readers reset. No problems to report. 03/24/2008 10:46 Alan A GMC was performed 3/24/2008. All transceivers were checked and tuned as necessary. The clocks on both PCs were adjusted to within one second of atomic time, no problems found. 03/12/2008 14:37 Darren PSMFC was on site today (3-12-08) to do a GMC and to replace the UPS's on the Data Collection Platform. The UPS that was PC1 had failed last week. The shed PITtag that had drifted into antenna 0F from antenna 0D has since left the field. I tuned the transceiver and placed "unique" mode bak to "off". The file 072.O2 was sent to PTAGIS to cover the time that PC1 was offline. The PC clocks were set to within 1 second of atomic time and each other. 03/11/2008 08:16 Alan Files BO208067.S2 through BO208070.K9 were uploaded from PC2 to fill the gap created by power issues with PC1 earlier this week. 03/11/2008 07:34 Alan The PIT Tag (3D9.1BF1E83F1B) has moved from antenna 0D to antenna 0F. Reader unique has been set to "on" for transceiver 0F so as to minimize file sizes. Reader unique has been set back to "off" for transceiver 0D. PTAGIS Field Operations will continue to monitor. 03/10/2008 11:45 Troy With the help of B2J SMP personnel the computer power was removed from the UPS and plugged into the wall recpt. at ~ 11:30 PDT. I PCA'ed into the machine and everything looks to be ok. The file gaps will be covered with files from PC2. 03/09/2008 08:33 Troy Verified that PC1 is still un-available via PCA and PC2 is still up and collecting data. PSMFC will be on site early this week to look into this. 03/08/2008 21:24 Dave According to the Corps, the UMT returned to service at 1010 on 1 March. It had been OOS since Oct. 1, 2007. Fish detected at BO2 after 10AM on 1 March should also be detected at BO4 if they continue to ascend the fishway. 03/08/2008 11:13 Troy Site personnel checked in on PC1 and found a red light on the UPS with a message replace battery. Pushed the reset button and the PC came up. I however cannot PCA in. PSMFC will be on site early next week to resolve this problem. PC2 will be checked periodically to ensure that it is still up and collecting data. 03/08/2008 09:08 Troy Checking into why this site is not loading. Unable to PCA into the machine. Verified that PC2 is up and running. More news when available. 03/07/2008 07:25 Alan A PIT Tag (3D9.1BF1E83F1B)is apparently stuck in the field near antenna 0D. Reader unique has been set to "on" for transceiver 0D so as to minimize file sizes. PTAGIS Field Operations will continue to monitor. 03/04/2008 07:53 troy@ruf 0F:LowExcCurrent: The alarm threshold was adjusted yesterday. 03/03/2008 14:05 Troy OF's low exciter current alarm threshold was lowered for 3400 to 3100 as the transciever tuned up to 3.4. 03/03/2008 07:16 darren@r 0F:LowExcCurrent: Alarm will be addressed today during a site GMC. 03/02/2008 08:05 darren@r 01:LowExcCurrent,05:LowExcCurrent,0B:LowExcCurrent,0D:LowExcCurrent,0F:Low ExcCurrent: These alarms will be addressed on Monday during a site GMC. 02/28/2008 07:08 darren@r 01:LowExcCurrent,0F:LowExcCurrent: A site GMC was performed on Tuesday 2- 27-08 by PSMFC. These alarms were cleared by PSMFC personnel. 02/28/2008 07:05 Scott_Li Performed site GMC on 2/28, no problems to report. 01/08/2008 11:03 Darren A site GMC was performed today 1/8/08. All transceivers were checked for tuning, noise and detection ability. No problems were found. 01/01/2008 00:00 PTOC_Bot Annual log file initiation for BO2 #### End of Event Log for BO2 ###