From bob at tink.com Sat Nov 4 07:48:01 2017 From: bob at tink.com (Bob Tinkelman) Date: Sat, 04 Nov 2017 07:48:01 -0400 (EDT) Subject: [ispnet-announce] Maintenance announcement: Saturday, Nov 4, 08:30-09:30 Eastern In-Reply-To: "My own message dated Tue, 31 Oct 2017 05:04:19 -0400" Message-ID: <01QL2QGDZBX88X7I28@queens.tink.com> This scheduled maintenance work will begin shortly. I'll post another note on completion. - Bob > On Saturday morning (Nov 4, 08:30-09:30 ET) Telehouse will be performing > maintenance that will involve it shutting down one of the two power feeds > to each of the ISPnet cabinets at 85 Tenth Ave, New York, NY, the location > of ISPnet's nycsnyoo.ispnet.net POP. > Each cabinet has power from two circuits that are connected to an Automatic > Transfer Switch (ATS) designed to continue providing power to the equipment > in the cabinet as long os good power is being received on either of its > input circuits. > If all the ATSes work as designed, there will be no interruption to any > customer traffic. > If an ATS does not, then some or all the equipment in the associated > cabinet may reboot. > If you are an ISPnet customer and if a problem occurs, the effects will > vary depending on how your service is provided. > If you have equipment located at one of ISPnet's other POPs, or if your > service is provided via a data circuit to one of ISPnet's other POPs, then > at most you should see a brief period of routing instability as routing > from your POP to the rest of the Internet adjusts to use different paths. > If you have equipment located in an ISPnet-provided cabinet at 85 Tenth, > then your equipment may reboot. > If your service is provided through the nycsnyoo.ispnet.net POP at 85 Tenth > (either via a data circuit or a local cross-connect) then there could be a > service interruption if your connection is terminated on an ISPnet switch > that reboots. We'd estimate that any such service interruptions would last > at most 10-15 minutes. > ISPnet and Telehouse will have staff on-site to address any problems that > may arise. > Please contact ISPnet if you have any questions or requests for assistance > in preparation for Saturday's scheduled work. From bob at tink.com Sat Nov 4 08:23:07 2017 From: bob at tink.com (Bob Tinkelman) Date: Sat, 04 Nov 2017 08:23:07 -0400 (EDT) Subject: [ispnet-announce] Maintenance announcement: Saturday, Nov 4, 08:30-09:30 Eastern In-Reply-To: "My own message dated Tue, 31 Oct 2017 05:04:19 -0400" Message-ID: <01QL2RTDUF688X7I28@queens.tink.com> We have shut down one of the two redundant power feeds to each of ISPnet's 4 affected cabinets at 85 Tenth in preparation for Telehouse's 08:30-09:30 maintenance window. Our per-cabinet Automatic Transfer Switches worked as designed; no equipment lost power; there were no customer-visible effects. However, we are now operating without redundant power and will continue to do so until the end of Telehouse's maintenance window. I'll send another email when things are back to normal. - Bob > On Saturday morning (Nov 4, 08:30-09:30 ET) Telehouse will be performing > maintenance that will involve it shutting down one of the two power feeds > to each of the ISPnet cabinets at 85 Tenth Ave, New York, NY, the location > of ISPnet's nycsnyoo.ispnet.net POP. > Each cabinet has power from two circuits that are connected to an Automatic > Transfer Switch (ATS) designed to continue providing power to the equipment > in the cabinet as long os good power is being received on either of its > input circuits. > If all the ATSes work as designed, there will be no interruption to any > customer traffic. > If an ATS does not, then some or all the equipment in the associated > cabinet may reboot. > If you are an ISPnet customer and if a problem occurs, the effects will > vary depending on how your service is provided. > If you have equipment located at one of ISPnet's other POPs, or if your > service is provided via a data circuit to one of ISPnet's other POPs, then > at most you should see a brief period of routing instability as routing > from your POP to the rest of the Internet adjusts to use different paths. > If you have equipment located in an ISPnet-provided cabinet at 85 Tenth, > then your equipment may reboot. > If your service is provided through the nycsnyoo.ispnet.net POP at 85 Tenth > (either via a data circuit or a local cross-connect) then there could be a > service interruption if your connection is terminated on an ISPnet switch > that reboots. We'd estimate that any such service interruptions would last > at most 10-15 minutes. > ISPnet and Telehouse will have staff on-site to address any problems that > may arise. > Please contact ISPnet if you have any questions or requests for assistance > in preparation for Saturday's scheduled work. From bob at tink.com Sat Nov 4 09:01:46 2017 From: bob at tink.com (Bob Tinkelman) Date: Sat, 04 Nov 2017 09:01:46 -0400 (EDT) Subject: [ispnet-announce] Maintenance announcement: Saturday, Nov 4, 08:30-09:30 Eastern In-Reply-To: "My own message dated Sat, 04 Nov 2017 08:23:07 -0400 (EDT)" <01QL2RTDUF688X7I28@queens.tink.com> References: Message-ID: <01QL2T10FT428X7I28@queens.tink.com> Normal redundant power has been restored to all cabinets. All work on this maintenance window has been completed. All work went as expected with no customer-visible effects. - Bob > We have shut down one of the two redundant power feeds to each of > ISPnet's 4 affected cabinets at 85 Tenth in preparation for > Telehouse's 08:30-09:30 maintenance window. > Our per-cabinet Automatic Transfer Switches worked as designed; > no equipment lost power; there were no customer-visible effects. > However, we are now operating without redundant power and will > continue to do so until the end of Telehouse's maintenance > window. > I'll send another email when things are back to normal. > - Bob > > On Saturday morning (Nov 4, 08:30-09:30 ET) Telehouse will be performing > > maintenance that will involve it shutting down one of the two power feeds > > to each of the ISPnet cabinets at 85 Tenth Ave, New York, NY, the location > > of ISPnet's nycsnyoo.ispnet.net POP. > > Each cabinet has power from two circuits that are connected to an Automatic > > Transfer Switch (ATS) designed to continue providing power to the equipment > > in the cabinet as long os good power is being received on either of its > > input circuits. > > If all the ATSes work as designed, there will be no interruption to any > > customer traffic. > > If an ATS does not, then some or all the equipment in the associated > > cabinet may reboot. > > If you are an ISPnet customer and if a problem occurs, the effects will > > vary depending on how your service is provided. > > If you have equipment located at one of ISPnet's other POPs, or if your > > service is provided via a data circuit to one of ISPnet's other POPs, then > > at most you should see a brief period of routing instability as routing > > from your POP to the rest of the Internet adjusts to use different paths. > > If you have equipment located in an ISPnet-provided cabinet at 85 Tenth, > > then your equipment may reboot. > > If your service is provided through the nycsnyoo.ispnet.net POP at 85 Tenth > > (either via a data circuit or a local cross-connect) then there could be a > > service interruption if your connection is terminated on an ISPnet switch > > that reboots. We'd estimate that any such service interruptions would last > > at most 10-15 minutes. > > ISPnet and Telehouse will have staff on-site to address any problems that > > may arise. > > Please contact ISPnet if you have any questions or requests for assistance > > in preparation for Saturday's scheduled work.