Bottiger

Administrator
The fiber was cut to our server in NY. It is back up now but with limited connectivity.

Here is what the host has said.

Internap is having some sort of serious network problem in New York, causing a total loss of connectivity for our services there. They had this same type of problem approximately one hour ago, as well, for about 5 minutes.

We are still awaiting an update from Internap on what happened an hour ago and what is happening again now (presumably they are related).

Update @ 12:20pm EST: We continue to wait for Internap to resolve the problem in their New York market. They have told us that there is currently no estimated time to repair, as they don't yet know what is going on.

Update @ 12:49pm EST: Internap has now told us now that this is due to an outage within their physical fiber provider.

It usually takes hours, at minimum, to repair fiber cuts, because so much work is required to locate the problem and have a team perform the splicing. Internap says it is exploring other options in the meantime, but we do not expect a quick resolution.

Update @ 2:28pm EST: At 1:37pm EST, Internap was able to bring their facility back online through an alternate fiber link, restoring full connectivity to our services. Internap is continuing to work with their fiber vendor to bring the original fiber back online and restore redundancy.

Update @ 4:54pm EST: We're seeing packet loss occurring within Internap's network in NYC. This is likely due to their temporarily reduced capacity in this market, combined with increased traffic as we enter peak hours. We are asking Internap for another update.
 

Bottiger

Administrator
The host has said the fiber will be repaired tomorow Tuesday the 24th, at 2PM EST.

Update @ 12:21am EST: Internap continues to struggle at times in NYC and we have seen two periods of heavy packet loss in the last few hours.

We're told that the current estimate for a repair of their original fiber is 2pm EST later today (1/24).
 

Bottiger

Administrator
The connection will be repaired around 10-12 pm est.

Internap's fiber provider has told them that it has fixed the fiber path feeding the facility in NYC. Internap plans to test and re-integrate the fiber between 10pm and midnight tonight. This may lead to one or more brief disconnection events or periods of increased latency.