Kategori: Driftinfo

Our fiber provider Stokab has announced service maintenance to expand capacity for KN6 / KK Hammarby .

We’re investigating how it will affect services and how we will re-route traffic.
Our datacenter providers have multiple fiber runs, and so do we.
So we will plan accordingly and update this information as soon as we can.

If necessary, we will migrate critical services to our secondary site prior to the maintenance work.

Each fiber connection should only be affected once.

——————-

Support Information from Stokab
Rebuilding of KN6 site and KK Hammarby
Stokabs site KN6/KK Hammarby will soon be rebuilt in order to increase capacity. Those of you receiving this information will, in one way or another, be affected by this move.

The rebuild will be carried out in several stages within Stokabs service windows starting at the middle of October 2017.

Stage 1
In Stage 1 fibre connections will be redirected and customers will be notified in advance. Fibre connections will be redirected during several service windows but any specific connection will only be affected during one of the service windows.

Stage 2
During Stage 2 cables containing fibre connections that were not redirected in Stage 1 will be re-spliced. All cables will be clipped and spliced during the same service window from 00:00-07:00.

These fibre connections will only be affected by one outage, so if your connections were already redirected then you will not be affected by Stage 2.

The timeline for Stage 2 has not yet been decided but the preliminary date is set to December 2, 2017.

All affected customers will be notified by email according to normal procedures.

Sincerely yours,
Stokab Driftavdelning/Customer Networks Operations
”

00:00 – 01:00 utförs underhåll på Smallfoot .
Tjänster är åter igång så fort underhållet slutförs.

We’re investigating a shorter traffic dip at our upstream provider in Västberga Datacenter between 18:31 and 18:37.

BGP has rerouted to different traffic path.

Traffic was impacted when an unplanned reboot of a switch occured.

When: 21.15 – 21.30 (partial network issue) – VÄSTBERGA DC
When: 21.30 – 21.45 (rebooting core network caused extended traffic outage) – HAMMARBY / VÄSTBERGA DC

We apologize for the inconvenience. We are investigating the cause of the switch reboot.

Due to a general fault in the cooling equipment at internet exchange KN7.
Adminor will proactively failover our equipment to secondary network path.

This is to ensure that we can safely bring our equipment to power down status without causing unecessary service disruptions.

Update: At 00.00 Stokab suffered a failiure to their cooling equipment / VVS.
At 01.00 Adminor was notified of exceeded temperatures in our equipment. Customer traffic was re-routed to have minimal impact on connections.
At 02.20 Adminor was on-site to handle our equipment while sub-contractor worked on resolving the fault of the cooling equipment.
At 04.50 the systems were restored .

We will move customer traffic back to primary path at an emergency service window during out of office hours.

 

On 2017-04-30 between 01.00 – 05.00 Adminor will perform routine maintenance.
Your VPS / VM on our cluster in Stockholm will be rebooted and powered off for a couple of minutes.

At 21:58 a core switch at KN7 restarted to recover from an error state.
The switch failed over to secondary network. Causing intermittent connectivity issues between HY and VB datacenters. At 22:05 the switch had recovered.

We’re continuing to investigate the cause of the restart.

Update: The maintenance work was performed successfully.
We also managed to squeeze in our maintenance work scheduled for 2017-03-25 00:00 – 06:00 during this service window. This means we can cancel the service job and await STOKAB to complete theirs.

 

We’ll be performing urgent router maintenance tonight starting from 01.00 to coincide with some other big networks performing similar updates.
The upgrade is to ensure the routing plane receives an important update for BGP / routing that requires a reboot of our CISCO routers.

We’ll standby to reboot the primary router as well if we notice no issues on the backup/secondary router.
This will cause a disruption of a couple of minutes until all BGP announcements have updated.
Affected network: 46.253.192.0/20 ( 46.253.192.0 – 46.253.207.255)

We apologize for the inconvenience. This service job is unrelated to the planned maintenance 25/3 .

For full L3 redundancy we also offer IPs in multiple location/routers. Please contact us if you need IPv4 assignment for dual-homing of your own services.

We’d like to remind customers that on the night of 23rd March, there may be some service disruption to Adminors telephony number as we switch provider.
The backup number that has previously been sent out may be used in that case.

SRX617031793313519ID  – OLSRV.EXOO.EU.00.EN.WIP.BCH.TS.T01.POD.ST.EM@css.one.microsoft.com
Some customers are experiencing delay with Microsoft Online Protection services according to Microsoft.

————–

13:30 We’ve been informed by Microsoft that they are working on this issue.
23:00  Email delivery has resumed to some affected networks as seen by test emails.
Adminor continues to monitor this situation and will update this advisory if Microsoft changes their status.