Cybera Network Status Page:
Outage and Maintance History:
Subject: Connectivity issue in Edmonton via Hurricane Electric – Resolved
Category: Network failure
Start time: 2020-05-05 06:26pm Local time.
After monitoring for several hours, our upstream provider connection (Hurricane Electric) in Edmonton is looking stable now. We have confirmed with the provider that the issue has been resolved on their end.
Hurricane Electric has now confirmed that the issue was a software defect, which caused routes to not be learned/reannounced properly. They have stated: "We were able to clear the broken state and have a case opened with our vendor to get a bug fix."
Cybera has now re-routed internet traffic back to Edmonton from Calgary for our Edmonton members.
Please reach out to us at noc@cybera if you are still experiencing an issue after the maintenance window.
NOTE: This activity will not impact Calgary Members.
Subject: Connectivity issue in Edmonton via Hurricane Electric – Update
Category: Network failure
Start time: 2020-05-05 02:42pm Local time.
Hurricane Electric has confirmed that there was an issue with their equipment that is affecting the network. As a result, Cybera has redirected member transit from Edmonton to Calgary.
We will continue monitoring and if all looks good, we will revert the redirection later today.
Subject: Connectivity issue in Edmonton via Hurricane Electric
Category: Network failure
Start time: 2020-05-05 01:23pm Local time.
At the moment, we are having an upstream provider issue with Hurricane Electric in Edmonton.
Members in the Calgary region are not impacted by this issue.
We are investigating and will update members shortly.
Subject: Latency issue in Edmonton Region Client Connected via Supernet
Category: Latency Issues
The service in the Edmonton region has been restored by AXIA.
The root cause of the issue was AXIA making a capacity change to their link. Their technical team has now reverted that change, and will run further analysis.
Please contact network@cybera.ca or 403.536.0880 if you have any questions.
Subject: Edmonton SuperNet disruption
Category: Latency Issues
We are experiencing latency issues in the Edmonton region for members connected via SuperNet. We are working with the SuperNet team to resolve this issue as quickly as possible.
We will keep you informed about our progress. If you have any immediate questions, you can reach us at network@cybera.ca or 403.536.0880.
Category: Maintenance
Planned Start Time: Friday, May 17, 2019, 21:00 MDT
Planned End Time: Friday, May 17, 2019, 24:00 MDT
Cybera will be performing maintenance on its Edmonton router. Members should expect a few short duration outages (15 minutes) during the maintenance window.
Contact: Please contact the Cybera Network Operations Center at NOC@cybera.ca or (403) 536-0880 when network problems are experienced outside of a maintenance window.
Category: Maintenance
Planned Start Time: Wednesday, May 1, 2019, 19:00 MDT
Planned End Time: Wednesday, May 1, 2019, 21:00 MDT
Anticipated outage duration: This maintenance work will result in three to four, 15 minutes or less outages during the time frame indicated above.
As a follow up to today’s outage, we require an emergency maintenance window later tonight that will result in a few short duration outages as we resolve a related outstanding configuration issue.
Early findings: The outage today was caused by a Routing Engine failure on our Edmonton router and a related software issue that compounded the outage duration. We are working on a full post mortem for this incident and will share our findings at a later time.
Contact: Please contact the Cybera Network Operations Center at NOC@cybera.ca or (403) 536-0880 when network problems are experienced outside of a maintenance window.
Subject: Unscheduled network outage.
Category: Network outage update
Please note that Cybera experienced a network outage today starting at 11:42. We are still investigating the scope and root cause of this outage. We are now investigating a hardware issue with our Edmonton Router and are working with the equipment vendor.
All IBG members as well as the VFS members who had redundancy configured have been redirected to Calgary. We are still investigating and will send periodic updates throughout the day.
Contact: Please contact the Cybera Network Operations Center at NOC@cybera.ca or (403) 536 -0880 when network problems are experienced outside of a maintenance window.
On Friday March 8, Cybera experienced an outage that impacted several of our members.
On Friday at 4:50 pm we began maintenance work on the DWDM in Edmonton to reset a backup power supply. This work was successfully completed by 5:00 pm. Shortly after (at 5:10 pm), we started receiving alerts notifying us that the DWDM was down. The main and backup power supplies failed, impacting members in Edmonton without regional redundancy. Peering, IBG (Internet Buying Group), VFS (Virtual Firewall Service), and shared hardware firewall services became unavailable to them. This outage continued until we were able to find and install a working power supply at 7:45 pm.
Once the DWDM came back online, the Peering and IBG services were restored for all members. Unfortunately, the DWDM outage triggered another failure. This impacted the affected firewalls, and spread to include the previously working VFS firewalls across both regions. After several hours of debugging, we determined there was a Layer 2 spanning tree loop issue. By 2:00 am on Saturday, the issue was resolved for many of our members.
We did not realize that, at that time, the Calgary region was experiencing similar issues. Later Saturday morning, some of our VFS members in Calgary let us know they were having issues (thank-you!). A review of the symptoms showed the same problems that Edmonton had experienced, and we were able to similarly resolve the issue by 10:00 am Saturday morning.
Two schools, one in Edmonton and one in Calgary, continued to have firewall issues. Our team worked with them throughout the day to debug, and were able to resolve their issues by late afternoon.
We are compiling a list of lessons learned which we will be reviewing next week. Once we’ve determined our next steps and how we will improve our procedures going forward, we will share that information with our members.
Category: Network failure
Start Time: 2019-03-08 05:06pm Local time.
End Time: 2019-03-08 07:45pm Local time.
Status update:
Service via Edmonton DWDM is restored. It was found out that the DWDM power supply failed and replacement is done.
Category: Network failure
Start Time: 2019-03-08 05:06 Local time.
End Time: No ETA
Status update:
We are experiencing issue with our DWDM equipment in Edmonton and some customer connections which don't have redundancy via Calgary are affected. We will send status update as we get more information.
—
Category: Google Services
Start Time: 2017-03-17 8:00 am Local time. (Friday)
End Time: 2017-03-17 4:00 pm Local times.
Anticipated outage duration: No Outage
During the time frame indicated above, CYBERA will be adding a redundant connection to Google Services at YYCIX ( Calgary) Internet Exchange. During the above outage window we do not expect any outage for Google Services, but if you experience any problem related to Google, please contact us via phone or email provided here.
Please contact the Cybera Network Operations Centre at network@cybera.ca or (403) 536-0880.
Category: Calgary Supernet Maintenance
Start Time: 2017-03-11 18:00 Local time. (Saturday)
End Time: 2017-03-11 18:30
Anticipated outage duration: 10 minutes
During the time frame indicated above, SHAW will be performing maintenance on the Cybera to Supernet connection in Calgary. The outage duration should be less than the total duration of the reserved maintenance window and could include several small durations outages while maintenance is being done. Members connected via Edmonton PoP will not be affected.
Contact: Please contact the Cybera Network Operations Center at NOC@cybera.ca or (403) 536-0880 when network problems are experienced outside of a maintenance window. All outages, scheduled or not are posted here:
Category: EDMONTON router maintenance
Start Time: 2017-03-08 21:30 Local time. (Wednesday evening)
End Time: 2017-03-08 21:45
Anticipated Outage Duration: 15 minutes or less
During the time frame indicated above, Cybera will be performing maintenance on one of its virtual core router in Edmonton. The outage duration should be less than the total duration of the reserved maintenance window and could include several small durations outages while maintenance is being done.
Contact: Please contact the Cybera Network Operations Center or (403) 536-0880 when network problems are experienced outside of a maintenance window. All outages, scheduled or not are posted here.
Category: Calgary Supernet Maintenance
AXIA Change Ticket # CA0001322541
Start Time: 2017-02-08 00:01 Local time. (Wednesday)
End Time: 2017-02-08 06:00
Anticipated Outage Duration: 5 minutes
During the time frame indicated above, Axia/Supernet will be performing maintenance at the Calgary PoP. The outage duration should be less than the total duration of the reserved maintenance window and could include several small durations outages while maintenance is being done.
Contact: Please contact the Cybera Network Operations Center at NOC@cybera.ca or (403) 536-0880 when network problems are experienced outside of a maintenance window.