‹ Jul–Sep 2021 ›
September 2021
Network issue - Resolved

We have identified the google DNS is not able to resolve. We are checking it further with our engineers and update on the same.

  • all services are back to normal and outbound issues to google were resolved. --2:10 PM IST 17 Sep 2021

  • The google DNS issue is resolved. There was an issue at NIXI Delhi which has been fixed by NIXI.

    • Partial Outage - Block storage Zero Updates

    Maintenance activity on Block storage is completed. New Block storage can be launch from myaccount portal. Please reach out to cloud-platform@e2enetworks.com if any issue faced while creating the new Block Storage.

    Partial Outage - Block storage

    Block storage service currently under maintenace. New Block storage won't be able to create from myaccount portal. We are investigating reports and keep updated on the same.

    Deployment - EOS | Resolved

    The EOS deployment is completed. Please reach out to cloud-platform@e2enetworks.com

    Deployment - EOS

    We are undergoing maintenance activity for EOS services at 5.45 PM The operations on EOS from myaccount portal will be affected during the deployment. However, there won't be any effect on all direct operations

    Partial Outage - EOS

    We are investigating reports of access issues with EOS and are investigating this - The issue being diagnosed is of errors in uploading new objects. At the same time, existing objects were accessible 12:00 PM September 1 2021

  • The cluster has been stable after the fix and no recurrence of any upload issues on the EOS have been observed

    • September 1st 1:00 PM

  • The cluster has been stable for the last 12 hours and the fixes are made persistent

  • We had an issue in one of our EOS clusters where the cluster was slow in syncing. This led to errors in traffic to those particular nodes. We have deployed a temporary fix to speed up the sync...

    We are also optimising this further to ensure no recurrence of the issue and prioritising sync process IO to eliminate errors. We are currently monitoring the cluster after the fix and its working normally as expected.

    12:30 PM September 1 2021

    • August 2021
    Partial Network Outage - Resolved
    1. INCIDENT DETAILS:

    A. Observations The E2E’s monitoring team received lots of servers unreachable alerts.

    B. Immediate Actions Taken ( * ) • What action we have taken to identify the reported issue? Monitoring team immediately checked the alerts detail and identify that the issue with the selected pools. Therefore they immediately reported the issue to the network team. Network team verify all switches status and logs and did not find any internal issue in the network and reported the same issue to ISP team.

    1. ANALYSIS & ROOT CAUSE: ISP Team confirmed they are observing drop in the traffic and checking it further. They identify the issue with one of the ISP and opened a ticket with them. The identified ISP team confirmed the internal outage from their side and they will be sharing the final RCA in next 1-2 days.

    2. Actions Taken to Resolve the Issue: We have manually disabled the identified ISP in our network therefore all the traffic automatically shifted to another ISP and confirmed from the customers that issue is resolved for them post disabling the ISP in the network.

    Partial Network Outage

    The issues have been resolved by shifting the link to the alternate links and the traffic is normal.

    Partial Network Outage

    There is an outage on one of the redundant upstream ISP links and traffic is being switched to an alternate link

    Partial Network Outage - Resolved
    1. INCIDENT DETAILS:

    A. Observations The E2E’s monitoring team received lots of servers unreachable alerts.

    B. Immediate Actions Taken ( * ) • What action we have taken to identify the reported issue? Monitoring team immediately checked the alerts detail and identify that the issue with the selected pools. Therefore they immediately reported the issue to the network team. Network team verify all switches status and logs, we observed the high DDoS alert on one of our network.

    1. ANALYSIS & ROOT CAUSE: Soon after the issue was observed, the incoming traffic was mitigated on our network.

    2. Actions Taken to Resolve the Issue: We have manually disabled the network of the relevant server in our network therefore all the traffic started to functional normally.

    Partial Network Outage

    The relevant server traffic which was causing DDoS suspended in our network.

    Partial Network Outage

    There was an high incoming DDoS on one of the server.

    Partial Network Outage

    We are investigating reports of a network issue and are currently diagnosing this.

    July 2021
    Partial Network Outage - Resolved
    1. INCIDENT DETAILS:

    A. Observations The E2E’s monitoring team received lots of servers unreachable alerts.

    B. Immediate Actions Taken ( * ) • What action we have taken to identify the reported issue? Monitoring team immediately checked the alerts detail and identify that the issue with the selected pools. Therefore they immediately reported the issue to the network team. Network team verify all switches status and logs and did not find any internal issue in the network and reported the same issue to ISP team.

    1. ANALYSIS & ROOT CAUSE: ISP Team confirmed they are observing drop in the traffic and checking it further. They identify the issue with one of the ISP and opened a ticket with them. The identified ISP team confirmed the internal outage from their side.

    2. Actions Taken to Resolve the Issue: ISP have suspended / blocked the network in the network therefore all the started to respond normally once ISP took the action from their end.

    Partial Network Outage

    The relevant server traffic which was causing high DDoS attack on the network was suspended by the ISP.

    Partial Network Outage

    There was an high incoming DDoS traffic alert observed in ISP level.

    Maintenance activity on myaccount portal

    Maintenance activity is completed. Myaccount is operational now. In case of any issue, please reach out to our cloud team by sending an email to cloud-platform@e2enetworks.com

    We are performing an emergency maintenance activity in backend starting from 10:00 PM to 11:00 PM dated 27th June 2021

    Myaccount based operations like creation of new nodes/appliances, stop/start of nodes etc. will be affected during the period of maintenance. However, there won't be any affect on any of the existing customer servers/appliances/services. Thank you for your understanding.