On August 8, 2022 at approximately 11:07 UTC, we identified an issue with the network in our Netherlands data center. As a result, all workspaces and integration jobs hosted within this data center were unavailable. Initial findings suggested a possible issue at the firewall. In the first instance, we failed over to the other firewall and reviewed the route configuration; however, the issue persisted.
We engaged the vendors of the network hardware for further assistance. We identified a pair of upstream switches experiencing issues that caused a split brain condition. That issue resulted in the switches not forwarding traffic correctly. The split brain condition ultimately prompted one of the switches to reboot. The proper movement of traffic then resumed which resolved the incident.
To avoid a reoccurrence of this issue, we are working with the vendor to upgrade the switch firmware. We have scheduled a full hardware review to identify whether any physical factors may have contributed to the incident. If we encounter any issues, we will take immediate steps to remediate them. We have also enhanced our switch monitoring to provide further insight into device health.
We deeply apologize for the impact this had on your business operations. We understand the disruption these issues can cause to your business and users, and we are continuously strengthening our systems and procedures to avoid similar issues from happening again in the future.
If you have any further questions or concerns, please contact support@anaplan.com. Thank you for your patience during this situation and thank you for being an Anaplan customer.