On April 13th at approximately 19:42 PDT, our Engineers were alerted by our monitoring system to a potential issue affecting our API services. They immediately began investigating and determined that there was an issue with the memory utilization of this service, resulting in degraded performance of some of our API service components.
After further investigation, our engineers determined that the issue was related to a recent planned change in production. Remedial action was taken to restart and rollback the API service, restoring memory usage to expected levels at approximately 20:19 PDT.
To avoid recurrence of this issue, we are in the process of enhancing our existing testing protocol as well as implementing improvements to our services health checks.
Please accept our sincere apologies for the issue you encountered. We understand the disruption these cause your users and business and understand the high impact to your experience. Please know that we are working diligently to improve our systems and procedures to avoid future issues.
If you have any further questions or concerns please don't hesitate to contact us.