This incident has been resolved.

A fix has been implemented and we are monitoring the results.

We are seeing severe latency and timeouts during a rollback of the API servers. We are currently investigating the issue.

We are continuing to investigate this issue.

Starting about 15 minutes ago, we've seen an increase in API errors and latency. We're investigating and implementing some possible mitigations now.