Google Cloud CRITICAL

Cloud SQL Create Operations Failing Globally

March 3, 2023 · 07:18 PM UTC – 08:45 PM UTC · Duration: 1h 27min

Affected Services

Google Cloud SQL

Timeline

05:00 PM
Mini Incident Report We apologize for the inconvenience this service disruption/outage may have caused. We would like to provide some information about this incident below. Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Cloud Support using https://cloud.google.com/support. (All Times US/Pacific) Incident Start: 3 March 2023 11:18 Incident End: 3 March 2023 12:45 Duration: 1 hour, 27 minutes Affected Services and Features: CloudSQL- Create operations failing with ERROR_SN_CREATE_SUBNETWORK_FAILURE Regions/Zones: Global Description: Google Cloud SQL customers failed to create instances for a duration of 1 hour, 27 minutes. From preliminary analysis, the root cause of the issue is a backlog of queue processing which increased memory usage. Customer Impact: Affected customers experienced Create operation failures with the error code:ERROR_SN_CREATE_SUBNETWORK_FAILURE and debug information contained the error `Failed to create subnetwork. An internal exception occurred.’
09:13 PM
The issue with Google Cloud SQL has been resolved for all affected projects as of Friday, 2023-03-03 13:07 US/Pacific. We thank you for your patience while we worked on resolving the issue.
09:04 PM
Summary: Cloud SQL Create Operations Failing Globally Description: Mitigation work is currently underway by our engineering team. We do not have an ETA for mitigation at this point. We will provide more information by Friday, 2023-03-03 13:30 US/Pacific. Diagnosis: Cloud SQL Create Operations Failing Globally Workaround: None at this time.
08:49 PM
Summary: Cloud SQL Create Operations Failing Globally Description: We've received a report of an issue with Google Cloud SQL as of Friday, 2023-03-03 12:20 US/Pacific. We will provide more information by Friday, 2023-03-03 13:20 US/Pacific. Diagnosis: Cloud SQL Create Operations Failing Globally Workaround: None at this time.