We are investigating an issue with Google Cloud Networking.

Mini Incident Report We apologize for the inconvenience this service disruption/outage may have caused. We would like to provide some information about this incident below. Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Cloud Support using https://cloud.google.com/support or to Google Workspace Support using help article https://support.google.com/a/answer/1047213. (All Times US/Pacific) Incident Start: 5 May 2023 12:02 Incident End: 5 May 2023 12:58 Duration: 56 minutes Affected Services and Features: Gmail, Google Cloud Networking Regions/Zones: Multi Region Europe Description: Multiple Google services, including GCP and Workspace, experienced an outage for a duration of up to 56 minutes in and around Spain/Morocco. From preliminary analysis, the root cause of the issue was a Google initiated network routing change at the edge of our network there. The issue was mitigated at 12:58 by removing the problematic routers from service, forcing traffic to use other paths. Customer Impact: GCP Google Cloud Networking experienced a full outage for all internet service providers (ISPs) connected to two peering routers in Madrid, Spain. All GCP services were unavailable for users reaching GCP from impacted ISP(s) until mitigation in and around Spain/Morocco. Workspace Some Gmail customers had delivery delays and availability issues during the outage in Spain. If your service or application was affected, we apologize — this is not the level of quality and reliability we strive to offer you, and we have taken and are taking immediate steps to improve the platform’s performance and availability.

The issue with Google Cloud Networking has been resolved for all affected users as of Friday, 2023-05-05 12:58 US/Pacific. We thank you for your patience while we worked on resolving the issue.

We are experiencing an issue with Google Cloud Networking beginning at Friday, 2023-05-05 12:02 US/Pacific. Our engineering team continues to investigate the issue. We will provide an update by Friday, 2023-05-05 12:30 US/Pacific with current details. We apologize to all who are affected by the disruption.