Google Cloud MAJOR

Cloud Customers may experience minimal service disruption in us-east5-c

March 28, 2024 · 05:48 PM UTC – 09:20 PM UTC · Duration: 3h 32min

Affected Services

Virtual Private Cloud (VPC)Google Compute EngineGoogle Kubernetes EnginePersistent DiskGoogle Cloud Networking

Timeline

07:52 PM
Summary: Cloud Customers may experience minimal service disruption in us-east5-c Description: The issue with Google Compute Engine, Persistent Disk, Virtual Private Cloud (VPC) and Google Kubernetes Engine is believed to be affecting a very small number of projects and our Engineering Team has taken appropriate measures to mitigate the issue and are continuing to closely monitor the environment. If you have questions or are impacted, please open a case with the Support Team and we will work with you until this issue is resolved. No further updates will be provided here. We thank you for your patience while we're working on resolving the issue.
07:13 PM
Summary: Cloud Customers may experience minimal service disruption in us-east5-c Description: We are experiencing an issue with Google Compute Engine, Persistent Disk, and Google Kubernetes Engine. The maintenance activity in us-east5-c is now complete and telemetry is not showing any visible impact. Our engineers are continuing to monitor and full mitigation is expected to complete by Thursday, 2024-03-28 12:45 US/Pacific. We will provide an update by Thursday, 2024-03-28 11:45 US/Pacific with current details. Diagnosis: Customers may experience increased latency or packet loss. TPU instances may experience network performance degradation. Newly created VMs will be served via other zones in the us-east5 region. Existing workload should not be impacted. The impact may be limited to a fraction of ingress, egress, and VM-to-VM traffic. Workaround: Customers can use other zones without impact at this time.
06:34 PM
Summary: Cloud Customers may experience minimal service disruption in us-east5-c Description: We are experiencing an issue with Google Compute Engine, Persistent Disk, and Google Kubernetes Engine. Our engineers are working on performing maintenance in the us-east5-c zone to minimize impact. We will provide an update by Thursday, 2024-03-28 11:05 US/Pacific with current details. Diagnosis: Customers may experience increased latency or packet loss. Newly created VMs will be served via other zones in the us-east5 region. The current impact is limited to existing VMs where they may experience elevated network latencies and packet loss. Existing workload should not be impacted. The impact should be limited to VM-to-VM traffic. Workaround: None at this time.