Google Cloud MAJOR

US Multi-Regions: Cloud Logging experiencing elevated error rate while reading logs. Mitigation underway.

October 20, 2021 · 12:19 AM UTC – 10:00 AM UTC · Duration: 9h 41min

Affected Services

OperationsCloud Logging

Timeline

12:09 AM
Please refer to the following for the mini incident report: https://status.cloud.google.com/incidents/m617oqASdckYoegRtPJr
10:00 AM
The issue with Cloud Logging has been resolved for all affected users as of Tuesday, 2021-10-19 18:17:58 US/Pacific. We thank you for your patience while we worked on resolving the issue.
08:09 AM
Summary: US Multi-Regions: Cloud Logging experiencing elevated error rate while reading logs. Mitigation underway. Description: Mitigation work is still underway by our engineering team. Current status of Mitigation: us-west1: Mitigated. us-central1: In progress us-east1: In progress We will provide more information by Wednesday, 2021-10-20 02:00 US/Pacific. Diagnosis: Customers may experience increased latency in Cloud Logging and issues with loading logs. Workaround: None at this time.
05:59 AM
Summary: US Multi-Regions: Cloud Logging experiencing elevated error rate while reading logs. Mitigation underway. Description: Mitigation work is still underway by our engineering team. Current status of Mitigation: us-west1: Mitigated. us-central1: In progress us-east1: In progress We will provide more information by Wednesday, 2021-10-20 00:10 US/Pacific. Diagnosis: Customers may experience increased latency in Cloud Logging and issues with loading logs. Workaround: None at this time.
02:58 AM
Summary: US Multi-Regions: Cloud Logging experiencing elevated error rate while reading logs. Mitigation underway. Description: Mitigation work is still underway by our engineering team. The mitigation is expected to complete by Tuesday, 2021-10-20 00:00 US/Pacific. Current status of Mitigation: us-west1: Mitigated. us-central1: In progress us-east1: In progress We will provide more information by Tuesday, 2021-10-19 22:00 US/Pacific. Diagnosis: Customers may experience increased latency in Cloud Logging and issues with loading logs. Workaround: None at this time.
01:59 AM
Summary: US Multi-Regions: Cloud Logging experiencing elevated error rate while reading logs. Mitigation underway. Description: Mitigation work is underway by our engineering team. We do not have an ETA for mitigation at the moment. us-west1: Mitigated. us-central1: In progress us-east1: In progress We will provide more information by Tuesday, 2021-10-19 19:00 US/Pacific. Diagnosis: Customers may experience increased latency in Cloud Logging and issues with loading logs. Workaround: None at this time.