Global: Cloud Logging Query timing out

We apologize for the inconvenience this service disruption/outage may have caused. We would like to provide some information about this incident below. Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Support by opening a case using https://cloud.google.com/support (All Times US/Pacific) Incident Start: 27 July 2021 09:02 Incident End: 27 July 2021 13:14 Duration: 4 hours, 12 minutes Affected Services and Features: Cloud Logging Regions/Zones: Global Description: Cloud Logging experienced query timeouts globally for a duration of 4 hours, 12 minutes. From preliminary analysis, the root cause of the issue is a configuration change in the backend component used for indexing and cataloging the logs. Customer Impact: Cloud Logging - Query timeouts Cloud Console - Elevated errors for Activity Stream due to Cloud Logging query timeouts. Kubernetes, Cloud Run- Elevated logging errors due to Cloud Logging query timeouts.

The issue with Cloud Logging has been resolved for all affected projects as of Tuesday, 2021-07-27 14:46 US/Pacific. We thank you for your patience while we worked on resolving the issue.

Summary: Global: Cloud Logging Query timing out Description: We believe the issue with Cloud Logging is partially resolved and there is no further impact observed. The ETA for full resolution is end of week July 30th. We will provide an update by Friday, July 30th with current details. Diagnosis: None at this time. Workaround: None at this time.

Summary: Global: Cloud Logging Query timing out Description: We believe the issue with Cloud Logging is partially resolved and there is no further impact observed. The ETA for full resolution is unknown at this time. We will provide an update by Tuesday, 2021-07-27 14:00 US/Pacific with current details. Diagnosis: None at this time. Workaround: None at this time.

Summary: Global: Cloud Logging Query timing out Description: We believe the issue with Cloud Logging is partially resolved and there is no further impact observed. We will provide an update by Tuesday, 2021-07-27 13:00 US/Pacific with current details. Diagnosis: None at this time. Workaround: None at this time.

Summary: Global: Cloud Logging Query timing out Description: We are investigating a potential issue with Cloud Logging. We will provide more information by Tuesday, 2021-07-27 12:25 US/Pacific. Diagnosis: None at this time. Workaround: None at this time.