Cloud Pub/Sub customers in europe-north1, southamerica-west1, us-west2 may have experienced permission denied errors ...

Mini Incident Report We apologize for the inconvenience this service disruption/outage may have caused. We would like to provide some information about this incident below. Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Cloud Support using https://cloud.google.com/support (All Times US/Pacific) Incident Start: 15 April 2024 13:00 Incident End: 15 April 2024 13:35 Duration: 35 minutes Affected Services and Features: Cloud Pub/Sub Regions/Zones: Finland (europe-north1), Santiago (southamerica-west1), Los Angeles (us-west2) Description: Cloud Pub/Sub customers in europe-north1, southamerica-west1, us-west2 experienced permission denied errors for all API methods, including methods used to publish and subscribe for a duration of 35 minutes. From preliminary analysis, the root cause of the issue was a bad configuration change which was identified by our internal monitoring tools. The change was immediately rolled back and the impact was fully mitigated at 13:35. Customer Impact: Customers in the affected regions may have observed permission denied errors for all API methods.

We experienced an issue with Cloud Pub/sub beginning at Monday, 2024-04-15 13:00 US/Pacific. During the issue, customers publishing and subscribing in the affected regions may have been impacted. Publishing traffic redirected due to Message Storage Policies to the affected regions may have been impacted. Control operations may have been affected also. The issue was caused by a bad configuration change and the change was rolled back resolving the issue for all affected users as of Monday, 2024-04-15 13:35 US/Pacific. We thank you for your patience while we worked on resolving the issue.

Summary: Cloud Pub/Sub customers in europe-north1, southamerica-west1, us-west2 may have experienced permission denied errors for all API methods, including methods used to publish and subscribe. Description: We are investigating a potential issue with Google Cloud Pub/Sub. We will provide more information by Wednesday, 2024-04-17 14:15 US/Pacific. Diagnosis: None at this time. Workaround: None at this time.