Google Cloud MAJOR

Google Cloud Storage UI is experiencing some issues

September 2, 2021 · 10:00 AM UTC – 08:00 PM UTC · Duration: 10h

Affected Services

Google Cloud StorageGoogle Cloud Console

Timeline

05:57 PM
We apologize for the inconvenience this service disruption/outage may have caused. We would like to provide some information about this incident below. Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Support by opening a case using https://cloud.google.com/support (All Times US/Pacific) Incident Start: 02 Sep 2021 02:00 Incident End: 02 Sep 2021 12:00 Duration: 10 hours Affected Services and Features: Google Cloud Storage - Cloud Console UI Regions/Zones: Global Description: Google Cloud Storage (GCS) experienced up to an 85% failure rate globally when creating buckets from the GCS Console UI or other service UI’s which create buckets programmatically. From preliminary analysis, the increased failure rate was due to a GCS API rollout. Customer Impact: Customers experienced errors including “RPO is not supported” when creating new GCS buckets using the Cloud Console UI. Additional details: Customer workarounds included using the gcloud CLI (gsutil), or the API (such as via client libraries). Retrying failed requests may have also succeeded The GCS API rollout has been rolled back which fully restored the service.
04:37 PM
The issue with Google Cloud Storage is believed to be affecting only the user interface and has a workaround to use gsutil on CLI. Our Engineering Team is currently working on the resolution. If you have questions or are impacted, please open a case with the Support Team and we will work with you until this issue is resolved. We thank you for your patience while we're working on resolving the issue.
04:25 PM
Summary: Google Cloud Storage UI is experiencing some issues Description: We are experiencing an issue with Google Cloud Storage beginning at Thursday, 2021-09-02 07:45:57 PDT US/Pacific. Our engineering team continues to investigate the issue. We will provide an update by Thursday, 2021-09-02 08:55 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Users attempting to create gcs buckets in pantheon are getting errors Workaround: None at this time.