Google Cloud MINOR

Cloud Monitoring: Missing Bigtable Replication Metrics

December 15, 2022 · 12:47 AM UTC – 05:12 AM UTC · Duration: 4h 25min

Affected Services

Google Cloud Bigtable

Timeline

05:12 AM
The issue with Google Cloud Bigtable has been resolved for all affected users as of Wednesday, 2022-12-14 21:00 US/Pacific. We thank you for your patience while we worked on resolving the issue.
04:33 AM
Summary: Cloud Monitoring: Missing Bigtable Replication Metrics Description: We are experiencing an issue with Google Cloud Bigtable Metrics. CPU Load Metrics are impacted and could show the CPU Load as zero in the impacted locations. Customers who are periodically scaling their clusters based on the CPU Load Metrics will be operating on wrong data. Customers who are using the Cloud Bigtable native Autoscaling feature are NOT impacted. Replication metrics are also affected. Our engineering team continues to investigate the issue. We will provide an update by Wednesday, 2022-12-14 22:00 US/Pacific with current details. Diagnosis: Customers may be missing data in Cloud Monitoring for the following metrics: bigtable.googleapis.com/cluster/cpu_load, bigtable.googleapis.com/replication/latency, bigtable.googleapis.com/replication/max_delay Workaround: None at this time.
03:56 AM
Summary: Cloud Monitoring: Missing Bigtable Replication Metrics Description: We are experiencing an issue with Google Cloud Bigtable Metrics. CPU Load Metrics are impacted and could show the CPU Load as zero in the impacted locations. Customers who are periodically scaling their clusters based on the CPU Load Metrics will be operating on wrong data. Replication metrics are also affected for selected zones. Our engineering team continues to investigate the issue. We will provide an update by Wednesday, 2022-12-14 22:00 US/Pacific with current details. Diagnosis: Customers may be missing data in Cloud Monitoring for the following metrics: bigtable.googleapis.com/cluster/cpu_load, bigtable.googleapis.com/replication/latency, bigtable.googleapis.com/replication/max_delay Workaround: None at this time.
03:43 AM
Summary: Cloud Monitoring: Missing Bigtable Replication Metrics Description: We are experiencing an issue with Google Cloud Bigtable Metrics. CPU Load Metrics are impacted and could show the CPU Load as zero in the impacted locations. Customers who are periodically scaling their clusters based on the CPU Load Metrics will be operating on wrong data. Replication metrics are also affected for selected zones. Our engineering team continues to investigate the issue. We will provide an update by Wednesday, 2022-12-14 22:00 US/Pacific with current details. Diagnosis: Customers may be missing data in Cloud Monitoring for the following metrics: bigtable.googleapis.com/replication/latency bigtable.googleapis.com/replication/max_delay Workaround: None at this time.