Customers are unable to create read replica with private IP for Cloud SQL

Mini Incident Report We apologize for the inconvenience this service disruption/outage may have caused. We would like to provide some information about this incident below. Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Cloud Support using https://cloud.google.com/support. (All Times US/Pacific) Incident Start: 7 May, 2023 12:47 Incident End: 7 May, 2023 17:06 Duration: 4 hours, 19 minutes Affected Services and Features: Cloud SQL Regions/Zones: Global Description: Cloud SQL customers experienced “Invalid Request” errors when attempting to create read replicas for a duration of 4 hours, 19 minutes. From preliminary analysis, the root cause of the issue was a recent change where the Cloud Console UI stopped sending private IP information to the Cloud SQL Admin API for creating read replica requests. Customer Impact: Customers would have experienced the error “Invalid request: At least one of Public or Private IP connectivity must be enabled” when attempting to create a Cloud SQL read replica in Cloud Console. Additional details: Google engineers mitigated the issue on 7 May 2023 at 17:06 US/Pacific by rolling back the recent change made to the Cloud Console UI.

The issue with Google Cloud SQL has been resolved for all affected users as of Sunday, 2023-05-07 17:19 US/Pacific. We thank you for your patience while we worked on resolving the issue.

Summary: Customers are unable to create read replica with private IP for Cloud SQL Description: We are experiencing an issue with Google Cloud SQL. Our engineering team continues to investigate the issue. We will provide an update by Sunday, 2023-05-07 18:30 US/Pacific with current details. Diagnosis: Customers are unable to create new read replicas with only private IP for Cloud SQL instances. Replica creation without public IP configured in UI will result in the following error: “Invalid request: At least one of Public IP or Private IP connectivity must be enabled” Workaround: Users are being instructed to : Users can use gcloud command and explicitly specify the VPC network with --network flag, as a workaround.

Summary: Customers are unable to create read replica with private IP for Cloud SQL Description: We are experiencing an issue with Google Cloud SQL. Our engineering team continues to investigate the issue. We will provide an update by Sunday, 2023-05-07 16:30 US/Pacific with current details. Diagnosis: Customers are unable to create new read replicas with only private IP for Cloud SQL instances. Replica creation without public IP configured in UI will result in the following error: “Invalid request: At least one of Public IP or Private IP connectivity must be enabled” Workaround: Users are being instructed to : Users can use gcloud command and explicitly specify the VPC network with --network flag, as a workaround.

Summary: Customers are unable to create read replica with private IP for Cloud SQL Description: We are experiencing an issue with Google Cloud SQL. Our engineering team continues to investigate the issue. We will provide an update by Sunday, 2023-05-07 16:30 US/Pacific with current details. Users are being instructed to : Users can use gcloud command and explicitly specify the VPC network with --network flag, as a workaround. Example: gcloud sql instances create Diagnosis: Customers are unable to create new read replicas with only private IP for Cloud SQL instances. Replica creation without public IP configured in UI will result in the following error: “Invalid request: At least one of Public IP or Private IP connectivity m Workaround: Customers provided directions above to explicitly specify the VPC network

Summary: Customers are unable to create read replica with private IP for Cloud SQL Description: We are experiencing an issue with Google Cloud SQL. Our engineering team continues to investigate the issue. We will provide an update by Sunday, 2023-05-07 16:30 US/Pacific with current details. Diagnosis: Customers are unable to create new read replicas with only private IP for Cloud SQL instances. Replica creation without public IP configured in UI will result in the following error: “Invalid request: At least one of Public IP or Private IP connectivity must be enabled” Users can follow these steps as a workaround: Users can use gcloud command and explicitly specify the VPC network with --network flag, as a workaround. Example: gcloud sql instances create Workaround: Customers provided directions above to explicitly specify the VPC network

Summary: Customers are unable to create read replica with private IP for Cloud SQL Description: We are experiencing an issue with Google Cloud SQL. Our engineering team continues to investigate the issue. We will provide an update by Sunday, 2023-05-07 16:30 US/Pacific with current details. Diagnosis: Customers are unable to create new read replicas with only private IP for Cloud SQL instances. Replica creation without public IP configured in UI will result in the following error: “Invalid request: At least one of Public IP or Private IP connectivity must be enabled” Workaround: Users can use gcloud command and explicitly specify the VPC network with --network flag, as a workaround. Example: gcloud sql instances create

Summary: Customers are unable to create read replica with private IP for Cloud SQL Description: We are experiencing an issue with Google Cloud SQL. Our engineering team continues to investigate the issue. We will provide an update by Sunday, 2023-05-07 16:30 US/Pacific with current details. Diagnosis: Customers are unable to create new read replicas with only private IP for Cloud SQL instances. Replica creation without public IP configured in UI will result in the following error: “Invalid request: At least one of Public IP or Private IP connectivity must be enabled” Workaround: Users can use gcloud command and explicitly specify the VPC network with --network flag, as a workaround. Example: gcloud sql instances create

Summary: Customers are unable to create read replica with private IP for Cloud SQL Description: We are experiencing an issue with Google Cloud SQL. Our engineering team continues to investigate the issue. We will provide an update by Sunday, 2023-05-07 16:30 US/Pacific with current details. Diagnosis: Customers are unable to create new read replicas with only private IP for Cloud SQL instances. Replica creation without public IP configured in UI will result in the following error: “Invalid request: At least one of Public IP or Private IP connectivity must be enabled” Workaround: Users can use gcloud command and explicitly specify the VPC network with --network flag, as a workaround. Example: gcloud sql instances create

Summary: Customers are unable to create read replica with private IP for Cloud SQL Description: We are experiencing an issue with Google Cloud SQL. Our engineering team continues to investigate the issue. We will provide an update by Sunday, 2023-05-07 16:30 US/Pacific with current details. Diagnosis: Customers are unable to create new read replicas with only private IP for Cloud SQL instances. Replica creation without public IP configured in UI will result in the following error: “Invalid request: At least one of Public IP or Private IP connectivity must be enabled” Replica creation without public IP using gcloud command as below will alsoresult in the same error. gcloud sql instances create Workaround: Users can use gcloud command and explicitly specify the VPC network with --network flag, as a workaround. Example: gcloud sql instances create

Summary: Customers are unable to create read replica with private IP for Cloud SQL Description: We are experiencing an issue with Google Cloud SQL. Our engineering team continues to investigate the issue. We will provide an update by Sunday, 2023-05-07 15:00 US/Pacific with current details. Diagnosis: Customers are unable to create new read replica with only private IP. Replica creation without public IP configured in UI or gcloud command will result in the following error: “Invalid request: At least one of Public IP or Private IP connectivity must be enabled” Workaround: None at this time

Summary: Customers are unable to create read replica with private IP for Cloud SQL Description: We are experiencing an issue with Google Cloud SQL. Our engineering team continues to investigate the issue. We will provide an update by Sunday, 2023-05-07 14:30 US/Pacific with current details. Diagnosis: Customers are unable to create new read replica with only private IP. Replica creation without public IP configured in UI or gcloud command will result in the following error: “Invalid request: At least one of Public IP or Private IP connectivity must be enabled” Workaround: None at this time