03:00 AM
The issue with Vertex AI Batch Prediction, Vertex AI Online Prediction has been resolved for all affected users as of Thursday, 2023-05-11 18:59 US/Pacific.
We thank you for your patience while we worked on resolving the issue.
09:14 PM
Summary: Multi Region: Vertex AI Batch Prediction & Vertex AI Online Prediction Model Deployment Issues
Description: Our engineers have identified the issue and a fix is being rolled out. Online Prediction is mitigated as of 2023-05-11 12:30 US/Pacific. Batch Prediction is expected to rollout the fix by 2023-05-11 18:00 US/Pacific.
The issue is currently contained in the following four regions: us-west2, europe-west3, asia-east2, us-east1.
We will provide more information by Thursday, 2023-05-11 19:00 US/Pacific.
Diagnosis: Customers are unable to deploy new models on Online Prediction, when a new GKE cluster is created. Some customers Batch Prediction jobs are experiencing timeouts.
Workaround: None at this time.