Google Cloud MAJOR
An issue with Vertex Gemini API in multiple regions of Asia and America
November 13, 2024 · 03:51 PM UTC – 10:29 AM UTC · Duration: 114h 38min
Affected Services
Vertex Gemini API
Timeline
10:29 AM
The issue with Vertex Gemini API has been resolved for all affected users as of Monday, 2024-11-18 02:29 US/Pacific.
We thank you for your patience while we worked on resolving the issue.
01:21 AM
Summary: An issue with Vertex Gemini API in multiple regions of Asia and America
Description: Mitigation work is still underway by our engineering team, and error rates and latency are showing continued improvement.
We do not have an ETA for full mitigation at this point.
We will provide more information by Monday, 2024-11-18 11:00 US/Pacific.
Diagnosis: Customers impacted by this issue may observe long context requests to Gemini 1.5 Pro 002 are served with errors or extremely long latency in some clusters in the impacted regions.
Workaround: The impacted users may try using the Europe based regions to use the Vertex Gemini API configurations or operations.
07:59 PM
Summary: An issue with Vertex Gemini API in multiple regions of Asia and America
Description: Mitigation work is still underway by our engineering team, and error rates and latency are showing continued improvement.
We do not have an ETA for full mitigation at this point.
We will provide more information by Friday, 2024-11-15 17:30 US/Pacific.
Diagnosis: Customers impacted by this issue may observe long context requests to Gemini 1.5 Pro 002 are served with errors or extremely long latency in some clusters in the impacted regions.
Workaround: The impacted users may try using the Europe based regions to use the Vertex Gemini API configurations or operations.
05:51 PM
Summary: An issue with Vertex Gemini API in multiple regions of Asia and America
Description: Mitigation work is still underway by our engineering team, and error rates and latency are showing improvement.
We will provide more information by Friday, 2024-11-15 12:30 US/Pacific.
Diagnosis: Customers impacted by this issue may observe long context requests to Gemini 1.5 Pro 002 are served with errors or extremely long latency in some clusters in the impacted regions.
Workaround: The impacted users may try using the Europe based regions to use the Vertex Gemini API configurations or operations.
02:34 PM
Summary: An issue with Vertex Gemini API in multiple regions of Asia and America
Description: Mitigation work is currently underway by our engineering team.
Mitigation activities are still ongoing at this point.
We will provide more information by Friday, 2024-11-15 10:00 US/Pacific.
Diagnosis: Customers impacted by this issue may observe long context requests to Gemini 1.5 Pro 002 are served with errors or extremely long latency in some clusters in the impacted regions.
Workaround: The impacted users may try using the Europe based regions to use the Vertex Gemini API configurations or operations.
01:08 PM
Summary: An issue with Vertex Gemini API in multiple regions of Asia and America
Description: Mitigation work is currently underway by our engineering team.
We do not have an ETA for mitigation at this point.
We will provide more information by Friday, 2024-11-15 07:00 US/Pacific.
Diagnosis: Customers impacted by this issue may observe long context requests to Gemini 1.5 Pro 002 are served with errors or extremely long latency in some clusters in the impacted regions.
Workaround: The impacted users may try using the Europe based regions to use the Vertex Gemini API configurations or operations.
12:48 PM
Summary: An issue with Vertex Gemini API in multiple regions of Asia and America
Description: We are experiencing an intermittent issue with Vertex Gemini API beginning at Wednesday, 2024-11-13 03:21 US/Pacific.
While our engineering team continues to investigate the issue, please reach out to Google Cloud Support if you need assistance.
We will provide an update by Friday, 2024-11-15 06:00 US/Pacific with current details.
We apologize to all who are affected by the disruption.
Diagnosis: Customers impacted by this issue may observe long context requests to Gemini 1.5 Pro 002 are served with errors or extremely long latency in some clusters in the impacted regions.
Workaround: The impacted users may try using the Europe based regions to use the Vertex Gemini API configurations or operations.
11:42 AM
Summary: An issue with Vertex Gemini API in multiple regions of Asia and America
Description: We are experiencing an intermittent issue with Vertex Gemini API beginning at Wednesday, 2024-11-13 03:21 US/Pacific.
While our engineering team continues to investigate the issue, please reach out to Google Cloud Support if you need assistance.
We will provide an update by Friday, 2024-11-15 06:00 US/Pacific with current details.
We apologize to all who are affected by the disruption.
Diagnosis: Customers impacted by this issue may observe long context requests to Gemini 1.5 Pro 002 are served with errors or extremely long latency in some clusters in the impacted regions.
Workaround: The impacted users may try using the Europe based regions to use the Vertex Gemini API configurations or operations.
11:38 AM
Summary: An issue with Vertex Gemini API in multiple regions of Asia and America
Description: We are experiencing an intermittent issue with Vertex Gemini API beginning at Wednesday, 2024-11-13 03:21 US/Pacific.
While our engineering team continues to investigate the issue, please reach out to Google Cloud Support if you need assistance.
We will provide an update by Friday, 2024-11-15 06:00 US/Pacific with current details.
We apologize to all who are affected by the disruption.
Diagnosis: Users impacted by this issue may observe long context requests to Gemini 1.5 Pro 002 are served with either 100% errors or extremely long latency in some clusters in the impacted regions.
Workaround: The impacted users may try using the Europe based regions to use the Vertex Gemini API configurations or operations.
07:39 AM
Summary: An issue with Vertex Gemini API in multiple regions of Asia and America
Description: We are experiencing an intermittent issue with Vertex Gemini API beginning at Wednesday, 2024-11-13 03:21 US/Pacific.
While our engineering team continues to investigate the issue, please reach out to Google Cloud Support if you need assistance.
We will provide an update by Friday, 2024-11-15 04:00 US/Pacific with current details.
We apologize to all who are affected by the disruption.
Diagnosis: Users impacted by this issue may observe long context requests to Gemini 1.5 Pro 002 are served with either 100% errors or extremely long latency in some clusters in the impacted regions.
Workaround: The impacted users may try using the Europe based regions to use the Vertex Gemini API configurations or operations.