Google Cloud MINOR

Elevated rate of ‘500’ errors observed on Gemini 1.5 Flash and Gemini 1.5 Pro 002

January 7, 2025 · 09:28 PM UTC – 05:18 AM UTC · Duration: 7h 50min

Affected Services

Vertex Gemini API

Timeline

05:18 AM
The issue with Vertex Gemini API has been resolved for all affected users as of Tuesday, 2025-01-07 21:18 US/Pacific. We thank you for your patience while we worked on resolving the issue.
04:24 AM
Summary: Elevated rate of ‘500’ errors observed on Gemini 1.5 Flash and Gemini 1.5 Pro 002 Description: We are experiencing an intermittent issue with Vertex Gemini API. Gemini 1.5 Flash - Steady progress is being made with the recovery process, while the Engineering team continues to ensure that recurrence of errors are prevented. Gemini 1.5 Pro 002 - Engineering is working on the final instance where mitigation is being applied. Error rates have reduced to ~1-3%, and are expected to return to normalcy post complete mitigation. We will provide an update by Tuesday, 2025-01-07 23:30 US/Pacific with current details. Diagnosis: Customers impacted by this issue may see intermittent ‘500’ error messages. Workaround: None at this time.
03:29 AM
Summary: Elevated rate of ‘500’ errors observed on Gemini 1.5 Flash and Gemini 1.5 Pro 002 Description: We are experiencing an intermittent issue with Vertex Gemini API. Gemini 1.5 Flash - Steady progress is being made with the recovery process, while the Engineering team continues to ensure that recurrence of errors are prevented. Gemini 1.5 Pro 002 - Engineering is working on the final instance where mitigation is being applied. Error rates have reduced to ~1-3%, and are expected to return to normalcy post complete mitigation. We will provide an update by Tuesday, 2025-01-07 21:00 US/Pacific with current details. Diagnosis: Customers impacted by this issue may see intermittent ‘500’ error messages. Workaround: None at this time.
02:17 AM
Summary: Elevated rate of ‘500’ errors observed on Gemini 1.5 Flash and Gemini 1.5 Pro 002 Description: We are experiencing an intermittent issue with Vertex Gemini API. Gemini 1.5 Flash - Our engineering team continues to work steadily towards mitigation. Gemini 1.5 Pro 002 - A majority of the mitigation efforts have been successfully completed and a drastic improvement has been confirmed in the success rates for requests. We will provide an update by Tuesday, 2025-01-07 19:30 US/Pacific with current details. Diagnosis: Customers impacted by this issue may see intermittent ‘500’ error messages. Workaround: None at this time.
12:47 AM
Summary: Elevated rate of ‘500’ errors observed on Gemini 1.5 Flash and Gemini 1.5 Pro 002 Description: We are experiencing an intermittent issue with Vertex Gemini API. Our engineering team has identified a potential mitigation strategy and is in the process of executing the same. Subsequently, a drop in the number of ‘500’ errors has been observed. We will provide an update by Tuesday, 2025-01-07 18:00 US/Pacific with current details. Diagnosis: Customers impacted by this issue may see intermittent ‘500’ error messages. Workaround: None at this time.
11:30 PM
Summary: Elevated rate of ‘500’ errors observed on Gemini 1.5 Flash and Gemini 1.5 Pro 002 Description: We are experiencing an intermittent issue with Vertex Gemini API. Our engineering team continues to investigate the issue. We will provide an update by Tuesday, 2025-01-07 16:30 US/Pacific with current details. Diagnosis: Customers impacted by this issue may see intermittent ‘500’ error messages. Workaround: None at this time.
10:51 PM
Summary: Elevated rate of ‘500’ errors observed on Gemini 1.5 Flash Description: We are experiencing an intermittent issue with Vertex Gemini API. Our engineering team continues to investigate the issue. We will provide an update by Tuesday, 2025-01-07 16:00 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Customers impacted by this issue may see intermittent ‘500’ error messages. Workaround: None at this time.