Google Cloud MINOR

Calico Node pods failing to start and crash-looping

December 14, 2022 · 12:51 AM UTC – 08:55 PM UTC · Duration: 68h 4min

Affected Services

Google Kubernetes Engine

Timeline

08:55 PM
The issue with Google Kubernetes Engine has been resolved for all affected projects as of Friday, 2022-12-16 11:00 US/Pacific. We thank you for your patience while we worked on resolving the issue.
04:47 PM
Summary: Calico Node pods failing to start and crash-looping Description: We believe the issue with Google Kubernetes Engine is partially resolved. Full resolution is expected to complete by Friday, 2022-12-23 17:00 US/Pacific. We will provide an update by Friday, 2022-12-16 17:00 US/Pacific with current details. Diagnosis: Customers may observe their calico node pods failing to start and crash-looping indefinitely on GKE 1.24.7+ and 1.25.3+. This issue has impact on GKE versions with nodelocaldns enabled. Workaround: Customers may disable nodelocaldns. Customers may also raise a support ticket with Google to patch the impacted clusters.
12:27 AM
Summary: Calico Node pods failing to start and crash-looping Description: We believe the issue with Google Kubernetes Engine is partially resolved. Full resolution is expected to complete by Friday, 2022-12-23 17:00 US/Pacific. We will provide an update by Friday, 2022-12-16 17:00 US/Pacific with current details. Diagnosis: Customers may observe their calico node pods failing to start and crash-looping indefinitely on GKE 1.24.7+ and 1.25.3+. Workaround: Customers may disable nodelocaldns. Customers may also raise a support ticket with Google to patch the impacted clusters.