ensive-1758884350-specific: 0/1 replicas ready, 0 available, 0 unavailable waiting.go:203: Check #2: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #3: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 3 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} waiting.go:203: Check #4: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #5: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #6: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} waiting.go:203: Check #7: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #8: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #9: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} waiting.go:203: Check #10: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #11: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #12: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} waiting.go:203: Check #13: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #14: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #15: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:47: ๐Ÿ” Diagnostic information for deployment comprehensive-1758884350-specific: diagnostics.go:50: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c status: Phase=Pending, Reason= diagnostics.go:55: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c condition PodScheduled: False - 0/2 nodes are available: 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/2 nodes are available: 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: Nominated - Pod should schedule on: nodeclaim/topology-spread-1758884385-nodepool-5r5vr waiting.go:203: Check #16: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #17: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #18: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} waiting.go:203: Check #19: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #20: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:47: ๐Ÿ” Diagnostic information for deployment comprehensive-1758884350-specific: diagnostics.go:50: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c status: Phase=Pending, Reason= diagnostics.go:55: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c condition PodScheduled: False - 0/2 nodes are available: 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/2 nodes are available: 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: Nominated - Pod should schedule on: nodeclaim/topology-spread-1758884385-nodepool-5r5vr waiting.go:203: Check #21: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} waiting.go:203: Check #22: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #23: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #24: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} waiting.go:203: Check #25: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:47: ๐Ÿ” Diagnostic information for deployment comprehensive-1758884350-specific: diagnostics.go:50: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c status: Phase=Pending, Reason= diagnostics.go:55: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c condition PodScheduled: False - 0/2 nodes are available: 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/2 nodes are available: 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: Nominated - Pod should schedule on: nodeclaim/topology-spread-1758884385-nodepool-5r5vr waiting.go:203: Check #26: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #27: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} waiting.go:203: Check #28: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #29: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #30: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:47: ๐Ÿ” Diagnostic information for deployment comprehensive-1758884350-specific: diagnostics.go:50: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c status: Phase=Pending, Reason= diagnostics.go:55: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c condition PodScheduled: False - 0/2 nodes are available: 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/2 nodes are available: 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: Nominated - Pod should schedule on: nodeclaim/topology-spread-1758884385-nodepool-5r5vr waiting.go:203: Check #31: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #32: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #33: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} waiting.go:203: Check #34: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #35: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:47: ๐Ÿ” Diagnostic information for deployment comprehensive-1758884350-specific: diagnostics.go:50: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c status: Phase=Pending, Reason= diagnostics.go:55: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c condition PodScheduled: False - 0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/2 nodes are available: 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: Nominated - Pod should schedule on: nodeclaim/topology-spread-1758884385-nodepool-5r5vr diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. waiting.go:203: Check #36: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} waiting.go:203: Check #37: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #38: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #39: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} waiting.go:203: Check #40: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:47: ๐Ÿ” Diagnostic information for deployment comprehensive-1758884350-specific: diagnostics.go:50: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c status: Phase=Pending, Reason= diagnostics.go:55: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c condition PodScheduled: False - 0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/2 nodes are available: 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: Nominated - Pod should schedule on: nodeclaim/topology-spread-1758884385-nodepool-5r5vr diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. waiting.go:203: Check #41: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #42: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} waiting.go:203: Check #43: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #44: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #45: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:47: ๐Ÿ” Diagnostic information for deployment comprehensive-1758884350-specific: diagnostics.go:50: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c status: Phase=Pending, Reason= diagnostics.go:55: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c condition PodScheduled: False - 0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/2 nodes are available: 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: Nominated - Pod should schedule on: nodeclaim/topology-spread-1758884385-nodepool-5r5vr diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. waiting.go:203: Check #46: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #47: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #48: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} waiting.go:203: Check #49: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #50: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:47: ๐Ÿ” Diagnostic information for deployment comprehensive-1758884350-specific: diagnostics.go:50: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c status: Phase=Pending, Reason= diagnostics.go:55: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c condition PodScheduled: False - 0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/2 nodes are available: 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: Nominated - Pod should schedule on: nodeclaim/topology-spread-1758884385-nodepool-5r5vr diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. waiting.go:203: Check #51: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} waiting.go:203: Check #52: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #53: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #54: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} waiting.go:203: Check #55: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:47: ๐Ÿ” Diagnostic information for deployment comprehensive-1758884350-specific: diagnostics.go:50: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c status: Phase=Pending, Reason= diagnostics.go:55: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c condition PodScheduled: False - 0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/2 nodes are available: 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: Nominated - Pod should schedule on: nodeclaim/topology-spread-1758884385-nodepool-5r5vr diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. waiting.go:203: Check #56: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #57: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} waiting.go:203: Check #58: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #59: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #60: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:47: ๐Ÿ” Diagnostic information for deployment comprehensive-1758884350-specific: diagnostics.go:50: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c status: Phase=Pending, Reason= diagnostics.go:55: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c condition PodScheduled: False - 0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/2 nodes are available: 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: Nominated - Pod should schedule on: nodeclaim/topology-spread-1758884385-nodepool-5r5vr diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. waiting.go:203: Check #61: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #62: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #63: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} waiting.go:203: Check #64: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #65: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:47: ๐Ÿ” Diagnostic information for deployment comprehensive-1758884350-specific: diagnostics.go:50: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c status: Phase=Pending, Reason= diagnostics.go:55: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c condition PodScheduled: False - 0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/2 nodes are available: 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: Nominated - Pod should schedule on: nodeclaim/topology-spread-1758884385-nodepool-5r5vr diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. waiting.go:203: Check #66: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - ConsistentStateFound: True (ConsistentStateFound) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} waiting.go:203: Check #67: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #68: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #69: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - ConsistentStateFound: True (ConsistentStateFound) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} waiting.go:203: Check #70: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:47: ๐Ÿ” Diagnostic information for deployment comprehensive-1758884350-specific: diagnostics.go:50: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c status: Phase=Pending, Reason= diagnostics.go:55: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c condition PodScheduled: False - 0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/2 nodes are available: 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: Nominated - Pod should schedule on: nodeclaim/topology-spread-1758884385-nodepool-5r5vr diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. waiting.go:203: Check #71: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #72: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - ConsistentStateFound: True (ConsistentStateFound) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} waiting.go:203: Check #73: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #74: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #75: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - ConsistentStateFound: True (ConsistentStateFound) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:47: ๐Ÿ” Diagnostic information for deployment comprehensive-1758884350-specific: diagnostics.go:50: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c status: Phase=Pending, Reason= diagnostics.go:55: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c condition PodScheduled: False - 0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/2 nodes are available: 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: Nominated - Pod should schedule on: nodeclaim/topology-spread-1758884385-nodepool-5r5vr diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. waiting.go:203: Check #76: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #77: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #78: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - ConsistentStateFound: True (ConsistentStateFound) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} waiting.go:203: Check #79: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #80: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:47: ๐Ÿ” Diagnostic information for deployment comprehensive-1758884350-specific: diagnostics.go:50: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c status: Phase=Pending, Reason= diagnostics.go:55: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c condition PodScheduled: False - 0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/2 nodes are available: 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: Nominated - Pod should schedule on: nodeclaim/topology-spread-1758884385-nodepool-5r5vr diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. waiting.go:203: Check #81: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - ConsistentStateFound: True (ConsistentStateFound) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} waiting.go:203: Check #82: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #83: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #84: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - ConsistentStateFound: True (ConsistentStateFound) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} waiting.go:203: Check #85: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:47: ๐Ÿ” Diagnostic information for deployment comprehensive-1758884350-specific: diagnostics.go:50: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c status: Phase=Pending, Reason= diagnostics.go:55: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c condition PodScheduled: False - 0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/2 nodes are available: 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: Nominated - Pod should schedule on: nodeclaim/topology-spread-1758884385-nodepool-5r5vr diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. waiting.go:203: Check #86: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #87: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - ConsistentStateFound: True (ConsistentStateFound) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} waiting.go:203: Check #88: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #89: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable waiting.go:203: Check #90: Deployment comprehensive-1758884350-specific: 0/1 replicas ready, 0 available, 1 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-5r5vr: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_e0f65b46-b859-4f92-abd3-be8507d28175 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{3800 -3} {} 3800m DecimalSI} diagnostics.go:376: - memory: {{13328228352 0} {} 13328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{60 0} {} 60 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-82r4b: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_25e82eb9-8dc3-45cd-9a48-c6e9b172dd82 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-9qm2j: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_4d33cac1-fbd6-4319-bf9f-33f2b8114821 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - ConsistentStateFound: True (ConsistentStateFound) diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:47: ๐Ÿ” Diagnostic information for deployment comprehensive-1758884350-specific: diagnostics.go:50: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c status: Phase=Pending, Reason= diagnostics.go:55: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c condition PodScheduled: False - 0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/2 nodes are available: 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling. diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: Nominated - Pod should schedule on: nodeclaim/topology-spread-1758884385-nodepool-5r5vr diagnostics.go:72: Pod comprehensive-1758884350-specific-57f7cc59cc-kdt4c event: FailedScheduling - 0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 1 node(s) had untolerated taint {evict-test: true}, 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. waiting.go:225: Error Trace: /__w/karpenter-provider-ibm-cloud/karpenter-provider-ibm-cloud/test/e2e/waiting.go:225 /__w/karpenter-provider-ibm-cloud/karpenter-provider-ibm-cloud/test/e2e/consolidated_provisioning_test.go:91 Error: Received unexpected error: context deadline exceeded Test: TestE2EComprehensiveProvisioning/InstanceTypeSelection Messages: Deployment pods should be scheduled and running within timeout === RUN TestE2EComprehensiveProvisioning/BlockDeviceMapping consolidated_provisioning_test.go:111: Error Trace: /__w/karpenter-provider-ibm-cloud/karpenter-provider-ibm-cloud/test/e2e/consolidated_provisioning_test.go:111 Error: Should NOT be empty, but was [] Test: TestE2EComprehensiveProvisioning/BlockDeviceMapping Messages: Need at least one node to verify block devices === RUN TestE2EComprehensiveProvisioning/Scaling consolidated_provisioning_test.go:555: Error Trace: /__w/karpenter-provider-ibm-cloud/karpenter-provider-ibm-cloud/test/e2e/consolidated_provisioning_test.go:555 /__w/karpenter-provider-ibm-cloud/karpenter-provider-ibm-cloud/test/e2e/consolidated_provisioning_test.go:127 Error: Received unexpected error: deployments.apps "comprehensive-1758884350-workload" not found Test: TestE2EComprehensiveProvisioning/Scaling === RUN TestE2EComprehensiveProvisioning/ImageSelection consolidated_provisioning_test.go:156: Testing dynamic image selection... waiting.go:203: Check #1: Deployment comprehensive-1758884350-image-workload: 0/3 replicas ready, 0 available, 0 unavailable waiting.go:225: Error Trace: /__w/karpenter-provider-ibm-cloud/karpenter-provider-ibm-cloud/test/e2e/waiting.go:225 /__w/karpenter-provider-ibm-cloud/karpenter-provider-ibm-cloud/test/e2e/consolidated_provisioning_test.go:161 Error: Received unexpected error: deployments.apps "comprehensive-1758884350-image-workload" not found Test: TestE2EComprehensiveProvisioning/ImageSelection Messages: Deployment pods should be scheduled and running within timeout === RUN TestE2EComprehensiveProvisioning/MultiZoneDistribution consolidated_provisioning_test.go:175: Testing multi-zone node distribution... waiting.go:203: Check #1: Deployment comprehensive-1758884350-multizone: 0/3 replicas ready, 0 available, 0 unavailable waiting.go:203: Check #2: Deployment comprehensive-1758884350-multizone: 0/3 replicas ready, 0 available, 3 unavailable waiting.go:203: Check #3: Deployment comprehensive-1758884350-multizone: 0/3 replicas ready, 0 available, 3 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 5 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-594q9: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_785e133f-0201-4a48-9c16-c84457f96dfa diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-cbp8c: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_3ee7795f-07f0-4c4a-829b-35024c5af0b7 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-crxzp: diagnostics.go:361: ProviderID: diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Launched=Unknown, Registered=Unknown, Initialized=Unknown diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-n9nf2: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_b0b2ae6a-4f7c-4dbc-a6ac-fe1ede623603 diagnostics.go:362: NodeName: topology-spread-1758884385-nodepool-n9nf2 diagnostics.go:363: Conditions: diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Registered: True (Registered) diagnostics.go:366: - Initialized: True (Initialized) diagnostics.go:366: - ConsistentStateFound: True (ConsistentStateFound) diagnostics.go:366: - Drained: Unknown (Draining) diagnostics.go:368: Message: Draining diagnostics.go:366: - Ready: True (Ready) diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-nqg2b: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_ea07e099-aeb5-4774-9a03-887fe099d347 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} waiting.go:203: Check #4: Deployment comprehensive-1758884350-multizone: 0/3 replicas ready, 0 available, 3 unavailable waiting.go:203: Check #5: Deployment comprehensive-1758884350-multizone: 0/3 replicas ready, 0 available, 3 unavailable waiting.go:203: Check #6: Deployment comprehensive-1758884350-multizone: 0/3 replicas ready, 0 available, 3 unavailable diagnostics.go:355: ๐Ÿ“Š NodeClaims in cluster: 4 diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-594q9: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_785e133f-0201-4a48-9c16-c84457f96dfa diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - InstanceTerminating: True (InstanceTerminating) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-cbp8c: diagnostics.go:361: ProviderID: ibm:///eu-de/02c7_3ee7795f-07f0-4c4a-829b-35024c5af0b7 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - InstanceTerminating: True (InstanceTerminating) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-crxzp: diagnostics.go:361: ProviderID: ibm:///eu-de/02d7_2eab6a73-d8c1-4312-9b65-5093d99bf42f diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - InstanceTerminating: True (InstanceTerminating) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} diagnostics.go:360: NodeClaim topology-spread-1758884385-nodepool-nqg2b: diagnostics.go:361: ProviderID: ibm:///eu-de/02b7_ea07e099-aeb5-4774-9a03-887fe099d347 diagnostics.go:362: NodeName: diagnostics.go:363: Conditions: diagnostics.go:366: - Initialized: Unknown (AwaitingReconciliation) diagnostics.go:368: Message: object is awaiting reconciliation diagnostics.go:366: - Registered: Unknown (NodeNotFound) diagnostics.go:368: Message: Node not registered with cluster diagnostics.go:366: - Launched: True (Launched) diagnostics.go:366: - InstanceTerminating: True (InstanceTerminating) diagnostics.go:366: - Ready: Unknown (ReconcilingDependents) diagnostics.go:368: Message: Initialized=Unknown, Registered=Unknown diagnostics.go:374: Allocatable: diagnostics.go:376: - cpu: {{1800 -3} {} 1800m DecimalSI} diagnostics.go:376: - memory: {{5328228352 0} {} 5328228352 DecimalSI} diagnostics.go:376: - nvidia.com/gpu: {{0 0} {} 0 DecimalSI} diagnostics.go:376: - pods: {{30 0} {} 30 DecimalSI} waiting.go:203: Check #7: Deployment comprehensive-1758884350-multizone: 0/3 replicas ready, 0 available, 3 unavailable waiting.go:203: Check #8: Deployment comprehensive-1758884350-multizone: 0/3 replicas ready, 0 available, 3 unavailable waiting.go:225: Error Trace: /__w/karpenter-provider-ibm-cloud/karpenter-provider-ibm-cloud/test/e2e/waiting.go:225 /__w/karpenter-provider-ibm-cloud/karpenter-provider-ibm-cloud/test/e2e/consolidated_provisioning_test.go:181 Error: Received unexpected error: deployments.apps "comprehensive-1758884350-multizone" not found Test: TestE2EComprehensiveProvisioning/MultiZoneDistribution Messages: Deployment pods should be scheduled and running within timeout === RUN TestE2EComprehensiveProvisioning/UserDataBootstrap === RUN TestE2EComprehensiveProvisioning/CleanupVerification consolidated_provisioning_test.go:223: Cleanup will be handled by WithAutoCleanup wrapper === NAME TestE2EComprehensiveProvisioning cleanup.go:637: ๐Ÿงน Test completed: comprehensive-1758884350 - performing cleanup cleanup.go:109: Starting cleanup for test: comprehensive-1758884350 cleanup.go:158: Cleaning up PodDisruptionBudget resources for test comprehensive-1758884350 cleanup.go:158: Cleaning up Deployment resources for test comprehensive-1758884350 cleanup.go:158: Cleaning up NodeClaim resources for test comprehensive-1758884350 cleanup.go:158: Cleaning up NodePool resources for test comprehensive-1758884350 cleanup.go:158: Cleaning up IBMNodeClass resources for test comprehensive-1758884350 cleanup.go:215: Deleting IBMNodeClass: placement-strategy-validation-1758885381-valid-nodeclass cleanup.go:69: Waiting for IBMNodeClass deletion (max 5m0s)... cleanup.go:94: โœ… All IBMNodeClass resources deleted cleanup.go:250: โœ… Cleanup completed for test comprehensive-1758884350 consolidated_provisioning_test.go:227: TestE2EComprehensiveProvisioning completed successfully --- FAIL: TestE2EComprehensiveProvisioning (1034.29s) --- FAIL: TestE2EComprehensiveProvisioning/Setup (12.02s) --- FAIL: TestE2EComprehensiveProvisioning/BasicProvisioning (30.02s) --- FAIL: TestE2EComprehensiveProvisioning/InstanceTypeSelection (900.01s) --- FAIL: TestE2EComprehensiveProvisioning/BlockDeviceMapping (0.01s) --- FAIL: TestE2EComprehensiveProvisioning/Scaling (0.01s) --- FAIL: TestE2EComprehensiveProvisioning/ImageSelection (10.03s) --- FAIL: TestE2EComprehensiveProvisioning/MultiZoneDistribution (80.02s) --- PASS: TestE2EComprehensiveProvisioning/UserDataBootstrap (0.00s) --- PASS: TestE2EComprehensiveProvisioning/CleanupVerification (0.00s) FAIL FAIL github.com/pfeifferj/karpenter-provider-ibm-cloud/test/e2e 1034.324s FAIL