Skip to content

Conversation

@tetianakh
Copy link
Contributor

What type of PR is this?

/kind bug

What this PR does / why we need it:

If a node is being scaled down, it may get deleted at any time. Currently during large scaledowns cluster autoscaler is unable to associate nodes that are being deleted nodes with a nodegroup, causing expensive cache updates.
This change checks if a node is in scaledown and gets the nodegoup from scaledown request, not from cloud provider.

It also increases the MaxKubernetesEmptyNodeDeletionTime and MaxCloudProviderNodeDeletionTime to account for tail latencies in large bulk deletes.

Special notes for your reviewer:

Does this PR introduce a user-facing change?

NONE

If a node is being scaled down, it may get deleted at any time.
Currently during large scaledowns cluster autoscaler is unable to
associate nodes that are being deleted nodes with a nodegroup,
causing expensive cache updates.
This change checks if a node is in scaledown and gets the nodegoup from
scaledown request, not from cloud provider.

It also increases the MaxKubernetesEmptyNodeDeletionTime and
MaxCloudProviderNodeDeletionTime to account for tail latencies
in large bulk deletes.
@k8s-ci-robot k8s-ci-robot added release-note-none Denotes a PR that doesn't merit a release note. kind/bug Categorizes issue or PR as related to a bug. do-not-merge/needs-area area/cluster-autoscaler needs-ok-to-test Indicates a PR that requires an org member to verify it is safe to test. labels Jan 13, 2026
@k8s-ci-robot k8s-ci-robot requested review from elmiko and x13n January 13, 2026 14:58
@k8s-ci-robot
Copy link
Contributor

Hi @tetianakh. Thanks for your PR.

I'm waiting for a kubernetes member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: tetianakh
Once this PR has been reviewed and has the lgtm label, please assign towca for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot added size/M Denotes a PR that changes 30-99 lines, ignoring generated files. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. labels Jan 13, 2026
@x13n
Copy link
Member

x13n commented Jan 13, 2026

The description mentions bumping MaxCloudProviderNodeDeletionTime and MaxKubernetesEmptyNodeDeletionTime, but I don't see that change in the code. Is it a separate commit that you meant to push?

Also, can you update the release note? I think this is a performance optimization that may be worth calling out in the changelog.

@elmiko
Copy link
Contributor

elmiko commented Jan 15, 2026

++ to @x13n 's question.

@tetianakh tetianakh marked this pull request as draft January 16, 2026 09:15
@k8s-ci-robot k8s-ci-robot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Jan 16, 2026
@tetianakh
Copy link
Contributor Author

Thanks for noticing, changes in cluster-autoscaler/core/scaledown/actuation/delete_in_batch.go are missing from the commit.

Let me take another try at fixing this. After running more thorough tests I am less confident that this change fully fixes the problem.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/cluster-autoscaler cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. kind/bug Categorizes issue or PR as related to a bug. needs-ok-to-test Indicates a PR that requires an org member to verify it is safe to test. release-note-none Denotes a PR that doesn't merit a release note. size/M Denotes a PR that changes 30-99 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants