Skip to content

frontproxy indexing of deleted logicalclusters has a large delay #4073

Closed

Description

@SimonTheLeg

When deleting logical clusters, there is a multi-minute delay before it is picked up by front-proxy. This leads to kubectl get workspace requests to still display workspaces as ready, even though you cannot interact with them anymore. For example in the bottom right, you can see it takes ~9 minutes before indexing even triggers and afterwards it is lacking behind by minutes still.

Image

Activity

  1. mjudeikis commented on Apr 27, 2026

    @mjudeikis
    Contributor

    Did you checked this is still a case in main? I think I fixed it here #4047

  2. SimonTheLeg commented on May 12, 2026

    @SimonTheLeg
    MemberAuthor

    yes this still occurs, here is a screenshot running gf79ae83a046a6e from main branch

    Image
  3. xrstf commented on Jun 5, 2026

    @xrstf
    Contributor

    I am trying to reproduce this, but am failing both on the current main branch as well as on release-0.30. I tried to create 50 workspaces and deleting them all, which worked without issues. Then i created 50 workspaces on the root shard, picked a random one that was scheduled onto shard-1, then created 50 more workspaces in there and then deleted all workspaces recursively (from the root workspace again). Again, metrics were updated immediately.

  4. SimonTheLeg commented on Jun 8, 2026

    @SimonTheLeg
    MemberAuthor

    I have re-evaluated this. While I do think it is a bit strange that the indexed and actual logicalclusters red and orange lines seem to close in every 5 minutes, the initial delay is completely gone now and this behavior also only happens in the beginning. Towards the end both are similar. Closing this issue now.

    Image
  5. moved this from New to Done in kcpon Jun 8, 2026
  6. moved this from Done to Demo'd in OpenMesh - Backlogon Jul 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    • Status
      Done

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions