Skip to content

Deadline exceeded while reindexing all spaces #3237

Closed

Description

@BEBU88

Describe the bug

running opencloud search index --all-spaces --insecure --force-rescan still gives me an rpc Error deadline exceeded.

Steps to reproduce

  1. Run command opencloud search index --all-spaces --insecure --force-rescan
  2. The error occures after some time.

Expected behavior

All spaces should be reindexed.

Actual behavior

Terminal throws an error:
[69/6001] indexed space b90f49a2-097c-42bc-83ff-278a76ab2e8b$6ff29e3e-8caf-4393-9f33-2be26b4ed8a8!6ff29e3e-8caf-4393-9f33-2be26b4ed8a8 in 42.570234898s
rpc error: code = DeadlineExceeded desc = context deadline exceeded

Setup

Opencloud rolling 7.4.0 on Debian 13 with Docker.

Additional context

I also tried to set SEARCH_REINDEX_CONCURRENCY=1 but that didn't fix the issue.

Activity

  1. rhafer commented on Aug 4, 2026

    @rhafer
    Member

    All spaces should be reindexed.

    Yeah, that is what happens, even if the command line tool exits with that "deadline exceeded" error. The indexing process is happening on the server in the background AFAICT

  2. moved this from Qualification to Prio <= 3 in OpenCloud Team Boardon Aug 4, 2026
  3. BEBU88 commented on Aug 4, 2026

    @BEBU88
    Author

    I checked the CPU usage. It dropped from ~ 70 % to ~ 10% after the error occured. For me this indicates the indexing stopped but I will check this later.

  4. BEBU88 commented on Aug 5, 2026

    @BEBU88
    Author

    I did some further testing and set the loglevel for the search service to debug while indexing. After indexing stopped I did a search for a specific word and the results where empty. In my opinion there should have been a result since the space should have been indexed then.

  5. mwiedemeyer commented on Sep 15, 2026

    @mwiedemeyer

    same after upgrading to v8

  6. micbar commented on Sep 15, 2026

    @micbar
    Member

    Yes, same here.

    Retriggering the reindex in a screen session, will see tomorrow if it succeeded.

  7. Limerick-gh commented on Sep 15, 2026

    @Limerick-gh

    Got the same when doing rescan for v8.0.0 update.

  8. Limerick-gh commented on Sep 17, 2026

    @Limerick-gh

    The deadline exceeded error is gone with the v8.0.1, therefore the reindex is eating up all memory and is being killed fter a while due to oom.
    Adding extra memory did not fix it and I am getting the same result.
    Is there a way to limit the memory usage? I already lowered concurrency to 1, but facing the same issue again.

  9. aduffeck commented on Sep 17, 2026

    @aduffeck
    Member

    @Limerick-gh are you using a bleve or opensearch backend?
    Is Tika enabled, and if yes is Tika or opencloud using the memory?
    What amount of files/data and memory usage are we talking about?

    What you can do as a workaround is running the command without the --force-rescan bit which makes it pick up the work where it stopped last and not start all over again.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions