Skip to content

Import failure: on004078 (ds004078) #80

Open

Description

@neuromechanist

Dataset: on004078 | OpenNeuro source: ds004078
Missing objects: 61/9447 (at declared size, per nemar admin import verify)
Failure class: needs-triage

What happened: part of the epic #967 (nemarOrg/nemar-cli) OpenNeuro 0-byte-content recovery. This dataset did not reach a complete state. The hardened finalize gate correctly did NOT publish incomplete data — the dataset retains its real (partial) state; nothing empty was published.

Triage action: 61 objects missing after copy. Classify: are the 61 upstream-403 (unrecoverable) or a shard gap (re-runnable)? Inspect the copy shard logs.

Refs: epic nemarOrg/nemar-cli#967; recovery run followed .context/recover-runbook.md. data_complete=0 is the honest catalog state until resolved.

Activity

  1. added
    import-failureOpenNeuro import/recovery failed for a dataset
    needs-triageNo cause could be determined from the reported error; classify by hand from the run
    on Jul 22, 2026
  2. neuromechanist commented on Sep 16, 2026

    @neuromechanist
    MemberAuthor

    Re-measured: above the 90% threshold, stays listed (#1396, ADR 0064)

    Re-measured against the bucket on 2026-09-16, on ADR 0064's basis (distinct
    annexed keys, never tree entries and never total_files):

    on004078: 61 of 9223 data keys have no object. 99.34% of its data is available.

    Above the 90% a listed dataset must reach, so ADR 0005 governs unchanged: the
    dataset is listed, serves what it has, omits what it does not, and advertises
    nothing it cannot deliver. No withdrawal, and the remaining gap is reported
    rather than hidden.

    Sixty-one keys of 9,223. 9,162 keys are in the bucket and unregistered (#1392
    backlog), not registered while content is missing (ADR 0061).

    Verification basis: presence at declared size, so a zero-byte object left by
    a failed copy counts as missing rather than present (#967). Size-level, not
    checksum-level.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    import-failureOpenNeuro import/recovery failed for a datasetneeds-triageNo cause could be determined from the reported error; classify by hand from the run

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions