Skip to content

Phase 6: Data-plane + credential hardening — zarr rate limit + STS prefix-scoping #901

Closed

Description

@neuromechanist

Part of epic #896.

  • zarr.nemar.org rate-limit bypass (backend/src/index.ts:225): the zarr.nemar.org host returns zarrDataRoutes.fetch() directly, bypassing the API middleware stack (and its rate limiter), unlike data.nemar.org which re-enters api.fetch(). It is the highest-request-volume path. (Note: it does have edge caching via caches.default, so this is rate-limiting only.) Apply the data-plane rate-limit bucket to the zarr host path.
  • STS s3:ListBucket over-scoping (backend/src/services/sts.ts): per-session federation tokens grant unconditional s3:ListBucket on the bare bucket (no s3:prefix condition), because git-annex initremote's HeadBucket can't be prefix-scoped. Consequence: any user requesting credentials for their own dataset can enumerate object keys of every other dataset, including private/embargoed. Scope the per-session policy by prefix and move the HeadBucket bootstrap to a separate narrow path.

Priority: P1 (security scoping + availability).

Activity

  1. added
    P1High priority - important features, significant bugs
    securitySecurity-related issues
    featureNew feature or enhancement
    on Jul 2, 2026
  2. added 2 commits that reference this issue on Jul 7, 2026
  3. neuromechanist commented on Jul 7, 2026

    @neuromechanist
    ContributorAuthor

    zarr rate-limit half shipped in epic #896 (dev via #943). STS ListBucket prefix-scoping split to #941 (needs live git-annex validation).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    P1High priority - important features, significant bugsfeatureNew feature or enhancementsecuritySecurity-related issues

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions