Skip to content

Hangs on large files #21

Open
Open

Description

@Cobertos

Reported in #20 (comment) and can confirm

It looks like the extractor is hanging on large files (on the extracting portion specifically). A 330MB package takes 660 seconds (exe) and 864 seconds (python -m) vs 8 seconds in v1.0.0.

Workaround is to use v1.0.0 if you want it fast and trust your .unitypackage

Activity

  1. Cobertos commented on Oct 17, 2021

    @Cobertos
    OwnerAuthor

    I believe this was when switching to tarsafe instead of tarfile as tarsafe does a iteration over names which was a previous source of slowness

    Ideally tarsafe would need to be more performant... but I don't think Python gives any better way to check the tar before iteration.

  2. Cobertos commented on Oct 17, 2021

    @Cobertos
    OwnerAuthor

    I'm thinking:

    1. Add an --unsafe flag to use tarfile instead of tarsafe
    2. Add a print message right before extraction like Extraction checks the security of every .tar file entry. To speed up, add --unsafe if you trust your .unitypackage is not malicious
  3. Cobertos commented on Oct 17, 2021

    @Cobertos
    OwnerAuthor

    @catfag any thoughts maybe?

  4. CrackerHax commented on Dec 16, 2021

    @CrackerHax

    Yeah this tool is super slow

  5. OneManMonkeySquad commented on Jan 15, 2022

    @OneManMonkeySquad

    Having some output, either progress or just "working on it..." would help a lot

  6. kotori2 commented on Dec 15, 2022

    @kotori2

    For me it is 58 seconds for a 2.2MB file.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions