Skip to content

What is the minimum storage space required for the 731 use cases publicly disclosed by swe-bench pro on huggingface? #99

Description

@twilighgt

I understand that swe-bench requires at least 120GB; details are shown in the image below.
https://github.com/SWE-bench/SWE-bench#:~:text=the%20evaluation_results%20directory.-,Warning,-SWE%2Dbench%20evaluation
Image
but,What is the minimum storage space required for the 731 use cases publicly disclosed by swe-bench pro on huggingface?
https://huggingface.co/datasets/ScaleAI/SWE-bench_Pro/viewer
Image
Furthermore, there are currently 1002 images hosted on the hub,
Image
which does not match the number publicly disclosed on huggingface. Does this include other sub-items?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions