Search results

EvalScope integration: one-command evaluation support for SWE-bench_Pro

Status: Open.

#114 In scaleapi/SWE-bench_Pro-os;

· Yunnglin opened on Jul 24, 2026

Reference compute/time requirements and SWE-bench Pro Verified status

Status: Open.

#113 In scaleapi/SWE-bench_Pro-os;

· EazyReal opened on Jul 15, 2026

Request for GPT-5.2-Codex SWE-agent Trajectories and Cost Metadata

Status: Open.

#110 In scaleapi/SWE-bench_Pro-os;

· Shuyang-Liu opened on Jun 18, 2026

Right of reply: an external determinacy audit of the SWE-bench Pro public set

Status: Open.

#108 In scaleapi/SWE-bench_Pro-os;

· kimjune01 opened on Jun 9, 2026

Any plan to upgrade to support mini-swe-agent v2.x?

Status: Open.

#105 In scaleapi/SWE-bench_Pro-os;

· fenghuahu opened on Jun 3, 2026

Golden patch failed

Status: Open.

#101 In scaleapi/SWE-bench_Pro-os;

· fenghuahu opened on May 26, 2026

mini-swe-agent support

Status: Open.

#100 In scaleapi/SWE-bench_Pro-os;

· fenghuahu opened on May 25, 2026

What is the minimum storage space required for the 731 use cases publicly disclosed by swe-bench pro on huggingface?

Status: Open.

#99 In scaleapi/SWE-bench_Pro-os;

· twilighgt opened on May 20, 2026

Questions on reproducing SWE-Bench-Pro Leaderboard results

Status: Open.

#97 In scaleapi/SWE-bench_Pro-os;

· LeoXinhaoLee opened on May 14, 2026

Question About SWE-Bench Pro Leaderboard Submission Criteria

Status: Open.

#95 In scaleapi/SWE-bench_Pro-os;

· haoran-ding opened on May 6, 2026

Git Reward Hacking in SWEBench Pro OSS

Status: Open.

#93 In scaleapi/SWE-bench_Pro-os;

· ConnorBAdams opened on Apr 29, 2026

Questions about dataset construction scripts

Status: Open.

#92 In scaleapi/SWE-bench_Pro-os;

· manyifire opened on Apr 28, 2026