Skip to main content

​
List benchmarks

benchspan benchmarks list
Shows all benchmarks available to your account (public + any private benchmarks).

​
List instances

benchspan benchmarks instances <benchmark_name>
Shows all instances and named subsets for a benchmark. Useful for understanding what’s in a benchmark before running it. 
# See all SWEbench subsets
benchspan benchmarks instances swebench

# See agent-healthcheck subsets
benchspan benchmarks instances agent-healthcheck