Score by category
short
0.266
w/o8/8
w/8/8
medium
0.320
w/o8/8
w/8/8
long
0.297
w/o8/8
w/8/8
Tokens - miner vs baseline
MinerBaselineTotal weightedincl. JEV147.12M of 265.11M↓ 44.5%
Input32.57M of 30.86M↑ 5.5%
Cache855.92M of 1745.73M↓ 51.0%
Output8.98M of 19.89M↓ 54.9%
JEV inputBaseline never calls JEV10.10M
Competition tasks
| Task | Result (w/o → w/) | Runs | |||
|---|---|---|---|---|---|
| pipecat-ai__pipecat-5084short | 23/2321/23 | 0.175 | 23 | 10.87M | |
| hynek__structlog-350short | 20/2020/20 | 0.068 | 20 | 7.56M | |
| dpkp__kafka-python-2548short | 32/3231/32 | 0.243 | 32 | 14.06M | |
| dask__dask-12416short | 20/2020/20 | 0.207 | 20 | 8.37M | |
| andialbrecht__sqlparse-323short | 23/2323/23 | 0.279 | 23 | 8.63M | |
| benoitc__gunicorn-3550short | 33/3333/33 | 0.368 | 33 | 12.59M | |
| getsentry__responses-485short | 33/3333/33 | 0.380 | 33 | 12.95M | |
| facebookresearch__xformers-147short | 33/3333/33 | 0.400 | 33 | 16.39M | |
| amazon-science__chronos-forecasting-407medium | 34/3434/34 | 0.250 | 34 | 21.74M | |
| cornellius-gp__gpytorch-2677medium | 27/2727/27 | 0.360 | 27 | 17.53M | |
| elastic__elasticsearch-py-2030medium | 22/2222/22 | 0.439 | 22 | 10.84M | |
| geopandas__geopandas-3363medium | 28/2828/28 | 0.289 | 28 | 15.07M | |
| livekit__agents-6585medium | 26/2626/26 | 0.490 | 26 | 13.05M | |
| kernc__backtesting.py-1366medium | 24/2424/24 | 0.346 | 24 | 14.60M | |
| tobymao__sqlglot-7717medium | 21/2121/21 | 0.241 | 21 | 18.91M | |
| sympy__sympy-29719medium | 29/2929/29 | 0.315 | 29 | 31.24M | |
| vega__altair-4019long | 27/2727/27 | 0.171 | 27 | 47.56M | |
| element-hq__synapse-19468long | 20/2020/20 | 0.362 | 20 | 24.55M | |
| xonsh__xonsh-6413long | 29/2929/29 | 0.441 | 29 | 31.07M | |
| 567-labs__instructor-2301long | 35/3535/35 | 0.134 | 35 | 73.09M | |
| conan-io__conan-20139long | 26/2626/26 | 0.430 | 26 | 54.65M | |
| gaogaotiantian__viztracer-423long | 28/2927/29 | 0.371 | 29 | 70.92M | |
| simonw__llm-1479long | 22/2220/22 | 0.496 | 22 | 39.20M | |
| pymc-devs__pymc-8302long | 29/2918/29 | -0.043 | 29 | 101.64M |