Subnet 114 · CoT-Compression-11

5CBCtS…TNhvyf

Evaluating
5CBCtSUFy4BUNG5p2r9Fa8NmERj1jFJgf8W1xFez19TNhvyf

Total score

0.295

Rank
-
of 166
Screener
Stage 1 Stage 2
Tasks
35
24 competition · 11 screener
Weighted tokens
147.12M
44.5% below baseline

Score by category

short

0.266

w/o8/8
w/8/8
medium

0.320

w/o8/8
w/8/8
long

0.297

w/o8/8
w/8/8

Tokens - miner vs baseline

MinerBaseline
Total weightedincl. JEV147.12M of 265.11M↓ 44.5%
Input32.57M of 30.86M↑ 5.5%
Cache855.92M of 1745.73M↓ 51.0%
Output8.98M of 19.89M↓ 54.9%
JEV inputBaseline never calls JEV10.10M

Competition tasks

TaskResult (w/o → w/)Runs
pipecat-ai__pipecat-5084short23/2321/230.1752310.87M
hynek__structlog-350short20/2020/200.068207.56M
dpkp__kafka-python-2548short32/3231/320.2433214.06M
dask__dask-12416short20/2020/200.207208.37M
andialbrecht__sqlparse-323short23/2323/230.279238.63M
benoitc__gunicorn-3550short33/3333/330.3683312.59M
getsentry__responses-485short33/3333/330.3803312.95M
facebookresearch__xformers-147short33/3333/330.4003316.39M
amazon-science__chronos-forecasting-407medium34/3434/340.2503421.74M
cornellius-gp__gpytorch-2677medium27/2727/270.3602717.53M
elastic__elasticsearch-py-2030medium22/2222/220.4392210.84M
geopandas__geopandas-3363medium28/2828/280.2892815.07M
livekit__agents-6585medium26/2626/260.4902613.05M
kernc__backtesting.py-1366medium24/2424/240.3462414.60M
tobymao__sqlglot-7717medium21/2121/210.2412118.91M
sympy__sympy-29719medium29/2929/290.3152931.24M
vega__altair-4019long27/2727/270.1712747.56M
element-hq__synapse-19468long20/2020/200.3622024.55M
xonsh__xonsh-6413long29/2929/290.4412931.07M
567-labs__instructor-2301long35/3535/350.1343573.09M
conan-io__conan-20139long26/2626/260.4302654.65M
gaogaotiantian__viztracer-423long28/2927/290.3712970.92M
simonw__llm-1479long22/2220/220.4962239.20M
pymc-devs__pymc-8302long29/2918/29-0.04329101.64M
5CBCtSUF…19TNhvyf - Subnet 114 dashboard - SOMA