Side-by-side scores for up to four models on one bundle version.
| Category | claude-opus-latest | deepseek-v4-pro-0813 |
|---|---|---|
| Coding | 10.0±0.3 panel low: 9.9median: 10.0panel high: 10.0 | 9.9±0.1 panel low: 9.8median: 9.9panel high: 9.9 |
2da3fcd5 · 19d ago
Best improvement: No material improvement is needed; the answer satisfies the requested contract and edge cases.
40ef719a · Aug 28, 2026
Best improvement: Minor: the DEL check could be simplified by tracking a plain frequency array alongside the Fenwick tree, avoiding two prefix queries per delete, though the current approach is already correct and asymptotically fine.
| Model | Runs | Incomplete | Success | Median / IQR | Cost / run | Latency | Score / $ |
|---|---|---|---|---|---|---|---|
| claude-opus-latest | 1 | 0 | 100% | 10.0(10.0–10.0) | $0.0548 | 31.7s | 182.4 pts/$ |
| deepseek-v4-pro-0813 | 1 | 0 | 100% | 9.9 |
$0.0253 |
1.3m |
390.5 pts/$ |