Samples · swe_bench.swe_bench_lite
Run #46 · Adapter v1.0.0+patch-apply-detection · 50/50 Samples angezeigt
KI-Auswertung
Keine KI-Auswertung verfügbar.
Übersicht
50 SamplesVerteilung
Score-Histogramm
0.0 ────── 1.0
Latenz (ms)
p50: 26634
p95: 124753
mean: 57582
Tokens/s
p50: 50.8
mean: 57.3
Top-Fehlermuster
-
48×
no_result_for_issue -
2×
idle timeout reached for "http://100.64.0.4:4000/v1/chat/completions".
| Frage-ID | Status | Score | Prompt | Latenz | Tokens/s | TTFT | |
|---|---|---|---|---|---|---|---|
| astropy__astropy-12907 | error | — | 14133 ms | 71.3 | — | ||
|
Lade Detail …
|
|||||||
| astropy__astropy-14182 | error | — | 33737 ms | 71.4 | — | ||
|
Lade Detail …
|
|||||||
| astropy__astropy-14365 | error | — | 9346 ms | 69.7 | — | ||
|
Lade Detail …
|
|||||||
| astropy__astropy-14995 | error | — | 9326 ms | 65.6 | — | ||
|
Lade Detail …
|
|||||||
| astropy__astropy-6938 | error | — | 7961 ms | 70.7 | — | ||
|
Lade Detail …
|
|||||||
| astropy__astropy-7746 | error | — | 14359 ms | 70.9 | — | ||
|
Lade Detail …
|
|||||||
| django__django-10914 | error | — | 14732 ms | 69.6 | — | ||
|
Lade Detail …
|
|||||||
| django__django-10924 | error | — | 16737 ms | 69.4 | — | ||
|
Lade Detail …
|
|||||||
| django__django-11001 | error | — | 9633 ms | 69.6 | — | ||
|
Lade Detail …
|
|||||||
| django__django-11019 | error | — | 11688 ms | 62.5 | — | ||
|
Lade Detail …
|
|||||||
| django__django-11039 | error | — | 24339 ms | 71.8 | — | ||
|
Lade Detail …
|
|||||||
| django__django-11049 | error | — | 18174 ms | 71.7 | — | ||
|
Lade Detail …
|
|||||||
| django__django-11099 | error | — | 8613 ms | 70.9 | — | ||
|
Lade Detail …
|
|||||||
| django__django-11133 | error | — | 32867 ms | 71.7 | — | ||
|
Lade Detail …
|
|||||||
| django__django-11179 | error | — | 16048 ms | 71.4 | — | ||
|
Lade Detail …
|
|||||||
| django__django-11283 | error | — | 36350 ms | 69.8 | — | ||
|
Lade Detail …
|
|||||||
| django__django-11422 | error | — | 11047 ms | 70.3 | — | ||
|
Lade Detail …
|
|||||||
| django__django-11564 | error | — | 65760 ms | 69.6 | — | ||
|
Lade Detail …
|
|||||||
| django__django-11583 | error | — | 28587 ms | 69 | — | ||
|
Lade Detail …
|
|||||||
| django__django-11620 | error | — | 600003 ms | — | — | ||
|
Lade Detail …
|
|||||||
| django__django-11630 | error | — | 20610 ms | 47.9 | — | ||
|
Lade Detail …
|
|||||||
| django__django-11742 | error | — | 61372 ms | 49 | — | ||
|
Lade Detail …
|
|||||||
| django__django-11797 | error | — | 12422 ms | 47.7 | — | ||
|
Lade Detail …
|
|||||||
| django__django-11815 | error | — | 11854 ms | 52.3 | — | ||
|
Lade Detail …
|
|||||||
| django__django-11848 | error | — | 89872 ms | 50.9 | — | ||
|
Lade Detail …
|
|||||||
| django__django-11905 | error | — | 43517 ms | 47.9 | — | ||
|
Lade Detail …
|
|||||||
| django__django-11910 | error | — | 58195 ms | 50.7 | — | ||
|
Lade Detail …
|
|||||||
| django__django-11964 | error | — | 600001 ms | — | — | ||
|
Lade Detail …
|
|||||||
| django__django-11999 | error | — | 13303 ms | 46.4 | — | ||
|
Lade Detail …
|
|||||||
| django__django-12113 | error | — | 53357 ms | 48.5 | — | ||
|
Lade Detail …
|
|||||||
| django__django-12125 | error | — | 16553 ms | 47.5 | — | ||
|
Lade Detail …
|
|||||||
| django__django-12184 | error | — | 10014 ms | 47.6 | — | ||
|
Lade Detail …
|
|||||||
| django__django-12284 | error | — | 37514 ms | 48.4 | — | ||
|
Lade Detail …
|
|||||||
| django__django-12286 | error | — | 30629 ms | 48.8 | — | ||
|
Lade Detail …
|
|||||||
| django__django-12308 | error | — | 38953 ms | 51.7 | — | ||
|
Lade Detail …
|
|||||||
| django__django-12453 | error | — | 12879 ms | 50.4 | — | ||
|
Lade Detail …
|
|||||||
| django__django-12470 | error | — | 44009 ms | 51.6 | — | ||
|
Lade Detail …
|
|||||||
| django__django-12497 | error | — | 21904 ms | 50.8 | — | ||
|
Lade Detail …
|
|||||||
| django__django-12589 | error | — | 40705 ms | 50.6 | — | ||
|
Lade Detail …
|
|||||||
| django__django-12700 | error | — | 24566 ms | 49.1 | — | ||
|
Lade Detail …
|
|||||||
| django__django-12708 | error | — | 24681 ms | 49.2 | — | ||
|
Lade Detail …
|
|||||||
| django__django-12747 | error | — | 97638 ms | 50.3 | — | ||
|
Lade Detail …
|
|||||||
| django__django-12856 | error | — | 52461 ms | 47.9 | — | ||
|
Lade Detail …
|
|||||||
| django__django-12908 | error | — | 42190 ms | 47.9 | — | ||
|
Lade Detail …
|
|||||||
| django__django-12915 | error | — | 24170 ms | 50.1 | — | ||
|
Lade Detail …
|
|||||||
| django__django-12983 | error | — | 124649 ms | 50.4 | — | ||
|
Lade Detail …
|
|||||||
| django__django-13028 | error | — | 43392 ms | 46.6 | — | ||
|
Lade Detail …
|
|||||||
| django__django-13033 | error | — | 42776 ms | 46.2 | — | ||
|
Lade Detail …
|
|||||||
| django__django-13158 | error | — | 124838 ms | 48.9 | — | ||
|
Lade Detail …
|
|||||||
| django__django-13220 | error | — | 76616 ms | 46.5 | — | ||
|
Lade Detail …
|
|||||||