Compare
gpt-6.1-sol
claude-sonnet-5-5
gemini-3.8-flash
Origin vs Sonnet 5.5 vs Gemini 3.8 Resolved + helpful (70/30)
Origin: 64.05%Sonnet 5.5: 70.85%Gemini 3.8: 58.55%
Variant AOrigin· gpt-6.1-sol
Cost / request
$0.006629
Avg latency
720 ms
Error rate
2.14%
Resolved + helpful (70/30)
64.05%
Variant BSonnet 5.5· claude-sonnet-5-5
Cost / request
$0.008783
Avg latency
925 ms
Error rate
1.52%
Resolved + helpful (70/30)
70.85%
Variant CGemini 3.8· gemini-3.8-flash
Cost / request
$0.010936
Avg latency
1.12 s
Error rate
1.08%
Resolved + helpful (70/30)
58.55%
Per-run comparison
One agent or workflow runMetricOriginSonnet 5.5Gemini 3.8
Runs1,564802993
Requests / run4.02.62.1
Cost / run$0.025953$0.022494$0.022709
Node details
NodeOriginSonnet 5.5Gemini 3.8
checkout.assist$0.006629$0.008783$0.010936
Success-metric comparison
EventWeightOriginSonnet 5.5Gemini 3.8
Resolved70%66.00%72.80%60.50%
Helpful answer30%59.50%66.30%54.00%
CompositeΣ64.05%70.85%58.55%