Compare
gpt-6.1-sol
claude-sonnet-5-5
gemini-3.8-flash
Origin vs Sonnet 5.5 vs Gemini 3.8 Resolved + helpful (70/30)
Origin: 60.05%Sonnet 5.5: 66.85%Gemini 3.8: 54.55%
Variant AOrigin· gpt-6.1-sol
Cost / request
$0.007899
Avg latency
761 ms
Error rate
1.12%
Resolved + helpful (70/30)
60.05%
Variant BSonnet 5.5· claude-sonnet-5-5
Cost / request
$0.009830
Avg latency
954 ms
Error rate
0.68%
Resolved + helpful (70/30)
66.85%
Variant CGemini 3.8· gemini-3.8-flash
Cost / request
$0.005959
Avg latency
556 ms
Error rate
1.74%
Resolved + helpful (70/30)
54.55%
Per-run comparison
One agent or workflow runMetricOriginSonnet 5.5Gemini 3.8
Runs5,2512,1671,138
Requests / run2.62.14.0
Cost / run$0.020307$0.020503$0.023418
Node details
NodeOriginSonnet 5.5Gemini 3.8
support.reply$0.007899$0.009830$0.005959
Success-metric comparison
EventWeightOriginSonnet 5.5Gemini 3.8
Resolved70%62.00%68.80%56.50%
Helpful answer30%55.50%62.30%50.00%
CompositeΣ60.05%66.85%54.55%