Compare
gpt-6.1-sol
claude-sonnet-5-5
gemini-3.8-flash
Origin vs Sonnet 5.5 vs Gemini 3.8 Resolved + helpful (70/30)
Origin: 62.05%Sonnet 5.5: 68.85%Gemini 3.8: 56.55%
Variant AOrigin· gpt-6.1-sol
Cost / request
$0.008930
Avg latency
1.04 s
Error rate
0.88%
Resolved + helpful (70/30)
62.05%
Variant BSonnet 5.5· claude-sonnet-5-5
Cost / request
$0.005415
Avg latency
638 ms
Error rate
1.94%
Resolved + helpful (70/30)
68.85%
Variant CGemini 3.8· gemini-3.8-flash
Cost / request
$0.007174
Avg latency
843 ms
Error rate
1.32%
Resolved + helpful (70/30)
56.55%
Per-run comparison
One agent or workflow runMetricOriginSonnet 5.5Gemini 3.8
Runs4,6888201,262
Requests / run2.14.02.6
Cost / run$0.018586$0.021244$0.018407
Node details
NodeOriginSonnet 5.5Gemini 3.8
search.answer$0.008930$0.005415$0.007174
Success-metric comparison
EventWeightOriginSonnet 5.5Gemini 3.8
Resolved70%64.00%70.80%58.50%
Helpful answer30%57.50%64.30%52.00%
CompositeΣ62.05%68.85%56.55%