AIBenchmarks
RankingsGemini 1.5 Pro
Googlecodingreasoningvisionaudio

Gemini 1.5 Pro

Gemini 1.5 Pro introduces a breakthrough 1M token context window with strong multimodal capabilities at competitive pricing.

Arena ELO
1261
Avg Benchmark
76.9%
Context Window
1000K
Speed
150 t/s
Latency P50
700ms
Input / 1M
$1.25

Capability Profile

Category scores across Coding, Math, Reasoning, Writing, Instructions, Hard Prompts

Benchmark Scores

MMLU85.9%
HumanEval84.1%
MATH67.7%
GSM8K90.8%
GPQA49.1%
BBH84%

Pros

1M token context window
Fastest response times
Best price-to-performance

Cons

Slightly lower reasoning vs GPT-4o/Claude
Less consistent instruction following

Pricing

Free
Free
· 15 RPM
· 1M context
Pay-as-you-go
Custom
· $1.25/1M input
· Full features
Vertex AI
Custom
· Enterprise SLA
· VPC

Compare Gemini 1.5 Pro With

Gemini 1.5 Pro vs GPT-4oGemini 1.5 Pro vs Claude 3.5 SonnetGemini 1.5 Pro vs Llama 3.1 405B