PipelineScore
← Back to leaderboard
Head-to-head

Llama 3.1 70B Instruct vs DeepSeek Coder V2 236B

DeepSeek Coder V2 236B wins+8.6 pts (+11%)on the balanced composite.
meta
Llama 3.1 70B Instruct
76.4MAINLINE
deepseek
Winner
DeepSeek Coder V2 236B
85.0MAINLINE

Category-by-category

Higher bar wins each row.

Llama 3.1 70B Instruct
Category
DeepSeek Coder V2 236B
-14.073.2
Code
87.2+14.0
-4.978.8
Reason
83.7+4.9
-7.477.4
Tool Use
84.8+7.4
-12.776.3
RAG
89.0+12.7
-12.176.5
Speed
88.7+12.1
Llama 3.1 70B Instruct
Provider
meta
Released
2024-07-23
Context
128K
Lab
Community
DeepSeek Coder V2 236B
Provider
deepseek
Released
2024-06-17
Context
163.84K
Lab
Community