PipelineScore
← Back to leaderboard
Head-to-head

StarCoder2 3B vs DeepSeek Coder V2 236B

DeepSeek Coder V2 236B wins+37.7 pts (+80%)on the balanced composite.
bigcode
StarCoder2 3B
47.3TAP
deepseek
Winner
DeepSeek Coder V2 236B
85.0MAINLINE

Category-by-category

Higher bar wins each row.

StarCoder2 3B
Category
DeepSeek Coder V2 236B
-39.547.7
Code
87.2+39.5
-37.746.0
Reason
83.7+37.7
-35.249.6
Tool Use
84.8+35.2
-38.650.4
RAG
89.0+38.6
-45.043.7
Speed
88.7+45.0
StarCoder2 3B
Provider
bigcode
Released
2024-02-28
Context
16.384K
Lab
Community
DeepSeek Coder V2 236B
Provider
deepseek
Released
2024-06-17
Context
163.84K
Lab
Community